Middle Big Data Engineer
We are seeking a Middle Big Data Engineer to join our client's team, focusing on the design, development, and maintenance of data pipelines and anomaly detection models for large volumes of trading and trade-related data. The role is integral to ensuring the quality and reliability of enterprise-level solutions through the implementation of cutting-edge technologies.
Key Responsibilities:
- Design, develop, and maintain data pipelines and models for anomaly detection
- Provide technical guidance, ensuring the best technologies are applied to meet various business needs
- Advocate for and drive the adoption of advanced technologies within the engineering teams
- Focus on software quality by maximizing performance and reliability through process improvement
- Develop an understanding of evolving regulatory frameworks to mitigate regulatory and reputational risks
- Lead efforts to standardize best practices in coding, testing, scalability, stability, code reviews, and operational readiness
- Collaborate with both local and global teams to foster technical discussions, make decisions on architectural standards, and address potential blockers early
- Handle challenges such as negotiating data contracts and monitoring data quality metrics
Technical Requirements:
- Bachelor’s/Master’s degree in Computer Science, Engineering, or a related field, or an MBA
- Middle 3+ years of experience in software development or a similar role
- Fluent in English with strong communication skills for both meetings and written documentation
- Proven expertise in designing and developing end-to-end enterprise solutions, including automated testing and adhering to the Software Development Life Cycle (SDLC)
Required Technical Skills:
- Proficiency in Java or other object-oriented programming languages
- Expertise with big data tools and frameworks, such as:
- Spark
- Hadoop
- HBase (BigTable)
- Kafka
- Kubernetes
- Flink
- MapReduce
- ElasticSearch
- Presto
- Protobuf
- Strong database and data manipulation skills, particularly using SQL
- Hands-on experience with tools like Zeppelin and Jupyter for data analysis
Work Arrangement:
- Hybrid model from Bucharest, Romania – required to work in the office 2 days per week