Descripción de la oferta
Experteer Overview
As a Cloudera Data Engineer, you will design and operate high-performance data solutions within the Cloudera ecosystem, collaborating with platform architects, software engineers and DevOps to enable cloud-ready data infrastructure for SIX/BME. You drive performance-focused software development using Spark and Java/Scala, and shape data workflows integrated with Kafka streams. This role sits at the intersection of data engineering and platform operations, delivering scalable data capabilities for financial markets.
Compensaciones / Beneficios
• Design, plan and manage Spark-based applications on Cloudera clusters with Kafka streams integration
• Develop and maintain high-quality code with performance in mind using Spark/Java/Scala
• Analyze functional requirements and translate them into detailed technical specs
• Collaborate with platform architects, software engineers and DevOps to operate data solutions
• Work with Cloudera tools (Cloudera Manager, Ranger, Knox, Atlas, Hive) and data technologies (Kudu, HDFS, Impala, Spark)
• Ensure robust software delivery and CI/CD practices (Gitlab, Gitlab CI)
• Contribute to open-source inspired data workflows and best practices across the team
Responsabilidades
• Experience in Cloudera ecosystem (Cloudera Manager, Ranger, Knox, Atlas, Hive)
• Spark with streaming applications (Scala/Java)
• Kafka Streams integration
• Kudu and HDFS data design, Impala queries
• XML, JSON, Avro data formats
• Git (GitLab) usage
Requisitos principales
• Flexible work models
• Personal development and extensive learning offerings
• Agile working methods
