Descripción de la oferta
Job OverviewWe are looking for a Data Engineer to contribute in a project with one of our integral customers. You will collaborate with cross‑functional teams to deliver scalable data pipelines, data warehouses, and data marts, ensuring data quality, security, and regulatory compliance.RequirementsStrong understanding of when to use a wide range of tools, rather than limited hands‑on experience with a narrow set of technologies. Engineers must know when to apply different tools and technologies—and when not to.Experience with Spark / Scala, Python, SQL.Experience with AWS services: S3, Glue, Athena, EMR, EC2, and Lambda. Ability to design ETL processes and data modeling.Ability to learn and develop end‑to‑end (E2E) knowledge of processes, enabling sound decision‑making.Analytical thinking, with the ability to anticipate edge cases and future scalability challenges.Strong problem‑solving skills.High attention to detail.Nice to HaveFamiliarity with CI/CD tools (e.g., GitHub Actions).Experience with Apache Iceberg or similar table formats.Knowledge of data quality frameworks (e.g., Great Expectations, Deequ).Knowledge of Bash and HCL is a plus.
#J-18808-Ljbffr
