Spark / Data Lakehouse Developer

Expected, Spark, Apache Spark, MongoDB, Apache Iceberg or Hud, Python, Scala, AWS, Microsoft Azure, Google Cloud Platform

Optional, Kafka

About the project, We are looking for an experienced Spark / Data Lakehouse Developer to join our Data Platform team. In this role, you will design, develop, and implement data reconciliation solutions within the Operational Data Store (ODS) layer, based on MongoDB, ensuring data consistency and synchronization with multiple source systems., , Additionally, you will be responsible for building and maintaining data layers in a modern Data Lakehouse architecture (Delta Lake / Apache Iceberg / Hudi) — from raw data storage up to curated and presentation zones (silver, gold)., , Sounds like your kind of challenge?

This is how we work, at the client's site, agile

Your responsibilities, Design and implement data reconciliation mechanisms within the Operational Data Store (ODS) layer., Develop integration and synchronization logic between ODS and source systems based on MongoDB., Build, optimize and maintain data pipelines with Spark and distributed processing frameworks., Design and develop data layers in Lakehouse architecture (from Raw through Curated to Gold zones)., Implement and maintain solutions using Delta Lake, Apache Iceberg or Apache Hudi., Ensure data quality, reliability, and monitoring across pipelines and storage layers., Collaborate closely with data engineers, analysts, and architects to deliver end to end data solutions., Participate in continuous improvement of the data platform architecture and engineering standards., Note: Detailed project information will be shared during the recruitment process.

Proven experience as a Data Engineer / Spark Developer in big data or cloud ecosystems., Strong knowledge of Apache Spark, especially in data processing and ETL pipeline development., Hands on experience with MongoDB and ODS type data store architectures., Practical experience in Data Lakehouse technologies such as Delta Lake, Apache Iceberg or Hudi., Proficiency in Python and/or Scala, including data manipulation and pipeline scripting., Solid understanding of data modeling, data reconciliation, and data governance concepts., Experience working with distributed data environments and cloud platforms (Azure, AWS, or GCP)., Familiarity with CI/CD processes and version control (Git).

Optional, Experience with streaming frameworks (e.g. Kafka, Structured Streaming)., Knowledge of data quality frameworks and testing solutions (Great Expectations, dbt tests)., Understanding of metadata management and Data Catalog tools., Familiarity with data security, access control, and audit mechanisms.

What we offer, Flexible cooperation model, Hybrid work setup – remote days available depending on the client’s arrangements - Warszawa lub Wrocław, Collaborative team culture – work alongside experienced professionals eager to share knowledge, Continuous development – access to training platforms and growth opportunities, Comprehensive benefits – including Interpolska Health Care, Multisport card, Warta Insurance, and more, High quality equipment – laptop and essential software provided

Benefits, sharing the costs of sports activities, private medical care, sharing the costs of professional training & courses, life insurance

Joining this project you’ll become part of Mindbox – a tech-driven company where consulting, engineering, and talent meet to build meaningful digital solutions. We’ll back you up every step of the way, accelerate your development, and ensure your skills make a difference.

Mindbox Sp. z o.o., At Mindbox, we connect top IT talents with technology projects for leading enterprises across Europe., Our focus is on matching your skills with work that matters – projects that use modern tech stacks, solve real business challenges, and give you space to grow. By joining us, you’ll deliver technology solutions for well-known brands, supported by the Mindbox team that values knowledge-sharing and continuous development. We make sure you have the tools, flexibility, and guidance to do your best work – and to keep moving forward in your career.