Utwórz profil, aby pracodawcy mogli Cię znaleźć, otrzymywać lepiej dopasowane oferty pracy i szybciej aplikować.
  • Wyszukiwanie ofert pracy
  • Zapisane
  • Stwórz CV
    Nowe
  • Wynagrodzenia
  • Subskrypcje

Senior Data Engineer (Databricks)

18480 - 25200 zł

Spyrosoft

About the role We are looking for a Senior Data Engineer with strong Databricks experience to build and optimize modern data platforms. You will develop scalable ETL/ELT pipelines, process large datasets and contribute to the evolution of cloud-native Data Engineering solutions. Responsibilities: Design, develop and maintain scalable ETL/ELT pipelines Build reliable batch and streaming data processing solutions Develop data pipelines using Databricks and Apache Spark Optimize Spark jobs and improve platform performance Work with Delta Lake and Medallion Architecture Build and maintain data models for analytics and reporting Ensure data quality, monitoring and observability Collaborate with Architects, Data Scientists and Analytics teams Participate in code reviews and technical improvements Contribute to CI/CD processes and engineering best practices Requirements: 5+ years of experience in Data Engineering 2+ years of commercial experience with Databricks Strong knowledge of PySpark and Spark SQL Excellent SQL skills Strong Python programming skills Experience building ETL/ELT pipelines Experience working with Delta Lake Good understanding of Medallion Architecture Experience with cloud environments (Azure, AWS or GCP) Experience with Git and CI/CD Understanding of data modelling principles Good communication skills Fluent English - C1 Nice to have: Unity Catalog experience dbt Kafka or Structured Streaming Airflow or Databricks Workflows Databricks certification Experience with performance tuning and cost optimization

Oferta pracy dodana 13 godziny temu