Senior Big Data Engineer

Senior Big Data Engineer role focused on designing and delivering data engineering solutions for healthcare applications. Responsibilities include building ETL pipelines processing millions of medical records, mentoring junior engineers, and ensuring platform reliability in production environments.

Responsibilities

• Design and build scalable ETL pipelines for processing large volumes of medical data
• Oversee and mentor junior and mid-level engineers with technical guidance
• Conduct peer code reviews and define technical standards
• Execute system analysis, development, deployment, and maintenance activities
• Create automated unit and integration tests; ensure quality and timely delivery

Requirements

• Bachelor's degree in IT, Software Engineering, Computer Science, Mathematics, or related field
• 6+ years experience with SQL, Python, or Scala
• 6+ years data engineering experience with Databricks platform
• Strong knowledge of Apache Spark, Delta, and Parquet formats
• Experience with ETL design, CI/CD tools (Jenkins/GitLab), and Azure Cloud Services
• Proficiency in data profiling, quality assessment, warehousing, and reporting
• Demonstrated leadership and mentoring capability for engineering teams