Senior Data Engineer / Spark Developer

Expected, Apache Spark, Databricks, Azure Synapse, Microsoft Fabric, Python

Operating system, Windows

About the project, An established accounting firm seeks a senior-level data engineering professional to design, develop and maintain scalable Apache Spark applications. The person in this role will define and enforce coding standards, conduct code reviews, optimise data processing workflows, and liaise regularly with the client and cross-functional teams. Remote working is available.

Your responsibilities, Establish, document and enforce best practices and coding standards across the project., Conduct thorough code reviews to ensure high code quality and compliance with established guidelines., Design, develop and maintain robust, scalable Spark applications for large-scale data processing., Write clean, maintainable and efficient code following accepted engineering practices., Optimise code and data pipelines for performance and scalability, ensuring efficient handling of columnar formats., Develop and maintain Delta Table and Parquet-based data workflows where applicable., Collaborate with cross-functional teams to deliver reliable software solutions and integrate with microservices architectures., Identify, diagnose and resolve technical issues to maintain application reliability and performance., Create and maintain comprehensive technical documentation for code, processes and operational workflows., Manage day-to-day operational flow and communicate clearly with team members and stakeholders., Maintain regular communication with the client to align requirements, progress and deliverables.

Minimum 7 years of hands-on experience in software development, with a strong focus on data engineering., Extensive experience with Apache Spark and working knowledge of Databricks and/or Azure Synapse/Fabric., Proficiency in Python, including strong data-manipulation skills using Pandas and/or Polars., Practical experience with columnar data storage formats, especially Parquet, and working with Delta Tables., Proven expertise in data processing, analysis and transformation workflows at scale., Solid understanding of microservices architecture and experience implementing scalable solutions., Strong analytical and problem-solving skills with a detail-oriented approach., Excellent organisational skills and the ability to self-manage, prioritise tasks and meet tight deadlines., Effective communication skills for collaboration with internal teams and external clients.

This is how we work on a project, documentation, issue tracking tools, testing environments

What we offer, Unique TEAL culture: relationship- and respect-driven community in a non-corporate atmosphere., Agile working model with minimal bureaucracy., Company integration trips to various locations in Europe for all employees., Activities supporting employee well-being and health., Luxmed Gold Extended medical care and Multisport Plus benefit.

Benefits, sharing the costs of sports activities, private medical care, sharing the costs of professional training & courses, remote work opportunities, flexible working time, integration events

YOUR ITEAMS sp. z o.o., Our business philosophy had been clarifying for a good few years, during which we gained experience in large and influential corporations. Based on well-established knowledge and best practices, we decided to build a Teal organisation in which we can fully:, , •realize our mutual passion for IT,, •professionally support our clients in this area,, •use the best standards born from our experience,, •have fun creating a harmonious community,, •stay true to our values and treat every person with respect,, •say goodbye to hierarchical treatment and lack of empowerment,, •have a smile on our lips when we think about the next Monday,

This is how we work,