Data Engineer (AWS, dbt, Redshift)
18480 - 21840 złCyclad
In Cyclad we work with top international IT companies in order to boost their potential in delivering outstanding, cutting-edge technologies that shape the world of the future. We are seeking an experienced Data Engineer to design, build, and maintain scalable ELT pipelines and enterprise data warehouse solutions within a cloud-based analytics environment. This role requires expertise in data warehousing, Amazon Redshift, Amazon S3, dbt, Apache Airflow, and dimensional modeling principles. Project information: Type of project: IT Services Office location: Poland Work model: Remote from Poland Budget: 110 - 130 PLN net/ h - b2b Project length: till the end of 2027, possible to extend it Only candidates with citizenship in the European Union and residence in Poland Start date: ASAP Project scope: Develop and maintain ELT pipelines from source systems (Cloudera/MinIO) to Amazon S3 and Amazon Redshift Build and maintain data warehouse layers, including Staging, Intermediate, Business View, and Dimensional Models Implement fact tables (Transactional, Accumulating Snapshot, and Periodic Snapshot) and Type 1 & Type 2 Slowly Changing Dimensions based on established data models Develop data transformations using dbt and orchestrate workflows using Apache Airflow Write, optimize, and troubleshoot SQL queries, including inner, self, and outer joins Work with Amazon Redshift for data loading, transformation, and performance optimization Manage and process data stored in Amazon S3 and Apache Iceberg tables on the MinIO platform Support the migration of data pipelines from Cloudera to the MinIO platform Collaborate with architects, data modelers, and business teams to deliver reliable and high-quality data solutions Competence demands: Strong hands-on experience with Amazon S3, Amazon Redshift, dbt and Apache Airflow Advanced SQL (Inner, Self, Left, Right, and Full Outer Joins) Strong understanding of Data Warehousing concepts, Fact and Dimension implementation, Slowly Changing Dimensions (Type 1 & Type 2), ETL architecture best practices Working knowledge of Kimball Dimensional Modeling Experience with Cloudera, MinIO, and Apache Iceberg ELT/Data Pipeline Development Very good English skills We offer: Remote working model Dynamic and innovation-driven engineering environment Full-time job agreement based on b2b Private medical care with dental care (covering 70% of costs) Multisport card (also for an accompanying person) Life insurance
- data mining Warszawa
- aws solutions architect Warszawa
- python developer python, flask, aws Warszawa
- engineer team Warszawa
- middleware engineer Warszawa
- hardware in the loop engineer Warszawa
- inżynieria genetyczna Warszawa
- firmware engineer Warszawa
- inżynieria optyczna Warszawa
- senior solutions engineer Warszawa