Odbieraj najlepsze oferty pracy na swój adres mailowy
- ..., Build and optimize ETL/ELT pipelines for batch and streaming data processing, Implement and maintain medallion architecture using Delta Tables, Integrate data from multiple sources, including SFTP files, Delta Tables, and Azure Event Hub, Work with Azure services such...ZasugerowanePraca zdalna
Sii Sp. z o.o.
Katowice14 dni temu - ...spoken and written Ideally, you’ll also have Knowledge of data formats such as Parquet, ORC and Avro, and table formats such as Delta Lake, Apache Hudi or Apache Iceberg Experience with AI agents, such as building agentic workflows or using large language models...ZasugerowanePełny etatPraca zdalna
- ...PySpark. Develop data products using modern Databricks capabilities such as Unity Catalog, Apache Spark™ Declarative Pipelines and Delta Lake. Create and improve data models that support reporting, self-service analytics and data science projects. Monitor...ZasugerowanePełny etatPraca hybrydowaPraca zdalnaPraca za granicąElastyczne godziny
14000 - 18000 zł
...learning and exploring new technologies and methodologies. Nice to have Experience with Databricks or another lakehouse platform (Delta Lake, Unity Catalog). Experience with Snowflake (our current analytical platform during the migration period). Front-end...ZasugerowanePraca zdalnaPełny etat15120 - 21000 zł
...Spark/PySpark, for simplified data access and governance. Secure integration solutions and enhanced data quality monitoring, utilizing Delta Live Table tests, established trust in the platform. The intermediate result is a user-friendly, secure, and data-driven platform,...ZasugerowanePraca zdalnaPełny etatElastyczne godziny- ...Responsibilities Operate and optimize Glue ETL pipelines, including initial loads and daily delta processing, and maintain Glue Catalog metadata, schemas, and Parquet structures. Ensure accurate delta detection using updated_at logic and manage efficient write...ZasugerowanePełny etat
- ...methodologies ~ Identify new industries and applications for Trusted Content and prioritize based on current library coverage, development delta to meet gaps, and effort to develop, deploy, and support ~ Work with key members of the Trusted Content team to Pilot, Develop,...Zasugerowane
13000 - 22000 zł
...engineering solutions on Databricks and Apache Spark , using Python, PySpark, Scala, and SQL as appropriate. Implement and maintain Delta Lake pipelines and modern Databricks capabilities, including Unity Catalog, Databricks Workflows, and Structured Streaming....ZasugerowanePełny etat- ...live phases. Project Technology: Azure MS Fabric Fabric Dataflows Gen2 Data Factory pipelines Notebooks (PySpark) Delta Lake OneLake Fabric Real-Time Intelligence Event Hub Profile General Project Experience: ~ Certification in the...ZasugerowanePełny etatPraca hybrydowaHome office
