Utwórz profil, aby pracodawcy mogli Cię znaleźć, otrzymywać lepiej dopasowane oferty pracy i szybciej aplikować.
  • Wyszukiwanie ofert pracy
  • Zapisane
  • Stwórz CV
    Nowe
  • Wynagrodzenia
  • Subskrypcje

Senior Data Engineer (GenAI / LLM)

DCG

Responsibilities:

  • Design and implement LLM‑ and agent‑assisted workflows to improve developer productivity and reliability of data pipeline delivery
  • Build and enhance AI‑driven automation for engineering processes, including: pull request automation, quality gates and assistive development tooling
  • Implement AI‑supported schema review and governance gates within the canonical message lifecycle
  • Drive AI‑powered test automation, including automated E2E test generation and quality validation
  • Develop and maintain data packaging pipelines transforming source data into canonical message formats aligned with Data Packaging Framework and Availability Layer patterns
  • Build and manage SQL‑based data transformations and configuration‑driven pipelines
  • Support the canonical message lifecycle, including:schema validation, versioning, compatibility checks and publishing workflows
  • Contribute to framework releases, operational stability, and documentation
  • Maintain and update Architecture Decision Records (ADRs)

Requirements:

  • Hands-on experience building LLM-powered automation for engineering workflows (e.g., review gates, quality checks, assistant tooling for dev/test/docs)
  • Experience with AI-assisted review/approval flows and integrating AI steps into CI/CD-style pipelines
  • Experience with AI-assisted test generation / test automation concepts
  • Strong engineering discipline around quality and safety for AI outputs (evaluation mindset, reproducibility, traceability)
  • Strong experience in data engineering and distributed processing; practical delivery mindset
  • Hands-on experience with Kafka and SQL-based transformations
  • Experience with batch/stream processing frameworks (e.g., Flink or Spark)
  • Familiarity with schema formats and lifecycle (e.g., JSON/Avro/XSD) and versioning/compatibility concepts
  • Experience working with Git workflows and Kubernetes environments
  • CI/CD and build pipeline experience (Bazel + Tekton)

Nice to have:

  • Experience with Data Reference Architecture / data product model
  • Knowledge of Airflow, Snowflake, Iceberg, or similar data platforms
  • Exposure to data governance, metadata, and lineage concepts
  • Experience in banking or other regulated environments

Offer:

  • Private medical care
  • Co-financing for the sports card
  • Constant support of dedicated consultant
  • Employee referral program
Oferta pracy dodana 21 dni temu