Senior Data Engineer

DCG

Responsibilities:

Design, build, and maintain scalable data pipelines ingesting data from internal banking systems, and external data providers
Develop and optimize data models for corporate lending domains, potentially involving loan origination, credit exposure, deal flow, and repayment history
Implement data quality checks, validation rules, and data lineage to ensure reliable and transparent data
Manage and evolve the data warehouse and data lake to support analytics, reporting, and machine learning use cases
Ensure data processing and storage comply with regulatory, security, and data governance requirements
Work closely with product managers, engineers, and lending domain experts in an agile team
Translate data insights and model outputs into clear, actionable recommendations for SMEs and business stakeholders
Document data pipelines, models, and key design decisions to support auditability and knowledge sharing

Requirements:

Expert-level proficiency in Python, PySpark, and SQL
Expert-level experience in ETL/ELT pipeline development, including designing, building, and maintaining scalable ingestion and processing pipelines
Strong, expert-level experience with cloud data warehouse / data lake environments
Expert knowledge of AWS, including practical experience with SageMaker and EventBridge in data/ML workflows
Expert-level skills in data modeling, including corporate lending data domains
Proven expertise in data quality and data lineage
Proven, hands-on experience in ML model development and deployment
Very good command of English, both spoken and written

Nice to have:

Strong domain expertise in corporate lending or financial services
In‑depth understanding of credit decision processes
Hands‑on experience with LLM / Generative AI integration in data or analytics platforms
Practical experience implementing agentic AI solutions
Strong understanding of model explainability and interpretability concepts

Offer:

Oferta pracy dodana 2 miesięcy temu

Powiązane wyszukiwania