Senior Data Engineer (ETL / Big Data)
DCG
Responsibilities:
- Design, develop, and maintain ETL processes supporting Market Abuse Surveillance and Compliance solutions
- Build and test data transformation workflows using DataStage and Python
- Develop and maintain data integration solutions that collect information from multiple sources, including Kafka, XML files, and database links
- Transform and prepare data in accordance with required output file structures and business requirements
- Deliver daily data feeds for a third-party SaaS platform used for market abuse surveillance
- Analyze, validate, and reconcile data to ensure accuracy, completeness, and regulatory compliance
- Collaborate with Compliance, Surveillance, and IT teams to support implementation and enhancement of monitoring processes
- Perform ETL testing, troubleshooting, and defect resolution across data integration workflows
- Participate in Agile ceremonies and project delivery activities using Jira
- Support onboarding of new data sources and implementation of additional reporting and surveillance requirements
- Contribute to continuous improvement of ETL processes, automation, and data quality controls
- Provide production support for data processing and integration-related issues
Requirements:
- Hands-on experience with DataStage and Python for data transformation and ETL development
- Strong experience working with Oracle SQL
- Experience integrating and processing data from Kafka, XML, and other structured data sources
- Experience working in Agile environments and using Jira for work management
- Strong IT background with knowledge of data integration, ETL processes, Python, DataStage, Kubernetes, and full-stack environments
- Strong analytical and problem-solving skills
- Ability to work effectively in a collaborative, cross-functional environment
- Fluent English, both written and spoken
Nice to have:
- Experience working in financial institutions, preferably within trading environments
- Knowledge of risk and compliance processes
- Experience with Actimize solutions and implementations
- Familiarity with market surveillance, compliance monitoring, or regulatory reporting solutions
Offer:
- Private medical care
- Co-financing for the sports card
- Constant support of dedicated consultant
- Employee referral program
Oferta pracy dodana 2 dni temu
Powiązane wyszukiwania
- senior data engineer Gdańsk
- data protection engineer Gdańsk
- junior big data developer Gdańsk
- junior data engineer Gdańsk
- data platform engineer Gdańsk
- lead data engineer Gdańsk
- big data engineer (scala) Gdańsk
- big data engineer Gdańsk
- senior big data developer Gdańsk
- javascript data integration developer Gdańsk