Senior GCP Data Engineer - BigQuery & Data Pipeline Development

Senior GCP Data Engineer – BigQuery & Data Pipeline Development

Miejsce pracy: Kraków

Technologies we use

Expected

• SQL
• BigQuery
• Google Cloud Platform
• Python
• Terraform
• Git
• Jenkins
• Ansible

Optional

• SoapUI

Operating system

• Linux

About the project

As a Senior GCP Data Engineer – BigQuery & Data Pipeline Development, you will be working for our client, a leading financial services organization, on a transformative data integration initiative. Your expertise will support the global MSS Operations team, enhancing data processing and analytics capabilities across multiple sources and enabling data-driven decision-making at scale. This role offers a platform for innovation and professional growth in the rapidly evolving cloud data landscape.

Unleash the Power of Data – Transform Business Insights with Cutting-Edge Cloud Engineering!

Krakow-based opportunity with hybrid work model.

Only candidates with an existing legal right to work in the European Union will be considered for this role.

This is how we organize our work

This is how we work

• at the client's site
• agile

Your responsibilities

• Design, build, test, and deploy GCP data models and transformations in BigQuery (including stored procedures, indexes, clusters, partitions, triggers).
• Create and manage ETL/ELT data pipelines transforming raw or unstructured data into a Data Vault model.
• Review, interpret, and implement business and technical requirements, ensuring compliance with IT and security standards.
• Monitor data pipelines for failures or performance issues, implementing solutions for scalability and robustness.
• Optimize ETL/ELT processes to handle large data volumes efficiently.
• Integrate data from various sources, maintaining consistency and accuracy.
• Manage code artifacts and CI/CD pipelines using Git, Jenkins, Terraform, with a focus on GCP cloud applications.
• Collaborate within an Agile environment, applying DataOps best practices to deliver high-quality solutions.

Our requirements

• At least 3 years of hands-on experience with SQL querying and optimization in BigQuery.
• Proven expertise in SQL Data Transformation, ETL/ELT pipeline development in GCP DataFusion or similar tools.
• Strong experience with Data Vault modeling principles.
• Skilled in Cloud Composer/Airflow, Cloud Run, Pub/Sub, Python, and Terraform.
• Proficiency with version control (Git) and CI/CD processes, including tools like Jenkins or Ansible.
• Experience working in a DataOps environment and Agile methodologies.
• Excellent problem-solving, organizational, and multi-tasking skills.

Optional

• Experience designing data ingestion pipelines with GCP Data Fusion, CDAP, or comparable tools (handling CSV, JSON, XML, RESTful & SOAP APIs, SFTP).
• Knowledge of Java development for custom Data Fusion plugins.
• Familiarity with continuous testing and deployment tools for cloud data solutions.

What we offer

• Stable and long-term cooperation with very good conditions
• Enhance your skills and develop your expertise in the financial industry
• Work on the most strategic projects available in the market
• Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years
• Participate in Social Events, training, and work in an international environment
• Access to attractive Medical Package
• Access to Multisport Program
• Access to Pluralsight
• Flexible hours

This is how we work on a project

• Continuous Deployment
• Continuous Integration

Benefits

• sharing the costs of sports activities
• private medical care
• flexible working time
• fruits
• integration events
• corporate gym
• saving & investment scheme
• no dress code
• coffee / tea
• drinks
• christmas gifts
• birthday celebration
• sharing the costs of a streaming platform subscription
• access to +100 projects
• access to Pluralsight

Recruitment stages

• online interview
• online interview

#GETREADY to meet with us!

ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in the financial industry in Europe. We offer an environment for professional, ambitious, and driven people.

We would like to meet you. If you are interested please apply and attach your CV in English or Polish, including a statement that you agree to our processing and storing of your personal data.

ITDS’s Whistleblower Procedure

You can report violations in accordance with ITDS’s Whistleblower Procedure available here:

ITDS Polska Sp. z o.o.

ITDS supports financial service providers to take the next steps.

We identify what’s possible, every day. Opportunities in the areas of technology, organization, and digitization.

We see where banks, insurers, payment companies, or fintech can go and how they can get there.

That’s why we want to stimulate you to ramp up your ambition. Forget what you perceive as restraints and step towards the new reality.

ITDS in Poland - Pure player in new Technologies & Financial Industry

+300 IT implementation professionals

+20 clients in the Banking, Insurance, Payment & Fintech Industry

ITDS excels in digital strategy delivery and implementation of best-of-breed lending solutions. ITDS has delivered successful strategic projects throughout Europe since 1998. We combine the experience we’ve accumulated with in-depth knowledge of technologies, business processes, and EU legislation to unlock new business opportunities.

Informujemy, że administratorem danych jest ITDS z siedzibą w Warszawie, ul. Złota 59 (dalej jako "administrator"). Masz prawo do żądania dostępu do swoich danych osobowych, ich sprostowania, usunięcia lub ograniczenia przetwarzania, prawo do wniesienia sprzeciwu wobec przetwarzania, a także prawo do przenoszenia danych oraz wniesienia skargi do organu nadzorczego. Dane osobowe przetwarzane będą w celu realizacji procesu rekrutacji. Podanie danych w zakresie wynikającym z ustawy z dnia 26 czerwca 1974 r. Kodeks pracy jest obowiązkowe. W pozostałym zakresie podanie danych jest dobrowolne. Odmowa podania danych obowiązkowych może skutkować brakiem możliwości przeprowadzenia procesu rekrutacji. Administrator przetwarza dane obowiązkowe na podstawie ciążącego na nim obowiązku prawnego, zaś w zakresie danych dodatkowych podstawą przetwarzania jest zgoda. Dane osobowe będą przetwarzane do czasu zakończenia postępowania rekrutacyjnego i przez okres możliwości dochodzenia ewentualnych roszczeń, a w przypadku wyrażenia zgody na udział w przyszłych postępowaniach rekrutacyjnych - do czasu wycofania tej zgody. Zgoda na przetwarzanie danych osobowych może zostać wycofana w dowolnym momencie. Odbiorcą danych jest serwis Hello HR oraz inne podmioty, którym powierzyliśmy przetwarzanie danych w związku z rekrutacją.
Naruszenia można zgłaszać zgodnie z Procedurą zgłaszania nieprawidłowości ITDS dostępną tutaj: