Middle Big Data Engineer (GCP, Python)

WE ARE

SoftServe is a global digital solutions company headquartered in Austin, Texas, founded in 1993. Our associates work on 2,000+ projects with clients across North America, EMEA, APAC, and LATAM. We are about people who create bold things, make a difference, have fun, and love their work.

Big Data & Analytics is the Center of Excellence's data consulting and data engineering branch. Hundreds of data engineers and architects nowadays build data & analytics end-to-end solutions from strategy through technical design and proof of concepts to full-scale implementation. We have customers in the healthcare, finance, manufacturing, retail, and energy domains.

We hold top-level partnership statuses with all the major cloud providers and collaborate with many technology partners like AWS, GCP, Microsoft, Databricks, Snowflake, Confluent, and others.

IF YOU ARE

• A Big Data engineer focused on designing and building scalable data pipelines
• Well-versed in batch and/or streaming data processing
• Proficient in SQL and Python
• Experienced in data engineering on Google Cloud Platform (GCP)
• Skilled in tools like Apache Spark (GCP Dataproc), Cloud Dataflow, or Apache Beam
• Familiar with Apache Airflow, Cloud Composer or AWS MWAA for orchestration
• Experienced with Google BigQuery and other GCP-native data services
• Familiar with tools like dbt or Dataform for data transformation
• Aware of AWS services such as S3, Redshift, RDS, EMR, or Athena (as part of the migration context)
• Confident in working with cloud-agnostic technologies such as PostgreSQL, MySQL, SQL Server, Kafka (Kafka Connect would be a plus), and PySpark
• Comfortable developing AWS Lambdas or Google Cloud Run Functions (formerly GCF)

AND YOU WANT TO

• Be part of a data-focused engineering team migrating large-scale systems from AWS to GCP
• Work with a modern technology stack, including BigQuery, Dataflow, Dataproc (Serverless), Cloud Run, and Composer
• Collaborate with experts on re-architecting and optimizing cloud-native data platforms
• Participate in the entire project lifecycle: from discovery and PoCs to MVPs and full production rollout
• Engage with customers ranging from global enterprises to innovative startups
• Continuously learn, share knowledge, and explore new cloud services
• Contribute to building a data platform that integrates batch, streaming, and real-time components
• Work in an environment that values technical ownership, code quality, and clean design

TOGETHER WE WILL

• Address different business and technology challenges, engage in impactful projects, use top-notch technologies, and drive multiple initiatives as a part of the Center of Excellence
• Support your technical and personal growth — we have a dedicated career plan for all roles in our company
• Investigate new technologies, build internal prototypes, and share knowledge with the SoftServe data community
• Upskill with full access to Udemy learning courses
• Pass professional certifications, encouraged and covered by the company
• Adopt best practices from experts while working in a team of top-notch engineers and architects
• Collaborate with world-leading companies and attend professional events