Senior Data Engineer GCP

Job description

We are looking for a Senior GCP Data Engineer

Mission Design, implement, and optimize end-to-end data solutions on Google Cloud Platform that drive our analytics and decision-making capabilities.

Key Responsibilities

CI/CD Pipeline Optimization:

Architect and refine continuous integration/continuous deployment pipelines using Cloud Build for automated, secure, and efficient releases.

ETL Pipeline Development:

Build and tune ETL pipelines in BigQuery, ensuring high-performance ingestion from SDDS and robust transformation logic.

Batch Ingestion Management:

Enhance scheduled queries, delta loads, and performance-tuned batch processes in BigQuery.

Troubleshooting & Incident Response:

Establish advanced monitoring, logging, and alerting strategies to quickly diagnose and resolve failed refresh jobs.

Event-Driven Processing:

Design scalable, event-driven architectures leveraging EventArc, Pub/Sub, Workflows, and GCS ingestion.

Documentation & Knowledge Sharing:

Maintain comprehensive Confluence pages with deployment guides, runbooks, and best-practice standards.

Profile Requirements

Experience:

Proven track record as a Data Engineer on Google Cloud Platform.

Core GCP Services:

Expert-level proficiency with BigQuery, Cloud Storage, Pub/Sub, Workflows, and EventArc.

Languages & IaC:

Advanced SQL, Python, and Terraform skills for infrastructure and data workflows.

CI/CD:

Hands-on experience with Cloud Build and GitHub Actions/GitHub workflows.

ETL & Orchestration:

Strong background in designing, orchestrating, and optimizing ETL pipelines.

Architecture:

Deep understanding of event-driven and real-time data processing patterns.

Performance Tuning:

Demonstrated ability to troubleshoot and optimize BigQuery workloads.

Documentation:

Strong writing skills in Confluence and other collaboration platforms.

Communication:

Ability to translate complex technical concepts to both technical and non-technical stakeholders.

At Amaris Consulting, we champion diversity as a catalyst for innovation. All qualified candidates are welcome, regardless of background, identity, or beliefs.

endif]--> endif]--> Who are we?

Amaris Consulting

is an independent technology consulting firm providing guidance and solutions to businesses. With more than 1,000 clients across the globe, we have been rolling out solutions in major projects for over a decade – this is made possible by an international team of 7,600 people spread across 5 continents and more than 60 countries. Our solutions focus on four different Business Lines: Information System & Digital, Telecom, Life Sciences and Engineering. We’re focused on building and nurturing a top talent community where all our team members can achieve their full potential. Amaris is your steppingstone to cross rivers of change, meet challenges and achieve all your projects with success.

At Amaris, we strive to provide our candidates with the best possible recruitment experience. We like to get to know our candidates, challenge them, and be able to give them proper feedback as quickly as possible. Here's what our recruitment process looks like:

Brief Call : Our process typically begins with a brief virtual/phone conversation to get to know you! The objective? Learn about you, understand your motivations, and make sure we have the right job for you!

Interviews

(the average number of interviews is 3 - the number may vary depending on the level of seniority required for the position). During the interviews, you will meet people from our team: your line manager of course, but also other people related to your future role. We will talk in depth about you, your experience, and skills, but also about the position and what will be expected of you. Of course, you will also get to know Amaris: our culture, our roots, our teams, and your career opportunities!

Case study : Depending on the position, we may ask you to take a test. This could be a role play, a technical assessment, a problem-solving scenario, etc.

As you know, every person is different and so is every role in a company.

That is why we have to adapt accordingly, and the process may differ slightly at times. However, please know that we always put ourselves in the candidate's shoes to ensure they have the best possible experience. We look forward to meeting you! endif]-->