Droisys•11h ago
Career Pages
GCP Data Engineer
United States
Remote
Mid Level
$60-$65/hr
Full Job Description
Overview
We are seeking an experienced GCP Data Engineer to build, maintain, and support robust cloud data pipelines on the Google Cloud Platform. This role focuses heavily on production reliability, rigorous data validation, deep root-cause analysis, and seamless collaboration with diverse stakeholders including both onshore and offshore teams.
Key Responsibilities
- GCP Pipeline Management: Hands-on experience required in building, maintaining, and supporting scalable batch and streaming data pipelines specifically using BigQuery and Google Cloud Storage (GCS).
- Airflow Expertise: Proven ability to author, schedule, troubleshoot, and optimize complex Airflow DAGs within a managed Cloud Composer environment. This includes managing custom operators, task dependencies, retries, backfills, log diagnostics, and runtime/SLA tuning.
- Dataflow & Beam Development: Hands-on experience building, maintaining, and debugging Apache Beam pipelines written in Java on Google Cloud Dataflow, including job monitoring and performance troubleshooting.
- ELT Transformations: Practical experience developing and debugging SQLX ELT transformations, data quality assertions, and dependency graphs using Dataform.
- BigQuery Proficiency: Deep SQL skills in BigQuery are essential, covering partitioned and clustered tables, query performance tuning, slot and cost optimization, and querying operational metadata and telemetry tables.
- Python Automation: Strong Python 3 skills for writing and debugging production-grade Airflow tasks, API integrations, and automation scripts.
- Production Reliability: Demonstrated ability to own production reliability by monitoring daily DAG and task runs, performing deep root-cause analysis (RCA) on failures or data discrepancies, building automated data validation and reconciliation checks, and deploying permanent fixes within SLA.
- Data Modeling & Communication: Solid grasp of dimensional modelling and modern ELT patterns for high-volume datasets (e.g., e-commerce or consumer-audience data), paired with clear communication skills for daily onshore/offshore handoffs and stakeholder alignment.
Company
Droisys
Droisys is a leading innovative technology company specializing in gamification, Artificial Intelligence solutions, and advanced app development.
United States
Posted on Career Pages
Practice this interview
A voice mock interview for GCP Data Engineer at Droisys, with questions from this job description and your resume, and a scored report afterwards.
Set up interview