Data Engineer

Join Tesco as a Data Engineer in Bangalore to develop and optimize robust ETL/ELT pipelines using Python, DBT, and a suite of AWS services. You will be instrumental in building and managing S3-based data lakes with modern data formats like Parquet, ORC, and Iceberg, and delivering end-to-end data solutions leveraging AWS Glue, EMR, Lambda, Redshift, and Athena. Our ideal candidate will implement strong data governance and security measures through AWS Glue Data Catalogue, Lake Formation, IAM, and KMS, orchestrating complex workflows with Airflow, Step Functions, or other AWS-native tools. Reliability and automation are key, so experience with CloudWatch, CloudTrail, CodePipeline, and Terraform is essential. You will collaborate closely with analysts and data scientists in an Agile environment to deliver critical business insights. This role offers exposure to Data Mesh principles and platforms like Data World, with a familiarity of Hadoop/HDFS in hybrid or legacy environments being advantageous. We are seeking candidates with 4-7 years of data engineering experience, including at least 3 years specifically on AWS platforms. Proficiency in Python (including AWS SDKs), DBT, SQL, and Spark is a must. Proven expertise with the AWS data stack (S3, Glue, EMR, Redshift, Athena, Lambda) and hands-on experience with workflow orchestration tools like Airflow or Step Functions are required. Familiarity with data lake formats (Parquet, ORC, Iceberg) and DevOps practices including Terraform and CI/CD is also expected. A solid understanding of data governance and security best practices is fundamental for this position at Tesco.