Tata Consultancy Services•2h ago
LinkedIn
Data Engineer
Bengaluru, Karnataka, India
Senior Level
Full Job Description
About the Role
We are seeking a Senior AWS Data Engineer to design and build scalable data solutions on the Amazon Web Services platform across India.
Mandatory Technical Skill Set:
- Python, PySpark for large-scale distributed processing
- AWS Glue, Lambda, S3, Redshift, Athena, EMR, DynamoDB, Kinesis, IAM, CI/CD, Databricks
Key Responsibilities:
- Design and maintain robust ETL/ELT pipelines using AWS Glue, Spark, Lambda, and Databricks.
- Build scalable data lakes and warehouses leveraging S3, Redshift, and Athena.
- Orchestrate complex workflows using Airflow or Step Functions.
- Integrate diverse AWS services (Kinesis for streaming, DynamoDB for NoSQL needs) to ensure seamless data flow.
- Optimize pipelines for peak performance, reliability, cost-efficiency, and security best practices including lineage tracking.
- Collaborate closely with business stakeholders to translate requirements into technical solutions.
Company
Tata Consultancy Services
Tata Consultancy Services (TCS) stands as a global technology partner for leading organizations worldwide, established in 1968 with unwavering standards of innovation and engineering excellence.With t...
Bengaluru, Karnataka, India
Posted on LinkedIn