Senior Data Engineer

About the Role

Join our team in India as a Senior Data Engineer responsible for building, productionizing, and maintaining robust AWS data pipelines, advanced AI agents, and scalable backend services. This hands-on position demands strong proficiency in Python and AWS technologies to bridge gaps across Data Engineering, Artificial Intelligence, and Backend development from design through deployment.

Key Responsibilities

• Data Engineering & AWS Pipelines: Design ingestion and ETL pipelines using Python and PySpark on AWS Glue. Orchestrate complex workflows with Step Functions while managing S3 data lakes, Athena queries, and the Glue Catalog.
• Backend & API Development: Build high-performance REST APIs and microservices for AI agents and enterprise systems. Manage authentication, validation, logging, monitoring, integrations, containerization, and deployment strategies.
• AI Agent Development: Develop intelligent agents using Amazon Bedrock and related frameworks like Strands or AgentCore. Implement advanced features including tool/function calling, RAG (Retrieval-Augmented Generation), state/context management, evaluation metrics, security protocols, observability, and reusable components.
• Engineering & DevOps: Write clean, testable code utilizing Git for version control and implement CI/CD practices. Adhere to IaC standards, cloud security bests, secrets management, logging, and monitoring requirements (Terraform preferred).

Required Skills

Mandatory qualifications include strong Python and AWS development experience; data pipeline expertise with PySpark/AWS Glue; familiarity with S3, Athena, and Step Functions; backend/REST API skills; hands-on LLM or GenAI knowledge (specifically Amazon Bedrock); exposure to AgentCore/Strands is highly desirable. Proficiency in Git, software engineering principles, and CI/CD workflows are essential.