Job Overview

Virtusa in Chennai is seeking a highly motivated and skilled Python Data Engineer. This entry-level role is perfect for individuals passionate about data, software development, and cloud technologies. You will be instrumental in designing, developing, and maintaining our robust data infrastructure and pipelines, contributing to high-impact projects within a dynamic team environment.

Key Deliverables

• Design, develop, and maintain scalable and reliable data pipelines using Python, DBT, and Snowflake for efficient data ingestion, transformation, and storage, ensuring high data quality and availability.
• Develop and maintain Infrastructure as Code (IaC) using Terraform or CloudFormation for automated setup and management of AWS data infrastructure components.
• Implement and maintain CI/CD pipelines with tools like GitHub Actions or Jenkins to automate testing, integration, and deployment of data pipelines.
• Conduct thorough code reviews, adhering to best practices to ensure code quality, maintainability, and security.
• Proactively monitor data pipelines for performance bottlenecks and cost inefficiencies, implementing optimizations to enhance throughput, reduce latency, and minimize operational expenditures.
• Create and maintain comprehensive documentation for data pipelines, software designs, and operational procedures to support knowledge sharing and audit readiness.

Essential Requirements

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• Strong proficiency in Python, including data manipulation libraries like Pandas and data pipeline frameworks such as Apache Beam or Airflow.
• Solid understanding of SQL and experience with relational databases (PostgreSQL, MySQL) or cloud data warehouses (Snowflake, AWS Redshift).
• Familiarity with AWS cloud computing platform and its data services (S3, Glue, Lambda, Athena, IAM).
• Basic understanding of data modeling concepts and experience designing schemas for analytical and transactional databases.

Preferred Qualifications

• Experience with Data Build Tool (DBT).
• Experience with Infrastructure as Code (IaC) tools like Terraform or CloudFormation.
• Familiarity with CI/CD pipelines and automated testing frameworks.
• Exposure to Agile development methodologies and cross-functional team collaboration.
• Knowledge of data governance principles and data quality management.

Skills Profile

Must-Have Skills:

• Technical: Python (data manipulation), Advanced SQL, AWS (S3, Glue, Lambda, Athena), DBT, Git.
• Domain Knowledge: Data warehousing principles, ETL processes, Data modeling.
• Behavioral & Interpersonal: Strong communication, Collaboration in Agile teams, Problem-solving attitude.
• Process & SOP: Experience in documenting data pipeline processes, Code review participation, Adherence to coding standards.
• Analytical & Problem-Solving: Ability to debug and optimize data pipelines, Root cause analysis.

Good-to-Have Skills:

• Advanced Technical: Orchestration tools (Airflow), Spark or other distributed processing frameworks, IaC proficiency.
• Additional Certifications: AWS Certified Data Engineer, Python certifications.
• Cross-Functional Exposure: Interacting with data scientists and Business Stakeholders.
• Leadership Traits: Mentoring junior data engineers.
• Continuous Improvement: Familiarity with data quality monitoring techniques.

Additional Information:

• This is a full-time, onsite position based in Chennai, Tamil Nadu, India.
• Standard working hours with potential for flexible scheduling after probation.
• Reporting to a Senior Data Engineer or Engineering Manager.
• Comprehensive onboarding and training provided.