Sr. Data Engineer

As a Senior Data Engineer based in Hyderabad, India, you will own the end-to-end data pipeline, ensuring the reliability, efficiency, and scalability of our data systems. You will collaborate closely with cross-functional teams, including data scientists, analysts, and software engineers, to develop robust data solutions that empower data-driven decision-making.

Responsibilities:

• Create optimal data pipeline architecture.
• Develop and maintain end-to-end scalable data infrastructure and pipelines.
• Identify, design, and implement process improvements, automating manual processes and optimizing data delivery.
• Assist internal stakeholders with data-related technical issues and support their data infrastructure needs.
• Develop data tools for analytics and data scientists, contributing to product innovation.
• Collaborate with data and analytics experts to enhance functionality in data systems.
• Design and implement data models, ensuring integrity and consistency.
• Identify and resolve performance bottlenecks, optimizing queries and processing.
• Implement data governance best practices for quality, security, and compliance.
• Stay informed about emerging technologies, contribute to tool selection, and enhance data infrastructure.
• Create and maintain comprehensive documentation for data engineering processes and workflows.
• Drive the team's data strategy, technical roadmap, and data storage solutions.
• Empower the team for self-servicing and efficient troubleshooting.

Required Qualifications:

• Bachelor’s degree or equivalent experience.
• 7+ years of experience using SQL in an advanced capacity, including query authoring, tuning, and identifying useful abstractions.
• 5 years of hands-on experience in Python, demonstrating proficiency in data wrangling and object-oriented programming.
• Expertise in designing, creating, managing, and utilizing large datasets.
• Ability to build efficient, flexible, extensible, and scalable ETL and reporting solutions.
• Root cause analysis experience on internal and external data and processes.
• Experience with cloud-based database platforms, preferably Snowflake.
• 3+ years of Git experience for version control and collaboration.
• 3+ years of experience working with AWS cloud technology.
• 3+ years of experience working with workflow management platforms like Airflow/Dagster.
• 2+ years experience using Tableau to build impactful reports and dashboards.
• Experience working with dbt is a plus.
• Strong analytical and problem-solving skills.
• Cross-functional team collaboration experience in a dynamic environment.
• Proven track record of navigating ambiguity, prioritizing needs, and solving impactful business problems.
• Excellent written and verbal communication skills for technical and non-technical audiences.
• Empathy-driven, supporting team success.
• Remote work experience with a U.S-based team is preferred.