Optum India•1h ago
LinkedIn
Senior Data Engineer
Hyderabad, Telangana, India
Senior Level
Full Job Description
About the Role
You will develop scalable data pipelines for enterprise analytics using PySpark, Python, Snowflake, Databricks, Azure Blob Storage, and ADF. You'll build AI tools to reduce manual workload, manage ETL/ELT workflows with Delta Live Tables, ensure platform stability, remediate security vulnerabilities, and support healthcare data environments.
Key Responsibilities
- Design and optimize PySpark-based processing workflows on Databricks for batch/streaming use cases.
- Create robust ETL/ELT pipelines using Azure Data Factory across dev/test/prod environments.
- Ensure platform reliability through version upgrades, incident resolution, and security compliance.
- Collaborate with cross-functional teams to troubleshoot issues and deliver high-quality data solutions.
Requirements
- Bachelor's degree or equivalent experience (3+ years).
- Strong hands-on skills in Databricks, PySpark, Snowflake, Apache Spark, UNIX/Linux scripting, Python, and Airflow.
- Experience with IBM DataStage/Teradata and AI tools for automation.
- Familiarity with healthcare data environments.
Company
Optum India
Optum, a global organization delivering care through technology to help millions live healthier lives, is pushing innovation at its Hyderabad capability center.As part of UnitedHealth Group, Optum Ind...
Hyderabad, Telangana, India
Posted on LinkedIn