Senior Data Engineer
Full Job Description
Lead Data Engineering (Palantir Foundry) at Lear Corporation - Pune District, Maharashtra, India
Lear Corporation is seeking a highly skilled Senior Data Engineer to join their team in Pune, Maharashtra. This role is pivotal in designing, building, and maintaining scalable data pipelines within the Palantir Foundry platform. You will collaborate with cross-functional teams to deliver robust and reliable data solutions that drive crucial decision-making and support mission-critical projects.
Key Responsibilities:
- Manage and execute data-focused projects within Lear’s data analytics and application platforms, from conception to solution deployment.
- Utilize Palantir Foundry tools including Pipeline Builder and Code Repositories, and leverage Data Lineage for visualizing data flows.
- Implement programmatic health checks for pipeline durability and integrate both new and legacy technologies.
- Lead the design and implementation of complex, scalable, reliable, and efficient data pipelines, utilizing Git for version control.
- Transform big data into manageable, high-quality datasets, optimizing build times and resource utilization.
- Produce and maintain datasets, ensuring they meet organizational needs and reflect the latest information.
- Implement data quality health checks and validation processes.
- Collaborate closely with data scientists, analysts, and operational teams, providing technical guidance and fostering a collaborative environment.
- Stay updated on industry trends and emerging technologies to enhance pipeline performance, reliability, and maintainability.
- Ensure documentation and procedures align with internal practices and Sarbanes-Oxley requirements.
- Mentor junior team members, foster knowledge sharing, and contribute to team development.
- Continuously test, improve, and optimize data pipeline performance, reliability, and system performance for all deployed resources.
Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
- Minimum 3 years of experience in data engineering, ETL, and data integration.
- Proficiency in Python and libraries such as Pyspark, Pandas, and Numpy.
- Strong understanding of Palantir Foundry capabilities.
- Familiarity with big data technologies like Hadoop, Spark, and Kafka.
- Excellent problem-solving skills, attention to detail, and strong communication and leadership abilities.
Join Lear to advance your data engineering career in an innovative, collaborative, and cutting-edge environment. Make a real impact in a role that blends technical expertise with leadership.
Company
Lear Corporation
Lear, a global leader in automotive technology, specializes in Seating and E-Systems. With over a century of experience, Lear is dedicated to enhancing the driving experience through intelligent in-ve...