
Senior Data Engineer
Responsibilities
Qualifications & Requirements
Experience Level: Senior Level
Full Job Description
Senior Data Engineer - Hyderabad, Telangana
IQ-EQ is seeking an experienced Senior Data Engineer to join our global team in Hyderabad, Telangana. This is a crucial technical role focused on delivering, enhancing, and maintaining our Group Data Platform as part of our Data Strategy and Transformation Journey. You will play a vital part in how our data is managed and utilized to maximize business value and growth, driving improvements for both internal and external stakeholders and clients.
About the Role
This is a hands-on, deeply technical position requiring a seasoned data engineering professional with extensive experience in building and managing complex data infrastructures. You will be instrumental in expanding and optimizing our data pipeline architecture, directly constructing, troubleshooting, and refining data pipelines. You will collaborate closely with software developers, database architects, data analysts, and data scientists, implementing data initiatives to build optimal, production-ready models.
Key Responsibilities:
- Create and maintain optimal data pipeline architecture.
- Assemble large, complex data sets to meet business requirements.
- Identify and implement internal process improvements, including automation and infrastructure optimization.
- Build infrastructure for efficient data extraction, transformation, and loading from various sources using SQL and cloud big data technologies (AWS, Azure).
- Develop analytics tools to provide actionable insights into key business metrics.
- Collaborate with stakeholders across Executive, Product, Data, and Design teams to support their data infrastructure needs.
- Implement data flows connecting operational systems, analytics, and business intelligence (BI) systems.
- Document source-to-target mappings.
- Re-engineer manual data flows for scalability and repeatability.
- Write and optimize ETL scripts.
- Develop reusable business intelligence reports.
- Support the Lead Data Engineer with day-to-day supervision of the Data Science and Engineering team.
- Provide in-country coordination for the India team, ensuring adherence to processes and policies.
Expected Behaviors:
- Effective communication, adapting style to audience and message.
- Action-oriented, taking ownership and identifying new opportunities.
- Interpersonal savvy, building rapport across all levels and cultures.
- Analytical mind, excellent problem-solving skills, and attention to detail.
Qualifications and Experience:
Education & Professional Qualifications:
- Bachelor's degree in Computer Science or a related field.
- 8-10 years of experience in software engineering, with specific experience in Data Engineering and Analytics.
- Background in the Financial Industry is preferred.
Technical Experience:
- Proficiency in Linux fundamentals and Bash scripting.
- Programming expertise in Python, Go, Scala, C++, or Kotlin.
- Expertise in Python libraries such as Pandas, Numpy, PySpark, and Dask.
- In-depth knowledge of Algorithms and Data Structures.
- Deep understanding of database systems (e.g., PostgreSQL, MySQL, Microsoft SQL Server).
- Experience with cloud platforms (AWS, Azure, GCP).
- Experience with Data Lakes/Data Warehouses (Snowflake, DataBricks, Redshift).
- Experience in Stream processing (Kafka, Kinesis).
- Experience in implementing Data Warehousing and API solutions.
- Experience working in complex, multi-country professional services, financial services, or BPO organizations.
- Demonstrated ability to work effectively in a multi-cultural, talented, and demanding team environment.
- Strong program management knowledge.
- Excellent written and oral communication skills.
- Passion, dynamism, and drive.
- Personal presence, integrity, and credibility.
- Ability to solve problems independently or collaboratively.
- Experience in leading and mentoring teams.
- Strong analytical and troubleshooting skills.
- Experience/Exposure to ISO 27001 Infosec compliances.
Languages:
Fully proficient in spoken and written English; additional European languages will be an asset.
Company
IQ-EQ
IQ-EQ is a leading service provider for the alternative asset industry, assisting managers with hedge fund, private equity fund, and mutual fund launches, fund administration, advisory firm setup, reg...