Lead Data Engineer

Lead Data Engineer - Capital One, Bangalore

Join Capital One in Bangalore as a Lead Data Engineer, and become part of a dynamic team of innovators and problem-solvers dedicated to addressing real-world challenges and meeting customer needs. We are actively seeking Data Engineers who are enthusiastic about integrating data with cutting-edge technologies. This role offers a unique opportunity to be at the forefront of a significant transformation within Capital One.

Key Responsibilities:

• Engage with and across Agile teams to architect, build, test, deploy, and support technical solutions utilizing full-stack development tools and technologies.
• Collaborate with a team of experienced developers specializing in machine learning, distributed microservices, and full-stack systems.
• Leverage programming languages such as Java, Scala, and Python, alongside Open Source RDBMS and NoSQL databases, and cloud-based data warehousing services like Redshift and Snowflake.
• Share your passion for staying abreast of technological trends, experimenting with new technologies, actively participating in internal and external technology communities, and mentoring fellow engineering professionals.
• Partner with digital product managers to deliver robust, cloud-based solutions that enhance user experiences and support millions in achieving financial empowerment.
• Perform unit testing and conduct code reviews with team members to ensure rigorous design, elegant coding, and optimal performance tuning.

Qualifications:

• Bachelor's degree in Computer Science and Engineering.
• A minimum of 7 years of experience in application development (internship experience excluded).
• A minimum of 2 years of experience with big data technologies.
• A minimum of 1 year of experience with cloud computing platforms (AWS, Microsoft Azure, Google Cloud).
• 8+ years of application development experience, including proficiency in Python, SQL, Scala, or Java.
• 4+ years of experience with a public cloud provider (AWS, Microsoft Azure, Google Cloud).
• 4+ years of experience with distributed data/computing tools such as MapReduce, Hadoop, Hive, EMR, Kafka, Spark, Gurobi, or MySQL.
• 4+ years of experience working with real-time data and streaming applications.
• 4+ years of experience with NoSQL database implementations (e.g., Mongo, Cassandra).
• 4+ years of data warehousing experience, specifically with Redshift or Snowflake.
• 4+ years of experience with UNIX/Linux environments, including command-line operations and shell scripting.
• 2+ years of experience with Agile engineering methodologies.