Software Engineer II

About the Role

We are seeking a motivated Software Engineer II - Data Engineer with expertise in Spark, Python, and either Databricks or AWS EMR to join our dynamic team at JPMorgan Chase within the Commercial & Investment Bank. This is an excellent opportunity to grow your skills and advance your career by contributing to the enhancement, design, and delivery of cutting-edge technology products in a secure, stable, and scalable manner.

As an emerging member of our software engineering team, you will be instrumental in executing software solutions through the design, development, and technical troubleshooting of multiple components within our technical products, applications, and systems.

Job Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL processes.
• Work with large datasets utilizing Spark on Databricks or AWS EMR.
• Write efficient SQL queries for data extraction, transformation, and analysis.
• Collaborate effectively with data scientists, analysts, and other engineering teams to deliver high-quality data solutions.
• Implement data processing workflows on key AWS services including S3, ECS, Lambda, EMR, and Glue.
• Develop and maintain Python scripts for data processing and automation tasks.
• Ensure the quality, integrity, and security of data across all data engineering activities.
• Troubleshoot and resolve data-related issues promptly.

Required Qualifications

• Formal training or certification in software engineering concepts with 2+ years of applied experience.
• Proven expertise in Data Engineering with Apache Spark.
• Hands-on experience with either Databricks or AWS EMR.
• Strong knowledge of SQL and fundamental database concepts.
• Experience in designing and implementing ETL and data processing workflows.
• Proficiency with essential AWS services such as S3, ECS, Lambda, EMR/Glue.
• Advanced proficiency in Python programming.
• Excellent problem-solving and analytical capabilities.
• Bachelor's degree in Computer Science, Information Technology, or a related field (or equivalent practical experience).
• Strong communication and collaboration skills.
• Ability to work autonomously and as a collaborative team member.

Preferred Qualifications

• Experience with Infrastructure as Code (IaaC) tools like Terraform or CloudFormation.
• Familiarity with writing unit test cases for Python code.
• Knowledge of version control systems, including BitBucket or GitHub.
• Understanding of CI/CD pipelines and associated automation tools.