AWS Databricks Data Engineer (Remote, India - Contract)

Intuition IT is seeking a skilled and experienced AWS Databricks Data Engineer for a critical contract role. This remote position, based in India, offers an exciting opportunity to work on cutting-edge data solutions for our clients.

As an AWS Databricks Data Engineer, you will be instrumental in designing, developing, and maintaining robust and efficient data pipelines and infrastructure, leveraging the power of AWS and Databricks.

Key Responsibilities:

• Design, develop, and maintain high-performance ETL (Extract, Transform, Load) pipelines utilizing PySpark on Databricks platforms.
• Build, deploy, and manage comprehensive data solutions within the AWS ecosystem, including services like S3, Glue, Redshift, and others.
• Efficiently process and analyze large-scale datasets using Apache Spark technologies.
• Optimize existing data workflows and solutions for enhanced performance, scalability, and cost-efficiency.
• Provision and manage AWS cloud infrastructure using Infrastructure as Code (IaC) principles with Terraform.

Required Skills & Experience:

• Strong hands-on experience with core AWS services relevant to data engineering.
• Proven expertise and hands-on experience with Databricks platform.
• Proficiency in programming languages, specifically PySpark and Python.
• Good understanding of data warehousing concepts and best practices.
• Experience or working knowledge of Terraform for infrastructure provisioning and management.
• Excellent problem-solving abilities and analytical skills.