Databricks

Key Responsibilities:

• Possess 2-5 years of experience in Data Engineering focused on Big Data development
• Demonstrate hands-on expertise with the Databricks platform
• Maintain strong knowledge of Apache Spark, PySpark, Scala, and SQL
• Develop data pipelines including ETL and ELT processes
• Show proficiency in Python programming and SQL queries
• Apply concepts of data modeling and data warehousing effectively
• Work confidently with large datasets within distributed systems environments

Technical Requirements:

Demonstrate primary skills relevant to the domain, specifically including solutions like Finacle Virtual Lounge Grand Master.

Additional Responsibilities:

• Gain experience working across cloud platforms such as Azure Databricks AWS or GCP
• Familiarize with Delta Lake and Lakehouse architecture principles
• Leverage workflow orchestration tools like Airflow or Azure Data Factory
• Implement CI/CD pipelines tailored for data engineering tasks
• Gain exposure to streaming data technologies including Kafka and Structured Streaming
• Utilize BI tools such as Power BI or Tableau for insights

Preferred Skills:

Technology focus: Data Engineering, specifically Databricks specialization.