Data Science Engineer

Overview

This role involves developing Machine Learning (ML) and Artificial Intelligence (AI) projects, with a specific focus on creating ML and GenAI solutions for big data analytics within a CI/CD environment. Utilize analytics toolsets such as DS tools, Spark, Databricks, LLM frameworks like LangChain/LlamaIndex, and technologies from Microsoft Azure or open-source options. Automate the end-to-end ML lifecycle using Azure Machine Learning Services and Pipelines.

Responsibilities

• Understand and scale existing Proof of Concepts (PoCs) for LLMs, translating them into production-ready solutions using industry best practices.
• Optimize the cost of generating responses to queries by identifying the most effective and economical alternatives.

Qualifications

We are seeking candidates experienced in applications that leverage Large Language Models to enhance user experience. A well-seasoned data scientist with substantial experience in API and backend development, utilizing accelerators like FastAPI and AsyncIO, is preferred.