Data Analyst

About The Role

We are seeking experienced Data Analysts with a specialized background in Machine Learning Evaluation Benchmarks (MLE Bench) to join our dynamic team. You will contribute to benchmark-driven evaluation projects focusing on real-world machine learning systems.

Primary Responsibilities:

• Analyze structured and unstructured datasets from ML training, inference, and evaluation pipelines to identify performance trends and anomalies.
• Define, compute, and validate metrics measuring model performance, robustness, and behavior across various benchmark scenarios.
• Investigate data distributions, failure modes, and edge cases to diagnose issues and inform system improvements.
• Develop Python and SQL scripts for analysis, reporting, and workflow execution.

Qualifications

Ideal candidates have a minimum of three years of professional experience as a Data Analyst or analytics-focused engineer. Proficiency in Python, SQL, and relational databases is essential. You must demonstrate strong statistical knowledge, the ability to handle large datasets, and skills in creating clean, documented code.

Duties & Benefits

• Create comprehensive analytical artifacts ensuring reproducibility.
• Collaborate with ML engineers on challenging evaluation scenarios for the MLE Bench project.