Senior Software Engineer I

Role Title: Senior Software Engineer I (Data Platform Operations & Observability Engineer)

About the Role

We are seeking a highly skilled Data Platform Operations & Observability Engineer to enhance and support our analytics platform across on-premises and Azure environments. In this critical role, you will provide reliable support for production data pipelines through pipeline monitoring, incident resolution, automation, and observability improvements.

Your expertise in Python, SQL, cloud technologies (Azure), data engineering, monitoring tools, and troubleshooting will be vital to maintaining the integrity of our platform services. You will investigate production issues, restore failed processes, communicate effectively with stakeholders, and proactively improve platform reliability by building enhanced monitoring solutions, alerting systems, logging dashboards, and operational procedures.

Key Responsibilities

• Operations & Support: Monitor production data pipelines to identify opportunities for improving reliability and efficiency. Troubleshoot pipeline failures, application errors, and performance problems across on-premises and cloud environments. Conduct root cause analysis and implement corrective actions while communicating incidents and remediation plans effectively.
• Azure & Data Services: Support Azure services including Databricks, Data Factory, Synapse, and Data Lake Storage. Administer Windows servers for patching, software installation, vulnerability remediation, and system maintenance. Create comprehensive operational documentation, diagrams, and support procedures.
• Observability & Reliability: Design and maintain monitoring, alerting, and dashboard solutions using tools like Grafana, Elasticsearch/Kibana, Azure Log Analytics Workspace, and Amazon CloudWatch Logs. Define operational metrics, KPIs, SLAs, and SLOs to develop proactive monitoring that detects issues before they impact users.
• Automation: Automate operational tasks and repetitive support activities to drive continuous improvements in platform reliability and observability.

Required Skills & Qualifications

• Core Technologies: Strong Python development skills (Pyspark expected) with deep expertise in Observability including logging, monitoring, dashboard creation from logs, alerting, debugging, and performance analysis.
• Cloud Logging Tools: Proven experience with Grafana, Elasticsearch/Kibana, Azure Log Analytics Workspace, and Amazon CloudWatch Logs.
• Data & Integration: Experience working with Azure or other cloud platforms using common data formats such as CSV, JSON, XML, and Parquet. Knowledge of data integration concepts, file transfers (Control-M, AutoSys), APIs, and data validation.
• Scheduling Tools: Familiarity with Control-M, Airflow, Windows Task Scheduler is beneficial.

Nice-to-have Experience

• Databricks and Azure Data Factory experience (beneficial but not mandatory).

Candidate Profile:

We welcome applications from individuals with backgrounds in NOC/networking, administration, development, or data-engineering who have successfully transitioned toward Python and observability-oriented work. Strong troubleshooting skills, verbal/written communication abilities, self-motivation, attention to detail, and the eagerness to learn are essential for thriving in our fast-paced environment.

We are an equal opportunity employer committed to providing a fair hiring process regardless of race, color, creed, religion, sex, national origin, citizenship status, disability status, protected veteran status, age, marital status, sexual orientation, gender identity, or genetic information. Qualified applicants will be considered without regard for these characteristics.

Please read our Candidate Privacy Policy and learn more about spotting job scams on our website. If you require accommodations at any stage of the recruitment process due to a disability or other need, please contact us via our Applicant Request Support Form or by phone (1-855-833-5120).