Python Developer

Senior Software Engineer – Data Products & Cloud Solutions

About Us:

The Compass team at Kelly is dedicated to building the software and infrastructure that powers precision agriculture. We transform complex data—including machine telemetry, agronomic insights, geospatial coordinates, logistics tracking, and more—into scalable production capabilities.

Role Overview:

We are seeking a highly technical Senior Software Engineer to design, build, deploy, and support robust data products and services. You will work across backend APIs, event-driven pipelines, cloud infrastructure (AWS), databases, Databricks integrations, and operational tooling.

Key Responsibilities:

• Architect and implement scalable AWS and Databricks solutions to enhance Compass services for reliability, performance, and maintainability.
• Design and build production-grade Python REST APIs, Lambda functions, backend processes, and event-driven microservices.
• Create data pipelines that ingest, transform, process, and persist high-volume machine, agronomic, geospatial, and logistics data.
• Maintain AWS infrastructure using Terraform (Infrastructure as Code).
• Manage PostgreSQL/Aurora databases, including schema design, migrations, connectivity, and performance tuning.
• Develop solutions supporting both real-time/event-driven workloads and scheduled batch processing.
• Create CI/CD pipelines using GitHub Actions for automated testing and deployment of applications and infrastructure.
• Implement observability via Datadog to manage logging, metrics, dashboards, alerts, and monitoring.
• Troubleshoot production issues across APIs, databases, queues, cloud environments, and external integrations.

Essential Requirements:

• Python Expertise: Excellent development skills with a track record of deploying production software. Experience with frameworks like DBMate or Pydantic is preferred.
• AWS Mastery: Strong proficiency with Lambda, API Gateway, IAM, S3, SQS, EventBridge, and RDS/Aurora.
• Data & Databases: Deep experience with relational databases (PostgreSQL) and data-processing applications.
• IaC & DevOps: Proficient in Terraform for Infrastructure as Code; experienced with CI/CD, automated testing, and Git/GitHub workflows.
• Architecture: Comfortable working across technologies to solve ambiguous problems independently. Experience improving systems for scalability, security, performance, and cost-efficiency is crucial.

Preferred Qualifications:

• Data Platforms: Hands-on experience with Databricks, Spark, PySpark, SQL, Delta Lake, or similar big data technologies.
• Serverless & Containers: Knowledge of event-driven/serverless architectures and Docker containerization (e.g., AWS Lambda Powertools).
• Safety & Auth: Understanding of authentication/authorization patterns like OAuth/OIDC and IAM policies. Experience with observability platforms such as Datadog.