Senior Data Engineer

About the Role

Lumenalta partners with forward-thinking organizations to build scalable technology solutions that delight users and accelerate growth. Our global teams bring curiosity, commitment, and technical excellence to every project, valuing transparency, autonomy, and impact.

What You'll Be Doing

• Architect & Implement: Build data landing zones for streaming telemetry (Striim) and historical relational data (Oracle), enforcing strict asset segregation across ingestion layers.
• Pipeline Development: Design end-to-end batch and streaming pipelines within a Databricks Lakehouse environment, leveraging Delta Live Tables (DLT) for reliable state management and incremental processing.
• Data Transformation: Develop logic to calculate descriptive statistics at ingestion time and build advanced Silver/Gold layer pipelines for complex multi-sensor time-alignment.
• Cost Management: Configure ETL clusters, SQL Warehouses, and monitoring tools; establish spend alerts and cost projections to manage FinOps accountability.
• Production Cutover: Lead cutover activities including environment hardening, historical backfill processing, and phased loading of parameters.
• Data Quality & Collaboration: Enforce data quality standards across all layers and collaborate with stakeholders to translate manufacturing/IoT requirements into robust architecture decisions.

What We're Looking For

• 5+ years in data engineering delivering production-grade pipelines in high-volume enterprise environments.
• Advanced experience with Databricks (Delta Lake, DLT, SQL Warehouses) at scale.
• Proven expertise with Striim or equivalent CDC tools in manufacturing/IoT contexts.
• Strong proficiency in Python/PySpark and advanced SQL for complex transformations.
• Experience managing high-frequency time-series datasets and multi-sensor synchronization.
• Familiarity with cloud cost management, cluster sizing, and resource optimization.
• Comfortable owning go-live activities including cutover planning and stabilization.

Benefits & Location

This is a fully remote position open to candidates based in the Pacific, Central, or Eastern U.S. time zones, with occasional travel to Georgia required.
Salary: $80,000 - $130,000 annually (W2 Employees).
Benefits include:

• Flexible working hours
• Health insurance (medical and dental)
• 401K Contribution
• Professional development fund
• 15 days of PTO
• Access to soft-skill courses