Senior Data Engineer – Apache Spark...
Full Job Description
About the Role
Join the Webex Data Analytics Platform (WAP) engineering organization to develop Cisco's core big data platform at Webex. As a Senior Data Engineer, you will build high-impact analytics and data pipelines alongside product teams.
Your Impact:
- Enhance open-source technologies for big data processing.
- Build and operate Kafka-based streaming applications for ingestion, filtering, enrichment, and replication.
- Develop scalable jobs using Apache Spark and/or Apache Flink following platform guidelines.
- Leverage Apache Iceberg to manage large analytical datasets in the data lake.
- Tune performance, scalability, and cost efficiency across all workloads.
Requirements:
Minimum Qualifications:
- 8–12 years of experience in data engineering and software development.
- Strong skills in the open-source ecosystem (Java/Scala, Python).
- Practical expertise with Apache Spark, Apache Flink, Trino/Presto, Kafka, and SQL for analytical workloads.
Preferred Qualifications:
- Real-time analytics stores like Pinot or Clickhouse.
- AI Tools experience (GitHub Copilot, Cursor, Codex).
- Data governance tools such as DataHub.
- Workflow orchestration with DolphinScheduler or Airflow.
- Lakehouse systems like Apache Amoro.
Why Cisco?
Cisco is revolutionizing data infrastructure for the AI era. With 40 years of fearless innovation, we create solutions bridging physical and digital worlds to provide unparalleled security and insights. Join a global network of experts collaborating with empathy to build meaningful solutions that make an impact everywhere.
Company
Cisco
Cisco is a global technology leader revolutionizing how organizations connect and protect in the AI era, with over 40 years of securing connections worldwide.Through industry-leading AI-powered soluti...