Staff Data Engineer

Shift5 is building a data platform for onboard operational technology. The Staff Data Engineer will design, build, and maintain batch and streaming data pipelines using Apache Airflow and Benthos. They will own features end-to-end, mentor team members, collaborate with data scientists, and ensure data quality. The role involves occasional travel to customer sites and requires expertise in AWS, containerization, and big data.

6+ years software/data engineering experience with strong programming skills in GoLang, Java, or Python. 6+ years relational database and Big Data experience (Hadoop, Spark). 4+ years with Docker, Kubernetes, and cloud services. Expertise in batch and streaming data pipelines (Apache Airflow, Benthos). Preferred: U.S. citizenship, MS in CS or related, experience with data lakes/warehouses, DevOps, and occasional travel.