Senior Software Engineer, Data Engineering

DS collects radio data at a scale few organizations ever see — continuous, high-rate streams from sensors around the globe. We're hiring a Senior Data Engineer to design the platform that turns that firehose into an asset: a data lakehouse that serves researchers training models, production systems running inference, and agents retrieving context in real time. You'll own the architecture from ingestion through storage, cataloging, vector search, and access, and you'll design it explicitly for AI/ML workloads, not just analytics.

4–6+ years of software / data engineering experience, including several years designing and operating large-scale data platforms in production. Deep experience with lakehouse architectures and technologies — e.g., Apache Iceberg, Delta Lake, or Hudi; Parquet; Spark, Flink, Trino, DuckDB, or similar engines. Hands-on experience with vector databases and embedding retrieval (e.g., pgvector, Milvus, Qdrant, Weaviate, Pinecone, LanceDB, or FAISS-based systems), including indexing trade-offs and scaling. Strong experience with AWS or another major cloud provider. Fluency in Python and SQL; experience with orchestration tools (Airflow, Dagster, Prefect, Step Functions, etc.). Demonstrated experience designing data architectures specifically for ML / AI workloads. Strong grasp of data modeling, consistency, and the trade-offs between batch and streaming.