← Serch more jobs

Senior Data Engineer

LinkedIn Versant Media Los Angeles, CA
Mid-Senior level Posted April 17, 2026 2 variants Job link
Thinking about this job
Not Met Priorities
What still needs stronger evidence
Requirements
  • 5+ years of experience building production-grade data pipelines in cloud environments using Spark-based platforms (e.g., Databricks, EMR, Dataproc, open-source Spark)
  • Expertise in PySpark, SQL, and Spark-based data processing, with experience operating pipelines at scale in production
  • Hands-on experience building batch or streaming production data pipelines using distributed processing frameworks (e.g., Spark, Flink) and query engines such as Presto
  • Proficiency with orchestration tools such as Apache Airflow or Dagster, with hands-on experience in CI/CD, monitoring, alerting, and data quality for production systems
  • Experience working with modern data architectures, including event-driven and distributed systems
  • Proficiency with Git and collaborative development workflows
  • Build and operate batch and real-time ingestion pipelines using Spark based batch and streaming patterns (e.g., Structured Streaming, CDC), with experience on Databricks or comparable platforms
  • Solid understanding of infrastructure, networking, and data security fundamentals
Preferred Skills
  • Experience building Lakehouse platforms and medallion pipelines in Databricks
  • Familiarity with Unity Catalog, data governance, and compliance frameworks (e.g., PCI)
  • Hands-on experience with CI/CD pipelines, orchestration tools, and infrastructure-as-code
  • Experience with Lakeflow Spark Declarative Pipelines (SDP), MLflow, feature stores, and MLOps practices
  • Background in media and entertainment data (e.g., video metadata, ad tech, audience analytics)
  • Experience building data platforms within the media industry, with a strong understanding of audience analytics
  • Experience working with large-scale analytical datasets (e.g., event logs, clickstream data, audience metrics)
  • Comfortable using AI-assisted development tools (e.g., ChatGPT)
  • Databricks or cloud certifications (e.g., Databricks Certified Data Engineer)
  • Passion for clean, reliable, and scalable data systems
  • Strong communication and collaboration skills
Education
  • (Not required) – Bachelor’s degree in Computer Science, Data Engineering, or equivalent practical experience