The Data Team leverages data from our autonomous vehicles and operations to determine autonomy and service readiness. We provide the foundation for strategic decision-making at our client. You will help develop and implement the next generation of our data pipeline to ensure visibility into our business as we scale toward the launch of an autonomous mobility service. You will define the system and build the pipeline to enable our client to develop and scale with a data-first culture.
Responsibilities
- Design, build, and maintain a platform used by our client teams to build large-scale data pipelines
- Drive platform efficiency improvements to reduce latency and improve data freshness
- Support data-driven engineering decisions through improved observability and key metrics
- Partner with engineering teams to support long-term scaling of their data pipelines
Qualifications
- 5+ years of software engineering experience
- Strong fluency with Python
- Strong understanding of distributed systems
- Strong written and verbal communication skills
- Good experience building and maintaining data intensive production systems at scale
- Good experience with relational databases and non-relational (NoSQL) databases
- Good experience with infrastructure-as-code tools (e.g. Terraform, …)
- Experience with large scale streaming platforms (e.g. Kafka, Kinesis)
Bonus Qualifications
- Experience with data warehouse platforms (e.g. Redshift, BigQuery, Databricks, …)
- Experience building scalable and maintainable data pipelines
- Experience with AWS ECS and/or Kubernetes
- Experience with a workflow manager such as Airflow
- Experience with large scale processing frameworks (e.g. Spark, Hadoop, …)
