Software Engineer, Logs Infrastructure

If autonomous driving and large scale infrastructure aligns with your passions and skills, please come join the Waymo Logs team and help us build the future together.

The Waymo Logs team owns the infrastructure for collecting, offloading, processing and storing driven and simulated data of Waymo cars.

In this Hybrid role you will report to the Tech Lead Manager.

You will:

• Data Collection:
  • Onboard logging collection infrastructure, including data formats, APIs, and libraries.
  • Data ingestion pipeline, including uploader modules over LTE/Wifi/wired connections, temporary storage.
  • Offboard components that facilitate onboard data collection and ingestion, including quotas, sampling, and prioritized upload requests.
  • Strategy and onboard+offboard infrastructure that maximizes the value of the limited data collected in the face of multiple requirements, physical and budgetary constraints, safety and regulatory requirements. This includes application of novel statistical sampling methods and ML.
  • Achieving operational readiness to scale #miles driven by orders of magnitude, including reliability improvements and elimination of overheads that scale linearly with miles.
• Data Storage:
  • • Storage management aspects, including file formats, encodings, replication, rebalancing, integrity, durability, backends and APIs.
    • Dataset management aspects, including metadata, versioning, lifetime control, quotas and APIs for set/membership management.
    • Data stewardship for access control, auditing, wipeout, and regulatory compliance (e.g. GDPR).
    • Responsibility for overall storage cost. This includes tooling required for data curation, plus defining and implementing storage cost control policies spanning multiple Waymo teams.

You have:

• 3+ years of professional software engineering experience.
• 3+ years of experience working on large-scale distributed systems.
• 3+ years of experience with C++.
• Proven track record of driving collaboration effectively across organizational boundaries.
• Strong ability to document technical designs, processes, and communicate clearly with cross-functional teams.

We prefer:

• Building large scale storage systems (onboard and offboard).
• Familiarity with Backend Infrastructure / Streaming Infrastructure / Batch Infrastructure.
• Sampling / Compression / Fleet Optimization algorithms
• Building dataset management infrastructure.
• Track record of successfully executing forward looking ambitious bets.
• Track record of high coding productivity