Lead Engineer for Hadoop Platform - Data Schema Management team at Uber
San Francisco, CA, US

About the Role

Uber is currently looking for an experienced engineer to lead Uber's "Data schema & metadata Management" team. Based in San Francisco or Palo Alto, the team is responsible for building the infrastructure that supports defining, storing, and serving schema and metadata. The team's mission is to unleash the real power of data by managing the schemas and enforcing evolution rules and being the gatekeeper to prevent incompatible schema or metadata changes that would prevent data accessibility. This includes providing solutions to create/update and retrieve schemas and metadata, supporting different schema frameworks used across different teams (i.e. Avro, Parquet, Thirft, Protocol Buffers, and Json), and seamlessly converting between different frameworks to create consistency and alignment. Come help us scale our Big Data team and fundamentally influence the quality of data used to make key business decisions at Uber.

What You'll Do

  • Build and lead a diverse team of engineers with a mix of Big data, Infrastructure, and full stack engineering backgrounds
  • Operate at the intersection of Infrastructure, Big Data, Storage, & Online Services and explore all aspects of a Data analytics platform that collects, stores and serves 100s petabytes of information.
  • Lead, mentor and retain the best tech talent in the Bay area
  • Develop cross-org partnerships with peer organizations; collaborate and address their schema and metadata requirements
  • Influence and guide strategy, execution and innovation for all aspects of data analytics at Uber
  • Engage with the open source community to understand existing work and influence future roadmap; Represent Uber via talks at conferences and blog posts

What You'll Need

  • 2+ years of leading experience scaling or managing multi person teams with a track record of delivering results while growing/mentoring engineers on your team
  • Experience going through the full software cycle of requirements, design, coding/testing best practices and operational excellence in delivering world-class software and services
  • Communication and leadership skills, with the ability to initiate and drive processes and projects proactively
  • Solid understanding of Schema & Metadata, Data Analytics, Storage, Compute & network infrastructures
  • Be customer obsessed and have the ability to translate customer and technical requirements into detailed engineering plans, architecture, and design
  • Give technical feedback and drive quality via code reviews, design reviews, and postmortems
  • Dedication to moving fast in the short-term, while simultaneously building for long-term

Bonus Points If

  • Under the hood experience with Apache AvroApache ParquetApache Thirft, Protocol Buffers, etc. is a strong plus
  • You have a strong vision for cross-domain data integration in a fast-paced environment like Uber while staying on top of rapid developments in the industry
  • Experience with highly available/fault-tolerant, distributed systems, large-scale data processing systems or enterprise/cloud analytics systems is also a strong plus

Keep up with the latest.

Get the latest updates from Norwest and insights into the venture capital world.