Staff Data Scientist, Google Labs

Minimum qualifications:

• Master's degree in Statistics, Data Science, Mathematics, Physics, Economics, Operations Research, Engineering, or a related field or equivalent practical experience.
• 8 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 6 years of work experience with a PhD degree.
  

Preferred qualifications:

• 10 years of work experience using analytics to solve product or business problems, coding (e.g., Python, R, SQL), querying databases or statistical analysis, or 8 years of work experience with a PhD degree.
  

About the job

In this role, you will be focused on quality evaluation and user analysis for coding verticals within Labs (AIDA). You will quickly iterate to explore new ideas and applications, for our work to be integrated into existing products. You will be discovering and solving problems that need to be solved to enable the use of a Large Language Model (LLM) to power the next generation of products and applications (e.g., safety, privacy, hallucination, etc).

You will be helping the team understand how users are using our LLM products through log analysis, evaluation methodology development, metrics development, etc.

Responsibilities

• Work with large, complex data sets. Solve difficult, non-routine analysis problems, applying advanced investigative methods as needed. Conduct end-to-end analysis that includes data gathering and requirements specification, processing, analysis, ongoing deliverables, and presentations.
• Present analysis to organization executives in order to share insights, influence product direction and answer difficult questions regarding Large Language models.
• Build and prototype analysis pipelines iteratively to provide insights at scale. Develop comprehensive understanding of Google data structures and metrics, advocating for changes where needed for both products development and business activity.
• Interact cross-functionally with a wide variety of teams. Work closely with engineers to identify opportunities for, design, and assess improvements to google products.