TL;DR

Staff Machine Learning Engineer (AI): Driving the development and deployment of state-of-the-art AI models and systems, impacting the capabilities and performance of Databricks' products and services. Focus on data collection, fine-tuning, and LLM technologies, implementing ML pipelines for rapid experimentation and iteration.

Location: San Francisco, California. Open to employees working from the Mountain View, CA office.

Salary: $190,000 — $285,000 USD

Company

Databricks is the data and AI company unifying and democratizing data, analytics and AI for more than 10,000 organizations worldwide.

What you will do

  • Shape the direction of applied AI areas and intelligence features in Databricks' products.
  • Drive the development and deployment of state-of-the-art AI models and systems.
  • Develop novel data collection, fine-tuning, and LLM technologies.
  • Design and implement ML pipelines for data preprocessing, feature engineering, model training, and model evaluation.
  • Work closely with cross-functional teams to deliver impactful AI solutions.
  • Build scalable, reusable backend systems to support GenAI products across the company.

Requirements

  • 2-8 years of machine learning engineering experience or a strong background in relevant ML research.
  • Strong track record of working with language modeling technologies.
  • Proficiency in Python, TensorFlow/PyTorch, and scalable ML architectures.
  • Ability to drive end-to-end model development, from research and prototyping to deployment and monitoring.
  • Strong analytical and problem-solving skills.
  • Strong coding and software engineering skills, and familiarity with software engineering principles.

Nice to have

  • Experience with LLM fine-tuning, prompt engineering, and retrieval-augmented generation (RAG).

Culture & Benefits

  • Comprehensive benefits and perks to meet the needs of all employees.
  • Opportunity to shape the future of AI-driven products at Databricks.
  • Work with cutting-edge models.
  • Collaborate with a world-class team of AI and ML experts.