Databricks-posted about 1 year ago
$166,000 - $166,000/Yr
Full-time • Senior
San Francisco, CA
501-1,000 employees
Professional, Scientific, and Technical Services

The Senior GenAI Machine Learning Engineer at Databricks will play a crucial role in enhancing the company's data and AI infrastructure platform. This position involves conducting foundational research and developing solutions that enable customers to analyze data using natural language. The engineer will work on large-scale distributed AI/ML systems, optimizing model serving, and creating novel methodologies for production use cases. The role is pivotal in shaping the applied ML areas and intelligence features of Databricks' products, directly impacting customer capabilities and product performance.

  • Conduct foundational research into the feasibility and effectiveness of solutions for data analysis using natural language.
  • Drive the development and deployment of state-of-the-art AI models and systems.
  • Architect and implement robust, scalable ML infrastructure for AI/ML model integration into production environments.
  • Develop novel data collection, fine-tuning, and pre-training strategies for optimal performance.
  • Design and implement automated ML pipelines for data preprocessing, feature engineering, model training, hyperparameter tuning, and model evaluation.
  • Implement advanced model compression and optimization techniques for language models.
  • Contribute to the AI community through research publications, conference presentations, and open-source project participation.
  • PhD in Computer Science or a related field, or equivalent practical experience.
  • 2-5 years of machine learning engineering experience in high-velocity, high-growth companies or relevant ML research experience.
  • Experience developing AI/ML systems at scale in production or high-impact research environments.
  • Strong track record with language modeling technologies, including generative and embedding techniques.
  • Strong coding and software engineering skills, with familiarity in testing, code reviews, and deployment.
  • Experience deploying and scaling language models in production, with an understanding of infrastructure challenges.
  • Strong understanding of computer science fundamentals.
  • Prior experience with Natural Language Processing is a plus.
  • Contributions to well-used open-source projects.
  • Experience with transforming unstructured text into structured code, queries, and data.
  • Comprehensive benefits and perks tailored to employee needs.
  • Eligibility for annual performance bonus and equity.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service