Bloomberg - New York, NY

posted 5 months ago

Full-time - Senior
New York, NY
251-500 employees
Broadcasting and Content Providers

About the position

Bloomberg's Engineering AI department is at the forefront of innovation, with over 300 AI practitioners dedicated to developing cutting-edge products and features that leverage advanced technologies. As a Senior LLM Engineer, you will play a pivotal role in this dynamic environment, contributing to teams of Machine Learning (ML) and Software Engineers focused on delivering AI-driven solutions for customer-facing products. Our commitment to enhancing search, discovery, and workflow solutions is evident in our investment in technologies such as transformers, gradient boosted decision trees, large language models (LLMs), and dense vector databases. Since 2009, Bloomberg has been a leader in building Artificial Intelligence applications that address the challenges of processing and organizing vast amounts of structured and unstructured information. Our AI systems are designed to provide high accuracy and low latency, enabling our clients to make informed decisions based on analytics about financial instruments across various asset classes. The emergence of LLMs presents exciting opportunities to expand our natural language processing (NLP) capabilities, and as a Senior LLM Platform Engineer, you will have the chance to influence the future of our infrastructure for LLM training and inference. In this role, you will be responsible for building production LLM systems that power essential business functions within the Bloomberg Terminal. You will optimize and support LLM workloads in both on-premises high-performance computing (HPC) and cloud environments, while also contributing to internal initiatives related to LLM research and development. Working with specialized hardware for tensor computations will be a key aspect of your responsibilities, allowing you to leverage your expertise in ML applications and model architectures.

Responsibilities

  • Build production LLM systems to power business functions in the Bloomberg Terminal
  • Optimize and support LLM workloads in on-prem HPC and cloud environments
  • Contribute to internal initiatives related to LLM research and development
  • Work with specialized hardware for tensor computations

Requirements

  • 4+ years of programming experience with an object-oriented programming language
  • A degree in Computer Science, Engineering or similar field of study or equivalent work experience
  • Experience in designing, developing, and supporting ML applications
  • Understanding of ML model architectures, specifically, transformers, and underlying computations
  • Experience in profiling, benchmarking and optimizing ML applications

Nice-to-haves

  • Deep working proficiency in Python
  • Experience in using HPC compute platforms and understanding anatomy of distributed computations
  • Proficiency with various ML accelerators (NVIDIA GPUs, TPUs, other vendor ASICs) and building efficient workloads for them
  • Solid understanding of networking (Infiniband, AWS EFA, RoCE)
  • Experience managing infrastructure in Amazon Web Services (AWS), Microsoft Azure, or Google Cloud Platform (GCP)

Benefits

  • Comprehensive and generous benefits plan
  • Merit increases
  • Incentive compensation for exempt roles
  • Paid holidays
  • Paid time off
  • Medical, dental, and vision insurance
  • Short and long term disability benefits
  • 401(k) with matching
  • Life insurance
  • Various wellness programs
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service