Staff ML Engineer

Lilt - New York, NY

Full-time - Mid Level

Remote - New York, NY

Publishing Industries

About the position

The Staff ML Engineer at LILT will play a crucial role in productizing new AI technologies and optimizing Machine Learning Operations infrastructure. This position involves collaboration with various teams to enhance the performance of Large Language Model deployments, ensuring high availability and reliability in production environments. The role is hybrid, requiring in-office work two days a week, and is based in Indianapolis, IN or Berlin, with potential remote work options in other metropolitan areas until offices are opened.

Responsibilities

• Design, maintain and optimize CI/CD pipeline and infrastructure for Large Language Model and vector database deployments.
• Collaborate with the Research and Engineering teams on infrastructure development for Lilt’s production and on-premise environments.
• Design and implement architecture to efficiently productize new AI technologies, guaranteeing high availability and reliability.
• Identify and facilitate delivery of multi-team projects on clear timelines.
• Give constructive, effective technical and organizational feedback on work product and communication.
• Work with Product to prioritize infrastructure improvements and technical debt against business requirements.

Requirements

• Bachelor’s, Master’s or equivalent in Computer Science, Statistics, or Computational Math (or equivalent industry experience in Computer Science or a related technical discipline).
• 3+ years of engineering experience.
• 2+ years experience working on a Machine Learning product.
• Experience with containerized CI/CD workflows.
• Experience with production deployment and optimization of large neural networks on accelerator hardware (GPUs).
• Experience with distributed LLM training infrastructures.
• Excellent verbal and written communication skills.
• Passion to devise solutions that require a focus on systems thinking.
• Demonstrated ability to gather, organize, and synthesize significant and diverse information.
• Strong desire to master the product that you create, and to understand the customer that uses the product.
• Experience collaborating with other engineers and researchers on large-scale machine learning systems.

Benefits

• Competitive salary
• Meaningful equity
• Flexible time off plus company holidays
• 401(k) matching
• Medical, dental, and vision insurance
• FSA/DFSA, HSA, and Commuter benefits
• Basic life insurance
• Short-term and long-term disability insurance
• Paid parental leave after 6 months
• Monthly lifestyle benefit stipend via the Fringe platform