GenAI Engineer

$200,000 - $300,000/Yr

Connections Personnel Of New York - New York, NY

Full-time - Mid Level

New York, NY

Administrative and Support Services

About the position

The GenAI Engineer will be part of the Generative AI Technology team, responsible for conceptualizing and developing the firm's Generative AI platform. This role involves designing, prototyping, deploying, and optimizing solutions that leverage large language models (LLMs) to enhance the firm's operations and integrate AI technology into various applications.

Responsibilities

• Architect, build, maintain, deploy, and support the internal GenAI platform including APIs, SDKs, and services.
• Design and build advanced GenAI plugins and services to streamline workflows and solve complex challenges.
• Conduct code reviews and PR reviews for team contributions and inner source contributors.
• Collaborate with the DevOps team to develop and maintain efficient CI/CD pipelines and processes.
• Work with the Cloud Engineering team to build and maintain a multi-cloud platform, leveraging model offerings across multiple cloud providers.
• Collaborate with research, product, data, and UI/UX teams to ensure platform requirements are met.
• Implement best practices for Vector DB architecture, including data modeling and query optimization.
• Stay updated on generative AI and LLMs, collaborating with the research team to offer timely capabilities on the platform.
• Produce clear and detailed design and technical documentation for APIs and platform capabilities.

Requirements

• Bachelor's degree in computer science, artificial intelligence, machine learning, or related field.
• 2+ years of experience working with LLMs, Natural Language Processing (NLP), and/or prompt engineering.
• 5+ years of industry experience in Python development.
• Strong experience designing SDKs and REST APIs for internal business applications and third-party vendors.
• Experience with system architecture design and deploying scalable, reliable systems in production environments.
• Strong tactical and strategic planning skills with attention to detail.
• Experience with FastAPI, Pydantic, SQLAlchemy, Pandas, Poetry.
• Familiarity with cloud provider services including Azure OpenAI, AWS Bedrock, or GCP Vertex.
• Familiarity with Datadog, Alembic, PostgresSQL, Celery, AWS, Redis, and Jinja.
• Familiarity with DevOps tools such as Jenkins, GitHub Actions, Artifactory, Helm.
• Ability to lead by example and explain technical concepts to various stakeholders.