AI Engineer

Sidley Austin Llp - Chicago, IL

Full-time

Chicago, IL

Professional, Scientific, and Technical Services

About the position

The AI Engineer, as a vital member of the AI Engineering team, is tasked with the development and implementation of advanced legal AI solutions aimed at enhancing efficiency, improving decision-making processes, and delivering valuable insights across various administrative business groups and legal practices. This role is pivotal in leveraging expertise in AI engineering, natural language processing (NLP), and machine learning to design, develop, and deploy innovative solutions that effectively utilize both structured and unstructured data. The AI Engineer will engage in prototyping and testing AI solutions using Python and Streamlit, with a particular emphasis on natural language processing and text extraction from documents, utilizing tools such as PyPDF and Azure Document Intelligence. In addition to prototyping, the AI Engineer will be responsible for developing plugins and assistants using frameworks like LangChain, LlamaIndex, or Semantic Kernel, showcasing expertise in prompt engineering and semantic function design. A significant aspect of the role involves designing and implementing Retrieval Augmented Generation (RAG) stores, which combine classic information retrieval techniques with semantic embeddings stored in vector and graph databases. The engineer will also develop and deploy agents using AutoGen, CrewAI, LangChain Agents, and LlamaIndex Agents, employing Generative AI to extract metadata and insights from documents. Fine-tuning large language models (LLMs) to optimize performance for specific domains and cost efficiency is also a critical responsibility. Collaboration with stakeholders is essential to implement and automate AI-powered solutions for common business workflows. The AI Engineer will enhance documentation procedures, maintain the codebase, and adhere to best practices to promote knowledge sharing and ensure an organized and reproducible working environment. This role requires a proactive approach to problem-solving and a commitment to continuous improvement in AI solutions within the legal domain.

Responsibilities

• Prototype and test AI solutions using Python and Streamlit with a focus on natural language processing and text extraction from documents (PyPDF, Azure Document Intelligence)
• Develop plugins and assistants using LangChain, LlamaIndex, or Semantic Kernel, with expertise in prompt engineering and semantic function design
• Design and implement Retrieval Augmented Generation (RAG) stores using a combination of classic information retrieval and semantic embeddings stored in vector and graph databases
• Develop and deploy agents using AutoGen, CrewAI, LangChain Agents, and LlamaIndex Agents
• Use Gen AI to distill metadata and insights from documents
• Fine tune LLMs to optimize for domain and cost
• Collaborate with stakeholders to implement and automate AI powered solutions for common business workflows
• Enhance documentation procedures, codebase, and adherence to best practices to promote and facilitate knowledge sharing and ensure the upkeep of an organized and reproducible working environment

Requirements

• Bachelor's Degree in Computer Science, Engineering, or related field
• A minimum of 5 years of experience in AI engineering or a related field
• Proven experience with AI engineering tools and technologies, including Python, Streamlit, Jupyter Notebooks, Langchain, LlamaIndex, and Semantic Kernel
• Experience with natural language processing, text extraction, and information retrieval techniques
• Strong understanding of machine learning and deep learning concepts including transformer based GPT models
• Experience with distributed computing and cloud environments (e.g., Microsoft Azure)
• Strong organizational, communication, and problem-solving skills, with the ability to work harmoniously and effectively with others
• Ability to preserve confidentiality and exercise discretion, with strong attention to detail and good judgment

Nice-to-haves

• Master's Degree in Computer Science, Engineering, or related field