MongoDB - New York, NY
posted 4 months ago
At MongoDB, we are at the forefront of innovation in the data management software market, which is projected to grow significantly in the coming years. Our Data Pipelines Engineering team plays a crucial role in this transformation by building ETL pipelines that populate our Internal Data Platform. This platform is essential for driving analytics that enhance the efficiency of our operations. We focus on creating highly performant and scalable processes that can handle massive datasets, making them readily available for querying in an optimal manner. Additionally, we are developing a Generative AI framework that empowers teams across the company to leverage the data stored in their Retrieval-Augmented Generation (RAG)-based applications. As a Senior Data & AI Engineer, you will be responsible for innovating strategies for building AI tools, including optimizing the chunking and retrieval of RAG-based data. You will evaluate and incorporate new concepts and tools into MongoDB's internal AI architecture while staying updated on industry trends in the AI space. Understanding the potential dangers associated with chatbots is critical, and you will build guardrails to mitigate these risks. Your role will also involve creating solutions that assess the content returned by AI tools using various frameworks, ensuring that the evaluation results help prevent hallucinations. Collaboration is key in this position, as you will work closely with Security and Compliance teams to ensure that datasets comply with appropriate permissions and regulations. You will also partner with our Data Platform, Architecture, and Governance teams to enhance the scalability, consumability, and discoverability of our data. This role is designed for someone who is passionate about data and AI, and who is eager to contribute to the development of cutting-edge solutions that drive MongoDB's success.