Senior Data & ML Engineer

Intelliswift Software - Seattle, WA

Full-time - Senior

Seattle, WA

Professional, Scientific, and Technical Services

About the position

The Senior Data & ML Engineer position is a hybrid role that requires a curious, driven, and passionate individual with a strong background in big data technologies and MLOps. This role is pivotal in participating in the full-cycle management of big data, processing, infrastructure, and machine learning system design. The primary objective is to build mission-critical, high-volume ML/AI applications that optimize the delivery of relevant advertising experiences to customers. As a Senior Engineer, you will be expected to balance hands-on building with influencing the direction of projects and technologies used within the team. In this role, you will collaborate closely with product teams, software engineers, data engineers, and scientists to design and develop highly scalable and robust data and ML platforms. These platforms will serve analytics and production AI/ML models aimed at optimizing advertising reach, frequency, and return on advertising spend. You will be responsible for building scalable and reliable data pipelines that efficiently ingest and process large volumes of data from various sources and formats, ensuring continuous integration with both internal and external systems. Additionally, you will design and construct large-scale data repositories that will serve as a knowledge base for Generative AI applications. The position requires a comprehensive understanding of the software development lifecycle, from design and implementation to testing and deployment. You will leverage your experience with distributed systems and parallel computing frameworks to scale ML workloads and design effective ML systems. Your proficiency in SQL and at least one programming language such as Python, Java, or Scala will be essential in executing your responsibilities effectively. Experience with cloud services like AWS, Azure, or GCP is also a critical component of this role.

Responsibilities

• Pair with product teams, software engineers, data engineers, and scientists to design and develop highly scalable and robust data and ML platforms.
• Build scalable and reliable data pipelines that efficiently ingest and process large volumes of data from disparate sources and formats.
• Continuously integrate data pipelines with internal and external systems.
• Design and build large-scale data repositories as a knowledge base for Generative AI applications.

Requirements

• 5+ years of experience as an ML Engineer, Data Engineer, Software Engineer, or in a similar role.
• Familiarity with the full life cycle of software development, from design and implementation to testing and deployment.
• Experience with distributed systems and distributed parallel computing frameworks (e.g., Apache Spark, Apache Ray, Dask, etc.).
• Experience with scaling ML workloads, MLOps, and designing ML systems.
• Experience with data modeling, data warehousing, and designing ETL workflows.
• Proficiency in SQL.
• Proficiency in at least one software programming language such as Python, Java, or Scala.
• Experience working with cloud services (AWS, Azure, GCP, etc.).

Nice-to-haves

• Experience working with the AWS ecosystem and development with AWS CDK.
• Knowledge of Data Privacy, Security, Risk, and Compliance best practices.
• Experience in machine learning, data mining, information retrieval, statistics, or natural language processing.
• Experience with LLM fine-tuning, developing, evaluating, and deploying LLM for real-world applications.