Software Engineer - Machine Learning Pipelines

$120,000 - $170,000/Yr

RWE - Bellevue, WA

Full-time - Mid Level

Hybrid - Bellevue, WA

1,001-5,000 employees

Specialty Trade Contractors

About the position

RWE Supply & Trading Americas, LLC is seeking a highly motivated software engineer to join their core AI Lab team. This role focuses on designing and implementing production-grade pipelines for machine learning models, contributing to innovative solutions in the renewable energy sector. The successful candidate will work closely with senior scientists and engineers, playing a pivotal role in architecting, developing, and optimizing end-to-end pipelines that enable the deployment and scaling of advanced machine learning solutions.

Responsibilities

• Design, develop, and operate complex machine learning and multi-faceted data fusion pipelines in a production environment
• Collaborate closely with data scientists, machine learning engineers, and scientists to integrate machine learning models into scalable production systems
• Develop reusable components, libraries, and frameworks to streamline pipeline development and maintenance
• Optimize pipeline performance, reliability, and resource utilization
• Expand knowledge of the latest advancements in machine learning technologies, cloud services, and software engineering best practices
• Contribute to a team culture where diverse viewpoints, backgrounds, and expertise are welcomed

Requirements

• 2+ years of experience building, deploying, and monitoring complex pipelines that operate at an hours-level cadence
• Experience in large scale data processing and distributed systems such as Apache Spark
• Proficiency in Python, Julia, and/or Mojo
• Experience with cloud computing platforms such as AWS, Azure, or Google Cloud Platform
• Strong understanding of containerization technologies (Docker, Kubernetes) and orchestration tools
• Familiarity with version control systems (e.g., Git), continuous integration/continuous deployment (CI/CD) pipelines, and infrastructure-as-code tools
• Excellent problem-solving skills, attention to detail, and a passion for learning and innovation
• Strong communication and collaboration skills, with the ability to work effectively in cross-functional teams

Nice-to-haves

• Experience with stream processing frameworks (e.g., Apache Kafka, Apache Flink) for real-time data ingestion and processing
• Knowledge of serverless computing and event-driven architectures for building scalable and cost-effective pipelines
• Experience with Google Cloud Platform MLOps tools (e.g., Vertex AI)
• Familiarity with monitoring, logging, and debugging tools for distributed systems (e.g., Prometheus, ELK Stack)
• Proficiency in database technologies for data storage and retrieval (e.g., PostgreSQL, MongoDB, BigQuery)
• Understanding of security best practices for securing data pipelines
• Expertise working with large geospatial weather and climate datasets as well as the Pangeo stack

Benefits

• Task oriented and hybrid working model
• Diverse and multicultural team in a highly dynamic and rapidly growing business
• Relocation expenses for moving to the greater Seattle area
• Competitive salary range of $120,000 - $170,000
• Supportive and inclusive work environment
• Excellent development prospects and attractive remuneration package