Backend Cloud Infrastructure Engineer

About the position

Bentley Systems, Inc is a global software development company that provides innovative software solutions for infrastructure professionals. We are looking for an experienced Senior Software Engineer to join our Transportation AI team. This is a great opportunity to work with cutting-edge cloud platforms within Google Cloud Platform and the latest technologies, while building robust and reusable components and backend APIs for our Portals.

Responsibilities

• Design, develop, and maintain our massive data ingestion pipelines to ensure continuous and reliable flow of image/video/GIS data into our cloud based datastores.
• Implement and manage data workflows using Apache Airflow to automate, schedule, and monitor data pipelines, ensuring efficient data processing and timely delivery.
• Architect and manage scalable and efficient cloud data storage solutions (preferably GCP).
• Work closely with data scientists, operational analysts, and other stakeholders to integrate data from various sources, including video/GIS, ensuring data consistency, quality, and reliability.
• Optimize data pipelines and storage solutions for performance, scalability, and cost-efficiency.
• Implement and enforce data security measures, ensuring compliance with industry standards and regulations.
• Develop automation scripts and monitoring tools to ensure the smooth operation of data pipelines and quickly identify and resolve issues.
• Work closely with the cross functional teams to understand data requirements.
• Build and maintain RESTful APIs to enable seamless access to data, ensuring reliability, high availability and security.
• Maintain comprehensive documentation of data engineering processes, architectures, and best practices.

Requirements

• BS in computer science or equivalent degree with at least 10 years of experience as a software engineer in data engineering work on revenue generating projects.
• Significant experience with Python, Java/Scala programming languages.
• Experience with programming GIS/Map Engines.
• Several years of creating/supporting APIs and throughput optimization.
• Good understanding of data structures, multi-threaded programming and other core computer science fundamentals.
• Experience architecting and implementing cloud native distributed systems with a focus on massive data (100s of TB of data per month).

Nice-to-haves

• Understanding of Kubernetes and deployment of distributed data pipelines.
• Understanding of machine learning fundamentals.

Benefits

• A great Team and culture.
• An exciting career as an integral part of a world-leading software company providing solutions for architecture, engineering, and construction.
• Competitive Salary and benefits.
• The opportunity to work within a global and diversely international team.
• A supportive and collaborative environment.
• Colleague Recognition Awards.