S2 Hr Solutions 1D - Columbus, OH
posted about 2 months ago
As a Data Engineer at ADB SAFEGATE, you will play a crucial role in designing, developing, and maintaining scalable and reliable data pipelines that process large volumes of both structured and unstructured data from various sources. Your work will involve collaborating with other teams to integrate data from IoT devices and other sources into our DataBricks platform, ensuring that the data is harmonized and maintains its integrity and accuracy throughout the processing stages. You will also be responsible for creating and maintaining data models that optimize the storage and querying of structured and semi-structured data, which is essential for efficient data management and retrieval. In addition to these responsibilities, you will focus on optimizing data processing and storage systems for performance, reliability, and scalability. Monitoring and troubleshooting performance issues in data pipelines will be a key part of your role, and you will develop solutions to address any issues that arise. Furthermore, you will document and maintain data engineering processes and methodologies, ensuring compliance with best practices and industry standards. This position offers an exciting opportunity to make a significant impact on our operations and contribute to the overall success of ADB SAFEGATE.