Senior Data Engineer

Marble Law Firm

Full-time - Mid Level

Professional, Scientific, and Technical Services

About the position

Marble is seeking a full-time Senior Data Engineer who is ready for a challenge and eager to design, implement, and support automation solutions that are transforming the food processing industry. As a part of the Marble team, you will leverage cutting-edge technologies to develop the next generation of automated solutions for food processing, bringing resilience to the food supply chain. The Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and infrastructure. This role involves extensive collaboration with software and computer vision teams to build scalable and efficient systems. As a data engineer, you will also be responsible for supporting Marble's data workflows, real-time processing needs, and analytics capabilities.

Responsibilities

• Design and build scalable data pipelines for real-time and batch processing
• Integrate advanced analytics and machine learning models with production systems
• Optimize and manage data storage and processing using technologies like AWS S3, MongoDB, InfluxDB, and ClickHouse
• Ensure high standards of data quality, security, and compliance
• Develop and implement data validation tests to guarantee the accuracy of analytics data
• Document and uphold data management policies and procedures

Requirements

• B.S. or M.S. degree in Computer Science, Engineering, or related field
• Strong background in Data Engineering with substantial software development experience
• Proficiency in SQL and Python
• Strong experience with AWS cloud services, particularly AWS S3, and data pipeline tools
• Experience with big data technologies like Hadoop, Spark, Kafka, and relational databases
• Knowledge of databases like MongoDB, InfluxDB, ClickHouse, and data streaming technologies
• Understanding of data quality, lineage, and governance frameworks
• Excellent problem-solving skills and the ability to work in a fast-paced environment
• Excellent communication and teamwork skills, with a willingness to take initiative and ownership of projects