Onsite-Data Integration Engineer

Beacon Hill Staffing Group - Los Angeles, CA

Full-time

Los Angeles, CA

Administrative and Support Services

About the position

The Data Integration Engineer role at Beacon Hill Technologies focuses on designing, implementing, and maintaining data integration solutions using AWS architecture and Python programming. The ideal candidate will ensure data quality and reliability while collaborating with cross-functional teams to deliver high-quality solutions on time.

Responsibilities

• Design, implement, and maintain data pipelines with safeguards for error handling and data quality monitoring.
• Write clean, efficient, and reusable Python code for scalable data pipelines.
• Manage, monitor, and troubleshoot Kafka messaging streams for data integration.
• Leverage core AWS services like Lambda, S3, Glue, RDS, and EC2 for data integration solutions.
• Identify and resolve data quality issues across multiple data sources to ensure data integrity and reliability.
• Collaborate effectively with data engineers, analysts, and product managers in a Scrum/Agile environment.

Requirements

• Strong proficiency in Python programming, focusing on design patterns for scalable data pipelines.
• Extensive experience with AWS architecture and core services such as Lambda, S3, Glue, RDS, and EC2.
• Solid experience in managing and troubleshooting Kafka messaging streams.
• Proven ability in ETL orchestration and data pipeline management, using tools like Datadog.
• Strong understanding of data quality management and monitoring.

Nice-to-haves

• Experience working in a Scrum/Agile environment.
• Proactive problem-solving skills and ability to manage multiple tasks.

Benefits

• Equal Opportunity Employer that values diversity in the workplace.