Data Engineer

Robert Half • Los Angeles, CA

441d • $150,000 - $175,000

About The Position

The Data Engineer will be responsible for developing and maintaining scalable data pipelines, supporting dynamic pricing models, and ensuring data accuracy and reliability. This role is crucial for translating data requirements into technical specifications and collaborating with data scientists and software development teams. The position offers an exciting opportunity to work in a fast-paced environment focused on data models and architecture.

Requirements

• Proficiency in Python for scripting and data manipulation.
• Proficiency in Azure Databricks for streamlined data analytics.
• Proficiency in Apache Spark to enhance data processing and analytics.
• Knowledge of Cloud Technologies for efficient data storage and retrieval.
• Strong understanding of Database systems for structured data handling.
• Experience with EO/IR systems for data collection and analysis.
• Competence in Algorithm Implementation to solve complex data problems.
• Expertise in Analytics for deriving valuable insights from data.
• Familiarity with Apache Hadoop for big data processing.
• Experience in API Development for seamless data integration and communication.
• Understanding of Machine Learning to build data models and predictive systems.
• Expertise in Power BI for data visualization and reporting.
• Familiarity with Apache Kafka for real-time data processing and streaming.

Responsibilities

• Engage with stakeholders to comprehend data requirements and translate these into technical specifications.
• Collaborate with data scientists to prepare data for model training, validation, and deployment.
• Develop and maintain scalable data pipelines to support dynamic pricing models.
• Implement and optimize ETL (Extract, Transform, Load) processes to ensure data accuracy and reliability.
• Monitor and troubleshoot data workflows to ensure continuous and reliable data integration.
• Work closely with the software development team to integrate data engineering solutions into the broader product architecture.
• Ensure data governance and compliance with relevant data privacy and security regulations.
• Document data engineering processes and contribute to best practices.

Benefits

• Medical insurance
• Vision insurance
• Dental insurance
• Life insurance
• Disability insurance
• 401(k) plan

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Administrative and Support Services
• Education Level: No Education Listed