Senior Data Engineer

Bright Vision Technologies - Los Angeles, CA

Full-time - Senior

Los Angeles, CA

About the position

The Senior Data Engineer at Bright Vision Technologies is a key role within an Agile scrum team, responsible for developing and maintaining scalable data solutions. This position focuses on building robust data pipelines and workflows using technologies such as Azure, Data Vault, Databricks, and GitHub to support business objectives. The role requires collaboration with Data Architects to ensure data quality and performance optimization.

Responsibilities

• Design and develop data pipelines to manage data flow between disparate systems.
• Build data pipelines to support analytics use cases, KPIs, or enterprise applications.
• Develop data quality metrics and perform quality control tests to verify data integrity.
• Interface with architects, product managers, and analysts to understand data needs and implement business rules into transformations.
• Document the data blending process, specifications, and workflow/data lineage.
• Perform continuous integration to ensure that every step of the pipeline is testable and automated.
• Communicate project status through Agile processes and in Jira for the cross-functional team.
• Collaborate with the business to understand backlog and refine use cases related to data management, BI reporting, and data science deliverables.
• Research source system data, architecture, and transactions.
• Lead the detailed design based on the understanding of the Logical Data Model.
• Create design documents for data integration or reporting projects.
• Develop new and improve existing processes to meet service levels.
• Analyze data integration problems, provide solutions, and recommend corrective actions.
• Analyze source system data structures and map them to target data warehouse schemas.
• Participate in design and code reviews, documentation of design, and implementation of methodologies for high-quality deployments.

Requirements

• 14+ years of experience in data engineering.
• Extensive experience with Data Vault.
• Excellent skills in requirements analysis, logical/physical modeling, data transformation, and data modeling.
• Strong understanding of technical governance design concepts.

Nice-to-haves

• Experience with Azure, Databricks, and GitHub.
• Familiarity with Agile methodologies and tools like Jira.

Benefits

• Equal employment opportunities and an inclusive work environment.