Yoh Services - Irving, TX

posted 26 days ago

Full-time
Irving, TX
Administrative and Support Services

About the position

The Azure Data Engineer role involves designing, building, and maintaining scalable data pipelines in Azure, ensuring compliance with security and privacy standards. The position requires active participation in data governance initiatives and collaboration with various teams to enhance data accessibility and quality. The engineer will also be responsible for troubleshooting data pipeline issues and improving data reliability and efficiency.

Responsibilities

  • Design, build & maintain scalable data pipelines in Azure.
  • Contribute to data & application governance initiatives by implementing policies and best practices.
  • Implement API-based integrations to manage increasing data volume and complexity.
  • Collaborate with report developers/analysts and business teams to enhance data models for BI tools.
  • Build and maintain infrastructure for optimal data extraction, transformation, and loading using Python and SQL.
  • Assist in designing processes to monitor data quality and ensure accuracy for stakeholders.
  • Troubleshoot data pipeline issues and oversee their resolution.
  • Identify improvements for data reliability, efficiency, and quality.
  • Collaborate with business units and development teams to strategize long-term data platform architecture.
  • Integrate external data sources from various formats.

Requirements

  • BS or MS degree in Computer Science or related field.
  • 3+ years with data processing systems in Azure (Data Factory, Data Lake storage, Data Bricks, Event Hubs).
  • 5+ years of database architecture and dimensional data modeling experience.
  • 5+ years of data migration activities.
  • 5+ years of experience with Python and SQL.
  • 3+ years working in an Agile development environment with DevOps and CI/CD pipelines.
  • Experience supporting integrations in/out of ERP systems (e.g., NetSuite, SAP).
  • Mastery in converting raw data into valuable datasets.
  • Familiarity with DevOps tools (Git, Jenkins, CI/CD, Jira).

Benefits

  • Equal Opportunity Employer
  • Consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service