Beacon Hill Staffing Group - Santa Fe, NM

posted 2 months ago

Full-time
Remote - Santa Fe, NM
Administrative and Support Services

About the position

The position involves building and supporting data pipelines and applications, primarily using Azure Data Factory or Apache Airflow. The role requires monitoring these workflows to ensure their efficiency and effectiveness in handling data processing tasks.

Responsibilities

  • Build data pipelines and applications using Azure Data Factory or Airflow.
  • Monitor and support data workflows to ensure optimal performance.
  • Utilize Kubernetes for orchestration and containerization of applications.
  • Develop and manage APIs for data integration and processing.

Requirements

  • 5+ years of experience in Azure and data pipeline development.
  • Proficiency in Azure Data Factory and Apache Airflow.
  • Strong skills in Python and Spark for data processing.
  • Experience with Kubernetes orchestration and containerization.
  • Familiarity with building, creating, and calling APIs.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service