Data Engineer, Azure Data Factory/Services Expert

Ecloud Labs - Dallas, TX

Full-time - Mid Level

Dallas, TX

Professional, Scientific, and Technical Services

About the position

The Azure Data Factory Expert position is designed for a data engineering professional with deep expertise in Azure Data Factory and related services. The role focuses on designing, developing, and maintaining data pipelines that integrate various services and systems in both batch and real-time environments. The candidate will work collaboratively with a high-performing team on impactful projects within a company that specializes in data engineering across multiple clients.

Responsibilities

• Design, develop, and maintain data pipelines using Azure Data Factory and Services.
• Integrate services and systems in both batch and real-time environments.
• Collaborate on-site with a team of talented data engineers to foster innovation and delivery.
• Serve the data engineering needs of multiple clients.

Requirements

• Expertise in Azure Data Factory and strong knowledge of Azure ecosystem tools (e.g., Azure Synapse, Data Lake).
• Proven experience with API integration, service connections, and large-scale systems.
• Microsoft Certified: Azure Data Engineer (or equivalent certification).
• Proficiency with RESTful APIs, JSON, and tools like Postman and Swagger.
• Proficiency in a programming language for data engineering, such as Python or Apache Spark.
• Strong familiarity with CI/CD processes, GitHub workflows, branching, and merging best practices.
• Solid knowledge of SQL and NoSQL databases and associated best practices.

Nice-to-haves

• Experience working within multi-cloud environments in addition to Azure, particularly with AWS or Google Cloud Platform.
• Working knowledge of Snowflake and familiarity with data warehousing principles.
• Familiarity with containerization and orchestration tools like Kubernetes and Docker.
• Strong problem-solving abilities and effective communication skills for articulating complex technical challenges and solutions.

Benefits

• Opportunity to work on impactful and challenging projects.
• Collaborative and innovative work environment.
• Access to professional development and training opportunities.