Azure Data Engineer - W2 (H1B/OPT) Accepted

Xcelo Group - Austin, TX

Full-time - Mid Level

Remote - Austin, TX

Professional, Scientific, and Technical Services

About the position

We are seeking a skilled Azure Data Engineer to join our team in Austin, TX, with the flexibility of remote work. In this full-time position, you will be responsible for designing, developing, and maintaining our data infrastructure on Microsoft Azure. Your role will involve close collaboration with data scientists, software engineers, and product managers to ensure that our data systems are robust, scalable, and efficient. You will play a critical role in shaping our data strategy and ensuring that our data architecture supports our business objectives. As an Azure Data Engineer, you will design and implement data pipelines and ETL processes that are essential for data integration and processing. You will work on optimizing data storage and retrieval processes to enhance performance and scalability. Additionally, you will be responsible for implementing and managing data security measures to ensure data privacy and compliance with relevant regulations. Writing clean, maintainable, and well-documented code is a key expectation, as is conducting code reviews to foster a collaborative development environment. You will also be tasked with troubleshooting and debugging complex technical issues related to data processing, ensuring that our data systems operate smoothly. Staying up-to-date with the latest advancements in Azure data services and related technologies will be crucial for your success in this role. We are looking for someone who is not only technically proficient but also possesses strong communication and collaboration skills to work effectively within our team.

Responsibilities

• Design, develop, and maintain data pipelines and ETL processes on Microsoft Azure.
• Collaborate with data scientists and analysts to understand data requirements and build data models.
• Optimize data storage and retrieval processes for performance and scalability.
• Implement and manage data security measures to ensure data privacy and compliance.
• Write clean, maintainable, and well-documented code, adhering to best practices.
• Conduct code reviews and contribute to a collaborative development environment.
• Troubleshoot and debug complex technical issues related to data processing.
• Stay up-to-date on the latest advancements in Azure data services and related technologies.

Requirements

• 5+ years of experience as a Data Engineer, with a focus on Azure.
• In-depth knowledge of Azure data services (e.g., Azure Data Factory, Azure SQL Database, Azure Synapse Analytics).
• Proficiency in programming languages such as Python, SQL, or Scala.
• Experience with big data technologies (e.g., Hadoop, Spark) and data warehousing solutions.
• Familiarity with data modeling, ETL processes, and data integration techniques.
• Proficiency in version control systems (Git) and familiarity with CI/CD pipelines.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
• Experience with data governance and compliance is a plus.
• Relevant certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.