Azure Cloud Technical Specialist

HCL Technologies - Phoenix, AZ

Full-time

Phoenix, AZ

10,001+ employees

Professional, Scientific, and Technical Services

About the position

HCLTech is seeking a highly talented and self-motivated Microsoft Azure Cloud Lead / Technical Specialist to join its team in advancing the technological world through innovation and creativity. In this role, you will be responsible for developing and maintaining data pipelines that ingest, transform, and load data from various sources. You will design and manage scalable data lakes to support comprehensive data storage and analysis needs, ensuring that data retention, lifecycle, and archival policies for datasets are effectively implemented. Your expertise will be crucial in working with Azure Data Lake Storage to efficiently store and manage large datasets. You will create and manage data models and data warehouses to support business intelligence and analytics needs, setting up and managing external tables while integrating with various data sources. Utilizing Delta Lake, you will optimize data storage and enable real-time analytics capabilities. Additionally, you will develop and deploy interactive and visually compelling reports and dashboards using Power BI, and utilize Azure Databricks for advanced data processing. Your role will also involve optimizing and managing Azure SQL databases to ensure high performance and availability, implementing CI/CD pipelines using Azure DevOps to streamline development and deployment processes, and ensuring data security and compliance with relevant regulations and best practices, such as NIST. You will also set up Azure Purview for data governance and have experience with data integration and migration from on-premises to cloud environments. Proficiency in Python and experience with Python Notebooks, as well as scripting and automation skills (Power Shell, ARM templates, Terraform), are essential. Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus.

Responsibilities

• Develop and maintain data pipelines to ingest, transform, and load data from various sources.
• Design and manage scalable data lakes to support comprehensive data storage and analysis needs.
• Design retention, lifecycle, archival policies for datasets.
• Work with Azure Data Lake Storage to efficiently store and manage large datasets.
• Create and manage data models and data warehouses to support business intelligence and analytics needs.
• Set up and manage external tables and integrate with various data sources.
• Utilize Delta Lake for optimized data storage and real-time analytics capabilities.
• Develop and deploy interactive and visually compelling reports and dashboards using Power BI.
• Utilize Azure Databricks for advanced data processing.
• Optimize and manage Azure SQL databases to ensure high performance and availability.
• Implement CI/CD pipelines using Azure DevOps to streamline development and deployment processes.
• Ensure data security and compliance with relevant regulations and best practices (e.g., NIST).
• Setup Azure Purview for data governance.
• Experience with data integration and migration from on-premises to cloud environments.

Requirements

• Experience in developing and maintaining data pipelines.
• Proficiency in designing and managing scalable data lakes.
• Knowledge of data retention, lifecycle, and archival policies.
• Experience with Azure Data Lake Storage.
• Ability to create and manage data models and data warehouses.
• Experience in setting up and managing external tables and integrating with various data sources.
• Proficiency in utilizing Delta Lake for optimized data storage.
• Experience in developing and deploying reports and dashboards using Power BI.
• Proficiency in Azure Databricks for advanced data processing.
• Experience in optimizing and managing Azure SQL databases.
• Knowledge of implementing CI/CD pipelines using Azure DevOps.
• Understanding of data security and compliance regulations (e.g., NIST).
• Experience with data integration and migration from on-premises to cloud environments.
• Proficiency in Python and experience with Python Notebooks.
• Proficiency in scripting and automation (Power Shell, ARM templates, Terraform).

Nice-to-haves

• Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus.

Benefits

• Continuous opportunities for career development and learning.
• Transparent communication with senior-level employees.
• Opportunities to experiment in different roles or pivot industries.