Cloud Data Engineer

Metas Solutions - Atlanta, GA

Full-time - Mid Level

Atlanta, GA

Professional, Scientific, and Technical Services

About the position

The Cloud Data Engineer at Metas Solutions will play a crucial role in facilitating the coordination and implementation of the CDC's AI/ML strategy and enterprise roadmap. This position involves project management activities, data science support, and the development of training materials for both internal and external partners. The role requires collaboration with various stakeholders, including CDC programs and governance bodies, in a remote work environment.

Responsibilities

• Work with a multi-disciplinary team of scientists, data engineers, developers, and data consumers in a fast-paced, Agile environment.
• Monitor and optimize data pipelines for performance, scalability, and cost-effectiveness.
• Support the assessment, design, development, and maintenance of scalable platforms for clients.

Requirements

• Bachelor's Degree with 3+ years of experience in extract, transform, load (ETL) operations focusing on Azure technologies.
• 2+ years of experience with source control and collaboration software, including Git or Atlassian tools.
• Knowledge of Azure Batch and its application in processing large data sets.
• Experience with SQL and relational databases (e.g., Azure SQL Database, SQL Server).
• Experience with Python or R, including data manipulation libraries (e.g., Pandas, NumPy, Polars, Tidyverse).
• Strong problem-solving skills and ability to work independently and in a team environment.
• Proficiency in Azure Data Factory and its components.

Nice-to-haves

• Experience with developing pipelines utilizing Azure Batch and Azure Data Factory.
• Familiarity with Apache Airflow or similar workflow orchestration tools.
• Experience with Azure Synapse Analytics, Azure Databricks, or Azure Blob Storage.
• Familiarity with cloud security best practices and data governance.
• Ability to quickly learn technical concepts and communicate with multiple functional groups.

Benefits

• Market competitive salary, commensurate with experience and education.
• Comprehensive benefits package including Medical, Dental, Vision, and Life Insurance.
• Paid Time Off (PTO).
• 401K with company match.
• Growth and promotion opportunities.