Sr Lead Data Engineer - Cloud

About the position

Cox Enterprises' Data Solutions Team is currently looking for a Senior Lead Data Engineer - Cloud to join our team in Atlanta, GA. The Senior Lead Cloud Data Engineer will end-to-end responsibility for new projects, processes, standards, and the continuous improvement of data and analytics solution delivery across customer portfolios, business partners, and internal initiatives. Additionally, this position will guide data analytics resources to deliver and support solutions that exceed stakeholder needs. This role will solve unique, significant, complex problems and drive creative solutions to provide consistent and standardized data solutions. The Senior Lead Cloud Data Engineer will have hands-on technical and functional experience with cloud platforms (i.e. Oracle, Azure, Amazon Web Services, Informatica), and functional familiarity with self-service tools (i.e. Tableau, Microsoft Power BI, Alteryx) to support stakeholder requirement. This role will have a history of independent judgment and decision-making across a large span of influence.

Responsibilities

• Coach, mentor, and develop cloud engineering and platform skills of Data Engineer resources.
• Lead large, complex technology engagements, roadmaps and strategy requiring in-depth data evaluation and critical thinking.
• Provide expert knowledge of modern cloud data architecture patterns and solutions.
• Understand the 'big picture' to assess impacts across the Business Intelligence platforms, Corporate IT solutions, and platforms in the Enterprise.
• Recommend technical design consistent with industry best-practices and Cox standards and Industry standards for cloud platforms conforming.
• Partner with Leadership, Portfolio, Enterprise Architecture, Analytics, Security, and Data Governance teams to collaborate on platform solutions and direction and analytics and reporting opportunities and priorities.
• Understand Agile software methodology and tools, encouraging an iterative mindset as the team prepares for a broad transition to agile.
• Develop an understanding of Cox Enterprises applications and their interdependencies with source applications, customers, and business processes within the areas they support.
• Identify solution architectural issues and propose alternative solutions.
• Interact and build trusted relationships with all levels of personnel, including management, from both business and technology teams.
• Know how to identify and mitigate risks and escalate potential business issues.
• Perform data integrations into Microsoft Fabric, including data sourcing and Fabric ETL development/set-up.
• Support data engineering for analytics products, including transformations, table views, or other needs to enable analytics products developed within lakehouse medallion architecture.
• Monitor and optimize the performance of data pipelines and storage solutions.
• Implement and enhance Data Reliability Engineering (DRE) practices.
• Help prepare Features and User Stories, functional and technical designs, test scenarios, and deployment plans related to the data platform.
• Perform gap analysis related to data processes and database table structures that populate reporting and analytics requirements.
• Construct, manage, monitor, and support data integration between multiple systems.

Requirements

• Bachelor's degree in a related discipline and 8 years' experience in a related field.
• Minimum of 8 years of experience as a Data Engineer, with a strong focus on Microsoft Azure.
• 5+ years of experience in Azure services (ADLS, ADF, DevOps, etc.).
• 1+ years' hands-on experience in architecting and building cloud solutions from end to end with Microsoft Azure and Fabric or Databricks platforms.
• 7+ years of Experience implementing modern cloud-based solution/platform (AWS, Azure, GCP).
• 8+ years of experience in designing and implementing ETL/ELT pipelines using ADF, integrating with other Azure services.
• 7+ years of Python development experience. Should have capability of developing own libraries.
• 4+ years of working in Spark applications (in Python/Scala) for data transformation and integration with cloud services and proficiency in PySpark.
• Experience with or knowledge of Agile Software Development methodologies.

Nice-to-haves

• Technical Skills: Azure networking, security (RBAC, Azure AD), Infrastructure as Code, CI/CD.
• Certifications: Microsoft Certified: Azure Solutions Architect or equivalent.
• Advanced level proficiency ETL / Data Orchestration technology (i.e. Azure Data Factory, SSIS, Informatica, Alteryx, Ab Initio, Pentaho, Talend), data processing, ETL pipelines, and big data technologies.
• Familiarity with designing and building APIs, ETL and data ingestion processes and utilization of tools to support enterprise solutions.
• Experience in performance tuning, query optimization, security, monitoring, and release management.
• Experience in cloud native technologies and patterns (AWS, Google Cloud).
• Experience in driving and/or influencing the data strategy of your team or organization.
• Familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST).

Benefits

• Flexible vacation policy allowing employees to take as much vacation with pay as they deem consistent with their duties.
• Seven paid holidays throughout the calendar year.
• Up to 160 hours of paid wellness annually for their own wellness or that of family members.
• Additional paid time off in the form of bereavement leave, time off to vote, jury duty leave, volunteer time off, military leave, and parental leave.
• Health care insurance (medical, dental, vision).
• Retirement planning (401(k)).
• Paid days off (sick leave, parental leave, flexible vacation/wellness days, and/or PTO).