Data Engineering Senior Manager

$135,000 - $227,500/Yr

PepsiCo - Plano, TX

Full-time - Senior

Remote - Plano, TX

Beverage and Tobacco Product Manufacturing

About the position

This position is focused on designing and implementing data processing pipelines using Databricks, Spark, Python, and other tools within the Azure ecosystem. The role involves collaborating with various stakeholders to ensure high-quality solutions through code reviews and adherence to engineering best practices. The individual will have the opportunity to lead projects and coordinate with teams to maintain best practices and standards for the Enterprise Data Warehouse and Azure Data Lake.

Responsibilities

• Lead delivery of key Enterprise Data Warehouse and Azure Data Lake projects within time and budget.
• Drive solution design and build to ensure scalability, performance, and reuse of data and other components.
• Ensure on-time and on-budget delivery that satisfies project requirements while adhering to enterprise architecture standards.
• Oversee coordination and partnerships with Business Relationship Managers, Architecture, and IT services teams to develop and maintain EDW and data lake best practices and standards along with appropriate quality assurance policies and procedures.
• May lead a team of employee and contract resources to meet build requirements, setting priorities for the team to ensure task completion and coordinating work activities with other IT services and business teams.
• Hold team accountable for milestone deliverables.

Requirements

• Bachelors or Masters degree in Computer Science, MIS, Business Management, or related field required.
• 16+ years of experience in Information Technology or Business Relationship Management.
• 10+ years of experience in Data Warehouse/Azure Data Lake; 2+ years of big data experience.
• Minimum 6 years of experience as project lead.
• Solutions Delivery experience in Data, BI or Analytics projects - expertise in system development lifecycle, integration, and sustainability.
• Strong programming experience in Python/Scala/SQL.
• Experience working with Big Data processing frameworks within Azure (BLOB/ADLS, Databricks/Spark, Azure Data Factory, etc.).
• Experience working with Data Warehousing platforms and projects (experience with star schemas, slowly changing dimensions, etc.).
• Experience working with Big Data streaming services and tools such as Kafka, Spark Streaming, etc.
• Thorough knowledge of data warehousing and data lake concepts.

Nice-to-haves

• Excellent remote collaboration skills.
• Experience working in a matrix organization with diverse priorities.
• Experience dealing with and managing multiple vendors.
• Exceptional written and verbal communication skills along with collaboration and listening skills.
• Ability to work with agile delivery methodologies.
• Ability to ideate requirements & design iteratively with business partners without formal requirements documentation.
• Ability to budget resources and funding to meet project deliverables.
• Excellent problem-solving and interpersonal skills.

Benefits

• Medical, Dental, Vision, Disability, Health, and Dependent Care Reimbursement Accounts.
• Employee Assistance Program (EAP).
• Insurance (Accident, Group Legal, Life).
• Defined Contribution Retirement Plan.
• Paid time off including paid parental leave, vacation, sick, and bereavement.