Data Engineering Senior Manager

$135,000 - $227,500/Yr

PepsiCo - Plano, TX

Full-time - Senior

Remote - Plano, TX

Beverage and Tobacco Product Manufacturing

About the position

The Data Engineering Senior Manager will lead the design and implementation of data processing pipelines using tools such as Databricks, Spark, and Python within the Azure ecosystem. This hybrid role requires collaboration with various stakeholders to ensure high-quality solutions and adherence to enterprise architecture standards. The position involves overseeing key projects related to the Enterprise Data Warehouse and Azure Data Lake, ensuring timely and budget-compliant delivery while managing a team of resources.

Responsibilities

• Lead delivery of key Enterprise Data Warehouse and Azure Data Lake projects within time and budget
• Drive solution design and build to ensure scalability, performance and reuse of data and other components
• Ensure on time and on budget delivery which satisfies project requirements, while adhering to enterprise architecture standards
• Oversee coordination and partnerships with Business Relationship Managers, Architecture and IT services teams to develop and maintain EDW and data lake best practices and standards along with appropriate quality assurance policies and procedures
• May lead a team of employee and contract resources to meet build requirements
• Set priorities for the team to ensure task completion
• Coordinate work activities with other IT services and business teams
• Hold team accountable for milestone deliverables

Requirements

• Bachelors or Masters degree in Computer Science, MIS, Business Management, or related field required
• 16+ years of experience in Information Technology or Business Relationship Management
• 10+ years of experience in Data Warehouse/Azure Data Lake; 2+ years of big data experience
• Minimum 6 years of experience as project lead
• Solutions Delivery experience in Data, BI or Analytics projects - expertise in system development lifecycle, integration, and sustainability
• Strong programming experience, Python/Scala/SQL
• Experience working with Big Data processing frameworks within Azure (BLOB/ADLS, Databricks/Spark, Azure Data Factory, etc.)
• Experience working with Data Warehousing platforms and projects (experience with star schemas, slowly changing dimensions, etc.)
• Experience working with Big Data streaming services and tools such as Kafka, Spark Streaming, etc.
• Thorough knowledge of data warehousing and data lake concepts

Nice-to-haves

• Excellent remote collaboration skills
• Experience working in a matrix organization with diverse priorities
• Experience dealing with and managing multiple vendors
• Exceptional written and verbal communication skills along with collaboration and listening skills
• Ability to work with agile delivery methodologies
• Ability to ideate requirements & design iteratively with business partners without formal requirements documentation
• Ability to budget resources and funding to meet project deliverables
• Excellent problem-solving and interpersonal skills

Benefits

• Medical, Dental, Vision, Disability, Health, and Dependent Care Reimbursement Accounts
• Employee Assistance Program (EAP)
• Insurance (Accident, Group Legal, Life)
• Defined Contribution Retirement Plan
• Paid time off including paid parental leave, vacation, sick, and bereavement
• Bonus based on performance and eligibility; target payout is 15% of annual salary paid out annually