Engineer 4, Engineering Operations

Comcast - Philadelphia, PA

Full-time - Mid Level

Philadelphia, PA

11-50 employees

Broadcasting and Content Providers

About the position

The position involves serving as a technical expert within project teams at Comcast, focusing on troubleshooting operational issues, providing technical solutions, and contributing to the implementation of new products. The role requires interfacing with vendors and engineering teams, ensuring compliance with technical standards, and providing leadership to junior engineers. The position emphasizes the importance of collaboration and innovation in a complex environment.

Responsibilities

• Deploy, schedule, and monitor ETL workflows on cloud platforms like Databricks, AWS Glue, and AWS EMR.
• Design, deploy, and manage AWS Lambda functions using Java.
• Configure AWS Application Gateway to expose Lambda functions as external APIs.
• Conduct research and develop proof-of-concepts to evaluate their potential impact on data infrastructure.
• Manage and maintain web application infrastructure, including servers, databases, and network components.
• Architect, develop, and deploy high-availability web applications with Angular frontends and Spring Boot backends.
• Monitor web application performance and troubleshoot issues to minimize downtime.
• Mentor junior Data Engineers and web application developers, providing technical guidance and fostering a collaborative environment.
• Build and maintain scalable and efficient data pipelines using Apache Spark and Scala.
• Extract, transform, and load data from diverse sources, including S3, APIs, and databases.
• Optimize Databricks cluster performance and resource allocation.

Requirements

• Strong proficiency in data engineering principles, ETL processes, and data warehousing concepts.
• Expertise in Apache Spark, Scala, Java, Python, and SQL/NoSQL databases.
• Strong proficiency with cloud platforms, particularly AWS (EC2, S3, Lambda, Glue, EMR, Athena, SNS, CloudWatch).
• Expert in web development frameworks like Angular and Spring Boot and CI/CD tools.
• Strong problem-solving and analytical skills.
• Excellent communication and collaboration skills.
• Preferably AWS Certified Solution Architect.

Nice-to-haves

• Experience with Amazon Quicksight.
• Familiarity with Databricks Platform.

Benefits

• Comprehensive health insurance coverage.
• 401k retirement savings plan.
• Paid time off and holidays.
• Tuition reimbursement for further education.
• Employee discounts on Comcast services.