Data Engineer

Meta - Fremont, CA

Full-time

Fremont, CA

Web Search Portals, Libraries, Archives, and Other Information Services

About the position

As a Data Engineer on the Meta Data Center's Data Science team, you will play a crucial role in supporting the growth of Meta's Data Center organization. Your primary responsibilities will include creating technology and data architecture, translating business needs into requirements, and building extensible data models. You will work closely with stakeholders, data scientists, and software engineers to ensure the efficient movement and transformation of data, ultimately informing critical strategic decisions.

Responsibilities

• Partner with leadership, engineers, program managers, and data scientists to understand data needs
• Build high-performance scalable data warehouses
• Design, build, and launch efficient and reliable data pipelines to move and transform data
• Securely source external data from numerous partners
• Design data models for optimal storage and retrieval
• Deploy data quality checks to ensure high quality of data
• Optimize existing pipelines and maintain all domain-related data pipelines
• Own the end-to-end data engineering component of the solution
• Support on-call shift as needed to support the team
• Design and develop new systems in partnership with software engineers for data consumption

Requirements

• BS/MS in Computer Science or a related technical field
• 5+ years of Python or other modern programming language development experience
• 5+ years of SQL and relational databases experience
• 5+ years experience in custom ETL design, implementation, and maintenance
• 3+ years of experience with workflow management engines (e.g., Airflow, Luigi, Prefect)
• 3+ years experience with Data Modeling
• Experience with cloud or on-premises Big Data/MPP analytics platforms (e.g., Netezza, Teradata)
• 2+ years experience working with enterprise DE tools

Nice-to-haves

• Experience with more than one coding language
• Experience designing and implementing real-time pipelines
• Experience with data quality and validation
• Experience with SQL performance tuning and process optimization
• Experience with anomaly/outlier detection
• Experience with notebook-based Data Science workflow
• Experience querying massive datasets using Spark, Presto, Hive, etc.
• Experience building systems integrations for ERP systems

Benefits

• Equal Employment Opportunity and Affirmative Action employer
• Commitment to providing reasonable accommodations for candidates with disabilities