Prudential Financial - Newark, NJ

posted 2 months ago

Full-time - Senior
Remote - Newark, NJ
Insurance Carriers and Related Activities

About the position

As a Director, Data Engineer at PGIM, you will play a pivotal role in shaping the organization's data journey through a structured and strategic approach. Your primary responsibility will be to ingest, transform, and validate data into the data lake, ensuring that the architecture and tools used for data governance, data modeling, and data transformation are effectively implemented. This position is based in Newark, NJ, and follows a hybrid work structure, requiring on-site presence 2-3 days per week based on task demands and personal preferences. In this role, you will be tasked with data ingestion from various on-prem and cloud sources, optimizing data for large-scale processing. You will build ETL pipelines to collect, merge, and transform raw data into suitable formats for analysis, utilizing ETL tools such as AWS Glue and Informatica, and orchestrating transformations using Airflow and other DAG tools. Additionally, you will create enterprise data models and define standards for data warehouse management, collaborating closely with data analytics and reporting teams to ensure data is structured appropriately for consumption. Your responsibilities will also include configuring and maintaining Master Data Management (MDM) tools and processes, defining master data quality validation criteria, and implementing automatic error detection schemes. You will be expected to implement data lineage capabilities to track data movement across the enterprise and establish data governance standards, including data definitions, quality rules, and business glossary functions. Supporting domain owners and data stewards in analyzing quality issues and monitoring cross-business unit data provisioning will also be key aspects of your role.

Responsibilities

  • Ingest, transform, and validate data into the data lake.
  • Evaluate and implement architecture and tools for data governance, data modeling, and data transformation.
  • Build ETL pipelines to collect, merge, and transform raw data into suitable formats for analysis.
  • Create enterprise data models and define standards for data warehouse management.
  • Collaborate with data analytics and reporting teams to structure data for consumption.
  • Configure and maintain MDM tools and system processes.
  • Define master data quality validation criteria and implement automatic error detection schemes.
  • Implement data lineage capability to understand data movement across the enterprise.
  • Establish data governance and standards including data definitions and quality rules.
  • Support domain owners and data stewards in analyzing quality issue root causes.

Requirements

  • Bachelor's degree in a relevant field.
  • 8+ years of experience in a data engineering role supporting an on-prem Data Lake.
  • 4+ years of experience with cloud platforms, preferably Azure.
  • Knowledge of Microsoft tools (Power BI, Synapse, Azure Data Factory).
  • 2+ years of experience with Snowflake (SnowSQL, SnowPark).
  • 5+ years of experience with relational databases (SQL, stored procedures, functions).
  • 5+ years of experience with Python, Spark, and SQL programming languages.
  • Extensive hands-on experience in modern data lake architecture, database development, and data modeling.
  • Knowledge of real-time data streaming and analytics.
  • Strong implementation skills with data structures, algorithms, and big data tools (Spark, Hadoop, Python, SQL, NoSQL, Hive).
  • Solid Linux OS and Shell Scripting experience.
  • Experience with big data technologies and data formats (e.g., Parquet, Delta, Iceberg).
  • Extensive experience with at least one of the following RDMS: Oracle, SQL Server, Postgres, or MySQL.
  • Good communication skills to partner with technical and business stakeholders.

Nice-to-haves

  • Prior experience in a lead role.
  • Detail-oriented with strong analytical and problem-solving abilities.
  • Professional and energetic self-starter.
  • Comfortable with ambiguity and able to translate conceptual ideas into practical solutions.

Benefits

  • Medical, dental, vision, and life insurance.
  • Paid Time Off (PTO).
  • 401(k) plan with generous company match (up to 4%).
  • Company-funded pension plan.
  • Wellness Programs with reimbursement for personal wellbeing items (up to $1,600 a year).
  • Work/Life Resources for support on various personal topics.
  • Tuition Assistance for traditional college enrollment and accredited programs.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service