Vertex Computer Systems - King of Prussia, PA

posted about 1 month ago

Full-time - Senior
King of Prussia, PA
Professional, Scientific, and Technical Services

About the position

The Senior Data Engineer position at King of Prussia, PA, is a 6-month contract role focused on developing and integrating ETL applications and high-performance data pipelines. The role requires extensive experience in big data technologies and cloud platforms, particularly Azure. The engineer will lead the design and development of scalable data solutions while ensuring best practices in data modeling and integration are followed. This position also involves collaboration with business stakeholders and providing mentorship to junior team members.

Responsibilities

  • Lead the design and development of scalable, high-performance data pipelines and ETL processes that meet business requirements.
  • Establish and enforce best practices for data modeling, data product design, and data integration.
  • Provide thought leadership and execution capability in Data domain selection, enhancement, and implementation.
  • Partner with Enterprise Data Management to define data standards, policies, and procedures to ensure data integrity, security, and availability.
  • Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
  • Provide technical guidance and mentorship to junior members about data architecture.
  • Communicate effectively with stakeholders at all levels of the organization to articulate technical concepts and recommendations.
  • Maintain client internal control standards, including timely implementation of internal and external audit points together with any issues raised by external regulators as applicable.
  • Additional Duties as assigned.

Requirements

  • 12 or more years of experience in developing and integrating ETL applications.
  • 7 or more years of experience in big data technologies such as Spark and Kafka.
  • 5 or more years of experience in data and domain modeling.
  • Extensive working experience with cloud platforms Azure Data Lake, Azure Data Factory, Azure DevOps, and Databricks.
  • Extensive working experience with Python and pySpark.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service