Apex-2000 - Plano, TX

posted about 1 month ago

Full-time
Plano, TX
Administrative and Support Services

About the position

The Data Architect role is focused on understanding functional and process requirements to determine data sources and sets. This position involves collaboration with the TMNA One Tech team to establish source ingestion requirements and analyze raw data for ingestion into the 2WSC staging environment. The role emphasizes the development and automation of data pipelines in AWS, leveraging various AWS services and coding practices to curate and aggregate data effectively.

Responsibilities

  • Understand functional/process requirements and data needs to determine data sources and data sets.
  • Collaborate with the TMNA One Tech team to understand supported integration patterns with source systems.
  • Identify source ingestion requirements and work with data stewards and OneTech enterprise architects for guidance and approvals.
  • Analyze raw data after establishing connections with source systems and ingest it into the 2WSC staging environment.
  • Collect data from multiple siloed systems, join, transform, and curate it to create a contextualized data set.
  • Develop data curation and aggregation code in AWS, leveraging Lambda Functions and Glue jobs in Python.
  • Develop, build, and automate data pipelines in AWS, integrating with Git code repositories and APIs.
  • Leverage AWS managed services for faster code development and ensure data and network security.

Requirements

  • Strong understanding of data architecture and data management principles.
  • Experience with AWS services, particularly Lambda Functions and Glue jobs.
  • Proficiency in Python for data curation and aggregation.
  • Ability to collaborate effectively with cross-functional teams.
  • Experience in developing and automating data pipelines.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service