Apex-2000 - Plano, TX

posted about 1 month ago

Full-time - Mid Level
Plano, TX
Administrative and Support Services

About the position

The Data Architect role is focused on understanding functional and process requirements to determine data sources and sets. This position involves collaboration with the TMNA One Tech team to establish source ingestion requirements and analyze raw data for ingestion into the 2WSC staging environment. The role emphasizes the development and automation of data pipelines in AWS, utilizing various AWS services and coding in Python.

Responsibilities

  • Understand functional/process requirements and data needs to determine data sources and data sets.
  • Collaborate with the TMNA One Tech team to understand supported integration patterns with source systems.
  • Identify source ingestion requirements and work with data stewards and OneTech enterprise architects for guidance and approvals.
  • Analyze raw data and ingest it into the 2WSC staging environment after establishing connections with source systems.
  • Collect data from multiple siloed systems, join, transform, and curate it to create a contextualized data set.
  • Develop data curation and aggregation code in AWS, leveraging Lambda Functions and Glue jobs in Python.
  • Develop, build, and automate data pipelines in AWS, integrating with Git code repositories and APIs.
  • Leverage AWS managed services for faster code development, data, and network security.

Requirements

  • Experience with AWS services, particularly Lambda Functions and Glue jobs.
  • Proficiency in Python for data curation and aggregation.
  • Strong understanding of data ingestion processes and integration patterns.
  • Ability to analyze raw data and transform it into usable datasets.

Nice-to-haves

  • Experience with Git code repositories.
  • Familiarity with data security practices in cloud environments.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service