Lorvenk Technologies - Richmond, VA

posted 2 months ago

Full-time
Richmond, VA
Professional, Scientific, and Technical Services

About the position

The AWS Data Engineer role is a critical position within our organization, focusing on the design, development, and maintenance of data pipelines and data architecture in the AWS ecosystem. The ideal candidate will have extensive experience in data engineering, particularly with AWS services, and will be responsible for ensuring the efficient processing and storage of large datasets. This role requires a deep understanding of data modeling, ETL processes, and the ability to work with various data sources and formats. The AWS Data Engineer will collaborate with data scientists, analysts, and other stakeholders to deliver high-quality data solutions that meet business needs. In this position, you will be tasked with building and optimizing data pipelines using AWS Glue and other AWS services. You will also be responsible for integrating data from various sources through REST APIs and ensuring data quality and integrity throughout the data lifecycle. The role demands a strong proficiency in Python and PySpark for data manipulation and transformation tasks. You will be expected to implement best practices for data governance and security, as well as contribute to the overall data strategy of the organization. As an AWS Data Engineer, you will play a key role in driving data initiatives and will be expected to stay updated with the latest trends and technologies in the data engineering field. Your contributions will directly impact the organization’s ability to leverage data for decision-making and strategic planning.

Responsibilities

  • Design, develop, and maintain data pipelines in AWS.
  • Optimize data architecture and ETL processes using AWS Glue.
  • Integrate data from various sources through REST APIs.
  • Ensure data quality and integrity throughout the data lifecycle.
  • Collaborate with data scientists and analysts to deliver data solutions.
  • Implement best practices for data governance and security.
  • Stay updated with the latest trends in data engineering.

Requirements

  • 10+ years of experience in data engineering or related field.
  • Strong proficiency in Python and PySpark.
  • Experience with AWS Glue and other AWS services.
  • Knowledge of REST APIs and data integration techniques.
  • Ability to work with large datasets and optimize data processing.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service