AWS Data Engineer - Memphis

$140,000 - $165,000/Yr

Vaco - Memphis, TN

Full-time - Mid Level

Hybrid - Memphis, TN

Administrative and Support Services

About the position

Vaco is actively seeking an AWS Data Engineer for a direct-hire position with our client in Memphis. This is a permanent opportunity to join a highly respected organization that is a proven leader in their field! As an AWS Data Engineer, you will be responsible for designing, implementing, and maintaining scalable data pipelines and solutions on the AWS platform. You will collaborate closely with cross-functional teams to gather requirements, architect data solutions, and ensure data integrity, availability, and performance. In this role, you will design and develop data pipelines, utilizing AWS services such as AWS Glue, AWS Data Pipeline, AWS Lambda, and other relevant technologies. You will also be tasked with architecting data models and data flows to support the organization's analytical and reporting needs, ensuring that data structures are optimized for performance and scalability. Integration of data from various sources, including databases, APIs, and streaming data sources, will be a key responsibility, ensuring seamless data flow and consistency across different systems. Additionally, you will develop ETL processes to transform raw data into usable formats for analytics and reporting, while optimizing these processes for performance and efficiency. Implementing data quality checks and governance processes will be essential to ensure data accuracy, consistency, and compliance with regulatory requirements. You will monitor data pipelines and systems for performance and reliability, implementing optimizations and improvements to enhance efficiency and scalability. Collaboration with data scientists, analysts, and business stakeholders will be crucial to understand data requirements and deliver solutions that meet business needs. Effective communication with both technical and non-technical stakeholders is expected. Finally, you will document data pipelines, data models, and technical specifications, promoting best practices for data engineering and ensuring adherence to standards and guidelines.

Responsibilities

• Design and develop data pipelines using AWS services such as AWS Glue, AWS Data Pipeline, AWS Lambda, and other relevant technologies.
• Architect data models and data flows to support the organization's analytical and reporting needs.
• Integrate data from various sources including databases, APIs, and streaming data sources.
• Develop ETL processes to transform raw data into usable formats for analytics and reporting.
• Implement data quality checks and governance processes to ensure data accuracy, consistency, and compliance with regulatory requirements.
• Monitor data pipelines and systems for performance and reliability, implementing optimizations and improvements.
• Collaborate closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions.
• Document data pipelines, data models, and technical specifications, promoting best practices for data engineering.

Requirements

• Proven experience as a Data Engineer, particularly with AWS services.
• Strong knowledge of data modeling and architecture principles.
• Experience with ETL processes and data transformation techniques.
• Familiarity with data integration from various sources including databases and APIs.
• Understanding of data quality and governance best practices.
• Ability to monitor and optimize data pipelines for performance and reliability.
• Excellent collaboration and communication skills, both technical and non-technical.

Nice-to-haves

• Experience with additional AWS services such as Amazon Redshift or Amazon S3.
• Knowledge of data warehousing concepts and practices.
• Familiarity with data visualization tools.
• Experience in a hybrid work environment.