About the position
AWS Hardware Engineering is looking for an experienced, innovative Data Engineer to join their Data Science and Analytics team. You will be part of a group of talented engineers and scientists that builds data products and services to turn hardware monitoring data into insights using advanced analytics and machine learning. As a Data Engineer, you will provide technical leadership, lead data engineering initiatives, and build end-to-end analytical solutions that are highly available, scalable, stable, secure, and cost-effective. You strive for simplicity, demonstrate creativity and sound judgement. You deliver data solutions that are customer focused, easy to consume and create business impact. You are passionate about working with huge datasets and have experience with the organization and curation of data for analytics. You have a strategic and long-term view on architecting advanced data ecosystem. You are experienced in building efficient and scalable data services and can integrate data systems with AWS tools and services to support a variety of customer use cases/applications. In this role, you can: Design, implement and operate large-scale, high-volume, high-performance data structures for analytics and data science. Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes by leveraging AWS technologies and big data tools. Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions with a flexible and adaptable data architecture. Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation. Collaborate with scientists to create fast and efficient algorithms that exploit our rich data sets for optimization, statistical analysis, prediction, clustering, and machine learning. Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers. This role falls within the broader AWS Infrastructure Services (AIS) organization, which owns the design, planning, delivery, and operation of all AWS global infrastructure. In other words, we're the people who keep the cloud running. We support all AWS data centers and all the servers, storage, networking, power, and cooling equipment that ensure our customers have continual access to the innovation they rely on. We work on the most challenging problems, with thousands of variables impacting the supply chain - and we're looking for talented people who want to help. You'll join a diverse team of software, hardware, and network engineers, supply chain specialists, security experts, operations managers, and other vital roles. You'll collaborate with people across AWS to help us deliver the highest standards for safety and security while providing seemingly infinite capacity at the lowest possible cost for our customers. And you'll experience an inclusive culture that welcomes bold ideas and empowers you to own them to completion.
Responsibilities
- Design, implement and operate large-scale, high-volume, high-performance data structures for analytics and data science.
- Implement data ingestion routines both real time and batch using best practices in data modeling, ETL/ELT processes by leveraging AWS technologies and big data tools.
- Gather business and functional requirements and translate these requirements into robust, scalable, operable solutions with a flexible and adaptable data architecture.
- Collaborate with engineers to help adopt best practices in data system creation, data integrity, test design, analysis, validation, and documentation.
- Collaborate with scientists to create fast and efficient algorithms that exploit our rich data sets for optimization, statistical analysis, prediction, clustering, and machine learning.
- Help continually improve ongoing reporting and analysis processes, automating or simplifying self-service modeling and production support for customers.
Requirements
- A Bachelor's degree in a quantitative/technical field (e.g. Computer Science, Statistics, Engineering) or equivalent industry experience
- 3+ years of experience with demonstrated strength in ETL/ELT, data modeling, data warehouse technical architecture, infrastructure components and reporting/analytic tools
- 3+ years of hands-on experience in writing complex, highly-optimized SQL queries across large data sets.
- 3+ years of experience in scripting languages like Python etc.
Nice-to-haves
- Experience with AWS services such as Redshift, Glue, S3, EMR, Kinesis and SNS/SQS.
- Experience architecting data lake and cloud data warehouses.
- Experience with big data technologies (Hadoop, Hive, Kafka, Spark, etc.)
- Experience in leading and delivering end-to-end projects.
- AWS certifications or other related professional technical certifications.
- Meets/exceeds Amazon's leadership principles requirements for this role.
- Meets/exceeds Amazon's functional/technical depth and complexity for this role.
Benefits
- 401k
- health_insurance
- dental_insurance
- vision_insurance
- life_insurance
- disability_insurance
- paid_holidays
- paid_volunteer_time
- tuition_reimbursement
- employee_stock_purchase_plan
- professional_development
- flexible_scheduling
- unlimited_pto
- conference_allowance
