Amazon - Seattle, WA
posted about 2 months ago
Amazon Web Services (AWS) is seeking an experienced Data Engineer to join the Global Services Support Operations (GSSO) team in Seattle, Washington. This role is pivotal in designing, developing, and maintaining efficient and scalable data pipelines, data models, and data warehousing solutions. The Data Engineer will ensure data integrity, quality, and availability across the organization, enabling data-driven decision-making and supporting business intelligence initiatives. The successful candidate will be responsible for conducting data discovery and profiling for various data sources, including Page0, entitlement models, and propensity models. They will design and implement robust ETL pipelines to extract data from multiple sources, transform it according to defined business rules, and load it into centralized data storage systems. In addition to developing and maintaining efficient data ingestion processes, the Data Engineer will design and develop effective data models and schemas for various data sources. They will implement and maintain a centralized data warehouse architecture, ensuring scalability, performance, and data integrity. Collaboration with stakeholders to understand data requirements and translate them into optimized data structures and models is essential. The role also involves establishing and enforcing data governance policies and procedures to maintain data quality, consistency, and integrity across the organization. The Data Engineer will implement data quality controls, monitoring, and reporting mechanisms to ensure data accuracy and reliability. Continuous monitoring of data quality, identifying issues, and implementing remediation measures will be part of the responsibilities. The Data Engineer will design and implement centralized data integration pipelines to consolidate data from various sources into a unified data platform, ensuring seamless data integration and interoperability between different systems, applications, and processes. They will also integrate propensity models with downstream systems and processes, facilitating data-driven decision-making. Implementing robust data security measures, including access controls, authentication, and authorization mechanisms, to protect sensitive data is crucial. The Data Engineer will ensure data lineage and traceability across the organization, enabling auditing and compliance, and will continuously monitor data flows to optimize performance by identifying bottlenecks and implementing efficient solutions. Additionally, they will develop and implement data retention and archiving policies to manage data growth and storage requirements, and establish data disaster recovery and business continuity plans to ensure data availability and resilience.