Imr Soft - Los Angeles, CA

posted 11 days ago

Full-time - Senior
Los Angeles, CA
Professional, Scientific, and Technical Services

About the position

The AWS Data Architect Lead is responsible for designing and implementing data solutions using AWS services. This role focuses on creating efficient data storage, processing, and access strategies while ensuring data governance and security. The position requires collaboration with various stakeholders to translate business needs into technical solutions, particularly in the context of big data and ETL processes.

Responsibilities

  • Create blueprints for data storage, processing, and access using AWS services like S3, Glue, EMR, Kinesis.
  • Design and build Lakehouse Solutions on AWS using Lambda, EMR, and EKS, and implement ETL pipelines for data transformation.
  • Design data access solutions for querying with Athena and integrate Iceberg Tables in Glue Catalog with Snowflake for analytics.
  • Work with large datasets and distributed computing using EMR and streaming solutions with Kinesis and Kafka.
  • Ensure data quality and compliance with regulations like GDPR, implementing security measures for sensitive information.
  • Collaborate with stakeholders to understand their needs and translate them into technical solutions.

Requirements

  • Deep understanding of core AWS services (S3, EC2, EKS, EMS, VPC, IAM, Glue, Athena).
  • AWS certifications (e.g., Solutions Architect, Big Data Specialty) are highly valued.
  • Strong knowledge of dimensional modeling, schema design, and data warehousing principles.
  • Experience with tools and techniques for data extraction, transformation, and loading (ETL).
  • Familiarity with big data technologies such as Hadoop, Spark, and Hive.
  • Proficiency in SQL and experience with relational databases; NoSQL databases experience is a plus.
  • Hands-on programming experience in Python with PySpark for automation and data processing tasks.
  • Understanding of data security best practices, access control, and compliance requirements.

Nice-to-haves

  • Experience with NoSQL databases like DynamoDB.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service