Lorven Technologies - Los Angeles, CA

posted 11 days ago

Full-time - Senior
Los Angeles, CA
Professional, Scientific, and Technical Services

About the position

The Lead Data Architect (AWS) role involves designing and implementing data solutions using AWS services. The position focuses on creating blueprints for data storage, processing, and access, ensuring data quality and compliance, and collaborating with stakeholders to translate business needs into technical solutions. This is a long-term contract position based in Woodland Hills, CA, with a hybrid work model.

Responsibilities

  • Create blueprints for data storage, processing, and access using AWS services like S3, Glue, EMR, and Kinesis.
  • Design and build Lakehouse solutions on AWS using Lambda, EMR, and EKS, and implement ETL pipelines for data transformation.
  • Design data access for querying with Athena and integrate Iceberg Tables in Glue Catalog with Snowflake for analytics and reporting.
  • Work with large datasets and distributed computing using EMR and streaming solutions with Kinesis and Kafka.
  • Ensure data quality and compliance with regulations like GDPR, and implement security measures for sensitive information.
  • Collaborate with stakeholders to understand their needs and translate them into technical solutions.

Requirements

  • Deep understanding of core AWS services (S3, EC2, EKS, EMR, VPC, IAM, Glue, Athena).
  • AWS certifications (e.g., Solutions Architect, Big Data Specialty) are highly valued.
  • Strong knowledge of dimensional modeling, schema design, and data warehousing principles.
  • Experience with tools and techniques for data extraction, transformation, and loading (ETL).
  • Familiarity with big data technologies such as Hadoop, Spark, and Hive.
  • Proficiency in SQL and experience with relational databases; NoSQL databases experience is a plus.
  • Hands-on programming experience in Python with PySpark for automation and data processing tasks.
  • Understanding of data security best practices, access control, and compliance requirements.

Nice-to-haves

  • Experience with NoSQL databases like DynamoDB.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service