Viva Tech Solutions LTD - Woodland, CA

posted 4 days ago

Full-time - Mid Level
Woodland, CA

About the position

The Lead AWS Data Architect is responsible for designing and implementing data solutions using AWS services. This role requires a strong architectural background, with a focus on creating scalable, secure, and cost-effective data storage and processing solutions. The architect will work on building Lakehouse solutions, ETL pipelines, and ensuring data governance and security while collaborating with various stakeholders to meet their data needs.

Responsibilities

  • Create blueprints for data storage, processing, and access using AWS services like S3, Glue, EMR, and Kinesis.
  • Design and build Lakehouse solutions on AWS using Lambda, EMR, and EKS, and implement ETL pipelines for data transformation.
  • Design data access solutions for querying with Athena and integrate Iceberg Tables in Glue Catalog with Snowflake for analytics and reporting.
  • Work with large datasets and distributed computing using EMR (with Spark) and streaming solutions with Kinesis and Kafka.
  • Ensure data quality and compliance with regulations like GDPR, implementing security measures to protect sensitive information.
  • Collaborate with stakeholders to understand their needs and translate them into technical solutions, explaining complex concepts clearly.

Requirements

  • Overall 12 years of experience in data architecture and solutions.
  • Minimum 2-3 years of experience as an Architect.
  • Deep understanding of core AWS services (S3, EC2, EKS, EMR, VPC, IAM, Glue, Athena).
  • Strong knowledge of dimensional modeling, schema design, and data warehousing principles.
  • Experience with ETL tools and techniques for data extraction, transformation, and loading.
  • Familiarity with big data technologies like Hadoop, Spark, and Hive.
  • Proficiency in SQL and experience with relational databases; NoSQL experience (like DynamoDB) is a plus.
  • Hands-on programming experience in Python with PySpark for automation and data processing tasks.
  • Understanding of data security best practices, access control, and compliance requirements.

Nice-to-haves

  • AWS certifications (e.g., Solutions Architect, Big Data Specialty).
  • Experience with NoSQL databases like DynamoDB.

Benefits

  • Competitive salary based on experience.
  • Flexible working hours with a hybrid model (3 days onsite).
  • Opportunity to work with cutting-edge technologies in AWS.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service