Benlabs Technology - Los Angeles, CA

posted 2 months ago

Full-time - Mid Level
Remote - Los Angeles, CA

About the position

The Sr. Data Engineer at BENlabs is responsible for leading the design and implementation of robust data pipelines that support the company's AI-driven marketing and content creation efforts. This role involves engaging with internal stakeholders to understand their data needs, architecting scalable data solutions using AWS technologies, and mentoring a team of data engineers. The position emphasizes collaboration with machine learning teams and the optimization of cloud-based data infrastructure.

Responsibilities

  • Lead the design and implementation of robust data pipelines from ingestion to consumption.
  • Engage with internal stakeholders to understand data requirements and translate them into scalable architectures.
  • Architect and optimize data solutions using AWS technologies to support business needs.
  • Develop and maintain comprehensive data models to support business applications and analytics.
  • Evaluate and implement best practices for data architecture, ensuring scalability and performance.
  • Leverage AWS services to design and manage large-scale data infrastructure.
  • Utilize orchestration systems to automate and manage complex data workflows.
  • Optimize cloud-based databases for performance, availability, and reliability.
  • Guide and mentor a team of data engineers, fostering a culture of continuous learning.
  • Provide technical leadership in data architecture projects.

Requirements

  • 4+ years of experience in data engineering with a focus on AWS technologies and end-to-end data pipeline design.
  • Proven track record in designing and implementing scalable data architectures.
  • Experience with Python, SQL, and data modeling.
  • Experience working with machine learning teams and deploying ML models.
  • Familiarity with orchestration systems such as EMR, Airflow, or Dagster.
  • Experience in AWS services (S3, Redshift, RDS, Glue, Lambda) and infrastructure as code (Terraform, CloudFormation).
  • Strong understanding of data modeling, ETL processes, and database optimization.
  • Proficiency in designing and managing large-scale distributed systems.
  • Strong communication skills to articulate complex technical concepts to non-technical stakeholders.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.

Nice-to-haves

  • Experience with Graph databases such as Neo4j or Amazon Neptune.
  • Experience with social media data and corresponding APIs.

Benefits

  • Competitive benefits package
  • Inclusive culture that fosters personal and professional growth
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service