Senior Data Engineer

Rockstar - Carlsbad, CA

Full-time - Senior

Carlsbad, CA

Insurance Carriers and Related Activities

About the position

Rockstar Games is seeking a Senior Data Engineer to join their Analytics team, focusing on building a cutting-edge game analytics platform. This role involves developing complex data ingestion and transformation processes to enhance player experiences and provide actionable insights to stakeholders. The position is full-time and based in Andover, MA, within a collaborative and inclusive environment.

Responsibilities

• Implement and maintain real-time and batch Data Models.
• Design and optimize the overall data architecture for scalability, reliability, and performance.
• Deliver real-time and non-real-time data models to analysts and data scientists.
• Assist in the development of deployment automation and operational support strategies.
• Develop a big data platform in Databricks using technologies like Spark and Airflow.
• Set standards for warehouse and schema design in Databricks and Snowflake.
• Identify opportunities for process improvement in data engineering.
• Maintain and extend CI/CD processes and documentation.
• Provide technical guidance and leadership to the data engineering team.

Requirements

• 6+ years of work experience with data modeling and business intelligence on big data architectures.
• 4+ years of experience with Python.
• 4+ years of experience with Spark.
• Expert in at least one SQL language.
• Experience developing and managing data warehouses on a terabyte or petabyte scale.
• Strong experience in massively parallel processing & columnar databases.
• Experience building Real-Time and/or Near-Real-Time data pipelines.
• Experience working in a Linux environment.

Nice-to-haves

• Experience with Databricks.
• Experience with Java or Scala.
• Experience with Jupyter Notebooks.
• Experience in Lambda data ingestion architecture.
• Experience with CI/CD.
• Familiar with Restful APIs.
• Experience with Artifact Repositories.
• Knowledge of the video game industry.
• Experience in Machine Learning pipelines and popular libraries.

Benefits

• Inclusive and collaborative work environment.
• Opportunities for professional development and learning.