Data Engineer

E-Solutions Group - San Jose, CA

Full-time

San Jose, CA

Computing Infrastructure Providers, Data Processing, Web Hosting, and Related Services

About the position

The Data Engineer role involves designing and developing scalable solutions for collecting and analyzing large datasets. The position focuses on creating and maintaining data pipelines, data structures, and reports, while ensuring data quality and expertise across various data flows. The role requires collaboration with internal data consumers to understand their data needs and support analysts and data scientists with coding skills in SQL and Python.

Responsibilities

• Design and develop robust, scalable solutions for collecting and analyzing large data sets.
• Create and maintain data pipelines, data structures, and reports.
• Understand business processes and how data is gathered, tying application telemetry to transactional data models.
• Build and manage data marts to satisfy growing data needs.
• Develop and manage data pipelines at an enterprise scale.
• Build data expertise and own data quality for various data flows.
• Interface with internal data consumers to understand their data needs.

Requirements

• 2+ years of SQL experience (Hive, Snowflake, AWS Redshift, etc.) is required.
• Experience in custom or structured ETL design, implementation, and maintenance (i.e. Airflow, Informatica, Talend, Pentaho).
• Ability to analyze data to identify deliverables, gaps, and inconsistencies.
• Experience working with either a Map Reduce or MPP system on any size/scale.
• +3 or -3 hour time zone within Pacific Time is preferred.