Big Data SQL Developer

$135,200 - $145,600/Yr

Pinnacle Group - Irving, TX

Full-time - Mid Level

Irving, TX

Insurance Carriers and Related Activities

About the position

The Big Data SQL Developer role is focused on delivering data quality rules and enhancing SQL queries within a hybrid work environment. The position requires strong technical skills in SQL and experience with various big data technologies, as well as the ability to communicate effectively with both technical and non-technical team members. The developer will be responsible for production support, job monitoring, and troubleshooting data issues, while also collaborating with analysts to provide technical solutions.

Responsibilities

• Code & develop and enhance SQL Queries.
• Release the SQL to UAT testing and Prod; Job scheduling and running.
• Production support - job monitoring and SQL error debugging.
• Ad_hoc python script creation.
• Hosting meetings and presenting tech demos.
• Discovery of new technical challenges that can be solved with existing and emerging Big Data hardware and software solutions.
• Assisting and supporting the analyst team on technical solutions.
• Understand SQL syntax/functions across different analytic engines/platforms, responsible for converting Starburst/Impala SQL to SparkSQL and providing optimal queries.
• Work with team members to ensure efforts within owned tracks of work will meet their needs.
• Communication and documentation.

Requirements

• 5+ years working experience with Starburst/TRINO, Impala, Hive, SparkSQL.
• Good knowledge of Hadoop environment and distribution system.
• Strong data analysis, data evaluation, and problem-solving skills.
• Proficiency in SQL and debugging is crucial.
• Experience with writing Python and Pyspark.
• Ability to identify and troubleshoot data issues and provide timely resolution.
• Great communication skills to explain technical concepts to non-technical team members.
• Ability to understand business requirements and convert them into technical requirements with action steps.
• Domain knowledge of data quality/data entitlement is a plus.
• Agile experience.

Nice-to-haves

• Domain knowledge of data quality/data entitlement.

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• 401K contributions
• PTO
• Sick leave
• Other benefits mandated by applicable state or localities.