Big Data SQL Developer

$135,200 - $145,600/Yr

Pinnacle Group - Irving, TX

Full-time - Mid Level

Irving, TX

Insurance Carriers and Related Activities

About the position

The Big Data SQL Developer role is focused on delivering data quality rules and enhancing SQL queries within a hybrid work environment. The position requires strong technical skills in SQL, Python, and various big data technologies, with an emphasis on problem-solving and effective communication to bridge the gap between technical and non-technical team members.

Responsibilities

• Code, develop, and enhance SQL queries.
• Release SQL to UAT testing and production; manage job scheduling and execution.
• Provide production support, including job monitoring and SQL error debugging.
• Create ad-hoc Python scripts as needed.
• Host meetings and present technical demonstrations.
• Identify new technical challenges and propose solutions using big data technologies.
• Assist and support the analyst team with technical solutions.
• Convert SQL syntax/functions across different analytic engines/platforms, specifically from Starburst/Impala SQL to SparkSQL.
• Collaborate with team members to ensure project needs are met.
• Maintain effective communication and documentation.

Requirements

• 5+ years of experience with Starburst/TRINO, Impala, Hive, and SparkSQL.
• Good knowledge of Hadoop environment and distribution systems.
• Strong data analysis, evaluation, and problem-solving skills.
• Proficiency in SQL and debugging.
• Experience with Python and Pyspark.
• Ability to identify and troubleshoot data issues and provide timely resolutions.
• Excellent communication skills to explain technical concepts to non-technical team members.
• Ability to understand business requirements and translate them into technical requirements with actionable steps.
• Domain knowledge of data quality/data entitlement is a plus.
• Experience working in an Agile environment.

Nice-to-haves

• Domain knowledge of data quality/data entitlement.

Benefits

• Medical insurance
• Dental insurance
• Vision insurance
• 401K contributions
• Paid time off (PTO)
• Sick leave
• Other benefits mandated by applicable state or localities.