Senior Data Engineer - Datalake (Remote) - REF5535R

$100,000 - $130,000/Yr

Unclassified - San Antonio, TX

Full-time - Mid Level

Onsite - San Antonio, TX

About the position

The Senior Data Engineer - Datalake at Vericast is responsible for analyzing, designing, creating, modifying, and supporting complex systems and processes that enhance business capabilities. This role involves developing applications, reports, and enterprise solutions while ensuring quality standards are met. The engineer will also provide guidance and support to less experienced team members and participate in cross-functional initiatives.

Responsibilities

• Creates Application and System Design Documents and Develops Applications / Reports / Systems / Enterprise Solutions
• Estimates component/application system level and Enterprise solution work efforts
• Creates RFI/RFP requests / responses for vendor product evaluations
• Designs, Develops, and Implements Complex Business Rules
• Responsible for fulfilling end-user requests and provides on-call support as required
• Periodically provides guidance to and assists in training less experienced individuals
• Delivers personal tasks on time and leads the delivery of tasks for natural or cross-functional workgroup
• Participates on initiatives with deliverables and meets quality standards on time
• Leads cross-functional initiatives with deliverables and meets quality standards on time

Requirements

• Bachelor's degree or equivalent work experience
• 5 years of experience in Data Engineering or ETL Development role
• Strong experience with PySpark, Python for building solid data pipelines
• Strong experience with Iceberg, Hive, S3, Trino
• Hands-on experience with Hadoop ecosystems, relational databases and SQL queries
• Hands-on experience with Apache Ranger, Rancher/Kubernetes preferred
• Hands-on experience with Talend, Red Point or other ETL technologies an advantage
• Experience with Agile Software Development methodologies
• Experience with GitLab, CI/CD process and ServiceNow

Nice-to-haves

• AWS cloud experiences in Redshift, Lambda, Sage Maker, Glue
• Experience with building Rest API

Benefits

• Medical, dental and vision coverage
• 401K with company match
• Generous PTO allowance
• Life insurance
• Employee assistance
• Pet insurance