Principal Data Engineer

Data Axle - Papillion, NE

Full-time - Senior

Papillion, NE

General Merchandise Retailers

About the position

The Principal Data Engineer at Data Axle is a senior-level role responsible for leading the design, implementation, and optimization of modern data architecture. This position focuses on developing and maintaining data pipelines using Databricks and Redshift, ensuring high-performance and cost-efficient workflows. The ideal candidate will collaborate with internal teams to create robust data models and enforce best practices in data engineering, while also automating manual processes to enhance system efficiency.

Responsibilities

• Collaborate with internal teams to design and implement a modern data architecture using Databricks and Redshift.
• Develop, maintain, and troubleshoot data pipelines and workflows within Databricks, ensuring reliability and performance.
• Create and maintain robust data models to support the ingestion and transformation of diverse data sources.
• Monitor data workflows, optimizing them for performance, scalability, and cross-efficiency.
• Establish and enforce best practices for data engineering, including version control, code reviews, and comprehensive documentation.
• Ensure the data infrastructure is resilient and can scale as data volume grows.
• Lead initiatives to automate manual data processes and improve overall system efficiency.

Requirements

• 7+ years experience in data engineering, with a focus on building and maintaining scalable data pipelines.
• 5+ years experience in relational marketing database analysis (data query, report development, and audience segmentation).
• Proficient in Python and SparkSQL/SQL programming.
• Ability to work with large datasets and optimize performance for high-throughput environments.
• Strong communication skills, with the ability to work collaboratively across teams.

Nice-to-haves

• Experience with Tableau is also a plus.