Senior Data Engineer

Allied Solutions - Carmel, IN

Full-time - Senior

Carmel, IN

Administrative and Support Services

About the position

The Senior Data Engineer plays a critical role in the successful execution of Allied's Data Strategy. This role will be focused on data acquisition, curation, and transformation of data into a useable asset. They will work cross-functionally to develop and deploy optimized data models and modern data architecture in support of strategic data and business initiatives. This role will serve as a subject matter expert for data domain knowledge, SQL, data design, and data processes across the enterprise. This individual will collaborate with teams across the organization to design and build end to end data flows for optimal business intelligence, advanced analytics, and data monetization efforts. Lastly, this role will contribute to core design of data architecture, data models, schemas, and inform future state Data Management and Data Strategy roadmaps.

Responsibilities

• Creates detailed documentation of data warehouse, data stores, and end-to-end data flows
• Troubleshoots and corrects data and data processing errors in existing solutions
• Works with other technical teams as well as with internal and external users to develop technical designs
• Develops and continually refines the BI-focused data architecture
• Works closely with the Data Intelligence department to understand the data and reporting requirements from internal and external customers and the steps to take on the back-end data side to achieve the expected results
• Conducts gap analysis on source system databases against Allied's enterprise data warehouse in support of Business Intelligence efforts
• Develops and maintains data sets and standardizes data collection and processing methodologies
• Provides technical advice and weighs in on technical decisions that impact cross-functional teams
• Attends and contributes to architecture meetings to determine project scope, time frame and cost estimates
• Works on plan and technical architecture to extract, integrate, and or push data to or from third-party providers
• Provides enterprise data solutions for Allied including ETL maintenance, warehouse data models, periodic upgrades, security, governance, and performance optimization
• Understands the data warehouse and data mart models as well as being familiar with the business information contained in each
• Locates and defines new process improvement opportunities or alternative technologies that will enhance speed to business value delivery with our data
• Collaborates with developers and subject matter experts to establish the technical vision and analyze tradeoffs between usability and performance needs
• Mentors other ETL Developers and Data Engineers

Requirements

• Bachelor's Degree required, or equivalent education/work experience
• 5+ years of experience with data warehousing, databases (MS SQL Server, Snowflake) and dimensional modeling
• 5+ years of experience in end-to-end data analysis and development
• 5+ years of experience with Informatica (Power Center, IICS)
• 3-5 years of experience in AWS cloud services (AWS Glue, Lambda, S3, etc.)
• 3-5 years of experience with Snowflake (Snowpipe, Snowpark, Streamlit, Streams/Tasks) (preferred)
• Extensive Experience with SQL required
• Experience with R or Python (preferred)
• Experience with Git and CI/CD (preferred)
• Strong attention to detail
• Familiarity with Object Oriented Analysis, Project Management, Business Analysis Methodology and the SDLC
• Ability to collaborate effectively and work as part of a team
• Customer-oriented, with a desire to resolve problems to the customer's satisfaction while maintaining a focus on productivity, efficiency, and quality
• Effective communicator to clients, management, and project partners
• Experience with cloud-based technologies and services (SaaS, PaaS, IaaS) (preferred)
• Experience with Master Data Management (preferred)
• Strong analytical and product management skills are required, including a thorough understanding of how to interpret customer business needs and translate them into application and operational requirements.

Nice-to-haves

• Experience with Snowflake (Snowpipe, Snowpark, Streamlit, Streams/Tasks)
• Experience with R or Python
• Experience with Git and CI/CD
• Experience with cloud-based technologies and services (SaaS, PaaS, IaaS)
• Experience with Master Data Management

Benefits

• medical, dental and vision insurance coverage
• 100% company-paid life and disability coverage
• 401k options with company match
• three weeks PTO by the end of the first year
• career growth opportunities
• broad career options within the same organization