Data Engineering Architect

About the position

The Data and Platform Solution Architect will focus on the Deluxe Data business to help architect the Data Platform. This includes designing the Data architecture, Platform capabilities, Data model & delivery pipeline, data governance & cataloging design, and designing data store/lake, as well as transformation & ingestion flows. The architect will interface with data engineers, architects, Product Management, data providers, Compliance, and Infrastructure teams to design and develop the best-in-class Deluxe Data Discovery platform. This role also involves participation in data asset management, regulatory compliance, and internal and external audits associated with supplier and/or customer data.

Responsibilities

• Responsible for architecture, design, build, and implementation of technical solutions and capabilities for Data Platform.
• Performs Business, Data, Application and Technology architecture work across both Solution and Enterprise scopes.
• Design and manage all data pipelines execution, management, monitoring and issues resolution. Work with Data Engineering to implement data pipelines.
• Participate in product management activities to meet the data needs associated with new products or services.
• Lead and participate in data acquisition initiatives.

Requirements

• Bachelor's degree (or equivalent experience) in Computer Science, Engineering, Information Technology, Business, or related field.
• 5 years of experience mastering the understanding of business complexities, problems or opportunities & applies expert knowledge, skills, and experiences to assist IT & Business stakeholders in aligning strategy and objectives to an acceptable solution/outcome.
• 5 years of experience in Microsoft ETL data ingestion framework specifically SQL Server, SSIS DevOps.
• 5 years of experience in SQL server development and management tools.
• 5 years of experience in file management, data storage management and operations on premise and cloud.
• 5 years of experience with data pipeline management frameworks on AWS cloud.
• 5 years of experience with Python, R scripting and IDEs like Jupyter notebook, RStudio.

Nice-to-haves

• Bachelor's degree in Data Science and Analytics
• 7 years of experience in Data Science, Analytics, ML/AI data modeling, data governance and data delivery platform design on multiple cloud platform like AWS.
• Expert in Python, R scripting and IDEs like Jupyter notebook, RStudio
• Familiarity with data pipeline management frameworks on multiple clouds (Azure, Google)
• Good understanding of Apache Spark operations and monitoring.
• Familiarity with open-source data wrangling tools and technologies
• Familiarity with Apache Hadoop, Hive, Impala etc
• Familiarity with NoSQL databases like MongoDB, Graph databases like Neo4j, Amazon Neptune etc.
• Worked in data supply chain management for a large data aggregator.
• Worked in data driven marketing businesses.
• Solid understanding of Cloud data warehousing and archiving tools.
• Solid understanding of high-volume data processing frameworks on premise and Cloud.