Senior Data Engineer

$113,000 - $123,000/Yr

University of Minnesota - Minneapolis, MN

Full-time - Mid Level

Minneapolis, MN

Educational Services

About the position

The Senior Data Engineer at the University of Minnesota Twin Cities will play a crucial role in developing and maintaining the university's data architecture. This position focuses on implementing a multi-container OCI environment to support Oracle GoldenGate and Oracle Analytics Cloud initiatives. The ideal candidate will collaborate with various teams to enhance the university's data capabilities, particularly in the context of higher education.

Responsibilities

• Support and leverage change data capture techniques on the PeopleSoft Oracle database to feed ERP data into downstream systems.
• Create Azure Data Pipelines using the Microsoft Azure toolkit.
• Model system agnostic data structures based to abstract away PeopleSoft specific source data structures.
• Implement and maintain data security activities including role, account, and secret management as well as regular access review.
• Design, develop and deploy new APIs, event streams, and file based integrations using Dell Boomi, Oracle SQL, Apache Kafka, Amazon SQS, and other data integration technologies.
• Monitor and maintain production integrations and data flows.
• Mentor members of the team, as necessary, working on all phases of the application development lifecycle.
• Provide Subject Matter Expertise on Change Data Capture and Databricks implementation practices.

Requirements

• BA/BS plus at least 4 years of experience, or master's degree plus 2 years of experience.
• Experience with the Microsoft Azure platform.
• Experience with Databricks.
• Experience building and optimizing 'big data' data pipelines, architectures, and data sets.
• Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.

Nice-to-haves

• Familiarity with Higher Education.
• Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
• Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
• Experience supporting and working with cross-functional teams in a dynamic environment.
• Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
• Experience with data pipeline and workflow management tools.
• Experience with object-oriented/object function scripting languages.
• Strong analytic skills related to working with structured datasets.

Benefits

• Competitive salary based on qualifications
• Opportunities for professional development
• Access to university resources and facilities