Metropolitan Council - Saint Paul, MN

posted 9 days ago

Full-time - Senior
Saint Paul, MN
101-250 employees
Executive, Legislative, and Other General Government Support

About the position

The Senior Data Engineer is responsible for designing, developing, and maintaining data solutions, including databases, data platforms, data lakes, data warehouses, and data marts. This role involves collaborating with technology and business units to ensure data availability for various stakeholders, ensuring the security, performance, and availability of data solutions, and administering data tools to resolve quality issues. The ideal candidate will have strong programming skills, expertise in data technologies, and the ability to lead and mentor others.

Responsibilities

  • Collaborate with technology and business stakeholders to determine data needs.
  • Design, develop, and maintain data solutions for operations, reporting, and analytics, including databases, data platforms, data lakes, data warehouses, and data marts.
  • Develop data solutions using various software methodologies including waterfall and agile.
  • Write and understand complex SQL queries and define best practices.
  • Design, develop, and maintain data integrations between source and target systems.
  • Understand and implement data security and data classifications.
  • Innovate and leverage emerging technologies and participate in strategic planning.
  • Provide ongoing database administration, maintenance, monitoring, and support.
  • Install and configure database software and drivers on servers and clients.
  • Setup monitoring and alerting of data solutions.
  • Script, automate, configure, and monitor data processes.
  • Maintain backups, continuity of operations, high availability, and disaster recovery.
  • Monitor data security, encryption, authentication, authorization, logging, and audits.
  • Complete database performance tuning, patching, and upgrades.
  • Maintain non-production data environments including data refreshes.
  • Manage database compression, capacity, and licenses.
  • Troubleshoot database, data integration, or application issues related to data.
  • Build and maintain modern cloud data platforms for reporting and analytics.
  • Partner with business intelligence and analytics developers on reporting and visualizations.
  • May integrate with a variety of internal and external data sources such as APIs, Web Services, and Integration Platform as a Service.
  • May work with data streaming and messaging services to move data between systems.
  • May lead a technical team.

Requirements

  • Master's degree in Computer Science/Engineering, Information Technology, or related field and three (3) years of experience; or
  • Bachelor's degree and five (5) years of experience; or
  • Associate's degree and seven (7) years of experience; or
  • High school diploma/GED and nine (9) years of experience.
  • Experience writing and tuning complex SQL queries and defining SQL best practices.
  • Installation and configuration of database software and drivers on servers and clients.
  • Data modeling, database normalization, and denormalization techniques.
  • Database administration and security, maintenance, monitoring, and support (SQL Server, Oracle, and Sybase ASE).
  • Designing, developing, and maintaining data integrations (data pipelines/ETL/ELT) using various types of data sources and targets.
  • Programming language knowledge with at least one scripting language.

Nice-to-haves

  • Experience developing data solutions for the cloud.
  • Modern cloud data platform experience.
  • Experience with APIs, Web Services, and Integration Platform as a Service.
  • Data streaming and messaging experience.
  • Data visualization experience.
  • Experience leading a technical team.
  • Experience working and collaborating with individuals from diverse backgrounds.

Benefits

  • Great work/life balance
  • Insurance starting on day one
  • MN State Retirement Program pension
  • In-house clinic
  • Salary continuance for injury or illness
  • 13 paid holidays per year plus generous annual leave
  • Employee development
  • Free Metro Transit rides
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service