Metadata Solutions Developer

Request Technology - Chicago, IL

Full-time

Chicago, IL

Administrative and Support Services

About the position

The Metadata Solutions Developer role focuses on developing and implementing metadata and data lineage solutions across various data sources in both on-premises and cloud environments. This position requires a strong background in data analysis, programming, and metadata management, with responsibilities that include creating data flow diagrams, automating metadata extraction, and ensuring compliance with data governance standards.

Responsibilities

• Develop Metadata and Data Lineage Solutions for multiple data sources across On Prem and Cloud environments including Kafka, Protocol Buffers, REDIS, APIs, Databases, Flat Files, JSON, ETL/BI Tools and other Data Platform technologies.
• Work with Technical SMEs/developers to understand the applications/systems design and create data flow diagrams/data mappings.
• Create Source to Target mapping documents by reverse engineering the application Java code/BI tools/SQL queries for the identified data flows.
• Develop custom metadata connectors/scanners using programming tools to automate the metadata extraction from disparate data sources.
• Develop solutions to automate metadata extraction and data flow/data lineage/Source to target mapping documents for complex applications/systems/BI tools.
• Manage metadata, administration, support, and ingest data management assets using extension mappings, custom data assets, and third-party metadata bridges.
• Create, develop, configure, and execute end-to-end business and technical data lineage across disparate sources in accordance with Data Governance Standards, Policies, and Procedures.
• Design and build data capabilities like data quality, metadata, data catalog, and data dictionary.

Requirements

• 6 or more years of data analysis experience with a robust understanding of metadata, data flows, and mappings.
• Ability to understand the Java Code base; read and/or write code using a programming language (e.g., Java, Python, etc.).
• Proficient with SQL and experience working with Git and data analysis using Python/Pyspark.
• Hands-on experience with Java version 8 onwards, Spring, SpringBoot, Microservices, REST API, Kafka Streams.
• Experience working with various types of databases like Relational, NoSQL, Object-based.
• Ability to review application development code to ensure it meets functional requirements, architectural and data standards.
• Proficiency in writing technical documentation for Java-based applications that process data in Real Time and batch.
• Ability to develop and implement Data Quality Solutions for multiple data sources across On Prem and Cloud environments.

Nice-to-haves

• Experience working on Protobuf, APIs, Kafka as Data Sources is preferred.
• Experience working with draw.io or other tools for creating architecture or data flow diagrams.
• Experience in object-oriented design and software design patterns.