Informatica Cloud (IDMC) ETL Developer

Infometry - Frisco, TX

Full-time - Mid Level

Frisco, TX

Professional, Scientific, and Technical Services

About the position

Infometry is seeking an experienced Informatica Cloud (IDMC) ETL Developer to design, develop, and optimize ETL workflows, integrating data from various sources and ensuring efficient data pipeline operations. The role requires a strong background in Snowflake, AWS, SQL, and experience with CI/CD pipelines and Jenkins, with a focus on data quality and governance.

Responsibilities

• Design, develop, and implement complex ETL mappings, data transformations, and task flows using Informatica Cloud (IDMC).
• Collaborate with data architects and business analysts to understand and translate data requirements into scalable ETL processes.
• Process complex files from S3 bucket, perform data quality checks, and load them into Snowflake.
• Leverage IDMC CDQ for business rules to perform data quality checks.
• Implement end-to-end ETL/ELT process using IDMC CDI/CAI for Snowflake using medallion architecture.
• Implement data masking and data encryptions using 3rd party APIs and algorithms.
• Design a dimensional model and implement Type 1 and Type 2 dimensions in Snowflake.
• Implement push-down optimization for the ELT use cases.
• Develop and optimize data pipelines to ensure the efficient and reliable flow of data from various sources to the Snowflake data warehouse.
• Write and maintain complex SQL queries and scripts to manipulate, transform, and load data efficiently.
• Implement CI/CD pipelines for automated testing, deployment, and monitoring of data pipelines, utilizing tools like Jenkins for continuous integration.
• Monitor and troubleshoot ETL processes to ensure data quality, performance, and accuracy.
• Collaborate with cross-functional teams to ensure timely delivery of data solutions and meet project milestones.
• Follow best practices in data security, governance, and compliance.

Requirements

• 8-10 years of total experience in data integration and ETL development.
• Minimum 4 years of experience in Informatica Cloud (IDMC) and Snowflake.
• Strong proficiency in AWS cloud services, including S3, Lambda, and RDS.
• Expertise in writing complex SQL queries for data manipulation and transformation.
• Hands-on experience with CI/CD pipelines, preferably using Jenkins.
• Strong understanding of data warehousing concepts, particularly in Snowflake.
• Experience in performance tuning and optimization of ETL processes.
• Excellent problem-solving and troubleshooting skills.
• Strong communication skills and ability to work in a collaborative team environment.