Hire Force Global - Frisco, TX

posted 15 days ago

Full-time
Frisco, TX

About the position

The Informatica Cloud (IDMC) ETL Developer with Snowflake position is focused on designing, developing, and optimizing ETL workflows to integrate data from various sources into Snowflake. The role requires a strong background in data integration, particularly with Informatica Cloud and Snowflake, and involves collaboration with data architects and business analysts to ensure efficient data pipeline operations.

Responsibilities

  • Design, develop, and implement complex ETL mappings, data transformations, and task flows using Informatica Cloud (IDMC).
  • Collaborate with data architects and business analysts to understand data requirements and translate them into scalable ETL processes.
  • Process complex files from S3 bucket, perform data quality checks, and load them into Snowflake.
  • Leverage IDMC CDQ for business rules to perform data quality checks.
  • Implement end-to-end ETL/ELT process using IDMC CDI/CAI for Snowflake using medallion architecture.
  • Implement data masking and data encryptions using 3rd party APIs and algorithms.
  • Design a dimensional model and implement Type 1 and Type 2 dimensions in Snowflake.
  • Implement push-down optimization for the ELT use cases.
  • Develop and optimize data pipelines to ensure the efficient and reliable flow of data from various sources to the Snowflake data warehouse.
  • Write and maintain complex SQL queries and scripts to manipulate, transform, and load data efficiently.
  • Implement CI/CD pipelines for automated testing, deployment, and monitoring of data pipelines, utilizing tools like Jenkins for continuous integration.
  • Monitor and troubleshoot ETL processes to ensure data quality, performance, and accuracy.
  • Collaborate with cross-functional teams to ensure timely delivery of data solutions and meet project milestones.
  • Follow best practices in data security, governance, and compliance.

Requirements

  • 8-10 years of total experience in data integration and ETL development.
  • Minimum 4 years of experience in Informatica Cloud (IDMC) and Snowflake.
  • Strong proficiency in AWS cloud services, including S3, Lambda, and RDS.
  • Expertise in writing complex SQL queries for data manipulation and transformation.
  • Hands-on experience with CI/CD pipelines, preferably using Jenkins.
  • Strong understanding of data warehousing concepts, particularly in Snowflake.
  • Experience in performance tuning and optimization of ETL processes.
  • Excellent problem-solving and troubleshooting skills.
  • Strong communication skills and ability to work in a collaborative team environment.

Nice-to-haves

  • Any certifications on IICS/Snowflake.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service