Horizontal Talent - Plano, TX

posted 2 months ago

Full-time
Plano, TX

About the position

As a Data Engineer I, you will play a crucial role in designing, developing, and maintaining our data pipelines. This position is essential for ensuring that our data infrastructure is robust and efficient, enabling the organization to leverage data effectively for decision-making and operational efficiency. You will work closely with product managers to understand the requirements of various data products and collaborate with Principal Architects and the Data Platform team to ensure that best practices are followed in data engineering. Your responsibilities will include implementing robust data models that cater to the needs of the organization and integrating data from various core systems, including banking, Salesforce CRM, and mortgage platforms. In this role, you will be responsible for designing, developing, and maintaining data pipelines that support enterprise data products. You will collaborate with product managers to gather and understand requirements, ensuring that the data solutions you develop align with business needs. Working with cross-functional teams, including Principal Architects and the Data Platform team, you will review designs and ensure that best practices are adhered to throughout the data engineering process. You will apply strong data modeling practices for raw, canonical, and semantic data zones, effectively communicating the story of ingested data to stakeholders. Your work will involve integrating data from core banking systems, Salesforce CRM, and mortgage origination and servicing platforms. You will utilize a mix of legacy and modern platforms, including MS-SQL, Snowflake, and Azure SQL DB, to ensure that data is accessible and usable across the organization. Leveraging ETL tools like SSIS, ADF, and DBT for data transformation will be a key part of your responsibilities. Additionally, you will follow CI/CD practices using Azure DevOps and ADO, and use container tools such as AKS to manage the data lifecycle efficiently.

Responsibilities

  • Design, develop, and maintain data pipelines to support enterprise data products.
  • Collaborate with product managers to gather and understand requirements.
  • Work with cross-functional teams, including Principal Architects and the Data Platform team, to review designs and ensure best practices.
  • Apply strong data modeling practices for raw, canonical, and semantic data zones.
  • Communicate the story of ingested data effectively.
  • Integrate data from core banking systems, Salesforce CRM, and mortgage origination and servicing platforms.
  • Utilize a mix of legacy and modern platforms, including MS-SQL, Snowflake, and Azure SQL DB.
  • Leverage ETL tools like SSIS, ADF, and DBT for data transformation.
  • Follow CI/CD practices using Azure DevOps and ADO.
  • Use container tools such as AKS to manage the data lifecycle.

Requirements

  • 5+ years of experience in data engineering or a related role.
  • 3+ years of experience in SQL Programming Knowledge.
  • 3+ years of experience in programming language Python or Java or C#.
  • 2+ years of experience using Git.
  • Proficiency in MS-SQL, Snowflake, and Azure SQL DB.
  • Hands-on experience with ETL tools such as SSIS, ADF, and DBT.
  • Familiarity with CI/CD tools like Azure DevOps and ADO.
  • Experience with container tools, specifically AKS.
  • Experience with streaming processing technologies - Kafka, Spark Streaming, Azure Service Bus.
  • Strong understanding of data warehousing, data modeling, and data architecture principles.
  • Excellent communication skills, with the ability to tell the story of data clearly and effectively.

Nice-to-haves

  • Experience in the banking, mortgage, treasury, wealth management, or insurance industries.
  • Familiarity with both legacy and modern data platforms.
  • Strong problem-solving skills and attention to detail.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service