Data Engineer

$128,000 - $144,000/Yr

CIBC

Full-time - Mid Level

10,001+ employees

Credit Intermediation and Related Activities

About the position

As a Data Engineer on the U.S. Data Strategy team at CIBC, you will be responsible for the technical design and development of applications across various technology platforms. This role involves transforming business requirements into programming instructions, developing custom ETL solutions, and ensuring data quality and consistency throughout the data pipeline. You will work in a fast-paced environment, collaborating with stakeholders to deliver impactful data management solutions while adhering to regulatory standards.

Responsibilities

• Develop and code end-to-end applications, including testing and debugging.
• Conduct technical design, development, and integration of multi-platform application systems.
• Configure and develop custom ETL solutions to ingest data into Azure SQL Data Warehouse.
• Design and develop SQL Server data objects such as tables, schemas, views, functions, and stored procedures.
• Implement data ingestion pipelines from multiple sources using Azure DataBricks and Apache Spark.
• Integrate end-to-end data pipelines to ensure data quality and consistency.
• Collaborate with project team members to support additional project components like API interfaces and Search.
• Evaluate performance and applicability of multiple tools against customer requirements.
• Document and maintain data lineage and validate application code against unit and security tests.
• Work in an agile SDLC, contributing from discovery to delivery of features.

Requirements

• Degree/diploma in Computer Science, Engineering, Management Information Systems, or a related field.
• 5+ years of experience as a Development Lead on Data Applications.
• Proficiency in the Data technology stack, including ETL, Azure SQL, and REST APIs.
• Expertise in designing and deploying data applications on cloud solutions like Azure or AWS.
• Hands-on experience in performance tuning and optimizing code in Databricks or similar ETL tools.
• Proficient in programming languages such as Pyspark and Python.
• Good understanding of SQL, T-SQL, and/or PL/SQL.
• Demonstrated analytical and problem-solving skills in a big data environment.

Nice-to-haves

• Microsoft Azure Big Data Architecture certification.
• Experience with Integration and BI Tools such as Tableau, Cognos, or Power BI.
• Significant automation experience for minimizing manual processes.

Benefits

• Medical, Dental, Vision, Health Savings Account, Life Insurance, Disability, and Other Insurance Plans.
• Paid Time Off (including Sick Leave, Parental Leave, and Vacation).
• Holidays and 401(k) plan.
• Incentive compensation plan, which may include a discretionary bonus component.
• Wellbeing support and MomentMakers recognition program.