Sr ETL Developer - Remote, (Eastern Time)

$148,614 - $201,066/Yr

Arch Capital Group Ltd.

Full-time - Senior

Remote

Insurance Carriers and Related Activities

About the position

The Senior ETL Developer will play a crucial role in the Corporate IT team, focusing on the maintenance and development of data integration solutions that support our Analytics platform. This position requires a deep understanding of data vault, data mart, dimensional modeling, and ETL standards and guidelines. The successful candidate will work primarily with Matillion and Snowflake data warehouses/databases, as well as Power BI for reporting purposes. The role involves translating business and technical requirements into effective data integration designs and deliverables, collaborating closely with the Corporate Data Architect. Additionally, the Senior ETL Developer will support the Agile process throughout development, testing, deployment, and post-production support phases. In this role, the developer will manage multiple projects simultaneously, ensuring timely delivery of solution designs while closely collaborating with the architecture team. Responsibilities include designing and developing ETL programs using modern ETL tools such as Matillion, DBT, and Python, as well as coaching and guiding the technical team in the development of ETL jobs. Performance improvement and tuning of data pipelines will also be a key focus, along with conducting technical reviews, data validation, and end-to-end testing of ETL objects. The developer will create and maintain necessary documentation according to standards and provide regular project status updates to the project manager. Furthermore, the role involves working with the deployment team for code migration across environments, triaging production issues, and implementing code fixes as needed. The ideal candidate will have proven experience in database administration with cloud data platforms like Snowflake, freeing up data engineers and analysts from administrative tasks. This position is designed for a professional with a strong background in BI project implementation within large-scale enterprise data warehouse environments, particularly with cloud computing services and Agile methodologies.

Responsibilities

• Handle multiple projects in parallel, participate and deliver solution design while working closely with the architecture.
• Design and Develop/Review ETL programs primarily using modern ETL tools like Matillion, DBT, and Python.
• Coach and guide the technical team in terms of development of ETL jobs.
• Provide performance improvement and tuning of data pipeline.
• Perform technical reviews, data validation, and end-to-end testing of ETL objects, source data analysis, and data profiling.
• Create necessary documentation as per the standards and update the project documentation.
• Support QA on end-to-end testing and provide daily/weekly project status to the project manager.
• Work with the deployment team in the code migration across the environments.
• Triage the Production issues and work on the code fixes.

Requirements

• 10+ years of experience in implementation of BI projects in a large-scale enterprise data warehouse environment.
• Hands-on experience in building large cloud data warehouses using Snowflake; including database architecture design, data transformations, stored procedures, account and security principles, performance management, etc.
• Experience with cloud computing services, particularly deploying and running services in Azure.
• Expert-level understanding of Agile, SDLC, CI/CD, DevOps, GitOps, and ProdOps.
• A team player with excellent verbal and written communication skills.
• Experience with other ETL tools like Matillion, ADF, and DBT.
• Advanced SQL knowledge and familiarity with relational, Vault, and dimensional modeling.
• Knowledge of Power BI.
• Required knowledge and skills would typically be acquired through a bachelor's degree in information technology or related field.

Nice-to-haves

• Financial industry data fluency is preferred but not required.