Unclassified - New York, NY

posted 4 months ago

Full-time
New York, NY

About the position

The ETL Developer position is a critical role focused on the extraction, transformation, and loading of data within a complex data environment. The successful candidate will be responsible for migrating approximately 200 data feeds, with an expectation of processing an average of one feed every two weeks. However, there is an anticipation of acceleration in this timeline, which means the developer must be prepared to adapt to a faster pace as needed. This role requires a strong proficiency in Python, SQL, and Databricks, as these technologies will be the primary tools used in the migration process. The position is based in New York and requires onsite presence three days a week, allowing for collaboration with team members and stakeholders. The developer will work closely with data architects and other developers to ensure that the data migration is executed smoothly and efficiently, adhering to best practices in ETL processes. Additionally, the role may involve troubleshooting and optimizing existing ETL processes to improve performance and reliability.

Responsibilities

  • Migrate approximately 200 data feeds to a new system.
  • Develop and maintain ETL processes using Python, SQL, and Databricks.
  • Collaborate with data architects and other developers to ensure successful data migration.
  • Troubleshoot and optimize existing ETL processes for better performance.
  • Adapt to an accelerated timeline for data feed migration as needed.

Requirements

  • Minimum of 13 years of experience in ETL development.
  • Strong proficiency in Python and SQL.
  • Experience with Databricks for data processing and migration.
  • Ability to work onsite in New York three days a week.
  • Proven track record of managing multiple data feeds and projects simultaneously.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service