Softa Ai Solutions - New York, NY

posted 9 days ago

Full-time - Senior
New York, NY

About the position

The Snowflake Lead Developer position is a senior role focused on data engineering and development within Azure Databricks and Snowflake environments. The ideal candidate will possess extensive experience in data ingestion, transformation, and warehousing concepts, particularly using Scala programming language. This role requires strong technical skills in managing data lakes and delta tables, as well as familiarity with SQL Server and Oracle databases. The position is based in Quincy, MA, and is offered as a contract role.

Responsibilities

  • Lead development and design efforts in Azure Databricks using Scala.
  • Perform end-to-end data ingestion and transformation in Databricks/Snowflake.
  • Implement data warehousing concepts, including ETL processes and SCD types.
  • Manage and optimize data lakes and delta tables.
  • Migrate data from SQL Server/Oracle to Databricks.
  • Write complex queries and functions using TSQL/PLSQL.
  • Communicate effectively with team members and stakeholders.

Requirements

  • 8-10 years of experience in data engineering and development.
  • Strong experience in Azure Databricks and Scala programming.
  • Extensive knowledge of data warehousing concepts and ETL processes.
  • Experience with data lakes and delta tables.
  • Familiarity with SQL Server and Oracle databases.
  • Experience with Spark SQL and other ETL tools.

Nice-to-haves

  • Experience with big data technologies like Hadoop.
  • Familiarity with multiple source systems databases.
  • Strong communication skills.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service