Database Developer

Tata Consultancy Services - Quincy, MA

Full-time - Senior

Quincy, MA

Professional, Scientific, and Technical Services

About the position

This position is for a Senior/Lead Developer specializing in data engineering, with a strong focus on Databricks and Snowflake. The role requires extensive experience in developing and designing data solutions, particularly using Scala in Databricks. The candidate will be responsible for end-to-end data ingestion and transformation, as well as working with data warehousing concepts and data lakes.

Responsibilities

• Develop and design data solutions using Databricks and Snowflake.
• Implement end-to-end data ingestion and transformation processes in Databricks.
• Utilize Scala programming for data development in Databricks.
• Work with data warehousing concepts, including ETL processes and slowly changing dimensions (SCD).
• Manage and optimize data lakes and delta tables.
• Collaborate with databases such as SQL Server and Oracle.
• Leverage big data technologies, particularly Hadoop, as an added advantage.

Requirements

• 8+ years of experience in data engineering and development.
• Extensive experience with Databricks, particularly in Scala.
• Strong knowledge of Snowflake is preferred but not mandatory.
• Good understanding of ETL concepts and data warehousing.
• Experience with data lakes and delta tables.
• Familiarity with SQL Server and Oracle databases.
• Experience with big data technologies like Hadoop is a plus.

Nice-to-haves

• Experience with big data technologies such as Hadoop.