PRINCIPAL DATA ENGINEER, AZURE

$166,400 - $197,600/Yr

Harnham - New York, NY

posted about 1 month ago

Full-time - Senior
Remote - New York, NY
Professional, Scientific, and Technical Services

About the position

As a Principal Data Engineer specializing in Azure, you will play a pivotal role in designing and developing data warehouses and data pipelines that are essential for machine learning model execution. This position requires a deep understanding of Azure data services and the ability to lead the design and development lifecycle of applications within a large team environment. You will collaborate with cross-functional teams, ensuring that the solutions you create are efficient and meet the business requirements. Your expertise will be crucial in implementing and designing large-scale solutions for multi-tenant architecture, particularly in OLTP and BI systems. In this role, you will actively participate in Agile methodologies, which include daily stand-ups, sprint planning, and product demonstrations. You will be responsible for writing efficient code and developing methods to handle third-party data, ensuring that the data pipelines you create are robust and scalable. Your contributions will directly impact the success of the projects you work on, as you will be leveraging your extensive experience in Azure data services to drive innovation and efficiency within the team. This position is fully remote and is offered as a 3-month contract-to-hire, providing an excellent opportunity for you to showcase your skills and potentially secure a long-term role with a company that values its employees and fosters a culture of collaboration and growth.

Responsibilities

  • Design and develop Azure data warehouses and data pipelines for ML model execution
  • Collaborate in a cross-functioning team and serve as an Azure subject matter expert
  • Lead the design and development lifecycle of applications
  • Participate in Agile methodology including daily stand-ups, sprint planning, and product demonstrations
  • Design efficient codes and develop methods for handling 3rd party data for ML models and overall business requirements

Requirements

  • Bachelor's degree in Computer Science, Data Systems or related field; Master's preferred
  • 7 years' hands-on experience in implementing and designing large-scale solutions for multi-tenant architecture in OLTP and BI systems and data pipelines
  • 5 years' experience in Azure data services including SQL Database, Databricks, Synapse, and Azure Analysis Services
  • Deep understanding and proven experience in implementation across different data stores such as Azure Data Lake, SQL Warehouse, Azure Blob Storage
  • Experience with messaging systems such as Kafka and process engines including Hadoop, Spark, or Storm
  • Background in designing and implementing data pipelines for BI and Machine Learning solutions
  • Ability to work in a fast-paced, collaborative team environment
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service