Senior Associate Data Engineer- Azure Databricks Developer

$118,000 - $160,000/Yr

Publicis Groupe - New York, NY

Full-time - Mid Level

New York, NY

10,001+ employees

Professional, Scientific, and Technical Services

About the position

Publicis Sapient is seeking a Senior Associate Data Engineer specializing in Azure to lead and deliver technical solutions for large-scale digital transformation projects. This role involves working with cutting-edge data technologies to help clients transition to a more digital future, focusing on data migration, building complex data pipelines, and providing technical expertise throughout client engagements.

Responsibilities

• Act as a trusted Azure expert to clients during digital transformation journeys.
• Advance the application of large-scale data platforms to enable business transformation.
• Lead Data Migration projects to Azure cloud.
• Build complex data pipelines on Azure infrastructure using cloud native technologies.
• Work closely with clients to understand their needs and translate them into technology solutions.
• Provide expertise as a technical resource to solve complex business issues related to data integration and database systems designs.
• Shape opportunities and create execution approaches throughout the lifecycle of client engagements.
• Ensure all deliverables are of high quality by setting development standards and participating in code reviews.
• Mentor, support, and manage team members.

Requirements

• Hands-on experience with Python, Spark/Pyspark, or Scala.
• Solid understanding and hands-on experience with Databricks and Spark, including core concepts like RDDs, DataFrames, and Datasets.
• Knowledge of SQL for querying and manipulating structured data.
• Expertise in ETL processes, data modeling, and data warehousing.
• Strong understanding of Azure cloud platform, including storage options and compute resources.
• Proficiency in using Azure's core services like Virtual Machines, Storage Accounts, and Azure Active Directory.
• Knowledge of database services like Azure SQL Database and Azure Cosmos DB.
• Understanding of DevOps principles and tools like Azure DevOps and GitHub Actions.
• Knowledge of Delta Lake and its use cases for building reliable data pipelines.
• Skills in data visualization tools like Power BI or Tableau.

Nice-to-haves

• Experience with streaming data tools like Kafka, Flink, or RabbitMQ.
• Certification in Azure.

Benefits

• Flexible vacation policy; time is not limited, allocated, or accrued.
• 16 paid holidays throughout the year.
• Generous parental leave and new parent transition program.
• Tuition reimbursement.
• Corporate gift matching program.