Senior Associate Data Engineer- Azure Databricks Developer

$113,000 - $150,000/Yr

Publicis Groupe - New York, NY

Full-time - Mid Level

New York, NY

10,001+ employees

Professional, Scientific, and Technical Services

About the position

Publicis Sapient is seeking a Senior Associate Data Engineer specializing in Azure Databricks to lead and deliver technical solutions for large-scale digital transformation projects. This role involves working with cutting-edge data technologies to help clients transition to a more digital future, ensuring high-quality deliverables and mentoring team members.

Responsibilities

• Act as a trusted Azure expert to clients during digital transformation journeys.
• Advance the application of large-scale data platforms to enable business transformation.
• Lead Data Migration projects to Azure cloud.
• Build complex data pipelines on Azure infrastructure using cloud native technologies.
• Understand client needs and translate them into technology solutions.
• Provide technical expertise to solve complex business issues related to data integration and database systems designs.
• Shape opportunities and create execution approaches throughout client engagements.
• Ensure high-quality deliverables by setting development standards and participating in code reviews.
• Mentor, support, and manage team members.

Requirements

• Hands-on experience with Python, Spark/Pyspark, or SCALA.
• Solid understanding and hands-on experience with Databricks and Spark, including RDDs, DataFrames, and Datasets.
• Knowledge of SQL for querying and manipulating structured data.
• Expertise in ETL processes, data modeling, and data warehousing.
• Strong understanding of Azure cloud platform, including Azure Blob Storage and Azure Data Lake Storage Gen2.
• Proficiency in Azure's core services like Virtual Machines, Virtual Networks, and Azure Active Directory.
• Knowledge of database services like Azure SQL Database and Azure Cosmos DB.
• Understanding of DevOps principles and tools like Azure DevOps and GitHub Actions.
• Understanding of Delta Lake and its use cases for building reliable data pipelines.
• Knowledge of SQL queries optimized for Databricks, including performance tuning techniques.
• Skills in data visualization tools like Power BI or Tableau.
• Experience with streaming data tools like Kafka, Flink, or RabbitMQ.
• Certification in Azure.

Benefits

• Flexible vacation policy; time is not limited, allocated, or accrued.
• 16 paid holidays throughout the year.
• Generous parental leave and new parent transition program.
• Tuition reimbursement.
• Corporate gift matching program.