Senior Associate Data Engineer- Azure Databricks Developer

$113,000 - $150,000/Yr

Publicis Groupe - Boston, MA

Full-time - Mid Level

Boston, MA

5,001-10,000 employees

Professional, Scientific, and Technical Services

About the position

Publicis Sapient is seeking a Senior Associate Data Engineer specializing in Azure Databricks to join their team of top-notch technologists. This role involves leading and delivering technical solutions for large-scale digital transformation projects, utilizing the latest data technologies to help clients evolve in a digital future.

Responsibilities

• Act as a trusted Azure expert to clients as part of large digital transformation journeys
• Advance the application of large-scale data platforms as a core building block to enable true business transformation
• Lead Data Migration projects to Azure cloud
• Build complex data pipelines on Azure infrastructure using cloud native technologies
• Work closely with clients to understand their needs and translate them into technology solutions
• Provide expertise as a technical resource to solve complex business issues that translate into data integration and database systems designs
• Shape opportunities and create execution approaches throughout the lifecycle of client engagements
• Ensure all deliverables are of high quality by setting development standards, adhering to the standards, and participating in code reviews
• Mentor, support, and manage team members

Requirements

• Hands on with Python, Spark/Pyspark, or SCALA
• Solid understanding and hands on experience with Databricks and Spark, including core concepts like RDDs, DataFrames, and Datasets
• Knowledge of SQL for querying and manipulating data, especially with structured data
• Expertise in data ingestion, transformation, and loading (ETL) processes, data modeling, and data warehousing
• Strong understanding of Azure cloud platform, including storage options and compute resources
• Proficiency in using Azure's core services like Virtual Machines, Virtual Networks, Storage Accounts, and Azure Active Directory
• Knowledge of database services like Azure SQL Database, Azure Cosmos DB, and Azure Database for PostgreSQL
• Understanding of DevOps principles and tools like Azure DevOps, GitHub Actions, and Jenkins
• Understanding of Delta Lake and its use cases for building reliable data pipelines
• Knowledge of SQL queries optimized for Databricks, including performance tuning techniques
• Skills in data visualization tools like Power BI or Tableau
• Experience with streaming data tools like Kafka, Flink or RabbitMQ
• Certification in Azure

Nice-to-haves

• Experience with data visualization tools like Power BI or Tableau
• Certification in Azure

Benefits

• Flexible vacation policy; time is not limited, allocated, or accrued
• 16 paid holidays throughout the year
• Generous parental leave and new parent transition program
• Tuition reimbursement
• Corporate gift matching program