Staff Data Engineer

About the position

As a Senior Data Platform Engineer, you will collaborate with cross-functional teams to enhance our data architecture, troubleshoot data processing issues, and implement solutions to ensure the integrity, efficiency, and governance of our data ecosystem. The ideal candidate is passionate about building and maintaining key datasets and data infrastructure, possesses strong problem-solving skills, and has a proven track record in managing and optimizing data platforms.

Responsibilities

• Perform architecture design, table design, metric consistency, data modeling, and implementation of a big data platform and analytics applications.
• Analyze latest big data and analytics technologies and provide expertise in big data strategies.
• Provide governance of business-critical product data sets within Sovrn’s data warehouse and ensure their readiness for data analysts and other internal business users.
• Specify data platform components and configurations required for data pipeline implementation.
• Implement data pipeline metrics to monitor performance, accuracy, and availability.
• Research, implement, and evolve methods to process our data.
• Optimize data processing and data access to business intelligence tools.
• Provide domain expertise across the organization to enable business growth and development through data services and data models.
• Troubleshoot systemic issues and lead improvements.
• Work with the security team to implement and maintain robust data security measures.
• Ensure compliance with relevant data governance and privacy regulations.

Requirements

• Excellent understanding of big data processing environments such as Spark and Databricks.
• Hands-on experience with data processing using Spark and Python.
• Hands-on experience in big data and distributed data processing in the AWS ecosystem.
• Hands-on experience with orchestration tools such as Airflow and MWAA.
• Proficiency with Postgres, Athena, and DynamoDB.
• Experience with data warehousing and data mart design and implementation.
• Strong understanding and inner workings of metadata management, data lineage, and data governance.
• Strong experience in structured, unstructured, semi-structured data techniques and processes.
• Hands-on experience with infrastructure as code tools like Terraform and AWS Cloudformation.
• Ability to clearly document and communicate architectural concepts at multiple levels.
• Experience with data security and compliance (PII, CCPA, GDPR etc.).
• Create and maintain data products from data warehouse to user facing outputs such as reports and dashboards.
• Ability to lead problem definition, solution designs, and define implementation work plans.
• A creative yet analytical mindset with problem-solving skills.
• Excellent communication and collaboration skills.
• Ability to understand business domains and translate into data requirements.
• Staying up to date with industry metrics and anticipate how they can be incorporated into Sovrn data.

Benefits

• Competitive salaries
• Stock options
• Medical, dental and vision coverage
• Short and long term disability
• Life insurance
• 11 paid holidays
• Flexible vacation
• Commuter benefits
• 401(k) plan and match
• Paid parental leave program