Big Data Platform Architect

BCforward - Philadelphia, PA

Full-time - Senior

Hybrid - Philadelphia, PA

5,001-10,000 employees

Professional, Scientific, and Technical Services

About the position

The Data Platform Architect will lead the design and implementation of scalable data solutions, focusing on data architecture, integration, and processing frameworks. This role requires expertise in Databricks and aims to optimize diverse workloads while ensuring compliance and governance across multi-cloud environments.

Responsibilities

• Design the data architecture for the proposed platform, focusing on scalability, performance, and support for advanced analytics and data science workloads.
• Ensure the platform supports multi-cloud operations, data sharing, and integration with various data sources, including on-premises and cloud environments.
• Collaborate with Cloud Architects and Engineers to implement data governance, financial governance, and compliance features.
• Optimize the platform for handling diverse workloads, relational operations, and multi-model data processing.
• Design and model data architecture tailored to organizational needs, leveraging Databricks and other relevant technologies.
• Develop and implement data ingestion frameworks, ensuring efficient and scalable data pipelines.
• Architect and maintain data Lakehouse storage solutions, emphasizing best practices for data modeling and schema design.
• Create and optimize data processing frameworks to support diverse workloads and data sources.
• Provide client-facing support, ensuring clear communication and understanding of technical solutions.
• Lead efforts in data sharing and integration across various platforms, connecting structured and unstructured data sources.
• Collaborate with stakeholders to document enterprise rollout strategies, data security blueprints, and architectural standards.

Requirements

• Strong background in data architecture and data integration.
• Expertise in data processing frameworks, particularly Databricks.
• Experience in designing scalable data solutions for advanced analytics and data science workloads.
• Knowledge of multi-cloud operations and data governance.
• Ability to optimize diverse workloads and relational operations.

Nice-to-haves

• Experience with data Lakehouse storage solutions.
• Familiarity with data modeling and schema design best practices.
• Client-facing experience in technical support.