DataBricks Architect

Conch Technologies - Jersey City, NJ

Full-time - Mid Level

Jersey City, NJ

Administrative and Support Services

About the position

The Databricks Architect position at Conch Technologies Inc is a critical role that involves designing and implementing data solutions using Databricks on AWS. The ideal candidate will have extensive experience with Databricks and a strong understanding of AWS services. This position requires a deep knowledge of data architecture, data engineering, and cloud technologies to effectively leverage Databricks for data processing and analytics. The architect will be responsible for creating scalable and efficient data pipelines, ensuring data quality, and optimizing performance within the Databricks environment. Additionally, the role involves collaborating with cross-functional teams to define data requirements and deliver solutions that meet business needs. The Databricks Architect will also play a key role in mentoring junior team members and providing technical guidance throughout the project lifecycle.

Responsibilities

• Design and implement data solutions using Databricks on AWS.
• Create scalable and efficient data pipelines for data processing and analytics.
• Ensure data quality and optimize performance within the Databricks environment.
• Collaborate with cross-functional teams to define data requirements.
• Mentor junior team members and provide technical guidance throughout the project lifecycle.

Requirements

• Extensive experience with Databricks and AWS services.
• Strong understanding of data architecture and data engineering principles.
• Proven ability to design and implement data solutions in a cloud environment.
• Experience with data processing frameworks and tools.
• Excellent problem-solving skills and attention to detail.

Nice-to-haves

• Experience with other cloud platforms such as Azure or Google Cloud.
• Knowledge of machine learning frameworks and tools.
• Familiarity with data governance and compliance standards.

Benefits

• Competitive salary based on experience.
• Opportunity for professional development and training.