Big Data Architect

$180,000 - $250,000/Yr

Aidash - Palo Alto, CA

Full-time - Senior

Palo Alto, CA

About the position

As a Big Data Architect at AiDash, you will be instrumental in enhancing and scaling data pipelines that manage vast amounts of satellite imagery and enterprise data. This role requires a blend of technical expertise, leadership, and strategic thinking to shape company-wide data strategies and drive impactful outcomes. You will collaborate closely with Data Science and Engineering teams to develop innovative data solutions that address complex business challenges.

Responsibilities

• Ensure efficient ingestion, storage, and processing of geospatial data, including satellite imagery, LiDAR, weather data, and enterprise datasets.
• Manage massive imagery, 3D, and vector data using big data platforms.
• Lead organization-wide initiatives to streamline data storage and transformation.
• Identify and implement tools to host and catalog satellite and sensor data.
• Implement data quality control, validation, and standardization processes to maintain dataset integrity.
• Collaborate with data scientists and stakeholders to align data systems with business needs and enable data-driven decisions.
• Provide technical leadership, evolve system architecture, and propose new technologies to keep the tech stack scalable and reliable.

Requirements

• Minimum of 12 years of overall professional experience, including at least 8 years in data engineering.
• Proven track record of designing, building, and operating large-scale data systems.
• Experience in building and maintaining modern data pipelines in cloud or hybrid environments.
• Deep understanding of data modeling, data warehousing solutions, and data architecture strategies for both transactional and analytical systems.
• Strong experience with big data technologies (e.g., Hadoop, Spark), database systems (e.g., SQL, NoSQL), geospatial toolkits and ETL tools.
• Expertise in at least one programming language, such as Scala, Java, or Python.
• Experience with cloud services (AWS, Azure, Google Cloud), and a solid understanding of the data pipeline tools and services available on these platforms.
• Exceptional problem-solving, analytical, communication, and teamwork skills.
• Leadership experience with the ability to collaborate effectively across teams to achieve company objectives.
• Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field.

Nice-to-haves

• Expertise in building data platforms that host petabytes of imagery data.
• Strong experience with modern data cataloging and warehousing technologies (e.g., Iceberg, Spark, Athena, Sedona).
• Experience in building platforms for storing and processing large volumes of geospatial data - including satellite and LiDAR images.

Benefits

• Comprehensive Medical, Dental, and Vision Coverage: 100% coverage for employees and 80% for their spouses and children.
• Health Reimbursement Account (HRA): 100% funded by AiDash to cover medical deductibles.
• 401(k) Plan: Begin contributing after three months of employment to prepare for your future. Currently, no company match is offered.
• Parental Leave: Supportive parental leave with 16 weeks for primary caregivers and 4 weeks for secondary caregivers.
• Generous Vacation Policy: Accrue 20 vacation days per year, plus enjoy your Birthday off!