Big Data Architect

$180,000 - $250,000/Yr

AiDash AiDash Inc. - Palo Alto, CA

Full-time - Senior

Palo Alto, CA

About the position

The Big Data Architect at AiDash will be responsible for enhancing and scaling data pipelines that manage vast amounts of satellite imagery and enterprise data. This role involves collaborating closely with Data Science and Engineering teams to develop innovative data solutions that address complex business challenges, ensuring efficient data ingestion, storage, and processing while maintaining data integrity and alignment with business needs.

Responsibilities

• Ensure efficient ingestion, storage, and processing of geospatial data, including satellite imagery, LiDAR, weather data, and enterprise datasets.
• Manage massive imagery, 3D, and vector data using big data platforms.
• Lead organization-wide initiatives to streamline data storage and transformation.
• Identify and implement tools to host and catalog satellite and sensor data.
• Implement data quality control, validation, and standardization processes to maintain dataset integrity.
• Collaborate with data scientists and stakeholders to align data systems with business needs and enable data-driven decisions.
• Provide technical leadership, evolve system architecture, and propose new technologies to keep the tech stack scalable and reliable.

Requirements

• Minimum of 12 years of overall professional experience, including at least 8 years in data engineering.
• Proven track record of designing, building, and operating large-scale data systems.
• Experience in building and maintaining modern data pipelines in cloud or hybrid environments.
• Deep understanding of data modeling, data warehousing solutions, and data architecture strategies for both transactional and analytical systems.
• Strong experience with big data technologies (e.g., Hadoop, Spark), database systems (e.g., SQL, NoSQL), geospatial toolkits, and ETL tools.
• Expertise in at least one programming language, such as Scala, Java, or Python.
• Experience with cloud services (AWS, Azure, Google Cloud) and a solid understanding of the data pipeline tools and services available on these platforms.
• Exceptional problem-solving, analytical, communication, and teamwork skills.
• Leadership experience with the ability to collaborate effectively across teams to achieve company objectives.
• Bachelor's or Master's degree in Computer Science, Engineering, Mathematics, or a related field.

Nice-to-haves

• Expertise in building data platforms that host petabytes of imagery data.
• Strong experience with modern data cataloging and warehousing technologies (e.g., Iceberg, Spark, Athena, Sedona).
• Experience in building platforms for storing and processing large volumes of geospatial data - including satellite and LiDAR images.

Benefits

• Comprehensive Medical, Dental, and Vision Coverage: 100% coverage for employees and 80% for their spouses and children.
• Health Reimbursement Account (HRA): 100% funded by AiDash to cover medical deductibles.
• 401(k) Plan: Begin contributing after three months of employment to prepare for your future.
• Parental Leave: Supportive parental leave with 16 weeks for primary caregivers and 4 weeks for secondary caregivers.
• Generous Vacation Policy: Accrue 20 vacation days per year, plus enjoy your Birthday off!