Staff Data Engineer - Data Analytics & Workflows

Full-time - Senior

Palo Alto, CA

About the position

AiDASH is looking for an experienced data engineer to join our fast-growing Data & ML Platform team. As a senior member of the team, you will be leading the design and development of Analytics and Workflows to process vast amounts of geospatial and enterprise data, and power ML inferencing and experimentation. In the role, you will work closely with stakeholders across teams such as Data Science, Product, and DevOps; and will have ample opportunities to guide and mentor other team members.

Responsibilities

• Design and build scalable data pipelines: Architect and implement data workflows for high-volume, high-complexity datasets, ensuring data is reliable, accurate, and accessible for analytics and machine learning applications
• Data architecture: Take ownership of designing and maintaining data architecture and storage solutions
• Performance tuning and optimization: Continuously optimize data workflows for performance, scalability, and cost-efficiency, including working with big data tools and cloud platforms
• Cross-functional Collaboration: Support data science, machine learning and business operations functions
• Infrastructure reliability and pipeline monitoring: Monitor and maintain pipelines and infrastructure to uphold internal SLAs

Requirements

• 8+ years of experience in data engineering, with hands-on experience designing and building data pipelines and architectures
• 4+ years experience in building data pipes, datalakes and datawarehouse
• Proficient in programming languages such as Python, Java, or Scala, and experience with data processing frameworks like Apache Spark or Hadoop
• Familiarity with data warehousing solutions like Snowflake, Redshift, or BigQuery
• Strong knowledge of ETL/ELT concepts, frameworks or tools (e.g., Apache Airflow, Talend, DBT, or similar)
• Deep understanding of data modeling techniques, and data warehouse design
• Knowledge of Data Security and Governance (nice to have)
• BS/BA in a technical field such as Computer Science

Nice-to-haves

• Experience with machine learning workflows and integrating data engineering systems with ML model training and inferencing
• Knowledge of satellite-generated data and geo-spatial technologies

Benefits

• Comprehensive Medical, Dental, and Vision Coverage: 100% coverage for employees and 80% for their spouses and children
• Health Reimbursement Account (HRA): 100% funded by AiDASH to cover medical deductibles
• 401(k) Plan: Begin contributing after three months of employment to prepare for your future. Currently, no company match is offered
• Parental Leave: Supportive parental leave with 16 weeks for primary caregivers and 4 weeks for secondary caregivers
• Generous Vacation Policy: Accrue 20 vacation days per year, plus enjoy your Birthday off!