Data Engineer

Arch Systems - Palo Alto, CA

Full-time - Mid Level

Palo Alto, CA

Professional, Scientific, and Technical Services

About the position

Arch Systems is seeking a talented and impactful Data Engineer to become part of our rapidly expanding team. In this role, you will work with data collected from factory machines and devices, processing and preparing it for effective data analytics and visualization. Your contributions will play a crucial role in transforming raw data into actionable insights that drive our business forward. As a Data Engineer, you will play a key role in managing and optimizing the data pipelines that fuel our Athena DB, ensuring seamless data integration and accessibility. In this role, you'll collaborate closely with both our cloud and data science teams to deliver robust, scalable data solutions.

Responsibilities

• Write and maintain transform code in Python to ensure efficient and reliable data flows within our ETL pipeline.
• Troubleshoot and fix infrastructure code related to AWS Lambda functions, ensuring smooth operation of cloud services.
• Lead complex data modeling efforts across multiple teams and domains, identifying and resolving data inconsistencies.
• Develop code to generate complex reports, and assist team members in debugging and optimizing their report-generating processes.

Requirements

• Bachelor's Degree Required, Advanced degrees (Master's or Ph.D.) are highly preferred.
• 3-7+ years of proven experience in Data science, Data processing, & Insight generation.
• Hands-on experience with machines, manufacturing, or other industrial processes, applying data-driven insights in real-world scenarios.
• Strong problem-solving abilities with a focus on clear, structured logic.
• Strong expertise in Python development, with a focus on data engineering applications.
• Comfortable working with cloud infrastructure, and eager to contribute to Terraform code for infrastructure as code (IaC) initiatives.
• Skilled in SQL, with experience in data modeling and analytics engineering to ensure clean, structured, and scalable data systems.
• Comprehensive understanding of complex systems, ensuring effective integration and functionality across platforms.
• Exceptional ability to simplify and articulate complex concepts to customers, ensuring clarity and engagement.
• Proficient in creating clear, impactful visuals and actionable takeaways that drive understanding and decision-making.

Nice-to-haves

• Demonstrated proficiency in coding, showcasing a strong command of best practices and efficient programming techniques.
• Outstanding grasp of theoretical concepts in computing, allowing for informed decision-making in complex scenarios.
• Highly adept at understanding the trade-offs involved in system design, ensuring optimal performance and scalability.
• Ability to self-unblock easily, demonstrating initiative and resourcefulness in overcoming challenges.
• Proven experience collaborating effectively with remote, distributed teams, leveraging communication tools to maintain productivity.
• Hands-on experience with AWS services, contributing to cloud-based solutions and architecture.
• Proficient in using Terraform for infrastructure management, enabling efficient deployment and scaling of resources.
• Familiarity with Kubernetes for managing containerized applications, enhancing deployment efficiency and reliability.

Benefits

• Comprehensive healthcare options for both employees and dependents.
• Retirement contributions.
• Supportive resources for wellbeing and development.
• Equity ownership opportunities to align personal success with the company's mission and growth.
• Remote-first work culture that provides flexibility and balance.