Principal Data Engineer

$177,560 - $244,145/Yr

Analog Devices - San Jose, CA

posted 6 days ago

Full-time - Senior
San Jose, CA
10,001+ employees
Computer and Electronic Product Manufacturing

About the position

As a Principal Data Engineer at Analog Devices, Inc., you will lead the design, development, and implementation of advanced data solutions that support the enterprise-wide data strategy. This role focuses on driving the architecture and optimization of a scalable, secure data platform that enables advanced analytics and data-driven decision-making across the organization. You will provide thought leadership, mentor a team of skilled data engineers, and ensure the reliability and security of data platforms.

Responsibilities

  • Lead the design and development of the data platform, ensuring it meets current and future business needs.
  • Architect data models, storage, and processing solutions that balance performance, scalability, and maintainability.
  • Perform hands-on development work on data analysis, data provisioning, data modeling, performance tuning, and optimization.
  • Perform design and development in technologies like Fivetran, Snowflake, DBT, Python, SQL, Spark, Kubernetes, Kafka and utilize cloud technologies like Azure, AWS, and GCP.
  • Design, build and maintain robust data processing frameworks for enabling actionable insights and analytics with petabyte scale structured/semi-structured/unstructured data.
  • Define and enforce best practices for data engineering, including coding standards, source control, and CI/CD processes.
  • Create dashboards using enterprise tools such as Tableau and PowerBI.
  • Work with vector, graph and NoSQL databases for complex data use-cases.
  • Ensure the reliability, performance, and security of data platforms and solutions.
  • Provide technical guidance and support to team members, fostering a culture of collaboration, innovation, and continuous improvement.
  • Work closely with business unit leaders, data scientists, and analysts to understand their requirements and translate them into robust technical solutions.
  • Implement data governance practices, ensuring data security, compliance, and quality controls.
  • Scope key business challenges, identify the right data, and provide direction to data analysts, product managers, data scientists, and data engineers.
  • Drive innovation by creating new frameworks, standards, prototypes, and automation projects.
  • Stay current with emerging trends and technologies in data engineering and analytics.

Requirements

  • Bachelor's or master's degree in computer science, Engineering, or a related field.
  • 15+ years of experience in data engineering, with a focus on designing and implementing large-scale data solutions.
  • Proven experience in a lead role, capable of driving projects and collaborating with cross-functional teams.
  • Strong proficiency in SQL, Python, big data technologies (Hadoop, Spark, Presto, Hive), containerization (Kubernetes), and cloud technologies like Snowflake, DBT, Dagster.
  • Experience designing, building and maintaining frameworks to handle large data volumes, streaming data use-cases using technologies like Kafka.
  • Experience building on at least one of the cloud technologies (AWS, GCP, Azure).
  • Deep understanding of data modeling, ELT processes, medallion architecture, open file formats and data integration techniques.
  • Outstanding communication and interpersonal skills, with the ability to engage effectively with technical and non-technical stakeholders.
  • Strong problem-solving skills and a proactive approach to identifying and addressing challenges.
  • Strong Knowledge of data governance, security, and compliance best practices.

Benefits

  • Medical coverage
  • Vision coverage
  • Dental coverage
  • 401k
  • Paid vacation
  • Paid holidays
  • Sick time
  • Discretionary performance-based bonus
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service