Cargill - Atlanta, GA

posted 2 months ago

Full-time - Senior
Atlanta, GA
10,001+ employees
Food Manufacturing

About the position

As a Senior Data Engineer Tech Lead at Cargill, you will be at the forefront of designing, developing, and operating complex, high-performance data-centric solutions. This role is pivotal in enabling analytical insights and enhancing process efficiencies across Cargill's diverse business environments. You will lead a small, passionate team dedicated to building innovative, resilient, and high-quality solutions while fostering a culture of sharing, learning, and growth. Your day-to-day responsibilities will include collaborating with business stakeholders and product owners to define requirements and design effective products or solutions. You will also participate in critical decision-making processes related to the architecture of these solutions. In this role, you will develop technical products utilizing big data and cloud-based technologies, ensuring they are scalable, sustainable, and robust. You will perform complex data modeling and prepare data in databases for use in various analytics tools, configuring and developing data pipelines to optimize data assets. Your technical guidance will be essential throughout all phases of the product or solution lifecycle, and you will build complex prototypes to test new concepts and develop reusable frameworks and components. As a leader, you will drive the adoption of new technologies and methods within the data engineering team, serving as a role model and mentor for other data engineers. You will independently solve complex issues with minimal supervision, escalating more intricate problems to the appropriate staff when necessary. This position offers a unique opportunity to make a significant impact within Cargill while working in a collaborative and innovative environment.

Responsibilities

  • Collaborate with business stakeholders and product owners to define requirements and design products or solutions.
  • Participate in decision-making processes related to architecting products and solutions.
  • Develop technical products or solutions utilizing big data and cloud-based technologies, ensuring scalability, sustainability, and robustness.
  • Perform complex data modeling and prepare data in databases for use in various analytics tools.
  • Configure and develop data pipelines to move and optimize data assets.
  • Provide necessary technical guidance through all phases of the product or solution lifecycle.
  • Build complex prototypes to test new concepts and develop reusable frameworks, components, and data products or solutions.
  • Drive the adoption of new technologies and methods within the data engineering team.
  • Serve as a role model and mentor for data engineers.
  • Independently solve complex issues with minimal supervision.

Requirements

  • Bachelor's degree in a related field or equivalent experience.
  • Minimum of four years of related work experience.
  • Experience developing modern data architectures, such as data warehouses, data lakes, and data meshes.
  • Experience with data collection and ingestion capabilities, such as AWS Glue, Kafka Connect, and Flink.
  • Experience with data storage and management of large, heterogeneous datasets.
  • Experience with transformation and modeling tools, including SQL-based transformation frameworks and orchestration tools.
  • Experience working in Big Data environments, including tools such as Hadoop and Spark.
  • Experience working in Cloud Platforms such as AWS, GCP, or Azure.
  • Strong programming knowledge of SQL, Python, R, Java, or Scala.
  • Proficiency in engineering tooling such as Docker, Git, and container orchestration services.
  • Strong experience working in DevOps models with an understanding of best practices for code management.

Nice-to-haves

  • Experience with indirect and direct leadership of engineering teams.
  • Experience and knowledge of data governance considerations including quality, privacy, and security implications for data product development.
  • Excellent analytical and problem-solving skills.
  • Excellent communication skills with technical and non-technical stakeholders.
  • Ability to navigate ambiguity and work in agile ways.

Benefits

  • Health insurance coverage
  • 401k retirement savings plan
  • Paid holidays
  • Flexible scheduling options
  • Professional development opportunities
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service