Data Engineer III - Data Platform Engineer

$90,000 - $180,000/Yr

Walmart - Bentonville, AR

Full-time - Entry Level

Bentonville, AR

General Merchandise Retailers

About the position

As a Walmart Data Platform Engineer, you will play a crucial role in harnessing the power of data to solve complex problems that will shape the future of retail. With Walmart's vast environment, you will work with some of the largest data sets in the industry, contributing to the orchestration layer of complex data transformations. Your primary responsibility will be to refine raw data from various sources into targeted, valuable data assets that can be consumed in a governed manner. You will collaborate with Data Scientists, Analysts, and other engineers to tackle exciting challenges, ultimately enhancing the retail business model and positively impacting customers' lives. Your work will involve designing, building, testing, and deploying cutting-edge solutions at scale, which will affect millions of customers worldwide. You will develop high-performance and scalable solutions that extract, transform, and load data using technologies such as Storm and Spark. Additionally, you will perform root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement. Your role will also require you to interact with Walmart engineering teams across different geographies, leveraging expertise and contributing to the tech community. In this position, you will engage with Product Management and Business teams to drive the agenda, set priorities, and deliver exceptional product features. You will be responsible for identifying the right open-source tools to deliver product features through research and proof of concepts. Furthermore, you will support the coaching and training of team members to ensure confidence in using software applications. Your commitment to software security will be paramount, as you will develop programs that monitor the sharing of private information, adding credibility to your work. Overall, this role is designed for someone who is passionate about data engineering and eager to make a significant impact in the retail sector.

Responsibilities

• Design, build, test and deploy cutting edge solutions at scale, impacting millions of customers worldwide.
• Develop high performance and scalable solutions/APIs that extract, transform, and load Storm, Spark, big data.
• Perform root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
• Build and optimize ‘storm/spark/big data' data pipelines, architectures and data sets involving petabyte and terabyte of data.
• Interact with Walmart engineering teams across geographies to leverage expertise and contribute to the tech community.
• Engage with Product Management and Business to drive the agenda, set priorities and deliver product features.
• Collaborate with team members to develop best practices and client requirements for the software.
• Analyze and test programs/products before formal launch to ensure flawless performance.
• Develop programs that monitor sharing of private information to enhance software security.
• Support the coaching and training of other team members to ensure confidence in software applications.

Requirements

• 3-4 years of experience in design and development of highly-scalable applications and platform development that deal with large data with real-time latency.
• Strong computer science fundamentals: data structures, algorithms, design patterns.
• Experience in managing Elasticsearch clusters, including indexing, querying, and performance tuning.
• Working knowledge of SQL/No-SQL and database technologies (Cassandra, Big Query, Data Bricks, Cosmos, Druid, etc.).
• Hands-on experience in building Micro-services and REST services using Java, Spring Boot.
• Experience on Cloud Architecture, Micro-services Architecture and container technologies (Docker, Kubernetes, etc.).
• Hands-on experience with event-based system processing such as Kafka.
• Experience in deploying solutions on cloud platforms (Azure, GCP).
• Work exposure on Agile methodologies and DevOps would be an added advantage.
• Well versed with Testing frameworks like JUnits and CI/CD Automation experience with tools like Git, Maven, Jenkins & Azure DevOps.
• Strong hands-on development skills to prototype technical & innovative solutions.
• Exceptional communication and interpersonal skills, including negotiation, facilitation, and consensus building skills.

Nice-to-haves

• Data engineering, database engineering, business intelligence, or business analytics experience.
• Master's degree in Computer Science or related field and 2 years' experience in software engineering or related field.
• Knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards and assistive technologies.
• Experience in creating inclusive digital experiences and knowledge of accessibility best practices.

Benefits

• Incentive awards for performance.
• Maternity and parental leave.
• Paid time off (PTO).
• Health benefits including medical, vision, and dental coverage.
• 401(k) plan and stock purchase options.
• Company-paid life insurance.
• Short-term and long-term disability benefits.
• Company discounts.
• Adoption and surrogacy expense reimbursement.
• Live Better U education benefit program covering tuition, books, and fees.