Sr. Big Data Engineer

$120,640 - $120,640/Yr

Connvertex Technologies - Sunnyvale, CA

Full-time - Mid Level

Sunnyvale, CA

Professional, Scientific, and Technical Services

About the position

The Sr. Big Data Engineer at Walmart is responsible for designing and implementing data processing systems and optimizing queries to enhance data manipulation and warehousing capabilities. This role requires a strong background in programming, system design, and experience with CI/CD and orchestration tools, contributing to the overall data strategy of the organization.

Responsibilities

• Design and implement data processing systems.
• Optimize SQL queries for performance.
• Utilize programming design patterns in development.
• Engage in system design activities.
• Implement CI/CD processes using tools like Jenkins.
• Utilize orchestration tools such as Airflow or Automic.
• Handle data processing and manipulation tasks, including data warehousing concepts.

Requirements

• Professional hands-on experience in Scala/Python.
• Professional hands-on experience in SQL and query optimization.
• Experience in programming design patterns.
• Experience in system design.
• Experience with CI/CD tools like Jenkins.
• Experience with orchestration tools like Airflow/Automic.
• Hands-on experience in data processing and manipulation, including data warehousing concepts.

Nice-to-haves

• Exposure to cloud platforms, preferably GCP.

Benefits

• Competitive hourly rate of $58 per hour on W2.