DATA ENG with Google Cloud Platform

Cloudious - Bentonville, AR

Full-time - Mid Level

Bentonville, AR

Administrative and Support Services

About the position

As a Senior Data Engineer at Cloudious, you will be responsible for designing and developing big data applications using the latest open-source technologies. This role involves working in an offshore model, developing data models, automating workflows, and creating data pipelines. You will also provide maintenance for existing systems, mentor junior engineers, and lead daily standups and design reviews.

Responsibilities

• Design and develop big data applications using open source technologies.
• Develop logical and physical data models for big data platforms.
• Automate workflows using Apache Airflow.
• Create data pipelines using Apache Hive, Apache Spark, and Apache Kafka.
• Provide ongoing maintenance and enhancements to existing systems.
• Participate in rotational on-call support.
• Learn the business domain and technology infrastructure quickly and share knowledge with the team.
• Mentor junior engineers on the team.
• Lead daily standups and design reviews.
• Groom and prioritize backlog using JIRA.
• Act as the point of contact for your assigned business domain.

Requirements

• 3+ years of recent Google Cloud Platform experience.
• Experience building data pipelines in Google Cloud Platform.
• Google Cloud Platform Dataproc, GCS & BIGQuery experience.
• 5+ years of hands-on experience with developing data warehouse solutions and data products.
• 5+ years of hands-on experience developing a distributed data processing platform with Hadoop, Hive or Spark, Airflow or a workflow orchestration solution.
• 4+ years of hands-on experience in modeling and designing schema for data lakes or for RDBMS platforms.
• Experience with programming languages: Python, Java, Scala, etc.
• Experience with scripting languages: Perl, Shell, etc.
• Experience working with, processing, and managing large data sets (multi TB/PB scale).
• Exposure to test driven development and automated testing frameworks.
• Background in Scrum/Agile development methodologies.
• Excellent verbal and written communication skills.
• Bachelor's Degree in computer science or equivalent experience.

Nice-to-haves

• Experience with Gitflow.
• Familiarity with Atlassian products like BitBucket, JIRA, Confluence.
• Experience with Continuous Integration tools such as Bamboo, Jenkins, or TFS.