Data Engineer with Google Cloud Platform

M3Bi - Phoenix, AZ

Full-time

Phoenix, AZ

Professional, Scientific, and Technical Services

About the position

The Data Engineer position focuses on leveraging Google Cloud Platform and various database technologies to support and enhance enterprise capabilities. The role involves working within an agile team to develop, deploy, and maintain software systems, ensuring high performance and reliability across environments. The engineer will be responsible for database administration, optimization, and troubleshooting, while also contributing to the overall engineering excellence of the team.

Responsibilities

• Function as a member of an agile team by contributing to software builds through consistent development practices.
• Participate in code reviews and automated testing.
• Debug basic software components and identify code defects for remediation.
• Enable the deployment, support, and monitoring of software across test, integration, and production environments.
• Automate deployments in test or production environments.
• Automatically scale applications based on demand projections.
• Architect, design, develop, and maintain enterprise capabilities and systems.
• Collaborate with teams in an agile environment on creating, evolving, and maintaining engineering excellence principles related to code, code reviews, testing methodologies, and defect management.
• Develop prototypes applying visualization and other techniques to fast-track concepts.

Requirements

• Experience with relational database (RDBMS) administration, development, and tuning, specifically MySQL and SingleStore.
• Experience with database support of OLTP and OLAP systems in a large development and production environment.
• Experience with database development and support of Massive Parallel Processing (MPP) systems, High Availability (HA), and Disaster Recovery (DR).
• Experience in analytical and columnar databases and supporting multiple application teams (columnar Database like Jethro).
• Experience in resolving data ingestion issues, performance issues, and day-to-day support.
• Responsible for Linux Infrastructure administration, DBMS upgrades, and shell scripting.
• Experience with transforming logical data architectures into physical data designs.
• Experience with Big Data tools, including Apache, Hadoop, Hive, and Spark distributed framework.
• Experience with public cloud platforms (Google Cloud Platform, AWS) optimization, enabling managed and serverless services.
• Managed MySQL versions 5.6, 5.7, and 8.0.35 along with SingleStore and Jethro databases.
• Optimized complex SQL queries.
• Worked on setting up MySQL High Availability clusters like InnoDB cluster setup.
• Developed programs by integrating SQL with shell script and Python.
• Worked on Privileged Access management, Identity Management, and Active Directory services on Big Data Platform.
• Administered, supported, and monitored over 100 database systems by proactively resolving database issues and maintaining servers.
• Performed capacity planning to deploy and configure database systems, develop and manage database objects.
• Opened various SR tickets and other discussions with vendors to resolve critical issues/bugs.
• Performed version upgrades on Jethro, SingleStore, MySQL, and Yellow Brick.
• Managed backup & recovery, disaster recovery, database performance tuning, memory tuning, application and SQL tuning, and security administration.
• Performed database installations, upgrades, and patches for vulnerability remediation.
• Cloned databases from production to create working environments for development/test.