Engineer - Python, Big Data, GCP - Next Generation Big Data

$85,000 - $150,000/Yr

American Express - Phoenix, AZ

Full-time - Mid Level

Phoenix, AZ

Credit Intermediation and Related Activities

About the position

The Engineer position at American Express focuses on designing, developing, and maintaining software solutions for the company's largest Big Data Platform, LUMI. This role is integral to the transition to public cloud services, specifically Google Cloud Platform (GCP), and involves working within an agile team to enhance customer-facing and internal applications. The position emphasizes collaboration, continuous improvement, and the use of cutting-edge technologies to optimize data processing and application performance.

Responsibilities

• Design, develop, solve problems, debug, evaluate, modify, deploy, and document software and systems for customer-facing and internal applications.
• Contribute to software builds through consistent development practices as a member of an agile team.
• Participate in code reviews and automated testing.
• Debug software components and identify code defects for remediation.
• Enable deployment, support, and monitoring of software across various environments.
• Automate deployments in test or production environments.
• Architect, design, develop, and maintain enterprise capabilities and systems.
• Collaborate with teams to maintain engineering excellence principles related to code and testing methodologies.
• Develop prototypes using visualization techniques to fast-track concepts.
• Seek continuous improvement by considering novel solutions using existing technologies.

Requirements

• 7+ years of experience designing, building, and implementing distributed cloud architecture, preferably in GCP.
• Experience with provisioning and network configuration for compute resources like Google Compute Engine and Dataproc.
• 3+ years of experience with GCP services such as Cloud Dataflow, Cloud Pub/Sub, BigQuery, and Cloud Storage.
• Experience implementing and maintaining AI/GenAI services using Google Cloud AI services, e.g., Vertex AI.
• 2+ years of experience in model deployment and leveraging metrics for predictions and recommendations.
• 2+ years of experience with Infrastructure as Code (IaC) and automation tools like Terraform and Ansible.
• 3+ years of experience with system performance monitoring and analysis tools like Prometheus and ELK stack.
• 5+ years of experience with installation and configuration of Big Data real-time application tools such as Elastic Search and Kibana.
• Ability to optimize cloud-based systems for performance, reliability, and cost-efficiency.
• Experience with scripting and automation using Python, Ruby, PowerShell, or bash.

Nice-to-haves

• Experience working in an agile application development environment.
• Understanding of Git and Git workflows.
• Experience supporting platform engineering activities, including network and firewall management.

Benefits

• Competitive base salaries
• Bonus incentives
• 6% Company Match on retirement savings plan
• Free financial coaching and financial well-being support
• Comprehensive medical, dental, vision, life insurance, and disability benefits
• Flexible working model with hybrid, onsite or virtual arrangements
• 20+ weeks paid parental leave for all parents
• Free access to global on-site wellness centers
• Free and confidential counseling support through Healthy Minds program
• Career development and training opportunities