Senior Manager Data Engineering

$219,700 - $219,700/Yr

Visa - Atlanta, GA

posted 3 months ago

Full-time - Senior
Remote - Atlanta, GA
Credit Intermediation and Related Activities

About the position

Visa USA Inc., a Visa Inc. company, is seeking a Senior Manager - Data Engineering to join our team in Atlanta, GA. In this role, you will be responsible for establishing data processes and automation that align with both business and technology requirements, utilizing Visa's supported data platforms and tools. You will deliver a range of data engineering projects, from small to large, either independently or as part of a collaborative project team. Your expertise will be crucial in developing and maintaining data models and schema designs that ensure efficient data storage and retrieval, adhering to best practices in data modeling and data architecture. As a Senior Manager, you will design and implement data pipelines that extract, transform, and load data from various sources into the data warehouse. Your focus will be on ensuring reusability, performance, scalability, and cost efficiency. Collaboration with cross-functional teams will be essential to understand data requirements and ensure data quality, which includes implementing data validation and quality checks at various stages of the pipeline. You will provide your expertise in data warehousing, ETL processes, and data modeling to support data-driven decision-making, while also optimizing data pipeline design and performance. You will be expected to extract and manipulate large datasets using standard tools such as Hadoop (Hive), Spark, Python (pandas, NumPy), Presto, and SQL. Developing data solutions using Agile principles will be part of your responsibilities, along with providing ongoing production support. Effective communication of complex concepts will be key, as will staying current with the latest trends and technologies in data engineering to ensure that Visa's data infrastructure remains state-of-the-art, particularly in cloud-based data engineering.

Responsibilities

  • Establish data processes and automation based on business and technology requirements.
  • Deliver small to large data engineering projects either individually or as part of a project team.
  • Develop and maintain data models and schema designs for efficient data storage and retrieval.
  • Design and implement data pipelines to extract, transform, and load data from various sources into the data warehouse.
  • Collaborate with cross-functional teams to understand data requirements and ensure data quality.
  • Implement data validation and data quality checks at various stages of the pipeline.
  • Provide expertise in data warehousing, ETL, and data modeling to support data-driven decision making.
  • Extract and manipulate large datasets using standard tools such as Hadoop (Hive), Spark, Python (pandas, NumPy), Presto, and SQL.
  • Develop data solutions using Agile principles.
  • Provide ongoing production support.
  • Communicate complex concepts in a clear and effective manner.
  • Stay up-to-date with the latest data engineering trends and technologies.

Requirements

  • Bachelor's degree in Electronics Engineering, Computer Science, or related field.
  • 5 years of experience in the job offered or in a Senior Manager - Data Engineering-related occupation.
  • Proficiency in Hadoop, Spark, Hive, Databricks, SQL, and Airflow.
  • Experience with Business Intelligence tools such as SSIS, Tableau, Power BI, ODI, and SQL.
  • Programming skills in Python or JAVA.
  • Knowledge of Data Science and Machine Learning, particularly with Python and MLOps applications.
  • Familiarity with Cloud Technologies: AWS, Azure, or GCP.
  • Experience in Data Architecture and modeling using Visio and DW modeling applications.

Benefits

  • Medical
  • Dental
  • Vision
  • 401(k)
  • FSA/HSA
  • Life Insurance
  • Paid Time Off
  • Wellness Program
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service