Mitsubishi - Tampa, FL

posted 3 months ago

Full-time - Senior
Tampa, FL
10,001+ employees
Transportation Equipment Manufacturing

About the position

MUFG Bank is seeking a Senior Data Platform Engineer with a robust background in Data Integration Technologies. This role is pivotal in managing and enhancing enterprise data integration platforms, including Data Stage, Talend, Ab Initio, Informatica, and AWS Glue, both in AWS cloud environments and on-premises infrastructure. The ideal candidate will possess a deep understanding of data integration, data quality, and big data processing engines, particularly in Cloud Native and Cloud agnostic platforms. The selected individual will play a critical role in migrating code bases from one Data Integration platform to another, ensuring seamless transitions and optimal performance. The responsibilities extend to hands-on experience with AWS services such as Glue, S3, EKS, Data Pipeline, and Step Functions, as well as establishing connectivity to AWS services like RDS from various data integration tools. The candidate will also be expected to work with big data processing platforms like Apache Spark, developing ETL code using Apache Pyspark. A thorough understanding of the benefits and limitations of each platform, along with migration paths offered by different vendors, is essential. Collaboration with multiple development teams and enterprise architects will be necessary to assess third-party tools and participate in the evaluation and comparison of offerings and capabilities. In addition to technical skills, the role requires strong collaboration and teamwork abilities. The engineer will participate in knowledge sharing, educate team members, and create documentation for onshore and offshore teams. Working closely with development and architecture groups, the engineer will design and deliver a data integration and workflow framework that encompasses data integration and data quality functionalities using various tools from multiple vendors. The role also involves participating in architecture discussions, influencing product roadmaps, and taking ownership of new projects while maintaining and supporting existing platforms and evolving to newer technology stacks and architectures. Security and compliance are paramount, and the engineer will implement and enforce security best practices for Data Integration Platforms, ensuring compliance with relevant regulations and internal policies. Comprehensive documentation for infrastructure designs, procedures, and configurations will be created and maintained using Confluence and Jira, along with providing support and troubleshooting assistance to team members and stakeholders as needed.

Responsibilities

  • Install, configure and manage enterprise data integration platforms including Data Stage, Talend, Ab initio, Informatica and AWS Glue in AWS cloud environments and on-premises infrastructure.
  • Perform critical role in migration of code base from one Data Integration platform to another.
  • Hands-on experience working with AWS services including Glue, S3, EKS, Data Pipeline, Step functions and establishing connectivity to AWS services like RDS from Informatica, data stage, Apache Spark.
  • Good understanding of benefits/limitations offered by each platform and migrations paths offered by different vendors.
  • Work closely with multiple development teams, enterprise architects to perform third party tools assessment and participate in evaluation/comparison of offering, capability of each tool etc.
  • Lead effort to Lift & shift/Replatform/Refactor of on premises Data Integration tools like Informatica PowerCenter to Cloud Native/Cloud agnostic platforms.
  • Participate in knowledge sharing, educating, and creating documentation with onshore/offshore teams.
  • Work with Development and architecture groups to design and deliver a data integration and workflow framework that provides data integration, data quality functionalities using different data integration tools from multiple vendors.
  • Participate in architecture discussions, influence product roadmap, and take ownership and responsibility of new projects.
  • Maintain and support existing platforms and evolve to newer technology stacks and architecture.
  • Implement and enforce security best practices for Data Integration Platforms with ‘Secure by Design' principles.
  • Ensure compliance with relevant regulations and internal policies through proper configuration and auditing.
  • Create and maintain comprehensive documentation for infrastructure designs, procedures, and configurations using Confluence and Jira.
  • Provide support and troubleshooting assistance to other team members and stakeholders as needed.

Requirements

  • Bachelor's degree in computer science, Information Technology, or related field; or equivalent work experience.
  • Familiarity with data processing systems such as Apache Spark and Pyspark.
  • Strong proficiency with AWS cloud services, including but not limited to Glue, S3, EKS, Data Pipeline, Step functions, RedShift, Amazon EMR.
  • Hands-on experience with data integration platforms including Data Stage, Talend, Ab initio, Informatica.
  • Demonstrated experience in designing and implementing data platform integration infrastructures using well architected framework.
  • Strong problem-solving skills and the ability to work independently as well as in a team environment.
  • Excellent communication skills, both written and verbal, detail-oriented with strong organizational and documentation skills.
  • At least 5 years of experience in Data warehousing.

Benefits

  • Comprehensive health and wellness benefits
  • Retirement plans
  • Educational assistance and training programs
  • Income replacement for qualified employees with disabilities
  • Paid maternity and parental bonding leave
  • Paid vacation, sick days, and holidays
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service