Sr. Cloud Data Engineer

$138,900 - $221,900/Yr

Federal Reserve Bank - San Francisco, CA

posted 5 months ago

Part-time,Full-time - Mid Level
Remote - San Francisco, CA
Monetary Authorities-Central Bank

About the position

The Federal Reserve Bank of San Francisco is seeking a Sr Cloud Data Engineer to join the Data and Analytics Service (DAS) Team. This role is pivotal in delivering a centralized data and analytics platform that provides advanced data migration and analytics solutions for our customers. The successful candidate will work collaboratively with Data Architects, Product Owners, Design Engineers, Developers, and Business Analysts in a dynamic environment. The primary focus will be on identifying solutions, building, and implementing Infrastructure as Code using our CI/CD pipeline. This position offers an opportunity to showcase critical thinking and technical skills across various disciplines, playing a key role in shaping the development and support of product roadmaps while advancing our cloud data analytics platforms. In this role, you will be responsible for understanding the technology vision and strategic direction of business needs. You will participate in defining technical requirements that outline solutions for enabling data analytics within an AWS cloud environment built on data mesh architecture. Your responsibilities will include designing integrated solutions in alignment with design patterns, blueprints, guidelines, and standard methodologies for data platform products. You will also engage in developing architecture and design conceptual solutions by incorporating cloud-native and third-party vendor products. Additionally, you will provide analysis of the current state and future state, partnering with the Product Manager to define key outcomes for an IT data platform strategy. You will conduct research and perform proofs of concept (POCs) with emerging technologies, adopting industry best practices in the data space to advance the cloud data platform using data mesh architecture. Your role will involve designing, developing, and implementing Low-Code ETL solutions, developing RESTful APIs and API Gateway integration, and automating processes through Infrastructure as Code to enhance build efficiency in the cloud using Terraform, Python, and OS shell scripts. You will also be responsible for developing data streaming, migration, and replication solutions, providing consulting and guidance on business solution development in the data and analytics space, and demonstrating leadership and collaboration skills to gain consensus and produce optimal solutions.

Responsibilities

  • Understand technology vision and strategic direction of business needs
  • Participate in defining technical requirements that outline solutions for enabling data analytics within an AWS cloud environment built on data mesh architecture
  • Design integrated solutions in alignment with design patterns, blueprints, guidelines, and standard methodologies for data platform products
  • Participate in developing architecture and design conceptual solutions by incorporating cloud native and 3rd party vendor products
  • Provide analysis of current state, future state, and partner with the Product manager to define key outcomes for an IT data platform strategy
  • Participate in research and perform POCs (proofs of concept) with emerging technologies and adopt industry best practices in the data space for advancing the cloud data platform using data mesh architecture
  • Design, develop, and implement Low-Code ETL solutions
  • Develop RESTful APIs and API Gateway integration
  • Develop automation through Infrastructure as a code to increase build efficiency in the cloud using Terraform, Python, and OS shell scripts
  • Develop scripting to integrate multiple data sources to data and analytics platform
  • Build platform supporting HA and disaster recovery
  • Develop data streaming, migration, and replication solutions
  • Provide consulting and guidance on business solution development in the data and analytics space and cloud technologies
  • Demonstrate leadership, collaboration, exceptional communication, negotiation, strategic and influencing skills to gain consensus and produce the best solutions
  • Engage with Senior leadership, business leaders at the Federal Reserve and the Board to share the business value
  • Promote collaboration across business and IT organizations

Requirements

  • Bachelor's degree in Computer Science, Management Information Systems, Computer Engineering, or related field or equivalent work experience; advanced degree preferred
  • 7+ years in designing and building ETL services with all aspects of cloud design, development, and implementation
  • 5+ years of experience with full stack development, including application, API, testing, and automation experience using at least one of the following languages (Terraform, JSON, Python)
  • 3+ years of experience designing, building, and supporting large scale solutions hosted either on-prem or in the cloud (AWS), and experience with migrating data to the cloud
  • Experience with maximizing CI/CD pipelines and GitLab is a must
  • Hands-on experience in Terraform, Python, and OS shell scripts including automation tools
  • Hands-on experience in one or more languages such as Java, JavaScript
  • Experience in one of the following Immuta, Starburst or Collibra workflow is preferred
  • Experience with other AWS data related services including various compute and storage offerings
  • Experience with RDS, NOSQL Databases, RDBMS and in-memory databases
  • Must be familiar with Agile methodologies and able to work in an Agile manner
  • Must be a U.S Citizen or a Green Card holder with intent to become a U.S Citizen
  • Must have a very strong application development background

Nice-to-haves

  • Strong background in data structures, networking, performance, and scalability
  • Advanced proficiency in cloud specific solutions related to gateways, streaming services, or file and database migration services
  • Microservices experience is strongly preferred
  • Demonstrates mutual respect, accepts diversity, and acts with authenticity
  • Demonstrates analytical and problem-solving skills and expertise in redefining data platform and analytics space

Benefits

  • Medical
  • Dental
  • Vision
  • Pre-tax Flexible Spending Account
  • Backup Childcare Program
  • Pre-Tax Day Care Flexible Spending Account
  • Paid Family Care Leave
  • Vacation Days
  • Sick Days
  • Paid Holidays
  • Pet Insurance
  • Matching 401(k)
  • Retirement/Pension
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service