Senior Data Platform Architect

OCLC Online Computer Library - Dublin, OH

Full-time - Senior

Dublin, OH

Religious, Grantmaking, Civic, Professional, and Similar Organizations

About the position

OCLC's Data Services provides the foundational platforms for OCLC's key data assets. Are you excited to solve problems with a global footprint and scale measured in petabytes, billions of records and thousands of updates per second? We are looking for a senior technology leader to join our team, working across the organization to understand business opportunities, our current solutions, and future technology opportunities for our core data platform. The right candidate will have the following skills, experiences, and attitude: You are driven to understand new technology, architecture and languages. You design solutions from first-hand knowledge built on proof of concepts, rapid prototyping and active collaboration with others. You understand the best technology solution solves a problem for a customer and understanding their needs is critical to success as a technologist. You have strong experience with the Hadoop ecosystem, including HBase, HDFS, Spark, Kafka, and others. You have provided architecture guidance for both on-premises and cloud solutions. Finally, you have experience developing within the Java/Spring ecosystem, especially for Search and ETL workflows.

Responsibilities

• Evaluate the existing Hadoop and adjacent ecosystem, including its architecture, infrastructure, and performance, to identify challenges in migration and areas of improvement.
• Develop comprehensive strategies for migration or risk mitigation, including a detailed roadmap, timeline, and resource requirements. Identify technology alternatives where appropriate.
• Provide leadership to organization in specific area of expertise.
• Assume the technical lead and be the architect for major OCLC systems or concepts. Participate in major architectural reviews and plans.
• Ensure that information and trends within their area of expertise are effectively communicated to relevant business units within OCLC.
• Prototyping systems in anticipation of new requirements.
• Develop functional requirements from prototype systems.
• Analyze and solve problems in existing systems.
• Design, code and test multiple modules of a system in a timely manner.
• Ensure that project teams plan and participate in load, capacity, and performance analysis and/or testing.
• Represent OCLC's position by participating on or leading relevant standards committees such as ISO, NISO, ACM, and IEEE. Lead the implementation of standards within OCLC systems.
• Other tasks as assigned.

Requirements

• Master's degree required plus 8 to 12 years experience at a high technical level of knowledge and experience. (Equivalent experience without a Master's degree is 10 to 14 years experience at a high technical level of knowledge and experience.)
• Familiarity with alternative big data technologies, such as Apache Kafka, Apache Flink, Apache Cassandra, or cloud-based solutions like Amazon EMR or Google BigQuery.
• 5+ years of leadership experience with Hadoop and adjacent technologies, such as Hive, Pig, and Spark.
• Proficiency in programming languages commonly used in big data processing, such as Java, Scala, or Python.
• Experience transitioning Hadoop workflows to alternative solutions strongly preferred.
• Strong understanding of distributed computing principles, experience with large-scale data processing frameworks, and big data concepts in general.
• Excellent communication and presentation skills.
• Ability to work independently and as part of a team.
• Several years' proven experience leading large-scale projects across multiple teams.
• Experience with multiple complex, business critical systems is expected.
• Experience with on-premise big data architectures preferred.
• Experience with Graph data architectures and Graph databases preferred.

Benefits

• Work-life balance
• Meaningful work
• Global impact