Big Data Solution Architect Reading, PA

Penske Automotive Group - Reading, PA

Full-time

Reading, PA

Truck Transportation

About the position

As a "Solution Architect" within this expansive and dynamic program, you will assume a pivotal and demanding role in shaping the technical design and technology trajectory of the client's intricate, cloud-based data platform solutions and services. Your responsibilities encompass spearheading the definition of the architecture strategy, thereby furnishing solutions involving - Container platforms (Kubernetes, PCF), AWS Managed Services (SQS, SNS, EKS, etc.), and drawing upon your experience in system delivery. Your application portfolio will encompass a diverse array of applications including SPA's, Web Applications, REST API's, applications integration with AI/ML models, and Kafka Streams based applications. Your primary objective is to architect solutions, tailored to an array of integrations, protocols, COTS, and bespoke product suites. As an authoritative figure and subject matter expert, you will steward one or more workstreams within the ambit of your application portfolio. Your efforts will facilitate productivity through the construction of cloud-based data services, contributing to their operationalization. Your role extends to furnishing crucial daily leadership and insight, partnering with teams of architects, engineering leaders, and product managers, forging alignment across multifunctional projects, and ensuring their feasibility in fiscal and technical dimensions. Collaborating closely with internal teams and business leaders alike, you will craft strategically sound target state architectures.

Responsibilities

• Design and architect end-to-end big data solutions, including data ingestion, storage, processing, and analytics components, to meet business requirements and performance objectives.
• Evaluate and recommend appropriate big data technologies, platforms, and frameworks based on business needs, technical requirements, and industry best practices.
• Design data integration pipelines and workflows to ingest data from multiple sources, including databases, data warehouses, streaming platforms, and external APIs.
• Identify performance bottlenecks and optimization opportunities in big data solutions and recommend optimizations in areas such as data partitioning, indexing, caching, and resource utilization.
• Architect highly scalable and fault-tolerant big data architectures that can handle large volumes of data, support concurrent user access, and maintain high availability.
• Create technical documentation, architecture diagrams, and solution blueprints to communicate design decisions, best practices, and implementation guidelines to stakeholders and project teams.
• Conceptualize, architect, and communicate the Solution architecture and roadmap.
• Act as a bridge between various technology groups: Data Architecture, Platform Architecture, Information Security, and Data Architecture.
• Guide software development and infrastructure engineering teams to adopt Cloud, hybrid, and on-premises cloud-native architecture.
• Conduct evaluations of competing technologies and provide well-informed recommendations.
• Identify areas for improvement and recommend adaptation roadmaps.
• Architect, construct, and oversee an efficient data platform utilizing modern, low/no code cloud technologies (AWS), interfacing with existing data services and storages.
• Mentor junior platform engineers, data engineers, developers, and operators, championing best practices and well-architected infrastructure.
• Define productivity strategies on Kubernetes for container orchestration in a cloud environment.
• Develop strategies for legacy modernization and cloud adoption for existing solutions.
• Establish operationalization standards for supporting Cloud-based architecture.
• Collaborate to evolve a sophisticated data model, collaborating with executives, engineers, product managers, scientists, and partners to harness structured data from diverse source systems.
• Advocate and educate engineering team members on software design principles, standards, and best practices.
• Leverage external engagements as needed to expedite projects.
• Other duties as assigned.

Requirements

• Bachelor's degree in computer science, Engineering, or related field or 10+ years of experience in IT. Candidates with lesser experience will be considered if they have exemplary proven accomplishments.
• Hands on expertise in one or more of the following programming languages - Java, Python, JavaScript, Golang is a MUST.
• Experience with server-side programming languages is a MUST.
• A strong hands-on expertise with Kubernetes and associated technologies is a MUST.
• In depth experience and Proficiency with tools like Kafka, Kubernetes, OpenSearch/ELK stack, and Observability platforms (Monitoring, Logging) is preferred.
• Experience with application build and deployment patterns on Kubernetes.
• Strong familiarity with Cloud native development patterns, and hands-on software development experience in Java, Spring stacks.
• Substantial in-depth (5+ years) experience in data storage technologies (RDBMS, MYSQL, Postgres, S3), including robust expertise in application, data, and infrastructure architecture disciplines. In-depth DBA-level expertise is not required.
• Experience in devising security standards for multi-protocol data access, along with experience in applying data authorization standards.
• Experience with CI/CD practices.
• Extensive Experience with App containerization using Docker and Kubernetes for container management.
• Knowledge of Tanzu Kubernetes Grid or Tanzu services is beneficial.
• Extensive experience in cloud architecture, particularly with AWS, including familiarity with Cloud hosting platforms such as Tanzu Application Service.
• Large-scale experience in designing and deploying applications on containers in a high-availability topology.
• Experience in operationalizing AI/ML models is preferred.
• Experience in the full Software Development Lifecycle and Agile methodology.
• Excellent communication, presentation, and problem-solving skill.
• Deep understanding and application of EAI patterns.
• MUST have 5+ years hands-on experience in designing and architecting highly available, resilient and performant systems.
• MUST be able to articulate design tradeoffs, technology choices to executive leadership.

Nice-to-haves

• Experience in operationalizing AI/ML models is preferred.
• Knowledge of Tanzu Kubernetes Grid or Tanzu services is beneficial.