Lead, Software Engineer Data Solution Architect (AWS)

About the position

Are you interested in building capabilities that enable the organization with innovation, speed, agility, scalability and efficiency? The Global Technology team takes great pride in our culture where digital transformation is built into our DNA! When you join our organization at Prudential, you'll unlock an exciting and impactful career - all while growing your skills and advancing your profession at one of the world's leading financial services institutions. As a Lead Software Engineer on/in Data Management & Governance you will partner with product owners, tech leads, designers, engineers and delivery professionals to improve Data Management and Governance services. You will code, test and debug new and existing applications as you implement capabilities to solve sophisticated business problems, deploy innovative products, services and experiences to delight our customers! In addition to advanced technical expertise and experience, you will bring excellent problem solving, communication and teamwork skills, along with agile ways of working, strong business insight, an inclusive leadership attitude and a continuous learning focus to all that you do.

Responsibilities

• Design and build scalable solutions and services in AWS, ensuring the solution meets business and technical requirements.
• Professional hands-on experience in developing extensible data pipeline and reusable data processors using PySpark, Scala, Python in AWS Glue and Lambda functions.
• Architect and develop secure, robust cloud-based services, real-time APIs, service integrations, and automations using a microservice architectural style.
• Lead the Solution design and implementation of solutions using AWS services.
• Maintain proficiency and implement best practices in AWS development tools and standards.
• Define and deploy job monitoring, metrics, and logging systems on AWS.
• Implement continuous integration and deployment (CI/CD) pipelines.
• Ability to comprehend requirements, identify potential tools/services in the market, and conduct comprehensive assessments leading to an informed selection process.
• Ability to coach/interact other technical resources, enterprise architects and cloud architects with minimal guidance and effectively leverage diverse ideas, experiences, thoughts, and perspectives to the benefit of the organization.
• Ability to excel in both independent and collaborative team environments.
• Lead the troubleshooting and resolution of issues in development, test, and production environments.

Requirements

• Expertise in architecture, designing and building scalable cloud-based application leveraging AWS services.
• Proven experience with services like EC2, ECS, Kong, ALB, SQS/SNS, Kinesis, RDS, S3, Lambda, Glue, DynamoDB, EMR, VPC, Route 53, CloudFormation/Terraform, CloudWatch, Dynatrace, IAM.
• Experience in building scalable and stronger data pipelines to support data integration, data processing, data quality and monitoring.
• Experience in handling various hierarchical data structures and file formats such as parquet, Json and Avro files.
• Strong knowledge of DevOps principles and methodologies and toolset experience in bitbucket/GitHub and Jenkins/Terraform in adopting CI/CD approach.
• Automate infrastructure provisioning and configuration management using as code, with experience in tools such as Terraform or CloudFormation.
• Proficient in programming languages: Python, PySpark / Scala is mandatory.
• Database: PostgreSQL, DynamoDB, Redis, GraphDBs.
• Architecture & Design Patterns: Specialized in Microservices and Service-oriented Architecture (SoA) with a focus on building web service APIs using REST and SOAP protocols, and adept in handling JSON and XML data formats.
• Software security skills: Proficient in secure coding, web application security, and DevSecOps with a strong understanding of concepts like authentication, authorization, encryption, digital signature, JWT, SSL, web service proxies, firewall, SAML 2.0, OpenID Connect, and OAuth 2.0.
• DevOps Tools & Practices: Skilled in branching techniques and the use of platforms such as GitHub and Bitbucket; proficient in DevOps practices and tools, including Jenkins.
• Proficient in monitoring and logging techniques used throughout the SDLC.
• Experience in programming language such as Node.js, Java is an added advantage.
• Excellent communication and collaboration skills.

Nice-to-haves

• 10-12 years of experience as an AWS Cloud Data Architect or related role.
• Involved in Architecture & design of Enterprise cloud systems.
• Strong understanding of data engineering principles and methodologies.
• Solution Design Thinking.
• Experience in performing detailed tool Assessment and selection process.
• Knowledge of data governance, metadata management and data quality is a plus.

Benefits

• Market competitive base salaries, with a yearly bonus potential at every level.
• Medical, dental, vision, life insurance, disability insurance, Paid Time Off (PTO), and leave of absences, such as parental and military leave.
• 401(k) plan with company match (up to 4%).
• Company-funded pension plan.
• Wellness Programs including up to $1,600 a year for reimbursement of items purchased to support personal wellbeing needs.
• Work/Life Resources to help support topics such as parenting, housing, senior care, finances, pets, legal matters, education, emotional and mental health, and career development.
• Education Benefit to help finance traditional college enrollment toward obtaining an approved degree and many accredited certificate programs.
• Employee Stock Purchase Plan: Shares can be purchased at 85% of the lower of two prices (Beginning or End of the purchase period), after one year of service.