Principal Software Engineer

About the position

NBME is seeking an experienced AWS Developer specialized in data architecture and processing to join the Product Engineering unit as a key member of the Scoring team. In this role, you will play a critical part in designing and developing a data-intensive new scoring system. As a Principal Software Engineer, you will be responsible for the leading architecture, development, testing, and implementation of the new system. You will collaborate closely with fellow engineers, the Enterprise Application team, infrastructure team, and business units to translate business requirements into scalable, effective solutions within the AWS environment. Your work will have a direct impact on NBME's future growth and innovation. We're looking for someone who thrives in a highly collaborative, digitally driven environment. Bring your talent for developing innovative solutions to our inclusive culture, where diversity of ideas, experiences, and backgrounds is highly valued.

Responsibilities

• Design and implement scalable, secure, and high-performance new scoring system data solutions on AWS to support business objectives
• Define the long-term architecture strategy for data ingestion, storage, processing, and analytics for the new scoring system
• Drive the adoption of AWS-native technologies and best practices across the organization
• Evaluate and integrate new AWS services and data technologies to enhance capabilities and improve efficiency
• Promote automation in data processing
• Participate in business and technical requirement meetings, create technical designs and solutions to fit business goals, and provide estimates for proposed solutions
• Communicate solutions to both technical and non-technical staff
• Work alongside Product Owners, Solution Architects, and other Engineers on the team and focus on leading design & implementation
• Mentor other technical and functional team members to offer a comprehensive solution
• Work closely with scrum teams on technical review of solutions and consult with enterprise architecture review board to ensure adherence to the enterprise architecture and security standards
• Lead and manage an offshore team of technical professionals, providing guidance, mentorship, code review and support, ensuring on time and high quality execution by team members.

Requirements

• Deep understanding of AWS data architecture and services, including Amazon S3, Amazon Athena, Amazon DynomDB and QuickSight
• Practical knowledge of integrating serverless data processing workflows with event-driven architectures using Amazon SQS, SNS, and EventBridge
• Strong understanding of serverless computing concepts and architectures in data processing contexts
• Hands-on experience with serverless data transformation and orchestration tools such as AWS Glue and AWS Step Functions
• Advanced knowledge of AWS SDKs for Python and frameworks for integrating data services
• Proficient in managing large-scale datasets in Amazon S3, including implementing lifecycle policies, archiving strategies, and data partitioning
• Experience with database optimization strategies, schema design, and query performance tuning for non-relational datasets
• Understanding of non-relational data store architectures, including columnar storage and distributed query engines
• Strong knowledge of data security and compliance practices, including encryption (KMS), IAM policies, and implementing row/column-level security in AWS data services
• Proficiency with AWS monitoring tools like CloudWatch, X-Ray, and CloudTrail for tracking data pipeline performance and resolving issues
• Ability to troubleshoot complex issues in distributed data systems, ensuring high availability and fault tolerance
• Experience in cost optimization for data solutions, balancing performance and storage needs with budgetary constraints
• Strong experience with Infrastructure as Code (IaC) tools, including AWS CloudFormation, AWS CDK deploying data architectures
• Proven ability to lead large-scale data architecture projects and collaborate effectively with stakeholders
• Strong mentorship skills to guide engineers in adopting data best practices, improving data literacy, and achieving technical excellence
• Clear and effective communication skills to articulate complex technical solutions to both technical and non-technical audiences.

Benefits

• Healthcare
• Dental
• Prescription
• Vision plans
• 401(k) w/match
• Tuition Reimbursement Plan
• Commuter Benefit: Public Transit or Parking options
• Remote Friendly Workplace