Senior Evaluator & Quality Analyst, Office for Data Aggregation, Translation, Analytics (ODATA), Community Awareness, Action, Response, and Engagement (BCAARE)

About the position

The Bureau of Awareness, Action, Response and Engagement (BCAARE) engages and supports community action to learn from community members' experiences and expectations to develop and disseminate behavioral health linkages and supports for wellness, and for preparing for, and responding to local and widespread events and emergencies. The bureau invites and includes peer perspectives to integrate equitable access to behavioral health across sectors and settings. BCAARE is organized into five offices including Behavioral Health Emergency Preparedness and Response, Community Engagement and Training, Consumer Affairs, Data Aggregation, Translation and Analytics, and Neighborhood Response Unit. Key programs, initiatives, and collaborations include Connections to Care: Building Resilience for Youth, Community Covid Conversations (3C), NYC Project Hope, Resilience and Emotional Support Team (REST), and the Mayor's Subway Safety Plan.

Responsibilities

• Manage and oversee BCAARE program evaluation and research activities from start to finish, in collaboration with ODATA director and program staff.
• Supervise one or more ODATA staff to support in the following tasks/activities.
• Provide ongoing support to units/offices across BCAARE to assist in program management and decision making, including data collection, data use, QI, and reporting.
• Develop evaluation plans and logic models to guide monitoring and evaluation efforts.
• Develop metrics for monitoring and evaluation efforts and develop tools to collect data, including process/program implementation metrics and outcomes.
• Manage and oversee program monitoring and evaluation protocols including process/program implementation metrics and outcomes.
• Create and maintain programmatic datasets and oversee and manage data collection and reporting in appropriate software packages.
• Manage, clean, and analyze data from multiple sources to report on program performance.
• Extract, clean, manipulate, organize, and analyze data using SAS, R, Excel, SQL, and other software.
• Develop qualitative evaluation tools, collect, and analyze qualitative data (e.g., interviews, focus groups, observational data).
• Create graphs, tables, dashboards, and narrative and report findings to internal and external stakeholders.

Requirements

• Experience practicing public health and working across systems to further a public health approach to mental wellness.
• 3+ years of experience managing, cleaning and analyzing quantitative data, including large administrative datasets.
• Experience with statistical software such as SAS, R SPSS, and SQL.
• Experience with quantitative data, including the ability to read, interpret and synthesize epidemiologic and other scientific literature.
• Experience in managing multiple projects and function effectively both independently and as part of a team.
• Expertise and experience in program monitoring and evaluation methods, including conducting needs assessments, developing evaluation plans, survey development, logic models, process and outcome evaluations.
• Experience with data visualization and dashboards, for example with Power BI and Tableau.
• Have doctorate-level education or MA/MS/MPH in public health, statistics, or a related social science or health care field with a focus on quantitative research.
• Experience with navigating Internal Review Board (IRB) processes and expertise about related policies and procedures desirable.
• Experience with geographical information software such as ArcGIS desirable.
• Have experience preparing manuscripts for submission to peer-reviewed journals, including data analysis, writing, and critical review.
• Ability to integrate data from multiple disciplines including fiscal, contract, budget, programmatic, claims and other sources.

Benefits

• Loan Forgiveness: As a prospective employee of the City of New York, you may be eligible for federal/state loan forgiveness and repayment assistance programs that lessen your payments or even fully forgive your full balance.
• A premium-free health insurance plan that saves employees over $10K annually, per a 2024 assessment.
• Additional health, fitness, and financial benefits may be available based on the position's associated union/benefit fund.
• A public sector defined benefit pension plan with steady monthly payments in retirement.
• A tax-deferred savings program.
• A robust Worksite Wellness Program that offers resources and opportunities to keep you healthy while serving New Yorkers.
• Depending on your position, you may be able to work up to two days during the week from home.
• Job security compared to private sector employment.