Evaluation Coordinator for Mid-term Performance Evaluation of Fulbright University Vietnam

Evaluation Coordinator

Mid-term Performance Evaluation of Fulbright University Vietnam

USAID Learns

Hanoi, Vietnam

Apply here

https://phg.tbe.taleo.net/phg02/ats/careers/v2/viewRequisition?org=SOCIIMPA2&cws=43&rid=4747

Note: This post is open to local candidates only.

About Social Impact

Social Impact (SI) is a global development management consulting firm. We provide monitoring, evaluation, strategic planning, and capacity-building services to advance development effectiveness. We work across all development sectors including democracy and governance, health and education, the environment, and economic growth. Since 1997 we have worked in over 100 countries for clients such as US government agencies, bilateral donors, multilateral development banks, foundations, and nonprofits.

Project Objective

SI is implementing the USAID/Vietnam Learns Contract (USAID Learns). The scope of the five-year project is to support USAID/Vietnam staff and partners to implement more efficient, effective, and transparent programs by improving: (1) USAID and Implementing Partner (IP) capacity to achieve expected results; (2) USAID’s understanding and tracking of project performance; and (3) collaboration, learning, and adapting (CLA).

Background

Launched in 2016, Fulbright University Vietnam (FUV) is the first fully independent, non-profit university in Vietnam. FUV marks a cornerstone of the U.S.-Vietnamese partnership in higher education. Founded on the Vietnamese-American partnership, the FUV model is based on American traditions of rigorous liberal arts education, and is firmly rooted in Vietnam’s culture and heritage. FUV aims to bring world-class university standards to Vietnam and help unlock the tremendous potential in Vietnam’s education sector. Since its establishment, USAID has provided three grants for FUV. USAID’s support is expected to help FUV establish itself as a self-sustaining, world-class university that prepares a new generation of leaders from across the country to tackle 21st-century challenges and drive Vietnam’s socio-economic development. By September 2023, the total number of enrolled students was 848, among which 727 were undergraduate students, and 121 were graduate students. 95 students took part in the first undergraduate commencement of FUV held in June 2023.

Purpose and Use of the Evaluation

This midterm performance evaluation comes at the end of the first two years of the third grant of USAID for FUV. The primary purpose of this evaluation is to examine the extent to which FUV has achieved the goals of USAID support, particularly in improving the quality and sustainability of FUV’s programs, and make recommendations for USAID’s future support. The evaluation should be able to reflect the progression of FUV over time, and also investigate the impact of COVID-19 on FUV’s performance.

Position Description

USAID Learns seeks an Evaluation Coordinator to support the team with this assignment. The Evaluation Coordinator will work closely with an Evaluation Team Leader and a Higher Education Management Expert to conduct the evaluation. A Higher Education Expert from USAID Washington is likely to join the team as an Advisor.

Research Questions

The evaluation will respond to the following questions:

1.    To what extent has FUV achieved the goals and objectives of USAID’s grants?

  • To what extent has FUV achieved the objectives of the three grants? Are there any gaps or unreached goals?  What interventions or approaches have achieved greater results and/or less effective in achieving desired results?
  • What was the progression of FUV over time in reaching its aspiration to provide a “world-class, liberal arts education” (particularly in aspects of accreditation, faculty qualifications, and research)? How has FUV progressed over time in terms of academic and research excellence? 
  • What were the key enabling or inhibiting factors that determined the degree of achievement? Did COVID-19 have any impact on the performance of FUV? How did the University navigate through the pandemic?

2.    To what extent has FUV achieved institutional sustainability as a non-profit world-class university in Vietnam?

  • To what extent has FUV achieved institutional sustainability in terms of institutional structure, governance, partnership, and academic programs?
  • To what extent has FUV been able to meet market demand (for FUV students and FUV programs)?
  • To what extent has FUV been able to sustainably finance its operations?

Methodology

Evaluators will review and finalize these questions in collaboration with the Mission prior to finalizing the evaluation design.

USAID expects that, at a minimum, the evaluation team will:

  • Upon award, familiarize themselves with documentation about the Mission’s support for FUV. USAID will ensure that this documentation is available to the team prior to the commencement of the work.
  • Review and assess the existing performance and effectiveness information or data.
  • Conduct site visits for field testing survey instruments (when applicable and feasible).
  • Meet and interview USAID project beneficiaries, partners, and host government counterparts at appropriate levels.
  • Interview USAID staff and if applicable, a number of sectoral experts needed for the evaluation.

The desk review will include at a minimum:

  • Materials related to USAID’ investment in FUV.
  • Materials related to FUV performance: Annual and Quarterly Reports, Annual Work Plans, MEL Plans, sector assessments, trip reports, performance reports, budgets, and gender analysis reports.
  • Miscellaneous thematic reports from other sources and projects by other donors.
  • National policy and strategy documents related to higher/university education.

The evaluation design in response to this SOW should be submitted for USAID review and approved prior to primary data collection. The evaluation design matrix should include a data analysis plan for each evaluation question.

The evaluation team, in collaboration with USAID, will finalize the evaluation methods before fieldwork begins. Explicit attention to gender and social inclusion issues must be integrated into the evaluation if equity and specific project objectives related to gender equality objectives are to be addressed.

Deliverables and Timelines

The study’s inception will tentatively take place in March 2024, allowing for data collection to begin in April 2024. Report drafting and finalization will happen from May to June 2024. An indicative list of deliverables and their corresponding timelines is set out in the table below.

Deliverable

Involved stakeholders

Purpose

Tentative Timeline

Kick-off Meeting with USAID

USAID, USAID Learns

  • Introductions
  • Confirm purposes, uses, users, expected deliverables, and timelines
  • Finalization of the scope of work

February, 2024

Desk Review

USAID, USAID Learns

  • Review of available documentation

February - March, 2024

Inception Report

USAID, USAID Learns

  • Preliminary evaluation design, including detailed sampling methodology; an evaluation design matrix that links the evaluation questions to data sources, methods, and the data analysis plan; limitations of the designs
  • Draft interview guides
  • Members of the evaluation team, delineated by roles and responsibilities
  • Evaluation timelines.
  • Anticipated locations and schedule for data collection efforts.
  • Utilization plan

March, 2024

Inbrief

USAID, USAID Learns

  • To discuss with USAID, IP about  the evaluation, initial assumptions, evaluation questions, methodology, and work plan, and to clarify any questions the team may have

March, 2024

Data collection

USAID, USAID Learns

  • Conduct necessary interviews

April, 2024

Preliminary Analysis Matrix

USAID Learns

  • Ongoing analysis of data

April, 2024

Validation Event

USAID, USAID Learns, IPs

  • Validation of study findings and co-create recommendations

May, 2024

Draft Report

USAID, USAID Learns

  • Production of the draft report

May, 2024

Out-brief Meeting

USAID, USAID Learns

  • Share findings and recommendations with USAID

June, 2024

Utilization Event

USAID, USAID Learns, IPs, stakeholders in service sectors

  • To jointly agree on how to operationalize recommendations, collaborate, follow-up on progress

June, 2024

Timelines: February 2024 – June 2024

Level of effort (LOE): up to 50 days

Responsibilities

  • Perform desk review and identify additional information required for analysis
  • Support the Team Leader's lead efforts in evaluation design, methodology, and data collection instruments.
  • Coordinate the evaluation activities, including meetings, interviews, note taking
  • Provide logistics support for evaluation activities, including interviews, meetings, group discussion, fieldwork, and events
  • Conduct interviews as needed and contribute to data collection
  • Provide ongoing analysis of qualitative and quantitative data
  • Support the preparation and presentation of the key findings and recommendations to USAID
  • Write assigned section of the draft evaluation report in coordination with the team members, taking into consideration feedback from the preliminary findings presentation
  • Work collaboratively with team members throughout design, implementation, analysis, and report writing to complement each other's areas of expertise

Qualifications 

  • Bachelor's degree, with preference for degree relevant to research, higher education, business administration, international development, or another related field?
  • 5 years of experience supporting or conducting mixed-method program evaluation or research
  • Must be able to conduct interviews and focus group discussion and analyze the resulting data
  • Sound experience with administration and/or logistics for data collection, specifically coordinating data collection activities?
  • Demonstrated organizational skills, attention to detail, and ability to take detailed notes?
  • Ability to work independently to meet deadlines and adhere to high quality standards?
  • Monitoring and/or Evaluation experience related to trade preferred?
  • Fluency in English and Vietnamese and in-depth knowledge of the operating environment in Vietnam required?
  • The candidate must be Vietnamese and reside in Vietnam
  • No relations with FUV or other interests that may compromise the Evaluation Coordinator’s actual or apparent impartiality.

The closing date for application: January 17, 2024. Selection and interviews will be performed constantly and interested candidates are encouraged to apply as soon as possible.

To apply, please merge both your CV and a cover letter into one pdf file and submit it through the online portal.

To learn more about Social Impact, please visit our website: http://www.socialimpact.com

SI is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

Only selected candidates will be contacted for an interview. Please, no phone calls, no visits.

Job Details
Organisation Name: 
USAID Learns - Social Impact
Location: 
Hanoi
Application Deadline: 
Wed, 2024-01-17