Peer Review Process

Rigorous peer review is the cornerstone of our funding programs. It ensures that we support research that meets the highest scientific standards, invests in BC’s best and brightest researchers, and builds our province’s capacity for world-class health research.

We adhere to six principles shared by all members of the National Alliance of Provincial Health Research Organizations (NAPHRO): integrity, accountability, transparency, balance, confidentiality and impartiality.

In line with these principles our review cycles follow the steps below:

Categorize applications by theme

Categorize applications by theme

Match reviewers to applications

Match reviewers to applications

Hold review panel meetings

Hold review panel meetings

Have three rounds of scoring

Have three rounds of scoring

Debrief with all reviewers

Debrief with all reviewers

Depending on the program, applications are categorized by theme with a review panel for each (e.g. biomedical, clinical, health services and population health research). The chairs and scientific officers of all review panels cross check these groupings to ensure the research proposed within each application aligns with the panel it is assigned to.

Once the application deadline has passed, we recruit reviewers who are subject matter experts in areas that directly align with the applications we’ve received. These reviewers are selected for their research excellence, breadth of knowledge, and maturity of judgment. We’ve been matching reviewers to applications based on expertise for 15 years, drawing on “external readers,” often from the international community, for highly specialized applications.

Review panels for our major funding awards are held in person. During COVID-19 we have moved our peer review meetings to a virtual format. Each reviewer is encouraged to share unbiased feedback and discuss scoring for each application (excluding those with conflicts). We find that through this frank and open discussion, reviewers challenge and hold each other accountable for adjudication decisions.

For each application, two lead reviewers (chosen for their subject matter expertise) share their assessments and initial scores. The panel discusses the application, and, based on these additional insights, the lead reviewers have the opportunity to revise their scores. This creates the “consensus score” which forms the basis for the voting range. Finally, all panel members (excluding those with conflicts) score the application anonymously; the average of these scores is the final score for the application.

Our reviewers are seasoned researchers and many sit on panels for a number of funding organizations. At the end of each review meeting, we invite them to share feedback on the program, the resources provided to applicants and the review process itself. This ensures we continue to refine our programs and processes to ensure they are of high quality and that we continue to meet the highest scientific standards.

An overview of our typical peer review process

 

Our structured peer review process is tailored to meet the needs of each individual funding program. Below is a visual overview of the process for our Scholar program, which has been running since 2001.

click on image below to enlarge

Recent review panels

2021 Research Trainee competition

Learn more

2021 Scholar competition

Learn more

2020 Convening & Collaborating competition

Learn more

2020 Health Professional-Investigator (HP-I) competition

Learn more

2020 Innovation to Commercialization competition

Learn more

2020 Reach competition

Learn more