Reviewer in Training Program

Program Parameters

Participants in the ECR Reviewer role will be assigned up to five applications to review based on their self-declared ability to review. ECR Reviewers must submit their reviews in accordance with committee deadlines. ECR Reviewers will attend the peer review meeting in its entirety, present their reviews, and participate in the committee meeting discussions including final consensus ratings, individual voting, and budget assessment. ECR Reviewers will present their assigned applications later in the meeting, and will have access to all of the supportive resources that CIHR provides to committee members.

Eligibility

• Must meet CIHR’s definition of an ECR on the application deadline for the Project Grant Competition;
• Must hold a position at an eligible Canadian institution on the application deadline for the Project Grant Competition;
• Must have at least one recent federally funded peer reviewed research grant (or equivalent) as a Principal Investigator;
• Must not have previously participated in the RiT Program as an ECR Reviewer;
• Must not have previously reviewed for the Project Grant competition; and
• Must not be Full College Members.

Applicants who have previously participated as a Mentee, and now meet these criteria, are eligible to participate as an ECR Reviewer.

Roles and Responsibilities

ECR Reviewers will follow the same roles and responsibilities as regular reviewers as outlined in the Project Grant manual except where differences are noted below. Briefly:

Before the meeting

The ECR Reviewer will:

• Complete the learning modules on:
  • Bias in Peer Review;
  • Conducting Quality Reviews; and
  • One of following modules based on their methodological expertise:
    • Introduction to Sex and Gender Considerations in Basic Science
    • Introduction to Sex and Gender Considerations in Clinical and Epidemiological Research
  • Participants in the Indigenous Health Research (IHR) committee must also complete:
    • Background context on Indigenous Health Research
    • Research Involving First Nations, Inuit and Métis Peoples of Canada (TCPS 2 Chapter 9) – Webinar
• Visit CIHR's Skill Builders webpage for interactive exercises on areas they wish to sharpen their skills for the peer review process. Suggested exercises include:
  • Appropriate Reviews with High Utility;
  • Writing Relevant Reviews;
  • Writing Robust Reviews; and
  • Aligning the Review Scores and Comments.
• Declare any conflict of interest and confirm their ability to review through ResearchNet;
• Evaluate and provide initial ratings on up to five assigned applications based on their self-declared ability to review;
• Prepare to present their reviews at the meeting, noting that not all applications are discussed at a committee meeting; and
• Familiarize themselves with all other applications to be assessed by their committee to facilitate discussions at the committee meeting.

During the meeting

The ECR Reviewer will:

• Attend the committee meeting date(s) in their entirety;
• Present to the committee their review of their assigned applications (presented later in the meeting);
• Participate in the committee discussions; and
• Vote on all the applications discussed by the committee and for which they are not in conflict.

After the meeting

The ECR Reviewer will:

• Have the option to revise their reviews within 5 business days after the end of the committee meeting;
• Be promoted to peer review processes at CIHR and participate when available; and
• Be invited to become an Associate Member if they meet the program's eligibility criteria.

Review Quality Assurance

After participating in the committee meeting, the Chairs, Scientific Officers and CIHR staff will provide feedback on ECR Reviewers using CIHR's standardized Reviewer Quality Feedback form. In certain cases, CIHR will implement strategies to best support ECR-Reviewers and promote continuous improvement by providing feedback on review quality, participation and responsiveness as well as directing reviewers to resources that outline the criteria of high quality reviewer performance. Please see CIHR Standards of Practice for Peer Review for more information.

Mentorship

The College of Reviewers has developed a guide for Mentors to help facilitate the mentorship process during the RiT Program. This guide will be provided to you prior to the committee meeting.

Roles and Responsibilites

Before the meeting

The Mentor will:

• Be assigned a Mentee by CIHR staff in collaboration with committee executives;
• Be introduced to the Mentee and will be asked to make themselves available to answer questions through MS Teams;
• Read and assess the review quality of the practice reviews prior to the meeting; and
• Provide Mentee with constructive feedback on review quality in advance of the meeting.

Important: While you can answer questions about the review process, review quality, and provide feedback on the practice reviews, scientific opinions and/or merit of an application should not be the focus.

During the meeting

Formal mentorship stops however, the Chair and Scientific Officer will:

• Explain Mentee's participation parameters at the start of the meeting during the sequence of steps presentation;
• Encourage and make space in the meeting for the Mentee to actively participate;
• Observe the Mentee's participation throughout the committee meeting; and
• Record the Mentee's comments during the discussion as anything they say will have an influence on the final consensus.

After the meeting

The Mentor will:

• Arrange a meeting with their Mentee to debrief on their experience (if schedules allow).

Roles and Responsibilities

CIHR staff will be available to answer questions and support both the Mentees, Mentors, and ECR Reviewers throughout the RiT Program.

Before the meeting

CIHR staff will:

• Introduce the Mentee and Mentor, providing them with an environment to collaborate (MS Teams);
• Assign Mentees up to 3 Project Grant applications for review (up to 5 applications assigned to ECR Reviewers);
• Provide access to appropriate learning materials and webinars; and
• Provide Mentee and Mentor Guide instructions that outline meeting participation parameters.

During the meeting

CIHR staff will:

• Ensure that the Mentee presents their review as scheduled in the agenda and sequence of steps; and
• Ensure that the Mentee follows meeting participation parameters.

After the meeting

CIHR staff will:

• Collect Review Quality Feedback forms from Chairs and Scientific Officers;
• Provide RQA feedback to Mentees and ECR Reviewers; and
• Collect feedback from all participants about their experience with the program.