You are now in the main content area

Virtual proctoring tools available at Ryerson

What is automated virtual proctoring?

A automated virtual proctoring system uses artificial intelligent technology to monitor students while they are taking their exams in the location of their choice, usually their homes. The system uses web cameras and screen monitoring software. It includes an identity verification process using the student’s image and their photo ID that are captured where the instructor can review them. The system also records exam sessions and provides flags in the recording where the student behaviour matches the list of academic misconduct either provided by the system or the instructor.

At Ryerson, we have Respondus LockDown Browser + Respondus Monitor and Proctortrack Level 3 systems available for automated virtual proctoring.

 

Respondus Monitor

Respondus Monitor, external link is a fully automated virtual proctoring system. It is accessed seamlessly through the D2L Brightspace Quiz tool, therefore students and instructors do not need to create separate accounts in Respondus. Respondus Monitor enables students to take online exams at any time according to the D2L Brightspace Quiz availability.

The Respondus application, which is a browser (Respondus LockDown Browser, external link), will lock the student in the browser and the student will be unable to access anything else on their computer which the instructor has listed as prohibited. There is also an allowed list of applications and URLs the instructor can configure.

A webcam is used to record themselves during the exam. The video recordings are streamed to the Respondus server during the exam and stored on the Respondus servers afterwards. A "startup sequence" guides students through requirements selected by the instructor, such as showing identification or making a short video of the exam environment. Only the instructor and TA/GA of the course can review video recordings and the results of the proctoring session. The videos are not downloadable and cannot be easily shared with others. 

Facial detection and artificial intelligent algorithms are being used to analyze the recordings and flag certain behaviours during an exam session. Video segments with potential exam violations are flagged for the instructor review.

Virtual proctoring feature

Respondus LockDown Browser + Respondus Monitor

Integration with D2L Brightspace

Yes

Exam preparation

Using Brightspace Quizzes

Students need to install the application.

Yes

Student’s ID verification process

Instructor has the option to require (or not) the following:

  • Student photo
  • ID card
  • Environment check

Students taking the exam



Exam which is in the Brightspace Quiz can be taken using a desktop computer or iPad

Instructors have the option to disable the following:

  • Print
  • copy/paste
  • Screen captures 
  • and have a list of allowed links/websites and applications.

Students video recording while taking the exam

The video is streamed to and recorded in the Respondus server.

  • Internet outage will cause a failure in the video recording. 
  • Internet disruption, e.g. reduced bandwidth, will not cause failure. Respondus will adjust.

Students submitting the exam

Submit the D2L Brightspace Quiz in Brightspace, logout from Brightspace, and close the browser.

Instructors reviewing the result.




Instructors are presented with “flags” as noted by the AI.

Instructors need to review the flags and discern whether they are academic misconduct or not. 

Flags

Flagged Events, external link:

  • Missing from Frame
  • Different person in Frame
  • Multiple persons in Frame 
  • An Internet interruption occurred
  • Video frame rate lowered due to quality of internet connection
  • Student exited LockDown Browser early
  • Low Facial Detection
  • A webcam was disconnected
  • A webcam was connected 
  • An attempt was made to switch to another screen or application
  • Video session terminated early
  • Failed Facial Detection Check
  • Student turned off facial detection alerts

Proctortrack Level 3

Proctortrack, external link is an online remote proctoring system. It provides both automated and live proctoring, however we are only subscribing to the automated proctoring through the offering from eCampusOntario and the Ontario Ministry of Colleges and Universities initiative., external link Instructors and students access Proctortrack through the D2L Brightspace tool, therefore no separate accounts in Proctortrack are needed.

The Proctortrack app allows instructors to disable other apps and URLs which students are not allowed to access and use during an examination.

Proctortrack records a student taking an exam using a webcam, processes and stores the video locally on the student’s computer. After the exam is over, the Proctortrack app uploads the recording to the Proctortrack server. Only the instructor and TA have access to these videos from the Proctortrack Dashboard which is accessed from the D2L Brightspace course, but they cannot download nor share them. 

Prior to the start of the exam, there is a series of tasks the student will need to complete called the on-boarding process. The identification verification is done In the on-boarding process. The instructor can decide what to include in the on-boarding process. The instructor can also configure what access and behaviours are permitted or prohibited. Facial detection and artificial intelligent algorithms are being used to analyze the recordings and flag certain behaviours during an exam session. Video segments with potential exam violations are flagged for the instructor review.

With Proctortrack Level 3, Proctortrack does a quality assurance before the instructors review the flags. This helps instructors since the flags presented would not include flags which are false or false positives.

Virtual proctoring feature

Proctortrack Level 3

Integration with D2L Brightspace

Yes

Exam preparation

Using Brightspace Quizzes

Students need to install the application.

Yes

Student’s ID verification process

Done during the on-boarding process where students create their profiles that will be used in all examinations. This eliminates the need for students to do the ID verification repeatedly. The ID verification process is configurable by the instructor.

Students taking the exam



Exam which is in the Brightspace Quiz can only be taken using a desktop computer.

Dual monitors will not work with Proctortrack.

Instructors have the option to select allowed and prohibited behaviours and to include allowed links/websites and applications.

Students video recording while taking the exam

The video is recorded locally on the student’s computer during the exam and uploaded to Proctortrack server at the end of the session.

Internet disruption or outage during the exam will not affect the recording.

Students submitting the exam

Submit the exam in either Brightspace Quiz or Assignment,  allow Proctortrack finish rendering and uploading the video, and quit Proctortrack.

Note: If the student forgets to quit  the application, the app will stay open. If the student then  needs to re-enter the exam (e.g. left the quiz due to internet access disruption) or take a different exam with Proctortrack, they won’t be able to start until they close the app and try again.

Instructors reviewing the result.




Before the instructors are presented with “flags” as noted by the AI, Proctortrack Level 3 provides quality assurance where Proctortrack staff checks the flags for true flags and removes false flags.

Flags

Below is a list of what instructors can require/not, allow/prohibit,  and enable/disable.

ID Verification:

  • Require face scan
  • Require/not Photo ID scan
  • Require/not room scan
  • Require/not knuckle scan

Test settings:

  • Allow/prohibit physical book
  • Allow/prohibit online/digital resources
  • Allow/prohibit scratchpad tools
  • Allow/prohibit handwritten notes
  • Allow/prohibit to take scans or pictures using phones
  • Allow/prohibit to take scans or upload documents
  • Allow/prohibit use of earphones
  • Allow/prohibit short breaks
  • Allow/prohibit food and drinks
  • Allow/prohibit copy/paste
  • Allow/prohibit print screen
  • Allow/prohibit printing
  • Enable/disable Desktop monitoring
  • Allow/prohibit multiple monitors
  • Allow/prohibit physical calculator
  • Allow/prohibit screen calculator
  • Enable/disable access code/password

Whitelist URL and/or Apps