New Technologies for Rating Scale Assessment in Psychiatric and Psychological Clinical Research: Rater Training

Source: EClinCloud. Author: eClinCloud.
Click the blue text above to follow us

On August 24–27, 2021, the "Training Series on Clinical Research Technologies and Capacity Building for Psychiatric and Psychological Disorders" was successfully held. Dr. Qin Long, CEO of EClinCloud, was invited to give a keynote presentation on "New Technologies for Rating Scale Assessment in Psychiatric and Psychological Clinical Research." He provided a comprehensive introduction to three new technologies currently used in rating scale assessment: eCOA, rater training, and blinded data analysis, and shared case examples demonstrating how these new technologies support clinical research.
We will introduce these three new technologies across three articles; this article covers Part 2: rater training.

Standardized assessments require standardized administration methods, so it is crucial that raters can conduct assessments accurately in accordance with scale requirements. Using validated methods and approaches, we provide comprehensive rater training to reduce human error, standardize scoring, ensure consistency of assessment results, and improve the reliability of endpoint outcomes.
To reduce placebo effects and scoring bias
Both investigators and patients need to receive relevant training
Investigators need to create a good assessment environment
Patients also need to have appropriate expectations about the clinical trial
Throughout the process, care should be taken to balance interactions with patients, manage patient expectations, keep contact minimal, listen more, and communicate directly.

Their expectations and mindset need to be well managed so that they maintain realistic expectations and avoid blind optimism, understanding that it is acceptable even if symptoms remain unchanged or worsen.

Throughout the trial, conducting rater training to maintain the accuracy and standardization of endpoint assessment is an ongoing process.
Some studies last a relatively long time—two, three, or even more years. To keep subjective scales objective over such an extended period, raters need ongoing training. For certain specific scales, not only is the training validity period short, but training records are also required; for example, for the NIHSS scale, each training is valid for only one year, and retraining is required after one year.
In addition, the trial process may also include periodic refresher training as well as remedial training conducted based on issues identified during data quality monitoring in the study.

Before training, raters need to submit an experience questionnaire so that we can understand their prior background, such as how many years of rating experience they have and which scales they are familiar with. An interview skills assessment is also conducted to evaluate the rater's interviewing ability and approach. More experienced and skilled raters may be exempted from most training, whereas less experienced or novice raters may receive more intensive training.
Select suitable raters once qualification requirements are met.
Conduct online or in-person training on interviewing and assessment skills through investigator meetings or a learning platform using various interactive learning tools. Training content may also cover topics such as subject selection, adherence to scale rules, synchronization of symptom measurement, and mitigation of placebo effects.
Confirm qualified raters for each study site.
Through this entire training process
Ensure rater training spans the entire clinical trial
Improve rating consistency
Ensure endpoint quality



