Clinical Evaluation of VainSim

Assessing Patient and Caregiver Perceptions of the Use of a Venous Access Infusion Training Device in an Infusion Workshop at Orlando Health Arnold Palmer Hospital for Children Hemophilia Treatment Center, conducted November 2023 - May 2024.

Methodology

  • Population

    18 bleeding disorder patients
    (ages 5-24) and 22 caregivers attended infusion workshops held by a HTC multidisciplinary team; participants 8 and older were able to evaluate the tool and complete surveys.

  • Pre-Survey

    To start, current level of infusion confidence was evaluated on a 5-point Likert scale (“I have never infused before [0]” to “Very Confident [4]”) before receiving infusion education and practicing with VainSim.

  • Post-Survey - Confidence

    After practicing with the simulator, confidence was measured again with a 4-point Likert scale (“Not Confident [1]” to “Very Confident [4]”).

  • Post-Survey - Usability

    Participants evaluated the
    usability of the simulator using the System Usability Scale (SUS), a usability assessment with ten items that measure participant agreement on a 5-point Likert scale (“Strongly Disagree [1]” to “Strongly Agree [5]”).

  • Practice Self-Infusion

    Next, the participant had the opportunity to practice infusion on themselves or a family member.

  • Post-Survey - Self Infusion

    Finally, their confidence was
    measured again at the end of study procedures with a 4-point Likert scale (“Not Confident [1]” to “Very Confident [4]”).
Interpret a System Usability Scale

Study Results

  • Wilcoxon Signed-Ranks tests were performed to determine whether participant confidence in infusion was affected by practicing with the simulator and attending the workshop.
  • These differences were significant; participant confidence was significantly higher (Z = 5.072, p = <0.001) after using the simulator tool and even higher after completing the workshop (Z = 5.056, p = <0.001).

System Usability

  • The simulator received a System Usability Score (SUS) of 83.26 (SD=11.52, 95% CI [79.36, 87.16]). The average SUS score across industries is 68.
  • Participant survey responses placed VainSim in the 95th percentile of usability scores, considered an 'Excellent' score.

Questions about the study or how you can use VainSim to achieve similar results? Contact us below!