Clinical Evaluation of VainSim
Assessing Patient and Caregiver Perceptions of the Use of a Venous Access Infusion Training Device in an Infusion Workshop at Orlando Health Arnold Palmer Hospital for Children Hemophilia Treatment Center, conducted November 2023 - May 2024.

Study Conclusion
VainSim scored in the 95th percentile of usability scores, considered 'Excellent'. For participants living with a bleeding disorder and their caregivers, confidence in infusion skills significantly increased after using VainSim, and further increased after completing the infusion workshop.
Methodology
-
Population
18 bleeding disorder patients
(ages 5-24) and 22 caregivers attended infusion workshops held by a HTC multidisciplinary team; participants 8 and older were able to evaluate the tool and complete surveys. -
Pre-Survey
To start, current level of infusion confidence was evaluated on a 5-point Likert scale (“I have never infused before [0]” to “Very Confident [4]”) before receiving infusion education and practicing with VainSim.
-
Post-Survey - Confidence
After practicing with the simulator, confidence was measured again with a 4-point Likert scale (“Not Confident [1]” to “Very Confident [4]”).
-
Post-Survey - Usability
Participants evaluated the
usability of the simulator using the System Usability Scale (SUS), a usability assessment with ten items that measure participant agreement on a 5-point Likert scale (“Strongly Disagree [1]” to “Strongly Agree [5]”). -
Practice Self-Infusion
Next, the participant had the opportunity to practice infusion on themselves or a family member.
-
Post-Survey - Self Infusion
Finally, their confidence was
measured again at the end of study procedures with a 4-point Likert scale (“Not Confident [1]” to “Very Confident [4]”).

Study Results
- Wilcoxon Signed-Ranks tests were performed to determine whether participant confidence in infusion was affected by practicing with the simulator and attending the workshop.
- These differences were significant; participant confidence was significantly higher (Z = 5.072, p = <0.001) after using the simulator tool and even higher after completing the workshop (Z = 5.056, p = <0.001).

System Usability
- The simulator received a System Usability Score (SUS) of 83.26 (SD=11.52, 95% CI [79.36, 87.16]). The average SUS score across industries is 68.
- Participant survey responses placed VainSim in the 95th percentile of usability scores, considered an 'Excellent' score.