Education, Test and Evaluation Analysis

Research, test and evaluation analysis in research programs are critical for the validity and reliability of the work conducted. Currently, the defense cuts in personnel have caused the inability to execute these research areas, which necessitates augmentation to existing study capabilities. A detailed front-end analysis facilitates more objective test and evaluation procedures and maintains traceability of critical research for medical simulation research products without creating additional workload for Principal Investigators.

IVIR’s Training/Test Assessment Capabilities Evaluation and Reporting System for Research (TrACER-RÒ) is an automated assessment and evaluation system. Specifically designed for research and testing, it reduces workload and minimizes human error in data collection and fusion. It produces test instruments, collects test data, correlates data and produces statistical/descriptive analysis for reports and produces objective evaluations of subjects and observer/controller performance for cognitive tasks, psychomotor skills, and effective measurement.

Sponsor
U.S. Army Research Laboratory
Award Date:
August, 2016
Contract #:
W911NF-16-C-0046
Status:
Delivered

The medical readiness of military or civilian medical personnel saves lives, making realistic education and training an imperative. However, to perform the correct intervention at the correct time in the continuum of care is critical to maximum effectiveness. It is imperative that training technology is capable of emulating real-life situations. This effort produced reviewable system engineering educational and requirements definition frontend analysis. This information is transferable to design requirements and appropriate test and evaluation procedures, producing accurate objective and repeatable assessment data for research programs in the medical simulation and training research area. The test and evaluation process, when applied with verification and validation principles, serves as an important risk mitigation to ensure requirement adherence and program success.

The mission of this research and development program is to provide a descriptive educational objective with a cross-reference matrix to design requirements definitions, test plans, test instruments, and data collection and analysis. It includes research of available doctrine and literature for a specified procedure and skill level to provide educational objectives. Test procedure and instruments was provided in a test master plan and Institutional Review Board (IRB) documentation as required. Performance assessment was conducted with trained observer/controllers for inter/interrater reliability during test conduct.

The intent was to research, develop, and provide test analysis to support current and future research efforts for meeting the necessary educational and operational requirements for medical training and simulation initiatives. It produced reviewable system engineering educational and requirements definitions frontend analysis, which are directly transferable to appropriate test and evaluation procedures, producing accurate objective and repeatable assessment data for research programs in the medical simulation and training research area. The data will assist the government in determining current and future medical simulation research efforts with objective assessment information.