Framework for the evaluation of a holistic fitness-to-drive system for commercial drivers in the PANACEA project

Abstract: Commercial drivers have a challenging work environment and often report being fatigued or stressed while driving [1]. Key considerations are the impact of shift work, task related fatigue, and impairment due to alcohol or drug use. The PANACEA project aims to create a holistic approach, during and roadside driving ability monitoring and assessment system. The system will assess the physical, cognitive, and psychological Fitness-to-Drive of commercial drivers. In cases of impairment, a complementary cloud-based countermeasures and coaching tool will deploy appropriate solutions targeting drivers, operators, and enforcement. It is intended that the PANACEA system will detect fitness-to-drive prior to starting work and during the work shift. In addition, it will prepare drivers ahead of their future shifts. To enable a systematic evaluation of the PANACEA system in various commercial driver groups, an evaluation framework was developed.MethodsCommonly used frameworks from different fields were reviewed. Previous reviews of evaluation frameworks have concluded that there is an abundance of frameworks available but no single framework that covers all aspects of evaluation [2-4]. Several transportation system evaluation frameworks exist, but these mostly focus on evaluation of the societal impact and economic benefits [3, 5] or environmental impact [6].None of the reviewed frameworks provided a perfect fit for the PANACEA project. The PANACEA project has its starting point in the project objectives, which are a combination of technology development, technology evaluation, knowledge creation, and impact assessment objectives. As there are various types of data collections planned, the framework needs to be flexible enough to allow for a range of different study designs. Moreover, the development of the PANACEA system will follow an iterative development process, where the results of initial data collections will be fed back to refine the PANACEA solutions. Lastly, the framework needs to cover the evaluation of the final PANACEA system, including the technical performance, usefulness and operability, user experiences, safety, socioeconomic impact etc. ResultsAn evaluation framework was developed by reviewing and combining components from commonly used frameworks in both the automotive and clinical research field. The FESTA methodology [7] was used as the foundation and the various steps in the evaluation process were adapted to suit the purpose of the PANACEA project.The evaluation process is divided into three phases; planning, implementation, and analysis and reporting. Within each phase, there are several steps to follow in the evaluation process. The steps are described as sequential steps in a linear way, where each step provides the necessary input for completion of the next step. The evaluation framework has a mixed methods approach combining qualitative and quantitative methods. ConclusionAn evaluation framework incorporating components from several previous frameworks was developed within the PANACEA project, setting the plan for data collection, analysis, and reporting. The PANACEA framework will be used in all studies included in the project to achieve effective and systematic data collection to provide a solid evidence base for assessment of progress and impact over time.The PANACEA project has received funding by the European Union’s Horizon 2020 research and innovation programme under Grant Agreement number 953426.References1.Filtness, A., et al., Bus driver fatigue. 2019, Transport for London: London, UK.2.Fynn, J.F., et al., A scoping review of evaluation frameworks and their applicability to real-world physical activity and dietary change programme evaluation. BMC Public Health, 2020. 20(1): p. 1000.3.Newman-Askins, R., L. Ferreira, and J.M. Bunker. Intelligent transport systems evaluation: From theory to practice. in 21st ARRB and 11th REAAA Conference. 2003.4.Yusof, M.M., et al., An evaluation framework for Health Information Systems: human, organization and technology-fit factors (HOT-fit). International Journal of Medical Informatics, 2008. 77(6): p. 386-398.5.He, J., Z. Zeng, and Z. Li, Benefit Evaluation Framework of Intelligent Transportation Systems. Journal of Transportation Systems Engineering and Information Technology, 2010. 10(1): p. 81-87.6.Jansuwan, S., et al., An evaluation framework of automated electric transportation system. Transportation Research Part E: Logistics and Transportation Review, 2021. 148: p. 102265.7.Barnard, Y., et al., Methodology for Field Operational Tests of Automated Vehicles. Transportation Research Procedia, 2016. 14: p. 2188-2196.

Keywords: Fitness-To-Drive, Driver Monitoring, Traffic Safety, Professional Driver, Evaluation

DOI: 10.54941/ahfe1005227

Cite this paper:

​