Integrated Multiscopic CPSS For Physical and Cognitive Measurement in an Independent Block-Design Test

This paper presents an integrated multiscopic cyber-physical-social system (CPSS) for evaluating physical and cognitive aspects in an independent block-design test (BDT). First, we utilize a hand tracker to extract physical features at the microscopic level, such as hand posture during manipulation. Second, an egocentric vision incorporating an eye tracker describes perceptual representation at the mesoscopic level. This system represents hand-eye coordination by measuring the distance between the hand and the center of visual attention during the test. Thirdly, an upper table vision system uses color feature recognition in each block to evaluate cognition at the macroscopic level. This system detects the blocks and recognizes that the design matches the task given. By evaluating eight designs of WAIS-IV BDT, our system has demonstrated its ability to measure physical and cognitive variables during the BDT successfully. Additional research and development are required to support BDT development in the future. Code and datasets are available online at https://github.com/anom-tμbdt-multiscopic.