Virtual interaction apparatus
The virtual interaction apparatus addresses the lack of integrated rehabilitation systems by providing a customizable and adaptable platform for cognitive rehabilitation, allowing users to interact with virtual elements and perform exercises tailored to their abilities, thereby enhancing rehabilitation effectiveness.
Patent Information
- Application Number
- PCT/IB2024/059090
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-19
- Filing Date
- 2024-09-19
- Publication Date
- 2025-03-27
AI Technical Summary
Current rehabilitation technologies lack an integrated and coherent multipurpose system capable of considering a variety of parameters to be configured for cognitive rehabilitation, covering orthopaedic, neuromotor, respiratory, muscle activation, and phonation aspects.
A virtual interaction apparatus featuring a display screen, processing unit, and controller system, which includes pointing devices and selector devices. This apparatus generates and displays cognitive exercises, allowing users to interact with virtual elements, and is configurable based on user conditions through calibration procedures.
The apparatus provides a customizable and adaptable solution for cognitive rehabilitation, allowing each user to perform exercises tailored to their motor and cognitive abilities, thereby enhancing rehabilitation effectiveness and user engagement.
Smart Images

Figure IB2024059090_27032025_PF_FP_ABST
Abstract
Description
[0001] “VIRTUAL INTERACTION APPARATUS”
[0002] The present invention relates to a virtual interaction apparatus.
[0003] The present invention therefore has particular application in the creation of a video interface that allows a user to interact with a virtual environment, preferably for use as a rehabilitation or physiotherapy device.
[0004] In fact, in the prior art, there is an increasing need to make available to the rehabilitation / health facilities that host them, apparatuses capable of coping with different ways of performing physiotherapy or cognitive rehabilitation activities, in a simple and intuitive way, possibly even remotely monitored.
[0005] The need is thus to be able to link cognitive activities (in which the use of the instrument is a necessary and sufficient part of the interaction) with incentive activities linked to the need to control and activate the signals necessary for the implementation of the instrument, thus linking cognitive rehabilitation to training relating to a very wide range of different rehabilitation domains.
[0006] In the prior art, however, to date there is no integrated and coherent multipurpose system that can consider as input variables a multiplicity of parameters sufficient to be configured as a system for cognitive rehabilitation with orthopaedic, neuromotor, respiratory, muscle activation and phonation implications.
[0007] The object of the present invention is therefore to make available a virtual interaction apparatus that is able to overcome the drawbacks of the prior art.
[0008] In particular, it is the aim of the present invention to provide a virtual interaction apparatus defining an integrated solution that, in addition to being configurable, is easily adaptable to the specific condition of the patient.
[0009] Further, it is also the aim of the present invention to provide an interaction apparatus capable of monitoring the patient / user's progress and adapting accordingly. Said aims are achieved by a virtual interaction apparatus according to the present invention, having the characteristics of one or more of the following claims.
[0010] In particular, these aims are achieved by a virtual interaction apparatus comprising a display screen that can be viewed by a user and a processing unit and controller system.
[0011] Preferably, the processing unit is configured to generate and display, via said screen, at least one cognitive exercise which provides to select and move one or more virtual elements displayed on the screen in order to achieve one or more target goals.
[0012] The controller system preferably comprises a plurality of pointing devices and at least one selector device.
[0013] Preferably, the pointing devices are selectively associated with said processing unit and configured to transform a movement of a part of the user's body into a corresponding movement of said virtual elements on said screen.
[0014] Preferably, the selector device is associated with said processing unit and configured to transform a command given by the user into an action of selecting or releasing said one or more virtual elements.
[0015] According to an aspect of the invention, the processing unit is configured to display to the user, via said screen, a plurality of execution modes of said cognitive exercise.
[0016] Preferably, the processing unit is also configured to - identify one or more pointing devices compatible with an execution mode selected by the user.
[0017] Preferably, the processing unit is also configured to - enable a single pointing device according to a pre-set priority and / or according to a preference expressed by the user.
[0018] Preferably, the processing unit is also configured to enable the selector device.
[0019] Preferably, moreover, the processing unit is programmed to configure said single enabled pointing device and / or said enabled selector device according to user conditions.
[0020] Preferably, configuration takes place by initiating a calibration procedure for said single enabled pointing device and / or said enabled selector device.
[0021] Alternatively, said single enabled pointing device and / or said enabled selector device is configured according to a pre-existing configuration associated with said user.
[0022] Advantageously, this makes it possible for each user / patient to perform the cognitive exercise as desired and calibrated to his or her actual motor / cognitive abilities, which benefits both the user's perception and the rehabilitation effectiveness of the session.
[0023] In other words, the presence of a pointing device (enabled) and a selector device (enabled) that are physically distinct from each other allows for maximum operating versatility and increases therapeutic efficiency by allowing exercises to be calibrated to the user's needs.
[0024] In at least one of the above aspects, the invention comprises one or more of the following preferred characteristics, which are described below.
[0025] Preferably, the execution modes comprise two or more of the following options:
[0026] - pointing by moving an upper limb;
[0027] - pointing by moving a lower limb;
[0028] - pointing by moving the pelvis;
[0029] - pointing by moving the head;
[0030] - pointing by moving the eyes.
[0031] Preferably, the calibration procedure for the single pointing device involves asking the user to place the pointing device in a first limit position and a second limit position.
[0032] Preferably, the second limit position is opposite the first along a first operating direction.
[0033] Preferably, the first and second limit positions are a function of the user's ability to move. Preferably, the calibration procedure of the single pointing device comprises taking the coordinates, along said first operating direction of the pointing device, of the first limit position and the second limit position.
[0034] Preferably, moreover, the calibration procedure of the pointing device comprises calibrating a stroke of the virtual element on the screen, along a first virtual direction corresponding to said first operating direction, as a function of a distance between the first and second limit position assumed by the single pointing device.
[0035] Advantageously, in this way, the apparatus adapts its behaviour to the motor and cognitive possibilities of the user / patient, adjusting the response of the software, thus the amplitude and speed of the movement of the virtual element on the screen (always constant) with the patient's real ability to move.
[0036] Preferably, the calibration procedure of the pointing device also involves asking the user to position the pointing device in a third limit position and a fourth limit position opposite the third along a second operating direction, wherein the third and fourth limit positions are a function of the user's ability to move.
[0037] Preferably, the calibration procedure of the pointing device comprises taking the coordinates, along said second operating direction of the pointing device, of the third limit position and the fourth limit position.
[0038] Preferably, the calibration procedure of the pointing device comprises calibrating a stroke of the virtual element on the screen, along a second virtual direction corresponding to said second operating direction, according to a distance between the third and fourth limit positions assumed by the single pointing device.
[0039] Preferably, the first and second operating directions are orthogonal to each other.
[0040] Preferably, the calibration procedure of the selector device comprises requesting the user to make a selection by means of an action involving the selector device. Preferably, the calibration procedure of the selector device also comprises detecting a level of force and / or pressure and / or volume of the action performed by the user.
[0041] Preferably, the calibration procedure of the selector device comprises calibrating a selection command enablement, according to a detected value of said force and / or pressure and / or volume level.
[0042] Advantageously, the selection can thus also be differentiated according to the patient's wishes or possibilities, possibly also depending on external factors (e.g. volume).
[0043] Preferably, moreover, said processing unit is configured to activate a movement compliance verification process during the performance of said cognitive exercise.
[0044] Advantageously, in this way the apparatus is able to autonomously reset its operating parameters and the calibration of the pointing devices and selectors, to the benefit of optimising the patient rehabilitation process.
[0045] These and other features, together with their relative advantages, will become clearer from the following illustrative, therefore non-limiting, description of a preferred, therefore non-exclusive, embodiment of a virtual interaction apparatus as shown in the attached drawings, wherein:
[0046] - Figure 1 shows a schematic overall view of a virtual interaction apparatus according to the present invention;
[0047] - Figures 2 and 3 show the virtual interaction apparatus of Figure 1 in two different calibration phases.
[0048] With reference to the accompanying figures, a virtual interaction apparatus according to the present invention is hereinafter referred to as a whole by number 1 .
[0049] Virtual interaction apparatus is herein intended to define an interface apparatus that allows a user to interact with a virtual environment that can be viewed via an appropriate display screen 2. This apparatus 1 finds its main and particular application in the therapeutic and rehabilitation sphere but, alternatively, the apparatus 1 could also find application in training or gaming.
[0050] The virtual interaction apparatus 1 basically comprises a frame 2 with a display screen 3 that can be viewed by a user, a processing unit 4 and a controller system 5.
[0051] The display screen 3 is thus configured to display a virtual environment to the user. This display screen 3 can be of various types, preferably flat screen, with LCD, LED, OLED or any state-of-the-art image display technology.
[0052] In the preferred embodiment, the apparatus 1 comprises an enclosed frame 2 from which the screen 3 is visually accessible, preferably at an upper portion.
[0053] The processing unit 4 is associated with the screen 3 and configured to generate and display, via said screen 3, at least one cognitive exercise involving the selection and movement of one or more of the virtual elements displayed on the screen 3 to achieve one or more target goals.
[0054] Preferably, the processing unit 4 is configured to propose a plurality of cognitive exercises to the user, differing both in type and level of difficulty or target goals.
[0055] It should be noted that the expression “cognitive exercises” is understood in this text to identify the display of one or more structured and repetitive exercises that reflect certain cognitive functions (memory, attention, problem solving, etc.) and require the user to complete certain operations (target goals).
[0056] The following is a non-exhaustive list exemplifying some of these cognitive exercises:
[0057] - doing a jigsaw puzzle by translating image pieces onto a grid;
[0058] - selecting on-screen elements (either images or text) meeting certain specified requirements or completing sequences;
[0059] - dragging and dropping textual or graphic elements to complete sequences or divide them into groups.
[0060] Such simple actions form the basis of a very wide range of cognitive exercises operating on the domains of memory, attention, logic, mathematical logic, executive functions, and spatial and temporal ordering. The processing unit 4 is thus configured to execute one or more algorithms representative of such exercises, in which one or more virtual elements must be moved appropriately.
[0061] In the preferred embodiment, the processing unit 4 comprises a microprocessor or microcontroller system, generically configured to perform control-related processing, presentation of the activity to the user by audiovisual means and interaction between the movements made by the user and control over the activity.
[0062] The processing unit 4 is thus configured to allow the user to log in by entering or detecting unique recognition data (e.g. codes, passwords, or biological parameters) and by means of recognition systems known in themselves and not described here.
[0063] Once the user profile is activated, the processing unit 4 is configured to display one or more cognitive exercises for the user to carry out.
[0064] In order to proceed with the movement of the virtual elements, the user is required to provide a plurality of inputs (or input signals), preferably generated and sent to the processing unit 4 by means of the controller system 5.
[0065] According to an aspect of the invention, the controller system 5 comprises a plurality of pointing devices 6 selectively associated with said processing unit 4 and configured to transform a movement of a part of the user's body into a corresponding movement of said virtual elements on the display screen 3.
[0066] Preferably, said plurality of pointing devices 6 comprises two or more of the following devices:
[0067] - wearable inertial sensors;
[0068] - cameras; - rgbd cameras;
[0069] - optical systems;
[0070] - eyetracking devices;
[0071] - sensor-equipped platform, e.g. equipped with load cells and detecting the centre of pressure, also in multiple configuration;
[0072] - unstable mobile platform equipped with inclinometer or equivalent technologies to assess real-time orientation in space;
[0073] - electromyographs;
[0074] - spirometry devices;
[0075] - magnetic sensors.
[0076] Each of the pointing devices 6 preferably comprises a transmission module 6a configured to generate one or more signals (digital or analog, wired or wireless) representative of said inputs.
[0077] In this regard, the processing unit 4 is thus associated with one or more receiving modules 4a configured to receive said one or more signals from the pointing devices 6.
[0078] Examples of transmission modules 6a and receiving modules 4a may be applicable to wi-fi® technologies, wired via USB, Bluetooth, or any other type using proprietary wired or wireless methods.
[0079] Preferably, moreover, the controller system 5 comprises at least one selector device 7 that can be associated with said processing unit 4 and configured to transform a command given by the user into an action of selecting or releasing said one or more virtual elements. Preferably, the selector devices 7 are physically, functionally and structurally distinct from the pointing devices 6.
[0080] Preferably, the controller system comprises a plurality of selector devices 7 which can be selectively associated with said processing unit 4.
[0081] More preferably, the plurality of selector devices 7 comprises at least one microphone 7b and a switch 7a selectively operable by the user.
[0082] The switch 7a is preferably defined by a push-button panel or joystick, which can be connected via cables using a short-range wireless protocol (e.g. wi-fi or bluetooth) to the processing unit 4, through which the user can enable the selection of a virtual element or its release.
[0083] According to an aspect of the present invention, the processing unit 4 is configured to initiate a cognitive exercise by displaying to the user, via said screen 3, a plurality of execution modes of said cognitive exercise.
[0084] “Execution mode” in this context intends to define the selection of the body part and the type of signal with which the user wishes to perform the cognitive exercise; given a single exercise, in fact, which is displayed virtually unchanged on the screen, the user has the possibility of performing it in reality in different modes, by means of different pointing devices 6 (possibly also selectors 7), in order to follow a dedicated rehabilitation path.
[0085] Preferably, the execution modes comprise two or more of the following options:
[0086] - pointing by moving an upper limb;
[0087] - pointing by moving a lower limb;
[0088] - pointing by moving the pelvis;
[0089] - pointing by moving the head;
[0090] - pointing by moving the eyes;
[0091] - pointing by moving the load on a static sensor-equipped platform to detect the centre of pressure;
[0092] - pointing by moving the load on an unstable platform so as to change its orientation in space.
[0093] The user, by means of a control device (not illustrated), e.g. a mouse or a touch screen, sends the processing unit a signal representative of the selected mode and, at this point, the processing unit 4 is preferably configured to identify one or more pointing devices 6 compatible with that execution mode.
[0094] Preferably, therefore, a predetermined number of compatible pointing devices 6 corresponds to each execution mode of the cognitive exercise.
[0095] It is indeed possible that some pointing devices are incompatible with certain modes, e.g. if the user chooses to perform the exercise with pointing by eye movement, in which case wearable pointing devices 6 such as accelerometers or magnetic sensors are incompatible.
[0096] Once it has been determined which pointing devices 6 are compatible with the chosen mode, the processing unit 4 is configured to enable a single pointing device 6 among those connected to the apparatus 1 .
[0097] This enablement is preferably performed according to a pre-set priority, determined e.g. by a user history or a pre-set sequence by the manufacturer.
[0098] Alternatively, the processing unit 4 could display to the user, again via the screen 3, the pointing devices 6 compatible with the chosen execution mode and available, offering the possibility to make an arbitrary selection, e.g. via the control device 8.
[0099] In this case, therefore, the enablement of the individual pointing device 6 is performed by the processing unit 4 according to a preference expressed by the user.
[0100] It should be noted that in the following the enabled pointing device 6 will sometimes be identified as “single pointing device 6”.
[0101] The processing unit 4 is also configured to enable the selector device 7.
[0102] In the preferred embodiment, as mentioned above, there is more than one selector device 7 and the processing unit 4 is preferably configured to identify and enable a single selector device 7 in a manner similar to that just described for the pointing devices 6.
[0103] In other words, the processing unit 4 is configured to enable a single selector device 7 according to a pre-determined priority, determined, for example, according to a user history or a sequence pre-set by the manufacturer, or according to a preference expressed by the user.
[0104] It should be noted that in the following the enabled pointing device 6 or selector device 7 will sometimes be identified as a “single pointing device 6” or “single selector device 7”, or as “enabled pointing device 6” or “enabled selector device 7”. The enabled pointing device 6 and enabled selector device 7 are physically distinct from each other.
[0105] According to an aspect of the invention, once the single pointing device 6 and the (single) selector device 7 are enabled, the control unit 4 is configured to configure the enabled single pointing device 6 and / or the (single) selector device 7 according to the user's conditions.
[0106] In a first option, this configuration is carried out by initiating a calibration procedure for the enabled pointing device 6 and / or selector device 7 (i.e. for the single pointing device 6 and / or the single selector device 7).
[0107] Alternatively, the processing unit 4 is arranged to configure the single pointing device 6 and / or single selector device 7 according to a preexisting configuration associated with that user.
[0108] Preferably, if there is a pre-existing configuration associated with the user, the processing unit 4 is configured to present the user with a choice between adopting said pre-existing configuration or performing the calibration procedure.
[0109] Advantageously, in this way the apparatus is not only able to provide the facility with maximum versatility in the way the exercise is performed, but is also able to adapt its response to the specific conditions of the user within his or her rehabilitation pathway.
[0110] Preferably, the calibration procedure of the (single) pointing device 6 comprises requesting the user to position the pointing device 6 in a first limit position and a second limit position opposite the first one along a first operating direction.
[0111] The first and second limit positions thus depend on the user's ability to move;
[0112] Preferably, the processing unit 4 is configured to classify as first and second limit positions the positions in which the user places the pointing device (i.e. the body part associated with it), assuming that the user actually places the body part by making maximum use of his or her ability to move. Preferably, the first and second limit positions are defined by one or more of the following alternatives:
[0113] - kinematic orientation variables according to intrinsic Euler angles;
[0114] - space position variables;
[0115] - eye-tracking variables;
[0116] - anterior-posterior or latero-lateral tilt variables;
[0117] - centre-of-pressure defining variables;
[0118] - muscle activation variables of one or more muscle groups;
[0119] - variables of flows and volumes in expiration or inspiration;
[0120] - volume variables;
[0121] - frequency variables;
[0122] - pressure and traction variables and metrics.
[0123] The “first operating direction” may correspond to a linear axis, but also to a rotational degree of freedom or a combination of the two, depending on the type of movement required by the application.
[0124] At this point, the processing unit 4 is configured to detect the coordinates, along said first operating direction, of the first limit position and the second limit position.
[0125] In other words, the processing unit 4, via the receiving module 4a, is configured to receive the signal sent by the transmission module 6a of the single pointing device 6 once the first or second limit position has been reached.
[0126] In the preferred embodiment, the processing unit 4 is configured to determine the limit position according to a logic of detecting the maximum or minimum position assumed by the pointing device 6 along the first operating direction.
[0127] In a preferred embodiment, the request to position the pointing device 6 at the first limit position and at the second limit position, and the consequent detection of the coordinates of these positions, is repeated at least twice.
[0128] In this embodiment, the processing unit is thus configured to determine the co-ordinates of the first limit position and the second limit position along the first operating direction as a function of the values measured in response to each request.
[0129] Preferably, the co-ordinates of the first limit position and the second limit position are determined as the average, or weighted average, of the values measured in response to each request.
[0130] Alternatively, however, the processing unit 4 could be configured to implement other logics, for example by determining the coordinates of the first limit position and the second limit position along the first operating direction as those of the maximum and minimum positions assumed by the single pointing device.
[0131] Note that the expressions “maximum” and “minimum” are used in this text to define the extreme values that a coordinate takes along a direction, evaluated for simplicity as a maximum and minimum on a numbered scale. Once the co-ordinates of the first and second limit positions have been determined, the processing unit 4 is configured to calibrate a stroke of the virtual element on the screen 3, along a first virtual direction corresponding to said first operating direction, as a function of a distance between the first and second limit positions assumed by the pointing device 6.
[0132] In other words, the range of movement of the virtual on-screen element is configured according to the actual user's ability to move, thus allowing the same exercise to be successful even starting from different mobility conditions.
[0133] Preferably, the calibration procedure also involves determining the coordinates of two other limit positions along a second operating direction, transverse (preferably orthogonal) to the first.
[0134] In more detail, preferably, the calibration procedure of the (single) pointing device 6 comprises:
[0135] - asking the user to position the pointing device 6 in a third limit position and a fourth limit position opposite the third along the second operating direction, wherein the third and fourth limit positions are a function of the user's ability to move; - taking the coordinates, along the second operating direction of the pointing device, of the third limit position and the fourth limit position;
[0136] - calibrating a stroke of the virtual element on the screen, along a second virtual direction corresponding to said second operating direction, as a function of a distance between the third and fourth limit position assumed by the pointing device.
[0137] Also in this case, preferably, the request to position the pointing device 6 at the third limit position and at the fourth limit position, and the consequent detection of the coordinates of these positions, is repeated at least twice.
[0138] According to a further aspect of the present invention, the processing unit 4 is preferably configured to also perform a calibration procedure of the selector device 7.
[0139] This calibration procedure involves asking the user to make a selection by means of an action involving the enabled selector device 7.
[0140] Such an action may be, for example, the issue of a predefined voice command, if the selector device 7 is a microphone, or pressing a button or lever, if the selector device 7 is a switch (example shown schematically in the figure).
[0141] It is therefore provided to detect a level of force and / or pressure and / or volume of the action performed by the user.
[0142] In the case of a voice command, the processing unit 4 detects the sound volume or acoustic intensity, for example, as well as, preferably, the composition of the sound, allowing the user to define not only the sound level but also the type of command.
[0143] Alternatively, the force with which the user is able to press or move the switch (button or lever) can be detected.
[0144] The control unit, therefore, calibrates the enabling of the selection command, depending on a value of said force and / or pressure and / or volume level detected.
[0145] In other words, for the same virtual input (i.e. selection or deselection of the virtual element), the level of action required at the “real” level can be subjectively differentiated according to the user's level of autonomy.
[0146] Once the pointing device 6 and selector device 7 are calibrated, the configuration is correlated to the user profile and saved to a memory card (or cloud).
[0147] This allows the same configuration to be available in a subsequent training session without the need for re-calibration of the devices, a feature that is particularly useful in the case of short intervals between one session and the next.
[0148] In this regard, however, it should be noted that preferably the processing unit 4 is configured to activate a movement compliance verification process during the performance of said cognitive exercise.
[0149] Preferably, therefore, the control unit 4 is configured to verify a success rate in achieving said target goal(s) and to compare said success rate with one or more threshold values.
[0150] Indeed, being a virtual interaction apparatus for rehabilitation purposes, the control unit 4 is preferably programmed (or trained) to expect a target attainment rate that starts low and tends to increase as rehabilitation progresses.
[0151] Any inconsistencies in this respect lead to the conclusion that the rehabilitation process is not progressing properly.
[0152] The processing unit 4 is thus configured to monitor said rate of attainment, comparing it with threshold values (predefined or set) which may be point values or defined by a range, or even by functions containing variables.
[0153] If too high or too low a rate of attainment is detected, the processing unit 4 is configured to initiate calibration procedures in order to re-calibrate the pointing device 6 and selector device 7.
[0154] If the rate of attainment is too high, in fact, it can be assumed that the user's level of cognitive or movement ability is too high compared to the calibration of the devices, which will therefore be re-calibrated to require larger, stronger or faster movements. On the contrary, if the success rate is too low, initiating the calibration procedure could make it possible to reduce the difficulty of the exercise in terms of amplitude and force of the movements.
[0155] The processing unit 4 is in fact configured to initiate the calibration procedure of the single pointing device 6 (and / or the selector device 7) if said rate of attainment exceeds a maximum threshold value and / or is below a minimum threshold value.
[0156] The invention achieves its intended purposes and attains important advantages. In fact, thanks to its calibration and monitoring functions, the apparatus of the invention allows the facility hosting it to provide a multiplicity of alternatives that can be adapted to the individual needs of the user / patient, guiding them during their rehabilitation process in order to optimise their recovery time.
Claims
CLAIMS1. A virtual interaction apparatus, comprising:- a display screen (3) that can be viewed by a user;- a processing unit (4) configured to generate and display, via said screen (3), at least one cognitive exercise which provides to select and move one or more of the virtual elements (VEs) displayed on the screen (3) in order to achieve one or more target goals;- a controller system (5), comprising: a plurality of pointing devices (6) that may be selectively associated with said processing unit (4) and configured to transform a movement of a part of the user's body into a corresponding movement of said one or more virtual elements (VEs) on said screen (3); at least one selector device (7) that may be associated with said processing unit (4) and configured to transform a command given by the user into an action of selecting or releasing said one or more virtual elements (VEs); wherein said processing unit (4) is configured to:- display to the user, via said screen (3), a plurality of execution modes of said cognitive exercise;- identify one or more pointing devices (6) compatible with an execution mode selected by the user;- enable a single pointing device (6) according to a pre-set priority and / or according to a preference expressed by the user;- enable the selector device (7);- configure said single enabled pointing device (6) and / or said enabled selector device (7) according to the user's conditions, by: o initiating a calibration procedure for said single enabled pointing device (6) and / or for said enabled selector device (7), or o configuring said single enabled pointing device (6) and / orsaid enabled selector device (7) according to a pre-existing configuration associated with said user.
2. Apparatus according to claim 1 , wherein said execution modes comprise two or more of the following options:- pointing by moving an upper limb;- pointing by moving a lower limb;- pointing by moving the pelvis;- pointing by moving the head;- pointing by moving the eyes.
3. Apparatus according to claim 1 or 2, wherein said calibration process of the single pointing device (6) comprises:- requesting the user to position the single pointing device (6) in a first limit position and a second limit position, opposite the first along a first operating direction, wherein the first and second limit positions are a function of the user's ability to move;- detecting the coordinates, along said first operational direction of the single pointing device (6), of the first limit position and the second limit position;- calibrating a stroke of the virtual element (VE) on the screen (3), along a first virtual direction (A) corresponding to said first operating direction, as a function of a distance between the first and second limit position assumed by the single pointing device (6).
4. Apparatus according to any one of the preceding claims, wherein said calibration procedure of the single pointing device (6) comprises:- requesting the user to position the single pointing device (6) in a third limit position and a fourth limit position, opposite the third along a second operating direction, where the third and fourth limit positions are a function of the user's ability to move;- detecting the coordinates, along said second operating direction of the single pointing device (6), of the third limit position and the fourth limit position;- calibrating a stroke of the virtual element (VE) on the screen (3), along a second virtual direction corresponding to said second operating direction, according to a distance between the third and fourth limit positions assumed by the single pointing device (6).
5. Apparatus according to claim 3 or 4, wherein the first and second operating directions are orthogonal to each other.
6. Apparatus according to claim 3 or 4, wherein the first and second limit positions are defined by one or more of the following alternatives:- kinematic orientation variables according to intrinsic Euler angles;- space position variables;- eye tracking variables;- anterior-posterior or latero-lateral tilt variables;- centre-of-pressure defining variables;- muscle activation variables of one or more muscle groups;- variables of flows and volumes in expiration or inspiration;- volume variables;- frequency variables;- pressure and traction variables and metrics.
7. Apparatus according to any one of the preceding claims, wherein the calibration procedure of the selector device (7) comprises:- requesting the user to make a selection by means of an action involving the selector device (7);- detecting a level of force and / or pressure and / or volume of the action performed by the user;- calibrating a selection command enablement, according to a detectedvalue of said force and / or pressure and / or volume level.
8. Apparatus according to any one of the preceding claims, wherein said processing unit (4) is configured to activate a movement compliance verification process during the performance of said cognitive exercise.
9. Apparatus according to claim 8, wherein said movement compliance verification process provides to:- verify a rate of attainment of said one or more targets;- compare said rate of attainment with one or more threshold values;- initiate said procedure of calibrating the single pointing device (6) if said rate of attainment exceeds a maximum threshold value and / or is below a minimum threshold value.
10. Apparatus according to any one of the preceding claims, wherein said plurality of pointing devices (6) comprises two or more of the following devices:- wearable inertial sensors;- cameras;- rgbd cameras;- optical systems;- eyetracking devices;- sensor-equipped platform, e.g. equipped with load cells and detecting the centre of pressure;- unstable mobile platform equipped with devices adapted to assess realtime orientation in space thereof;- electromyographs;- spirometry devices;- magnetic sensors.11 . Apparatus according to any one of the preceding claims, comprising aplurality of selector devices (7) that may be selectively associated with said processing unit (4) and enabled by said processing unit (4) according to a predetermined priority and / or according to a preference expressed by the user.
12. Apparatus according to claim 11 , wherein said plurality of selector devices (7) comprises at least one microphone and a switch selectively operable by the user.
13. Apparatus according to any one of the preceding claims, wherein said enabled pointing device (6) and said enabled selector device (7) are physically distinct from each other.
Citation Information
Patent Citations
Control system including an adaptive motion detector
US20060166620A1
Virtual and real object recording in mixed reality device
US20180246698A1
System, method and apparatus for treatment of neglect
US20180336973A1
Virtual reality activities for various impairments
US20230038695A1
Content movement and interaction using a single controller
US20230214015A1