Rehabilitation support system

The rehabilitation support system uses MR images and familiar objects to safely apply physical loads, addressing safety and motivation challenges in remote rehabilitation by improving measurement accuracy and user interaction, facilitating effective motor function rehabilitation.

JP2025011687AActive Publication Date: 2025-01-24UNIVERSITY OF TOYAMA
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2023113941
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-11
Publication Date
2025-01-24
Estimated Expiration
2043-07-11

AI Technical Summary

Technical Problem

Existing rehabilitation methods face challenges in maintaining motivation and safety, particularly in remote settings, as they lack devices that provide physical loads on the body while ensuring user safety, especially for motor function rehabilitation.

Method used

A rehabilitation support system using MR images that project familiar objects like desks and walls, incorporating markers and an image generation device to accurately measure and display MR images, ensuring safe physical interaction by determining the position of body parts and markers relative to these objects.

Benefits of technology

Enables safe and effective motor function rehabilitation at home by applying physical loads using familiar objects, enhancing measurement accuracy and user interaction with MR images, thereby improving rehabilitation outcomes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025011687000001_ABST
    Figure 2025011687000001_ABST
Patent Text Reader

Abstract

To provide a rehabilitation support system that can impart physical load on a body using an object that is familiar to a user while taking safety into account.SOLUTION: A rehabilitation support system using an MR image includes: an image generation device for generating and displaying an MR image; and a marker for controlling projecting at least part of the MR image on an object.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a rehabilitation support system. [Background technology]

[0002] Motor function rehabilitation (hereafter referred to as rehabilitation) is carried out manually in specific facilities under the guidance of doctors, physical therapists, occupational therapists, etc., and rehabilitation equipment has been used to apply load to the rehabilitation subject and assist with exercise. However, maintaining motivation during rehabilitation can be difficult, and current infection control measures have made it difficult to travel to specific facilities or use equipment frequently.

[0003] Patent Documents 1 and 2 propose devices for rehabilitating higher brain dysfunction using virtual images. By using virtual images, it becomes easier to create an environment where rehabilitation can be enjoyed, and it also becomes easier to realize rehabilitation in remote locations, such as at home. However, it is not easy for individuals to have dedicated equipment that applies physical stress to the body for the rehabilitation of motor functions, and the safety that medical professionals have taken into consideration is also important when it comes to rehabilitation using virtual images. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent No. 7029717 [Patent Document 2] Patent No. 6768231 Summary of the Invention [Problem to be solved by the invention]

[0005] An object of the present invention is to provide a rehabilitation support system that can apply a physical load to the body using everyday objects and that takes safety into consideration. [Means for solving the problem]

[0006] A rehabilitation support system according to the present invention is a rehabilitation support system using MR images, and includes an image generating device that generates and displays MR images, and a marker for controlling the projection of at least a portion of the MR images onto an object. The target object refers to a familiar object, which is difficult to move from the viewpoint of safety, and may be one or more selected from the group consisting of a desk, a wall, and a floor. When a user undergoing rehabilitation consciously tries to touch the MR image projected onto the object, their body parts tend to come into contact with the object, and contact with the object creates a repulsive force, which becomes a physical load.

[0007] In the present invention, the image generating device may have a measurement unit that measures the position of a body part of a user attempting to touch the object and a marker on the object, and an acquisition unit that acquires offset information from information on the user's body part and the marker. For example, when using an infrared camera positioned above to detect a hand positioned below, it is known that if the hand is too close to the desk surface, it cannot be reliably separated from the desk (see, for example, Grushko, S., et al., Analysis of Precision and Stability of Hand Tracking with Leap Motion Sensor, Sensors, 2020, 20(15), 4088.). When trying to measure the position of a hand or other object on an object by measuring the reflected light from an infrared LED or similar device, unwanted reflections from the object can cause errors in measuring the distance to the body part or object, and these errors are also affected by environmental conditions such as temperature, humidity, and lighting. Furthermore, even when using angular velocity sensors, acceleration sensors, magnetic sensors, etc., the relative position of a hand or other object is affected by the absolute position of each sensor located on the user's head, and correction is necessary as errors accumulate little by little, so the measurement accuracy is not necessarily high. However, in repeated rehabilitation, in order to receive an appropriate repulsive force from the object while taking safety into consideration, it is important to accurately recognize the position of the object each time. Therefore, the present invention aims to recognize the position of an object more accurately and simply by measuring the position of a marker on the object in addition to the body part of the user attempting to touch the object, and obtaining offset information using the position coordinates of the user's body part and the marker. For example, if the marker is made of a material with low reflectivity, the position may be measured using an infrared camera, or distance information may be obtained from the parallax of images taken by multiple visible light cameras.

[0008] In the present invention, the image generating device may have a display control unit that controls the display of the MR image, and the display control unit may utilize offset information. By using the offset information, the MR image can be projected more accurately onto the object. The image generating device may further include a determination unit that determines whether a body part of the user has touched an MR image, and the determination unit may utilize offset information. This makes it possible to accurately determine whether an MR image has been touched, which, for example, improves the accuracy of quantifying the distance a body part can be moved and of assessing rehabilitation. Effect of the Invention

[0009] According to the present invention, even if dedicated rehabilitation equipment is not available, it is possible to apply physical stress to the body using everyday objects, and motor function rehabilitation can be safely performed while having fun using MR images, and it can be easily performed at home, etc. [Brief description of the drawings]

[0010] [Figure 1] 1 shows a rehabilitation support system according to an embodiment, in which (a) shows an example in which the object is a desk, and (b) shows an example in which the object is a wall. [Diagram 2] FIG. 1 is a block diagram showing an example of the configuration of an image generating device. [Diagram 3]13 is a flowchart illustrating an example of processing performed by the image generating device. [Figure 4] An image of rehabilitation using rehabilitation application example 1 is shown. [Diagram 5] An image of rehabilitation using rehabilitation app example 2 is shown. [Figure 6] An image of rehabilitation using rehabilitation app example 3 is shown. [Figure 7] An image of rehabilitation using rehabilitation application example 4 is shown. [Figure 8] An image of rehabilitation using rehabilitation app example 5 is shown. [Figure 9] An image of rehabilitation using rehabilitation app example 6 is shown. [Figure 10] An image of rehabilitation using rehabilitation application example 7 is shown. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] The rehabilitation support system using MR (Mixed Reality) images includes an image generating device 1 that generates and displays MR images, and a marker 2 that controls the projection of at least a portion of the MR image onto an object 3, as shown in FIG.

[0012] The rehabilitation support system according to the present invention is preferably used in particular for rehabilitation of motor functions. Rehabilitation of motor function is useful, for example, for elderly people with weakened muscles, and for patients with central nervous system diseases (such as stroke and Parkinson's disease) and musculoskeletal diseases (such as spinal cord injury, joint disease, and tendon rupture) who have impaired motor function. In this specification, the term "user" refers to a person undergoing rehabilitation. In VR (Virtual Reality), which immerses the user in a virtual space, visual information from the real world is blocked, making it easy for the user to lose balance and experience dizziness, nausea, and other symptoms of so-called VR sickness. However, in MR, which projects two-dimensional or three-dimensional images into the real space, it is easy to carry out rehabilitation that takes into consideration the safety of the user.

[0013] In this specification, the term "body part" refers to a part that can be viewed through the display unit 12 of the image generating device 1, which will be described later, and that is recognized by the detection unit 13. For example, the user's body part may be the fingers, the palm, the back of the hand, the wrist, etc. The rehabilitation site may be the same as or different from the user's body site. For example, the rehabilitation site of the user may be the fingers, palm, back of the hand, wrist, forearm, elbow, upper arm, shoulder, or a combination thereof. Because no sensors or other devices are attached to the body parts that would interfere with gripping or moving the controller, it is easy to perform palmar flexion and dorsiflexion of the wrist, collectively flexion and extension of the fingers, and flexion and extension of each finger. It can also be used for rehabilitation of the shoulder joint, elbow joint, forearm, etc., with the fingers extended. In this specification, information on a body part of a user may include basic information such as the size of the body part in addition to the position information of the body part of a user.

[0014] The target object 3 is a familiar object found in the home, and from the viewpoint of safety, it is preferable for the target object 3 to be a desk, wall, floor, or the like that is difficult to move. For example, as shown in FIG. 1(a), the object may be a desk 3a and the user may perform rehabilitation while sitting on a chair, bed, or floor, or as shown in FIG. 1(b), the object may be a wall 3b and the user may perform rehabilitation while sitting on a chair or standing. For example, if a user has a movement disorder in their right fingers, they can place their right forearm on a desk and use their movable left hand to assist the right fingers. By using the object 3 to assist with the movement, the user can easily undergo rehabilitation safely even if there is no assistant such as a medical professional nearby.

[0015] The position of the marker 2 can be detected using the image generating device 1. For example, in addition to one-dimensional barcodes, two-dimensional barcodes, NFC tags, RFID tags, etc., small household items (e.g., pens, sticky notes, etc.) may function as markers as long as their position can be measured when placed on the target object 3. Figure 1(a) shows an example in which a thin paper-like, sheet-like, or sticker-like marker (e.g., a two-dimensional barcode) 2a is placed on an object 3, but the marker may also be a barcode displayed on an electronic device (screen) such as a smartphone. In this specification, the information on the marker preferably includes basic information such as the type and size of the marker in addition to the position information of the marker. As will be described later, by using the position information and basic information of the markers, the surface distance of the object 3 can be determined more accurately. Furthermore, as shown in FIG. 1(a), a rehabilitation mat 2b whose cushioning property, resilience, etc. are adjusted may have a marker function. For example, a barcode may be attached onto the rehabilitation mat 2b. Here, the rehabilitation mat 2b refers to "an object that is placed on the object 3 and used to carry out rehabilitation on it", and from a safety standpoint, it is preferable that it is difficult for it to move from the object 3 (for example, by providing an anti-slip surface or sticker on the underside). In addition, when rehabilitation is performed on a rehabilitation mat, "on the object" refers to "on the rehabilitation mat." As another example, the marker 2 may be transferred from a body part to the target object 3 by attaching a transfer material (e.g., a transfer sticker, transfer sheet, ink, etc.) to a body part of a user and touching the transfer material onto the target object 3.

[0016] The image generating device 1 is a head-mounted display (MR device) that can be worn on the head of a user, and may be, for example, HoloLens (registered trademark) or the like. As shown in Figure 2, the device includes a control unit 11, a display unit 12, a detection unit 13, a memory unit 14, a communication unit 15, and an audio input / output unit 16, and this embodiment is an example in which the functions implemented in the control unit 11 include a measurement unit 17, an acquisition unit 18, a display control unit 19, a judgment unit 20, and a proposal unit 21.

[0017] The control unit 11 includes a processor such as a CPU or a GPU, and controls the operation of the image generating device 1 as a whole.

[0018] The display unit 12 is a see-through, light-transmitting display, such as a glasses-type display in HoloLens (registered trademark).

[0019] The detection unit 13 includes a visible light camera, a near-infrared camera, a depth sensor (e.g., a ToF type), an angle sensor, an acceleration sensor, a geomagnetic sensor, a temperature sensor, etc., and detects the position and movement of the head of a user wearing an MR device, the positions and movements of body parts, and the positions of markers. In addition, the spatial mapping function, which requires multiple movements around the space to be measured and takes time, is preferably not used from the standpoint of safety and convenience for the user undergoing rehabilitation, and is not used in this embodiment. In addition to a hand tracking function using an infrared camera, etc., an eye tracking function for detecting the position of the user's pupils and irises may also be provided. For example, hand tracking and eye tracking may be used to input operations of the image generating device 1, basic information about markers and the user's body parts, etc.

[0020] The storage unit 14 stores programs, rehabilitation applications, basic information about markers, and the like. For example, a new rehabilitation application may be added to the storage unit 14 via the communication unit 15 described later. In addition, usage history information of the user's use of services provided by the rehabilitation assistance system, setting information tailored to the user, etc. may be stored.

[0021] The communication unit 15 is connectable to a network, and is capable of transmitting and receiving data to and from an external device (for example, a server or a terminal device (computer, smartphone, etc.)) via the network. In addition, basic information about the markers and the user's body parts may be input using an external device, and may be input by an assistant or other person other than the user. The input information also includes user information such as the user's height (arm length, leg length, etc.), gender, and age.

[0022] The voice input / output unit 16 includes a microphone and a speaker, and input operations may be performed by voice. It is preferable that various sounds are output, such as the start sound of a rehabilitation app and sounds of reactions to the user's actions.

[0023] The measurement unit 17 uses the detection unit 13 to measure the position of the body part of the user attempting to touch the object 3 and the position of the marker 2 . For example, when using reflection caused by infrared LED irradiation or the like, errors are likely to occur in the position information of a body part in the facing direction of the image generating device 1 equipped with the detection unit 13 and the target object 3, which is called the "error direction." In FIG. 1(a), the error direction is the Z-axis direction (up and down between the image generating device 1 and the desk 3a), and in FIG. 1(b), the error direction is the X-axis direction (front and back between the image generating device 1 and the wall 3b). Therefore, it is preferable to measure the three-dimensional coordinates of the body part of the user who is about to touch the object 3 and at least the error direction coordinates of the marker 2 on the object 3. In FIG. 1(a), this is the error direction coordinate (Z0) of marker 2, and in FIG. 1(b), this is the error direction coordinate (X0). Hereinafter, t is time, and the three-dimensional coordinates of the user's body parts (e.g., fingertips and joints (DIP joints, PIP joints, MP joints, IP joints), metacarpals, wrists, etc.) are expressed as (Xt, Yt, Zt), and the three-dimensional coordinates of marker 2 are expressed as (X0, Y0, Z0). For convenience, the object in FIG. 1(a) is a desk 3a, and the error direction coordinate (Z0) of the marker 2 is taken as an example for explanation, but the present invention is not limited to this.

[0024] The acquisition unit 18 acquires offset information for projecting an MR image onto the object 3 from the information on the user's body part and the markers 2 . Using the position coordinates (position information) of the user's body part and the marker 2, for example, the Z coordinate (Zt) of the MP joint of the index finger touching the object 3 obtained by the measurement unit 17 and the error direction coordinate (Z0) of the marker 2 are calculated as follows:<Z0であれば「Zt=0」、Zt> If Z0, the offset is "Zt-Z0=ΔZ". If the error direction is in the X-axis direction, it can be expressed as Xt - X0 = ΔX, and if it is in the Y-axis direction, it can be expressed as Yt - Y0 = ΔY. Also, the basic information of the marker may be included in the offset information. When rehabilitation is not performed on marker 2 (for example, a rehabilitation mat), in order to more accurately obtain the surface distance of the object 3, among the basic information of the marker, the dimension in the error direction of the marker (the dimension in the Z-axis direction in Fig. 1(a) (hereinafter referred to as the Z width)) can be included in the offset. In this case, if Zt < Z0, "the Z width of the marker" may be the offset, and if Zt > Z0, "ΔZ + the Z width of the marker" may be the offset.

[0025] The display control unit 19 controls the display of the MR image on the display unit 12 based on the offset information. For example, if Zt < Z0, Zt = 0, and if Zt > Z0, the Z coordinate (error direction coordinate) of the MR image is determined by subtracting ΔZ. Also, if Zt > Z0, by subtracting ΔZ and further subtracting the Z width of marker 2, it becomes possible to perform display control along the surface of object 3 more. Note that the "MR image" may include an auxiliary object in addition to the target object T that is projected substantially along the surface of the object 3. Examples of the auxiliary object include, for example, an instruction object such as a rehabilitation instruction, time, score, etc., an obstacle object D that restricts the movement direction of the rehabilitation site, an area object E that is the goal point or the movement area of the rehabilitation site, a marker object projected along marker 2, a body part object B projected along the user's body part, etc. For example, after measuring the three-dimensional coordinates (X0, Y0, Z0) of marker 2, a marker object may be projected so as to overlap marker 2. Also, a body part object B may be displayed so as to overlap the user's body part (for example, fingertip, joint, middle phalanx, wrist, etc.), and the display size may be adjusted based on the offset information. Note that the target object T is preferably a target for the user to move the rehabilitation site, and the display control unit 19 can control the display of the MR image according to the orientation of the user's head using the tracking information acquired by the detection unit 13.

[0026] The determination unit 20 determines that the user's body part has touched the MR image (particularly, the target object T) based on the offset information. When the target object T is projected substantially along the surface of the marker 2, its Z width can be expressed as (Ztop - Z0), and when it is projected substantially along the surface of the target object 3, it can be expressed as {Ztop - (Z0 + Z width of the marker)}. For example, if the Z width of the target object T is (Ztop - Z0) and the Z coordinate (Zt) of the MP joint of the index finger moved toward the target object T is Zt < Z0, then it is set to "Zt = 0", and if Zt > Z0, then "Zt - Z0 = ΔZ < Ztop", which means that the MP joint of the index finger is located within the Z-axis dimension of the target object T. By combining the information of the X and Y coordinates with the information of the above Z coordinate, it can be determined that the body part has touched the target object T. By using the offset information, the movable distance of the body part can be obtained more accurately. For example, by sharing information with medical staff or the like via the communication unit 15, the rehabilitation evaluation becomes easier to quantify. For example, if the Z coordinate (Zt) - ΔZ of the body part is approximately equal to the Z0 value, it can also be determined that the body part has contacted the target object 3.

[0027] The proposal unit 21 may select and propose the following rehabilitation application to the user. During the rehabilitation execution, for example, if the Z coordinate (MPZt) of the MP joint, which is the base of the finger, approaches the Z0 value, it can be determined that "the finger is extended", and if the state of being away from the Z0 value continues, it can be determined that "there is a high possibility that it is difficult to extend the finger". In order to prevent the user's rehabilitation from becoming suddenly difficult, the suggestion unit 21 may suggest, for example, a "rehabilitation app that stretches the fingers" to a user whose Z coordinate (MPZt) is approaching the Z0 value, and a "rehabilitation app that can be used without stretching the fingers" to a user whose Z coordinate (MPZt) continues to be away from the Z0 value.

[0028] In addition to the selection of a rehabilitation application by the suggestion unit 21, the user, an assistant, or the like may select the next rehabilitation application. There is no particular limit to the type of rehabilitation application, but for example, the application may be selected from a plurality of rehabilitation applications classified into "rehabilitation actions" and "movement of target object T". "Rehabilitation movements" include, for example, "lightly touching a body part to a target object 3 (target object T)," "sliding over the target object 3 as if pinching or flicking it," "moving the target object 3 in the error direction as if tapping it," and "rotating the wrist or other part while touching the target object 3." Examples of "movement of the target object" include "target object T is stopped at a predetermined position," "target object T moves toward the user's body part," "target object T moves away from the user's body part," "target object T appears due to the movement of the user's body part," "target object T is moved by the movement of the user's body part," etc.

[0029] FIG. 3 is a flowchart showing an example of processing performed by the image generating device 1. In step S1, the position of the marker 2 is measured after the position (absolute position) of the user's head is measured. Next, in step S2, the position of the body part of the user that is about to touch the object 3 is measured. In this case, for example, if the rehabilitation area is a finger, palm, back of the hand, wrist, etc., the fingers can be opened and closed while touching the target object 3 with the wrist, etc., and if the rehabilitation area is a forearm, elbow, upper arm, etc., the hand can be moved back and forth, left and right, up and down so that the entire hand is touching the target object 3, and relative position information can be stored. Offset information for projecting the MR image onto the object 3 is obtained. In addition, there is no restriction on the timing of inputting basic information about markers and user body parts, so long as it is done before the offset information is acquired. In addition, before measuring the position of a body part, a screen may be displayed to the user or assistant to select a rehabilitation part, etc., and the selection of rehabilitation apps may be narrowed down in accordance with the selection, as well as the instruction object and rehabilitation difficulty level (size of target object T, moving speed, moving direction, rehabilitation time, etc.). Rehabilitation begins by executing a rehabilitation start instruction on the rehabilitation app. During the rehabilitation in step S3, the MR image is displayed based on the offset information, and the target object T is repeatedly displayed and judged, particularly while judging whether the target object T has been touched. At this time, a score may be displayed. After rehabilitation is completed, a recommended rehabilitation app may be suggested for the next rehabilitation session. In this case, in addition to suggesting a rehabilitation app, different rehabilitation instructions (e.g., "Next time, touch with your little finger, not your index finger") may be suggested within the rehabilitation app.

[0030] Below, a specific example of a rehabilitation app will be given. Rehabilitation application examples 1 to 6 (FIGS. 4 to 9) are described using a desk 3a as the target object, and rehabilitation application example 7 (FIG. 10) is described using a wall 3b as the target object, but the present invention is not limited to this.

[0031] FIG. 4 shows an image of rehabilitation using the rehabilitation application example 1. For example, a rehabilitation action may be classified as "lightly touching the target object," and a movement of the target object may be classified as "the target object stops at a predetermined position." The target object T1 is projected along the desk 3a in the real space. In this embodiment, the target object T1 is an image that resembles a ball or a soap bubble (hereinafter, referred to as a bubble T1), but is not limited to this. Figures 4(a) to (c) show the field of view seen by a user wearing the image generating device 1, and show an example in which the right forearm is placed on a desk 3a and the movable left hand is used to assist the right hand with a motor disability. For example, by moving the right forearm along the desk 3a, it is easy to assist with the left hand, and when the right hand is moved left and right toward the bubble T1 as shown in Figure 4(b), the judgment unit 20 judges that the fingertips, etc. have touched the bubble T1, and the bubble T1 disappears as shown in Figure 4(c). Bubble T1 is displayed repeatedly, during which time the user performs rehabilitation. There is no particular restriction on the position or size of the bubble T1 projected onto the desk 3a, and it may be displayed in accordance with the degree of difficulty of rehabilitation, etc.

[0032] FIG. 5 shows an image of rehabilitation using the rehabilitation application example 2. For example, a rehabilitation action is classified as "lightly touching a target object," and a movement of the target object is classified as "the target object moves toward a body part of the user." The target object T2 is an example of a ball, and as shown in FIGS. 5(a) to (c), the ball T2 moves along a desk 3a toward the user. For example, when the ball T2 moves from the front direction along the desk 3a toward the user, the user's body parts are prompted to move so as to receive the ball T2. For example, if a person has a movement disorder in the right wrist, the right wrist may be placed on the desk 3a and the back of the hand may be brought into contact with the ball T2 while rotating the right wrist with the left hand as an assist.

[0033] FIG. 6 shows an image of rehabilitation using the rehabilitation application example 3. For example, a rehabilitation motion is classified as "moving the target object in the error direction as if hitting it," and a movement of the target object is classified as "the target object remains stationary at a predetermined position." In this embodiment, the target object T3 is a piano. As shown in FIG. 6(a), after a piano T3 is displayed alongside a desk 3a, the color of any of the keys may change. As shown in FIG. 6(b), for example, when the middle finger of the right hand is the rehabilitation part, a body part object B (e.g., fingertip B) is placed on the middle finger. tip , PIP joint B PIP , MP joint B MP ) may be displayed. As shown in FIG. 6(c), the user is prompted to move the middle finger, which is the rehabilitation part, in the error direction (in this case, the up-down (Z-axis) direction) as if tapping the object 3. For example, when the judgment unit 20 judges that the keys of a piano, which is the target object, have been touched, the sound of the keys may be output from the audio input / output unit 16. By stimulating the sense of hearing in addition to the repulsive force from the target object 3, it is easy to give the user the sensation that the piano, which is the MR image, is in real space.

[0034] FIG. 7 shows an image of rehabilitation using the rehabilitation application example 4. For example, a rehabilitation motion is classified as "sliding over the target object as if picking it up," and a movement of the target object is classified as "the target object is moved by the movement of a body part of the user." In this embodiment, an area object E and a box T4, which is a target object, are projected along a desk 3a in real space. It may be a rehabilitation app that moves a body part (target object T4) by sliding it within an area object E while touching a desk 3a, but it may also be an app that projects an obstacle object D with a variable thickness (Z width) to encourage movement forward, backward, left, right, up and down in order to move the rehabilitation part (e.g., the forearm) in the vertical direction.

[0035] FIG. 8 shows an image of rehabilitation using the rehabilitation application example 5. For example, a rehabilitation action may be classified as "sliding on the target object as if bouncing it," and a movement of the target object may be classified as "the target object appears due to the movement of a body part of the user." In this embodiment, as shown in FIG. 8(a), the user touches the thumb and index finger of his / her left hand to the desk 3a while spreading the fingertips apart, and as shown in FIG. 8(b), a target object T5 appears along the desk 3a approximately between the fingers. As shown in Figure 8(c), by touching the target object T5 with the right hand in a tracking manner, the difficulty of rehabilitation can be self-adjusted by moving the left hand.

[0036] FIG. 9 shows an image of rehabilitation using the rehabilitation application example 6. For example, a rehabilitation action may be classified as "rotating a wrist or the like while touching a target object," and a movement of a target object may be classified as "the target object is moved by the movement of a body part of the user." In this embodiment, an area object E is projected along a desk 3a, but is an image that has a cylindrical thickness, and the target object T6 that the user is touching is moved so as to fit within the area object E, as shown in Figure 9(a). In the example of FIG. 9, the user rotates while touching the object 3 with the wrist or the like, which is useful for rehabilitation of the wrist or the like. After the area object E disappears as shown in FIG. 9(c), the area object E and the target object T6 may be made to appear in response to the movement of the user's body part, as in the rehabilitation application example 5.

[0037] FIG. 10 shows an image of rehabilitation using the rehabilitation application example 7. The rehabilitation action is classified as "lightly touching the target object," and the movement of the target object is classified as "the target object moves toward a body part of the user." The target object T7 is an example of a cup, and as shown in FIGS. 10(a) to (c), the cup T7 moves toward the user along a wall 3b in real space. For example, by preventing cup 7 from moving in the front-back (X-axis) direction, the user can move his / her forearm, upper arm, shoulder, etc. up / down and left / right while keeping the palm of his / her hand along wall 3b.

Claims

1. A rehabilitation support system using MR images, comprising: A rehabilitation support system comprising: an image generating device that generates and displays an MR image; and a marker for controlling the projection of at least a portion of the MR image onto an object.

2. The rehabilitation support system according to claim 1, wherein the image generating device has a measurement unit that measures the position of a body part of a user attempting to touch the object and a marker on the object, and an acquisition unit that acquires offset information from information of the user's body part and the marker.

3. The rehabilitation support system according to claim 2 , wherein the image generating device has a display control unit that controls the display of the MR image, and the display control unit uses offset information.

4. The rehabilitation support system according to claim 2 , wherein the image generating device has a determination unit that determines whether a body part of the user has touched an MR image, and the determination unit uses offset information.

5. The rehabilitation support system according to any one of claims 1 to 4, wherein the object is one or more selected from a desk, a wall, and a floor.

Citation Information

Patent Citations

  • Position attitude sensor, position attitude detection method, composite reality providing device, game machine, composite reality providing method and storage medium

    JP1999136706A

  • Image display program, image display, image display system, and image display method

    JP2011076589A

  • Video processing apparatus, video processing method, and video processing system

    JP2016131031A

  • Simulation system and program

    JP2019122496A

  • Mixed reality optical system with digital aberration correction

    JP2021526700A