Virtual reality devices for medical rehabilitation training based on chronic lung disease management and physical recovery.

Abstract

This invention discloses a virtual reality device for medical rehabilitation training based on chronic lung disease management and physical recovery. The device includes a headband; an audio output unit mounted on the headband; a vibration unit mounted on the headband; a camera mounted on the headband; and a controller electrically connected to both the audio output unit and the vibration unit. The controller is configured to respond to a user's activation operation by controlling the audio output unit to output a prompt voice instructing the user to complete a first action, and to control the camera to activate. Furthermore, when the controller receives first image information from the camera indicating that the user has not completed the first action, it controls the vibration unit to enter a standalone operating state.

Description

Technical Field

[0001] This invention relates to the technical field of virtual reality devices, and more specifically, to a virtual reality device for medical rehabilitation training based on chronic lung disease management and physical recovery. Background Technology

[0002] With the rapid development of virtual reality (VR) technology, VR devices can be applied to various fields, such as e-commerce, gaming, and medicine. Currently, existing VR devices can be either head-mounted displays or glasses. Furthermore, when using these VR devices, users need to complete specific actions based on voice prompts to calibrate the device. However, this calibration can be difficult for users with hearing impairments. Summary of the Invention

[0003] One object of the present invention is to provide a virtual reality device for medical rehabilitation training based on chronic lung disease management and physical recovery.

[0004] According to a first aspect of the present invention, a virtual reality device for medical rehabilitation training based on chronic lung disease management and physical recovery is provided, the device comprising:

[0005] Head brace;

[0006] An audio output unit is disposed on the head-mounted frame;

[0007] Vibration unit, the audio output unit is disposed on the headband;

[0008] A camera, which is mounted on the head-mounted frame;

[0009] The controller is electrically connected to the audio output unit and the vibration unit respectively. The controller is used to respond to the user's start operation, control the audio output unit to output a prompt voice instructing the user to complete the first action, and control the camera to start; the controller is also used to control the vibration unit to enter a separate operation state when it receives the first image information output by the camera reflecting that the user has not completed the first action.

[0010] Optionally, the device further includes an imaging unit electrically connected to the controller; when the vibration unit is in a standby operating state, the controller is also configured to control the vibration unit and the imaging unit to enter a waiting-to-coordinate operating state when it receives second image information output by the camera reflecting that the user has completed the second action.

[0011] Optionally, the controller is further configured to control the imaging unit and the audio output unit to enter a waiting-to-operate state when it receives the first image information output by the camera reflecting that the user has completed the first action.

[0012] Optionally, the device further includes a Bluetooth transmitter, which is electrically connected to the controller, and the controller receives control commands output by the user terminal through the Bluetooth transmitter.

[0013] Optionally, the controller is further configured to, upon receiving a first control command output by the user terminal, determine a first state identifier corresponding to the imaging unit and the audio output unit being in a waiting-to-operate state; and, based on the first state identifier and the first event identifier indicated by the first control command, determine that the controller enters a first event mode corresponding to the first state identifier and the first event identifier; in the first event mode, the controller controls the audio output unit, the imaging unit, and the camera to operate in coordination according to the operating configuration indicated by the first event mode.

[0014] Optionally, the controller controls the audio output unit, the imaging unit, and the camera to operate in coordination according to the operating configuration indicated by the first event mode, including: the controller determining a first object of a set type in the third image information received from the camera; the controller determining a first mapping position of a preset motion point cloud model based on the first position information of the first object; and the controller generating and outputting a first demonstration image to the imaging unit based on the first mapping position, such that the audio output unit outputs demonstration audio when the imaging unit displays the first demonstration image.

[0015] Optionally, the controller is further configured to, upon receiving a second control command output by the user terminal, determine a second state identifier corresponding to the imaging unit and the vibration unit being in a waiting-to-operate state; and, based on the second state identifier and the second event identifier indicated by the second control command, determine that the controller enters a second event mode corresponding to the second state identifier and the second event identifier; in the second event mode, the controller controls the vibration unit, the imaging unit, and the camera to operate in coordination according to the operating configuration indicated by the second event mode.

[0016] Optionally, the controller controls the vibration unit, the imaging unit, and the camera to operate in coordination according to the operating configuration indicated by the second event mode, including: the controller determining a second object of a set type in the fourth image information received from the camera; the controller determining a second mapping position of a preset motion point cloud model based on the second position information of the second object; and the controller generating and outputting a second demonstration image to the imaging unit based on the second mapping position, such that the vibration unit outputs a demonstration vibration signal when the imaging unit displays the second demonstration image.

[0017] Optionally, the device further includes a data transmitter electrically connected to the controller, which receives the motion point cloud model output by the user terminal through the data transmitter.

[0018] Optionally, the headband includes an ear support and an imaging connection; the audio output unit is disposed on the ear support, the vibration unit is disposed on the ear support and the imaging connection, and the camera is disposed on the imaging connection.

[0019] According to one embodiment of this disclosure, the controller of a virtual reality device for medical rehabilitation training based on chronic lung disease management and physical recovery can respond to the user's activation operation, control the audio output unit to output a prompt voice instructing the user to complete a first action, and control the camera to start; the controller is also used to control the vibration unit to enter a separate operating state when it receives the first image information output by the camera reflecting that the user has not completed the first action. In other words, through this controller, the vibration unit can be used to achieve user calibration, effectively improving the user experience.

[0020] Other features and advantages of the invention will become clear from the following detailed description of exemplary embodiments of the invention with reference to the accompanying drawings. Attached Figure Description

[0021] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments of the invention and, together with their description, serve to explain the principles of the invention.

[0022] Figure 1 This is a schematic diagram of the structure of a virtual reality device for user medical rehabilitation training and physical recovery according to an embodiment of this application. Detailed Implementation

[0023] Various exemplary embodiments of the present invention will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the invention.

[0024] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit the invention or its application or use.

[0025] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0026] In all the examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0027] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0028] According to an embodiment of this application, a virtual reality device for medical rehabilitation training based on chronic lung disease management and physical recovery is provided, such as... Figure 1 As shown, the device may include:

[0029] Headgear 1;

[0030] Audio output unit 2, wherein the audio output unit 2 is disposed on the head-mounted bracket 1;

[0031] Vibration unit 3, the audio output unit 2 is disposed on the headband 1;

[0032] Camera 4 is mounted on the head-mounted bracket 1;

[0033] The controller is electrically connected to the audio output unit 2 and the vibration unit 3 respectively. The controller is used to respond to the user's start operation, control the audio output unit 2 to output a prompt voice instructing the user to complete the first action, and control the camera 4 to start; the controller is also used to control the vibration unit 3 to enter a separate operation state when it receives the first image information output by the camera 4 reflecting that the user has not completed the first action.

[0034] In this embodiment, the headband 1 can be an eyeglasses frame or a helmet frame, etc.

[0035] In this embodiment, the user's startup operation can be achieved by the user controlling a user terminal that is communicatively connected to the virtual reality device to issue a control command to start the virtual reality device, thereby activating the virtual reality device. Alternatively, the user can directly touch the startup control of the virtual reality device to start it.

[0036] In this embodiment, the first action is, for example, raising the left hand, raising the left leg, or waving, and the prompting voice is, for example, "Please use your left hand," "Please raise your left leg," or "Please wave."

[0037] In this embodiment, the controller has an action recognition function. Through the first image information output by the camera 4, it can determine whether the action reflected by the user in the first image information is the first action, so as to determine whether the user has completed the first action.

[0038] In this embodiment, the controller of the virtual reality device for medical rehabilitation training based on chronic lung disease management and physical recovery can respond to the user's start operation, control the audio output unit 2 to output a prompt voice instructing the user to complete the first action, and control the camera 4 to start; the controller is also used to control the vibration unit 3 to enter a separate operation state when it receives the first image information output by the camera 4 reflecting that the user has not completed the first action. In other words, through this controller, the vibration unit 3 can be used to achieve user calibration, effectively improving the user experience.

[0039] In some embodiments, the device further includes an imaging unit 5, which is electrically connected to the controller; when the vibration unit 3 is in a standby operating state, the controller is also configured to control the vibration unit 3 and the imaging unit 5 to enter a waiting-to-coordinate operating state when it receives second image information output by the camera 4 reflecting that the user has completed the second action.

[0040] In this embodiment, when the vibration unit 3 is in standby mode, the controller controls the vibration unit 3 to generate vibration. The controller uses the camera 4 to capture whether the user's action is raising their arm. When the user's action is raising their arm, it is determined that the user has completed the second action. In other words, by setting the vibration unit 3 to operate independently, the calibration of the virtual reality device can be effectively achieved when the user has hearing impairment. This effectively improves the user experience by providing vibration feedback to the user while the virtual reality device displays images of medical rehabilitation training and physical recovery, further enhancing the user's experience.

[0041] In some embodiments, the controller is further configured to control the imaging unit 5 and the audio output unit 2 to enter a waiting-to-operate state when the first image information output by the camera 4 reflects that the user has completed the first action.

[0042] In this embodiment, when the controller determines that the user has completed the first action, the controller can control the imaging unit 5 and the audio output unit 2 to enter a waiting and cooperating operation state, so as to improve the response speed of the imaging unit 5 and the audio output unit 2 during the subsequent process of the virtual reality device starting to guide the user in medical rehabilitation.

[0043] In some embodiments, the device further includes a Bluetooth transceiver 6, which is electrically connected to the controller, and the controller receives control commands output by the user terminal through the Bluetooth transceiver 6.

[0044] In this embodiment, by setting up a Bluetooth signal device 6, the user terminal and the controller can interact with each other to control the imaging unit 5, audio output unit 2 and vibration unit 3 to execute corresponding programs according to the instructions output by the user terminal regarding the recovery of different medical rehabilitation training bodies.

[0045] In some embodiments, the controller is further configured to, upon receiving a first control command output by the user terminal, determine a first status identifier corresponding to the imaging unit 5 and the audio output unit 2 being in a waiting-to-operate state; and, based on the first status identifier and the first event identifier indicated by the first control command, determine that the controller enters a first event mode corresponding to the first status identifier and the first event identifier; in the first event mode, the controller controls the audio output unit 2, the imaging unit 5, and the camera 4 to operate in coordination according to the operating configuration indicated by the first event mode.

[0046] In this embodiment, the first control command is, for example, a control command for rehabilitation movements related to "upper body joint rehabilitation training".

[0047] In this embodiment, the first state identifier can be a string, such as CY1, which indicates that the imaging unit 5 and the audio output unit 2 are in a waiting-to-operate state. The first event identifier can also be a string, such as CJ1, which indicates the rehabilitation action of "upper body joint rehabilitation training". Through the first state identifier and the first event identifier, the first program for the audio version of "upper body joint rehabilitation training" can be retrieved; that is, the controller enters the first event mode, and the audio output unit 2, the imaging unit 5, and the camera 4 cooperate to operate according to the operating configuration indicated by the first program. In other words, by setting the state identifier and the event identifier, either the audio version or the vibration version of the program can be retrieved to suit users with different needs.

[0048] In some embodiments, the controller controls the audio output unit 2, the imaging unit 5, and the camera 4 to operate in coordination according to the operating configuration indicated by the first event mode, including: the controller determining a first object of a set type in the third image information received from the camera 4; the controller determining a first mapping position of a preset motion point cloud model based on the first position information of the first object; and the controller generating and outputting a first demonstration image to the imaging unit 5 based on the first mapping position, such that when the imaging unit 5 displays the first demonstration image, the audio output unit 2 outputs demonstration audio.

[0049] In some examples, the type is set to, for example, a chair. Based on the third image information received from the camera 4, the controller determines that chair A1 in the third image information matches the chair type, i.e., chair A1 is the first object. The controller can determine the length, width, and height of chair A1, as well as the relative position of chair A1 to the user, and uses Simultaneous Localization and Mapping (SLAM) to determine the first mapping position of a preset motion point cloud model. Based on the first mapping position, the controller generates and outputs a first demonstration image to the imaging unit 5. When the imaging unit 5 displays the first demonstration image, the audio output unit 2 outputs demonstration audio to instruct the user to complete the corresponding medical rehabilitation training for physical recovery.

[0050] In some embodiments, the controller is further configured to, upon receiving a second control command output by the user terminal, determine a second state identifier corresponding to the imaging unit 5 and the vibration unit 3 being in a waiting-to-operate state; and, based on the second state identifier and the second event identifier indicated by the second control command, determine that the controller enters a second event mode corresponding to the second state identifier and the second event identifier; in the second event mode, the controller controls the vibration unit 3, the imaging unit 5, and the camera 4 to operate in coordination according to the operating configuration indicated by the second event mode.

[0051] In this embodiment, the second state identifier can be a string, such as CY2, which indicates that the imaging unit 5 and the vibration unit 3 are in a waiting-to-operate state. The second event identifier can also be a string, such as BJ1, which indicates the rehabilitation action of "lower body joint rehabilitation training". Through the second state identifier and the second event identifier, the second program for the vibration version of "lower body joint rehabilitation training" can be retrieved; that is, the controller enters the second event mode, and the vibration unit 3, the imaging unit 5, and the camera 4 cooperate to operate according to the operating configuration indicated by the first program. In other words, by setting the state identifier and event identifier, either the audio version or the vibration version of the program can be retrieved to suit users with different needs.

[0052] In some embodiments, the controller controls the vibration unit 3, the imaging unit 5, and the camera 4 to operate in coordination according to the operating configuration indicated by the second event mode, including: the controller determining a second object of a set type in the fourth image information received from the camera 4; the controller determining a second mapping position of a preset motion point cloud model based on the second position information of the second object; and the controller generating and outputting a second demonstration image to the imaging unit 5 based on the second mapping position, such that when the imaging unit 5 displays the second demonstration image, the vibration unit 3 outputs a demonstration vibration signal.

[0053] In some examples, the type is set to, for example, a chair. Based on the third image information received from the camera 4, the controller determines that chair A2 in the fourth image information matches the chair type, i.e., chair A2 is the second object. The controller can determine the length, width, and height of chair A2, as well as the relative position of chair A2 to the user, and uses Simultaneous Localization and Mapping (SLAM) to determine the second mapping position of a preset motion point cloud model. Based on the second mapping position, the controller generates and outputs a second demonstration image to the imaging unit 5. When the imaging unit 5 displays the second demonstration image, the vibration unit 3 outputs a demonstration vibration signal to instruct the user to complete the corresponding medical rehabilitation training for physical recovery.

[0054] In some embodiments, the device further includes a data transmitter 7, which is electrically connected to the controller, and the controller receives a motion point cloud model output by a user terminal through the data transmitter 7.

[0055] In this embodiment, the data transmitter 7 can be a wireless serial port module, which can receive motion point cloud models sent by user terminals at a faster transmission speed, effectively improving the operating efficiency of virtual reality devices used for medical rehabilitation training based on chronic lung disease management and physical recovery.

[0056] In some embodiments, the headband 1 includes an ear support and an imaging connection; the audio output unit 2 is disposed on the ear support, the vibration unit 3 is disposed on the ear support and the imaging connection, and the camera 4 is disposed on the imaging connection.

[0057] In this embodiment, by placing the audio output unit 2 on the ear support, close to the user's ear, the sound quality of the virtual reality device used for medical rehabilitation training based on chronic lung disease management and physical recovery is effectively improved. By placing the vibration unit 3 on the ear support and the imaging connection, the contact area with the headband 1 is large, effectively achieving a better vibration effect.

[0058] While specific embodiments of the invention have been described in detail by way of examples, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of the invention. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of the invention. The scope of the invention is defined by the appended claims.

Claims

1. A virtual reality device based on pulmonary chronic disease management and body recovery, characterized in that, The device comprises: a head-mounted support; an audio output unit arranged on the head-mounted support; a vibration unit arranged on the head-mounted support; a camera arranged on the head-mounted support; a controller electrically connected with the audio output unit and the vibration unit respectively, the controller being configured to control the audio output unit to output prompt voice indicating the user to complete a first action and control the camera to start in response to a starting operation of the user; the controller being further configured to control the vibration unit to enter a single operation state when the first image information output by the camera reflects that the user does not complete the first action; the device further comprises an imaging unit electrically connected with the controller; when the vibration unit is in the single operation state, the controller is further configured to control the vibration unit and the imaging unit to enter a waiting cooperation operation state when the second image information output by the camera reflects that the user completes a second action; the controller is further configured to determine a second state identifier corresponding to the waiting cooperation operation state of the imaging unit and the vibration unit when receiving a second control instruction output by a user terminal; determine a second event mode corresponding to the second state identifier and a second event identifier indicated by the second control instruction according to the second state identifier and the second event identifier; in the second event mode, the controller controls the vibration unit, the imaging unit and the camera to cooperate according to the running configuration indicated by the second event mode; the controller controls the vibration unit, the imaging unit and the camera to cooperate according to the running configuration indicated by the second event mode, comprising: the controller determines a second object of a set type in the fourth image information according to the fourth image information output by the camera; the controller determines a second mapping position of a preset motion point cloud model according to second position information of the second object; the controller generates and outputs a second demonstration image to the imaging unit according to the second mapping position, so that the vibration unit outputs a demonstration vibration signal when the imaging unit displays the second demonstration image.

2. The apparatus of claim 1, wherein, The controller is further configured to control the imaging unit and the audio output unit to enter a waiting cooperation operation state when the first image information output by the camera reflects that the user completes a first action.

3. The apparatus of claim 1, wherein, The device further comprises a Bluetooth signaler electrically connected with the controller, and the controller receives the control instruction output by the user terminal through the Bluetooth signaler.

4. The apparatus of claim 3, wherein, The controller is further configured to, when receiving the first control instruction output by the user terminal, determine a first state identifier corresponding to a state in which the imaging unit and the audio output unit are in a standby cooperation operation state; determine, according to the first state identifier and a first event identifier indicated by the first control instruction, a first event mode corresponding to the first state identifier and the first event identifier; and control, in the first event mode, the audio output unit, the imaging unit, and the camera to cooperate according to an operation configuration indicated by the first event mode.

5. The apparatus of claim 4, wherein, The controller controls the audio output unit, the imaging unit, and the camera to cooperate according to the operation configuration indicated by the first event mode, including: determining, by the controller according to the third image information output by the camera, a first object in the third image information that meets a set type; determining, by the controller according to first position information of the first object, a first mapping position of a preset motion point cloud model; and generating, by the controller according to the first mapping position, and outputting to the imaging unit, a first demonstration image, so that the audio output unit outputs demonstration audio when the imaging unit displays the first demonstration image.

6. The apparatus of claim 1, wherein, The device further includes a data transmitter electrically connected to the controller, and the controller receives a motion point cloud model output by a user terminal through the data transmitter.

7. The apparatus of claim 1, wherein, The head-mounted support includes an ear support portion and an imaging connection portion; the audio output unit is arranged on the ear support portion, the vibration unit is arranged on the ear support portion and the imaging connection portion, and the camera is arranged on the imaging connection portion.

Images