Motion assistance system and method applied in motion assistance system

Abstract

One of the purposes of the present invention is to provide a motion assistance system capable of communicating with an external device. A motion assistance system according to the present invention comprises: a motion assistance device which is configured to detect a biological signal of a wearer and to assist the wearer's motion on the basis of the biological signal; a speech recognition means which is configured to recognize speech that has been inputted to the motion assistance device; a communication means which is configured to perform communication between the motion assistance device and an external device; and a control means which is configured to control the motion assistance device and / or the communication means on the basis of the inputted speech.

Description

Motion assist system and method performed in the motion assist system

[0001] The present invention relates to a motion assist system and a method performed in the motion assist system.

[0002] It is said that of the approximately 300,000 stroke patients in Japan each year, approximately 200,000 suffer from paralysis of the fingers. Rehabilitation devices for assisting the movement of the fingers of stroke patients are known (for example, Patent Document 1).

[0003] International Publication No. 2019 / 107554

[0004] The inventor of the present invention discovered the usefulness of using a motion assist device, such as a training device, for assisting body movements as part of daily life infrastructure, and as a result of extensive research, invented the present invention.

[0005] The present invention provides a movement assist system capable of communicating with an external device. The present invention provides, for example, the following items: (Item 1) A movement assist system comprising: a movement assist device configured to detect a biosignal of a wearer and assist a movement of the wearer based on the biosignal; voice recognition means configured to recognize a voice input to the movement assist device; communication means configured to communicate between the movement assist device and an external device; and control means configured to control the movement assist device and / or the communication means based on the voice. (Item 2) The movement assist system according to the above items, wherein the external device includes a server device of an e-commerce site. (Item 3) The movement assist system according to any one of the above items, wherein the control means is configured to perform an operation on the e-commerce site via the communication means based on the movement of the wearer detected by the movement assist device. (Item 4) The movement assistance system according to any one of the above items, wherein the control means is configured to: determine characteristics of products to be searched for on the EC site based on the movement of the wearer; and transmit a command to a server device of the EC site via the communication means to search for products having the determined characteristics on the EC site. (Item 5) The movement assistance system according to any one of the above items, wherein the movement includes at least one of a movement indicating the size of the product and a movement indicating the weight of the product. (Item 6) The movement assistance system according to any one of the above items, further comprising a change means for changing a manner in which products on the EC site are presented to the wearer based on a state of the wearing part of the wearer. (Item 7) The movement assistance system according to any one of the above items, wherein the change means determines whether the state of the wearing part is such that the product can be handled, and changes the manner in which the product is presented when it is determined that the state of the wearing part is not such that the product can be handled. (Item 8) The movement assistance system according to any one of the above items, wherein the external device includes a training instruction device.(Item 9) The action-assistance system according to any one of the above items, wherein the action-assistance device is configured so that the action and / or state of a drive unit of the action-assistance device is reflected in the training instruction device and / or the action and / or state of the drive unit of the training instruction device is reflected in the action-assistance device. (Item 10) The action-assistance system according to any one of the above items, further comprising audio output means configured to output audio. (Item 11) The action-assistance system according to any one of the above items, wherein the action-assistance device is for training a stroke patient. (Item 12) A method performed in the action-assistance system, the action-assistance system comprising the action-assistance device, audio recognition means, and control means, the method including: the audio recognition means recognizing audio; the control means performing an operation on an e-commerce site based on the recognized audio; the action-assistance device worn by a wearer detecting a motion of the wearer; and the control means performing an operation on the e-commerce site based on the detected motion. (Item 13) A server device for electronic commerce on an EC site, the server device being configured to communicate with the movement assistance system described in any one of the above items, the server device comprising: means for receiving from the movement assistance system a command to search for a product on the EC site, means for receiving a state of a mounting portion of the movement assistance device of the movement assistance system, means for searching for the product in accordance with the command, and means for changing a manner in which the product is presented based on the state. (Item 14) The server device described in any one of the above items, wherein the changing means determines whether the state of the mounting portion is such that the product can be handled, and changes the manner in which the product is presented when it is determined that the state of the mounting portion is not such that the product can be handled.(Item 15) A method for electronic commerce on an EC site, comprising: receiving an instruction to search for products on the EC site from the action assistance system described in any one of the above items, receiving a state of a mounting portion of a action assistance device of the action assistance system, searching for products in accordance with the instruction, and changing a manner in which the products are presented based on the state. (Item 16) A program for electronic commerce on an EC site, the program being executed on a server device having a processor, and causing the processor to perform processes including: receiving an instruction to search for products on the EC site from the action assistance system described in any one of the above items, receiving a state of a mounting portion of a action assistance device of the action assistance system, searching for products in accordance with the instruction, and changing a manner in which the products are presented based on the state. (Item 17) A method for assisting electronic commerce, the method comprising: providing a user with the action assistance system described in any one of the above items; the action assistance system communicating with a server device of an EC site in accordance with voice input by the user; the action assistance system sending a purchase instruction to the server device of the EC site to purchase a product from the EC site; and receiving a commission from a provider of the server device of the EC site in response to the server device of the EC site performing the purchase process.(Item 18) A server device for supporting remote training, the server device configured to communicate with at least one movement assistance system described in any one of the above items and at least one training instruction device, the at least one movement assistance system including a first movement assistance system, the server device comprising: means for receiving content of training instruction provided by a therapist to a user of the first movement assistance system via the training instruction device and characteristics of the therapist, means for receiving an effect of the training instruction and characteristics of the user, and storage means for storing the characteristics of the therapist, the content of the training instruction by the therapist, characteristics of a person receiving the training instruction, and the effect of the training instruction in association with each other. (Item 19) The server device described in any one of the above items, wherein the at least one movement assistance system further includes a second movement assistance system, the server device further comprising: means for receiving characteristics of a second user of the second movement assistance system, and means for referring to the information stored in the storage means and determining at least one therapist to provide training instruction to the second user based on the characteristics of the second user. (Item 20) The server device according to any one of the above items, further comprising: a means for receiving conditions for a therapist to be hired; and a means for determining at least one therapist to be hired based on the conditions by referring to the information stored in the storage means. (Item 21) A method for supporting remote training, comprising: receiving details of training instruction that a therapist has given to a user of the movement assistance system according to any one of the above items via a training instruction device and characteristics of the therapist; receiving an effect of the training instruction and characteristics of the user; and storing the characteristics of the therapist, the details of the training instruction by the therapist, characteristics of a person receiving the training instruction, and the effect of the training instruction in association with each other.(Item 22) A program for supporting remote training, the program being executed in a server device having a processor unit, the program causing the processor unit to perform processes including: receiving content of training instruction that a therapist has given to a user of the movement assistance system described in any one of the above items via a training instruction device and characteristics of the therapist; receiving an effect of the training instruction and characteristics of the user; and storing the characteristics of the therapist, the content of the training instruction by the therapist, characteristics of a person receiving the training instruction, and the effect of the training instruction in association with each other. (Item 23) A system for electronic commerce on an e-commerce site, wherein the server device is configured to communicate with at least one of the action assistance systems described in any one of the above items, wherein the action assistance system is configured to: determine products to be searched for on the e-commerce site based on voice input to the action assistance device; and transmit an instruction to the server device via the communication means for searching for the determined products on the e-commerce site, wherein the server device is configured to receive an instruction to search for the products on the e-commerce site from the action assistance system, and search for the products in accordance with the instruction. (Item 24) The system described in any one of the above items, wherein the action assistance system is further configured to: determine characteristics of the products based on the movement of the wearer detected by the action assistance device, and the instruction includes an instruction to search the e-commerce site for the products having the determined characteristics. (Item 25) The system according to any one of the above items, wherein the server device is further configured to receive a state of a portion where the action assist device is worn, and change a manner in which the product is presented based on the state, and the action assist system is configured to present the product to the wearer in the changed manner.

[0006] According to the present invention, it is possible to provide a movement assist system capable of communicating with an external device, which allows the wearer to use the movement assist device as part of daily life infrastructure and receive various types of support using the movement assist device in daily life.

[0007] FIG. 1 is a diagram showing an example of a flow of a new service using a motion assistance device. FIG. 1 is a diagram showing an example of a flow of a new service using a motion assistance device. FIG. 2 is a diagram showing an example of a configuration of the motion assistance system 100 of the present invention. FIG. 3 is a diagram showing an example of a peripheral configuration of the motion assistance system 100 of the present invention. FIG. 4 is a diagram showing an example of a flow of a process performed in the motion assistance system 100 and the server device 200 of the EC site. FIG. 5 is a diagram showing an example of a flow of a process performed in the motion assistance system 100 and the training instruction device 400. FIG. 6 is a diagram showing an example of a flow of a process performed in the motion assistance system 100 and the training instruction device 400.

[0008] The present invention will be described below.Unless otherwise specified, it should be understood that the terms used in this specification are used in the meanings generally used in the relevant field.Therefore, unless otherwise defined, all technical and scientific terms used in this specification have the same meaning as commonly understood by those skilled in the art to which this invention belongs.In the event of any discrepancy, this specification (including definitions) shall prevail.

[0009] (1. New Service Using a Movement-Assist Device) The inventor of the present invention has developed a new service using a movement-assist device. This service uses a movement-assist device to assist body movements as part of daily life infrastructure, allowing injured users to receive various types of support using the movement-assist device. For example, a user can use the movement-assist device for its intended purpose of assisting movements in daily life (e.g., finger assistance) while also communicating with a remote therapist via the movement-assist device. This allows the user to consult with a remote therapist via the movement-assist device or receive remote training guidance from the remote therapist. For example, a user can use the movement-assist device for its intended purpose of assisting movements in daily life (e.g., finger assistance) while also connecting to the Internet via the movement-assist device. This allows the user to do research or shop on an e-commerce (EC) website using the movement-assist device. The movement assist device can be connected to a home TV (or tablet device, etc.), for example, so that a remote therapist's activity can be displayed on the TV (or tablet device, etc.), or a web page from the Internet can be displayed on the TV (or tablet device, etc.). In particular, the inventors of the present invention believed that by allowing a user with limited mobility to select and purchase products on an e-commerce website using their disabled fingers, the user can feel joy and satisfaction while easily purchasing daily necessities and other items. This joy, satisfaction, and ease of purchasing can lead to improved motivation for training and improved quality of life. To achieve this, the new service described above incorporates a mechanism for connecting to an e-commerce website via a movement assist device and actively moving the user's fingers while operating the e-commerce website. In this specification and claims, "training" includes both medical training involving medical procedures (e.g., rehabilitation (more specifically, medical rehabilitation) and training using medical equipment) and non-medical training not involving medical procedures (e.g., training using non-medical equipment such as fitness equipment).Therefore, the person who instructs the "training," that is, the "therapist," may be a medical professional with medical qualifications, or may be a person without medical qualifications.

[0010] 1A and 1B show an example of the flow of a new service using a motion assist device. A user U wearing the motion assist device 10 can receive various types of support via the motion assist device 10. The user U of this service may be a user with physical paralysis, typically a user who has suffered a stroke and has paralysis of the fingers.

[0011] The user U can receive movement assistance from the movement assistance device 10. The movement assistance device 10 can be provided to the user U by a service provider P. The movement assistance device 10 can, for example, detect a biosignal from the user U, determine an intended movement of the user U based on the biosignal, and assist the movement of the user U.

[0012] In this specification, the term "biological signal" refers to a signal emitted by a living organism. Examples of biological signals include, but are not limited to, electromyographic signals indicating muscle activity of a living organism, electrocardiographic signals indicating cardiac activity of a living organism, electroencephalograms indicating brain activity of a living organism, and neural signals transmitted in nerve cells. A specific value of a biological signal can be associated with specific information (for example, a specific movement of the living organism (e.g., a movement of flexing fingers, a movement of extending fingers, a movement of abducting fingers, a movement of adduction of fingers, etc.)). The biological signal is typically a myoelectric signal.

[0013] The action-assist device 10 may be, for example, the action-assist device described in International Publication No. 2021 / 157390 (incorporated herein by reference). The action-assist device 10 can typically assist the user U in the movement of his or her fingers.

[0014] In one aspect, the user U can receive remote training guidance from a remote therapist. Fig. 1A shows an example of a flow in this aspect. The movement-assist device 10 is equipped with a microphone and a speaker, and the user U can receive remote training guidance from the therapist while communicating with the therapist at the hospital H via the movement-assist device 10, for example.

[0015] When the user U moves the fingers wearing the action assist device 10, the action assist device 10 can detect the user U's movement.

[0016] In step S1, the detected motion data of the user U is transmitted to the hospital H. In the hospital H, a training instruction device (robot hand) owned by a therapist receives the motion data of the user U.

[0017] The training instruction device can move the finger units of the training instruction device in accordance with the motion data of the user U, as if the user U were moving his or her fingers. This allows the therapist, even if remote, to check the motion of the user U's fingers. Furthermore, the training instruction device can express the smoothness of the motion of the user U's fingers in accordance with the motion data of the user U, allowing the therapist, even if remote, to check the range of motion of the user U's fingers.

[0018] The therapist can move the training instruction device, and when the therapist moves the training instruction device, the training instruction device can detect the movement and force applied by the therapist.

[0019] In step S2, the detected movement data of the therapist is transmitted to the movement assist device 10 of the user U.

[0020] The action-assist device 10 can move the user U's fingers, to which the action-assist device 10 is attached, according to the motion data provided by the therapist, as if the therapist were actually moving the user U's fingers. At this time, the therapist can sense the reaction force and movement of the training instruction device in response to the applied force and movement, thereby learning the state of spasticity, rigidity, and contracture of the user U. The therapist can further move the training instruction device according to the state of spasticity, rigidity, and contracture of the user U. In this way, the user U can receive training instruction from the therapist even while remotely located. At this time, it is preferable that a call between the user U and the therapist is maintained. More preferably, the call can be a video call in which an image is displayed on a camera-equipped display device (e.g., a TV with a webcam, a tablet device, etc.) connected to the action-assist device 10. It is preferable that communication between the training instruction device and the action-assist device 10 be substantially real-time, even if there is some loss of time.

[0021] For example, in addition to receiving training instruction from the training instruction device, the user U can also consult with a therapist about training via a video call.

[0022] In this way, the user U can receive training guidance from the comfort of his or her own home without having to go to a hospital or the like.

[0023] In the above example, the therapist is described as being located in a hospital, but the therapist does not necessarily have to be located in a hospital. For example, the therapist can provide training guidance to the user U from any environment (e.g., home) as long as the environment is network-connectable. This may lead to changes in the way therapists work and increase employment opportunities for therapists.

[0024] In the flow shown in FIG. 1A, steps S3 to S8 can be performed as additional steps.

[0025] In step S3, the content of the training instruction given by the therapist is transmitted to the service provider P. The content of the training instruction includes, for example, the actions of the therapist detected by the training instruction device (for example, the magnitude of the force applied by the therapist to the training instruction device, the duration of the force applied by the therapist to the training instruction device, the direction of the force applied by the therapist to the training instruction device, etc.). The content of the training instruction may also include, for example, instructions given by the therapist to the user U. The communication between the training instruction device and the service provider P does not need to be substantially real-time, and it is preferable that the communication be lossless even if there is some delay.

[0026] At this time, the characteristics of the therapist can also be transmitted. The characteristics of the therapist may include, for example, the therapist's work experience (e.g., years of work, number of patients treated, areas of expertise of the therapist, areas of weakness of the therapist) and the therapist's attributes (e.g., age, gender).

[0027] Step S3 may be performed simultaneously with step S2 or after step S2. When step S3 is performed simultaneously with step S2, in step S2, the detected motion data of the therapist may be transmitted to the motion-assist device 10 of the user U via the service provider P.

[0028] In step S4, the effect of the training instruction received from the therapist is transmitted to the service provider P. The effect of the training instruction may include, for example, a change over time in the range of motion of the fingers and a change over time in the strength exerted by the fingers.

[0029] At this time, the characteristics of the user U can also be transmitted. The characteristics of the user U may include, for example, the condition of the user U (e.g., the range of motion of the joints, the state of paralysis (Brunnstrom stage, or the degree of spasticity, rigidity, or contracture, etc.)), the attributes of the user U (e.g., age and gender), and the training history of the user U (e.g., the period or number of times the user U received training guidance, the period during which the user U used the action assistance system 100).

[0030] Through steps S3 and S4, the therapist's instruction history and the prognosis or characteristics of the user who received that instruction are stored as big data in the service provider P. The service provider P associates and stores the therapist's instruction history and the prognosis or characteristics of the user who received that instruction. This big data can be used for various purposes.

[0031] In one example, this big data can be used in matching users with therapists.

[0032] In step S5, a user U2 who is a new user of the action-assist device 10 transmits a request to receive training guidance to the service provider P. At this time, the characteristics of the user U2 may also be transmitted to the service provider P. The characteristics of the user U2 may include, for example, the condition of the user U2 (e.g., the range of motion of the joints, the state of paralysis (Brunnstrom stage, or the degree of spasticity, rigidity, or contracture, etc.)), and the attributes of the user U2 (e.g., age, gender).

[0033] The service provider P refers to the big data and searches for a therapist who is compatible with the user U2. A therapist who is compatible with the user U2 may be, for example, a therapist who has experience in improving the symptoms of the user U, or a therapist who is good at providing training guidance for the symptoms of the user U.

[0034] In step S6, the searched therapists are presented to the user U2. If the user U2 approves, the user U2 can receive training guidance from the therapists.

[0035] In this way, steps S5 and S6 allow the user U2 to easily receive training guidance from a therapist suited to the user.

[0036] In another example, this big data can be used by hospitals when recruiting therapists.

[0037] In step S7, hospital H2, which wishes to hire a new therapist, transmits the conditions for the therapist to be hired to service provider P. The conditions for the therapist to be hired may include, for example, the work experience of the therapist to be hired (e.g., years of work, number of patients treated), the strengths and weaknesses of the therapist to be hired, and the attributes of the therapist to be hired (e.g., age, gender).

[0038] The service provider P refers to the big data and searches for therapists who meet the conditions. For example, therapists who meet all the conditions or therapists who meet some of the conditions are searched for.

[0039] In step S8, the searched therapists are presented to the hospital H2, which can then contact the presented therapists and proceed with the hiring process.

[0040] For example, when a therapist provided by service provider P is hired by hospital H2, service provider P may request payment of a fee from hospital H2.

[0041] In this way, by steps S7 and S8, hospital H2 can search for and employ a desired therapist.

[0042] In another aspect, the user U can shop at an EC site. Figure 1B shows an example of a flow in this aspect.

[0043] In step S11, the service provider P provides the action-assist device 10 to the user U. The action-assist device 10 can assist the user U in the movement of his or her fingers. The action-assist device 10 is equipped with a microphone, and the user U can, for example, shop on an e-commerce site by voice operation.

[0044] The user U can provide voice input to the action-assist device 10 by speaking the name of a product they want along with a password for activating the voice operation (for example, "MELTz," which is the nickname of the action-assist device 10). For example, the user U can input a command to purchase athletic shoes by voice by speaking, "MELTz, I want athletic shoes." For example, the user U can input a command to purchase rice by voice by speaking, "MELTz, buy me rice."

[0045] In step S12, the input instruction is transmitted from the action assist device 10 to the server S of the EC site. Upon receiving the instruction, the server S executes a purchase process in accordance with the instruction.

[0046] If there are multiple products specified by the instruction, the multiple specified products can be presented to the user U as purchase candidates. The purchase candidates may be presented, for example, by voice from a microphone provided in the action assistance device 10, or by being displayed on a display device (e.g., a TV) connected to the action assistance device 10. The user U can select a desired product from the presented purchase candidates. For example, the user U may select the desired product by voice, or by operating a cursor displayed on the display device.

[0047] When the user U selects a desired product by operating a cursor, the user U can operate the cursor by moving the fingers wearing the action-assist device 10. For example, the movement of the user U's fingers can be linked to the movement of the cursor so that the cursor moves downward when the fingers are bent, upward when the fingers are extended, left when the fingers are abducted, and right when the fingers are adducted. This is preferable because it encourages training for the user U.

[0048] In addition, the user U can perform a product search in conjunction with the information obtained from the action assist device 10.

[0049] For example, by opening your fingers to a certain width and saying, "MELTz, I want a container about this size," the size of the opened fingers is measured by the motion assistance device, and the measured size and the content of the utterance are sent to the server S, which then searches for a container that matches that size.

[0050] For example, a similar operation can be performed while holding an existing container. In this case, by linking with a web camera and showing the container to the web camera and saying, "MELTz, I want a container about this size," the characteristics of the container are identified by image recognition, and the size is determined by the degree to which the fingers are spread, allowing for accurate narrowing down of the target item.

[0051] The action-assist device 10 may be equipped with an IMU (Inertial Measurement Unit), which may detect hand movements or gestures. Even for objects too large to be grasped with fingers, the user can draw the outline of the object with their hand and say, "MELTz, I want a container about this size," which will recognize the approximate size via the IMU and search for a suitable item. Searches can also be performed based on the weight of the object being held.

[0052] In this way, the user U can search for and select a desired product using his / her disabled fingers, and the user U can purchase the product. As described above, this leads to the user U feeling joy and satisfaction, which may in turn lead to the user U being motivated to train.

[0053] On the other hand, even if the user U is able to purchase a product using his or her disabled fingers, if the purchased product is one that cannot be handled with the condition of the user U's fingers (for example, a product that cannot be grasped with paralyzed fingers, a product that cannot be operated with paralyzed fingers, a product that cannot be grasped or operated even with the use of the action-assist device 10, etc.), this may actually cause the user U to lose motivation. Therefore, the present service can introduce a mechanism that prevents the user U from searching for, selecting, or purchasing such products, or provides a solution that enables the user U to handle such products.

[0054] As an example, the service can devise a way of presenting products to the user U so that the user U can select products taking into account the user U's physical condition or the specifications of the action-assist device 10. For example, when the user U searches for a product that is too large to grasp with the range of motion of the fingers of the paralyzed side of the user U, the product can be presented to the user U at a lower search ranking so that the product does not appear at the top of the search results because it cannot be grasped with the fingers of the paralyzed side. Alternatively, when the user U searches for a product that is too large to grasp with the range of motion of the fingers of the paralyzed side of the user U, a notice indicating that the product cannot be grasped with the fingers of the paralyzed side can be displayed on the product and presented to the user U. Alternatively, when the user U searches for a product that is too large to grasp with the range of motion of the fingers of the paralyzed side of the user U, a recommendation of an assistive tool for grasping the product with the fingers of the paralyzed side can be presented to the user U. For example, when user U searches for a product that is too heavy to hold even with the assistance of the motion assistance device 10, the product may be presented to user U at a lower search ranking so that it does not appear at the top of the search results, or a notice to the user U stating that the product cannot be held even with the use of the motion assistance device 10 may be attached to the product display, or a recommendation to upgrade the motion assistance device 10 may be presented to user U.

[0055] The physical state of the user U can be detected, for example, by the action-assist device 10 worn by the user U. Alternatively, the physical state of the user U can be determined, for example, from the physical state of the user U (e.g., the range of motion of the fingers, the level of paralysis of the fingers, etc.) revealed by training guidance by a therapist, that is, from the big data described above with reference to FIG. 1A .

[0056] For example, the action-assist device 10 may provide the user U with an image (e.g., hardness) of a searched product. In order to provide the user U with an image of the hardness of the searched product before purchasing it, the action-assist device 10 applies resistance to the fingers to simulate the hardness, allowing the user U to experience as if they were touching the product.

[0057] When the user U selects the product he or she wishes to purchase from the searched and presented products, the purchase process is carried out.

[0058] In step S13, the purchased product is provided to the user U.

[0059] In this way, the user U can shop on an e-commerce website using the action-assist device 10 (and TV) that they normally use. This is particularly advantageous for elderly users who are not familiar with devices such as smartphones or personal computers. This is because they can use e-commerce websites without using unfamiliar devices or small screens. This may lower the barrier to using e-commerce websites for elderly users. Furthermore, as described above, by enabling product selection that takes into account the user U's physical condition or the specifications of the action-assist device 10, it is possible to provide joy and satisfaction to physically disabled users U and maintain their motivation while avoiding situations in which the user U loses motivation.

[0060] The above-mentioned embodiment is advantageous for EC site providers in that it lowers the barriers to elderly people's use of EC sites, allowing them to attract elderly customers.Furthermore, it is also advantageous for companies that offer products on EC sites to attract elderly customers and run targeted advertisements aimed at elderly people.

[0061] In step S14, in response to the purchase of a product via the action-assist device 10, the EC site provider pays a fee to the service provider P. In this way, the service provider P collects a usage fee from the EC site provider in addition to collecting a usage fee for the action-assist device 10 from the user U, allowing the user to receive the service at a low price. Furthermore, the service provider P may collect advertising fees from companies that offer products on the EC site.

[0062] In another aspect, the user U can, for example, make a call. The user U can make a voice call or a video call with any person other than the therapist described above. For example, by storing a phone book in the action-assist device 10, the user U can search for a call partner from the phone book (for example, by voice input) and make a call.

[0063] In another aspect, the user U can, for example, search for something using a search engine. The user U can provide voice input to the action-assist device 10 by, for example, uttering a password for activating voice operation (e.g., “MELTz,” the nickname of the action-assist device 10) along with the object to be searched for. The user U can input a command to check today's weather by voice, for example, uttering, “MELTz, what's the weather today?” The user U can input a command to check a route from home to Kayabacho by voice, for example, uttering, “MELTz, what's the route to Kayabacho?” The action-assist device 10 can search for the command content by transmitting the command to a search engine server. The searched content may be presented by voice from a microphone provided in the action-assist device 10 or may be presented by being displayed on a display device (e.g., a TV) connected to the action-assist device 10.

[0064] The above-mentioned services can be implemented, for example, by a motion assistance system described below.

[0065] (2. Configuration of the Action Assistance System) FIG. 2 shows an example of the configuration of the action assistance system 100 of the present invention.

[0066] The movement assistance system 100 includes a movement assistance device 10, a voice recognition unit 110, a communication unit 120, and a control unit 130.

[0067] The action-assist device 10 is configured to detect a biosignal of the wearer and assist the wearer in their movements based on the biosignal. The action-assist device 10 can have any configuration as long as it includes a detector for detecting the biosignal of the wearer and a driver for driving the part of the wearer where the action-assist device 10 is worn based on the biosignal. The action-assist device 10 can receive a control signal from the controller 130 and be controlled in accordance with the control signal.

[0068] The detection unit may be any biosignal sensor, typically an electromyographic sensor. The biosignal detected by the detection unit may be passed to the control means 130.

[0069] The drive unit may be any drive means, and may be configured to drive the attachment site (e.g., a finger) by wire drive, or may be configured to drive the attachment site by a pneumatic actuator, or may be configured to drive the attachment site by the torque of a motor.

[0070] The driving unit can drive the wearing part in accordance with the control signal. The control signal can be generated by the control unit 130 based on a biological signal detected by the detection unit. This allows the action-assist device 10 to drive the wearing part according to the wearer's intention to move the wearing part. Alternatively, the control signal can be generated by the control unit 130 based on a signal from an external device described below. This allows the action-assist device 10 to reflect the operation and / or state of a driving unit of an external device, such as a training instruction device, in the action-assist device 10. For example, when a therapist moves a finger part of a training instruction device at hand, the movement is reflected in the action-assist device 10, which moves the corresponding finger of the wearer. For example, when a therapist maintains the finger part of a training instruction device at hand in a specific state, the state is reflected in the action-assist device 10, and the corresponding finger of the wearer is maintained in that state.

[0071] The action-assist device 10 may include a movement / state detection unit that detects the wearer's movement and / or the state of the wearer's body part. The movement / state detection unit may detect the state of paralysis of the wearer's body part (e.g., the degree of spasticity, rigidity, or contracture), the range of motion of the wearer's body part, or both, as the state of the wearer's body part. The movement / state detection unit may include, but is not limited to, an angle sensor that can detect the angle of a joint of the wearer's body part, a force sensor that can detect the force acting on the wearer's body part, and the like. The movement / state detection unit may be, for example, an inertial measurement unit (IMU), a torque sensor, a pressure sensor, or the like. For example, the IMU can detect the wearer's gestures. Alternatively, for example, a torque sensor or a pressure sensor can detect the weight of an object held by the wearer.

[0072] The action-assist device 10 may include a voice input unit (for example, a microphone). Voice input to the action-assist device 10 is passed to the voice recognition unit 110.

[0073] The voice recognition unit 110 is configured to recognize voice input to the action assist device 10. The voice recognition unit 110 can recognize voice using a technique known in the field of voice recognition.

[0074] For example, the voice recognition unit 110 may recognize a specific wake word, and thereby recognize a voice input following the wake word as an instruction. For example, in the example described above with reference to Figures 1A and 1B, "MELTz" is used as the wake word.

[0075] The speech recognized by the speech recognition means 110 may be processed as speech data in subsequent processing, converted into text, or converted into corresponding commands for processing. The data is passed from the speech recognition means 110 to the control means 130.

[0076] The communication means 120 is configured to perform communication between the action-assist device 10 and an external device. The communication means 120 can perform communication between the action-assist device 10 and the external device via a network. Here, the type of network does not matter. The network may be, for example, the Internet or a LAN.

[0077] The communication means 120 can receive a signal from the action-assist device 10 via the control means 130 and transmit the signal to an external device. The communication means 120 can receive a signal from an external device and transmit the signal to the action-assist device 10 via the control means 130. The communication means 120 can transmit any signal to an external device and receive any signal from an external device. For example, the communication means 120 can transmit a signal to an external device for controlling the external device. For example, the communication means 120 can receive a signal from an external device for controlling the action-assist device 10. For example, the communication means 120 can transmit a signal to an external device / receive a signal from an external device for controlling the action-assist device 10. For example, the communication means 120 can transmit a signal for a voice call or a video call to / from an external device.

[0078] The external device may be any device external to the motion assistance system 100 .

[0079] In one embodiment, the external device may typically be a server device that provides a website, preferably a server device that provides an e-commerce site, or may be a server device that provides a search engine.

[0080] In one embodiment, the external device may be a training instruction device. The training instruction device is a device used by a person who provides training (e.g., a therapist (occupational therapist, etc.), a doctor, etc.). The training instruction device may have a structure that mimics the part where the action-assist device 10 is worn. For example, if the action-assist device 10 is a device worn on the fingers, the training instruction device may have a hand-shaped device (i.e., a robotic hand). For example, if the action-assist device 10 is a device worn on the lower limb, the training instruction device may have a lower-limb-shaped device.

[0081] In one embodiment, the external device may be a server device that manages the movement assistance system. The server device can manage the movement assistance system in association with its user. For example, the server device can store the movement assistance system in association with the user's characteristics in a connected database. The user's characteristics include at least one of the user U's condition (e.g., range of motion of the joint, state of paralysis (Brunnstrom stage, or degree of spasticity, rigidity, or contracture, etc.)), user attributes (e.g., age, gender), and user training history (e.g., period or number of times the user received training instruction, period of time the user used the movement assistance system 100). For example, the state of the attachment site (e.g., range of motion of the attachment site, state of paralysis of the attachment site, etc.) detected by the movement assistance device of the movement assistance system may be transmitted to the server device, and the state of the attachment site may be stored in association with the user in the database. For example, the condition of the user U (e.g., Brunnstrom stage, etc.) estimated or diagnosed by (e.g., a doctor, therapist, dedicated system, etc.) based on the condition of the attachment site detected by the motion-assistance device of the motion-assistance system may be transmitted to the server device, and the condition of the user U may be associated with the user and stored in the database unit. The stored information may later be used by a therapist, a server device of an EC site, or the motion-assistance system.

[0082] The server device can also manage the movement assistance system and the therapist who provides training guidance to the user of the movement assistance system in association with each other. For example, the server device can store, in a connected database, the movement assistance system, user information, and characteristics of the therapist who provided training guidance to the user in association with each other. The therapist's characteristics include at least one of the therapist's work experience (e.g., years of work experience, number of patients treated, areas of expertise, areas of weakness) and the therapist's attributes (e.g., age, gender). For example, the content of the training guidance (e.g., the therapist's movements (e.g., the magnitude of the force applied by the therapist to the training guidance device, the duration of the force applied by the therapist to the training guidance device, the direction of the force applied by the therapist to the training guidance device, etc.), and the content of the therapist's instructions) may be stored in association with the therapist and the user. For example, the content of the training guidance may be transmitted from the training guidance device to the server device during or after the training guidance, and the content of the training guidance may be stored in association with the user and the therapist in the database. In addition, the effects of the training instruction (e.g., changes over time in the range of motion of the fingers and changes over time in the strength of the fingers) may be stored in association with the therapist and the user. For example, after the training instruction, the effects of the training instruction may be transmitted from the movement assistance system 100 to the server device, and the effects of the training instruction may be stored in the database in association with the user and the therapist. The stored information may be used later by the therapist, by the server device of the EC site, or by the movement assistance system.

[0083] The control means 130 is configured to control the action-assist device 10 and / or the communication means 120 .

[0084] The control unit 130 can control the action assist device 10 and / or the communication unit 120 based on the voice recognized by the voice recognition unit 110 .

[0085] For example, the control means 130 can control the communication means 120 to transmit to an external device voice data of the voice recognized by the voice recognition means 110. For example, the control means 130 can control the communication means 120 to transmit to an external device a control signal generated based on the voice recognized by the voice recognition means 110.

[0086] For example, the control unit 130 can control the action-assist device 10 with a control signal generated based on the voice recognized by the voice recognition unit 110. For example, the control unit 130 can control the action-assist device 10 to change the action mode or assistance intensity of the action-assist device 10 according to the voice. For example, the control unit 130 can determine a product to be searched for on an e-commerce site based on the voice recognized by the voice recognition unit 110 and generate a command to search for the product on the e-commerce site.

[0087] The control unit 130 can control the communication unit 120 and transmit a signal to an external device based on the wearer's movement detected by the movement-assist device 10 or other means, thereby enabling an operation to be performed on the external device and / or information to be transmitted to the external device.

[0088] For example, the control unit 130 can perform operations on an e-commerce site via the communication unit 120 based on the wearer's movements detected by the action-assist device. For example, the control unit 130 can transmit a control signal to an external device (e.g., a server device of an e-commerce site) via the communication unit 120 so that the wearer can operate a cursor by moving the fingers wearing the action-assist device 10. For example, the control unit 130 can transmit a control signal to the external device such that the movement of the wearer's fingers and the movement of the cursor are linked, such that the cursor moves downward when the wearer flexes the fingers, moves upward when the wearer extends the fingers, moves left when the wearer abducts the fingers, and moves right when the wearer adducts the fingers. This aspect is preferable because it encourages the wearer to train. Note that the above-described linkage is merely an example, and any other linkage between the user's movements and the movement of the cursor is possible.

[0089] For example, the control unit 130 can transmit information represented by the wearer's movements to an external device (e.g., a server device of an e-commerce site) via the communication unit 120. This allows the wearer to communicate their intentions, for example, by moving the fingers or the entire hand wearing the action-assist device 10. For example, when the wearer spreads their fingers to indicate the intended size, the action-assist device 10 detects the movement, and the control unit 130 estimates the size based on the detected movement and transmits a signal indicating the size to the external device. For example, when the wearer moves their entire hand to indicate the intended size (e.g., moving their hand to trace the outer edge of the intended size or spacing their hands apart to indicate the intended size), a camera included in the display device (described below) detects the movement, and the control unit 130 estimates the size based on the detected movement and transmits a signal indicating the size to the external device. For example, when the wearer holds an object of a similar weight to indicate the intended weight, the action-assist device 10 detects the movement and magnitude of the force used when holding the object, and the control unit 130 estimates the weight based on the detected movement and magnitude of the force and transmits a signal indicating the weight to the external device.

[0090] This can be applied, for example, to searching for products with desired characteristics on an e-commerce website. For example, the control unit 130 can determine the characteristics of products to be searched for on the e-commerce website based on the wearer's movements and transmit a command to the e-commerce website's server device via the communication unit to search for products with the determined characteristics. For example, when the wearer spreads his or her fingers to indicate the desired size, the control unit 130 can determine the characteristics (i.e., size) of the products to be searched for based on the movement and transmit a command to the e-commerce website's server device to search for products with that size. For example, when the wearer holds an item of similar weight to indicate the desired weight, the control unit 130 can determine the characteristics (i.e., weight) of the products to be searched for based on the movement and transmit a command to the e-commerce website's server device to search for products with that weight. This aspect is also preferable because it encourages the wearer to train. In particular, the wearer can feel joy and satisfaction by, for example, using his or her disabled fingers to search for a desired product, which can motivate training.

[0091] For example, the control unit 130 can control the action-assist device 10 so that it acts as a resistance to the wearing part in order to represent the characteristics (e.g., hardness, ease of movement, etc.) of a product searched for on an EC site. This allows the wearer to feel the characteristics (e.g., hardness, ease of movement, etc.) of the searched product when moving the fingers wearing the action-assist device 10, and to get an idea of ​​the product before purchasing it.

[0092] The action assistance system 100 can be connected to any display device (for example, a television, a tablet terminal, etc.), thereby making it possible to display a signal received from an external device on the display device.

[0093] The display device may include a speaker, which allows it to output audio, for example, based on an audio signal received from an external device (e.g., an audio signal from a voice call or video call).

[0094] The display device may include a camera. This allows for input of video. For example, video can be input for video calls. The camera can also be used to detect the wearer's movements. In addition, to further improve the accuracy of movement detection, a depth camera may be used as the camera, or a camera may be used in combination with LiDAR.

[0095] The display device may be a component of the action assistance system 100 or may be a component external to the action assistance system 100 .

[0096] The action assistance system 100 may further include an audio output unit (not shown). The audio output unit is any unit capable of outputting audio. For example, the audio output unit may be a speaker included in the display device, or may be a speaker separate from the display device.

[0097] The audio output unit can output audio based on an audio signal received from an external device (e.g., an audio signal from a voice call or a video call), thereby enabling a call via the action assistance system 100.

[0098] The action-assistance system 100 may further include a change unit that changes the manner in which information to be presented to the wearer is presented based on the state of the wearing site of the action-assistance device 10. More specifically, the change unit may change the manner in which products on an e-commerce website are presented to the wearer based on the state of the wearing site. The state of the wearing site may be, for example, the degree of paralysis of the wearing site (e.g., Brunnstrom stage, or the degree of spasticity, rigidity, or contracture), the range of motion of the wearing site, or both. The state of the wearing site may also be, for example, the state of involuntary movement of the wearing site. The state of the wearing site may also be represented by, for example, a biosignal (e.g., signal strength) such as electromyography associated with the wearing site. For example, the change unit may change the presentation manner so that products that are too large to handle (e.g., too large to grasp) due to the range of motion or paralysis of the wearing site are presented to the wearer by lowering their search ranking. For example, the change unit may change the presentation manner so that products are presented to the wearer with a warning attached to the product indicating that the product cannot be grasped due to the range of motion or paralysis of the wearing site. For example, the change means can change the presentation mode to recommend an assistive tool for grasping products that are too large to grasp due to the range of motion or paralysis of the wearing site. For example, the change means can change the presentation mode to lower the search ranking of products that cannot be handled (e.g., cannot be operated or cannot be finely controlled) due to the involuntary movement of the wearing site (e.g., tremor), and present the products to the wearer. For example, the change means can change the presentation mode to present the products to the wearer with a warning attached to the product indicating that the product cannot be handled due to the involuntary movement of the wearing site. For example, the change means can change the presentation mode to recommend an assistive tool for handling products that cannot be handled due to the involuntary movement of the wearing site. In this way, the manner in which products on an e-commerce site are presented to the wearer is changed depending on the condition of the wearing site.

[0099] For example, the change unit may determine whether the state of the attachment part is such that the product on the EC site can be handled, and if it is determined that the state of the attachment part is not such that the product can be handled, change the manner in which the product is presented. For example, the change unit may acquire the state of the attachment part by detecting it with the action-assist device 10, or may acquire it from a database unit of a server device that stores a history of past training instructions. For example, products on the EC site are tagged in advance with the state of the attachment part that allows the product to be handled or the state of the attachment part that prevents the product from being handled, and the change unit may determine whether the state of the attachment part is such that the product on the EC site can be handled based on the tagging. The state of the attachment part that allows the product to be handled or the state of the attachment part that prevents the product from being handled can be determined, for example, from reviews and feedback of the product by other EC site users.

[0100] The change unit can be implemented by, for example, the control unit 130. After receiving information about the searched product from the server device of the EC site, the control unit 130 changes the presentation mode based on the state of the wearing part, and can present the changed presentation mode to the wearer via the display device or audio output unit of the action assistance system 100.

[0101] The change unit can be implemented, for example, by a server device of an EC site. After a product is searched for, the change unit of the server device can change the presentation mode based on the state of the wearing part when presenting the searched product to the wearer, and present the changed presentation mode to the wearer via the display device or audio output unit of the action assistance system 100.

[0102] Each component of the action-assistance system 100 may be implemented as a component separate from the action-assistance device 10, or may be mounted on the action-assistance device 10. For example, the voice recognition means 110, the communication means 120, and the control means 130 may be implemented by a processor, which may be the same as or different from the processor of the action-assistance device 10 and be mounted on the action-assistance device 10, or may be implemented as an external processor of the action-assistance device 10.

[0103] FIG. 3 shows an example of the peripheral configuration of the action assistance system 100 of the present invention.

[0104] At least one movement assistance system 100 is connected to at least one server device 200 and at least one training instruction device 400 via a network 500 .

[0105] The network 500 may be any type of network. For example, the network 500 may be the Internet or a LAN. The network 500 may be a wired network or a wireless network.

[0106] 3 shows two movement assistance systems 100, one server device 200, and two training instruction devices 400, but the numbers of the movement assistance systems 100, the server devices 200, and the training instruction devices 400 are not limited to these. Any number of movement assistance systems 100, any number of server devices 200, and any number of training instruction devices 400 can be connected via the network 500.

[0107] One action-assistance system 100 is, for example, a system used by one wearer. The wearer may be, for example, a stroke patient who has suffered a stroke, and the action-assistance device 10 of the action-assistance system 100 may be used for training the stroke patient.

[0108] One training instruction device 400 is, for example, a device used by a person who provides training (for example, a therapist (occupational therapist, etc.), a doctor, etc.). The training instruction device 400 may have a structure that mimics the part where the action-assist device 10 is worn. For example, if the action-assist device 10 is a device worn on the fingers, the training instruction device 400 may have a hand-shaped device (i.e., a robotic hand). For example, if the action-assist device 10 is a device worn on the lower limb, the training instruction device 400 may have a lower-limb-shaped device.

[0109] The server device 200 may include an interface, a processor, and a memory. The interface exchanges information with the outside of the server device 200. The processor of the server device 200 can receive information from the outside of the server device 200 and send information to the outside of the server device 200 via the interface. The interface can exchange information in any format. The processor executes the processes of the server device 200 and controls the overall operation of the server device 200. The processor reads and executes programs stored in the memory. This allows the server device 200 to function as a system that executes desired steps. The processor may be implemented by a single processor or by multiple processors. The memory stores programs required to execute the processes of the server device 200 and data required to execute the programs. The memory may store programs for processing e-commerce, programs for processing to support remote training, programs for supporting e-commerce, and the like, as described below. Here, the method for storing the programs in the memory is not critical. For example, the programs may be pre-installed in the memory. Alternatively, the program may be installed in the memory unit by being downloaded via a network. Alternatively, the program may be stored in a computer-readable storage medium and installed in the memory unit by reading the medium. The memory unit may be implemented by any storage means.

[0110] The server device 200 may be, for example, a server device of an EC site. The server device 200 is connected to a database unit 300. The database unit 300 may store information about products sold on the EC site. In the following, an example will be described in which the server device 200 is a server device of an EC site.

[0111] The server device 200 may have a configuration for e-commerce. The server device may include a means for receiving, from the motion assistance system 100, an instruction for searching for a product on an EC site. As described above, the motion assistance system 100 can determine a product to be searched for on an EC site based on the voice input to the motion assistance device 10 and generate an instruction for searching for the product on the EC site. Furthermore, the motion assistance system 100 can also determine the characteristics (e.g., size, weight) of a product to be searched for on the EC site based on the user's motion and generate an instruction for searching for a product having the characteristics on the EC site. The motion assistance system 100 transmits the generated instruction to the server device 200, and the server device 200 can receive the instruction. The receiving means may be implemented, for example, by an interface that controls communication between the server device 200 and the outside.

[0112] The server device 200 may include a means for receiving the status of the attachment site of the action-assistance device 10 of the action-assistance system 100. The status of the attachment site may be, for example, the degree of paralysis of the attachment site (e.g., Brunnstrom stage, or the degree of spasticity, rigidity, or contracture), the range of motion of the attachment site, or both. The status of the attachment site may be acquired by detection by the action-assistance device 10, or may be acquired from a database unit of the server device 200 that stores a history of past training instructions. The receiving means may be implemented, for example, by an interface that controls communication between the server device 200 and the outside.

[0113] The server device 200 may include a means for searching for a product in accordance with the received command. The server device 200 can search for the product specified by the command from the database unit 300 that stores product information.

[0114] The server device 200 may include a means for changing the manner in which the searched products are presented to the user in accordance with the received state of the attachment part. This is the above-mentioned changing means.

[0115] With the above-described configuration, the server device 200 can support e-commerce by, for example, the following process. Specifically, the processor of the server device 200 can: receive an instruction to search for products on an EC site from the movement assistance system 100; receive the status of the attachment site of the movement assistance device 10 of the movement assistance system 100; search for products according to the instruction; and change the manner in which the products are presented based on the status.

[0116] Furthermore, when changing the manner in which the product is presented based on the state, the processor of the server device 200 can further determine whether the state of the attachment part is in a state in which the product can be handled, and change the manner in which the product is presented if it is determined that the state of the attachment part is not in a state in which the product can be handled.

[0117] The server device 200 may be, for example, a server device of a service provider P that provides the movement assistance system 100. In the following, an example will be described in which the server device 200 is a server device of the service provider P that provides the movement assistance system 100.

[0118] The server device 200 can be used to support remote training.

[0119] The server device 200 can include a means for receiving the content of training instruction that the therapist has given to the user of the movement assistance system 100 and the characteristics of the therapist via the training instruction device 400, and a means for receiving the effect of the training instruction and the characteristics of the user. The content of the training instruction can be received, for example, from the training instruction device 400 via the network 500. The effect of the training instruction and the characteristics of the user can be received, for example, from the movement assistance system 100 via the network 500. These receiving means can be implemented, for example, by an interface that controls communication between the server device 200 and the outside.

[0120] The content of the training instruction includes, for example, the actions of the therapist detected by the training instruction device (e.g., the magnitude of the force applied by the therapist to the training instruction device, the duration of the force applied by the therapist to the training instruction device, the direction of the force applied by the therapist to the training instruction device, etc.). The content of the training instruction may also include, for example, instructions given by the therapist to the user. The characteristics of the therapist may include, for example, the therapist's work experience (e.g., years of work, number of patients treated, areas of strength and weakness) and the therapist's attributes (e.g., age and gender).

[0121] The effect of the training instruction may include, for example, a change in the range of motion of the fingers over time, a change in the force exerted by the fingers over time, etc. The user's characteristics may include, for example, the user's condition (e.g., the range of motion of the joints, the state of paralysis (Brunnstrom stage, or the degree of spasticity, rigidity, or contracture, etc.)), the user's attributes (e.g., age, gender), and the user's training history (e.g., the period or number of times the user U received training instruction, the period during which the user U used the action assistance system 100).

[0122] The server device 200 is connected to a database unit 300, and the received information can be stored in the database unit 300. The database unit 300 can store the characteristics of the therapist, the content of the training instruction by the therapist, the characteristics of the person receiving the training instruction, and the effect of the training instruction, in association with each other. The data stored in the database unit 300 can be used as big data. For example, by referring to the database unit 300, it becomes possible to know whether the training instruction provided by the therapist was effective, for what kind of person it was effective, and for what kind of person it was ineffective.

[0123] In one aspect, the server device 200 can be used to match a new user of the movement assistance system 100 with a therapist. In this case, the server device 200 can include a means for receiving the characteristics of the second user from the movement assistance system 100 (second movement assistance system) used by the new user (second user). The characteristics of the second user can be received, for example, from the second movement assistance system 100 via the network 500. This receiving means can be implemented by an interface that controls communication with the outside of the server device 200, similar to the above-mentioned receiving means.

[0124] The characteristics of the second user may include, for example, the condition of the second user (e.g., range of motion of a joint, state of paralysis (Brunnstrom stage, or degree of spasticity, rigidity, or contracture, etc.)), second user attributes (e.g., age, gender).

[0125] The server device 200 may include a means for determining at least one therapist to provide training guidance to the second user. The determining means may refer to the database unit 300 and determine the at least one therapist based on the characteristics of the second user. The at least one therapist may be a therapist who is compatible with the second user, a therapist who has experience in improving the symptoms of the second user, or a therapist who is skilled in providing training guidance for the symptoms of the second user. The determining means may be implemented, for example, by a processor unit of the server device 200. The database unit 300 associates the teaching experience and effects of each therapist, which enables the server device 200 to make such a determination.

[0126] In another aspect, the server device 200 can be used to match employers who wish to hire therapists with therapists. In this case, the server device 200 can include a means for receiving the requirements of the therapist to be hired from a terminal device used by the employer who wishes to hire the therapist. The requirements of the therapist to be hired can be received, for example, from the terminal device (a personal computer, a smartphone, a tablet, etc.) via the network 500. This receiving means, like the receiving means described above, can be implemented by an interface that controls communication with the outside of the server device 200.

[0127] The conditions for the therapist to be hired may include, for example, the work experience of the therapist to be hired (e.g., years of work, number of patients treated), the areas of expertise of the therapist to be hired, the areas of weakness of the therapist), and the attributes of the therapist to be hired (e.g., age, gender).

[0128] The server device 200 may include a means for determining at least one therapist to be hired. The determining means may refer to the database unit 300 and determine at least one therapist based on the conditions for a therapist to be hired. The at least one therapist may be a therapist who meets all of the conditions for a therapist to be hired, or a therapist who meets some of the conditions for a therapist to be hired. The determining means may be implemented, for example, by a processor unit of the server device 200. The database unit 300 associates the teaching experience and characteristics of each therapist, which enables the server device 200 to make such a determination.

[0129] The server device 200 can return information about the at least one determined therapist to the terminal device and present it to the employer, who can then proceed with the hiring process based on the presented information.

[0130] The server device 200 may include a means for receiving a fee from the employer in response to the employer hiring at least one determined therapist. The receiving means may receive the fee in any manner. For example, the receiving means may receive the fee by cash, card payment, cryptocurrency, account transfer, code payment, etc.

[0131] With the above-described configuration, the server device 200 can support remote training by, for example, the following process. Specifically, the processor of the server device 200 can receive the content of training instruction that the therapist has given to the user of the movement assistance system 100 via the training instruction device 400 and the characteristics of the therapist, receive the effect of the training instruction and the characteristics of the user, and store the characteristics of the therapist, the content of the training instruction by the therapist, the characteristics of the person receiving the training instruction, and the effect of the training instruction in the database unit in association with each other.

[0132] Furthermore, the processor of the server device 200 can further perform the following: receive characteristics of a second user of the second movement assistance system; and determine at least one therapist to provide training guidance to the second user based on the characteristics of the second user by referring to the information stored in the database unit. Additionally or alternatively, the processor of the server device 200 can further perform the following: receive conditions for therapists to be hired; and determine at least one therapist to be hired based on the conditions by referring to the information stored in the database unit.

[0133] In another embodiment, the server device 200 can be used to support electronic commerce. In this embodiment, the server device 200 can manage multiple action assistance systems 100 and their respective users. The server device 200 can provide users with an environment in which they can use an e-commerce site via the action assistance systems 100.

[0134] For example, the server device 200 can receive a commission from an EC site provider in response to a user purchasing a product on the EC site via the movement assistance system 100. Alternatively, the server device 200 can receive an advertising fee from a company that provides advertisements to the EC site in response to a user purchasing a product on the EC site via the movement assistance system 100. The server device 200 can receive the advertising fee by any method. For example, the server device 200 can receive the advertising fee by cash, card payment, cryptocurrency, account transfer, code payment, etc.

[0135] 4 shows an example of a flow of a process performed in the movement assistance system 100 and the server device 200 of the EC site. In this example, a process in which a user of the movement assistance system 100 purchases a product on the EC site will be described.

[0136] First, the user performs a voice input to the action-assist device 10 being worn to start a process of purchasing a product on an e-commerce site. The voice input to start the process is, for example, a combination of a specific wake word, a product to be purchased, and a word suggesting the purchase (e.g., "I want it," "Buy it," etc.). As an example, the user utters, "MELTz, I want some sneakers." As another example, the user utters, "MELTz, I want a container about this size" while making a hand gesture.

[0137] In step S401, the voice recognition means 110 of the action assistance system 100 recognizes the voice input to the action assistance device 10. The voice recognition means 110 determines an action to be taken based on the voice. For example, in the example described above, the voice recognition means 110 determines purchasing a product as the action to be taken based on the voice "MELTz, I want sneakers," and determines that the product to be purchased is "sneakers." For example, in another example described above, the voice recognition means 110 determines purchasing a product as the action to be taken based on the voice "MELTz, I want a container of this size," and the gesture, and determines that the product to be purchased is a "container" of the size recognized by the gesture.

[0138] In step S402, the control unit 130 of the action assistance system 100 generates a command for an action to be performed and transmits the command to the server device 200 via the communication unit 120. For example, in the example described above, a command for purchasing "sneakers" is transmitted to the server device 200 of the EC site. For example, in the other example described above, a command for purchasing a "container" of the size recognized by the gesture is transmitted to the server device 200 of the EC site.

[0139] In step S403, the server device 200 of the EC site searches for a product to be purchased. The server device 200 can search for the product to be purchased, for example, from product information stored in the database unit 300. For example, in the example described above, the server device 200 searches for "sports shoes." For example, in the other example described above, the server device 200 searches for "containers" of the size recognized by the gesture.

[0140] In step S404, the server device 200 of the EC site transmits information about the products found in step S403 to the action assistance system 100. For example, if multiple products are found in step S403, the server device 200 transmits information about the multiple found products to the action assistance system 100. The action assistance system 100 can present the received product information to the user. For example, the action assistance system 100 may present the product information to the user by voice, or by displaying the product information on a display device connected to the action assistance system 100. The user can refer to the presented product information and decide whether or not to purchase the product.

[0141] At this time, the action assistance system 100 can change the manner in which the product is presented based on the state of the user's wearing part. First, the action assistance system 100 receives the state of the user's wearing part. For example, the action assistance system 100 may use the state of the wearing part detected by the action assistance device 10, or may receive the state of the wearing part from a database unit that stores past training history. The action assistance system 100 determines whether the state of the wearing part is such that the product found in step S403 can be handled, and if it is determined that the state of the wearing part is not such that the product can be handled, the action assistance system 100 can change the manner in which the product is presented to the wearer. For example, if the product found in step S403 is too large to be grasped due to the range of motion or paralysis of the wearing part, the action assistance system 100 can change the presentation manner so that the product is presented to the wearer with a lower search ranking. For example, if the product found in step S403 is too large to be grasped within the range of motion or paralysis of the part of the body where the product is attached, the action assistance system 100 can change the presentation mode so that the product is presented to the wearer with a warning to the effect that the product cannot be grasped within the range of motion or paralysis of the part of the body where the product is attached. For example, if the product found in step S403 is too large to be grasped within the range of motion or paralysis of the part of the body where the product is attached, the action assistance system 100 can change the presentation mode so that the action assistance system 100 recommends an assistive tool for grasping a product that is too large to be grasped within the range of motion or paralysis of the part of the body where the product is attached. If the product found in step S403 is a product that cannot be handled (e.g., cannot be operated or cannot be finely controlled) due to the state of involuntary movement of the wearing part (e.g., a tremor state), the action assistance system 100 can change the presentation mode so that the product is presented to the wearer with a lower search ranking, or can change the presentation mode so that the product is presented to the wearer with a notice attached to the product stating that it cannot be handled due to the state of involuntary movement of the wearing part, or can change the presentation mode so that an assistive tool for handling the product that cannot be handled due to the state of involuntary movement of the wearing part is recommended.In this way, the manner in which the products found in step S403 are presented to the wearer is changed depending on the condition of the wearer's body part. This makes it possible to avoid a situation in which the user loses motivation because the product they purchased after struggling to move their limited body parts turns out to be an item that they cannot handle given their physical condition.

[0142] For example, the user can input a command to select a product and / or to purchase a product via the action-assistance device 10 worn by the user. For example, the user can input a command to purchase a product by performing a specific action requested by the action-assistance system 100 (e.g., repeating finger flexion and extension a predetermined number of times within a predetermined time, repeating finger abduction-adduction a predetermined number of times within a predetermined time, maintaining the fingers in a predetermined posture (e.g., a V-sign posture) for a predetermined time, etc.). Alternatively, when product information is displayed on a display device connected to the action-assistance system 100, the user can input a command to select a product and / or to purchase a product by operating a cursor displayed on the display device.

[0143] In step S405, the action-assist device 10 detects a user's action. The action / state detection unit of the action-assist device 10 can detect the user's action. The control unit 130 of the action-assist system 100 can generate a command for an operation on the EC site based on the detected action. The control unit 130 may generate a command, for example, every time a user's action is detected, or may generate a command after a certain action is detected.

[0144] In step S406 , the control unit 130 of the action assistance system 100 transmits the generated command to the server device 200 via the communication unit 120 .

[0145] In step S407, the server device 200 selects a product in accordance with the command and performs a purchase process for the selected product. The server device 200 can perform the purchase process for the product, for example, by using pre-acquired payment information of the user. Alternatively, the server device 200 can request the user to input payment information, and perform the purchase process for the product once the payment information is input.

[0146] In step S408, a notification that the product purchase process has been completed is sent to the action assistance system 100. The purchased product is delivered to the user.

[0147] In this way, the user can use the movement assistance system 100 to shop on an e-commerce website. Because the user can access the e-commerce website via the movement assistance device 10 that they normally wear, without needing to use a device such as a smartphone, the barrier to accessing an e-commerce website can be lowered for users who are not familiar with devices such as smartphones. Furthermore, by allowing the user to input product selection and / or product purchase through their own movements, the user's training can be promoted. This aspect is particularly preferable for users with paralysis of the fingers.

[0148] For example, in step S401, in addition to voice, a user's motion may be detected. The user's motion in this case includes at least one of a motion indicating the size of a product and a motion indicating the weight of the product. This allows the user to specify the size and / or weight of the desired product through motion. This also encourages user training and is particularly preferable for users with paralysis of the fingers.

[0149] 5A shows an example of a flow of a process performed in the movement assistance system 100 and the training instruction device 400. In this example, the movement of the user's fingers in the movement assistance system 100 is reflected in the robot hand of the training instruction device 400, and a therapist provides training instruction to the user based on this.

[0150] First, the user performs a voice input to the action-assist device 10 being worn to start the process of receiving training guidance from a therapist. The voice input to start the process is, for example, a combination of a specific wake word and a word suggesting training guidance (e.g., "Start training guidance," "Connect me to therapist AAA," etc.). As an example, the user utters, "MELTz, connect me to therapist AAA."

[0151] In step S501, the voice recognition means 110 of the movement assistance system 100 recognizes the voice input to the movement assistance device 10. The voice recognition means 110 determines an action to be taken based on the voice. For example, in the above example, the voice recognition means 110 determines that the action to be taken is to start training guidance based on the voice "MELTz, connect me to therapist AAA."

[0152] In step S502, the control means 130 of the movement assistance system 100 generates a command for an action to be performed and transmits the command to the training instruction device 400 via the communication means 120. For example, in the above example, a command for starting training instruction is transmitted to the training instruction device 400 of the therapist AAA.

[0153] In step S503, the training instruction device 400 of the therapist AAA starts training instruction in response to the command to start training instruction. For example, the training instruction device 400 starts a call (voice call or video call) with the movement assistance system 100. This allows the therapist to start training instruction for the user.

[0154] For example, a therapist instructs a user to move their fingers, and the user moves their fingers in accordance with the instructions.

[0155] In step S504, the action-assist device 10 detects the action and / or state of the user's fingers. The action / state detection unit of the action-assist device 10 can detect the action and / or state of the user's fingers. The control means 130 of the action-assist system 100 can generate a command indicating the detected action and / or state. For example, the control means 130 may generate a command every time a user action and / or state is detected, or may generate a command after a certain action and / or state is detected.

[0156] In step S505, the control unit 130 of the movement assistance system 100 transmits the generated command to the training instruction device 400 via the communication unit 120.

[0157] In step S506, the training instruction device 400 reflects the user's motion and / or state in the robotic hand in accordance with the received command. This allows the therapist to check whether the user is moving his or her fingers as instructed. Furthermore, the therapist can check the state of the user U's fingers (e.g., the degree of finger contracture).

[0158] In this way, the therapist can confirm the movement and / or condition of the user's fingers and then continue the training instruction or change the level of the training instruction. This allows the user to receive appropriate training instruction from the comfort of their own home without meeting the therapist in person. This is particularly useful in situations where face-to-face contact is limited.

[0159] 5B shows an example of a flow of a process performed in the movement assistance system 100 and the training instruction device 400. In this example, the movement of the fingers of the robot hand of the training instruction device 400 is reflected in the movement assistance device 10 of the movement assistance system 100, and the therapist moves the user's fingers to provide training instruction to the user.

[0160] First, the user performs a voice input to the action-assist device 10 being worn to start the process of receiving training instruction from a therapist. The voice input to start the process is, for example, a combination of a specific wake word and a word suggesting training instruction (e.g., "Start training instruction," "Connect me to a therapist," etc.). As an example, the user utters, "MELTz, start training instruction."

[0161] In step S511, the voice recognition means 110 of the action assistance system 100 recognizes the voice input to the action assistance device 10. The voice recognition means 110 determines an action to be taken based on the voice. For example, in the above example, the voice recognition means 110 determines that starting training instruction is the action to be taken based on the voice, "MELTz, start training instruction."

[0162] In step S512, the control means 130 of the action assistance system 100 generates a command for an action to be performed and transmits the command to the training instruction device 400 via the communication means 120. For example, in the above example, a command for starting training instruction is transmitted to the training instruction device 400.

[0163] In step S513, the training instruction device 400 of the therapist AAA starts training instruction in response to the command to start training instruction. For example, the training instruction device 400 starts a call (voice call or video call) with the movement assistance system 100. This allows the therapist to start training instruction for the user.

[0164] For example, a therapist instructs a user to move their fingers in accordance with the therapist's motion support. The user moves their fingers according to the instructions. To provide motion support, the therapist moves the fingers of the robotic hand at hand as if they were the user's fingers.

[0165] In step S514, the training instruction device 400 detects the motion and / or state of the fingers of the robotic hand. The training instruction device 400 can generate a command indicating the detected motion and / or state. For example, the training instruction device 400 may generate a command each time a motion and / or state by the user is detected, or may generate a command after a certain motion and / or state is detected.

[0166] In step S515, the training instruction device 400 transmits the generated command to the action-assist device 10. The control means 130 of the action-assist device 10 can receive the command via the communication means 120.

[0167] In step S516, the control unit 130 of the action assistance system 100 reflects the action and / or state of the robotic hand in the action assistance device 10 in accordance with the received command. This allows the user to move their fingers while receiving action assistance as if a therapist were assisting the movement of the user's fingers. The state of the user's fingers at this time may be reflected in the robotic hand, for example, by a process similar to steps S504 to S506.

[0168] In this way, a user can receive appropriate training instruction without meeting a therapist in person, for example, from the comfort of their own home, which is particularly useful, for example, in situations where face-to-face contact is limited.

[0169] Information obtained in the training instruction process described above in FIGS. 5A and 5B (e.g., the movement, force, time, etc., with which the therapist moves the training instruction device 400, or the movement, force, time, etc., with which the user moves the motion-assistance device 10 of the motion-assistance system 100) can be transmitted to the server device 200 and stored as big data.

[0170] The present invention is not limited to the above-described embodiments. It is understood that the scope of the present invention should be interpreted only by the claims. It is understood that a person skilled in the art can implement an equivalent scope based on the description of the present invention and common technical knowledge from the description of specific preferred embodiments of the present invention.

[0171] The present invention is useful for providing a movement assistance system capable of communicating with an external device.

[0172] 10 Motion assistance device 100 Motion assistance system 110 Voice recognition means 120 Communication means 130 Control means

Claims

1. A server device for supporting remote training, wherein the server device is configured to communicate with at least one operational support system and at least one training instruction device, the at least one operational support system includes a first operational support system, and the server device is Means for receiving the content of training instruction given by a therapist to a user of the first motion assistance system via the training instruction device, A means for receiving the effects of the training instruction and the characteristics of the user, A storage means for storing the content of the training instruction provided by the therapist, the characteristics of the person receiving the training instruction, and the effects of the training instruction in relation to each other. A server device equipped with the following features.

2. The at least one operation assistance system further includes a second operation assistance system, and the server device is Means for receiving the characteristics of the second user of the second operation assistance system, A means for determining at least one therapist who should provide training guidance to the second user, based on the characteristics of the second user, by referring to the information stored in the storage means. The server device according to claim 1, further comprising:

3. The server device further receives the therapist's characteristics, The server device according to claim 2, wherein the storage means stores the characteristics of the therapist, the content of the training instruction provided by the therapist, the characteristics of the person receiving the training instruction, and the effects of the training instruction in association with each other.

4. Means of receiving the requirements for therapists to be employed, A means for determining at least one therapist to be employed based on the conditions, by referring to the information stored in the storage means. The server device according to claim 3, further comprising:

5. An operation assistance system that communicates with the server device described in Claim 1, A motion assistance device configured to detect the wearer's biosignals and assist the wearer's movements based on those biosignals, A voice recognition means configured to recognize the voice input to the aforementioned operating assistance device, A communication means configured to communicate between the aforementioned operating assistance device and an external device, A control means configured to control the operation assist device and / or the communication means based on the aforementioned voice, A motion assistance system equipped with the following features.

6. A motion assistance system, A motion assistance device configured to detect the wearer's biosignals and assist the wearer's movements based on those biosignals, A voice recognition means configured to recognize the voice input to the aforementioned operating assistance device, A communication means configured to communicate between the aforementioned operating assistance device and an external device, A control means configured to control the operation assist device and / or the communication means based on the aforementioned voice, A motion assistance system equipped with the following features.

7. The operation assistance system according to claim 5 or 6, wherein the external device includes a training instruction device.

8. The motion assistance system according to claim 7, wherein the motion assistance device is configured such that the operation and / or state of the drive unit of the motion assistance device is reflected in the training instruction device, and / or the operation and / or state of the drive unit of the training instruction device is reflected in the motion assistance device.

9. The operation assistance system according to claim 5 or 6, further comprising an audio output means configured to output sound.

10. The motion assistance system according to claim 5 or 6, wherein the motion assistance device is for training stroke patients.

11. A method to support remote training, The therapist receives the content of the training instruction given to the user of the movement assistance system via the training instruction device, To receive the effects of the training instruction and the characteristics of the user, The content of the training instruction provided by the therapist, the characteristics of the person receiving the training instruction, and the effectiveness of the training instruction are stored in association with each other. A method that includes this.

12. A program for supporting remote training, wherein the program is executed on a server device equipped with a processor unit, and the program is The therapist receives the content of the training instruction given to the user of the movement assistance system via the training instruction device, To receive the effects of the training instruction and the characteristics of the user, The content of the training instruction provided by the therapist, the characteristics of the person receiving the training instruction, and the effectiveness of the training instruction are stored in association with each other. A program that causes the processor unit to perform processing including the above.

13. A method performed in a motion assistance system, wherein the motion assistance system comprises a motion assistance device, voice recognition means, and control means, and the method is The aforementioned speech recognition means recognizes speech, The control means transmits a command to the training instruction device to start training instruction based on the recognized voice, Receiving commands indicating actions and / or states from the training instruction device, In accordance with the received command, the operation and / or state is reflected in the operation assist device attached to the wearer. A method that includes this.

14. The motion assist device detects the movements and / or state of the wearer, The training instruction device receives commands indicating the actions and / or status of the wearer. The method according to claim 13, further comprising: