Oral device and meal simulation system

Abstract

This system provides a meal simulation that uses sight, smell, and taste to simulate the experience of eating, thereby stimulating motivation for safe and nutritious meals. [Solution] The meal simulation system comprises a goggle device worn on the user's head and capable of displaying images of a virtual body corresponding to the user's movements in real space; an oral device worn in the user's mouth and capable of releasing a taste or aroma corresponding to predetermined identification information into the user's mouth when such information is received; and a control device.

Description

Technical Field

[0001] The present invention relates to an intraoral device and a meal simulation system.

Background Art

[0002] In an aging society, the divergence between the average life span and the healthy life span (the period without restrictions in daily life) has been a problem. To extend the healthy life span, it is necessary to maintain motor functions. Also, for maintaining motor functions, nutritional intake through diet is important.

[0003] Patent Document 1 describes a technique that can give a pseudo-chewing texture without giving the user a sense of discomfort even when chewing a nursing food with poor texture. This can improve the satisfaction and enjoyment of meals and maintain and improve chewing ability.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The elderly, patients, etc. who have undergone digestive tract surgery may sometimes be unable to ingest food temporarily. Also, there is a risk of aspiration such as choking due to dysphagia, and there are cases where they cannot eat safely. Then, the desire for food may decrease, and it may become increasingly difficult to eat safely.

[0006] The present invention has been made in view of such problems, and provides an intraoral device and a meal simulation system capable of eliciting the desire for meals for safe nutritional intake by providing a pseudo-experience of meals using vision, smell, and taste.

Means for Solving the Problems

[0007] According to a first aspect of the present invention, the meal simulation system comprises a goggle device worn on the user's head and capable of displaying an image of a virtual body corresponding to the user's movements in real space; an in-mouth device worn in the user's mouth and capable of releasing a taste or aroma corresponding to predetermined identification information into the user's mouth when such information is received; and a control device, the control device comprising: a display processing unit that displays one or more types of virtual food to the user through the goggle device; an identification information acquisition unit that acquires identification information indicating the type of virtual food corresponding to the location to which the user's eating utensils are carried in real space; and a transmission unit that transmits the acquired identification information to the in-mouth device worn in the user's mouth when the eating utensils are brought to the user's mouth.

[0008] According to a second aspect of the present invention, in the meal simulation system according to the first aspect, when the oral device receives the identification information, and when it senses the user's chewing motion following the reception, it releases a taste or aroma corresponding to the identification information into the user's mouth.

[0009] According to a third aspect of the present invention, the meal simulation system according to the first or second aspect further comprises a plate device having a receiving surface that is subject to the superimposed display of virtual food by the goggle device, and incorporating a sensor capable of sensing the position of the eating utensil as it approaches on the receiving surface.

[0010] According to a fourth aspect of the present invention, in a meal simulation system according to any one of the first to third aspects, when the eating utensil is brought to the location of the virtual food in real space, the display processing unit superimposes an image showing at least a part of the virtual food in accordance with the movement of the eating utensil.

[0011] According to a fifth aspect of the present invention, a meal simulation method is performed using a goggle device worn on the head of a user and capable of displaying an image of a virtual body corresponding to the user's movements in real space, and an oral device worn in the mouth of a user and capable of releasing a taste or aroma corresponding to predetermined identification information into the user's mouth when such information is received, the method comprising: displaying one or more virtual foods to the user through the goggle device; acquiring identification information of the virtual food corresponding to the location where the user's eating utensils are carried in real space; and transmitting the acquired identification information to the oral device worn in the user's mouth when the eating utensils are brought to the user's mouth.

[0012] According to a sixth aspect of the present invention, the program causes a computer in a meal simulation system, which includes a goggle device worn on the user's head and capable of displaying an image of a virtual body corresponding to the user's movements in real space, and an in-mouth device worn in the user's mouth and capable of releasing a taste or aroma corresponding to predetermined identification information into the user's mouth when it receives such information, to perform the following steps: display one or more virtual foods to the user through the goggle device; acquire identification information of the virtual food corresponding to the location where the user's eating utensils are carried in real space; and transmit the acquired identification information to the in-mouth device worn in the user's mouth when the eating utensils are brought to the user's mouth. [Effects of the Invention]

[0013] According to the oral device and meal simulation system of the present invention, by using sight, smell, and taste to simulate the experience of eating, it is possible to stimulate the desire to eat in order to safely obtain nutrition. [Brief explanation of the drawing]

[0014] [Figure 1] It is a diagram showing the overall configuration of the meal simulation system according to the first embodiment. [Figure 2] It is a diagram showing the configuration of the control device according to the first embodiment. [Figure 3] It is a diagram showing the configuration of the intraoral device according to the first embodiment. [Figure 4] It is a diagram showing the processing flow of the meal simulation system according to the first embodiment. [Figure 5] It is a diagram showing the overall configuration of the meal simulation system according to the second embodiment.

Mode for Carrying Out the Invention

[0015] <First Embodiment> Hereinafter, the meal simulation system according to the first embodiment of the present invention will be described with reference to FIGS. 1 to 4.

[0016] (Overall Configuration of Meal Simulation System) FIG. 1 is a diagram showing the overall configuration of the meal simulation system according to the first embodiment. The meal simulation system 1 shown in FIG. 1 is for user A who cannot take meals due to, for example, digestive surgery or dysphagia to perform meal training while taking nutrition.

[0017] As shown in FIG. 1, the meal simulation system 1 includes a control device 10, a goggle device 11, an intraoral device (mouthpiece type device) 12, a plate device 13, and a chopstick type device 14.

[0018] The goggle device 11 is worn on the head of user A and is capable of displaying an image of a virtual body according to the movement of the user in the real space (so-called AR and MR technologies are applied).

[0019] The intraoral device 12 is configured to be worn in the mouth of user A and to emit a taste or scent corresponding to the received identification information into the user's mouth when receiving the predetermined identification information from the external (control device 10).

[0020] The dish device 13 has a receiving surface that is the target of the superimposed display of virtual food by the goggle device 11. The dish device 13 incorporates a contact sensing sensor capable of sensing the position where the eating utensil (the chopstick-shaped device 14 described later) contacts on the receiving surface.

[0021] The chopstick-shaped device 14 is shaped like a real chopstick and is gripped by the user. At the tip of this chopstick-shaped device 14, a contact sensing member is provided to sense contact with the contact sensing sensors provided in the dish device 13 and the intraoral device 12. The chopstick-shaped device 14 is one aspect of the eating utensil in the present embodiment. In other embodiments, as the eating utensil, instead of the chopstick-shaped device 14, a fork-shaped device or a spoon-shaped device having a contact sensing member at the tip may be used.

[0022] (Configuration of the control device) FIG. 2 is a diagram showing the configuration of the control device according to the first embodiment. The control device 10 is a computer that controls the entire meal simulation system 1. The control device 10 may be a general computer including a CPU 100, a memory 101, and a communication interface 102.

[0023] The CPU 100 is a processor that exhibits various functions according to a pre-prepared program (application).

[0024] The memory 101 is a storage area that holds the instructions and data necessary for the operation of the CPU 100.

[0025] The communication interface 102 is an interface for performing wireless communication with the above-described various devices.

[0026] As shown in Figure 2, the CPU 100 of the control device 10 performs the functions of a display processing unit 1000, an identification information acquisition unit 1001, and a transmission unit 1002.

[0027] The display processing unit 1000 displays one or more types of virtual food (for example, a steak dish consisting of steak meat and side dishes) to user A through the goggle device 11. The display processing unit 1000 displays the virtual food so that it is superimposed on the receiving surface of the plate device 13. This makes it appear to user A that a meal is served on a plate.

[0028] The identification information acquisition unit 1001 acquires identification information indicating the type of virtual food corresponding to the location of contact when it detects that the tip (contact sensing member) of the chopstick-shaped device 14 held by user A has made contact with any position on the receiving surface of the plate device 13. For example, if the tip of the chopstick-shaped device 14 touches the position on the receiving surface of the plate device 13 where "steak" is displayed, the identification information acquisition unit 1001 acquires identification information corresponding to "steak". Also, if the tip of the chopstick-shaped device 14 touches the position on the receiving surface of the plate device 13 where "side dish" is displayed, the identification information acquisition unit 1001 acquires identification information corresponding to "side dish".

[0029] When the tip of the chopstick-shaped device 14 is brought to the mouth of user A, the transmission unit 1002 transmits the identification information acquired by the identification information acquisition unit 1001 to the oral device 12 that is attached to the mouth of the user A.

[0030] In this embodiment, the control device 10 is described as a separate computer from the other devices, as shown in Figure 1, but this is not the only embodiment. In other embodiments, the control device 10 may be implemented in one of the goggle device 11, the oral device 12, the plate device 13, or the chopstick-shaped device 14, or the functions of the control device 10 described above may be implemented across multiple types of other devices.

[0031] (Configuration of an intraoral device) Figure 3 shows the configuration of an oral device according to the first embodiment. As shown in Figure 3, the oral device 12 comprises a mouthpiece portion 120 and a tank portion 121.

[0032] The mouthpiece portion 120 is fitted inside the mouth of user A. The mouthpiece portion 120 is equipped with a chewing sensor 120A for detecting chewing movements.

[0033] The tank section 121 includes a contact sensing sensor 121a, a plurality of tanks 121b, and actuators 121c. The contact sensing sensor 121a is a sensor that detects contact with the tip portion (contact sensing member) of the chopstick-shaped device 14.

[0034] Tank 121b contains several types of sensory-forming materials. These sensory-forming materials include taste-forming materials (sweeteners, acidulants, salts, umami agents, bittering agents, etc.) and olfactory-forming materials (food scents).

[0035] The actuator 121c is a drive member for delivering the sensory-forming material contained in each tank 121b to the mouth (mouthpiece portion 120) of user A in response to an electrical signal. For example, if the sensory-forming material is contained in tank 121b in a liquid state, the actuator 121c delivers the liquid sensory-forming material into the mouth. Alternatively, if the sensory-forming material is contained in tank 121b in a gaseous state, the actuator 121c may deliver the gaseous sensory-forming material into the mouth. Furthermore, the actuator 121c may process the liquid sensory-forming material into a gaseous (smoke-like) form before delivering it into the mouth.

[0036] (Processing flow of the meal simulation system) Figure 4 shows the processing flow of the meal simulation system according to the first embodiment. The processing flow shown in Figure 4 is executed repeatedly during the operation of the meal simulation system 1.

[0037] The display processing unit 1000 of the control device 10 displays the food (virtual food) on the receiving surface of the plate device 13 through the goggle device 11 (step S1). Then, user A performs the action of picking up the virtual food on the plate device 13 with the chopstick-shaped device 14 while looking at the image displayed on the goggle device 11.

[0038] Next, the identification information acquisition unit 1001 of the control device 10 detects which food item the tip of the chopstick-shaped device 14 touched among the dishes displayed on the receiving surface of the plate device 13 (i.e., which food item user A selected), and acquires identification information indicating the type of food item (step S2). For example, if the tip of the chopstick-shaped device 14 touches the position on the receiving surface of the plate device 13 where "steak" is displayed, the identification information acquisition unit 1001 acquires identification information corresponding to "steak".

[0039] The display processing unit 1000 of the control device 10 updates the image of food displayed on the goggle device 11 to display an image of the food being picked up with chopsticks, corresponding to the identification information acquired in step S2 (step S3). For example, if the identification information corresponding to "steak" is acquired in step S2, the display processing unit 1000 displays an image of "steak" being picked up with chopsticks on the goggle device 11. The display processing unit 1000 also updates the image of "steak" superimposed on the receiving surface of the plate device 13 so that it switches to an image of "steak" with a portion of the chopsticks missing. When user A sees the image of food being picked up with chopsticks, they bring the tip of the chopstick-shaped device 14 closer to their mouth. At this time, the display processing unit 1000 may sequentially update and display the image on the goggle device 11 so that the image of the food being picked up with chopsticks moves in accordance with the movement of the chopstick-shaped device 14.

[0040] The oral device 12 detects when the tip of the chopstick-shaped device 14 makes contact with it using a contact sensing sensor 121a provided in the tank section 121 (step S4). The oral device 12 then notifies the control device 10 of the contact by the chopstick-shaped device 14.

[0041] Next, when the control device 10's transmitting unit 1002 detects contact between the chopstick-shaped device 14 and the oral-insertable device 12, it transmits the identification information acquired in step S2 to the oral-insertable device 12 (step S5).

[0042] Furthermore, user A brings the tip of the chopstick-shaped device 14 close to their mouth and then performs a chewing motion. The oral device 12 then detects the user's chewing motion using the chewing sensor 120A in the mouthpiece portion 120 and releases a sensory-forming material corresponding to the identification information received from the control device 10 into the mouthpiece portion 120 (step S6). For example, if the control device 10 receives identification information corresponding to "steak," it releases a sensory-forming material corresponding to "steak." This sensory-forming material may contain only one of either a taste-forming material or an olfactory-forming material, or both. This allows user A to obtain a realistic sensation similar to that of actual eating.

[0043] (Effects and Benefits) As described above, in the meal simulation system 1 according to this embodiment, the control device 10 displays virtual food on the goggle device 11 and transmits identification information corresponding to the type of virtual food to the oral device 12, causing the taste or aroma to be released into the user's mouth.

[0044] With this configuration, the meal simulation system 1 can provide user A with a realistic simulated experience of eating a real meal through sight, taste, and smell. As a result, the meal simulation system 1 can give user A a sense of satisfaction from eating and stimulate user A's desire to eat.

[0045] Furthermore, in the meal simulation system 1 according to this embodiment, the oral device 12 senses the chewing motion of user A and releases a sensory-forming material into the user's mouth according to the identification information.

[0046] With this configuration, the meal simulation system 1 can give user A the feeling that they are eating real food.

[0047] Furthermore, the meal simulation system 1 according to this embodiment has a receiving surface on which an image of virtual food is superimposed by a goggle device 11, and a plate device 13 that incorporates a sensor capable of detecting when a chopstick-shaped device 14 approaches the receiving surface.

[0048] With this configuration, the meal simulation system 1 can detect which of the multiple foods included in the virtual meal the user A has brought the chopstick-shaped device 14 close to (selected), and provide the user A with a sensation corresponding to the food A has selected. In addition, the user A can experience the sensation of eating multiple foods in a single meal simulation. As a result, the meal simulation system 1 can further improve the user A's satisfaction with and motivation for eating.

[0049] Furthermore, in the meal simulation system 1 according to this embodiment, when the chopstick-shaped device 14 is moved to the position of the virtual food, the control device 10 superimposes an image showing a part of the virtual food (for example, an image of picking up food with chopsticks) in accordance with the movement of the chopstick-shaped device 14.

[0050] With this configuration, the meal simulation system 1 can provide user A with a realistic experience, as if they were actually picking up and eating real food with chopsticks.

[0051] In the above-described embodiment, the processes of various operations of the control device 10 are stored in program form on a computer-readable recording medium, and the various operations are performed by the computer reading and executing this program. The computer-readable recording medium refers to magnetic disks, magneto-optical disks, CD-ROMs, DVD-ROMs, semiconductor memory, etc. Alternatively, this computer program may be distributed to a computer via a communication line, and the computer that receives the distribution may execute the program.

[0052] The above program may be intended to implement some of the functions described above. Furthermore, it may be a so-called differential file (differential program) that can implement the above functions in combination with a program already recorded in the computer system. In addition, the functions of the control device 10 may be implemented using cloud computing.

[0053] As described above, several embodiments relating to this disclosure have been explained, but all of these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be carried out in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents.

[0054] <Example 1> In the above-described embodiment, the meal simulation system 1 was explained using an example in which it has only one goggle device 11 that is worn on the head of user A, but it is not limited to this. For example, if user A is unable to eat alone, a caregiver may assist user A with eating. To be applicable in such cases, the meal simulation system 1 may have multiple goggle devices 11. Modification 1 describes an example in which the meal simulation system 1 has two goggle devices: a first goggle device 11 worn on the head of user A and a second goggle device 11 worn on the head of the caregiver.

[0055] In Modification 1, the caregiver operates the chopstick-shaped device 14 on behalf of user A to pick up virtual food from the plate device 13 and bring it to user A's mouth. In addition, the display processing unit 1000 of the control device 10 synchronizes the display of images of virtual food on both the first goggle device 11 worn by user A and the second goggle device 11 worn by the caregiver during steps S1 and S3 of Figure 4. The images displayed on the first goggle device 11 and the second goggle device 11 are adjusted to show different angles of the same virtual food, according to the viewpoint positions of the caregiver and user A, respectively. By displaying images on both the first and second goggle devices 11 in this way, the caregiver and user A can share the same information about the virtual food (what kind of food is on the plate device 13, which food was brought to user A's mouth, etc.). As a result, user A, who requires assistance, can have a simulated experience that is similar to eating a real meal.

[0056] <Modification 2> Furthermore, although the above embodiment described an example in which a sensory-forming material corresponding to food is contained in the tank 121b of the oral device 12, the invention is not limited to this. In Modification 2, the tank 121b of the oral device 12 may further contain a deodorizing material that eliminates the smell of food.

[0057] In variation 2, for example, the virtual food displayed via the goggle device 11 includes a palate cleanser drink or food such as "water" or "sherbet." When user A performs the action of eating the palate cleanser food, a deodorizing material is sent to the mouthpiece portion 120 of the oral device 12, eliminating the smell of the virtual food that user A just ate.

[0058] Here, we will describe an example where "sherbet" is provided as a palate cleanser. In step S1 of Figure 4, the display processing unit 1000 of the control device 10 displays an image of "sherbet" as one of the virtual foods.

[0059] In step S2 of Figure 4, the identification information acquisition unit 1001 of the control device 10 detects that the tip of the chopstick-shaped device 14 (which may also be a spoon-shaped device) has touched the "sherbet" display position and acquires the identification information corresponding to "sherbet".

[0060] Steps S3 to S5 in Figure 4 are the same as in the embodiment described above.

[0061] Furthermore, in step S6 of Figure 4, the oral device 12 releases a deodorizing material corresponding to the "sherbet" identification information received from the control device 10 into the mouthpiece portion 120.

[0062] The smell of food can evoke the taste of food in user A. Therefore, the meal simulation system 1 can give user A the experience of eating food by delivering an olfactory-forming material into user A's mouth. On the other hand, the meal simulation system 1 can also deliver a deodorizing material into user A's mouth to eliminate the smell of the food eaten immediately before, allowing user A to better enjoy the next food they eat. This prevents the mixing of different food smells in user A's mouth, which could reduce user A's appetite.

[0063] Furthermore, if "water" is provided as a drink to take a break between bites, the meal simulation system 1 may have a cup-shaped device in addition to the chopstick-shaped device 14, on which an image of "water" is superimposed. In this case, in step S2 of Figure 4, when the identification information acquisition unit 1001 of the control device 10 detects that user A lifts the cup-shaped device, it acquires identification information corresponding to "water". The process flow thereafter is the same as in the modified example 2 described above.

[0064] <Second Embodiment> Hereinafter, a meal simulation system according to the first embodiment of the present invention will be described with reference to Figure 5.

[0065] Figure 5 shows the overall configuration of the meal simulation system according to the second embodiment. As shown in Figure 5, the control device 10 of the meal simulation system 1 according to the second embodiment has a built-in recording medium containing multiple types of chewing sounds and chewing tactile information D (hereinafter also simply referred to as "chewing sound information D"). Furthermore, the oral device 12 of the meal simulation system 1 according to the second embodiment further comprises a bone conduction device 122.

[0066] The control device 10 is capable of communicating with the bone conduction device 122 of the oral-wearable device 12. In the second embodiment, the control device 10 and the bone conduction device 122 may be connected by a wire, or they may transmit and receive information via wireless communication. Chewing sound information D is audio data consisting of recordings of chewing sounds for various foods (steak, fried chicken, salad, etc.). This audio data is prepared in advance for each food and recorded as audio data on the recording medium built into the control device 10.

[0067] The bone conduction device 122 is one form of sound transmission. Specifically, the control device 10 converts the chewing sound information D, which is sound data, into vibration information and transmits it to the bone conduction device 122. The bone conduction device 122 receives this vibration information and generates vibrations. User A perceives the chewing sound by sensing these vibrations through the bone. In other words, the bone conduction device 122 functions as a bone conduction speaker that transmits sound through the bones of user A (rather than through the eardrum). As a result, user A directly perceives the chewing sound of food through the bones from the vibrations of the oral-worn device 12.

[0068] The flow of the meal simulation using the meal simulation system 1 of the second embodiment will be described.

[0069] In the second embodiment of the meal simulation system 1, the control device 10 further plays chewing sound information D (audio data) via the bone conduction device 122 during the processing of step S6 in Figure 5. Here, the control device 10 uses the identification information (information indicating the type of food) obtained in step S2 to play the chewing sound information D corresponding to that identification information. For example, if user A selects "fried chicken" on the receiving surface of the plate device 13 in step S2, the control device 10 acquires identification information indicating "fried chicken". Then, when the control device 10 senses user A's chewing motion in step S6, it plays the chewing sound information D corresponding to "fried chicken" via the bone conduction device 122.

[0070] As described above, according to the meal simulation system 1 of the second embodiment, the release of a sensory-forming material and the playback of chewing sounds are triggered by the chewing motion of user A. Furthermore, the playback of chewing sounds is performed by bone conduction via the oral-wearable device 12 (bone conduction device 122). In this way, user A not only perceives the chewing sounds aurally, but also feels the vibrations that are the source of the chewing sounds themselves (in the mouth) through touch. As a result, user A can simulate the sensation of actually chewing food based on both sound and vibration information. Therefore, according to the meal simulation system 1 of this embodiment, user A can obtain a sensation that is closer to that of an actual meal.

[0071] <Modified form of the second embodiment> In the second embodiment described above, the playback of chewing sounds is triggered by the chewing motion of user A, but other embodiments are not limited to this approach.

[0072] For example, in a modified version of the second embodiment, the meal simulation system 1 plays video data showing a person chewing food in response to an operation (start playback) by a caregiver on the control device 10. The video information of this video data is transmitted by a goggle device, and the audio information (chewing sounds) of the video data is transmitted via an oral-wearing device 12 (bone conduction device 122).

[0073] The caregiver encourages user A to perform chewing movements in accordance with the movements in the video (video and audio of chewing food). When user A performs chewing movements in accordance with the movements in the video, the meal simulation system 1 uses that chewing movement as a trigger to release sensory-forming material from the oral device 12.

[0074] This approach makes it possible to conduct more effective feeding training for patients with dementia or those with significantly impaired swallowing function (patients who have difficulty swallowing food).

[0075] The features of the meal simulation system 1 according to the second embodiment and its modified form are summarized as follows. That is, the oral device 12 in the meal simulation system 1 according to the second embodiment and its modified form further comprises means for transmitting sound and tactile information. One form of this means for transmitting sound and tactile information is a bone conduction device 122. In the second embodiment and its modified version, the control device 10 in the meal simulation system 1 transmits the sounds of chewing food and the sensory information of chewing food as vibration information via a sound transmission means (bone conduction device 122). [Explanation of Symbols]

[0076] 1. Meal Simulation System 10 Control device 11. Goggle devices 100 CPU 1000 Display Processing Unit 1001 Identification Information Acquisition Unit 1002 Transmitter 101 memory 102 Communication Interface 12. Oral devices (mouthpiece-type devices) 120 Mouthpiece section 120A Chewing Sensor 121 Tank section 121a Contact detection sensor 121b Tank 121c actuator 122 Bone conduction devices (means of sound transmission) 13 Plate Devices 14 Chopstick-shaped devices D. Chewing sounds and tactile information of chewing.

Claims

1. An oral device that is placed inside the user's mouth, A means for releasing flavor or aroma into the user's mouth in response to the user's chewing motion, A transmission means that receives audio information and / or vibration information and reproduces audio and / or vibration based on the received audio information and / or vibration information, An oral device equipped with the following features.

2. The transmission means is a bone conduction device. The oral device according to claim 1.

3. When identification information indicating the type of food is obtained, the system releases a taste or aroma corresponding to that identification information. The oral device according to claim 1 or claim 2.

4. An oral device according to claim 1 or claim 2, A display device capable of displaying video information contained in video data showing the act of chewing food, Equipped with, The transmission means of the oral device receives the video data and reproduces sound and / or vibration based on the sound information and / or vibration information contained in the received video data. A meal simulation system.

Images