Hologram avatar interactive health support device
The hologram avatar interactive health support device addresses the limitations of existing systems by offering personalized health support through a single wearable device, suitable for users unfamiliar with smartphones or visually impaired, and includes heatstroke prevention, improving user comfort and accessibility.
Patent Information
- Application Number
- JP2025099243
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2025-06-13
- Publication Date
- 2025-10-02
- Estimated Expiration
- 2045-06-13
AI Technical Summary
Existing health management systems fail to consider users unfamiliar with smartphones or smartwatches, or those with visual impairments, and often require multiple devices, such as smartwatches for healthcare data management and heatstroke prevention, which can be cumbersome and uncomfortable to wear.
A hologram avatar interactive health support device that integrates biometric sensors into a wearable device, projecting a 3D hologram avatar for interaction, providing health support through voice commands, and utilizing multimodal AI for tailored health advice, with optional heatstroke prevention using fewer devices.
Enables users to receive personalized health support through interaction with a hologram avatar, accommodating those unfamiliar with smartphones or visually impaired, and provides heatstroke prevention with a single wearable device, enhancing user experience and comfort.
Smart Images

Figure 0007746623000001_ABST
Abstract
Description
[Technical Field]
[0001] The present invention relates to a health support device, and more particularly to a holographic interactive health support device that is suitable for constantly acquiring biometric information using a body-worn device and providing health support that is tailored to the user by interacting with the user through a holographic avatar in response to changes in the acquired biometric information. [Background technology]
[0002] Conventionally, health management systems have become widespread in which a sensor of a body-worn device (e.g., a smart watch terminal, a wristband terminal, etc.) is constantly worn on the wrist in contact with the skin to perform real-time measurements (e.g., Patent Document 1).
[0003] For example, systems have been developed that pair smartwatches with mobile devices such as smartphones to centrally manage users' healthcare data. Healthcare data is used for health management, exercise management, and habit development. However, while these systems can manage a large amount of healthcare data, they do not take into consideration the operation of users who are unfamiliar with smartphones or those with visual impairments.
[0004] On the other hand, while it is possible to use hologram avatar technology for interaction, this technology does not take into consideration the operation of users who are unfamiliar with smartphones or the visually impaired, and therefore cannot be implemented as is.
[0005] Examples of related patents on hologram avatar technology include Patent Documents 2, 3, and 4. Patent Document 2 discloses a system for generating medical information provision data containing necessary and sufficient information for providing medical information based on a medical interview with a patient in a virtual space. Patent Document 3 discloses an avatar communication system suitable for web conferences using avatars that use a user's facial image, with low implementation costs. Patent Document 4 discloses an apparatus for aligning three-dimensional (3D) representations for hologram / avatar control using a body-worn device. The body-worn device is a face-worn device, which has limitations on use and is not suitable for wearing 24 hours a day.
[0006] A known heatstroke prevention device is a dedicated heatstroke prevention watch (Patent Document 5) equipped with a technology called "Netsu-gamori Sensor (registered trademark)" that calculates and detects body heat. The heatstroke prevention watch measures core body temperature non-invasively by wrapping a wristband around the wrist and bringing the sensor surface into contact (adhering) with the skin.
[0007] Using two smartwatches, one for managing healthcare data and the other for preventing heatstroke, allows for health management and heatstroke prevention. However, using two smartwatches means wearing one on each arm, which can be difficult to use and uncomfortable to wear. [Prior art documents] [Patent documents]
[0008] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-120822 [Patent Document 2] Japanese Patent Application Publication No. 2025-062422 [Patent Document 3] Japanese Patent Publication No. 2022-165823 [Patent Document 4] U.S. Patent No. 1,167,5195 [Patent Document 5] Patent No. 6755034 Summary of the Invention [Problem to be solved by the invention]
[0009] In the above Patent Document 1, users who are accustomed to using smartphones will not find it inconvenient to use, but the device does not take into consideration the operation of users who are unfamiliar with smartphones or smartwatches, or users with visual impairments.
[0010] The above Patent Documents 2 to 4 have the problem that they cannot be easily introduced because they do not take into consideration the operation of users who are unfamiliar with smartphones or smartwatches or the visually impaired.
[0011] The above-mentioned Patent Document 5 has a problem in that the device is bulky because it is a dedicated heatstroke prevention watch.
[0012] The present invention has been made in consideration of the above-mentioned problems, and its object is to provide a hologram avatar interactive health support device that enables users who are unfamiliar with smartphones or smartwatches, or even those who are visually impaired, to receive health support that is tailored to the user through a dialogue between the user and a hologram avatar.
[0013] Another object is to provide a hologram avatar interactive health support device that can also prevent heatstroke using even fewer devices. [Means for solving the problem]
[0014] A holographic avatar health support apparatus according to a first aspect of the present invention is a health support apparatus for providing health support to a user, comprising: a body-worn device having a biometric information acquisition sensor for acquiring biometric information of a user, the body-worn device being worn on the user's wrist with the biometric information acquisition sensor in contact with the user's skin; collection means for collecting the biometric information acquired by the body-worn device in real time; and a management server connected to the collection means via the cloud, wherein the body-worn device comprises: avatar image generation means for generating an avatar image based on the biometric information; aerial display means for projecting the generated avatar image into the air as a three-dimensional hologram; and selection means for selecting biometric information to be monitored 24 hours a day in response to voice commands uttered by the user, and the management server comprises a dialogue engine for providing health support through a dialogue between the avatar image and the user in response to changes in the biometric information selected by the selection means, and the holographically projected avatar responds visually or audibly in accordance with the biometric information. The device continuously executes a voice dialogue with the user and changes the response of the avatar according to the biometric information acquired each time. It is characterized by:
[0015] A hologram avatar health support device according to a second invention is the hologram avatar health support device of the first invention, characterized in that the aerial display means includes any one of a MEMS mirror, a microprojector, and a diffractive optical element.
[0016] The hologram avatar type health support device according to the third invention is the first or second invention, characterized in that the body-worn device is a wristwatch type device or a bracelet type device.
[0017] A hologram avatar health support device according to a fourth invention is the third invention, further comprising a skin-attached sensor unit.
[0018] The hologram avatar health support device according to a fifth invention is the first invention, wherein the dialogue engine is configured to be able to communicate with the multimodal AI on the cloud.
[0019] A sixth aspect of the present invention provides a hologram avatar type health support device according to the first aspect of the present invention, further comprising: acquisition The sensors are characterized by including at least heart rate and core body temperature.
[0020] The hologram avatar health support device of the seventh invention is the first invention, characterized in that when the user inquires about their health condition by voice, the dialogue engine generates a response based on the latest biometric information and the avatar presents this response.
[0021] The hologram avatar type health support device of the eighth invention is characterized in that, in the first invention, the collecting means is a smartphone, a tablet, or a personal computer, and the body-worn device and the collecting means are paired by a short-range wireless interface.
[0022] The hologram avatar health support device of the ninth invention is the first invention, characterized in that the avatar presents the user with a health condition by changing its facial expression, tone of voice, or speech content based on acquired biometric information. [Effects of the Invention]
[0024] As described above, according to the present invention, even users who are unfamiliar with smartphones or smartwatches or those who are visually impaired can receive health support that is tailored to the user through interaction between the user and a hologram avatar.
[0025] Furthermore, according to the present invention, it is possible to realize a hologram avatar interactive health support device that can also take measures against heatstroke with even fewer devices. [Brief explanation of the drawings]
[0026] The drawings illustrate specific embodiments of the invention according to the present disclosure, including essential features of the invention as well as alternative and preferred embodiments. [Figure 1]FIG. 1 is a block diagram of a hologram avatar type health support device to which the present invention is applied. [Figure 2] FIG. 2 is a diagram showing an example of spatial display of a hologram avatar image by a body-wearable device according to an embodiment of the present invention. [Figure 3] FIG. 3 is a diagram showing an example of a voice dialogue regarding heart rate. [Figure 4] FIG. 4 is a diagram illustrating an example of the hardware configuration of a user terminal. [Figure 5] FIG. 5 is a diagram illustrating an example of the hardware configuration of the management server 4. As shown in FIG. [Figure 6] FIG. 6 is a diagram illustrating an example of the hardware configuration of the LLM server 5. [Figure 7] FIG. 7 is a diagram showing an example of spatial display of a hologram avatar image using a mini projector. [Figure 8] FIG. 8 is a diagram showing an example of a two-dimensional avatar image displayed on a mobile terminal. [Figure 9] FIG. 9 is a schematic diagram showing an example in which an adhesive device is added. [Figure 10] FIG. 10 is a block diagram showing an example in which an adhesive device is added. [Figure 11] FIG. 11 is a diagram illustrating an example of biometric information acquisition data. [Figure 12] FIG. 12 is a diagram showing an example of a voice command. [Figure 13] FIG. 13 is a diagram showing an example of a color adjustment voice command. [Figure 14] FIG. 14 is a flowchart of a health support method according to an embodiment of the present invention. [Figure 15] FIG. 15 is an initial setting flowchart showing an example of selecting 24-hour monitoring. [Figure 16] FIG. 16 is a flowchart of a health support method using the settings in FIG. DETAILED DESCRIPTION OF THE INVENTION
[0027] Hereinafter, an embodiment of the present invention will be described with reference to the drawings.
[0028] <Embodiment> Fig. 1 is a schematic diagram of a hologram avatar type health support device to which the present invention is applied, Fig. 2 is a diagram showing an example of spatial display of a hologram avatar image by a body-wearable device showing an embodiment of the present invention, and Fig. 3 is a diagram showing an example of a voice dialogue regarding heart rate.
[0029] In FIG. 1, the hologram avatar health support device includes user terminals 1, 2, and 3, a management server 4, an LLM server 5, a cloud 6, and a health support site .
[0030] The user terminals 1, 2, and 3 are either body-worn devices alone or terminals that combine a body-worn device with a mobile terminal paired with it. As shown in FIG. 2, the body-worn device 2a is worn on the user's wrist 21 with a biometric information acquisition sensor (not shown) in contact with the user's skin. There are two types: one with a built-in collection means that collects biometric information acquired by the body-worn device 2a in real time, and another with a collection means provided separately from the body-worn device 2a and paired with a mobile terminal. Specifically, the body-worn device 2a is a well-known wristwatch-type or bracelet-type smartwatch to which a spatial display function of a hologram avatar has been added. The user terminal 2, which serves as the collection means, is connected to a management server 4 via a cloud 6 and provides health support to the user. The body-wearable device 2a includes an avatar image generation unit that generates an avatar image based on biometric information acquired by a biometric information acquisition sensor (not shown), an aerial display unit that projects the generated avatar image into the air as a three-dimensional hologram, and a selection unit that selects the biometric information to be monitored 24 hours a day through the operation of a voice command uttered by the user. The aerial display unit includes a micro-MEMS mirror, a micro-projector, or a diffractive optical element. The micro-projector is about the size of a smartphone, allowing the user to carry the device around with them.
[0031] The management server 4 is connected to the user terminal 2 etc. via the cloud 6 and is equipped with a dialogue engine that provides health support through a dialogue between the user and an avatar image in response to changes in the biometric information selected by the selection means, and the holographically projected avatar responds visually or audibly according to the biometric information. The dialogue engine may also be configured to perform voice dialogue using natural language processing using the multimodal AI of the LLM server 5.
[0032] The LLM server 5 is a server equipped with multimodal (generative) AI. For example, it includes one or more LLMs (large language models) as general-purpose generative AI models. LLMs are natural language models constructed by learning large amounts of text data, and are used in many natural language (NLG) tasks, such as generating answers to specific questions, automatically generating sentences, and summarizing text. Examples of LLMs include: OpenAI:GPT-4o, Google:Gemini 1.5 Flash· In this embodiment, the system receives an AI request from the management server 4, as well as prompts incorporating pre-set health status interpretation logic / evaluation criteria for the multimodal AI, and a knowledge base that accumulates health-related information and expert knowledge collected from the health support site 7, and performs AI analysis of the user's biometric information, which is monitored 24 hours a day.
[0033] The cloud 6 mediates the connection between the user terminal 2 (1 or 3), the management server 4, and the LLM server 5.
[0034] Health support site 7 is a site where users who use this service register as members, accumulate biometric data from 24-hour monitoring of users, and provide health support. Personnel at management server 4 periodically access health support site 7, obtain 24-hour monitoring information for member users, and update the database in management server 4.
[0035] FIG. 4 is a diagram showing an example of the hardware configuration of the user terminal 2 in FIG. 1. The user terminal 2 may be a voice interaction-enabled mobile communication terminal, a smartphone, a tablet PC, a notebook PC, a desktop PC, or the like. In Fig. 4, the user terminal 2 has a CPU 31, a ROM 32, a RAM 33, a display 34, a biometric authentication storage unit 35, an ID / password authentication unit 36, a touch input unit 37, a communication interface 38, a camera 39, a speaker 40, and a microphone 41, and is configured to enable voice interaction by operating voice commands uttered by the user. The user terminal 2 shows the configuration of a mobile terminal, but a body-worn device also shows a similar configuration. The main difference is the configuration excluding the camera 39, and the biometric information acquisition The difference is that the sensor is located on the back of the device. acquisition The sensor is a sensor that measures heart rate, body temperature, skin galvanic response, stress index, or sleep information. acquisition The body-worn device is equipped with at least a short-range wireless communication interface, and in consideration of power consumption, the short-range wireless communication interface is preferably a low-power version of Bluetooth.
[0036] This allows users who are unfamiliar with smartphones or smartwatches, or even those with visual impairments, to receive personalized health support through interaction between the user and a hologram avatar.
[0037] FIG. 5 is a diagram illustrating an example of the hardware configuration of the management server 4 in FIG. 5, management server 4 includes a communication control unit 51, a reception unit 52, a program processing unit 53, a storage unit 54, a dialogue engine 55, a biometric information database 56, a health condition interpretation logic / evaluation criteria database 57, a health support database 58, a prompt database 59, an input unit 60, and an output unit 61. The storage unit 54 stores, in the form of software, a biometric information acquisition means, an avatar image generation means, an avatar image display control means, a voice command analysis means, and an AI request means.
[0038] FIG. 6 is a diagram illustrating an example of the hardware configuration of the LLM server 5 in FIG. 6, the LLM server 5 has a processor 62, an input unit 63, a large-scale language model 64, a memory unit 65, an output unit 66, and a communication control unit 67, and a multimodal AI module is stored in the memory unit 65. The multimodal AI module is a module that can handle voice, images, and text simultaneously.
[0039] FIG. 7 is a diagram showing an example of spatial display of a hologram avatar image using a mini projector.
[0040] 7 shows a mini-projector 71, a microphone 72 attached to the user's clothing, and a three-dimensional avatar image 73 projected by the mini-projector 71. Voice interaction is possible through the microphone 72, and the mini-projector 71 is equipped with a speaker, so voice output is also possible. As a result, under the control of the dialogue engine 55, the avatar image includes facial expressions, colors, gestures, or speech content that change according to heart rate, body temperature, electrodermal response, stress index, or sleep information.
[0041] Fig. 8 is a diagram showing an example of avatar video displayed on a mobile terminal. In the above embodiment, a holographic avatar video is displayed in the air by holographic projection, but as shown in Fig. 8, a two-dimensional avatar video may be displayed on a mobile terminal 81 held in the user's hand.
[0042] Second Embodiment FIG. 9 is a schematic diagram showing an example in which a stick-on device is added, and FIG. 10 is a block diagram showing an example in which a stick-on device is added. The second embodiment differs from the first embodiment in that an adhesive device 82 is added to the body-wearable device 2a, as shown in FIGS. 9 and 10 . The mobile terminal 81 and the body-wearable device 81 are wirelessly connected via a short-range wireless communication interface (e.g., Bluetooth (registered trademark)), and the adhesive device 82 is wirelessly connected to the mobile terminal 81 or the body-wearable device 81 via Bluetooth (registered trademark) or the like. In the following, the adhesive device 82 attached to the skin of a user 83 will be described as a core thermometer. The addition of the core thermometer shows a configuration that also includes measures against heatstroke. The alert temperature for core body temperature is set to 38.5°C, and it is recommended that the core body temperature be kept at or below 38°C. The adhesive device 82 as a core thermometer monitors 24 hours a day and outputs an alarm or a voice message when the temperature does not exceed 38°C, thereby preventing heatstroke before it occurs.
[0043] Fig. 11 is a diagram showing an example of biometric information acquisition data, and Fig. 12 is a diagram showing an example of a voice command. Fig. 13 is a diagram showing an example of a color adjustment voice command. The voice commands in Fig. 12 and Fig. 13 can be similarly applied to the first embodiment.
[0044] As shown in FIG. 11 , the acquired biological information data includes 24-hour blood oxygen level measurement data, 24-hour blood pressure measurement data, 24-hour heart rate measurement data, 24-hour stress measurement data, 24-hour body temperature measurement data, 24-hour blood glucose level measurement data, and 24-hour core body temperature measurement data. Here, the 24-hour blood oxygen level measurement data, 24-hour heart rate measurement data, 24-hour stress measurement data, and 24-hour body temperature measurement data are also measured by well-known smartwatches, so detailed explanations are omitted. Sleep measurement data may also be acquired as other measurement data. Since the accuracy of 24-hour blood glucose level measurement data provided by smartwatches is low, a patch-type device is used. Specifically, the FreeStyle Libre 2 (registered trademark) manufactured by Abbott Japan and the D7 (registered trademark) manufactured by Dexcom Inc. can be used. The Libre 2 is attached to the upper arm for measurement. The D7 is attached to the upper arm or abdomen for measurement. Real-time measurement is possible and the device is wirelessly connected via Bluetooth (registered trademark). 24-hour core body temperature measurement data can also be obtained using the adhesive device 82.
[0045] As shown in Fig. 12, when selecting a monitoring item for 24-hour monitoring, the user operates the voice command. Here, the voice command used for 24-hour blood oxygen level measurement is "Sanso", the voice command used for 24-hour blood pressure measurement is "Ketsuatsu", the voice command used for 24-hour heart rate measurement is "Shinpaku", the voice command used for 24-hour stress measurement is "Stress", the voice command used for 24-hour body temperature measurement is "Taiion", the voice command used for 24-hour blood glucose level measurement is "Ketuchi", and the voice command used for 24-hour core body temperature measurement is "Shinbutaion".
[0046] As shown in Figure 13, color adjustment voice commands include "Akaruku," "Kuraku," "Shikijaku P (Pi)," "Shikijaku D (Day)," and "Koureisha." Here, "Akaruku" means to brighten the display of the hologram avatar. "Kuraku" means to darken the display of the hologram avatar. "Shikijaku P (Pi)" means to adjust the color of pink, which is difficult for color-blind people to see. "Shikijaku D (Day)" means to adjust the color of green, which is difficult for color-blind people to see. "Koureisha" means to adjust the color that is difficult for elderly people to see.
[0047] FIG. 14 is a flowchart of a health support method according to an embodiment of the present invention. The items to be monitored for 24 hours are selected in advance using the initial setting flowchart shown in FIG.
[0048] First, the body-wearable device 2a is powered on and 24-hour monitoring is performed (step 101). Next, selected biological information is acquired and 24-hour monitoring is performed. Here, the biological information is acquired by measuring the items shown in FIG. 11 for 24 hours and storing the data. The selected biological information is acquired and uploaded to the management server in real time and stored in a database in the management server. Other biological information is periodically uploaded to the management server and stored in the database.
[0049] When an inquiry is received from a user, or when an abnormality is detected during 24-hour monitoring, an avatar image is generated (step 103), and a three-dimensional hologram avatar image is displayed in the air (step 104).
[0050] The displayed hologram avatar image is checked and the display colors are adjusted (step 105). Here, display colors that are difficult for visually impaired people or elderly people to see are adjusted. This is a kind of calibration operation that can improve visibility for users.
[0051] Health support is provided while the user and the avatar have a voice dialogue based on the acquired biometric information (step 106). The display of the avatar image is controlled by the management server.
[0052] FIG. 15 is an initial setting flowchart showing an example of selection of 24-hour monitoring items. First, the voice command of the body-wearable device 2a is activated (step 201).
[0053] The system outputs a voice message "Performing initial settings" using voice synthesis (step 202).
[0054] Next, the system outputs a voice message by voice synthesis saying, "Please select a 24-hour monitoring item" (step 203).
[0055] In response to this, the user inputs the voice message "Shinpaku" and "Shinbutaion" by speaking (step 204).
[0056] The system outputs a voice message using voice synthesis, saying "Your heart rate and core body temperature have been registered" (step 205).
[0057] The 24-hour monitoring items have been registered through the above processing steps. If there are no problems with the power supply, you can monitor all of the items in Figure 11 24 hours a day, or if you need to consider battery capacity limitations, you can extend the battery life by selecting the items you particularly want.
[0058] FIG. 16 is a flowchart of the health support method based on the initial setting of FIG.
[0059] First, the body-wearable device 2a is powered on and performs 24-hour monitoring (step 301). Next, the selected heart rate and core body temperature are acquired in real time, and 24-hour monitoring is performed.
[0060] When an abnormality is detected during 24-hour monitoring (step 303), a 3D hologram avatar image is displayed in the air (step 304).
[0061] Health support is provided while the user and the avatar have a voice dialogue based on the acquired biometric information (step 106). The display of the avatar image is controlled by the management server. Here, the avatar image outputs a voice-synthesized message according to the health status as shown in Figure 3. The avatar image can also change its facial expression under the control of the management server.
[0062] According to the second embodiment, it is possible to realize a hologram avatar interactive health support device that can also provide heatstroke prevention measures using a small number of devices.
[0063] Thus, according to this embodiment, even users who are unfamiliar with smartphones or smartwatches or those who are visually impaired can receive health support that is tailored to the user through interaction between the user and a hologram avatar.
[0064] The above-described body-wearable device can achieve the following benefits. This health support device can be used not only in everyday life but also in hospitals, clinics, nursing homes, and other facilities to monitor the health of the elderly and those with chronic diseases, and is expected to be widely adopted. It does not require external devices such as goggles, and allows users to naturally grasp their health status visually and audibly in their daily lives. Interacting with an avatar lowers the user's psychological barrier and motivates them to continue managing their health. The avatar expresses their condition through color, facial expressions, and speech, enabling intuitive understanding even without specialized knowledge. Voice conversations also make it possible to accommodate elderly and visually impaired users.
[0065] <Additional Notes> A hologram avatar interactive health support device having a switching control function in which, when it is determined that visual display of an avatar by a hologram display means is not possible, a dialogue processing unit uses a voice output means to execute a voice dialogue by the avatar. When the device or system determines that the hologram cannot be displayed properly under the current circumstances, the hologram display means: (1) when the ambient illuminance exceeds a predetermined threshold, (2) when the hologram device is not connected or is in an error state, (3) or when the remaining power is below a predetermined level, The device has a control means for automatically switching the display of the avatar to a voice interaction mode when the device determines that the hologram display is not appropriate based on conditions such as ambient illuminance, the state of the display device, the remaining power, user settings, or spatial constraints, and The hologram avatar interactive health support device is equipped with a control means that, when any of these is detected, stops the visual display of the avatar and switches to dialogue via audio output. [Explanation of symbols]
[0066] 1, 2, 3 User terminal 2a Body-worn devices 4 Management Server 5 LLM Server 6. Cloud 7 Health support sites 21 Wrist 55 Dialogue Engine 65a Multimodal AI Module 81 Mobile devices 82 Adhesive Devices
Claims
1. A health support device for providing health support to a user, the health support device comprising: a body-worn device having a biometric information acquisition sensor for acquiring biometric information of a user, the body-worn device being worn on the user's wrist with the biometric information acquisition sensor in contact with the user's skin; collection means for collecting the biometric information acquired by the body-worn device in real time; and a management server connected to the collection means via a cloud, The body-wearable device comprises: an avatar image generating means for generating an avatar image based on the biometric information; aerial display means for projecting the generated avatar image into the air as a three-dimensional hologram; a selection means for selecting biological information to be monitored 24 hours a day by a voice command operation uttered by a user, The management server is a dialogue engine that provides health support through dialogue between the avatar image and the user in response to changes in the biological information selected by the selection means; Equipped with A hologram avatar type health support device characterized in that the hologram projected avatar responds visually or audibly according to the biometric information, and the device continuously carries out voice dialogue with the user, changing the avatar's response according to the biometric information acquired each time.
2. 2. The hologram avatar type health support device according to claim 1, wherein the aerial display means includes any one of an MEMS mirror, a microprojector, and a diffractive optical element.
3. 3. The hologram avatar type health support device according to claim 1, wherein the body-wearable device is a wristwatch type device or a bracelet type device.
4. 4. The hologram avatar type health support device according to claim 3, further comprising a skin-attachable sensor unit.
5. The hologram avatar type health support device according to claim 1, characterized in that the dialogue engine is configured to be able to communicate with the multimodal AI on the cloud.
6. 2. The hologram avatar type health support device according to claim 1, wherein the biological information acquisition sensor includes at least a heart rate and a core body temperature.
7. The hologram avatar type health support device according to claim 1, characterized in that when the user inquires about their health condition by voice, the dialogue engine generates a response based on the latest biometric information and the avatar presents this response.
8. The hologram avatar type health support device according to claim 1, characterized in that the collecting means is a smartphone, a tablet, or a personal computer, and the body-wearable device and the collecting means are paired via a short-range wireless interface.
9. 2. The hologram avatar type health support device according to claim 1, wherein the avatar presents the user with a health condition by changing facial expression, tone of voice, or speech content based on the acquired biometric information.
Citation Information
Patent Citations
A system that utilizes physiological monitoring and electronic media to improve health.
JP2013509205A
Information processing system, information processing method, and recording medium
JP2021128350A
Method for embodying avatar, computer program, and computing device
JP2023123398A
Method and system for providing user-customized ordering process based on a multimodal ai kiosk device
KR102788570B1
Method of providing health information using electronic device and the electronic device
US20240203577A1
Cited By
Hologram projection wearable communication terminal with AI variable optical control
JP7874931B1