Necklace-type terminal and data processing system

Abstract

To provide a necklace-type terminal and data processing system that suppress the occurrence of health problems for users. [Solution] The necklace-type terminal comprises a collection unit that collects the output of a microphone that captures the wearer's speech, and an execution unit that uses the collected output to perform a health problem suppression process that presents suggested information for suppressing the occurrence of health problems in at least one of the wearer's mental health and physical health.

Description

Technical Field

[0001] The technology of the present disclosure relates to a necklace-type terminal and a data processing system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] However, in the prior art, there is room for improvement in suppressing the occurrence of health problems of users.

Means for Solving the Problems

[0005] A first aspect according to the technology of the present disclosure is a necklace-type terminal including a collection unit that collects an output of a microphone that picks up an utterance of a wearer, and an execution unit that executes a health problem suppression process for presenting proposal information for suppressing the occurrence of at least one of mental and physical health problems of the wearer using the collected output.

[0006] A second aspect of the technology of this disclosure is a necklace-type terminal of the first aspect, wherein the mental health problem is an increased feeling of loneliness, and the physical health problem is a decline in cognitive function.

[0007] A third aspect of the technology of this disclosure is a necklace-type terminal according to the first or second aspect, wherein the collection unit further collects the output of a biosensor that detects the wearer's biometric data, and the execution unit performs a process as the health problem suppression process that uses the collected biometric data to present suggested information for suppressing the occurrence of the wearer's physical health problems.

[0008] A fourth aspect of the technology of the present disclosure is a necklace-type terminal of the third aspect, wherein the biometric data is at least one of heart rate, blood oxygen saturation, body temperature, and sleep pattern.

[0009] A fifth aspect of the technology of this disclosure is a necklace-type terminal according to the first or second aspect, wherein the collection unit further collects the output of at least one of a position detection unit that detects the position of the wearer and a fall sensor that detects the wearer's fall state, and the execution unit performs a process as the health problem suppression process that uses at least one of the collected position and fall state to present suggested information for suppressing the occurrence of the wearer's physical health problems.

[0010] A sixth aspect of the technology of this disclosure is a necklace-type terminal of the first or second aspect, wherein the wearer is an elderly person of a predetermined age or older.

[0011] A seventh aspect of the technology of this disclosure is a necklace-type terminal according to the first or second aspect, further comprising a communication unit that transmits the output collected by the collection unit to a data processing unit, wherein the execution unit performs the health problem suppression process using the response from the data processing unit corresponding to the transmitted output.

[0012] An eighth aspect of the technology of the present disclosure is a data processing system including a necklace-type terminal of the seventh aspect and a data processing device, the data processing device including an input unit that receives the output transmitted by the communication unit, a processing unit that inputs a prompt including information corresponding to the received output to a data generation model and obtains a response for executing the health problem suppression processing using the output of the data generation model, and an output unit that outputs the obtained response to the necklace-type terminal.

[0013] A ninth aspect of the technology of the present disclosure is a data processing system of the eighth aspect, wherein the output unit outputs information to the wearer's associates indicating that there is a problem if the output of the data generation model is an output relating to a problem with the wearer's health.

[0014] A tenth aspect of the technology of this disclosure is a data processing system of the eighth or ninth aspect, wherein the output unit outputs information to the necklace-type terminal indicating that there is a problem with cognitive function when the output of the data generation model is an output relating to a decline in the wearer's cognitive function.

[0015] An eleventh aspect of the technology of this disclosure is a data processing system of the eighth or ninth aspect, wherein the input unit further receives the wearer's profile information, and the processing unit inputs a prompt including information corresponding to the received output and the profile information to the data generation model, and uses the output of the data generation model to obtain a response for executing the health problem suppression processing. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system. [Figure 2] This is a conceptual diagram showing an example of the main functions of a data processing device and a necklace-type terminal. [Figure 3] This is a side view showing the configuration of a necklace-type terminal. [Figure 4] It is a top view showing the configuration of a necklace-type terminal. [Figure 5] Schematically shows the functional configuration of the control unit of the necklace-type terminal according to the first embodiment. [Figure 6] Schematically shows the functional configuration of the specific processing unit of the data processing device. [Figure 7] Schematically shows an example of the operation flow of specific processing by the data processing device according to the first embodiment. [Figure 8] It is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 9] Schematically shows the functional configuration of the control unit of the necklace-type terminal according to the second embodiment. [Figure 10] It is a sequence diagram showing the flow of the first specific processing by the data processing system according to the second embodiment. [Figure 11] It is a sequence diagram showing the flow of the second specific processing by the data processing system according to the second embodiment. [Figure 12] Schematically shows an example of the operation flow of processing by the necklace-type terminal according to the second embodiment. [Figure 13] Schematically shows an example of the operation flow of the first specific processing by the data processing device according to the second embodiment. [Figure 14] Schematically shows an example of the operation flow of the second specific processing by the data processing device according to the second embodiment.

Embodiments for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a data processing device, a data processing method, and a program according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0018] First, the terms used in the following description will be explained.

[0019] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), or an APU (Accelerated Processing Unit).

[0020] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a necklace-type terminal 14. An example of the data processing device 12 is a server. In this embodiment, the data processing device 12 is an example of a "data processing device" according to the technology of this disclosure, and the necklace-type terminal 14 is an example of a "necklace-type terminal" according to the technology of this disclosure.

[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The necklace-type terminal 14 includes a computer 36, a microphone 38, a sensor 39, a speaker 40, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 38, sensor 39, speaker 40, camera 42, and communication interface 44 are also connected to the bus 52.

[0028] The user 20 wearing the necklace-type terminal 14 may be, for example, a patient whose health condition is being diagnosed, or a regular user.

[0029] The microphone 38 picks up the voice emitted by the user 20, who is wearing the necklace-type terminal 14, as well as sounds around the user 20. The microphone 38 also receives instructions from the user 20 by receiving the voice emitted by the user 20. The microphone 38 captures the voice emitted by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 40 outputs audio according to the instructions from the processor 46. The speaker 40 is, for example, a directional speaker and outputs audio towards the user 20's ears.

[0030] Sensor 39 is a sensor that detects biometric data of the user 20, who is wearing the necklace-type terminal 14. For example, sensor 39 may be a heart rate sensor or a blood oxygen sensor.

[0031] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0032] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0033] Figure 2 shows an example of the main functions of the data processing device 12 and the necklace-type terminal 14.

[0034] As shown in Figure 2, in the data processing device 12, specific processing is performed by the processor 28. The storage 32 stores a specific processing program 56. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores the data generation model 58. The data generation model 58 is used by the specific processing unit 290. The storage 32 also includes a data storage unit 54.

[0036] In the necklace-type terminal 14, data acquisition processing is performed by the processor 46. The storage 50 stores the data acquisition program 60. The processor 46 reads the data acquisition program 60 from the storage 50 and executes the read data acquisition program 60 on the RAM 48. The data acquisition processing is realized by the processor 46 operating as a control unit 46A according to the data acquisition program 60 executed on the RAM 48.

[0037] As shown in Figures 3 and 4, the necklace-type terminal 14 includes multiple microphones 38, multiple sensors 39, multiple speakers 40, and multiple cameras 42. Figures 3 and 4 show an example where two microphones 38 are positioned in front of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two sensors 39 are positioned to the right and left of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two speakers 40 are positioned to the right rear and left rear of the user 20 when the user 20 wears the necklace-type terminal 14. They also show an example where two cameras 42 are positioned to the right front and left front of the user 20 when the user 20 wears the necklace-type terminal 14. Finally, they show an example where two sensors 39 are positioned inside the necklace-type terminal 14 so as to contact the user 20's neck when the user 20 wears the necklace-type terminal 14.

[0038] Next, we will explain the processing of the control unit 46A when the necklace-type terminal 14 performs data collection processing to collect data.

[0039] In this embodiment, the data collection process collects the user's biometric data in real time. Furthermore, it collects not only biometric data but also all surrounding environment data. This makes it possible to detect early signs of conditions such as Alzheimer's disease and dementia. It also allows for monitoring of the user's health status (e.g., heart disease).

[0040] As shown in Figure 5, the control unit 46A includes a data acquisition unit 100 and a communication unit 102.

[0041] The data acquisition unit 100 collects the outputs of the microphone 38, sensor 39, and camera 42, respectively.

[0042] The communication unit 102 transmits the outputs of the microphone 38, sensor 39, and camera 42, which are collected by the data acquisition unit 100, to the data processing unit 12.

[0043] Next, we will describe the processing of the specific processing unit 290 when the data processing device 12 performs specific processing to obtain a response corresponding to a user utterance.

[0044] In the specific processing in this embodiment, a response corresponding to the user utterance picked up by the microphone 38 of the necklace-type terminal 14 is obtained using the data generation model 58.

[0045] As shown in Figure 6, the specific processing unit 290 includes an input unit 292, a processing unit 294, and an output unit 296.

[0046] The input unit 292 stores the outputs of the microphone 38, sensor 39, and camera 42, respectively, received from the necklace-type terminal 14, in the data storage unit 54.

[0047] The input unit 292 acquires user utterances received by the necklace-type terminal 14. Specifically, it acquires user utterances picked up by the microphone 38 of the necklace-type terminal 14.

[0048] The processing unit 294 performs specific processing using the data generation model 58. Specifically, it inputs a prompt including user utterances to the data generation model 58 and obtains a generation result. At this time, the outputs of the sensor 39 and camera 42 collected by the data acquisition unit 100 may also be included in the prompt.

[0049] The output unit 296 transmits the result of the specific processing to the necklace-type terminal 14. In the necklace-type terminal 14, the control unit 46A causes the speaker 40 to output the result of the specific processing. In this way, a response corresponding to the user utterance picked up by the microphone 38 is output to the user 20 by the speaker 40. The microphone 38 further acquires the user utterance in response to the result of the specific processing. The control unit 46A transmits the audio data indicating the user utterance acquired by the microphone 38 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the user utterance.

[0050] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0051] The outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 are used, for example, to diagnose the health status of user 20. In this case, the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 may be transmitted to a terminal on the medical institution's side. Alternatively, the data processing device 12 may analyze the outputs of the microphone 38, sensor 39, and camera 42 stored in the data storage unit 54 to diagnose the health status of user 20.

[0052] Next, the operation of the data processing system 10 will be explained.

[0053] First, let's explain an example of the data collection process flow.

[0054] When user 20 is wearing the necklace-type terminal 14, the data acquisition unit 100 sequentially collects the outputs of the microphone 38, sensor 39, and camera 42. The communication unit 102 sequentially transmits the outputs of the microphone 38, sensor 39, and camera 42 collected by the data acquisition unit 100 to the data processing unit 12.

[0055] Next, an example of the flow of a specific process will be explained with reference to Figure 7. Here, the input unit 292 of the data processing device 12 sequentially acquires the outputs of the microphone 38, sensor 39, and camera 42 received from the necklace-type terminal 14 and stores them in the data storage unit 54.

[0056] In step S300, the processing unit 294 determines whether a predetermined trigger condition is met. Specifically, the trigger condition may be that the user utterance picked up by the microphone 38 contains a specific word (for example, the name of the agent installed in the necklace-type terminal 14) or a phrase (for example, "Hi! XX" (where XX is the name of the agent)).

[0057] If the trigger condition is met in step S300 (step S300; Yes), the data processing system 10 proceeds to step S301. On the other hand, if the trigger condition is not met in step S300 (step S300; No), the data processing system 10 terminates the specific processing.

[0058] In step S301, the processing unit 294 generates a prompt by adding an instruction to obtain the result of a specific process to the text representing the user utterance picked up by the microphone 38.

[0059] For example, a prompt such as "The user is speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech) can be generated. Alternatively, the outputs of sensor 39 and camera 42 can be added to the prompt to generate a prompt such as "This is biometric data representing the user's heart rate and video data representing the user's surroundings. The user is also speaking as follows: XXX. Please respond as the agent." (XXX is the user's speech)

[0060] In step S303, the processing unit 294 inputs the generated prompt to the data generation model 58 and obtains the result of a specific process based on the output of the data generation model 58.

[0061] In step S304, the output unit 296 outputs the result of the specific processing to the necklace-type terminal 14 and terminates the specific processing.

[0062] [Second Embodiment] In this embodiment, an example of an embodiment is described in which the data processing system 10 aims to suppress the occurrence of health problems for a user 20 who is an elderly person (in this case, 65 years of age or older) wearing a necklace-type terminal 14.

[0063] The health and safety risks faced by the elderly are diverse. Examples include forgetting to take medication, falls, loneliness due to living alone, and early symptoms of dementia. To address these risks, it is necessary to integrate not only health management functions but also emotional support and communication functions.

[0064] While conventional devices for the elderly offer features to support health management and safety, they address individual problems rather than providing integrated support. Furthermore, the lack of features related to mental health care and dementia prevention makes it difficult to comprehensively improve the quality of life for the elderly.

[0065] Therefore, the data processing system 10 according to this embodiment aims to solve these problems and suppress the occurrence of health problems for the user 20.

[0066] Figure 8 shows an example of the configuration of the data processing system 10 according to the second embodiment. As shown in Figure 8, the data processing system 10 according to this embodiment differs from the data processing system 10 according to the first embodiment in that a medical institution terminal 18 is added.

[0067] The medical institution terminal 18 according to this embodiment is a terminal installed in the medical institution where the user 20 is receiving treatment. The medical institution terminal 18 is connected to a network 54, and the data processing device 12 can access the medical institution terminal 18 via the network 54.

[0068] Furthermore, as shown in Figure 8, the data processing system 10 according to this embodiment differs from the data processing system 10 according to the first embodiment in that the necklace-type terminal 14 is equipped with a position detection unit 41A for detecting position data indicating the wearer's position and a fall sensor 41B for detecting fall data indicating the wearer's fall state.

[0069] For example, a GPS (Global Positioning System) chip can be used as the position detection unit 41A. Furthermore, an acceleration sensor, angular acceleration sensor, or the like can be used as the tilt sensor 41B.

[0070] Furthermore, the data processing system 10 according to this embodiment includes, in addition to the heart rate sensor and blood oxygen sensor described above, a body temperature sensor for detecting the body temperature of the wearer, the user 20, and a sleep sensor for detecting the user 20's sleep pattern, as sensors 39 corresponding to the biosensors of this disclosure. However, the system is not limited to this configuration, and one or more of these sensors may be used as the sensor 39.

[0071] Furthermore, in the data processing system 10 according to this embodiment, profile information (hereinafter referred to as "user profile") 59 relating to the user 20 of the necklace-type terminal 14 is registered in the storage 32 of the data processing device 12 for each user 20. The user profile 59 according to this embodiment is registered for each user 20 and includes behavioral history information showing daily activity history such as when they eat, when they go out, and their range of activity, as well as health information such as chronic illnesses and past medical history.

[0072] In this embodiment, the health information in the user profile 59 is registered by the attending physician of the corresponding user 20, but this is not the only possible configuration. For example, the health information may be registered by a healthcare professional other than the user 20's attending physician, or by a family member of the user 20. Furthermore, in the data processing system 10 according to this embodiment, the user profile 59 includes both behavioral history information and health information, but this is not the only possible configuration, and the user profile 59 may include only one of these pieces of information.

[0073] As shown in Figure 9, the control unit 46A of the necklace-type terminal 14 according to this embodiment includes a data acquisition unit 100, a communication unit 102, and an execution unit 104.

[0074] The data acquisition unit 100 collects the output of the microphone 38 that captures the speech of the user 20, who is wearing the device.

[0075] The execution unit 104 uses the output collected by the data collection unit 100 to perform a health problem suppression process (hereinafter simply referred to as the "health problem suppression process") which presents suggested information for suppressing the occurrence of health problems in at least one (in this embodiment, both) of the user 20's mental health and physical health.

[0076] In the data processing system 10 according to this embodiment, the mental health problem is defined as an increase in feelings of loneliness, and the physical health problem is defined as a decline in cognitive function.

[0077] In this embodiment, the data acquisition unit 100 further collects the output of the sensor 39 that detects the user 20's biometric data, and the execution unit 104 uses the collected biometric data to perform a process as a health problem suppression process that presents suggested information for suppressing the occurrence of physical health problems in the user 20.

[0078] Furthermore, the data collection unit 100 according to this embodiment further collects the outputs of the position detection unit 41A and the fall sensor 41B, and the execution unit 104 uses the collected position and fall state to perform a process as a health problem suppression process that presents suggested information for suppressing the occurrence of physical health problems for the user 20.

[0079] As described above, the data processing system 10 according to this embodiment performs the process of presenting suggested information for suppressing the occurrence of physical health problems in the health problem suppression process using both position and the state of falling, but it is not limited to this form. For example, it is also possible to perform the process of presenting suggested information for suppressing the occurrence of physical health problems using only one of the position or the state of falling.

[0080] In this embodiment, the proposed information is presented via sound using the speaker 40, but the system is not limited to this configuration. For example, the proposed information may be presented via push notifications on the display of a mobile device such as a smartphone owned by the user 20, or via vibration using a vibrator.

[0081] For example, if user 20's heart rate is abnormal, the system will suggest, "There is an abnormality in your heart rate, please consult your doctor." Also, for example, if user 20 has exceeded the range of activity recorded in the activity history registered in user profile 59, the system will suggest, "You have exceeded your normal range of activity and are beyond a safe range, so please be careful." Furthermore, for example, if user 20 shows signs of early-stage dementia, the system will suggest, "There is a suspicion that you are in the early stages of dementia, so please consult your doctor."

[0082] Furthermore, if these suggestions pose a risk to user 20, the system may also be configured to notify the medical institution or family member responsible for user 20.

[0083] In the data processing system 10 according to this embodiment, similar to the first embodiment, the communication unit 102 transmits the output collected by the data collection unit 100 to the data processing device 12. The execution unit 104 according to this embodiment then performs health problem suppression processing using the response from the data processing device 12 corresponding to the output transmitted by the communication unit 102. That is, in the data processing system 10 according to this embodiment, the data processing device 12 acquires the information necessary for health problem suppression processing and transmits it to the necklace-type terminal 14 as the response.

[0084] Next, we will describe the processing of the specific processing unit 290 when the data processing device 12 performs specific processing to obtain a response corresponding to the above output.

[0085] In the specific processing in this embodiment, the response corresponding to the above output is obtained using the data generation model 58.

[0086] Therefore, the specific processing unit 290 according to this embodiment also includes an input unit 292, a processing unit 294, and an output unit 296, as shown in Figure 6.

[0087] The input unit 292 stores the output received from the necklace-type terminal 14 in the data storage unit 54.

[0088] The input unit 292 acquires the above output received by the necklace-type terminal 14. Specifically, it acquires the user utterance picked up by the microphone 38 of the necklace-type terminal 14, and the outputs of the position detection unit 41A, the tip-over sensor 41B, and the sensor 39.

[0089] The processing unit 294 performs specific processing using the data generation model 58. Specifically, it inputs a prompt to the data generation model 58 that includes information corresponding to the received output, instructing it to generate suggestion information to suppress the occurrence of mental and physical health problems of the user 20, and obtains a generation result, i.e., a response to execute the health problem suppression processing. For example, it inputs user speech picked up by the microphone 38 of the necklace-type terminal 14, and the outputs of the position detection unit 41A, the fall sensor 41B, and the sensor 39, and also inputs the prompt to the data generation model 58 that says, "This is user speech, the detection result of the user's position, the detection result of the user's fall state, and the detection result of the user's biometric data. Determine whether the user's loneliness is increasing and generate advice to prevent the user's loneliness from increasing. Also, determine whether the user's cognitive function is declining and generate advice to prevent the user's cognitive function from declining."

[0090] The output unit 296 transmits the result of the specific processing as the above response to the necklace-type terminal 14. The execution unit 104 in the necklace-type terminal 14 uses the result of the specific processing to perform health problem suppression processing.

[0091] In this embodiment, if the output of the data generation model 58 indicates that there is a problem with the user's health, the output unit 296 outputs information to the person related to the user 20 indicating that there is a problem. In this embodiment, the person related to the user 20 is the user 20's attending physician at the medical institution, but the embodiment is not limited to this form. For example, the person related to the user 20 may be a medical professional other than the user 20's attending physician, or a family member of the user 20.

[0092] Furthermore, in this embodiment, if the output of the data generation model 58 is an output related to a decline in the cognitive function of user 20, the output unit 296 outputs information indicating that there is a problem with cognitive function to the necklace-type terminal 14 as the suggested information described above. In response, the necklace-type terminal 14 performs a process to present this information to user 20.

[0093] Furthermore, the input unit 292 according to this embodiment further receives user 20 profile information (the user profile 59 described above), and the processing unit 294 inputs a prompt to the data generation model 58 that includes information corresponding to the received output and profile information, and instructs the model to generate suggested information for suppressing the occurrence of mental and physical health problems of user 20, and obtains a response for executing health problem suppression processing using the output of the data generation model 58.

[0094] The data processing system 10 according to this embodiment provides four types of functions: health management function, safety support function, mental support and communication function, and dementia prevention function.

[0095] The health management function continuously monitors the user's (20) biometric data and notifies the user (20) in real time if an abnormality is detected. In addition to a reminder function for medication, the system may also evaluate the effects of medication based on biometric data and report to the doctor as needed.

[0096] Furthermore, the safety support function automatically notifies family members or medical institutions if a fall is detected by the fall sensor 41B. In addition, the location detection unit 41A utilizes the location detection results to track the location data of elderly people at risk of wandering in real time, and issues an alert if they move beyond a safe range.

[0097] Furthermore, the psychological support and communication functions reduce feelings of loneliness in the elderly through everyday conversations. The data processing device 12 uses the data generation model 58 to develop conversations based on the user 20's hobbies and interests, providing psychological support. In addition, voice call and video call functions may be included to facilitate communication between the user 20 and their family, allowing for easy contact.

[0098] Furthermore, the dementia prevention function accumulates speech data related to daily lifestyle patterns and cognitive function to detect early signs of dementia. If an abnormality related to dementia is detected, the user 20 is prompted to consult a medical institution early through suggested information.

[0099] In the data processing system 10 according to this embodiment, the data processing device 12 performs specific processing (hereinafter referred to as "first specific processing") using location data, fall data, and biometric data in order to realize health management functions and safety support functions. Furthermore, in the data processing system 10 according to this embodiment, the data processing device 12 performs specific processing (hereinafter referred to as "second specific processing") using speech data and user profile 59 in order to realize mental support and communication functions, and dementia prevention functions.

[0100] Figure 10 shows a sequence diagram illustrating the flow of the first specific processing by the data processing system 10 according to this embodiment.

[0101] As shown in Figure 10, the necklace-type terminal 14 transmits the above output (location data, fall data, and biometric data) to the data processing device 12 when the user 20 is wearing the necklace-type terminal 14. In response, the data processing device 12 inputs a prompt including the received output to the data generation model 58 to generate the above-mentioned suggestion information as a response and transmits it to the accessing necklace-type terminal 14.

[0102] The necklace-type terminal 14 uses the received response to play back the suggestion information indicated by the response via the speaker 40. Therefore, the user 20 can take action in accordance with the suggestion indicated by the suggestion information played back by the speaker 40.

[0103] Here, if the output of the data generation model 58 indicates that there is a health problem with user 20, the data processing device 12 notifies a person related to user 20 (in this case, their primary physician) that there is a problem. As a result, the person related can become aware that there is something wrong with user 20.

[0104] Figure 11 shows a sequence diagram illustrating the flow of the second specific processing by the data processing system 10 according to this embodiment.

[0105] As shown in Figure 11, the data processing device 12 reads speech data of the user 20 from the data storage unit 54 for the most recent predetermined period (for example, within one month) at a predetermined timing, and also reads the user profile 59 of the user 20 from the storage 32. The data processing device 12 then inputs a prompt containing the read speech data and user profile 59 to the data generation model 58. In response, the data generation model 58 outputs information indicating the level of loneliness of the user 20 (hereinafter referred to as "loneliness information") and information indicating the level of cognitive function of the user 20 (hereinafter referred to as "cognitive function information").

[0106] Therefore, if the level of loneliness indicated by the loneliness information is above a predetermined first threshold, the data processing device 12 changes the prompts input to the data generation model 58 when having a conversation with the user 20 as exemplified in the first embodiment to conversations that reduce loneliness. In this case, the data processing device 12 also notifies the medical institution terminal 18 of information indicating that the user 20 is feeling lonely.

[0107] Furthermore, if the level of cognitive function indicated by the cognitive function information is below a predetermined second threshold, the data processing device 12 sends suggestion information indicating that cognitive function is declining to the necklace-type terminal 14. In this case, the data processing device 12 also notifies the medical institution terminal 18 of the information indicating that user 20's cognitive function is declining.

[0108] Next, the operation of the data processing system 10 will be explained.

[0109] First, with reference to Figure 12, an example of the processing flow performed in the necklace-type terminal 14 according to this embodiment will be described. Note that the processing shown in Figure 12 starts when the user 20 puts on the necklace-type terminal 14, but it is not limited to this form. For example, the processing shown in Figure 12 may start when the user 20 gives a command to start execution by speaking, or when the power switch (not shown) of the necklace-type terminal 14 is turned on.

[0110] In step S400, the data acquisition unit 100 collects the above output. Specifically, it collects position data from the position detection unit 41A, fall data from the fall sensor 41B, and biological data from the sensor 39.

[0111] In step S402, the communication unit 102 transmits the collected output to the data processing unit 12. Upon receiving the output, the data processing unit 12 transmits the response (in this embodiment, the proposed information) to the accessing necklace-type terminal 14, as described above.

[0112] Therefore, in step S404, the communication unit 102 waits until it receives the above response, and in step S406, the execution unit 104 uses the received response to perform health problem suppression processing (in this embodiment, presentation of proposed information).

[0113] In step S408, the data acquisition unit 100 determines whether a predetermined termination timing has arrived. If the determination is negative (step S408; No), it returns to step S400; however, if the determination is positive (step S408; Yes), it terminates the process. In this embodiment, the termination timing is set to the timing when the user 20 removes the necklace-type terminal 14, but the system is not limited to this configuration. For example, the termination timing could be set to the timing when the user 20 gives a verbal instruction to terminate execution, or when the power switch (not shown) of the necklace-type terminal 14 is opened.

[0114] Next, an example of the flow of the first specific processing performed in the data processing device 12 according to this embodiment will be described with reference to Figure 13. Here, the input unit 292 of the data processing device 12 sequentially acquires the output of location data, fall data, and biometric data received from the necklace-type terminal 14 and stores them in the data storage unit 54.

[0115] In step S500, the processing unit 294 determines whether a predetermined trigger condition is met. Specifically, the trigger condition may be the receipt of location data, fall data, and biometric data from any of the necklace-type terminals 14.

[0116] If the trigger condition is met in step S500 (step S500; Yes), proceed to step S502. On the other hand, if the trigger condition is not met in step S500 (step S500; No), terminate the first specific processing.

[0117] In step S502, the processing unit 294 adds an instruction statement to the received position data, fall data, and biometric data to obtain the result of the first specific processing, and generates a prompt.

[0118] For example, it generates a prompt that says, "This includes location data indicating the user's position, fall data indicating the user's fall status, and biometric data representing heart rate, blood oxygen saturation, body temperature, and sleep patterns. From this data, generate suggestion information regarding the user's health, and if notification to the user's doctor is necessary, generate notification information indicating the content of that notification."

[0119] Thus, in this embodiment, position data, fall data, and biometric data are all applied, but the invention is not limited to this, and any one or a combination of any two of these data may be applied.

[0120] In step S504, the processing unit 294 inputs the generated prompt to the data generation model 58 and obtains the result of the first specific processing (in this embodiment, proposed information and notification information if notification is required) based on the output of the data generation model 58.

[0121] In step S506, the output unit 296 outputs (transmits) the proposed information generated by the data generation model 58 as the above response to the access source necklace-type terminal 14.

[0122] Upon receiving the above response, the necklace-type terminal 14 plays the proposal indicated by the received proposal information using the speaker 40.

[0123] In step S508, the output unit 296 determines whether or not it is necessary to notify a medical institution by determining whether or not the data generation model 58 has generated notification information. If the determination is negative (step S508; No), the first identification process is terminated, while if the determination is positive (step S508; Yes), the process proceeds to step S510.

[0124] In step S510, the output unit 296 transmits the notification content indicated by the notification information to a medical institution terminal 18 located at the medical institution where the user 20's attending physician works, and terminates the first identification process.

[0125] Next, an example of the flow of the second specific processing performed in the data processing device 12 according to this embodiment will be described with reference to Figure 14. Here, in order to avoid confusion, the processing will be performed only for a single user 20 (hereinafter referred to as the "target user") of the data processing system 10, but it goes without saying that the same processing can be performed for multiple users 20.

[0126] In step S600, the processing unit 294 determines whether a predetermined trigger condition is met. Specifically, the trigger condition may be the arrival of a predetermined timing (in this embodiment, 12:00 on the first day of each month) which is the timing for starting the execution of the second specific processing.

[0127] If the trigger condition is met in step S600 (step S600; Yes), proceed to step S602. On the other hand, if the trigger condition is not met in step S600 (step S600; No), terminate the second specific processing.

[0128] In step S602, the processing unit 294 reads the speech data for the most recent predetermined period (one month in this embodiment) corresponding to the target user from the data storage unit 54, and also reads the target user's user profile 59 from the storage unit 32.

[0129] In step S604, the processing unit 294 adds an instruction to obtain the result of the second specific processing to the read speech data and user profile 59 to generate a prompt.

[0130] For example, it might generate a prompt like this: "This is the user's most recent speech data and user profile. From this data, understand the user's intentions and emotions to generate loneliness information indicating the user's level of loneliness, and cognitive function information indicating the user's level of cognitive function. Also, if it is necessary to notify the user's doctor, generate notification information indicating the content of that notification."

[0131] As described above, in this embodiment, both speech data and user profile 59 are applied, but the embodiment is not limited to this, and it is also possible to apply only the speech data from among these data.

[0132] In step S606, the processing unit 294 inputs the generated prompt to the data generation model 58 and obtains the result of the second identification process (in this embodiment, loneliness information, cognitive function information, and notification information if notification is necessary) based on the output of the data generation model 58. Thus, in this embodiment, a single data generation model 58 is used for both the first and second identification processes, but the system is not limited to this configuration. For example, different data generation models may be used for the first and second identification processes.

[0133] In step S608, the processing unit 294 determines whether the level of loneliness indicated by the acquired loneliness information is equal to or greater than a predetermined first threshold. If the determination is negative (step S608; No), the unit proceeds to step S612; however, if the determination is positive (step S608; Yes), the unit proceeds to step S610.

[0134] In step S610, the processing unit 294 modifies the prompts input to the data generation model 58 when having a conversation with user 20 as exemplified in the first embodiment, to be conversations that reduce feelings of loneliness. From this point onward, the target user can have conversations that reduce feelings of loneliness when using the necklace-type terminal 14.

[0135] In step S612, the processing unit 294 determines whether the level of cognitive function indicated by the acquired cognitive function information is below a predetermined second threshold. If the determination is negative (step S612; No), the unit proceeds to step S616; however, if the determination is positive (step S612; Yes), the unit proceeds to step S614.

[0136] In step S614, the processing unit 294 sends suggestion information indicating that cognitive function is declining to the target user's necklace-type terminal 14.

[0137] In step S616, the output unit 296 determines whether or not notification to a medical institution is necessary by determining whether or not the data generation model 58 has generated notification information. If the determination is negative (step S616; No), the second identification process is terminated, while if the determination is positive (step S616; Yes), the process proceeds to step S618.

[0138] In step S618, the output unit 296 transmits the notification content indicated by the notification information to a medical institution terminal 18 located at the medical institution where the user 20's attending physician works, and terminates the second identification process.

[0139] Through the first and second specific processing described above, elderly individuals will be able to live independently and safely while receiving physical and mental support. Daily conversations using the data generation model 58 and real-time monitoring of their health status will enable family members and healthcare professionals to look after the elderly with peace of mind. Furthermore, by preventing dementia and reducing feelings of loneliness, the quality of life for the elderly can be improved.

[0140] In this embodiment, the data processing device 12 directly makes the notification to the medical institution when notification is necessary due to the first and second specific processing, but the embodiment is not limited to this form. For example, if notification information is generated in the data processing device 12, the notification information may be transmitted to the necklace-type terminal 14, while the necklace-type terminal 14 makes the notification using the notification information. In this embodiment, the notification using the notification information may be made via a mobile terminal such as a smartphone held by the user 20.

[0141] Furthermore, although this embodiment describes the application of the data processing system of the Disclosure to elderly individuals, the Disclosure is not limited to this form and can be applied to people of other age groups as well.

[0142] Furthermore, although this embodiment describes a case in which various information is generated by the data generation model 58 without using video data showing images captured by the camera 42, it goes without saying that the system is not limited to this form, and various information may also be generated using the video data. In this form, the circumstances of the user 20's fall can be easily understood.

[0143] Furthermore, although this embodiment describes a case in which the loneliness level and cognitive function level of user 20 are estimated from the user 20's utterances using the same processing as in the first embodiment, the embodiment is not limited to this form.

[0144] For example, the system could routinely present the user 20 with simple quizzes or puzzles via a necklace-type terminal 14, and estimate their level of loneliness and cognitive function based on the combination of the questions and the user 20's answers.

[0145] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[0146] In the embodiments described above, examples were given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing method for the specific process may be used, which may involve multiple computers, including computer 22.

[0147] In the embodiments described above, examples were given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0148] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0149] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0150] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0151] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0152] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0153] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0154] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0155] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted as being incorporated by reference.

[0156] In relation to the above, the following additional information is disclosed.

[0157] <Note 1> A collection unit that collects the output of a microphone that captures the wearer's speech, An execution unit that uses the collected output to perform a health problem suppression process that presents suggested information for suppressing the occurrence of health problems in at least one of the wearer's mental health and physical health, A necklace-type terminal that includes this device. <Note 2> The aforementioned mental health problem is an increase in feelings of loneliness. The aforementioned physical health problem is a decline in cognitive function. The necklace-type terminal described in Appendix 1. <Note 3> The collection unit further collects the output of the biosensor that detects the wearer's biological data, The execution unit uses the collected biometric data to perform a process, as the health problem suppression process, which involves presenting suggested information for suppressing the occurrence of physical health problems in the wearer. The necklace-type terminal described in Appendix 1 or Appendix 2. <Note 4> The aforementioned biometric data includes at least one of the following: heart rate, blood oxygen saturation, body temperature, and sleep pattern. The necklace-type terminal described in Appendix 3. <Note 5> The collection unit further collects the output of at least one of the position detection unit that detects the position of the wearer and the fall sensor that detects the wearer's fall state. The execution unit performs a process, as the health problem suppression process, which uses at least one of the collected position and the state of the fall to present suggested information for suppressing the occurrence of physical health problems of the wearer. A necklace-type terminal as described in any one of the appendices 1 through 4. <Note 6> The wearer is an elderly person above a predetermined age. A necklace-type terminal as described in any one of the appendices 1 through 5. <Note 7> The system further includes a communication unit that transmits the output collected by the collection unit to a data processing unit, The execution unit executes the health problem suppression process using the response from the data processing device corresponding to the transmitted output. A necklace-type terminal as described in any one of the appendices 1 through 6. <Note 8> The necklace-type terminal described in Appendix 7, A data processing system including a data processing device, The aforementioned data processing device is An input unit that receives the output transmitted by the communication unit, A processing unit inputs a prompt containing information corresponding to the received output to a data generation model, and uses the output of the data generation model to obtain a response for executing the health problem suppression process, An output unit that outputs the acquired response to the necklace-type terminal, A data processing system that includes this. <Note 9> The output unit, if the output of the data generation model is an output relating to a problem with the wearer's health, outputs information to the wearer's associates indicating that such a problem exists. The data processing system described in Appendix 8. <Note 10> The output unit, when the output of the data generation model is an output relating to a decline in the wearer's cognitive function, outputs information to the necklace-type terminal indicating that there is a problem with cognitive function. The data processing system described in Appendix 8 or Appendix 9. <Note 11> The input unit further receives the wearer's profile information, The processing unit inputs a prompt containing information corresponding to the received output and the profile information to the data generation model, and uses the output of the data generation model to obtain a response for executing the health problem suppression process. A data processing system as described in any one of the appendices 8 through 10. [Explanation of symbols]

[0158] 10 Data Processing Systems 12 Data Processing Devices 14 Necklace-type terminal 18 Medical Institution Terminals 38 Microphones 39 Sensors 40 speakers 41A Position detection unit 41B Tip-over sensor 42 cameras 46A Control Unit 59 User Profiles 100 Data Acquisition Unit 102 Communications Department 104 Execution Unit 290 Specific Processing Unit 292 Input section 294 Processing Unit 296 Output section< / url:>

Claims

1. A collection unit that collects the output of a microphone that captures the wearer's speech, An execution unit that uses the collected output to perform a health problem suppression process that presents suggested information for suppressing the occurrence of health problems in at least one of the wearer's mental health and physical health, A necklace-type terminal that includes this device.

2. The aforementioned mental health problem is an increase in feelings of loneliness. The aforementioned physical health problem is a decline in cognitive function. The necklace-type terminal according to claim 1.

3. The collection unit further collects the output of the biosensor that detects the wearer's biological data, The execution unit uses the collected biometric data to perform a process, as the health problem suppression process, which involves presenting suggested information for suppressing the occurrence of physical health problems in the wearer. The necklace-type terminal according to claim 1 or claim 2.

4. The aforementioned biometric data includes at least one of the following: heart rate, blood oxygen saturation, body temperature, and sleep pattern. The necklace-type terminal according to claim 3.

5. The collection unit further collects the output of at least one of the position detection unit that detects the position of the wearer and the fall sensor that detects the wearer's fall state. The execution unit performs a process, as the health problem suppression process, which uses at least one of the collected position and the state of the fall to present suggested information for suppressing the occurrence of physical health problems of the wearer. The necklace-type terminal according to claim 1 or claim 2.

6. The wearer is an elderly person above a predetermined age. The necklace-type terminal according to claim 1 or claim 2.

7. The system further includes a communication unit that transmits the output collected by the collection unit to a data processing unit, The execution unit executes the health problem suppression process using the response from the data processing device corresponding to the transmitted output. The necklace-type terminal according to claim 1 or claim 2.

8. The necklace-type terminal described in claim 7, A data processing system including a data processing device, The aforementioned data processing device is An input unit that receives the output transmitted by the communication unit, A processing unit inputs a prompt containing information corresponding to the received output to a data generation model, and uses the output of the data generation model to obtain a response for executing the health problem suppression process, An output unit that outputs the acquired response to the necklace-type terminal, A data processing system that includes this.

9. The output unit, if the output of the data generation model is an output relating to a problem with the wearer's health, outputs information to the wearer's associates indicating that such a problem exists. The data processing system according to claim 8.

10. The output unit, when the output of the data generation model is an output relating to a decline in the wearer's cognitive function, outputs information to the necklace-type terminal indicating that there is a problem with cognitive function. The data processing system according to claim 8 or claim 9.

11. The input unit further receives the wearer's profile information, The processing unit inputs a prompt containing information corresponding to the received output and the profile information to the data generation model, and uses the output of the data generation model to obtain a response for executing the health problem suppression process. The data processing system according to claim 8 or claim 9.

Images