Program, information processing device, information processing method, and information processing system

Abstract

Provided is a technology for outputting a report including an abnormality determination result of a care recipient, control content for a facility apparatus, and a basis of the control content.　This computer program causes at least one computer to execute a process for: acquiring data pertaining to a care recipient and data pertaining to a facility apparatus; and imparting, to a generative model, the acquired data pertaining to the care recipient and the acquired data pertaining to the facility apparatus, thereby outputting a report including the abnormality determination result of the care recipient, the control content for the facility apparatus, and the basis for the control content.

Description

Program, Information Processing Apparatus, Information Processing Method, and Information Processing System

[0001] The present disclosure relates to a program, an information processing apparatus, an information processing method, and an information processing system.

[0002] Patent Document 1 discloses a system that monitors the behavior of a cared person including elderly people, sick people, and the like.

[0003] Japanese Unexamined Patent Application Publication No. 2020-190889

[0004] However, with the system described in Patent Document 1, it is difficult to output a report that includes the abnormality determination result of the cared person, the control content for facility equipment, and the basis for the control content. An object of the present disclosure is to provide a computer program and the like that can output a report including the abnormality determination result of the cared person, the control content for facility equipment, and the basis for the control content.

[0005] A program according to one aspect of the present disclosure causes at least one computer to execute a process of acquiring data relating to a cared person and data relating to facility equipment, inputting the acquired data relating to the cared person and the acquired data relating to the facility equipment into a generation model, and outputting a report including the abnormality determination result of the cared person, control content for the facility equipment, and a basis for the control content.

[0006] A program according to a second aspect of the present disclosure is the program according to the first aspect, and causes at least one computer to execute a process of inputting a prompt including an abnormality determination instruction for the cared person based on data relating to the cared person and data relating to facility equipment, an instruction for specifying control content of the facility equipment according to the abnormality determination result, an instruction for specifying a basis for the control content, and an instruction for generating a report including the abnormality determination result, the specified control content, and the basis for the control content into the generation model, and outputting the report.

[0007] A program according to a third aspect of the present disclosure is the program according to any one of the first aspect or the second aspect, and causes at least one computer to execute a process of outputting a control command corresponding to the control content to the facility equipment.

[0008] A program of the fourth aspect relating to one aspect of this disclosure is a program of the first or third aspect, which causes at least one computer to perform a process to identify a recipient by providing the abnormality determination result to the generation model.

[0009] A program of the fifth aspect relating to one aspect of this disclosure is a program of the first or fourth aspect, which causes at least one computer to perform a process of notifying the identified recipient by providing the generation model with a prompt including an anomaly detection result, a plurality of candidate recipients, a command to identify a recipient from the plurality of candidate recipients based on the anomaly detection result, and a command to notify the identified recipient.

[0010] A program in the sixth aspect relating to one aspect of this disclosure is a program in either the first or fifth aspect, which causes at least one computer to execute a process of making a notification to the specified notification destination by a first agent that has been set with prompts including a command to determine an abnormality of the person being cared for based on data relating to the person being cared for and data relating to the equipment, a command to specify the control content of the equipment according to the abnormality determination result, a command to specify the basis for the control content, and a command to generate a report including the abnormality determination result, the specified control content, and the basis for the control content; and a command to make a notification to the specified notification destination by a second agent that has been set with prompts including the abnormality determination result, a plurality of notification destination candidates, a command to specify a notification destination from the plurality of notification destination candidates based on dialogue with the first agent regarding the abnormality determination result and the notification destination, and a notification command to the specified notification destination.

[0011] The program of the seventh aspect relating to one aspect of this disclosure is a program of any of the first or sixth aspects, wherein the data relating to the person being cared for includes the person being cared for's speech and the person being cared for's vital data, and the data relating to the equipment includes control data for the air conditioning equipment.

[0012] The program of the eighth aspect relating to one aspect of this disclosure is a program of the first aspect or the seventh aspect, which causes at least one computer to perform a process of obtaining a query from the notifying user and providing the obtained query to the generation model to output a response.

[0013] The information processing device in the ninth aspect relating to one aspect of this disclosure includes a processing unit that acquires data relating to a person receiving care and data relating to equipment, and by providing the acquired data relating to the person receiving care and the equipment to a generation model, it performs processing to output a report that includes the result of determining an abnormality of the person receiving care, the control content for the equipment, and the basis for said control content.

[0014] The information processing method of the tenth aspect relating to one aspect of this disclosure involves acquiring data relating to the person receiving care and data relating to equipment, and then using at least one computer to perform a process that outputs a report including the result of determining an abnormality of the person receiving care, the control content for the equipment, and the basis for said control content by providing the acquired data relating to the person receiving care and the equipment to a generation model.

[0015] An information processing system according to an eleventh aspect relating to one aspect of this disclosure comprises equipment and an information processing device having a processing unit, wherein the processing unit acquires data relating to the person being cared for and data relating to the equipment, and outputs a report including the result of determining an abnormality of the person being cared for, the control content for the equipment, and the basis for said control content by providing the acquired data relating to the person being cared for and the data relating to the equipment to a generation model.

[0016] According to this disclosure, it is possible to output a report that includes the results of the abnormality detection of the person being cared for, the control content for the equipment, and the basis for the control content.

[0017] This is a schematic diagram showing the overall configuration of the equipment system according to the embodiment. This is a block diagram showing the configuration of the control system of the air conditioner. This is a block diagram showing the configuration of the control system of the user terminal. This is a block diagram showing the configuration of the control system of the first server. This is a block diagram showing the configuration of the control system of the second server. This is a flowchart explaining the processing of each control unit in the first embodiment. This is an explanatory diagram explaining an example of the first agent prompt in the first embodiment. This is an explanatory diagram explaining an example of the first agent prompt in the first embodiment. This is an explanatory diagram explaining an example of the second agent prompt in the first embodiment. This is an explanatory diagram of an example of dialogue between the first agent and the second agent in the first embodiment. This is an explanatory diagram of an example of the first agent prompt and report in a modified example. This is a flowchart explaining the processing of each processing unit in the second embodiment. This is a flowchart explaining the processing of each processing unit in the second embodiment. This is an example of the display of the display unit in the second embodiment. This is a flowchart explaining the processing of each control unit in the third embodiment. This is an example of the display of the display unit in the third embodiment.

[0018] Computer programs, information processing methods, and information processing systems according to embodiments of this disclosure will be described below with reference to the drawings. This disclosure is not limited to these examples, but is indicated by the claims, and all modifications within the meaning and scope of the claims are intended to be included. Furthermore, at least some of the embodiments described below may be combined in any way.

[0019] Figure 1 is a schematic diagram showing the overall configuration of the equipment system according to the embodiment. The equipment system 1 according to the embodiment is an air conditioning system 1. The air conditioning system 1 comprises an air conditioner 100 and a user terminal 200. The air conditioner 100 and the user terminal 200 are connected to each other via a local communication network NW1 such as Wi-Fi (registered trademark).

[0020] The air conditioner 100 is a household or commercial air conditioner for adjusting the temperature, humidity, air cleanliness, etc., of a room, and comprises an indoor unit and an outdoor unit. The air conditioner 100 adjusts the temperature, humidity, etc., of a room by operating in response to control commands output from a remote controller 150 or a user terminal 200.

[0021] The user terminal 200 is a device such as a smartphone, tablet, personal computer, or smart speaker operated by the user of the air conditioner 100. The user terminal 200 is equipped with artificial intelligence (AI). The artificial intelligence installed in the user terminal 200 is constructed by a generation model MD2 that generates new content in response to inputs such as text, voice, still images, and videos. The generation model MD2 may be a proprietary model that has been fine-tuned and / or distilled (lightened) for a specific application. The content generated by the generation model MD2 includes text, voice or music, images such as still images or videos, etc. By using the generation AI, the user terminal 200 can create the indoor environment desired by the user by generating control commands for the air conditioner 100 while interacting with the user, and by controlling the operation of the air conditioner 100 based on the generated control commands.

[0022] In the example shown in Figure 1, there is one user terminal 200, but there may be multiple user terminals 200 capable of controlling the air conditioner 100.

[0023] The air conditioning system 1 may include an air purifier 151, a circulator 152, a diffuser 153, lighting equipment 154, and sound equipment 155. The air purifier 151 is a device for purifying the air in a room and providing clean air. The circulator 152 is a device for circulating the air in a room. The diffuser 153 is a device for diffusing fragrance. The lighting equipment 154 is a device for illuminating the space in a room. The sound equipment 155 is a device for playing music, ambient sounds, etc. These devices 151 to 155 are connected to at least one of the air conditioner 100 and the user terminal 200 via a communication network NW1 so as to be able to communicate.

[0024] The air conditioning system 1 may further include a wearable device 250 worn by the user. The wearable device 250 measures, for example, at least one of the user's heart rate, body temperature, sweating, blood pressure, respiration, brain waves, and body composition, and outputs the measurement results as the user's biometric information. The output destination may be the air conditioning unit 100 or the user terminal 200.

[0025] The air conditioning system 1 may further include a first server 310 or a second server 320 accessible from the air conditioner 100 or a user terminal 200. The air conditioner 100 or the user terminal 200 and the first server 310 or the second server 320 are connected to each other via an external communication network NW2, such as the Internet.

[0026] The first server 310 is equipped with a generative AI. The generative AI of the first server 310 is constructed by a generative model MD3 that generates new content in response to inputs such as text, audio, still images, and videos. The generative model MD3 may include existing models such as GPT (Generative Pretrained Transformer) (registered trademark), BERT (Bidirectional Encoder Representations from Transformers), GAN (Generative Adversarial Network), Wave Net, DALL-E, and Stable Diffusion, or it may be a unique model that has been fine-tuned for a specific application from an existing model. The first server 310 generates content such as text, audio, still images, and videos in response to requests from the air conditioner 100 or user terminal 200, and returns the generated content to the requester.

[0027] The second server 320 is a search server that searches for relevant documents or information in response to an input query and returns the relevant documents or information to the requester. Existing search engines such as vector search are used to search for relevant documents and information. In one example, the second server 320 is a general-purpose search server that returns search results in response to external search requests. Alternatively, the second server 320 may be a dedicated search server that can access a database DB that stores information such as operation manuals, service guides, technical handbooks, installation instructions, customer information, operation data during trial operation, and operation data after the start of operation for the air conditioner 100, and searches the database DB in response to external search requests and returns the search results to the requester. The database DB may also register construction information when the air conditioner 100 was installed (installation location of indoor and outdoor units, piping length, floor plan, year of construction), information about the installed air conditioner 100 (model, Ua value, horsepower, etc.), and sales information for each employee.

[0028] The air conditioning system 1 according to the embodiment implements the information processing system of the present disclosure using at least one of the generation model MD2 installed on the user terminal 200 and the generation model MD3 installed on the first server 310. The information processing system of the present disclosure may be implemented using only the content output from the generation model MD2 installed on the user terminal 200, or it may be implemented using only the content output from the generation model MD3 installed on the first server 310.

[0029] Furthermore, the information processing system disclosed herein may be realized through the cooperation of a generation model MD2 installed on a user terminal 200 and a generation model MD3 installed on a first server 310.

[0030] Furthermore, the information processing system disclosed herein may be implemented using a RAG (Retrieval-Augmented Generation) mechanism. That is, in response to an input query from the air conditioner 100 or user terminal 200, the second server 320 may output documents or information related to the input query, and the first server 310 may generate content based on the documents or information output from the second server 320 and return the content to the air conditioner 100 or user terminal 200. By using a RAG mechanism, more accurate and relevant content can be provided.

[0031] In this embodiment, the user terminal 200 is configured to have the generation model MD2 installed. Alternatively, the generation model may be installed in the air conditioner 100. In this case, the information processing system of this disclosure may be realized using the generation model MD1 (see Figure 2) installed in the air conditioner 100. Furthermore, the information processing system of this disclosure may be realized by the cooperation of the generation model MD1 of the air conditioner 100 and the generation model MD3 of the first server 310.

[0032] Furthermore, generation models may be installed on both the air conditioner 100 and the user terminal 200. In this case, at least two of the generation models, MD1 of the air conditioner 100, MD2 of the user terminal 200, and MD3 of the first server 310, may work together to realize the information processing system disclosed herein.

[0033] Figure 2 is a block diagram showing the configuration of the control system of the air conditioner 100. The air conditioner 100 comprises a control unit 101, a storage unit 102, a communication unit 103, a sensor unit 104, and a drive unit 110.

[0034] The control unit 101 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and the like. The ROM in the control unit 101 stores control programs for controlling the operation of the drive unit 110. The CPU in the control unit 101 executes the control programs stored in the ROM and various computer programs stored in the memory unit 102, and controls the operation of the drive unit 110, thereby making the entire device function as the air conditioner 100 in this disclosure.

[0035] The storage unit 102 is equipped with a storage device such as flash memory. The storage unit 102 stores various computer programs to be executed by the control unit 101, as well as data necessary for the execution of these programs.

[0036] The computer program (program product) stored in the memory unit 102 includes a control program PG1 for realizing the information processing system of this disclosure. The control program PG1 may be a single computer program or a group of programs composed of multiple computer programs. The control program PG1 may be executed collaboratively by multiple computers.

[0037] The computer program, including the control program PG1, is provided, for example, on a non-temporary recording medium RM1 on which the computer program is recorded in a readable format. The recording medium RM1 is a portable memory such as a CD-ROM, USB memory, SD card, microSD card, or CompactFlash®. The control unit 101 reads various computer programs from the recording medium RM1 using a reading device (not shown in the figure) and stores the read computer programs in the storage unit 102. The computer programs stored in the storage unit 102 may also be provided via communication. In this case, the control unit 101 acquires the computer programs via communication through the communication unit 103 and stores the acquired computer programs in the storage unit 102.

[0038] The data stored in the memory unit 102 may include at least one of the following: an operation manual, a service guide, a technical handbook, installation instructions, customer information, operational data during commissioning, and operational data after the start of operation.

[0039] When the air conditioner 100 is equipped with a generation AI, the generation model MD1 that constructs the generation AI is stored in the memory unit 102. The generation model MD1 is a model that generates new content in response to inputs such as text, voice, still images, and videos. The content generated by the generation model MD1 includes text, voice or music, images such as still images or videos, etc. The generation model MD1 is a unique model that has been fine-tuned and / or distilled (lightened) for a specific application from existing models such as GPT (registered trademark), BERT, GAN, Wave Net, DALL-E, and Stable Diffusion.

[0040] The communication unit 103 is equipped with a communication interface for communicating with the user terminal 200 and the like. The communication interface provided by the communication unit 103 can be a communication interface compliant with a wireless LAN (Local Area Network) communication standard such as Wi-Fi (registered trademark). Alternatively, a communication interface compliant with a short-range wireless communication standard such as Bluetooth may be used. In addition to the user terminal 200, the communication unit 103 may be configured to communicate with an air purifier 151, a circulator 152, a diffuser 153, lighting equipment 154, sound equipment 155, and the like.

[0041] The communication unit 103 may further include a communication interface for communicating with the first server 310 or the second server 320. Such a communication interface can be a wireless communication interface such as Wi-Fi®, 3G, 4G, 5G, or LTE (Long Term Evolution).

[0042] The sensor unit 104 includes one or more sensors that measure various physical quantities in an indoor environment or the user's condition. The sensors included in the sensor unit 104 include sensors that measure at least one of indoor temperature, humidity, heat, CO₂ concentration, and illuminance. The sensor unit 104 may also include sensors that measure the user's movement, facial expression, and the like.

[0043] The drive unit 110 includes a compressor 111, a four-way switching valve 112, an indoor fan 113, a flap 114, and the like. The compressor 111 is a device for sucking in a refrigerant in a constant-temperature low-pressure gaseous state and compressing it into a high-temperature high-pressure gas. During cooling operation, the refrigerant compressed by the compressor 111 returns to the suction side of the compressor 111 via an outdoor heat exchanger, an expansion valve, a first indoor heat exchanger, a solenoid valve, and a second indoor heat exchanger. In this refrigeration cycle, heat is dissipated by the outdoor heat exchanger functioning as a condenser, and indoor air is cooled by the first and second indoor heat exchangers functioning as evaporators to perform cooling. During heating operation, the four-way switching valve 112 switches the path, and heating is performed in a cycle reverse to that during cooling operation.

[0044] The indoor fan 113 is a device for uniformly circulating cooled air or warmed air throughout the room. The air volume generated by the indoor fan 113 is controlled by a control command from the control unit 101. By adjusting the air volume generated by the indoor fan 113, the efficiency of cooling and heating can be improved, and energy consumption can be reduced.

[0045] The flap 114 is a device for adjusting the direction of air delivered from the air conditioner 100. The orientation of the flap 114 is controlled by a control command from the control unit 101. By ensuring an appropriate air flow with the flap 114, the efficiency of cooling and heating can be improved, and energy consumption can be reduced.

[0046] FIG. 3 is a block diagram showing the configuration of a control system of the user terminal 200. The user terminal 200 is a terminal device such as a smartphone, a tablet terminal, a personal computer, or a smart speaker, and includes a control unit 201, a storage unit 202, a communication unit 203, an imaging unit 204, a voice input unit 205, a voice output unit 206, a positioning unit 207, an operation unit 208, a display unit 209, and the like.

[0047] The control unit 201 includes a CPU, a ROM, a RAM, and the like. The ROM provided in the control unit 201 stores a control program and the like for controlling operations of respective hardware units included in the user terminal 200. The CPU in the control unit 201 reads and executes the control program stored in the ROM and a computer program stored in the storage unit 202, and controls the operations of the respective hardware units, thereby causing the entire apparatus to function as the user terminal 200 according to the present disclosure. The RAM provided in the control unit 201 temporarily stores data used during execution of calculations.

[0048] In the embodiment, the control unit 201 is configured to include a CPU, a ROM, and a RAM. Alternatively, the control unit 201 may be one or more control circuits or processing circuits including, for example, a GPU (Graphics Processing Unit), an FPGA (Field Programmable Gate Array), a DSP (Digital Signal Processor), a quantum processor, a volatile or non-volatile memory, or the like. Further, the control unit 201 may also have functions such as a clock that outputs date and time information, a timer that measures an elapsed time from when a measurement start instruction is given to when a measurement end instruction is given, and a counter that counts numbers.

[0049] The storage unit 202 includes a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 202 stores various computer programs executed by the control unit 201 and various data used by the control unit 201.

[0050] The computer program (program product) stored in the memory unit 202 includes a control program PG2 for realizing the information processing system of this disclosure. The control program PG2 may be a single computer program or a group of programs composed of multiple computer programs. The control program PG2 may be executed collaboratively by multiple computers. For example, the information processing system of this disclosure may be realized by the collaboration of a control program PG1 installed in the air conditioner 100 and a control program PG2 installed in the user terminal 200.

[0051] The computer program, including the control program PG2, is provided, for example, on a non-temporary recording medium RM2 on which the computer program is recorded in a readable format. The recording medium RM2 is a portable memory such as a CD-ROM, USB memory, SD card, microSD card, or CompactFlash®. The control unit 201 reads various computer programs from the recording medium RM2 using a reading device (not shown in the figure) and stores the read computer programs in the storage unit 202. The computer programs stored in the storage unit 202 may also be provided via communication. In this case, the control unit 201 acquires the computer programs via communication through the communication unit 203 and stores the acquired computer programs in the storage unit 202.

[0052] The memory unit 202 may include a generation model MD2. The generation model MD2 is a model that generates new content in response to inputs such as text, audio, still images, and videos. The content generated by the generation model MD2 includes text, audio or music, images such as still images or videos, etc. The generation model MD2 is a unique model that has been distilled (lightened) for a specific application from existing models such as GPT®, BERT, GAN, Wave Net, DALL-E, and Stable Diffusion.

[0053] The communication unit 203 is equipped with a communication interface for communicating with the air conditioner 100 and the like. The communication interface provided by the communication unit 203 can be a communication interface compliant with a wireless LAN communication standard such as Wi-Fi (registered trademark). Alternatively, a communication interface compliant with a short-range wireless communication standard such as Bluetooth may be used. In addition to the air conditioner 100, the communication unit 203 may be configured to communicate with an air purifier 151, a circulator 152, a diffuser 153, lighting equipment 154, sound equipment 155, and the like.

[0054] The communication unit 203 further includes a communication interface for communicating with the first server 310 or the second server 320. Such a communication interface can be a wireless communication interface such as Wi-Fi®, 3G, 4G, 5G, or LTE (Long Term Evolution).

[0055] The imaging unit 204 is equipped with an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge-Coupled Device), and generates an image (still image or moving image) of the object to be imaged by imaging the object. The imaging unit 204 outputs the image data related to the generated image to the control unit 201. The control unit 201 stores the input image data in the storage unit 202. The control unit 201 may display the image based on the image data on the display unit 209, or transmit it to the outside via the communication unit 203.

[0056] The audio input unit 205 includes a microphone for collecting sound, a processing circuit for converting the collected sound into a digital signal (audio data), and the like. The audio data generated in the audio input unit 205 is sent to the control unit 201, where appropriate processing such as noise reduction is performed. The audio data generated in the audio input unit 205 is also stored in the storage unit 202 or transmitted to the first server 310 via the communication unit 203.

[0057] The audio output unit 206 is equipped with a speaker that outputs sound. The audio output unit 206 reproduces sound based on the audio data provided by the control unit 201. In this embodiment, the audio input unit 205 and the audio output unit 206 are configured to input and output sound, but sounds other than voice (ambient sounds, music, etc.) may be input to the audio input unit 205 and sounds other than voice (ambient sounds, music, etc.) may be output from the audio output unit 206.

[0058] The positioning unit 207, for example, is equipped with a GPS (Global Positioning System) receiver and receives radio waves transmitted from GPS satellites to determine the current location of the user terminal 200. The positioning unit 207 outputs location information related to the determined current location of the user terminal 200 to the control unit 201.

[0059] The operation unit 208 is equipped with operating devices such as a touch panel, keyboard, and switches, and accepts various inputs and operations from the user. The control unit 201 acquires information input through the operation unit 208 and performs appropriate control based on the various operation information provided by the operation unit 208.

[0060] The display unit 209 is equipped with a display device such as a liquid crystal monitor or an organic EL (Electro-Luminescence) monitor, and displays information that should be notified to the user in response to instructions from the control unit 201.

[0061] Figure 4 is a block diagram showing the configuration of the control system of the first server 310. The first server 310 is a dedicated or general-purpose server computer and includes a control unit 311, a storage unit 312, a communication unit 313, and the like.

[0062] The control unit 311 includes a CPU, ROM, RAM, etc. The ROM in the control unit 311 stores control programs and the like that control the operation of each hardware component of the first server 310. The CPU in the control unit 311 reads and executes the control programs stored in the ROM and the computer programs stored in the memory unit 312, and controls the operation of each hardware component, thereby making the entire device function as the first server 310 in this disclosure. The RAM in the control unit 311 temporarily stores data used during the execution of calculations.

[0063] In this embodiment, the control unit 311 is configured to include a CPU, ROM, and RAM, but the configuration of the control unit 311 is not limited to the above. The control unit 311 may also include functions such as a clock for outputting date and time information, a timer for measuring the elapsed time from the time a measurement start instruction is given until a measurement end instruction is given, and a counter for counting numbers.

[0064] The storage unit 312 includes a storage device such as an HDD or SSD. The storage unit 312 stores various computer programs executed by the control unit 311, various data acquired through the communication unit 313, and various data used by the control unit 311.

[0065] The computer program (program product) stored in the memory unit 312 may include a control program PG3 for realizing the information processing system of the present disclosure. The control program PG3 may be a single computer program or a group of programs composed of multiple computer programs. The control program PG3 may be executed collaboratively by multiple computers. For example, the control program PG3 may realize the information processing system of the present disclosure by collaborating with a control program PG1 installed in the air conditioner 100 or a control program PG2 installed in the user terminal 200.

[0066] The computer program, including the control program PG3, is provided, for example, on a non-temporary recording medium RM3 on which the computer program is recorded in a readable format. The recording medium RM3 is a portable memory such as a CD-ROM, USB memory, SD card, microSD card, or CompactFlash®. The control unit 311 reads various computer programs from the recording medium RM3 using a reading device (not shown in the figure) and stores the read computer programs in the storage unit 312. The computer programs stored in the storage unit 312 may also be provided via communication. In this case, the control unit 311 acquires the computer programs via communication through the communication unit 313 and stores the acquired computer programs in the storage unit 312.

[0067] The memory unit 312 may include a generation model MD3. The generation model MD3 is a model that generates new content in response to inputs such as text, audio, still images, and video. The content generated by the generation model MD3 includes text, audio or music, images such as still images or video, etc. The generation model MD3 may be an existing model such as GPT®, BERT, GAN, Wave Net, DALL-E, or Stable Diffusion, or it may be a proprietary model fine-tuned for a specific application.

[0068] The communication unit 313 is equipped with a communication interface for communicating with a user terminal 200 or the like. The communication interface provided by the communication unit 313 can be a wireless communication interface such as 3G, 4G, 5G, or LTE (Long Term Evolution).

[0069] The first server 310 may include an operation unit for receiving operations from administrators, a display unit for displaying information to be notified to administrators, etc. The first server 310 may be a single computer, or it may be a computer system composed of multiple computers and peripheral devices.

[0070] Figure 5 is a block diagram showing the configuration of the control system of the second server 320. The second server 320 is a dedicated or general-purpose server computer and includes a control unit 321, a storage unit 322, a communication unit 323, and the like.

[0071] The control unit 321 includes a CPU, ROM, RAM, etc. The ROM in the control unit 321 stores control programs and the like that control the operation of each hardware component of the second server 320. The CPU in the control unit 321 reads and executes the control programs stored in the ROM and the computer programs stored in the memory unit 322, and controls the operation of each hardware component, thereby making the entire device function as the second server 320 in this disclosure. The RAM in the control unit 321 temporarily stores data used during the execution of calculations.

[0072] In this embodiment, the control unit 321 is configured to include a CPU, ROM, and RAM, but the configuration of the control unit 321 is not limited to the above. The control unit 321 may also include functions such as a clock for outputting date and time information, a timer for measuring the elapsed time from the time a measurement start instruction is given until a measurement end instruction is given, and a counter for counting numbers.

[0073] The storage unit 322 includes a storage device such as an HDD or SSD. The storage unit 322 stores various computer programs executed by the control unit 321, various data acquired through the communication unit 323, and various data used by the control unit 321.

[0074] The storage unit 322 may also include a database DB for storing information such as the operation manual, service guide, technical handbook, installation instructions, customer information, operation data during trial operation, and operation data after the start of operation for the air conditioner 100. The database DB may further register construction information when the air conditioner 100 was installed (installation location of indoor and outdoor units, piping length, floor plan, and year of construction), information about the installed air conditioner 100 (model, Ua value, horsepower, etc.), and sales information for each employee.

[0075] The communication unit 323 is equipped with a communication interface for communicating with a user terminal 200 or the like. The communication interface provided by the communication unit 323 can be a wireless communication interface such as 3G, 4G, 5G, or LTE (Long Term Evolution).

[0076] The second server 320 may include an operation unit for receiving commands from administrators, a display unit for displaying information to be notified to administrators, etc. The second server 320 may be a single computer, or it may be a computer system composed of multiple computers and peripheral devices.

[0077] (First Embodiment) The computer program of the first embodiment outputs a report that includes the result of the abnormality determination of the person being cared for, the control content for the equipment, and the basis for the control content.

[0078] In this disclosure, "persons receiving care" broadly includes individuals who require some form of assistance or support, such as caregiving, and is not limited to "persons requiring care" or "persons requiring support" as defined in national laws and regulations, including Japan's Long-Term Care Insurance Act. In this disclosure, persons receiving care include, for example, individuals with neurological disorders such as dementia, individuals with mental illness, individuals with physical disabilities, bedridden individuals, the elderly, injured persons, sick persons, pregnant women, postpartum women, or infants.

[0079] In this embodiment, the memory unit 312 may store personal information of the person being cared for, such as their name, age, gender, height, weight, blood type, medical history, progression of any disease including dementia, or level of independence in daily living. The memory unit 312 may also store contact information for the caregiver, the care facility used by the person being cared for, a designated medical institution, or a designated emergency medical institution. For example, the contact information may include a telephone number or an email address. The memory unit 312 may also store schedule information related to the caregiver's or care facility's schedule. This schedule information may include, for example, the caregiver's planned activities, the care facility's opening hours, or the care facility staff's shift schedule.

[0080] All computer programs and information processing methods in this embodiment can be broadly applied to equipment in general. Equipment includes, for example, air conditioners 100, air purifiers 151, circulators 152, diffusers 153, lighting equipment 154, audio equipment 155, televisions, refrigerators, washing machines, or information processing devices.

[0081] In this embodiment, the generation model MD3 is preferably configured to output control commands that can be executed by the equipment. For example, the generation model MD3 may be fine-tuned using LoRA (Low-Rank Adaptation) or QLoRA, etc., with multiple pairs of natural language instructions and corresponding equipment control commands as training data.

[0082] Figure 6 is a flowchart illustrating the processing of each control unit in the first embodiment. The control unit 101 of the air conditioner 100, which is a piece of equipment, acquires data related to the person receiving care (step S101). The control unit 101 may acquire data related to the person receiving care from, for example, a sensor unit 104, a user terminal 200 held by the person receiving care, or a wearable device 250 held by the person receiving care.

[0083] Data related to the person receiving care may include, for example, images of the person receiving care, audio recordings of the person receiving care, or vital data of the person receiving care. Images of the person receiving care may include, for example, images showing the person receiving care's movements or facial expressions. Audio recordings of the person receiving care may include, for example, audio recordings containing the person receiving care's speech. Audio recordings of the person receiving care may include, for example, the person receiving care talking to themselves, or the person receiving care's responses to audio recordings such as questions or greetings from equipment. Vital data of the person receiving care may include, for example, data on the person receiving care's heart rate, body temperature, sweating, blood pressure, respiration, electroencephalogram, activity level, or body composition. Preferably, data related to the person receiving care may include data from the past predetermined period of the person receiving care and data from the most recent predetermined period of the person receiving care.

[0084] The control unit 101 acquires data related to the equipment (step S102). The control unit 101 may acquire data related to the equipment from the air conditioner 100 or other equipment. The data related to the equipment may include operating data of the equipment or data of the space in which the equipment is installed. Preferably, the data related to the equipment includes data from a predetermined period in the past and data from a predetermined period in the most recent time. The control unit 101 may acquire data related to the equipment from the storage unit 102.

[0085] The data related to the equipment may include data related to the air conditioner 100. The data related to the air conditioner 100 may include operating data of the air conditioner 100, or air conditioning data of the space in which the air conditioner 100 is installed. The operating data of the air conditioner 100 may include data related to the usage history of the air conditioner 100, such as the on / off status of the air conditioner 100, temperature setting, airflow direction or airflow volume setting, or operating mode. The air conditioning data of the space in which the air conditioner 100 is installed may include data related to the temperature, humidity, or carbon dioxide concentration of the space, for example.

[0086] If there are other pieces of equipment connected via the communication network NW1 or NW2, the control unit 101 may acquire data related to such equipment. Data related to equipment may include, for example, data relating to the usage history of equipment such as the on / off history of an air purifier 151, a circulator 152, a diffuser 153, lighting equipment 154, audio equipment 155, or television, the opening and closing history of a refrigerator, the operation history of a washing machine, or the operation history of an information processing device.

[0087] The control unit 101 may acquire data related to the external environment in addition to data related to the equipment. Data related to the external environment may include, for example, weather, outside temperature, humidity, atmospheric pressure, or other meteorological information. If the sensor unit 104 can acquire data related to the external environment, the control unit 101 may acquire the data related to the external environment acquired by the sensor unit 104. The control unit 101 may also acquire data related to the external environment from weather-related websites via the communication network NW1 or the communication network NW2.

[0088] Step S102 may be performed before step S101, or steps S101 and S102 may be performed in parallel.

[0089] The control unit 101 transmits reference data, which includes data related to the person receiving care and data related to equipment, to the first server 310 (step S103). The reference data may also include data related to the external environment. The control unit 311 of the first server 310 receives the reference data (step S104). The control unit 311 inputs the received reference data, the first agent prompt, and the second agent prompt into the generation model MD3 (step S105). The control unit 311 may also input the personal information of the person receiving care, such as name, age, gender, height, weight, blood type, medical history, disease progression, or level of independence in daily living, into the generation model MD3 as reference data.

[0090] Figures 7 and 8 are explanatory diagrams illustrating an example of a first agent prompt in the first embodiment. The first agent prompt is a prompt that assigns the role of a first agent, which is an AI agent, to the generation model MD3. In this embodiment, the first agent determines whether or not there is an abnormality in the person being cared for, generates control content for the equipment based on the determination result, and generates a report that includes the abnormality determination result, the control content, and the basis for the control content. In this embodiment, the "report" may be divided into two or more parts according to their content.

[0091] In this embodiment, the first agent prompt includes the role of the first agent, a command to confirm reference data, a command to determine an abnormality in the person being cared for based on data relating to the person being cared for and data relating to the equipment, a command to estimate the urgency of the person being cared for according to the abnormality determination result, a command to specify the control content of the equipment according to the abnormality determination result, a command to specify the basis for the control content, a command to generate a report including the abnormality determination result, the specified control content, and the basis for the control content, and a command to execute control of the equipment.

[0092] The first agent prompt may include, for example, the role of the first agent. The role may include, for example, that the first agent should monitor the person being cared for, analyze reference data to determine if there is an abnormality in the person being cared for and output the abnormality determination result, and if an abnormality is determined to exist in the person being cared for, report it to the second agent and control equipment to respond to the abnormality.

[0093] The first agent prompt should ideally include content such as, as shown in Figure 7, "You are an AI responsible for monitoring elderly people and those requiring care, such as those suffering from dementia. You will analyze sensor data (usage history of air conditioning and other appliances, vital data, and behavioral patterns) and detect abnormalities. Follow the procedure below to determine the abnormality and report it to the second agent. Also, implement air conditioning control to address the abnormality."

[0094] The first agent prompt may include, for example, a command to confirm reference data. The command to confirm reference data may include, for example, a request to confirm data related to the usage history of equipment, vital data, images of the person being cared for, voice of the person being cared for, behavioral patterns, lifestyle habits, or cognitive function of the person being cared for estimated from the images or voice of the person being cared for, or the person being cared for's most recent health status estimated from vital data.

[0095] The first agent prompt may include, for example, the following, as shown in Figure 7: "1. Data confirmation - Home appliance usage history (e.g., usage of air conditioners, refrigerators, televisions, and lighting) - Vital data (e.g., heart rate, body temperature, steps, sleep data) - Behavioral patterns (e.g., estimated from lifestyle habits using images and audio, such as voice speech history and door opening / closing status) - Recent lifestyle habits (e.g., estimated from lifestyle habits using images and audio, such as always waking up at a certain time and turning on the air conditioner) - Recent cognitive function (e.g., estimated cognitive function by analyzing responses to questions from the air conditioner) - Recent health status (e.g., estimated from vital data, such as recently having slightly elevated blood pressure)."

[0096] The first agent prompt may include, for example, a command to determine if there is an abnormality in the person being cared for, based on data about the person being cared for and data about the equipment. The abnormality determination command may include, for example, a command to determine whether there is an abnormality in the person being cared for, based on the current usage status of the equipment compared with the equipment's usage history. More specifically, it may include a command to determine, for example, whether the person being cared for is using the equipment at the time they normally use it, based on the equipment's usage history, and to determine whether there is an abnormality in the person being cared for, based on the determination result.

[0097] An abnormality determination command may include, for example, a statement that it should be determined whether or not there is an abnormality in the person being cared for based on the number of utterances in the most recent predetermined period compared with the number of utterances in the past predetermined period. More specifically, it may include a statement that it should be determined whether or not the current number of utterances of the person being cared for is normal based on the average number of utterances of the person being cared for in a predetermined period calculated from the person being cared for's past voice, and then determined whether or not there is an abnormality in the person being cared for based on the determination result.

[0098] An abnormality determination command may include, for example, a statement that a determination should be made as to whether or not there is an abnormality in the person being cared for, based on the current vital data compared with past vital data. More specifically, it may include a statement that, for example, a determination should be made as to whether or not each current vital data is normal based on the mean and standard deviation of each vital data from the person being cared for over a specified period, and then a determination should be made as to whether or not there is an abnormality in the person being cared for, based on the determination result.

[0099] The abnormality determination command may include, for example, a statement that a determination should be made as to whether or not there is an abnormality in the person being cared for, based on the person's response to an interaction from the equipment. More specifically, for example, the command may include a statement that the air conditioner 100 should issue a call, and that a determination should be made as to whether or not there is an abnormality in the person being cared for, based on the person's voice, whether or not there is a response to the issued call within a certain period of time.

[0100] The first agent prompt should include, for example, the following, as shown in Figure 7: "2. Determining whether an abnormality is present. Analyze the following items comprehensively to determine if an abnormality is present - Compare with past usage trends and see if the air conditioner is being used at the time it should be used (if not, it is closer to an abnormality) - Speech data: If the number of utterances is less than the average, it is closer to an abnormality. - Vital abnormalities: If there is an abnormal decrease in heart rate, a sudden change in body temperature, or an extreme decrease in activity level, it is closer to an abnormality. - No response from the user: If there is no response to the call for a certain period of time, it is closer to an abnormality."

[0101] The first agent prompt may include, for example, a command to estimate the urgency level of the person being cared for based on the abnormality detection result. The first agent prompt may include, for example, content such as, "3. If there is an abnormality in the estimation of urgency, estimate whether an emergency response is necessary - the urgency level is estimated in three stages: low, medium, and high."

[0102] The first agent prompt may include, for example, a command to specify the control content of the equipment in response to the abnormality detection result. The command to specify the control content may include, for example, a request to specify the content of the air conditioning control based on the personal information of the person being cared for, the image of the person being cared for, the voice of the person being cared for, the vital data of the person being cared for, the operating data of the equipment, the data of the space in which the equipment is installed, or the notification destination identified by the second agent, as described later. The command to specify the control content may include, for example, a request to create a control command corresponding to the control content to cause the equipment to execute the specified control content.

[0103] The first agent prompt may include, for example, a command to specify the basis for the control content. The command to specify the basis for the control content may include, for example, a statement that the basis for the specified control content should be output. The command to specify the basis for the control content may also include, for example, a statement that an explanation should be included as to which item of the reference data was used and how the control content was specified. In this embodiment, the output of the basis for the control content is shown by giving a prompt to the generation model MD3, but it is not limited to this. The basis for the control content may be the content that contributed to the output result of the control content by the generation model MD3. For example, if the control unit 311 uses a machine learning model that has been trained to output control content when data on the person being cared for and data on equipment are input, the control unit 311 may identify the data on the person being cared for or the data on equipment that contributed to the output result of the control content as the basis for the control content. For example, the control unit 311 identifies data on the person being cared for or data on equipment with a high contribution, such as SHAP value (Shapley value), as the basis for the control content. The control unit 311 may output a report including the basis for the control content by providing the generation model MD3 with data on the identified care recipients with a high contribution or data on equipment.

[0104] The first agent prompt should ideally include content such as, for example, as shown in Figure 8: "4. Air conditioning control - Implement optimal air conditioning control according to the environment, the physical condition of the elderly person, and the reporting destination (e.g., lower the set temperature by a few degrees if body temperature rises rapidly, raise the set temperature by a few degrees if room temperature is low) - Generate control commands to implement air conditioning control - Output the basis for the air conditioning control - Clearly explain which data regarding the environment and the physical condition of the elderly person was relied upon to devise the air conditioning control."

[0105] The first agent prompt may include, for example, a command to generate a report that includes the abnormality detection result, the identified control content, and the basis for the control content. The command to generate the report may include, for example, a statement that the report should include the abnormality detection result of the person being cared for, the abnormality content, and the estimated urgency. The command to generate the report may also include, for example, a statement that the report should include the control content of the equipment or the basis for the control content of the equipment. The first agent prompt may also include, for example, a statement that the generated report should be given to the second agent, which will be described later, and that they should have a dialogue about who to notify. The "dialogue" includes the exchange of information between agents, and for example, the first agent giving the report it generated to the second agent.

[0106] The first agent prompt may include, for example, as shown in Figure 8, "5. Report to the second agent (generate report) Create a report step by step that includes the following and report it to the second agent, and discuss the content of the alert. i) Anomaly detection report - presence or absence of anomaly - content of the anomaly: (Example) Air conditioner not used + no speech + decreased heart rate - estimated urgency ii) Air conditioning control - content of air conditioning control - basis for air conditioning control."

[0107] The first agent prompt may include, for example, a control execution command for equipment. The control execution command may include, for example, a request to send a control command to the equipment according to the control content.

[0108] The first agent prompt may include content such as, for example, "6. Implementing air conditioning control - Sending control commands to the air conditioner to implement air conditioning control," as shown in Figure 8.

[0109] Figure 9 is an explanatory diagram illustrating an example of a second agent prompt in the first embodiment. The second agent prompt is a prompt that assigns the role of a second agent, which is an AI agent, to the generation model MD3. In this embodiment, the second agent identifies a recipient from the candidate recipients and sends a notification.

[0110] The second agent prompt in this embodiment includes the role of the second agent, the care environment of the person being cared for, the abnormality detection result, a plurality of potential recipients, a command to specify a recipient from the plurality of potential recipients based on dialogue with the first agent regarding the recipient, a command to confirm the abnormality detection result based on a report generated by the first agent, a plurality of potential recipients, a command to specify a recipient from the plurality of potential recipients based on dialogue with the first agent regarding the abnormality detection result, the plurality of potential recipients, and the recipient, a command to generate notification content to be sent to the recipient as needed, and a notification command to the specified recipient.

[0111] The second agent prompt may include, for example, the role of the second agent. The role may include, for example, a directive to identify the recipient of the report based on the report. The second agent prompt may also include, for example, the care environment of the person being cared for. The control unit 311 may complete the second agent prompt by receiving input of the care environment of the person being cared for from the user and inputting the received input into the second agent prompt. The input of the care environment of the person being cared for may include, for example, details such as whether they are in a care facility, hospital, or receiving home care.

[0112] The second agent prompt may include, for example, a confirmation command for the abnormality detection result based on the report generated by the first agent. The second agent prompt may include, for example, multiple potential recipients. Potential recipients may include, for example, the caregiver of the person receiving care, the care facility used by the person receiving care, a medical institution, or an emergency medical institution. The second agent prompt may include, for example, a command to specify a recipient from the multiple potential recipients based on the abnormality detection result, the multiple potential recipients, and the dialogue with the first agent regarding the recipients. The command to specify a recipient may include a note that the recipient should be identified by referring to the scheduled information.

[0113] The second agent prompt should include content such as, for example, as shown in Figure 9: "You are an AI whose role is to receive reports of abnormalities from the first agent, assess the urgency of the abnormality, and decide on the appropriate response. Decide who to contact—family, care station, or 119—and make the call. The user's care environment is {}. ### (Procedure) 1. Confirm the details of the abnormality (analyze the report from the first agent) - Example: "Air conditioner not used + no speech + decreased heart rate" - Evaluate the urgency of the abnormality based on the details of the abnormality and the estimated urgency 2. Discuss with the first agent and decide on a course of action by referring to and summarizing the family's schedule information (there are three possible courses of action) - Notify family only - Issue an emergency alert to the caregiver (care station or family) - Immediately call 119."

[0114] The second agent prompt may include, for example, a command to generate a report to be sent to the recipient as needed. The report content may be determined based on the report. The report content may include, for example, the care recipient's personal information, the result of the abnormality detection, the nature of the abnormality, the care recipient's recent health status, or other special notes.

[0115] The second agent prompt may include, for example, the following, as shown in Figure 9: "3. Generating the report content (if necessary) - User name: Mr. / Ms. XX - Age: XX years old - Details of the abnormality: (Example) No response of consciousness + decreased heart rate + decreased body temperature - Recent health condition: XX - Special notes for the paramedics: XX".

[0116] The second agent prompt may include, for example, an order to notify the designated recipient. The second agent prompt may include, for example, content such as "4. Notify family, care station, and ambulance crew - based on the policy decided in step 2, make the notification," as shown in Figure 9.

[0117] As shown in Figure 6, the control unit 311 determines whether or not there is an abnormality in the person being cared for (step S106).

[0118] Figure 10 is an explanatory diagram of an example of dialogue between the first agent and the second agent in the first embodiment. The dialogue shown in Figure 10 does not need to be displayed on the display unit 209 or the like, and can take place within the control unit 311. When reference data is provided to the generation model MD3 and a report including an abnormality judgment result is generated by the first agent, the contents of the report are output. The report may include, but is not limited to, the presence or absence of abnormalities in the usage status of equipment, the number of utterances, vital data, or the responses of the person being cared for, the difference compared to normal times, the content of the abnormality, or the urgency of the abnormality as an abnormality judgment result. For example, as shown in Figure 10, a report including an abnormality judgment result is output, including the contents such as "The following abnormalities were detected: - Air conditioner not used (during normal usage time) - No utterances (usually occurs more than twice a day) - Wearable device heart rate data abnormal (decreasing trend) - Estimated urgency high". In step S106 of Figure 6, the control unit 311 may, for example, determine whether or not there is an abnormality in the person being cared for based on the report including the abnormality judgment result.

[0119] If it is determined that there is no abnormality (step S106: NO), the control unit 311 returns the process to step S101. If it is determined that there is an abnormality (step S106: YES), the control unit 311 obtains the schedule information from the storage unit 312 (step S107). The control unit 311 inputs the obtained schedule information and the generated report into the generation model MD3 (step S108).

[0120] As shown in Figure 10, when schedule information is obtained, the second agent identifies a recipient from the abnormality detection result, multiple potential recipients, and multiple potential recipients based on the abnormality detection result, and outputs the identified recipient. For example, as shown in Figure 10, the output may say, "According to the schedule, my family is out far away today, so I will first make an emergency call to 119. After that, I will contact my family." The identified recipient is then output.

[0121] When the identified recipient of the report is output, the first agent identifies the control content of the equipment and the basis for that control content in accordance with the abnormality detection result, and outputs a report containing the control content for the equipment and the basis for that control content. The report may, but is not limited to, include, as control content, for example, content regarding the operation of the equipment after control, or the difference in the operation of the equipment before and after control. The report may, but is not limited to, include, as the basis for the control content, for example, information based on data about the person being cared for that was used to identify the control content, or information based on data about the equipment used to identify the control content. For example, as shown in Figure 10, a report containing the control content for the equipment and the basis for that control content is output, including content such as, "Understood. The room temperature is high, so I will start the air conditioner at 23°C until the ambulance arrives." In this report, the part "the room temperature is high" is information based on data about the equipment used to identify the control content, the part "because the room temperature is high" is the basis for the control content, and the part "I will start the air conditioner at 23°C" is the control content. Simultaneously with the output of the report, the first agent generates control commands corresponding to the control content.

[0122] As shown in Figure 6, the control unit 311 transmits the control command generated by the first agent to the air conditioner 100 (step S109). The control unit 101 receives the control command (step S110). The control unit 101 executes the control command (step S111). The control of the air conditioner 100 is changed by the execution of the control command.

[0123] The control unit 311 makes a notification to the recipient identified by the second agent (step S112). The control unit 311 may refer to the contact information of the recipient stored in the memory unit 312. If the recipient is a caregiver, the control unit 311 may send a report containing the abnormality detection result, the identified control content, and the basis for the control content to the caregiver's user terminal 200 as a notification, and the control unit 201 may display the received report on the display unit 209. If the recipient is a caregiver, the control unit 311 may also make a phone call to the caregiver's user terminal 200 and play an audio report over the phone. If the recipient is not a caregiver, the control unit 311 may send a report containing the abnormality detection result, the identified control content, and the basis for the control content, or the notification content, to the recipient's email address as a notification. If the recipient is not a caregiver, the control unit 311 may also make a phone call to the recipient's phone number and play an audio report or notification content over the phone.

[0124] The control unit 311 may perform the processing in step S112 before the processing in step S109, or it may perform the processing in step S109 and the processing in step S112 in parallel. Regardless of the identified notification destination, the control unit 311 may send a notification to a predetermined notification destination, for example, the caregiver's contact information. In this case, it is preferable to send a report to the caregiver's contact information. This completes the processing.

[0125] By controlling the operation of equipment, including the air conditioner 100, in response to abnormalities in the person being cared for, the progression of the abnormality in the person being cared for can be slowed. While the progression of the abnormality is slowed, the condition of the person being cared for can be communicated to a third party through a report, thereby increasing the probability of successful protection and rescue of the person being cared for.

[0126] Including the rationale for equipment control in the report clarifies the reasons for controlling the equipment and increases the sense of satisfaction with the control system.

[0127] By referring to data on the care recipient and data on equipment, the system considers not only the care recipient's inherent characteristics but also the environment surrounding them when determining if an abnormality occurs in the care recipient, resulting in a more accurate assessment of the abnormality.

[0128] Each process performed by the control unit 311 may also be performed by the control unit 101 or the control unit 201. Each process performed by the control unit 101 may also be performed by the control unit 201 or the control unit 311. The content generated by the generation model MD3 may also be generated by the generation model MD1 or the generation model MD2. The first agent prompt or the second agent prompt may be given to two or more different generation models. The first agent prompt and the second agent prompt may be partially divided and given to two or more different generation models.

[0129] (Modification) Figure 11 is an explanatory diagram of an example of the first agent prompt and report in a modified example. The report generation command in the first agent prompt may include, for example, a statement that a report should be generated for transmission to an emergency medical institution or healthcare facility. The report generation command may also include, for example, a statement that the report should include the date and time the data related to the care recipient was acquired, the result of the abnormality determination, the nature of the abnormality, the urgency of the abnormality, the care recipient's recent health status, the control details of the equipment, or the basis for the control details of the equipment.

[0130] The first agent prompt may include, for example, as shown in Figure 11, "7. Reporting at the time of notification (report generation) Report the detected contents to the paramedics in a report generated according to the following format: - Detection date and time: yyyy / mm / dd HH: mm - Presence or absence of abnormality - Content of abnormality: (Example) Air conditioner not used + no speech + decreased heart rate - Duration of abnormality: ○ hours - Estimated urgency: (Low / Medium / High) - Recent health status of the person being cared for - Content of air conditioning control - Basis for air conditioning control - Other relevant data: Recent lifestyle, temperature environment."

[0131] The report generated by the first agent may include, for example, the following content as shown in Figure 11: "Report - Detection date and time: 2026 / 08 / 01 20:15 - Abnormality: Abnormality present - Abnormality details: Air conditioner not used + no speech + decreased heart rate - Abnormality duration: 1 hour - Estimated urgency: (High) - Recent health status of the person being cared for: Slightly hypertensive - Details of air conditioning control: Room temperature set to 22°C - Basis for air conditioning control: Room temperature was high and heatstroke was suspected." Reports like the one shown in Figure 11 should ideally be sent to emergency services or medical institutions or other highly specialized organizations involved in life-saving, but they may also be sent to caregivers or care facilities.

[0132] This configuration allows for the provision of more detailed information about the person receiving care to emergency services or medical institutions, thereby increasing the success rate of saving the person's life.

[0133] The report may be a segmented report, as shown in Figure 10, or a single report, as shown in Figure 11. The report may be interactive, as shown in Figure 10, or in itemized and bulleted format, as shown in Figure 11, or in other formats. The report may be in a format composed of markup language, or in audio format, for example.

[0134] Based on the above, a program can be realized that can output a report including the results of the abnormality detection of the person being cared for, the control content for the equipment, and the rationale for the control content.

[0135] (Second Embodiment) The program of this embodiment generates reports and controls equipment while interacting with people around the person being cared for when the urgency of the abnormality is low. The following mainly describes the differences from the first embodiment, and configurations or processes common to the first embodiment are denoted by the same reference numerals and their detailed descriptions are omitted.

[0136] The first agent prompt in this embodiment may include, for example, a command to generate a report including the abnormality detection result when an abnormality is detected. The report does not necessarily have to include the control content and the basis for the control content. The first agent prompt may also include, for example, a statement that the report including the abnormality detection result should include the date and time of acquisition of data related to the person being cared for, the abnormality detection result, the nature of the abnormality, the urgency of the abnormality, the health status of the person being cared for, or the behavioral pattern of the person being cared for.

[0137] The first agent prompt may include, for example, "If, based on the abnormality detection result, it is determined that there is an abnormality in the person being cared for, generate a report that includes the date and time the data related to the person being cared for was acquired, the abnormality detection result, the nature of the abnormality, the urgency of the abnormality, and the person being cared for's recent health status and behavioral patterns."

[0138] In this embodiment, the first agent prompt may include, for example, a command to modify the control content based on a first query regarding the abnormality detection result of the person being cared for. The first query is a query received from a user who is the recipient of the report, such as a caregiver or a care facility staff member. The first agent prompt may include, for example, "When a comment is received from a user, modify the control content and control command as necessary, taking into account the content of the comment, and generate a report that includes the modified control content and the basis for the control content."

[0139] In this embodiment, the first agent prompt may include, for example, a command to generate a report that includes control content and the basis for the control content in response to the received first query. The first agent prompt may include, for example, "When a comment is received from the user, please generate a report that includes control content and the basis for the control content, taking into consideration the content of the comment."

[0140] In this embodiment, the first agent prompt may include, for example, a command to determine whether or not to regenerate the control content based on a second query regarding the control content, a command to execute control of the equipment when regeneration is not required, and a command to regenerate the control content when regeneration is required. The second query is a query received from a user who is the recipient of the notification, such as a caregiver or a care facility staff member. The user who enters the second query is preferably the same as the user who entered the first query, but they may be different.

[0141] The first agent prompt may include, for example, "Based on the comments received from the user, determine whether it is necessary to regenerate the control content. If regeneration is not necessary, send the generated control commands to the equipment to change the equipment's control. If regeneration is necessary, regenerate the control content based on the comments."

[0142] The second agent prompt in this embodiment may include, for example, a command to send a report to the user and a command to interact with the user. The second agent prompt may include, for example, content such as, "Send each report generated by the first agent to the user and interact with the user."

[0143] Figures 12 and 13 are flowcharts illustrating the processing of each processing unit in the second embodiment. Control unit 101 and control unit 311 execute the processes from step S101 to step S106 shown in Figure 6.

[0144] As shown in Figure 12, if an abnormality is determined in step S106 shown in Figure 6 based on the abnormality determination result, the control unit 311 determines whether the urgency of the abnormality of the person being cared for is low or low (step S201). The control unit 311 may, for example, determine whether the urgency is high or low by referring to the estimated urgency level in the report.

[0145] If it is determined that the urgency is not low (step S201: NO), the control unit 311 performs the processing from step S107 onwards in Figure 6. If it is determined that the urgency is low (step S201: YES), the control unit 311 sends a report including the abnormality determination result to the caregiver's user terminal 200 (step S202). In this embodiment, the owner of the caregiver's user terminal 200 may be, for example, the caregiver or a care facility staff member. In this embodiment, the owner of the caregiver's user terminal 200 is assumed to be the caregiver, and will be referred to as "caregiver's user terminal 200" below.

[0146] In this embodiment, in step S202, a report is sent to the caregiver, so the caregiver becomes the recipient of the notification. In this embodiment, the report does not include the generated control content or the basis for the control content. The control unit 201 receives the report (step S203). The control unit 201 displays the received report on the display unit 209 (step S204).

[0147] Figure 14 shows an example of the display on the display unit 209 in the second embodiment. When the second agent sends a report containing the abnormality detection result and the control unit 201 receives the report, the display unit 209 will display a report containing, for example, as shown in Figure 14, "A low-priority abnormality has been detected. It is currently 10 PM. The room temperature is 22°C and the humidity is 50%. According to the sensor and camera footage, Ms. A is in bed, but she has an anxious expression and has said, 'I can't sleep.' According to past data, when the room temperature falls below 22°C at night, Ms. A tends to have difficulty falling asleep, and the risk of wandering and falling increases."

[0148] As shown in Figure 12, the control unit 201 receives input of a first query from the user via operation of the operation unit 208 (step S205). The control unit 201 receives input such as, for example, "Understood. Please set the temperature so that the risk is reduced," as shown in Figure 14. As shown in Figure 12, the control unit 201 sends the received first query to the first server 310 (step S206).

[0149] The control unit 311 receives the first query (step S207). The control unit 311 inputs the received first query into the generation model MD3 (step S208). The control unit 311 sends a report containing the control content and the basis for the control content to the caregiver's user terminal 200 as a response to the first query (step S209).

[0150] The control unit 201 receives the report (step S210). The control unit 201 displays the received report on the display unit 209 (step S211). When the second agent sends a report containing the control content and the basis for the control content, and the control unit 201 receives the report, the display unit 209 displays a report containing content such as, for example, as shown in Figure 14, "Understood. However, it is necessary to prevent it from getting too cold at night, so it would be effective to gradually raise the room temperature from the current 22°C to 23°C. Is it alright to control it in that way?". In this report, the part "However, it is necessary to prevent it from getting too cold at night" corresponds to the basis for the control content, and the part "Gradually raise the room temperature from the current 22°C to 23°C" corresponds to the control content.

[0151] As shown in Figure 12, the control unit 201 receives input for the second query from the user via the operation of the operation unit 208 (step S212). The control unit 201 receives input such as, for example, "Yes, please," as shown in Figure 14. As shown in Figure 12, the control unit 201 sends the received second query to the first server 310 (step S213).

[0152] The control unit 311 receives the second query (step S214). As shown in Figure 13, the control unit 311 inputs the received second query into the generation model MD3 (step S215). The control unit 311 determines whether or not to regenerate the control content based on the second query (step S216). If it is determined that regeneration is not necessary (step S216: NO), the control unit 311 performs the same processing as in steps S109 to S111 in Figure 6 to control the equipment (steps S217 to S219).

[0153] If it is determined that regeneration is necessary (step S216: YES), the control unit 311 performs the processing from step S208 onwards in Figure 12. In step S208 in this case, the control unit 311 may input a second query into the generation model MD3. Upon inputting the second query into the generation model MD3, the control content is regenerated based on the second query, and a report including the regenerated control content and the basis for said control content is sent to the caregiver's user terminal 200.

[0154] By generating control content for equipment while interacting with people around the person receiving care, the control unit 311 can generate more appropriate control content.

[0155] By limiting communication with people around the person receiving care to cases where the urgency of the abnormality is low, highly specialized rescue operations can be carried out by emergency services or medical institutions when the situation is highly urgent.

[0156] In step S106 shown in Figure 6, if it is determined that there is an abnormality based on the abnormality determination result, step S201 may be skipped and step S202 may be performed.

[0157] If the first or second query is not received from the caregiver's user terminal 200 for a certain period of time after the report has been sent, the control unit 311 may automatically send the generated control command to the equipment and control the equipment.

[0158] Based on the above, a program can be realized that generates more appropriate control settings for equipment by interacting with the user.

[0159] (Third Embodiment) The program of this embodiment receives an evaluation of the appropriateness of the notification and changes the notification method for subsequent notifications according to the evaluation. The following mainly describes the differences from the first embodiment, and components or processes common to the first embodiment are denoted by the same reference numerals and their detailed explanation is omitted.

[0160] The second agent prompt in this embodiment may include a query input request output command after notification to a predetermined contact. The query input request is text or voice prompt to request query input from the user. The second agent prompt may include, for example, "If a 119 emergency call has been made, explain the response and confirm with the caregiver whether there were any problems with the response."

[0161] In this embodiment, the second agent prompt may include a command to modify the conditions for identifying the notification destination based on the user's query and the dialogue history between the user and the generative model MD3, and a command to output a response including the modifications. The second agent prompt may include, for example, "Please modify the criteria for identifying the notification destination based on the dialogue history with the user, including the query received from the user. Please send the response including the modifications to the caregiver once to obtain their consent before making any changes."

[0162] Figure 15 is a flowchart illustrating the processing of each control unit in the third embodiment. In step S112 shown in Figure 6, if the control unit 311 notifies a predetermined contact, the control unit 311 sends a query input request to the caregiver's user terminal 200 (step S301). The predetermined contact may be, for example, a medical institution or an emergency medical institution. The control unit 201 receives the query input request (step S302). The control unit 201 displays the query input request on the display unit 209 (step S303).

[0163] Figure 16 shows an example of the display of the display unit 209 in the third embodiment. The control unit 201 may, for example, display the following as a query input request: "We would like to hear your opinion on whether this report was appropriate. Do you feel that the 119 call was appropriate? Are there any areas that can be improved?"

[0164] As shown in Figure 15, the control unit 201 receives input for the third query (step S304). As shown in Figure 16, the control unit 201 receives input in response to the query input request, for example, as the third query, such as "I was just sleeping, so it might not have been necessary to call 119." As shown in Figure 15, the control unit 201 sends the received third query to the first server 310 (step S305).

[0165] The control unit 311 receives the third query (step S306). The control unit 311 inputs the received third query into the generation model MD3 (step S307). The control unit 311 sends the generated response to the caregiver's user terminal 200 (step S308). The response may include modifications to the specific conditions for the recipient of the notification. As shown in Figure 16, the control unit 311 sends a response that includes modifications to the specific conditions for the recipient of the notification, such as, "I see, the threshold for detecting an anomaly may have been high this time. In the future, shall we first try to contact Mr. / Ms. XX with an automated voice message, and only call 119 if there is absolutely no response?"

[0166] As shown in Figure 15, the control unit 201 receives a response (step S309). The control unit 201 displays the received response on the display unit 209 (step S310). The control unit 201 accepts input for the fourth query (step S311). As shown in Figure 16, the control unit 201 accepts input such as "Yes, please." As shown in Figure 15, the control unit 201 sends the accepted input for the fourth query to the first server 310 (step S312).

[0167] The control unit 311 receives the fourth query (step S313). The control unit 311 inputs the fourth query to the generation model MD3 (step S314). Based on the fourth query, the control unit 311 determines whether a re-response is necessary (step S315). If it determines that a re-response is necessary (step S315: YES), the control unit 311 returns the process to step S307. If it determines that a re-response is not necessary (step S315: NO), the control unit 311 modifies the specific conditions for the notification destination based on the interaction history between the user and the generation model MD3, including the query input request, the third query, the response, and the fourth query (step S316).

[0168] For example, as shown in Figure 16, if a query input request is received regarding a 119 emergency call, and a third query is received stating that a 119 call was unnecessary because the person being cared for was simply sleeping, the control unit 311 outputs a response that includes a modification to the conditions for specifying the recipient of the call, stating that it will call the person being cared for by voice, and if there is no response from the person being cared for, it will call the emergency services. If a fourth query is received indicating agreement to this response, the control unit 311 converts the modified content of the response into a control command and executes it. This completes the process.

[0169] If the control unit 311 receives a third query indicating that no modifications are necessary, it may terminate the process.

[0170] In this embodiment, the response includes modifications to the specific conditions for the recipient of the notification; however, the response does not necessarily have to include modifications to the specific conditions for the recipient of the notification.

[0171] Based on the above, the program will be improved to allow for more appropriate reporting based on user feedback.

[0172] 1: Equipment system / Air conditioning system (information processing system) 100: Air conditioner 101: Control unit (processing unit) 200: User terminal 201: Control unit (processing unit) 310: First server (information processing device) 311: Control unit (processing unit) 320: Second server 321: Control unit (processing unit) 322: Memory unit MD1: Generation model MD2: Generation model MD3: Generation model PG1: Control program PG2: Control program PG3: Control program

Claims

1. A program that causes at least one computer to perform a process that acquires data on the person being cared for and data on equipment, and provides the acquired data on the person being cared for and data on equipment to a generation model, thereby outputting a report that includes the result of determining an abnormality of the person being cared for, the control content for the equipment, and the basis for said control content.

2. The program according to claim 1, which outputs a report by providing the generation model with prompts including a command to determine an abnormality of the person being cared for based on data relating to the person being cared for and data relating to the equipment, a command to specify the control content of the equipment according to the abnormality determination result, a command to specify the basis for the control content, and a command to generate a report including the abnormality determination result, the specified control content, and the basis for the control content.

3. The program according to claim 1, which outputs a control command to the equipment according to the control content.

4. The program according to claim 1, which identifies a recipient for notification by providing the abnormality determination result to the generation model.

5. The program according to claim 1, which provides the generation model with a prompt including an abnormality detection result, a plurality of candidate recipients, a command to specify a recipient from the plurality of candidate recipients based on the abnormality detection result, and a command to send a notification to the specified recipient, thereby sending a notification to the specified recipient.

6. The program according to claim 1, wherein a first agent is configured with prompts including a command to determine an abnormality of the person being cared for based on data relating to the person being cared for and data relating to the equipment, a command to specify the control content of the equipment according to the abnormality determination result, a command to specify the basis for the control content, and a command to generate a report including the abnormality determination result, the specified control content, and the basis for the control content, and outputs the report; and a second agent is configured with prompts including a command to specify a recipient from among the multiple recipient candidates based on the abnormality determination result and dialogue with the first agent regarding the recipient, and a command to notify the specified recipient, and notifies the specified recipient.

7. The program according to claim 1, wherein the data relating to the person being cared for includes the person being cared for's speech and the person being cared for's vital data, and the data relating to the equipment includes control data for the air conditioning equipment.

8. The program according to claim 4, which obtains a query from the user to whom the notification is sent, and outputs a response by providing the obtained query to the generation model.

9. An information processing device comprising a processing unit that acquires data relating to a person receiving care and data relating to equipment, and by providing the acquired data relating to the person receiving care and the equipment to a generation model, outputs a report that includes the result of determining an abnormality of the person receiving care, the control content for the equipment, and the basis for said control content.

10. An information processing method that, using at least one computer, performs the following process: acquire data relating to a person receiving care and data relating to equipment; provide the acquired data relating to the person receiving care and the equipment to a generation model; and output a report including the result of determining an abnormality of the person receiving care, the control content for the equipment, and the basis for said control content.

11. An information processing system comprising equipment and an information processing device having a processing unit, wherein the processing unit acquires data relating to the person receiving care and data relating to the equipment, and outputs a report including the result of determining an abnormality of the person receiving care, the control content for the equipment, and the basis for said control content by providing the acquired data relating to the person receiving care and the data relating to the equipment to a generation model.

Images