Air conditioning information output method, air conditioning information output device, and computer program

Abstract

Provided are an air conditioning information output method, an air conditioning information output device, and a computer program for creating a space that corresponds to requests from individual users. In this air conditioning information output method, a computer: acquires content corresponding to a request to the environment of a space; imparts, to a language model, the content and a prompt for instructing output of data relating to control of an air conditioning device in the space; and outputs information relating to the control of the air conditioning device on the basis of data obtained from the language model.

Description

Air conditioning information output method, air conditioning information output device and computer program

[0001] The present disclosure relates to an air conditioning information output method, an air conditioning information output device, and a computer program.

[0002] Patent Document 1 discloses a system that uses sensors that respectively detect indoor environment, temperature, humidity, and carbon dioxide concentration, and adjusts the indoor temperature to approach a target temperature and the indoor humidity to approach a target humidity.

[0003] Japanese Unexamined Patent Publication No. 2020-176799

[0004] An object of the present disclosure is to provide an air conditioning information output method, an air conditioning information output device, and a computer program that create a space that responds to the individual needs of users.

[0005] In the air conditioning information output method according to one embodiment, a computer acquires content corresponding to a request for a space environment, provides the content and a prompt instructing output of data related to control of an air conditioning apparatus in the space to a language model, and outputs information related to control of the air conditioning apparatus based on data obtained from the language model.

[0006] In the air conditioning information output method according to one embodiment, the air conditioning apparatus may include any one of an air conditioner, an outdoor air conditioning unit, a humidifier, a dehumidifier, a fan, an air purifier, and an aromatherapy diffuser.

[0007] In the air conditioning information output method according to one embodiment, in addition to the air conditioning apparatus, the computer may provide the language model with a prompt instructing output of data related to control of an audio device or a lighting device in the space, and output information related to the air conditioning apparatus and the audio device or the lighting device.

[0008] In the air conditioning information output method according to one embodiment, the computer may store the type and number of the air conditioning apparatuses provided in the target space, and generate, as the prompt, text instructing output of information related to control of the air conditioning apparatuses in the target space based on the stored type and number of the air conditioning apparatuses.

[0009] In one embodiment of the air conditioning information output method, the computer may create text as a prompt instructing the computer to output data corresponding to the type and number of air conditioning devices stored, from among the temperature and humidity setting data to be given to the air conditioner, humidifier, or dehumidifier, the wind direction and wind strength setting data to be given to the air conditioner, fan, or air purifier, and the setting data for the air freshener, as information related to the control of the air conditioning devices.

[0010] In one embodiment of the air conditioning information output method, the computer may acquire text indicating the request as content and provide the language model with a prompt containing the acquired text.

[0011] In one embodiment of the air conditioning information output method, the computer may perform a dialogue with the user by providing natural language sentences uttered by the user to a language model and outputting a response sentence, and may acquire the history of the dialogue as content.

[0012] In one embodiment of the air conditioning information output method, the computer may use the language model to create a question sentence that elicits a response corresponding to the request from the user, output the created question sentence to the user, and perform the dialogue.

[0013] In one embodiment of the air conditioning information output method, the language model is a multimodal model that accepts text and images, video, or audio, and the computer may acquire images, video, or audio corresponding to the request as content, and provide the acquired images, video, or audio and the prompt to the language model.

[0014] In one embodiment of the air conditioning information output method, the computer may acquire natural language text uttered by the user as the content, provide the natural language text to the language model to generate an image, video, or sound corresponding to the user's request, create a prompt as text instructing the output of data related to the control of the air conditioning equipment that matches the generated image, video, or sound, and input the image, video, or sound, as well as the created prompt, to the language model.

[0015] In one embodiment of the air conditioning information output method, the computer may store the outputted information relating to the control of the air conditioning equipment in association with identification information for the content, and output information relating to the control of the air conditioning equipment according to the designation of the identification information.

[0016] In one embodiment of the air conditioning information output method, the computer may receive a user's request to save the outputted information relating to the control of the air conditioning equipment, and instruct the language model to output data relating to the control of the air conditioning equipment for the user using the saved information.

[0017] An air conditioning information output device according to one embodiment includes a processing unit that acquires content corresponding to the requirements for the environment of a space, provides a language model with the content and a prompt instructing it to output data relating to the control of air conditioning equipment in the space, and outputs information relating to the control of air conditioning equipment based on the data obtained from the language model.

[0018] One embodiment of a computer program causes a computer to acquire content corresponding to the requirements of the spatial environment, provide a language model with the content and a prompt instructing it to output data relating to the control of air conditioning equipment in the space, and then execute a process to output information relating to the control of air conditioning equipment based on the data obtained from the language model.

[0019] According to one embodiment of the air conditioning information output method, air conditioning information output device, and computer program, it becomes possible to create a space that meets the individual needs of each user through content.

[0020] This is a schematic diagram showing the overall configuration of the air conditioning system according to the first embodiment. This is a block diagram showing the configuration of the control system of the air conditioner. This is a block diagram showing the configuration of the control system of the user terminal. This is a block diagram showing the configuration of the control system of the first server. This is a block diagram showing the configuration of the control system of the second server. This is a functional block diagram showing the functions of the user terminal in the air conditioning system. This is a flowchart showing an example of the air conditioning processing procedure by the air conditioning system in the first embodiment. This is an explanatory diagram of an example of the content of control information output based on the content. This is a diagram showing an example of the content input screen output to the display unit. This is a flowchart showing an example of the air conditioning processing procedure by the air conditioning system in the second embodiment. This is a flowchart showing an example of the air conditioning processing procedure by the air conditioning system in the second embodiment. This is a diagram showing an example of the content input screen in the third embodiment. This is a flowchart showing an example of the air conditioning processing procedure by the air conditioning system in the fourth embodiment. This is a diagram showing an example of the content input screen in the fourth embodiment.

[0021] A specific example of the air conditioning information output method according to this embodiment will be described below with reference to the drawings. However, this technology is not limited to these disclosures, and is as indicated by the claims, with all modifications intended to be within the meaning and scope of the claims.

[0022] <First Embodiment> Figure 1 is a schematic diagram showing the overall configuration of an air conditioning system according to the first embodiment. The air conditioning system 1 comprises an air conditioner 100 and a user terminal 200. The air conditioner 100 and the user terminal 200 are connected to each other via a local communication network NW1 such as Bluetooth® or Wi-Fi®. The transmission and reception of control commands between the air conditioner 100 and the user terminal 200, as described later, may be achieved by infrared communication.

[0023] The air conditioner 100 is a household or commercial air conditioner for adjusting the temperature, humidity, or air cleanliness of a room, and comprises an indoor unit and an outdoor unit. The air conditioner 100 adjusts the temperature, humidity, etc. of a room by operating in accordance with control commands output from a remote controller 150 or a user terminal 200.

[0024] The user terminal 200 is a device such as a smartphone, tablet, personal computer, or smart speaker operated by the user of the air conditioner 100. The user terminal 200 is equipped with generative AI (Artificial Intelligence). The generative AI installed in the user terminal 200 is constructed by a generative model MD2 that generates new content in response to inputs such as text, audio, still images, or videos. The generative model MD2 is a learning model based on a language model that vectorizes input sentences (text) and outputs a response sentence in natural language with appropriate features for input sentences with features represented by vector data. The generative model MD2 may be a multimodal model that accepts inputs of audio, still images, or videos in addition to text. When audio, still images, or videos are input, the generative model MD2 vectorizes their features, performs calculations on the combined input sentence and the vectorized data, and outputs the text of the response sentence, or the audio, still image, or video that serves as the response. The generation model MD2 may be a proprietary model that has been fine-tuned and / or distilled (lightened) for a specific application. The content generated by the generation model MD2 includes text, sound such as voice or music, and images such as still images or videos. The user terminal 200 can create the indoor environment desired by the user by using the generation AI to interact with the user, generating control commands for the air conditioner 100, and controlling the operation of the air conditioner 100 based on the generated control commands.

[0025] In the example shown in Figure 1, there is one user terminal 200, but there may be multiple user terminals 200 capable of controlling the air conditioner 100.

[0026] The air conditioning system 1 may further include an air purifier 151, a circulator (fan) 152, a diffuser (fragrance diffuser) 153, lighting equipment 154, and sound equipment 155. The air conditioning system 1 may also include an air handling unit 156, a humidifier 157, and a dehumidifier 158 (see Figure 6). The air purifier 151 is a device for purifying the indoor air and providing clean air. The circulator 152 is a device for circulating the indoor air. The diffuser 153 is a device for diffusing fragrance. The lighting equipment 154 is a device for illuminating the indoor space. The sound equipment 155 is a device for playing music or ambient sounds. The air handling unit 156 is a device for taking in outside air for ventilation, cooling, heating, or humidifying it, and supplying it indoors. These devices 151 to 158 are connected to at least one of the air conditioner 100 and the user terminal 200 via the communication network NW1 so as to be able to communicate. The target devices of the air conditioning system 1 are not limited to the air purifier 151, circulator (fan) 152, diffuser (fragrance diffuser) 153, lighting equipment 154, sound equipment 155, air handling unit 156, humidifier 157, and dehumidifier 158 described above, but may include any equipment that can be used to prepare the space for the user. The sound equipment 155 can be replaced with sound equipment installed in the user terminal 200.

[0027] The air conditioning system 1 may further include a wearable device 250 worn by the user. The wearable device 250 measures, for example, at least one of the user's heart rate, body temperature, sweating, blood pressure, respiration, brain waves, and body composition, and outputs the measurement results as the user's biometric information. The output destination may be the air conditioning unit 100 or the user terminal 200.

[0028] The air conditioning system 1 may further include a first server 310 or a second server 320 accessible from the air conditioner 100 or a user terminal 200. The air conditioner 100 or the user terminal 200 and the first server 310 or the second server 320 are connected to each other via an external communication network NW2, such as the Internet.

[0029] The first server 310 is equipped with a generative AI. The generative AI of the first server 310 is constructed by a generative model MD3 that generates new content in response to inputs such as text, audio, still images, or videos. The generative model MD3 may be a multimodal model that accepts inputs of text, audio, still images, or videos. The generative model MD3 may include existing models such as GPT (Generative Pretrained Transformer, registered trademark), BERT (Bidirectional Encoder Representations from Transformers), GAN (Generative Adversarial Network), Wave Net, DALL-E, and Stable Diffusion, or it may be a unique model that has been fine-tuned for a specific application from an existing model. The first server 310 generates content such as text, audio, still images, or videos in response to a request from the air conditioner 100 or user terminal 200, and returns the generated content to the requester.

[0030] The second server 320 is a search server that searches for relevant documents or information in response to an input query and returns the relevant documents or information to the requester. Existing search engines such as vector search are used to search for relevant documents and information. In one example, the second server 320 is a general-purpose search server that returns search results in response to external search requests. Alternatively, the second server 320 may be a dedicated search server that can access a database DB that stores information such as operation manuals, service guides, technical handbooks, installation instructions, customer information, operation data during trial operation, or operation data after the start of operation for the air conditioner 100, and searches the database DB in response to external search requests and returns the search results to the requester. The database DB may also further register construction information when the air conditioner 100 was installed (installation location of indoor and outdoor units, piping length, floor plan, or year of construction), information about the installed air conditioner 100 (model, Ua value, or horsepower, etc.), sales information for each employee, etc.

[0031] The air conditioning system 1 according to the first embodiment realizes space creation by generating AI by utilizing at least one of the generation model MD2 installed on the user terminal 200 and the generation model MD3 installed on the first server 310. The space creation by generating AI may be realized by utilizing the content output from the generation model MD2 installed on the user terminal 200, or by utilizing the content output from the generation model MD3 installed on the first server 310.

[0032] The creation of a space using generation AI may also be achieved through the cooperation of generation model MD2 installed on the user terminal 200 and generation model MD3 installed on the first server 310.

[0033] Furthermore, the creation of spaces using generation AI may be realized using a RAG (Retrieval-Augmented Generation) mechanism. That is, in response to an input query from the air conditioner 100 or user terminal 200, the second server 320 may output documents or information related to the input query, and the first server 310 may generate content based on the documents or information output from the second server 320 and return the content to the air conditioner 100 or user terminal 200. By using a RAG mechanism, more accurate and relevant content can be provided.

[0034] In the first embodiment, the user terminal 200 is configured to have the generation model MD2 installed. Alternatively, the generation model may be installed in the air conditioner 100. In this case, the generation model MD1 (see Figure 2) installed in the air conditioner 100 may be used to realize space creation by generation AI. Alternatively, the generation model MD1 of the air conditioner 100 and the generation model MD3 of the first server 310 may cooperate to realize the above-mentioned "space creation by generation AI".

[0035] Furthermore, generation models may be installed on both the air conditioner 100 and the user terminal 200. In this case, at least two of the generation models, MD1 of the air conditioner 100, MD2 of the user terminal 200, and MD3 of the first server 310, may work together to realize space creation using generation AI.

[0036] Figure 2 is a block diagram showing the configuration of the control system of the air conditioner 100. The air conditioner 100 comprises a control unit 101, a storage unit 102, a communication unit 103, a sensor unit 104, and a drive unit 110.

[0037] The control unit 101 includes a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), etc. The control unit 101 may also include an MPU (Micro-Processing Unit), GPU (Graphics Processing Unit), or NPU (Neural Processing Unit). The ROM in the control unit 101 stores control programs for controlling the operation of the drive unit 110. The CPU in the control unit 101 executes the control programs stored in the ROM and various computer programs stored in the storage unit 102, and controls the operation of the drive unit 110, thereby making the entire device function as the air conditioner 100 in this disclosure.

[0038] The storage unit 102 is equipped with a storage device such as flash memory. The storage unit 102 stores various computer programs to be executed by the control unit 101, as well as data necessary for the execution of these programs.

[0039] The computer program (program product) stored in the memory unit 102 includes a control program PG1 for realizing the "space creation by generation AI" described above. The control program PG1 may be a single computer program or a group of programs composed of multiple computer programs. The control program PG1 may be executed collaboratively by multiple computers.

[0040] The computer program, including the control program PG1, is provided, for example, on a non-temporary recording medium RM1 on which the computer program is recorded in a readable format. The recording medium RM1 is a portable memory such as a CD-ROM, USB memory, SD card, microSD card, or CompactFlash®. The control unit 101 reads various computer programs from the recording medium RM1 using a reading device (not shown in the figure) and stores the read computer programs in the storage unit 102. The computer programs stored in the storage unit 102 may also be provided via communication. In this case, the control unit 101 acquires the computer programs via communication through the communication unit 103 and stores the acquired computer programs in the storage unit 102.

[0041] The data stored in the memory unit 102 may include at least one of the following: an operation manual, a service guide, a technical handbook, installation instructions, customer information, operational data during commissioning, and operational data after the start of operation.

[0042] When the air conditioner 100 is equipped with a generation AI, the generation model MD1 that constructs the generation AI is stored in the memory unit 102. The generation model MD1 is a model that generates new content in response to inputs such as text, voice, still images, and videos. The content generated by the generation model MD1 includes text, voice or music, images such as still images or videos, etc. The generation model MD1 is a unique model that has been fine-tuned and / or distilled (lightened) for a specific application from existing models such as GPT, BERT, GAN, Wave Net, DALL-E, and Stable Diffusion.

[0043] The communication unit 103 includes a communication interface for communicating with a user terminal 200 and the like. As the communication interface included in the communication unit 103, a communication interface compliant with wireless LAN (Local Area Network) communication standards such as Wi-Fi (registered trademark) can be used. Alternatively, a communication interface compliant with short-range wireless communication standards such as Bluetooth may be used. In addition to the user terminal 200, the communication unit 103 may be configured to be capable of communicating with an air purifier 151, a circulator 152, a diffuser 153, a lighting device 154, an audio device 155, an outdoor air conditioner 156, and the like.

[0044] The communication unit 103 may further include a communication interface for communicating with a first server 310 or a second server 320. As such a communication interface, wireless communication interfaces such as Wi-Fi (registered trademark), 3G, 4G, 5G, and LTE (Long Term Evolution) can be used.

[0045] The sensor unit 104 includes one or more sensors that measure various physical quantities in an indoor environment or the state of a user. The sensors included in the sensor unit 104 include sensors that measure at least one of indoor temperature, humidity, heat, CO2 concentration, and illuminance. The sensor unit 104 may include sensors that measure a user's movement, facial expression, and the like.

[0046] The drive unit 110 includes a compressor 111, a four-way switching valve 112, an indoor fan 113, a flap 114, and the like. The compressor 111 is a device for sucking in a constant-temperature, low-pressure gaseous refrigerant and compressing it into a high-temperature, high-pressure gas. During cooling operation, the refrigerant compressed by the compressor 111 returns to the suction side of the compressor 111 via an outdoor heat exchanger, an expansion valve, a first indoor heat exchanger, an electromagnetic valve, and a second indoor heat exchanger. In this refrigeration cycle, heat is dissipated by the outdoor heat exchanger functioning as a condenser, and indoor air is cooled by the first and second indoor heat exchangers functioning as evaporators to perform cooling. During heating operation, the four-way switching valve 112 switches the flow path, and heating is performed in a cycle reverse to that in cooling operation.

[0047] The indoor fan 113 is a device for evenly circulating cooled air or heated air throughout the entire room. The airflow volume of the indoor fan 113 is controlled by a control command from the control unit 101. By adjusting the airflow volume of the indoor fan 113, the efficiency of cooling and heating can be improved, and energy consumption can be reduced.

[0048] The flap 114 is a device for adjusting the direction of air delivered from the air conditioner 100. The orientation of the flap 114 is controlled by a control command from the control unit 101. By ensuring an appropriate air flow with the flap 114, the efficiency of cooling and heating can be improved, and energy consumption can be reduced.

[0049] Figure 3 is a block diagram showing the configuration of the control system of the user terminal 200. The user terminal 200 is a terminal device such as a smartphone, a tablet terminal, a personal computer, or a smart speaker, and includes a control unit 201, a storage unit 202, a communication unit 203, an imaging unit 204, a voice input unit 205, a voice output unit 206, a positioning unit 207, an operation unit 208, a display unit 209, and the like.

[0050] The control unit 201 includes a CPU, a ROM, a RAM, and the like. The control unit 201 may also include an MPU, a GPU, an NPU, or the like. A control program for controlling the operation of each hardware unit included in the user terminal 200 is stored in the ROM included in the control unit 201. The CPU in the control unit 201 reads and executes the control program stored in the ROM and the computer program stored in the storage unit 202, and controls the operation of each of the above hardware units, thereby causing the entire apparatus to function as the user terminal 200 in the present disclosure. Data used during the execution of calculations is temporarily stored in the RAM included in the control unit 201.

[0051] In the first embodiment, the control unit 201 is configured to include a CPU, ROM, and RAM. Alternatively, the control unit 201 may be one or more control circuits or processing circuits that include, for example, a GPU (Graphics Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), quantum processor, volatile or non-volatile memory, etc. The control unit 201 may also include functions such as a clock that outputs date and time information, a timer that measures the elapsed time from the time a measurement start instruction is given to the time a measurement end instruction is given, and a counter that counts numbers.

[0052] The storage unit 202 includes a storage device such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive). The storage unit 202 stores various computer programs executed by the control unit 201 and various data used by the control unit 201.

[0053] The computer program (program product) stored in the memory unit 202 includes a control program PG2 for realizing space creation using generation AI. The control program PG2 may be a single computer program or a group of programs composed of multiple computer programs. The control program PG2 may be executed collaboratively by multiple computers. For example, the control program PG1 installed in the air conditioner 100 and the control program PG2 installed in the user terminal 200 may collaborate to realize space creation using generation AI.

[0054] The computer program, including the control program PG2, is provided, for example, on a non-temporary recording medium RM2 on which the computer program is recorded in a readable format. The recording medium RM2 is a portable memory such as a CD-ROM, USB memory, SD card, microSD card, or CompactFlash®. The control unit 201 reads various computer programs from the recording medium RM2 using a reading device (not shown in the figure) and stores the read computer programs in the storage unit 202. The computer programs stored in the storage unit 202 may also be provided via communication. In this case, the control unit 201 acquires the computer programs via communication through the communication unit 203 and stores the acquired computer programs in the storage unit 202.

[0055] The memory unit 202 may include a generation model MD2. The generation model MD2 is a model that generates new content in response to inputs such as text, audio, still images, and videos. The content generated by the generation model MD2 includes text, audio or music, images such as still images or videos, etc. The generation model MD2 is a unique model that has been distilled (lightened) for a specific purpose from existing models such as GPT, BERT, GAN, Wave Net, DALL-E, and Stable Diffusion.

[0056] The communication unit 203 is equipped with a communication interface for communicating with the air conditioner 100 and the like. The communication interface provided by the communication unit 203 can be a communication interface compliant with a wireless LAN communication standard such as Wi-Fi (registered trademark). Alternatively, a communication interface compliant with a short-range wireless communication standard such as Bluetooth may be used. In addition to the air conditioner 100, the communication unit 203 may be configured to communicate with an air purifier 151, a circulator 152, a diffuser 153, lighting equipment 154, sound equipment 155, and the like.

[0057] The communication unit 203 further includes a communication interface for communicating with the first server 310 or the second server 320. Such a communication interface can be a wireless communication interface such as Wi-Fi®, 3G, 4G, 5G, or LTE (Long Term Evolution).

[0058] The imaging unit 204 is equipped with an image sensor such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge-Coupled Device), and generates an image (still image or video) of the object to be imaged by imaging the object. The imaging unit 204 outputs the image data related to the generated image to the control unit 201. The control unit 201 stores the input image data in the storage unit 202. The control unit 201 may display the image based on the image data on the display unit 209, or transmit it to the outside via the communication unit 203.

[0059] The audio input unit 205 includes a microphone for collecting sound, a processing circuit for converting the collected sound into a digital signal (audio data), and the like. The audio data generated in the audio input unit 205 is sent to the control unit 201, where appropriate processing such as noise reduction is performed. The audio data generated in the audio input unit 205 is also stored in the storage unit 202 or transmitted to the first server 310 via the communication unit 203.

[0060] The audio output unit 206 is equipped with a speaker that outputs sound. The audio output unit 206 reproduces sound based on the audio data provided by the control unit 201. In this embodiment, the audio input unit 205 and the audio output unit 206 are configured to input and output sound, but sounds other than voice (ambient sounds, music, etc.) may be input to the audio input unit 205 and sounds other than voice (ambient sounds, music, etc.) may be output from the audio output unit 206.

[0061] The positioning unit 207, for example, is equipped with a GPS (Global Positioning System) receiver and receives radio waves transmitted from GPS satellites to determine the current location of the user terminal 200. The positioning unit 207 outputs location information related to the determined current location of the user terminal 200 to the control unit 201.

[0062] The operation unit 208 is equipped with operating devices such as a touch panel, keyboard, and switches, and accepts various inputs and operations from the user. The control unit 201 acquires information input through the operation unit 208 and performs appropriate control based on the various operation information provided by the operation unit 208.

[0063] The display unit 209 is equipped with a display device such as a liquid crystal monitor or an organic EL (Electro-Luminescence) monitor, and displays information that should be notified to the user in response to instructions from the control unit 201.

[0064] Figure 4 is a block diagram showing the configuration of the control system of the first server 310. The first server 310 is a dedicated or general-purpose server computer and includes a control unit 311, a storage unit 312, a communication unit 313, and the like.

[0065] The control unit 311 includes a CPU, ROM, RAM, etc. The ROM in the control unit 311 stores control programs and the like that control the operation of each hardware component of the first server 310. The CPU in the control unit 311 reads and executes the control programs stored in the ROM and the computer programs stored in the memory unit 312, and controls the operation of each hardware component, thereby making the entire device function as the first server 310 in this disclosure. The RAM in the control unit 311 temporarily stores data used during the execution of calculations.

[0066] In this embodiment, the control unit 311 is configured to include a CPU, ROM, and RAM, but the configuration of the control unit 311 is not limited to the above. The control unit 311 may also include functions such as a clock for outputting date and time information, a timer for measuring the elapsed time from the time a measurement start instruction is given until a measurement end instruction is given, and a counter for counting numbers.

[0067] The storage unit 312 includes a storage device such as an HDD or SSD. The storage unit 312 stores various computer programs executed by the control unit 311, various data acquired through the communication unit 313, and various data used by the control unit 311.

[0068] The computer program (program product) stored in the memory unit 312 may include a control program PG3 for realizing the "space creation by generation AI" described above. The control program PG3 may be a single computer program or a group of programs composed of multiple computer programs. The control program PG3 may be executed collaboratively by multiple computers. For example, the control program PG3 may realize the "space creation by generation AI" described above by collaborating with a control program PG1 installed in the air conditioner 100 or a control program PG2 installed in the user terminal 200.

[0069] The computer program, including the control program PG3, is provided, for example, on a non-temporary recording medium RM3 on which the computer program is recorded in a readable format. The recording medium RM3 is a portable memory such as a CD-ROM, USB memory, SD card, microSD card, or CompactFlash®. The control unit 311 reads various computer programs from the recording medium RM3 using a reading device (not shown in the figure) and stores the read computer programs in the storage unit 312. The computer programs stored in the storage unit 312 may also be provided via communication. In this case, the control unit 311 acquires the computer programs via communication through the communication unit 313 and stores the acquired computer programs in the storage unit 312.

[0070] The memory unit 312 may include a generation model MD3. The generation model MD3 is a model that generates new content in response to inputs such as text, audio, still images, and videos. The content generated by the generation model MD3 includes text, audio or music, images such as still images or videos, etc. The generation model MD3 may be an existing model such as GPT, BERT, GAN, Wave Net, DALL-E, or Stable Diffusion, or it may be a proprietary model fine-tuned for a specific application.

[0071] The communication unit 313 is equipped with a communication interface for communicating with a user terminal 200 or the like. The communication interface provided by the communication unit 313 can be a wireless communication interface such as 3G, 4G, 5G, or LTE (Long Term Evolution).

[0072] The first server 310 may include an operation unit for receiving operations from administrators, a display unit for displaying information to be notified to administrators, etc. The first server 310 may be a single computer, or it may be a computer system composed of multiple computers and peripheral devices.

[0073] Figure 5 is a block diagram showing the configuration of the control system of the second server 320. The second server 320 is a dedicated or general-purpose server computer and includes a control unit 321, a storage unit 322, a communication unit 323, and the like.

[0074] The control unit 321 includes a CPU, ROM, RAM, etc. The ROM in the control unit 321 stores control programs and the like that control the operation of each hardware component of the second server 320. The CPU in the control unit 321 reads and executes the control programs stored in the ROM and the computer programs stored in the memory unit 322, and controls the operation of each hardware component, thereby making the entire device function as the second server 320 in this disclosure. The RAM in the control unit 321 temporarily stores data used during the execution of calculations.

[0075] In this embodiment, the control unit 321 is configured to include a CPU, ROM, and RAM, but the configuration of the control unit 321 is not limited to the above. The control unit 321 may also include functions such as a clock for outputting date and time information, a timer for measuring the elapsed time from the time a measurement start instruction is given until a measurement end instruction is given, and a counter for counting numbers.

[0076] The storage unit 322 includes a storage device such as an HDD or SSD. The storage unit 322 stores various computer programs executed by the control unit 321, various data acquired through the communication unit 323, and various data used by the control unit 321.

[0077] The storage unit 322 may also include a database DB for storing information such as the operation manual, service guide, technical handbook, installation instructions, customer information, operation data during trial operation, and operation data after the start of operation for the air conditioner 100. The database DB may further register construction information when the air conditioner 100 was installed (installation location of indoor and outdoor units, piping length, floor plan, and year of construction), information about the installed air conditioner 100 (model, Ua value, horsepower, etc.), and sales information for each employee.

[0078] The communication unit 323 is equipped with a communication interface for communicating with a user terminal 200 or the like. The communication interface provided by the communication unit 323 can be a wireless communication interface such as 3G, 4G, 5G, or LTE (Long Term Evolution).

[0079] The second server 320 may include an operation unit for receiving operations from administrators, a display unit for displaying information to be notified to administrators, etc. The second server 320 may be a single computer, or it may be a computer system composed of multiple computers and peripheral devices.

[0080] In the air conditioning system 1 configured in this way, the user terminal 200 can specify environmental requirements for a target space, such as "indoors" as shown in Figure 1, using content, and control the equipment corresponding to the content. Even if the user's environmental requirements for the space are ambiguous, the system can control equipment to create a space that meets the user's requirements. Figure 6 is a functional block diagram showing the functions of the user terminal 200 in the air conditioning system 1. In the first embodiment, the control unit 201 of the user terminal 200 functions as a content acquisition unit 211, a control information output unit 212 using a generation model MD2, and a command output unit 213 that outputs control commands to each device from the outputted control information, based on the control program PG2.

[0081] The control unit 201, which functions as a content acquisition unit 211, acquires content corresponding to the user's request through operation of the operation unit 208 or voice input to the voice input unit 205. In the first embodiment, the content acquisition unit 211 acquires text corresponding to the user's request. The text may be a conversation expressed in natural language describing the user's wishes, or it may be extracted keywords.

[0082] The control unit 201, which functions as a control information output unit 212, outputs control information for each device, including the air conditioner 100, corresponding to the content acquired by the content acquisition unit 211 using the generation model MD2. In the first embodiment, the control information output unit 212 inputs text instructing the generation model MD2 to output control information corresponding to the content, along with the content acquired by the content acquisition unit 211, and outputs the control information obtained from the generation model MD2. The control information output unit 212 stores the types and number of devices installed in the target space and creates and provides text instructing the generation model MD2 to output control information according to the types and number of devices. Based on the types and number of devices installed in the target space that are stored, the control information output unit 212 can also determine whether there is any missing content to input in order to obtain control information from the generation model MD2.

[0083] The control unit 201, which functions as a command output unit 213, can communicate with the air conditioner 100, air purifier 151, circulator 152, diffuser 153, lighting equipment 154, sound equipment 155, air handling unit 156, humidifier 157, and dehumidifier 158 via the communication network NW1. The command output unit 213 converts the control information output by the control information output unit 212 into control commands corresponding to each target device, and outputs the control commands to each device via the communication unit 203. The command output unit 213 may also output control signals to each device via a wired connection through the I / O provided by the control unit 201, such as a user terminal 200.

[0084] Depending on the application environment of the air conditioning system 1, it may be possible to provide only the air conditioner 100 among the air conditioner 100, air purifier 151, circulator 152, diffuser 153, lighting equipment 154, sound equipment 155, outdoor air handling unit 156, humidifier 157, and dehumidifier 158. The connection destinations of the command output unit 213 shown in Figures 1 and 6 are merely examples illustrating cases where many devices are included, and as mentioned above, only the air conditioner 100 may be able to communicate, or the air conditioner 100 and the air purifier 151 may be able to communicate, or the outdoor air handling unit 156 and the lighting equipment 154 may be able to communicate, and any combination is possible.

[0085] Due to the functions of the control unit 201 of the user terminal 200 described above, the air conditioning system 1 outputs control information corresponding to the content indicating the user's request, sometimes in cooperation with the first server 310 and the second server 320.

[0086] Figure 7 is a flowchart showing an example of the air conditioning process procedure by the air conditioning system 1 in the first embodiment. The following process procedure is started when the user activates the control program PG2 on the user terminal 200 and selects a setting menu for the air conditioning system 1.

[0087] The control unit 201 of the user terminal 200 identifies the equipment that can communicate from among the air purifier 151, circulator 152, diffuser 153, lighting equipment 154, sound equipment 155, air handling unit 156, humidifier 157, and dehumidifier 158 (step S201). In step S201, the control unit 201 may identify the equipment from the types and number of air conditioning equipment that have been registered in advance in the setting menu and stored in the storage unit 202. In step S201, the control unit 201 may attempt to establish a communication connection using the communication unit 203 and identify the equipment that is running and can communicate.

[0088] The control unit 201 acquires control information at the time of processing of the identified equipment (step S202). In step S202, the control unit 201 acquires, for example, from the air conditioner 100 the operating mode, which is one of cooling, heating, or dry operation, parameters corresponding to the mode, such as the set temperature or set humidity, and data obtained from the sensor unit 104, such as the room temperature, humidity, or CO2 concentration. The control unit 201 also acquires operating modes or control parameters from other equipment.

[0089] The control unit 201 outputs the acquired control information via the display unit 209 and / or the audio output unit 206 (step S203), and, functioning as a content acquisition unit 211, accepts content input from the user regarding the control of each device (step S204). In step S203, the control unit 201 may create and output a question sentence based on the control program PG2 to elicit the user's requests regarding the information at the time of processing, prompting the user to input content in step S204. In step S204, the control unit 201 acquires keywords indicating the user's requests or conversational sentences in natural language from the operation unit 208 or the audio input unit 205.

[0090] Based on the received content, the control unit 201, functioning as a control information output unit 212, creates a prompt instructing the output of data related to the control of the air conditioning equipment identified in step S201 (step S205). In step S205, if the target is the air conditioner 100, humidifier 157, or dehumidifier 158, the control unit 201 creates a prompt instructing the output of temperature and humidity setting data. In step S205, if the target is the air conditioner 100, circulator 152, or air purifier 151, the control unit 201 creates a prompt instructing the output of wind direction and wind strength setting data. In step S205, if the target is the diffuser 153, the control unit 201 creates a prompt instructing the output of strength setting data such as weak / strong. In step S205, the control unit 201 creates text instructing the output of data corresponding to the type and number of identified equipment.

[0091] In step S205, the control unit 201 can obtain more appropriate control information by creating a prompt that includes a description of the control information at the time of processing acquired in step S202.

[0092] In step S205, the control unit 201 may create a prompt to output a response sentence in response to the user's content input, so as to make it a conversation. For example, in step S205, if the control unit 201 has reflected the content acquired in step S202 but still lacks the information necessary to configure the target device, it may create a prompt to output a response sentence to elicit this information and instruct the control unit 201 to continue the conversation. If the information necessary for configuration is satisfied by the user's content input, the control unit 201 may create a prompt to output control information.

[0093] In step S205, if the control unit 201 has received input of additional content from the user in multiple parts in step S209, as described later, it creates a prompt to instruct the output of data based on the content and the history including the additional content. If the control unit 201 has obtained conversation text from the user in natural language in step S204, in step S205 the control unit 201 may create a prompt to instruct the output of control information based on the conversation history.

[0094] In step S205, the control unit 201 may include information such as weather, outside temperature, or outside humidity obtained based on the current location of the user terminal 200 acquired by the positioning unit 207 in the prompt.

[0095] The control unit 201 provides the content received in step S204 and the prompt created in step S205 to the generation model MD2 (step S206). In step S206, if additional content has been received, the control unit 201 may provide the generation model MD2 with a history of the received content, including this additional content, or it may provide the generation model MD2 with content each time it is received. If the generation model MD2 is continuously receiving content input from the user, it may retain data on past content input from the user and output control information reflecting this past data.

[0096] The control unit 201 acquires control information output from the generated model MD2 (step S207), and for confirmation, outputs the acquired control information via the display unit 209 and / or the audio output unit 206 (step S208).

[0097] The control unit 201 determines whether there is any new additional content input from the user based on the control information output in step S208 (step S209). If it determines that there is new additional content input (S209: YES), it returns the process to step S204.

[0098] If the control unit 201 determines that there is no new content input (S209: NO), it converts the control information acquired in step S207 into control commands for each device (step S210) and stores it in the storage unit 202 as history (step S211). In step S211, the control unit 201 may store the control information in association with the identification ID and date and time information, or it may store the control information in association with an overview of the input content.

[0099] The control unit 201 outputs the converted control command to each device using its function as a command output unit 213 (step S212). The control unit 201 outputs the result of step S212 using the display unit 209 and / or the audio output unit 206 (step S213), and terminates the processing related to the settings for each device.

[0100] In response to the output in step S213, the control unit 201 may accept a save operation from the user and receive a name from the user for saving, which it may then store in the storage unit 202.

[0101] Figure 8 is an explanatory diagram illustrating an example of the content of control information output based on the content. The upper part of Figure 8 shows the conversation history, including the input text from the user terminal 200 and the response text from the generation model MD2, and the lower part of the figure shows an example of the content of control information output from the conversation history.

[0102] The conversation shown in Figure 8 indicates that, in response to the question "What kind of space would you like?" from the control unit 201 based on the control program PG2, the user entered the text "A relaxing space."

[0103] The control unit 201 of the user terminal 200, using the function of the control information output unit 212, provides the generation model MD2 with text (content) indicating the user's request for a "relaxing space," and outputs the control information shown at the bottom of Figure 8. As shown in Figure 8, the control information includes information on temperature, humidity, wind, sound, and scent. For the content "relaxing space," for example, the output will be 24°C for temperature, 48% for humidity, a weak wind, relaxing music for sound, and a weak scent.

[0104] Based on the control information output in this manner, the control unit 201 starts the air conditioner 100 and, using the function of the command output unit 213, outputs a control command to the air conditioner 100 to set the operating mode to automatic, the temperature setting to 24°C, and the airflow setting to low. The control unit 201 also uses the same function to output a control command to the humidifier 156 or dehumidifier 157 indicating the target humidity. The control unit 201 also uses the same function to determine that there is no need to operate the circulator 152 and does not start it. The control unit 201 also uses the same function to start the diffuser 153 and outputs a control command to the diffuser 153 instructing it to operate in low mode. The control unit 201 also uses the same function to start the audio equipment 155 and outputs a control command instructing it to play music from the specified playlist.

[0105] As shown in Figure 8, the user can input content to configure the control information for each device in the target space, including the air conditioner 100. Rather than operating the control panels of the air conditioner 100, humidifier 156 or dehumidifier 157, and sound equipment 155, the user can avoid the complexity of using the control program P2 and create an appropriate space by inputting text that expresses the atmosphere, such as "relax," or by making voice calls to the smart speaker.

[0106] Figures 9 and 10 show an example of a content input screen 290 output to the display unit 209. Figure 9 shows the result of a conversation similar to the one shown in Figure 8 being performed via the operation unit 208 and the display unit 209. The content input screen 290 shown in Figure 9 is a screen that accepts content input from the user as a request to the space, and includes an input area 291 that accepts text input manually or by voice, like a messaging application, and an output area 292 that displays the input text and the output from the generation model MD2. The content input screen 290 displays the text (message) input by the user and the output from the generation model MD2 in the form of speech bubbles.

[0107] Figure 10 shows that, after the conversation shown in Figure 9, if the user inputs modifications or requests as additional content, the content input screen 290 displays text in the input area 291 indicating a request to keep the music as is and to not operate the diffuser 153. In response, the control unit 201 outputs control information to the output area 292 of the content input screen 290 indicating that the diffuser 153 will not be operated in accordance with the request.

[0108] As shown in Figures 8-10, users can fine-tune the creation of their desired space by inputting text indicating their requests into an interface similar to a messaging app and modifying the outputted control information. Even if the user's requests for the spatial environment are vague, the requests will gradually become more appropriate, and after the control starts and the user likes the control, they can save it by inputting a save request in input area 291. This allows the generation model MD2 to refer to previously saved control information and make recommendations to the user. Through this process, the user terminal 200 can function as a space creation AI agent using the control program PG2.

[0109] <Second Embodiment> In the second embodiment, the user terminal 200 executes processing using the generation model MD3 of the first server 310. The air conditioning system 1 of the second embodiment is the same as the air conditioning system 1 of the first embodiment, except for the processing procedure using the first server 310 which will be described below. Therefore, the same reference numerals are used for common components and detailed descriptions are omitted.

[0110] Figures 11 and 12 are flowcharts illustrating an example of the air conditioning process performed by the air conditioning system 1 in the second embodiment. Among the processing steps shown in Figures 11 and 12, steps common to the processing steps shown in Figure 7 of the first embodiment are given the same step numbers, and detailed explanations are omitted.

[0111] In the second embodiment, when the control unit 201 of the user terminal 200 receives content input via operation to the operation unit 208 or voice input to the voice input unit 205 (S204), it sends a control information output request to the first server 310 including the received content and the information acquired in steps S201 and S202 (step S215).

[0112] The first server 310 receives a control information output request (step S311). Based on the control program PG3, the control unit 311 of the first server 310 requests related information from the second server 320 based on the information of the target air conditioning equipment included in the control information output request (step S312). In step S312, the control unit 311 may include the model number, product information, or model of the target air conditioning equipment in the request for related information. The control unit 311 extracts identification data of the user terminal 200 itself, or identification data that identifies the user using the user terminal 200, from the control information output request and includes identification data that allows information registered in the database DB to be retrieved.

[0113] The second server 320 receives a request for relevant information (step S321), and the control unit 321 identifies knowledge data such as customer information, manuals, and driving data from the database DB based on the identification data included in the request (step S322). The control unit 321 either reads the identified knowledge data or obtains the reference location of the knowledge data (step S323) and sends it to the first server 310 (step S324).

[0114] The first server 310 receives knowledge data or a reference destination (step S313). The control unit 311 specifies the received knowledge data itself or a reference destination and creates a prompt instructing the output of data related to the control of the air conditioning equipment based on the content included in the control information output request received in step S311 (step S314). In step S314, the control unit 311, for example, uses the knowledge data to create a prompt instructing each device to appropriately output the content of the control information corresponding to the content.

[0115] In step S314, the control unit 311 may use the current location of the user terminal 200, acquired by the positioning unit 207 of the user terminal 200, to obtain information such as weather, outside temperature, or outside humidity from an external server that provides weather forecasts via the communication network NW2, and use it as knowledge data.

[0116] Other details of the procedure for creating the prompt in step S314 are the same as the details of the process in step S205 of the processing procedure shown in Figure 7 of the first embodiment. Therefore, the details of the process in step S314 will not be explained.

[0117] The control unit 311 provides the content included in the control information output request received in step S311, the prompt created in step S314, and the knowledge data itself or the specified reference destination received in step S313 to the generation model MD3 (step S315). In step S315, if the control unit 311 is receiving additional content, such as when the conversation continues as described later, it may provide the generation model MD3 with a history of the received content including this additional content, or it may provide the generation model MD3 with content each time it is received. If the generation model MD3 is continuously receiving content input from the user, it may retain data on past content input from the user and output control information reflecting the past data.

[0118] The control unit 311 acquires control information output from the generated model MD3 (step S316), and for confirmation, transmits the acquired control information to the user terminal 200 (step S317).

[0119] The control unit 201 of the user terminal 200 receives control information transmitted from the first server 310 (step S216), and for confirmation, outputs the received control information using the display unit 209 and / or the audio output unit 206 (step S217).

[0120] The control unit 201 determines whether there is any additional content input from the user based on the control information output in step S217 (step S218). If it determines that there is additional content input (S218: YES), it returns the process to step S204.

[0121] If it is determined that no additional content has been input (S218: NO), the control unit 201 executes the processing from step S210 onward, which converts the control information received in step S216 into a control command.

[0122] The processing procedure shown in the second embodiment makes it possible to obtain control information corresponding to the appropriate settings of each device, such as manuals and operating data, from the generation model MD2. In the second embodiment as well, the control unit 311 of the first server 310 may use the generation model MD2 to create conversational text in response to content (user input text) received by the user terminal 200, and output it from the user terminal 200. In the second embodiment, the control unit 311 of the first server 310 can accurately determine missing information by using knowledge data from the database DB.

[0123] <Third Embodiment> In the third embodiment, the user terminal 210 used in the user terminal 200 receives images or sounds as content and outputs control information that creates a space that reproduces or evokes the content. The air conditioning system 1 of the third embodiment is the same as the air conditioning system 1 of the first or second embodiment, except for the processing procedure described below, so the same reference numerals are used for common components and detailed descriptions are omitted. In the air conditioning system 1 of the third embodiment, the generation model MD2 used in the user terminal 200 and the generation model MD3 used in the first server 310 employ a multimodal model.

[0124] In the third embodiment, the generation model MD2 or generation model MD3 accepts image or video input instead of text. In the third embodiment, the air conditioning system 1 basically executes the processing procedure shown in Figure 7 of the first embodiment, or the processing procedure shown in Figures 11 and 12 of the second embodiment. In the third embodiment, the control unit 201 of the user terminal 200 accepts image or video input in step S204 of the processing procedure in Figure 7 or the processing procedure in Figures 11 and 12. For this reason, in step S203, the control unit 201 may prompt the user to input an image or video by displaying a message or GUI on the display unit 209 such as, "Please specify an image or video that matches the image of the space you want to create."

[0125] In step S205 of the processing procedure in Figure 7, or in step S314 of the processing procedures in Figures 11 and 12, during the prompt creation process, the control unit 201 or control unit 311 includes in the prompt an instruction statement that instructs the system to describe the content, such as "description="A photo with"", for the given image or video content, and also includes in the prompt an instruction statement that instructs the system to analyze information such as temperature, wind speed, and color tone based on the created description, and output data to control the air conditioning system, including the air conditioner 100, lighting equipment, etc.

[0126] Figures 13 and 14 show an example of a content input screen 290 in the third embodiment. The content input screen 290 of the third embodiment includes an input area 291, such as a messaging application, and an output area 292, similar to the screens shown in Figures 9 and 10 of the first embodiment. In the third embodiment, the input area 291 includes a media input unit 293 that accepts the selection of an image or video. When the media input unit 293 is selected, the control unit 201 can accept the selection from an image stored in the storage unit 202 of the user terminal 200 or in the cloud, or acquire an image captured by the imaging unit 204. In Figure 13, when the media input unit 293 is selected, a list of images is displayed at the bottom of the content input screen 290, and the user can input the selected sound, image, or video as content by selecting one of them.

[0127] Figure 14 shows the content input screen 290 shown in Figure 13 after an image is selected in the media input section 293 and the output area 292 is updated. The output area 292 displays control information output by the control information output section 212 in natural language. The output area 292 displays a description of the image selected in the media input section 293, and in addition, control information related to temperature, humidity, wind, sound, and smell (fragrance) output from the generation model MD2 or generation model MD3 corresponding to the description is output. In the example in Figure 14, the image description is "Shows a tropical beach scene," and the control information outputs a temperature of "25°C to 27°C" based on "bright sunshine" corresponding to "beach" obtained from the content. Furthermore, the control information outputs humidity of "50% to 60%" based on the analysis that "the humidity on the beach is relatively high," which also corresponds to "beach," and wind speed (wind volume) of "approximately 4 to 6 m / s" based on the analysis that "a gentle breeze from the sea during the day" is output. The control information outputs the necessary music for a "tropical beach," specifically "music that evokes the sound of waves and the laughter of people playing in the distance." Furthermore, the control information outputs "a fragrance that recreates the fresh scent of the sea."

[0128] Based on the control information output to the content input screen 290 shown in Figure 14, the control unit 201, through the function of the command output unit 213, outputs a command to the air conditioner 100 to set the temperature to 25°C based on the correspondence with the outside temperature, to stop the operation of the humidifier 157 and dehumidifier 158, and to the air handling unit 156 to operate at a low speed to bring in fresh air. The control unit 201, through the function of the command output unit 213, outputs a command to stop the operation of the air purifier 151 and to output the set fragrance to the diffuser 153. The control unit 201, through the function of the command output unit 213, outputs a command to the music application installed on the user terminal 200 as the audio device 155 to play music from a playlist such as "sound of waves, background music for a tropical beach".

[0129] The control unit 201 of the user terminal 200 may, instead of receiving image or video input in step S204, acquire content in natural language and have the generation model MD2 or generation model M3 generate sound, image, or video (video) corresponding to the user's request based on the acquired content. The control unit 201 may also perform the same processing as described in the third embodiment to receive approval from the user for the generated sound, image, or video and output control information corresponding to the approved sound, image, or video.

[0130] As shown in the third embodiment, audio, images, or videos can be specified as content, and the user can obtain not only control information for creating a "comfortable" space set on the air conditioner 100 side, but also a variety of control information to explore "comfort" according to the user's own senses. Even if the user's requests for the environment of the space are ambiguous, such as differing in their desire for the same "comfort," the system can obtain control information that appropriately responds to the user's requests. In addition, subtle control is possible not only with the air conditioner 100, but also with the air purifier 151, diffuser 153, or humidifier 157, etc., by specifying text or images that include "relax" expressed in natural language.

[0131] <Fourth Embodiment> In the fourth embodiment, the user terminal 200 allows the user to save control information and accepts the user's selection from the saved control information. The air conditioner system 1 of the fourth embodiment is the same as the air conditioner system 1 shown in the first to third embodiments, except for the processing details described below, so the same reference numerals are used for common components and detailed explanations are omitted.

[0132] In the fourth embodiment, the control unit 201 of the user terminal 200 stores the control commands converted from the control information as history in step S211 of the processing procedure shown in Figure 7 or Figures 11 and 12. After operating each air conditioning device, including the air conditioner 100, for a while according to the control commands, the control unit 201 accepts a request to save the created space from the user who likes it. At this time, the control unit 201 stores the control information to be saved and the corresponding identification information corresponding to the content (text, sound, image, or video) in association with it. The control unit 201 may accept a name from the user when saving. When the control unit 201 saves control information output from content that is sound, image, or video, it may store a thumbnail of the content and an explanatory text generated by generation model MD2 or generation model MD3 for the content in association with it in the storage unit 202.

[0133] Figure 15 is a flowchart showing an example of the air conditioning process by the air conditioning system 1 in the fourth embodiment. The following process begins when the user starts the control program PG2 on the user terminal 200 and selects a setting menu for the air conditioning system 1. Of the process steps shown in Figure 15, steps that are common with the flowchart in Figure 7 shown in the first embodiment are given the same step numbers and detailed explanations are omitted.

[0134] In the fourth embodiment, after outputting control information at the time of processing (S203), the control unit 201 determines whether or not the user has requested a selection from past history (step S221). If the control unit 201 determines that no selection has been requested (S221: NO), it proceeds to step S204 and continues the processing procedure shown in the first to third embodiments.

[0135] If the control unit 201 determines that a selection has been requested (S221: YES), it reads the control information previously stored as history in the storage unit 202 (step S222). In step S222, the control unit 201 may read the data that has been converted and stored as a control command, or it may read the control information before conversion, or past content and prompts for outputting that control information.

[0136] The control unit 201 outputs a list of control information read in step S222 (step S223), and accepts a selection from the output list (step S224). The control unit 201 continues processing from step S212 onward according to the control command corresponding to the selected control information.

[0137] Figure 16 shows an example of a content input screen 290 in the fourth embodiment. The content input screen 290 of the fourth embodiment includes an input area 291, similar to a messaging application, and an output area 292, similar to the screens shown in Figures 9 and 10 of the first embodiment. In the example screen in Figure 16, the input area 291 includes a media input unit 293. In the example screen in Figure 16, the natural language phrase "Let me select from previous settings," entered by the user, is reflected and displayed in the output area 292. Upon input of the text "Let me select from previous settings," the control unit 201 determines, in step S221 of the processing procedure shown in Figure 15, that a selection from history has been requested, and proceeds to step S222.

[0138] The content input screen 290 shown in Figure 16 includes a list 294 in which images designated as content are associated with corresponding control information (control commands). List 294 shows control information associated with an image of a tropical beach and control information associated with an image reminiscent of a mountain drive. In List 294, content can be used as identification information, and the user can specify their favorite settings from the past while imagining what kind of space can be created by specifying an image (thumbnail).

[0139] The processing procedure shown in the fourth embodiment allows users to reuse their favorite settings from the past. As shown in Figure 16, because the settings are saved in association with the corresponding content, users can visually grasp and specify what kind of space the settings were intended to create. Even if the requests are vague, it is possible to control each piece of equipment, including the air conditioner 100, according to the individual user's requests.

[0140] The embodiments disclosed above are illustrative in all respects and not restrictive. The scope of the invention is indicated by the claims, and all modifications within the meaning and scope of the claims are equivalent.

[0141] 1. Air conditioning system 100. Air conditioner 151. Air purifier 152. Circulator 153. Diffuser 154. Lighting equipment 155. Audio equipment 156. Outdoor air handling unit 157. Humidifier 158. Dehumidifier 200. User terminal 201. Control unit 202. Memory unit 203. Communication unit 208. Operation unit 209. Display unit PG1, PG2. Control programs MD1, MD2. Generation models

Claims

1. An air conditioning information output method comprising: a computer acquiring content corresponding to the requirements for the spatial environment; providing a language model with the content and a prompt instructing the output of data relating to the control of air conditioning equipment in the space; and outputting information relating to the control of air conditioning equipment based on the data obtained from the language model.

2. The air conditioning information output method according to claim 1, wherein the air conditioning equipment includes one of the following: an air conditioner, an outdoor air handling unit, a humidifier, a dehumidifier, a fan, an air purifier, and an aroma diffuser.

3. The air conditioning information output method according to claim 2, wherein the computer provides a prompt to the language model instructing it to output data relating to the control of sound equipment or lighting equipment in the space, in addition to the air conditioning equipment, and outputs information relating to the air conditioning equipment and the sound equipment or lighting equipment.

4. The air conditioning information output method according to claim 2, wherein the computer stores the types and number of air conditioning devices installed in the target space, and generates text as a prompt that instructs the output of information regarding the control of the air conditioning devices in the target space based on the stored types and number of air conditioning devices.

5. The air conditioning information output method according to claim 4, wherein the computer generates text instructing the computer to output, as a prompt, data corresponding to the type and number of air conditioning devices stored, from among the temperature and humidity setting data to be given to the air conditioner, humidifier, or dehumidifier, the wind direction and wind strength setting data to be given to the air conditioner, fan, or air purifier, and the setting data for the air freshener, as information related to the control of the air conditioning devices.

6. The air conditioning information output method according to any one of claims 1 to 5, wherein the computer obtains text indicating the request as the content and provides the language model with a prompt containing the obtained text.

7. The air conditioning information output method according to any one of claims 1 to 5, wherein the computer performs a dialogue with the user by providing natural language sentences uttered by the user to a language model and outputting a response sentence, and acquires the history of the dialogue as content.

8. The air conditioning information output method according to claim 7, wherein the computer creates a question sentence using the language model to elicit an answer corresponding to the request from the user, outputs the created question sentence to the user, and performs the dialogue.

9. The air conditioning information output method according to any one of claims 1 to 5, wherein the language model is a multimodal model that accepts text and images, video, or audio, and the computer acquires images, video, or audio corresponding to the request as content, and provides the acquired images, video, or audio and the prompt to the language model.

10. The air conditioning information output method according to claim 1 or 2, wherein the computer obtains natural language text uttered by a user as content, provides the natural language text to the language model to generate an image, video, or sound corresponding to the user's request, creates text as a prompt that instructs the output of data relating to the control of the air conditioning equipment that matches the generated image, video, or sound, and inputs the image, video, or sound, as well as the created prompt, to the language model.

11. The air conditioning information output method according to claim 1 or 2, wherein the computer stores the outputted information relating to the control of the air conditioning equipment in association with the identification information for the content, and outputs the information relating to the control of the air conditioning equipment according to the designation of the identification information.

12. The air conditioning information output method according to claim 1 or 2, wherein the computer receives a user's request to save the outputted information relating to the control of the air conditioning equipment, and instructs the language model to output data relating to the control of the air conditioning equipment for the user using the saved information.

13. An air conditioning information output device comprising: a processing unit that acquires content corresponding to the requirements for the environment of a space; provides a language model with the content and a prompt that instructs the output of data relating to the control of air conditioning equipment in the space; and outputs information relating to the control of air conditioning equipment based on the data obtained from the language model.

14. A computer program that causes a computer to acquire content corresponding to the requirements of a spatial environment, to provide a language model with the content and prompts instructing it to output data relating to the control of air conditioning equipment in the space, and to execute a process that outputs information relating to the control of air conditioning equipment based on the data obtained from the language model.

Images