Notification system, notification method, and refrigerator

Abstract

To provide a notification system, a notification method, and a refrigerator, which can improve convenience.SOLUTION: A notification system performs notification through a voice output device and includes a control section. The control section can control the voice output device so as to perform first notification when a first condition is satisfied and perform second notification when a second condition is satisfied. One of the first notification and the second notification is a first type of notification about a content that can be set to a household appliance by a user. The other of the first notification and the second notification is a second type of notification. If the second condition is satisfied when the first condition is satisfied, the control section determines a content or a mode of the notification by the voice output device on the basis of a relationship including the type of notification between the first notification and the second notification.SELECTED DRAWING: Figure 18

Description

Technical Field

[0001] Embodiments of the present invention relate to a notification system, a notification method, and a refrigerator.

Background Art

[0002] In a refrigerator having a speaker, when the notification indicating that thawing has been completed in the chilled compartment overlaps with the notification indicating that the water supply tank is empty, a technique for determining the order of notifications based on a predetermined priority has been proposed.

[0003] By the way, a notification system for household appliances such as a refrigerator is expected to further improve convenience.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] The problem to be solved by the present invention is to provide a notification system, a notification method, and a refrigerator that can improve convenience.

Means for Solving the Problems

[0006] The notification system of the embodiment is a notification system that provides notification via an audio output device and includes a control unit. The control unit can control the audio output device to provide a first notification when a first condition is met and a second notification when a second condition is met. One of the first and second notifications is a first type of notification relating to content that can be set by the user on the home appliance. The other of the first and second notifications is a second type of notification. When the first condition is met and the second condition is met, the control unit determines the content or manner of notification by the audio output device based on the relationship between the first and second notifications, including the types of notifications. [Brief explanation of the drawing]

[0007] [Figure 1] A diagram showing the overall configuration of the home appliance management system according to the embodiment. [Figure 2] A perspective view showing a refrigerator according to an embodiment. [Figure 3] A cross-sectional view of the refrigerator along the F3-F3 line shown in Figure 2. [Figure 4] A diagram showing a refrigerator with the refrigerator compartment door open, according to the embodiment. [Figure 5] A diagram showing the setting operation unit of an embodiment. [Figure 6] A perspective view showing a partially disassembled upper wall of the refrigerator according to the embodiment. [Figure 7] A block diagram showing the functional configuration related to the speaker device of the embodiment. [Figure 8] A block diagram showing the functional configuration of the refrigerator according to the embodiment. [Figure 9] A diagram showing the types of notifications in the embodiment. [Figure 10] A diagram showing an example of the content of the adjustment information for the embodiment. [Figure 11] A flowchart showing an example of the processing flow of the notification control unit of the embodiment. [Figure 12] A diagram illustrating the notification control in Scene 1 of the embodiment. [Figure 13] A diagram illustrating the notification control in Scene 2 of the embodiment. [Figure 14] A diagram for explaining the notification control in Scene 3 of the embodiment. [Figure 15] A diagram for explaining the details of the notification control in Scene 3 of the embodiment. [Figure 16] A diagram for explaining the details of the notification control in Scene 3 of the embodiment. [Figure 17] A diagram for explaining the details of the notification control in Scene 3 of the embodiment. [Figure 18] A diagram for explaining the notification control in Scene 5 of the embodiment. [Figure 19] A diagram showing an example of the content of the priority information in the embodiment. [Figure 20] A diagram for explaining the notification control in Scene 6 of the embodiment. [Figure 21] A diagram for explaining the notification control in Scene 7 of the embodiment. [Figure 22] A diagram for explaining the notification volume in the embodiment. [Figure 23] A diagram for explaining the notification control in Scene A of the embodiment. [Figure 24] A diagram for explaining the notification control in Scene B of the embodiment. [Figure 25] A diagram for explaining the notification control in Scene C of the embodiment. [Figure 26A] A diagram for explaining the notification control in Scene D of the embodiment. [Figure 26B] A diagram for explaining the notification control in Scene D of the embodiment. [Figure 27] A diagram for explaining the notification control in Scene E of the embodiment. [Figure 28] A diagram for explaining the notification control in Scene F of the embodiment. [Figure 29] A diagram for explaining the notification control in Scene G of the embodiment. [Figure 30] A diagram showing the overall configuration of the home appliance management system according to the first modification example of the embodiment. [Figure 31] A diagram showing the overall configuration of the home appliance management system according to the second modification example of the embodiment.

Modes for Carrying Out the Invention

[0008] The notification system, notification method, and refrigerator of the embodiment will be described below with reference to the drawings. In the following description, components having the same or similar functions will be denoted by the same reference numerals. Duplication of these components may be omitted. In this application, "based on XX" means "based on at least XX," and may also include cases where XX is based on another element in addition to XX. Furthermore, "based on XX" is not limited to cases where XX is used directly, but may also include cases where XX has been calculated or processed. In this application, "XX or YY" is not limited to cases where either XX or YY is used, but may also include cases where both XX and YY are used. This is also true when there are three or more optional elements. XX and YY are arbitrary elements (e.g., arbitrary information).

[0009] In this application, "to acquire" is not limited to actively acquiring information by sending a transmission request, but may also include acquiring information by passively receiving information transmitted from another device. Furthermore, "to acquire" is not limited to directly acquiring the target information (information to be acquired) from an external source, but may also include acquiring the target information by generating it through calculations or processing of information obtained from an external source.

[0010] (Embodiment) <1. Overall Configuration of the Home Appliance Management System> Figure 1 shows the overall configuration of the home appliance management system 1. The home appliance management system 1 is an example of an "information processing system". The home appliance management system 1 includes, for example, one or more home appliances 100, a server 200, and a home appliance management application AP on a terminal device 300. In this embodiment, each of the home appliances 100, the server 200, and the terminal device 300 is an example of a "computer". The network NW described later may be, for example, the Internet, a cellular network, a Wi-Fi network, LPWA (Low Power Wide Area), WAN (Wide Area Network), LAN (Local Area Network), or other public lines or dedicated lines, depending on the situation.

[0011] The home appliance 100 is an electrical appliance primarily used in a home. The home appliance 100 is used by user U and is located within user U's residence. The home appliance 100 is connected to a network NW, for example, via a wireless router WR and modem M installed within user U's residence. The home appliance 100 can communicate with a server 200 or a terminal device 300 via the network NW. The home appliance 100 may also communicate directly with the terminal device 300 using short-range wireless communication, such as Bluetooth®.

[0012] In the examples described below, one or more home appliances 100 include a refrigerator 100A (first home appliance) and a clothes processing machine 100B (second home appliance). Note that the first and second home appliances are not limited to the above examples and may include refrigerators, clothes processing machines, air conditioners, cooking appliances, lighting devices, television receivers, or other home appliances as appropriate. In this application, "clothing processing machine" refers to washing machines (including washer-dryers), dryers, or closet-type clothes processing machines. For convenience of explanation, clothes processing machine 100B may be referred to as "washing machine 100B" below. In this application, "cooking appliance" refers to oven ranges, microwave ovens, toasters, or rice cookers.

[0013] Server 200 is a management server that manages the home appliance 100. Server 200 consists of one or more server devices (e.g., cloud servers). Server 200 can communicate with the home appliance 100 or terminal devices 300 via a network NW. Server 200 may include an information processing unit that performs edge computing or fog computing, such as an information processing unit included in a router in the network NW. Server 200 is not limited to a cloud server; it may also be a computer in the user U's residence or a home router.

[0014] The terminal device 300 is a computer used by user U. The terminal device 300 is, for example, a portable terminal device such as a smartphone or tablet terminal device. However, the terminal device 300 is not limited to a portable terminal device and may be a personal computer or the like. The terminal device 300 includes, for example, a display device 301, an input device 302, and a communication unit 303. The display device 301 has a display screen 301a capable of displaying various information. The input device 302 is capable of receiving input from user U. The input device 302 is, for example, a touch panel superimposed on the display screen 301a. The input device 302 may include a camera, microphone, etc., provided on the terminal device 300. The communication unit 303 is a communication module capable of wireless communication. The communication unit 303 is connected to the network NW via or directly through a wireless router WR and modem M. The communication unit 303 can communicate with home appliances 100 or a server 200 via the network NW. As mentioned above, the terminal device 300 may also be able to communicate directly with the home appliance 100 using short-range wireless communication such as Bluetooth.

[0015] The terminal device 300 has application program P installed and supports the functions described below. Application program P is an application program for managing home appliances 100. Hereinafter, the application software launched when application program P is executed will be referred to as the "home appliance management app AP".

[0016] <2. Refrigerator> Next, I will explain the refrigerator 100A. Figure 2 is a perspective view showing refrigerator 100A. Refrigerator 100A includes, for example, a housing 10, multiple doors 20, a cooling unit 30 (see Figure 3), an ultraviolet irradiation device 37 (see Figure 3), a setting operation unit 40 (see Figure 3), a communication unit 50 (see Figure 6), a control board 60 (see Figure 6), and a speaker device 70 (see Figure 6). In this embodiment, an example of a "notification system" is realized by the configuration of refrigerator 100A excluding the speaker device 70.

[0017] <2.1 Enclosure and Door> The casing 10 is a component that forms the majority of the outer casing of the refrigerator 100A. The casing 10 has an upper wall 10a, a lower wall 10b, left and right side walls 10c, 10d, and a rear wall 10e, and is box-shaped with an open front. The casing 10 includes, for example, an inner box that forms the inner surface of the casing 10, an outer box that forms the outer surface of the casing 10, and foamed insulation material provided between the inner box and the outer box, and has thermal insulation properties. The casing 10 includes a plurality of storage compartments 11.

[0018] The multiple storage compartments 11 include, for example, a refrigerator compartment 11A, a chilled compartment 11Aa (see Figure 3), a vegetable compartment 11B, an ice-making compartment 11C, an upper freezer compartment 11D, and a main freezer compartment 11E. In this embodiment, the refrigerator compartment 11A is located at the top, the vegetable compartment 11B is located below the refrigerator compartment 11A, the ice-making compartment 11C and the upper freezer compartment 11D are located below the vegetable compartment 11B, and the main freezer compartment 11E is located below the ice-making compartment 11C and the upper freezer compartment 11D. However, the arrangement of the storage compartments 11 is not limited to the above example. The chilled compartment 11Aa is an example of a "special storage compartment". The special storage compartment may be a partial freezing compartment cooled to a partial freezing temperature range, or a switching compartment that allows switching between temperature ranges, instead of a chilled compartment. Each storage compartment 11 has an opening that allows food to be put in and taken out.

[0019] The openings of the multiple storage compartments 11 are closed by multiple doors 20. The multiple doors 20 include left and right refrigerator compartment doors 20Aa and 20Ab that close the opening of the refrigerator compartment 11A, a vegetable compartment door 20B that closes the opening of the vegetable compartment 11B, an ice maker compartment door 20C that closes the opening of the ice maker compartment 11C, an upper freezer compartment door 20D that closes the opening of the upper freezer compartment 11D, and a main freezer compartment door 20E that closes the opening of the main freezer compartment 11E. Hereafter, when the left and right refrigerator compartment doors 20Aa and 20Ab are not distinguished, they will simply be referred to as "refrigerator compartment door 20A".

[0020] <2.2 Cooling section> Figure 3 is a cross-sectional view of the refrigerator 100A shown in Figure 2 along the line F3-F3. The refrigerator 100A has a cooling unit 30 that cools a plurality of storage compartments 11. The cooling unit 30 includes, for example, a compressor 31, a refrigerating cooler 32, a refrigerating blower 33, a freezing cooler 34, and a freezing blower 35.

[0021] The compressor 31 compresses the refrigerant and supplies the compressed refrigerant to the refrigerating cooler 32 and the freezing cooler 34 via a condenser and capillary tube. The refrigerating cooler 32 is located in the first ventilation passage K1, which is situated behind the refrigerator compartment 11A, and cools the air flowing through the first ventilation passage K1 using the refrigerant supplied from the compressor 31. The refrigerating fan 33 circulates the air cooled by the refrigerating cooler 32 (cold air) between the refrigerated temperature zone compartments (refrigerated compartment 11A, chilled compartment 11Aa, and vegetable compartment 11B) and the first ventilation passage K1. This cools the refrigerated temperature zone compartments.

[0022] The refrigeration cooler 34 is located in the second ventilation passage K2, which is situated behind the main freezer compartment 11E, and cools the air flowing through the second ventilation passage K2 using a refrigerant supplied from the compressor 31. The refrigeration blower 35 circulates the air (cold air) cooled by the refrigeration cooler 34 between the refrigeration temperature zone chambers (ice-making compartment 11C, upper freezer compartment 11D, and main freezer compartment 11E) and the second ventilation passage K2. This cools the refrigeration temperature zone chambers.

[0023] <2.3 Ultraviolet irradiation device> The ultraviolet irradiation device 37 is installed, for example, in the vegetable compartment 11B. When the sterilization mode is set, the ultraviolet irradiation device 37 promotes sterilization of the vegetable compartment 11B by irradiating the inside of the vegetable compartment 11B with ultraviolet light. The ultraviolet irradiation device 37 may also be installed in the refrigerator compartment 11A or the chilled compartment 11Aa, etc., instead of or in addition to the vegetable compartment 11B.

[0024] <2.4 Settings and Operation Section> The setting operation unit 40 is located inside the refrigerator 100A (for example, on the inner surface of the housing 10). The setting operation unit 40 receives user U operations related to the refrigerator 100A.

[0025] Figure 4 shows the refrigerator 100A with the refrigerator compartment doors 20Aa and 20Ab open. In this embodiment, the setting operation unit 40 is provided on the inner surface of the refrigerator compartment 11A (for example, on the left side of the inner surface of the refrigerator compartment 11A). When the refrigerator compartment doors 20Aa and 20Ab are closed, the setting operation unit 40 is not exposed to the outside of the refrigerator 100A, and the user U cannot operate the setting operation unit 40. On the other hand, when the refrigerator compartment doors 20Aa and 20Ab are opened, the setting operation unit 40 is exposed to the outside of the refrigerator 100A, and the user U can operate the setting operation unit 40.

[0026] The setting operation unit 40 may be provided on the surface of the door 20 (for example, the front of the refrigerator compartment door 20A) instead of inside the refrigerator 100A. In this application, "provided on the surface" means that the setting operation unit 40 can be operated by the user U touching the surface, and may include cases where the sensor is located recessed relative to the surface of the door.

[0027] Figure 5 shows the setting operation unit 40. The setting operation unit 40 includes, for example, a plurality of operation units 41, a plurality of light-emitting units 42, and an operation control unit 43.

[0028] The operation unit 41 is a button, switch, or dial provided on the setting operation unit 40. Multiple operation units 41 include, for example, multiple first operation units 41a, multiple second operation units 41b, and multiple third operation units 41c. The first operation unit 41a receives operations from user U regarding the setting of the cooling control of the refrigerator 100A. "Operations regarding the setting of the cooling control" include switching the setting of the cooling intensity (e.g., "strong setting", "medium setting", "weak setting"), which is the temperature setting of the storage compartment 11, or starting or ending a predetermined control mode for one or more storage compartments 11. "Predetermined control modes" include, for example, a cooling control mode for the chilled compartment 11Aa (e.g., a special chilled mode or a defrosting mode), a cooling control mode for the ice-making compartment 11C (e.g., a rapid ice-making mode or an ice-making stop mode), and a cooling control mode for the upper freezer compartment 11D (e.g., a soft freezing mode or an automatically ending freezing mode).

[0029] The second operation unit 41b accepts user U operations related to the settings of the ultraviolet irradiation device 37. "Operations related to the settings of the ultraviolet irradiation device" include operations such as switching the settings of the ultraviolet irradiation device 37 (for example, "on state" and "off state"). The third operation unit 41c accepts user U operations related to the settings of the wireless communication of the refrigerator 100A. "Operations related to the settings of wireless communication" include operations such as wireless communication connection registration operations (for example, pairing in Bluetooth) and operations such as restarting the wireless communication control unit.

[0030] The light-emitting unit 42 is located next to the corresponding operation unit 41. The light-emitting unit 42 notifies the user U of the cooling intensity and control mode settings of the refrigerator 100A, the settings of the ultraviolet irradiation device 37, or the settings of the wireless communication unit of the refrigerator 100A, for example, by lighting up.

[0031] The operation control unit 43 is implemented, for example, by one or more control microcontrollers (microcomputers) 40M (see Figure 7). The operation control unit 43 receives user U operations on the operation unit 41 and outputs a signal corresponding to the received settings to the main unit control unit 61 (see Figure 7), which will be described later. The operation control unit 43 also controls the lighting of the light-emitting unit 42 based on the control signals received from the main unit control unit 61.

[0032] In this embodiment, the operation control unit 43 does not immediately confirm the settings even when the operation unit 41 is operated by the user U. For example, the operation control unit 43 waits for a predetermined time (e.g., 1 second) after the operation unit 41 is operated by the user U, and if the operation unit 41 is not operated during the predetermined time, it confirms the settings based on the settings that were operated before the waiting period. The operation control unit 43 then outputs a signal corresponding to the confirmed settings to the main unit control unit 61. This will be described in detail later.

[0033] <2.5 Communications Department> Figure 6 is a perspective view showing a partially disassembled upper wall 10a of refrigerator 100A. The communication unit 50 is, for example, installed on the upper wall 10a of the refrigerator 100A. The communication unit 50 is, for example, a wireless communication module. The communication unit 50 is connected to a network NW via a wireless router R and modem M installed in the user U's home, for example, and can communicate with a server 200 or terminal device 300. The communication unit 50 may also be a communication unit that communicates via a wired connection. The communication unit 50 may have a short-range wireless communication function such as Bluetooth.

[0034] <2.6 Control Board> The control board 60 is, for example, located at the rear of the upper wall 10a of the refrigerator 100A. The control board 60 includes, for example, a main unit control unit 61, a timing unit 62, and a storage unit 63.

[0035] The main control unit 61 is implemented, for example, by one or more control microcontrollers (microcomputers) 60M mounted on the control board 60. The main control unit 61 comprehensively controls the entire refrigerator 100A. The main control unit 61 controls, for example, the cooling unit 30, the ultraviolet irradiation device 37, the setting operation unit 40, the communication unit 50, and the speaker device 70. The functions of the main control unit 61 will be described in detail later.

[0036] The timing unit 62 is included, for example, in the control microcontroller 60M. The timing unit 62 has a function of counting time. By counting time, the timing unit 62 generates time-elapsed information indicating the passage of time and provides the generated time-elapsed information to the main control unit 61.

[0037] The memory unit 63 is implemented using ROM (Read Only Memory) and RAM (Random Access Memory), among other things. The memory unit 63 stores various information necessary for the operation of the refrigerator 100A.

[0038] <2.7 Speaker Equipment> The speaker device 70 is, for example, installed on the front of the upper wall 10a of the housing 10. The speaker device 70 notifies the user U, who is around the refrigerator 100A, of predetermined information by outputting an audio announcement. The speaker device 70 is an example of an "audio output device".

[0039] Figure 7 is a block diagram showing the functional configuration related to the speaker device 70. The speaker device 70 includes, for example, a speaker 70A and a speaker control board 70B.

[0040] Speaker 70A is, for example, a device that has a diaphragm and converts electrical signals into sound (e.g., voice). Speaker 70A is an example of a "sound emitter".

[0041] The speaker control board 70B is a board for operating the speaker 70A. The speaker control board 70B includes, for example, a speaker control unit 71, an audio amplifier 72, and a storage unit 73.

[0042] The speaker control unit 71 is implemented, for example, by one or more control microcontrollers (microcomputers) 70M mounted on the speaker control board 70B. The speaker control unit 71 controls the sound output from the speaker 70A. For example, the speaker control unit 71 can communicate with the main control unit 61 via a Universal Asynchronous Receiver / Transmitter (UART) interface. When an audio notification is to be made via the speaker 70A, the speaker control unit 71 receives a control signal from the main control unit 61 for making the notification. Based on the control signal received from the main control unit 61, the speaker control unit 71 acquires audio data corresponding to the control signal from the audio information J11 stored in the storage unit 73, and outputs the acquired audio data to the audio amplifier 72.

[0043] The audio amplifier 72 is located between the speaker control unit 71 and the speaker 70A. The audio amplifier 72 amplifies the audio data received from the speaker control unit 71 and outputs the amplified audio data to the speaker 70A. As a result, an audio announcement corresponding to the audio data is output from the speaker 70A to the outside of the refrigerator 100A.

[0044] The memory unit 73 is implemented, for example, by a ROM. The memory unit 73 stores, for example, audio information J11. The audio information J11 includes various audio data for notification output from the speaker 70A.

[0045] <2.8 Various Sensors> Figure 8 is a block diagram showing the functional configuration of refrigerator 100A. In addition to the configuration described above, refrigerator 100A includes, for example, a door open detection sensor 110 and a temperature sensor 120. Refrigerator 100A may also have a proximity sensor 130.

[0046] (Door open detection sensor) The door open detection sensor 110 is a sensor that detects the opening and closing of the door 20. The door open detection sensor 110 includes, for example, a refrigerator door sensor 111 that detects the opening and closing of the refrigerator door 20A, a vegetable door sensor 112 that detects the opening and closing of the vegetable door 20B, an ice maker door sensor 113 that detects the opening and closing of the ice maker door 20C, an upper freezer door sensor 114 that detects the opening and closing of the upper freezer door 20D, and a main freezer door sensor 115 that detects the opening and closing of the main freezer door 20E. The detection result of the door open detection sensor 110 is output to the main unit control unit 61. The door open detection sensor 110 can detect the open and closed states of the refrigerator 100A as states that occur in the refrigerator 100A due to the actions of user U. In the following description, unless otherwise specified, the open and closed states of the door 20 are detected by the door open detection sensor 110. The door open detection sensor 110 is an example of a "detection unit".

[0047] (Temperature sensor) The temperature sensor 120 is a temperature sensor that detects the temperature of the storage room 11 (for example, the air temperature inside the storage room 11). The temperature sensor 120 includes, for example, a refrigerator room temperature sensor 121 that detects the temperature of the refrigerator room 11A, a chilled room temperature sensor 122 that detects the temperature of the chilled room 11Aa, and a main freezer room temperature sensor 123 that detects the temperature of the main freezer room 11E. The detection results of the temperature sensor 120 are output to the main unit control unit 61.

[0048] (Proximity sensor) The proximity sensor 130 detects the presence of a user U (in other words, a user U within a predetermined range relative to the refrigerator 100A) that is within a predetermined range relative to the proximity sensor 130. The proximity sensor 130 is provided, for example, on the housing 10 or the door 20. The proximity sensor 130 is, for example, a capacitive sensor. However, the proximity sensor 130 is not limited to a capacitive sensor, and may also be a high-frequency oscillation sensor using electromagnetic induction, a magnetic sensor using a magnet, or an infrared receiving sensor using infrared light. The detection result of the proximity sensor 130 is output to the main unit control unit 61.

[0049] <3. Main Unit Control Section> Next, the main control unit 61 will be described in detail. As shown in Figure 8, the main unit control 61 includes, for example, an information acquisition unit 151, a detection unit 152, a condition fulfillment determination unit 153, and a notification control unit 154. Some or all of these functional units may be provided in the speaker control unit 71 instead of the main unit control 61. Also, some or all of these functional units may be provided in the home appliance management application AP of the server 200 or terminal device 300 instead of the refrigerator 100A.

[0050] <3.1 Information acquisition section> The information acquisition unit 151 communicates with the server 200 or terminal device 300 via the communication unit 50 and acquires various information from the server 200 or terminal device 300. For example, if another home appliance 100 (e.g., washing machine 100B) that has been registered in association with the same user U finishes operating, the information acquisition unit 151 receives a notification from the server 200 informing it that the operation of the other home appliance 100 has finished.

[0051] The information acquisition unit 151 acquires a notification from the server 200 or terminal device 300 informing the user of the content set in the reminder, when the notification period set in the reminder arrives, provided that the home appliance management application AP on the server 200 or terminal device 300 is equipped with a reminder management unit (schedule management unit) and a reminder is set. In this application, "reminder" means a notification sent to user U at a notification period set in advance by user U so that user U does not forget appointments or tasks. A reminder may also be called a "memorandum notification". For example, a reminder may be a reminder that arrives only once with a specific date set as the notification period, or a reminder that arrives regularly with a specific day of the week set as the notification period.

[0052] The information acquisition unit 151 receives a notification from the server 200 or terminal device 300 when the expiration date (e.g., best-before date or use-by date) of food ingredients managed as inventory by the food ingredient management unit has passed, provided that the food ingredient management unit is installed in the home appliance management application AP of the server 200 or terminal device 300.

[0053] The information acquisition unit 151 receives a notification from the server 200 or terminal device 300 indicating that the recipe information has been updated when the recipe management unit (recipe management system) is installed in the home appliance management application AP of the server 200 or terminal device 300 and the recipe information in the database that the recipe management unit can refer to is updated (for example, when new recipe information is added).

[0054] The information acquisition unit 151 is not limited to the examples described above, and may also receive various other notifications from the server 200 or terminal device 300. Each piece of information acquired by the information acquisition unit 151 is information acquired from outside the refrigerator 100A and is an example of "information received by home appliances."

[0055] <3.2 Detection Unit> The detection unit 152 detects various states or state changes related to the refrigerator 100A. The detection unit 152 includes, for example, an abnormality detection unit 152a, a mode termination detection unit 152b, a water supply container depletion detection unit 152c, an operation detection unit 152d, a startup state detection unit 152e, and a usage state detection unit 152f.

[0056] (Anomaly detection unit) The abnormality detection unit 152a determines whether or not there is an abnormality in the refrigerator 100A based on the detection results of various sensors included in the refrigerator 100A (for example, the temperature sensor 120 or another sensor) and the abnormality determination threshold included in the threshold information J12. For example, the abnormality detection unit 152a determines that there is an abnormality in a component related to a sensor if the detection result of a certain sensor falls outside the normal range indicated by the abnormality determination threshold. As a result, the abnormality detection unit 152a detects that an abnormality has occurred in the refrigerator 100A. The threshold information J12 is stored in, for example, the storage unit 63.

[0057] (Mode termination detection unit) The mode termination detection unit 152b determines whether the currently running control mode can be terminated based on the time elapsed information generated by the timing unit 62 or the detection results of various sensors included in the refrigerator 100A (e.g., temperature sensor 120 or another sensor), and the mode termination determination threshold included in the threshold information J12. For example, the mode termination detection unit 152b detects that the termination conditions for the currently running control mode have been met when the time counted by the timing unit 62 reaches the mode termination determination threshold (e.g., time threshold), or when the detection results of the various sensors reach the mode termination determination threshold (e.g., temperature threshold). In this case, the main unit control unit 61 terminates the currently running control mode.

[0058] (Water container water level detection unit) The water supply container depletion detection unit 152c determines whether the water supply container is depleted of water based on the detection result of the water level sensor installed in the water supply container for ice making and the depletion detection threshold included in the threshold information J12. For example, the water supply container depletion detection unit 152c detects that the water supply container is depleted of water if the water level detected by the water level sensor falls below the depletion detection threshold.

[0059] In this embodiment, the contents detected by the abnormality detection unit 152a, the mode termination detection unit 152b, and the water supply container depletion detection unit 152c each fall under the category of "a change in state that occurred in the home appliance at a time different from user operation" and also fall under the category of "a change in state of components of the home appliance."

[0060] (Operation detection unit) The operation detection unit 152d detects user U's operation of the setting operation unit 40. For example, when user U operates the setting operation unit 40, the operation detection unit 152d receives a predetermined signal from the setting operation unit 40 to detect that user U has performed an operation on the setting operation unit 40. As a result, the operation detection unit 152d detects user U's operation of the setting operation unit 40 as an action of user U related to the refrigerator 100A.

[0061] (Startup status detection unit) The startup state detection unit 152e determines whether the home appliance management application AP on the terminal device 300 is in a startup state by, for example, communicating with the server 200 or the terminal device 300. In this application, "startup state" is not limited to a state in the process of startup, but includes a state in which it has been started and is usable by user U. The startup state may also be referred to as the "operating state". The startup state detection unit 152e detects that the home appliance management application AP on the terminal device 300 is in a startup state by, for example, receiving a predetermined signal from the server 200 or the terminal device 300. On the other hand, the startup state detection unit 152e detects that the home appliance management application AP on the terminal device 300 is not in a startup state (is in a stopped state) by not receiving the predetermined signal from the server 200 or the terminal device 300. As a result, the startup state detection unit 152e can detect the startup state of the home appliance management application AP on the terminal device 300 as a state that occurs on the terminal device 300 used by user U due to user U's actions. The home appliance management application AP is an example of a "specified functional unit" in the terminal device 300.

[0062] (Usage status detection unit) The usage status detection unit 152f determines whether speaker 70A is in use or not by, for example, communicating with speaker device 70. "Speaker usage status" refers to a state where, for example, terminal device 300 and refrigerator 100A are wirelessly connected, and user U is using speaker 70A to play music or the like. The usage status detection unit 152f detects that speaker 70A is in use by, for example, receiving a predetermined signal from speaker device 70. On the other hand, the usage status detection unit 152f detects that speaker 70A is not in use by not receiving the predetermined signal from speaker device 70. Thus, the usage status detection unit 152f can detect the usage status of speaker 70A as a state occurring in refrigerator 100A due to user U's actions. Speaker 70A is an example of an "output device".

[0063] The refrigerator 100A may have a display device 80 including a display screen instead of / in addition to the speaker device 70. The display device 80 is a display device such as a liquid crystal display or an organic EL (Electro-Luminescence) display. The usage status detection unit 152f determines whether the display device 80 is in use by, for example, communicating with the display device 80. "Usage status of the display device" means, for example, that the refrigerator 100A is connected to a network NW and a recipe video or the like is being played on the display device 80. The display device 80 is another example of an "output device". The usage status detection unit 152f detects that the display device 80 is in use by receiving a predetermined signal from the display device 80. On the other hand, the usage status detection unit 152f detects that the display device 80 is not in use by not receiving the predetermined signal from the display device 80. Hereinafter, the speaker device 70 and the display device 80 will be collectively referred to as "output device 90".

[0064] <3.3 Condition establishment determination part> The condition fulfillment determination unit 153 determines whether the conditions for issuing a notification (hereinafter referred to as "notification conditions") have been met for each type of notification. For example, the condition fulfillment determination unit 153 determines whether the notification conditions have been met based on the information acquired by the information acquisition unit 151 and / or the information detected by the detection unit 152, and the determination information J13 stored in the storage unit 63. The determination information J13 is information in which notification conditions corresponding to each type of notification are pre-registered. For example, the condition fulfillment determination unit 153 determines that the notification conditions have been met if the content indicated by the information acquired by the information acquisition unit 151 and / or the content detected by the detection unit 152 matches the notification conditions included in the determination information J13. The processing of the condition fulfillment determination unit 153 will be described in detail later.

[0065] <3.4 Notification Control Unit> The notification control unit 154 transmits information to the speaker control unit 71 to output a notification from the speaker device 70 for notifications that the condition for notification has been determined to be met by the condition fulfillment determination unit 153. As a result, the notification control unit 154 executes various notifications via the speaker device 70. In this embodiment, if the timing of multiple notifications overlaps, the notification control unit 154 determines the content or manner of the notification based on the adjustment information J14 stored in the storage unit 63 (in other words, adjusts the content or manner of the notification based on the adjustment information J14), and then performs the notification with the determined content or manner. The processing of the notification control unit 154 will be described in detail later.

[0066] <4. Types of Notifications> Next, we will explain the types of announcements output from the speaker device 70. Figure 9 shows the types of notifications. The notifications output from the speaker device 70 include, for example, (1) setting system notifications, (2) notification system notifications, and (3) door open alarms.

[0067] <4.1 Settings-related notifications> "Setting-related notifications" are notifications regarding settings that can be set on the refrigerator 100A by user U. Setting-related notifications are notifications that are output in response to user U operating the setting operation unit 40, for example, and inform user U of the settings that user U has set (i.e., provide feedback to user U on the settings that have been set). For example, setting-related notifications are notifications that indicate the start or stop of control settings set by user U, and are notifications that output voice messages such as "The refrigerator temperature setting has been changed to the strong setting" or "The sterilization mode will start". Setting-related notifications are an example of "Type 1 notifications". Examples of setting-related notifications include the following.

[0068] (1) "Chilled Mode Setting": This is a notification that indicates the start or stop of the cooling control mode set by user U regarding the cooling control mode of the chilled compartment 11Aa (for example, a special chilled mode or a defrost mode). (2) "Freezing Mode Setting": This is a notification that indicates the start or stop of the cooling control mode set by user U for the upper freezer compartment 11D (for example, soft freezing mode or a freezing mode that automatically terminates). (3) "Setting the ice-making mode": This is a notification that indicates the start or stop of the cooling control mode of the ice-making compartment 11C (for example, rapid ice-making mode or ice-making stop mode) set by the user U. (4) "Power saving setting": This is a notification that indicates the start or stop of a power saving mode set by user U for one or more storage rooms 11. (5) "Refrigeration Temperature Setting": This is a notification that informs the user U of the cooling intensity (e.g., "High setting", "Medium setting", "Low setting") of the refrigeration temperature zone compartments (e.g., refrigerator compartment 11A, chiller compartment 11Aa, and vegetable compartment 11B). (6) "Freezing Temperature Setting": This is a notification that informs the user U of the cooling intensity (e.g., "High setting", "Medium setting", "Low setting") of the freezing temperature zone compartments (e.g., ice making compartment 11C, upper freezing compartment 11D, and main freezing compartment 11E). (7) "Disinfection setting": This is a notification that indicates the start or stop of the disinfection mode using the ultraviolet irradiation device 37, as set by the user U.

[0069] In this embodiment, the setting system notifications (1) to (7) described above are notifications that inform the user U of the content set by operating the setting operation unit 40, and are output in response to the user U operating the setting operation unit 40. In other words, the timing of these setting system notifications is when the user U performs an operation on the setting operation unit 40.

[0070] In this application, "setting system notification" is not limited to notifications output in response to the operation of the setting operation unit 40 located inside the refrigerator 100A, but may also include notifications output in response to the operation of other operation units by the user U. "Other operation units" are, for example, a setting operation unit located on the surface of the door 20 of the refrigerator 100A (for example, the front of the refrigerator compartment door 20A), or an operation unit implemented on the display screen 301a of the terminal device 300 by the home appliance management application AP of the terminal device 300.

[0071] <4.2 Announcement-type notifications> "Notification notifications" are notifications that differ from notifications (notifications informing of settings) that are output in response to user U operating the setting operation unit 40, and are notifications regarding a change in state that has occurred in the refrigerator 100A, or notifications regarding information that the refrigerator 100A has received. Notification notifications are, for example, notifications that inform user U of the content of the above-mentioned change in state that has occurred in the refrigerator 100A, or notifications that inform user U of the content of information that the refrigerator 100A has received from an external source. For example, notification notifications are notifications that an abnormality has occurred in the refrigerator 100A, or that the expiration date of food has passed. From another perspective, notification notifications also include, for example, "notifications regarding the status of parts of home appliances."

[0072] While the aforementioned "setting-related notifications" are notifications initiated by the user U's actions, "notification-related notifications" are notifications that do not originate from the user U's actions and are intended to inform the user U of information that they might not notice without the notification. In this embodiment, "setting-related notifications" and "notification-related notifications" are treated as different types of notifications. Notification-related notifications are an example of the "second type of notification." Examples of notification-related notifications include the following. Note that refrigerator 100A does not need to have all of the following notifications as notification-related notifications.

[0073] (a) "Refrigerator malfunction detected": This is a notification indicating that a malfunction has occurred in the refrigerator 100A. A "refrigerator malfunction" can be a malfunction of the cooling unit 30, a malfunction of the setting operation unit 40, a malfunction of the communication unit 50, a malfunction of the control board 60, a malfunction of the speaker device 70, or a malfunction of any sensor. In this embodiment, the "refrigerator malfunction detected" notification is given when a malfunction is detected by the malfunction detection unit 152a. The timing of this notification is, for example, immediately (i.e., when the malfunction occurs) and when the door is opened (i.e., when the open state of the door 20 is detected). Alternatively, for example, the notification may be given each time the open state of the door 20 is detected until no more malfunctions are detected. In addition, for some malfunctions, the notification may be given only when the door is opened.

[0074] In this application, "when the door is open" means, for example, when the door 20 is already detected open when the notification reason (a change in the state of refrigerator 100A or reception of information from the outside) occurs, it means when the notification reason occurs. If the door 20 is not detected open when the notification reason occurs, it means when the door 20 is first detected open after the notification reason has occurred. This definition is the same for other notifications.

[0075] (b) "Mode End": This is a notification that indicates the end of a control mode set by user U when the mode ends due to meeting the termination conditions. "Control mode set by user U" refers to a control mode that ends when predetermined termination conditions are met, such as a defrost mode, a rapid ice-making mode, a rapid freezing mode, or a freezing mode that ends automatically. In this embodiment, the "Mode End" notification is given when the mode end detection unit 152b detects the end of the control mode. The timing of this notification is, for example, immediately (i.e., at the time of mode end).

[0076] (c) "End of operation of other home appliances": This is a notification that another home appliance 100 (for example, a washing machine 100B) that has been registered in association with the same user U as the refrigerator 100A has finished operating. In this embodiment, the "End of operation of other home appliances" notification is given when the information acquisition unit 151 receives a notification that the operation of the other home appliance 100 has finished. The timing of this notification is, for example, immediately (i.e., when the operation of the other home appliance 100 has finished).

[0077] (d) "Reminder": This is a notification that informs the user of the content set as a reminder when the time has come to notify the user of the reminder regarding the user's planned actions. In this embodiment, the "reminder" notification is given when the information acquisition unit 151 acquires a notification that informs the user of the content set as a reminder. The timing of this notification is, for example, when the door is opened, and more preferably when the door is detected to be open after the notification time set by the user U.

[0078] (e) "Expired Best Before Date": This is a notification that alerts the user when the expiration date (e.g., best before date or use-by date) of food ingredients managed as inventory by the food ingredient management department has passed. In this embodiment, the "Expired Best Before Date" notification is given when the information acquisition unit 151 receives a notification indicating that food ingredients have passed their expiration date. The timing of this notification is, for example, when the door is opened.

[0079] (f) "Water container empty": This is a notification that alerts the user when the water container for ice making is empty. In this embodiment, the "Water container empty" notification is given when the water container is detected to be empty by the water container empty detection unit 152c. The timing of this notification is, for example, when the door is opened.

[0080] (g) "Recipe Update": This is a notification that the recipe information in the database accessible to the recipe management unit has been updated. In this embodiment, the "Recipe Update" notification is given when the information acquisition unit 151 receives a notification that the recipe information has been updated. The timing of this notification is, for example, when the door is opened.

[0081] <4.3 Door Open Alarm> The "door open alarm" is an alarm notification that alerts user U to the door 20 being left open if the door remains open for a predetermined period of time. The door open alarm may be an audio notification such as "The refrigerator door is open," or an audio notification such as a buzzer sound. The door open alarm is notified multiple times, for example, after 1 minute, 2 minutes, and 3 minutes have elapsed since the door open detection sensor 110 detected that the door 20 was open.

[0082] While the aforementioned "setting-related notifications" are notifications initiated by user U's actions, the "door open alarm" is a notification that is not initiated by user U's actions and is intended to inform user U of information that would be difficult for user U to notice without the notification. In this embodiment, "setting-related notifications" and "door open alarms" are treated as different types of notifications. The door open alarm is another example of the "second type of notification." Furthermore, when distinguishing the door open alarm from notification-related notifications, it falls under the category of an example of the "third type of notification."

[0083] <4.4 Basic Rules of Hochi> In this embodiment, the following two basic rules are established regarding notification control. The notification control described below is performed in accordance with these two basic rules. (i) While setting-related notifications are notifications that originate from user U's actions, alert-related notifications are notifications that inform user U of information that would be difficult for user U to notice without the notification. For this reason, alert-related notifications are reliably conveyed to user U. (ii) Among the multiple configuration operations performed by user U, the configuration system notification corresponding to the last operation performed shall be reliably communicated to user U.

[0084] <5. Control related to notification> Next, we will explain the control related to notifications performed by the notification control unit 154. When the notification timings of multiple notifications overlap, the notification control unit 154 determines the content or manner of the notification based on either the first decision method or the second decision method shown below. The notification control unit 154 is an example of a "control unit".

[0085] Here, we define some terms. "First notification" refers to one of the following: a setting system notification, an alert system notification, or a door open alarm. Similarly, "second notification" refers to one of the following: a setting system notification, an alert system notification, or a door open alarm.

[0086] The "first condition" is the notification condition for issuing the first notification. The "first condition" is that, if the first notification is a setting system notification, an operation by user U related to the settings of refrigerator 100A is detected (for example, an operation on the setting operation unit 40 is detected by the operation detection unit 152d). The "first condition" is that, if the first notification is an alert system notification, a change in state that occurred in refrigerator 100A at a time different from the operation by user U is detected by the detection unit 152, or a predetermined notification from outside refrigerator 100A is acquired by the information acquisition unit 151. In addition, if the first notification is an alert system notification and the notification timing is when the door is opened, the "first condition" is that, in addition to the above conditions, the door is open. The "first condition" is that, if the first notification is a door open alarm, the state in which the door 20 is detected as open by the door open detection sensor 110 continues for more than a predetermined time (for example, 1 minute). The notification control unit 154 issues a first notification when the first condition is met.

[0087] The "second condition" is the condition for issuing a second notification. Similar to the "first condition," the "second condition" is that, if the second notification is a setting system notification, user U's operation related to the settings of the refrigerator 100A is detected (for example, an operation on the setting operation unit 40 is detected by the operation detection unit 152d). The "second condition" is that, if the second notification is an alert system notification, a change in state that occurred in the refrigerator 100A at a time different from user U's operation is detected by the detection unit 152, or a predetermined notification from outside the refrigerator 100A is acquired by the information acquisition unit 151. In addition, if the second notification is an alert system notification and the notification timing is when the door is opened, the "second condition" is that, in addition to the above conditions, the door is open. The "second condition" is that, if the second notification is a door open alarm, the state in which the door 20 is detected as open by the door open detection sensor 110 continues for more than a predetermined time (for example, 1 minute). The notification control unit 154 issues a second notification when the second condition is met.

[0088] <6. 1st decision method> Next, I will explain the first decision method. The first decision method is a method for determining the content or manner of notification when the notification timings of multiple notifications overlap, based on the relationship including the type of notification. For example, if the first condition is met and the second condition is met, the notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the relationship including the type of notification between the first notification and the second notification.

[0089] In this embodiment, the notification control unit 154 determines the content or manner of notification by the speaker device 70 based on both the type of notification of the first notification and the second notification, and the sequence of events in which the first type of notification and the second type of notification satisfy the notification conditions (for example, the notification conditions described above). For example, the notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the adjustment information J14 stored in the storage unit 63 as registered information of the above relationship.

[0090] Figure 10 shows an example of the contents of adjustment information J14. Adjustment information J14 is a table information registered in which, for example, the case classification of situations in which the notification timings of multiple notifications overlap, and the determination content or manner of the notification (adjustment content of the notification content or manner) determined by the notification control unit 154 when each situation occurs are associated.

[0091] For example, in the adjustment information J14, when the notification timing of the first type of notification and the notification timing of the second type of notification overlap, the cases are divided into two scenarios: one where the notification conditions for the first type of notification are met first and the notification conditions for the second type of notification are met later, and another where the notification conditions for the second type of notification are met first and the notification conditions for the first type of notification are met later. Therefore, when the first condition is met and the second condition is met, the notification control unit 154, for example, refers to the adjustment information J14 to determine the content or manner of notification by the speaker device 70 based on both the type of notification for the first and second types of notifications and the chronological order in which the notification conditions for the first and second types of notifications were met. Details of the adjustment content for each scenario registered in the adjustment information J14 will be described later separately for each scenario.

[0092] In this example, the notification control unit 154 performs a decision process using the adjustment information J14, which is table information. However, the processing of the notification control unit 154 is not limited to the above example. The notification control unit 154 can also perform the same processing by performing a decision process as shown in Figure 11, instead of processing using table information.

[0093] Figure 11 is a flowchart showing an example of the processing flow of the notification control unit 154. When the notification timings of multiple notifications overlap, the notification control unit 154 first determines whether the notification conditions for the first type of notification have been met first (S101). Then, if the processing in S101 is positive (S101:YES), the notification control unit 154 determines whether the notification conditions for the second type of notification have been met later (S102). If the processing in S102 is positive (S102:YES), the notification control unit 154 determines the adjustment content corresponding to Scene 1, which will be described later, and issues a notification based on the determined adjustment content (S201).

[0094] If the process in S102 is negative (S102: NO), the notification control unit 154 determines whether the notification conditions for the first type of notification were later met (S103). If the process in S102 is positive (S102: YES), the notification control unit 154 determines the adjustment content corresponding to Scene 3, which will be described later, and issues a notification based on the determined adjustment content (S202). If the process in S103 is negative (S103: YES), the notification control unit 154 proceeds to an unillustrated flow corresponding to a different scene.

[0095] On the other hand, if the process in S101 is negative (S101: NO), the notification control unit 154 determines whether the notification conditions for the second type of notification were met first (S104). If the process in S104 is positive (S104: YES), the notification control unit 154 determines whether the notification conditions for the first type of notification were met later (S105). If the process in S105 is positive (S105: YES), the notification control unit 154 determines the adjustment content corresponding to Scene 2, which will be described later, and issues a notification based on the determined adjustment content (S203).

[0096] If the S105 process is negative (S105: NO), the notification control unit 154 determines whether the notification conditions for the second type of notification were later met (S106). If the S106 process is positive (S106: YES), the notification control unit 154 determines the adjustment content corresponding to Scene 4, which will be described later, and issues a notification based on the determined adjustment content (S204). If the S106 process is negative (S106: YES), the notification control unit 154 proceeds to an unillustrated flow corresponding to a different scene. Also, if the S104 process is negative (S104: YES), the notification control unit 154 proceeds to an unillustrated flow corresponding to a different scene.

[0097] The notification control unit 154 can determine the content or manner of notification by the speaker device 70 based on both the type of notification for the first notification and the second notification, and the chronological sequence in which the first type notification and the second type notification met the notification conditions, by performing the determination process described above, similar to the process using the table information described above. The branching conditions and determination flow information that define the determination process described above are another example of the adjustment information J14.

[0098] Next, we will explain the details of the adjustments made to the content or manner of the notification, on a case-by-case basis. In the diagrams used to explain each scene (Scenes 1-7, Scenes A-G) below, the events are arranged chronologically from top to bottom. That is, these diagrams show that the events occur in order, starting with the event listed at the top and ending with the event listed at the bottom.

[0099] In this embodiment, "determining (adjusting) the content or manner of notification" includes, for example, suppressing notification or changing the timing of notification for at least one of the first notification and the second notification. "Suppressing notification" means, for example, not making a notification or stopping a notification that is in progress. However, "suppressing notification" is not limited to the above examples and may also include simplifying the content of the notification before making it. Also, for example, if no notification is made, the audio is not played, so the content (audio) of the notification cannot be confirmed, which can also be said to be determining (adjusting) the manner of notification. These definitions are the same for the second determination method. "Changing the timing of notification" means, for example, delaying the timing of notification or changing the notification order of multiple notifications.

[0100] In this embodiment, if the first notification is the first type of notification and the second notification is the second type of notification, the notification control unit 154 performs the following processing. For example, the notification control unit 154 makes the content or manner of notification by the speaker device 70 different depending on whether the first condition (notification condition for the first notification) is met first and then the second condition (notification condition for the second notification) is met, or whether the second condition is met first and then the first condition is met.

[0101] <6.1 (Scenario 1) When the first type of notification comes first, and the second type of notification comes later> In this embodiment, if the first notification is the first type of notification and the second notification is the second type of notification, the notification control unit 154 performs the following processing. For example, if the second condition is met when the first condition is met, the notification control unit 154 delays the timing of the second notification (second type of notification) compared to the case where the second condition is met when there is no scheduled notification of the first notification (first type of notification). For example, the notification control unit 154 performs the first notification (first type of notification) as is, while delaying the timing of the second notification (second type of notification), performing the second notification after the first notification has finished.

[0102] Figure 12 is a diagram illustrating the notification control in Scene 1. In this example, the first condition corresponding to the first notification (first type of notification: setting system notification) is met when the temperature setting of the refrigerator compartment 11A is changed by the operation of user U. Therefore, the notification control unit 154 starts a notification as the first notification, indicating that the temperature setting of the refrigerator compartment 11A has been changed.

[0103] In this example, while the first notification is being executed, the refrigerator 100A receives a notification from the server 200 informing it that the washing machine 100B has finished operating, thus satisfying the second condition corresponding to the second notification (second type of notification: notification system notification). Therefore, a notification overlap state is established, which is "when the first condition is satisfied and the second condition is also satisfied."

[0104] In this embodiment, the notification control unit 154 does not start the second notification in the notification overlap state described above, but keeps the second notification on standby. The notification control unit 154 then continues to perform the first notification that is currently running until completion. After the first notification is finished, the notification control unit 154 starts the second notification that was on standby.

[0105] By making these adjustments, the user experience can be improved. For example, setting notifications (such as those corresponding to the last settings configured) can be communicated to the user, and important announcement notifications can be communicated to the user last, making it easier for the user to pay attention to the announcement notifications and ensuring that the announcement notifications are communicated to the user more reliably.

[0106] <6.2 (Scenario 2) When the second type of notification comes first, and the first type of notification comes later> In this embodiment, if the first notification is the second type of notification and the second notification is the first type of notification, the notification control unit 154 performs the following processing. For example, if the first condition is met and the second condition is met, the notification control unit 154 performs the first notification (second type of notification) as is and suppresses the second notification (first type of notification). For example, the notification control unit 154 does not perform the second notification.

[0107] Figure 13 is a diagram illustrating the notification control in Scene 2. In this example, the first condition corresponding to the first notification (second type of notification: announcement notification) is met when the refrigerator 100A receives a notification from the server 200 indicating a reminder. Therefore, the notification control unit 154 starts a notification as the first notification, indicating the content of the reminder (for example, "Today is the day for combustible waste collection").

[0108] In this example, while the first notification is being executed, the temperature setting of the refrigerator compartment 11A is changed by user U, which satisfies the second condition corresponding to the second notification (first type of notification: setting system notification). Therefore, a notification overlap state is established, which is "when the second condition is satisfied in addition to the first condition being satisfied."

[0109] In this embodiment, the notification control unit 154, in the notification overlap state described above, continues to perform the first notification that is currently being executed until the end. On the other hand, the notification control unit 154 decides not to perform the second notification and discards the information related to the second notification.

[0110] By making such adjustments, the convenience for user U can be improved. For example, if user U intentionally operates the setting operation unit 40 while an notification system is running, it can be assumed that user U is familiar with the settings operation of the refrigerator 100A, and at the very least, the priority of the setting system notification for that operation can be judged to be low. For this reason, it is assumed that there is little need to wait until the notification system notification is finished before broadcasting the setting system notification, and by deliberately not broadcasting the setting system notification, it is possible to suppress the length of the notification execution time, and by conveying the notification system notification, which is of high importance as a notification, to user U last, it is possible to make it easier for user U to pay attention to the notification system notification.

[0111] <6.3 (Scenario 3) When multiple Type 1 notifications overlap> In this embodiment, when a preceding condition (first condition corresponding to the preceding notification) corresponding to one first type of notification, which is a preceding notification, is met, and a succeeding condition (first condition corresponding to the succeeding notification) corresponding to another first type of notification, which is a succeeding notification, is also met, the notification control unit 154 suppresses the preceding notification and performs the succeeding notification. For example, the notification control unit 154 stops the preceding notification that is currently being executed and performs the succeeding notification.

[0112] Figure 14 is a diagram illustrating the notification control in Scene 3. In this example, first, the temperature setting of the refrigerator compartment 11A is changed by the user U, which satisfies the preceding condition (first condition) corresponding to the preceding notification (first type of notification: setting system notification). Therefore, the notification control unit 154 starts a notification as a preceding notification, indicating that the temperature setting of the refrigerator compartment 11A has been changed.

[0113] In this example, while the preceding notification is being executed, a setting change to turn on the disinfection mode is performed by user U, which satisfies the subsequent condition (second condition) corresponding to the subsequent notification (first type of notification: setting system notification). Therefore, a notification overlap state is established, which is "when the first condition is met and the second condition is also met".

[0114] In this embodiment, in the notification overlap state, the notification control unit 154 stops the preceding notification that is currently being executed and starts the subsequent notification. If there are no other notifications of the first type, the notification control unit 154 then completes the subsequent notification.

[0115] By making such adjustments, the convenience for user U can be improved. For example, the content of a preceding notification can be judged as unimportant to user U because user U is performing another operation during that notification. Therefore, by only notifying the user of the content set in the last operation, it is possible to reduce annoyance compared to when a series of notifications of low importance to user U are made, and the notification delay can be suppressed. In addition, by notifying the user of the content set in the last operation, if a malfunction occurs, for example, when food or other items hit the setting operation unit 40 when the door 20 is closed, user U will be more likely to recognize that a malfunction has occurred.

[0116] (Details of the control example in Scene 3) Next, we will explain the details of the control example for Scene 3 described above. In this embodiment, if no operation is performed on any of the operation units 41 for a predetermined period of time (e.g., 1 second) following an operation by user U on an operation unit 41, the setting operation unit 40 confirms the setting based on the operations performed up to that point.

[0117] Figure 15 is a diagram illustrating the details of the control example in Scene 3. As described above, if no operation is performed on any of the operation units 41 (e.g., operation unit A) for a predetermined time (e.g., 1 second) after an operation by user U on one of the operation units 41, the setting operation unit 40 confirms the setting based on the operations performed up to that point. Once the setting is confirmed, the setting operation unit 40 transmits a signal (e.g., setting information A) corresponding to the confirmed setting to the main unit control unit 61.

[0118] Next, the notification control unit 154 determines the control content based on the signal received from the setting operation unit 40 and transmits a signal corresponding to the determined control content (for example, setting information A) to the speaker control unit 71. As a result, audio corresponding to the setting content set by user U is output from the speaker device 70. If, while a preceding notification (for example, notification A) is being executed, user U performs an operation on another operation unit 41 (for example, operation unit B), and the subsequent conditions corresponding to the subsequent notification are met while the preceding notification is being executed, the executing preceding notification (notification A) is stopped and the subsequent notification (notification B) is started, as explained using Figure 13.

[0119] Figure 16 is another diagram illustrating the details of the control example in Scene 3, showing the case where multiple operations are performed on the same operation unit 41 (e.g., operation unit A). For example, when changing the temperature setting from "low setting" to "high setting", pressing the operation unit 41 (operation unit A) once switches the cooling intensity setting in the order of "low setting" → "medium setting" → "high setting". At this time, a predetermined time difference (e.g., 1 second) is set so that an alert is not generated each time the operation unit 41 (operation unit A) is pressed. For operations on the same operation unit 41 (e.g., operation unit A), the setting is determined based on the last operation, and a signal corresponding to the determined setting (e.g., "high setting") is transmitted from the setting operation unit 40 to the main unit control unit 61. In this case, only one first condition corresponding to the last set setting is met, and an alert corresponding to the last set setting is given only once. For example, the setting is determined based on the last set setting, which is "high setting". Then, an audio message indicating that the "strong setting" has been selected is output from the speaker device 70.

[0120] Figure 17 is another diagram illustrating the details of the control example in Scene 3, showing the case where operations are performed on multiple operation units 41 (e.g., operation unit A, operation unit B). For example, pressing the operation unit 41 corresponding to the temperature setting (e.g., operation unit A) once switches the cooling intensity setting from "low setting" to "medium setting". Then, before the predetermined time (e.g., 1 second) has elapsed, pressing another operation unit 41 (e.g., operation unit B) related to the cooling control mode of the upper freezer compartment 11D once sets the "rapid freezing mode". Subsequently, if no operation is performed on any of the operation units 41 for a predetermined time (e.g., 1 second) since the last operation of an operation unit 41, the setting operation unit 40 confirms the two settings, "medium setting" and "rapid freezing mode", and transmits signals corresponding to the two confirmed settings to the main unit control unit 61. As a result, the two first conditions corresponding to the two settings are simultaneously met.

[0121] In this case, the notification control unit 154 notifies only one notification of the first type with the highest priority, based on a predetermined priority set in advance for multiple first type notifications. In this embodiment, the notification control unit 154 determines, based on a predetermined priority set in advance, that the cooling control mode of the upper freezer compartment 11D has a higher notification priority than the temperature setting. Then, a notification indicating that the "rapid freezing mode" has been set is output from the speaker device 70. On the other hand, no notification indicating that the temperature setting has been changed to the "medium setting" is output. In this application, "priority" has substantially the same meaning as "priority." Therefore, in the following description, "priority" may be read as "priority."

[0122] By making these adjustments, delays in notifications can be avoided, and important information from the configuration system notifications can be conveyed to the user U first.

[0123] <6.4 (Scenario 4) When multiple Type 2 notifications overlap> In this embodiment, when a prerequisite condition (first condition) corresponding to a preceding notification, which is one type of second notification, is met, and a subsequent condition (second condition) corresponding to a subsequent notification, which is another type of second notification, is met, the notification control unit 154 performs the following processing. For example, if the preceding notification is already being executed (spoken), the notification control unit 154 performs the preceding notification as is, while delaying the execution of the subsequent notification, and performs the subsequent notification after the preceding notification has finished. If the preceding notification has not yet been executed, the notification control unit 154 may rearrange the notification order of multiple types of second notifications based on a predetermined priority order (for example, rearranging the notification order so that notifications with higher priority are announced first), and perform multiple types of second notifications in the rearranged notification order. The "predetermined priority order" is, for example, the same as the priority order described later with reference to Figure 19.

[0124] <6.5 (Scenario 5) When multiple Type 1 notifications and Type 2 notifications overlap> In this embodiment, when a preceding condition (first condition corresponding to the preceding notification) corresponding to one first type of notification, which is a preceding notification (setting system notification), is met, and a second condition corresponding to a second type of notification (notification system notification) and a subsequent condition (first condition corresponding to the subsequent notification) corresponding to another first type of notification, which is a succeeding notification (setting system notification), are met, the notification control unit 154 suppresses the execution of the preceding notification, performs the succeeding notification, and performs the second notification after the completion of the succeeding notification. For example, the notification control unit 154 stops the preceding notification that is currently being executed midway, and then performs the succeeding notification and the second notification.

[0125] Figure 18 is a diagram illustrating the notification control in Scene 5. In this example, first, the temperature setting of the refrigerator compartment 11A is changed by the operation of user U, which satisfies the preceding condition (first condition corresponding to the preceding notification) corresponding to the preceding notification (first type of notification: setting system notification). Therefore, the notification control unit 154 starts a notification as a preceding notification, indicating that the temperature setting of the refrigerator compartment 11A has been changed.

[0126] In this example, while the preceding notification is running, the refrigerator 100A receives a notification from the server 200 indicating that the washing machine 100B has finished operating, thus satisfying the second condition corresponding to the second notification (second type of notification: notification system notification). Furthermore, while the preceding notification is running, for example, after the second condition has been satisfied, the setting change to turn on the sterilization mode is performed by user U, thus satisfying the subsequent condition (first condition corresponding to the subsequent notification) corresponding to the subsequent notification (first type of notification: setting system notification). Therefore, a notification overlap state is established, which is "when the preceding condition is satisfied, and the second condition and the subsequent condition as the first condition are also satisfied."

[0127] In this embodiment, in the notification overlap state, the notification control unit 154 stops the preceding notification that is currently being executed midway, starts the subsequent notification, and delays the timing of the second notification. In this embodiment, the notification control unit 154 completes the subsequent notification. Then, after the subsequent notification is completed, the notification control unit 154 performs the second notification.

[0128] By making such adjustments, the user's convenience can be improved. For example, even if there are multiple setting notifications, the setting notification corresponding to the last setting among the multiple setting notifications can be conveyed to the user. Furthermore, by conveying the most important notification last to the user, the user is more likely to pay attention to the notification, and the notification can be conveyed to the user more reliably.

[0129] <6.6 (Scenario 6) Cases where the notification conditions are no longer met while the notification is in standby mode> In this embodiment, the notification control unit 154 decides to perform multiple notifications in order based on a predetermined priority order when multiple conditions corresponding to each of the multiple notifications are met. If, before all of the multiple notifications have been performed, the conditions corresponding to one or more notifications included in the multiple notifications that have not yet been performed are no longer met, the notification control unit 154 will perform the notification for that one or more notifications when the conditions corresponding to that one or more notifications are met again.

[0130] Figure 19 shows an example of the contents of priority information J15. In the example shown in Figure 19, among multiple notifications (notification notifications), the notification for "refrigerator malfunction" has the highest priority, followed by "mode termination," "termination of operation of other home appliances," "reminder," "expired best before date," "water container running out," and "recipe update," in descending order of notification priority.

[0131] In this embodiment, when multiple conditions corresponding to multiple notifications are met, the notification control unit 154 decides to perform the multiple notifications based on a predetermined priority order included in the priority information J15 stored in the storage unit 63. For example, the notification control unit 154 decides to rearrange the notification order of the multiple notifications based on the predetermined priority order (for example, rearranging the notification order so that notifications with higher priority are notified first), and to perform the multiple notifications in the rearranged order.

[0132] Figure 20 is a diagram illustrating an embodiment of Scene 6. In this embodiment, after the notification control unit 154 has decided to issue multiple notifications based on a predetermined priority order when multiple conditions corresponding to each of the multiple notifications are met, if the conditions corresponding to one or more notifications that have not yet been issued are not met before all of the multiple notifications have been issued, the one or more notifications that have not yet been issued are moved to a standby state. In the example shown in Figure 20, it is shown that it has been decided to issue three notifications: "Refrigerator malfunction," "Water container running out of water," and "Reminder" (see (a) in Figure 20). Note that the "Refrigerator malfunction" notification here is issued when the door is opened.

[0133] Then, when the notification control unit 154 detects that the door 20 is open, it outputs a second notification corresponding to "refrigerator malfunction," which has the highest priority among the three notifications, based on the priority information J15. At this point, if the door 20 is no longer detected as open before the "water container empty" and "reminder" notifications have been issued, the "water container empty" and "reminder" notifications will move to a standby state (see (b) in Figure 20). When the door 20 is detected as open again, the notification control unit 154 outputs a second notification corresponding to "reminder" according to the priority specified in the priority information J15 (see (c) in Figure 20). After the "reminder" notification has finished, the notification control unit 154 outputs a second notification corresponding to "water container empty" according to the priority specified in the priority information J15 (see (d) in Figure 20).

[0134] In this embodiment, if the conditions corresponding to another notification system notification (hereinafter referred to as "notification C2") are met during the execution of one notification system notification (hereinafter referred to as "notification C1"), the notification control unit 154 puts notification C2 into standby mode. After notification C1 finishes, the notification control unit 154 then determines which notification to execute next from among the multiple notifications currently in standby mode, based on the predetermined priority order described above.

[0135] Furthermore, the embodiment shown in Figure 20 may be implemented in combination with the embodiment shown in Figure 18. That is, for example, first, user U opens the door 20 and operates the setting operation unit 40 to change the temperature setting of the refrigerator compartment 11A, and the notification control unit 154 starts an alert indicating that the temperature setting of the refrigerator compartment 11A has been changed as a first type of alert, which is a preliminary alert (setting system alert). Suppose that during the execution of the preliminary alert, an abnormality in the refrigerator 100A and the water supply container running out of water are detected, and the notification period of the reminder set by user U has passed. Also, suppose that during the execution of the preliminary alert, user U operates the setting operation unit 40 to change the setting to turn on the sterilization mode.

[0136] In this case, the preceding notification indicating that the temperature setting of the refrigerator compartment 11A has been changed will be stopped midway, and the subsequent notification (setting-related notification) indicating that the sterilization mode has been changed to the ON state will be started, while the timing of the three notifications of the second type, namely "refrigerator malfunction," "water container empty," and "reminder" (notification-related notifications), will be delayed. Furthermore, if the door 20 is no longer detected as open before the notification of "refrigerator malfunction," which has the highest priority among the three notifications, is issued, the three notifications, "refrigerator malfunction," "water container empty," and "reminder," will be moved to a standby state.

[0137] Furthermore, if user U closes door 20, the notification control unit 154 may not determine the next notification to be executed, but may postpone the determination of the notification order until door 20 is opened again. In other words, for example, if user U cancels the reminder setting before the "reminder" notification in Figure 20 is made, the "reminder" notification, which has moved to a standby state, may be canceled when door 20 is opened again. If there are still unexecuted notifications when door 20 is closed, the notification control unit 154 may make a notification to inform user U that there are still unexecuted notifications. Also, if there are notifications with an immediate notification timing when door 20 is closed, the notification control unit 154 may immediately announce those notifications after door 20 is closed.

[0138] In this embodiment, the notification control unit 154 decides to perform the multiple notifications in order based on a predetermined priority when multiple conditions corresponding to each of the multiple notifications are met. If, before all of the multiple notifications are performed, the conditions corresponding to a notification with a relatively high priority among the multiple notifications are no longer met, and the conditions corresponding to a notification with a relatively low priority that has not yet been performed among the multiple notifications are met, the notification control unit 154 may prioritize performing the notification with the relatively low priority over the notification with the relatively high priority.

[0139] For example, first, when user U opens the door 20 and operates the setting operation unit 40, the temperature setting of the refrigerator compartment 11A is changed, and a first-type notification (setting-related notification) is initiated, indicating that the temperature setting of the refrigerator compartment 11A has been changed. Suppose that an abnormality corresponding to the "refrigerator malfunction" notification, which is only issued when the door is open, is detected while the first-type notification is being executed. Also, suppose that while the first-type notification is being executed, the information acquisition unit 151 receives a notification indicating that the operation of another home appliance 100 has ended. In this case, the notification control unit 154 decides to issue the second-type notifications, "refrigerator malfunction" and "operation of other home appliances has ended" (notification-related notifications), in order based on a predetermined priority. However, if the door 20 is closed before the "refrigerator malfunction" notification is issued, the conditions corresponding to the "refrigerator malfunction" notification are no longer met, so the notification of "operation of other home appliances has ended," which has a relatively lower priority than the "refrigerator malfunction" notification, is given priority.

[0140] Furthermore, if, for example, user U puts something hot into refrigerator 100A, causing the internal temperature of refrigerator 100A to decrease slowly, the abnormality detection unit 152a may determine that there is a cooling abnormality based on the change in internal temperature. In this case, the corresponding "refrigerator abnormality" notification is only issued when the door is opened. At this time, if the conditions for other notifications with a relatively lower priority than the "refrigerator abnormality" notification are met, the notification control unit 154 decides to issue multiple notifications in order based on a predetermined priority. However, once the hot item placed in refrigerator 100A is cooled, the phenomenon of the internal temperature not decreasing slowly is resolved, the abnormality detection unit 152a does not determine that there is a cooling abnormality, and the conditions corresponding to the "refrigerator abnormality" notification are no longer met. Even in this case, if the conditions for other notifications with a relatively lower priority that have not yet been issued are met, the notification control unit 154 will prioritize those other notifications with a relatively lower priority over the "refrigerator abnormality" notification.

[0141] <6.7 (Scenario 7) When a door open alarm is sounded (Part 1)> In this embodiment, if the first notification is the first type of notification (setting system notification) and the second notification is the second type of notification (door open alarm) which is a notification that the door of the refrigerator 100A remains open for more than a first predetermined time, the notification control unit 154 performs the following processing. For example, if the first condition is met and the second condition is met, the notification control unit 154 suppresses the second notification (door open alarm) and performs the first notification (setting system notification).

[0142] In this embodiment, if the first condition is met and the second condition is met, the notification control unit 154 suppresses the second notification (door open alarm) and performs the first notification (setting system notification). Then, if the notification control unit 154 detects that the door of the refrigerator 100A is open after a second predetermined waiting period (for example, if the door of the refrigerator 100A continues to be detected as open for the second predetermined period), it performs the second notification (door open alarm). The starting point of the second predetermined period is, for example, when the second condition is met, but it may also be set at the end of the first notification (setting system notification). Each of the first and second predetermined periods is, for example, one minute.

[0143] Figure 21 is a diagram illustrating the notification control in Scene 7. In this example, if the door of the refrigerator 100A remains open, the notification control unit 154 outputs a door open alarm multiple times, including 1 minute, 2 minutes, and 3 minutes after the door 20 is detected open, provided that it does not overlap with other notifications.

[0144] In this example, the notification control unit 154 determines that the notification condition (second condition) for the door open alarm corresponding to "after 1 minute elapsed" is met if the open state of the refrigerator door 100A is continuously detected for 1 minute (first predetermined time) after detection. At this time, if the notification timing of the door open alarm corresponding to "after 1 minute elapsed" does not overlap with the notification timing of the setting system alarm, the notification control unit 154 will issue the door open alarm corresponding to "after 1 minute elapsed". On the other hand, if the notification timing of the door open alarm corresponding to "after 1 minute elapsed" overlaps with the notification timing of the setting system alarm, the notification control unit 154 will suppress the notification of the door open alarm corresponding to "after 1 minute elapsed" (for example, by not issuing a notification) and issue a setting system notification.

[0145] Then, if the notification control unit 154 detects that the door of the refrigerator 100A remains open for a period of 1 minute (the first second predetermined time), it determines that the notification condition (second condition) for the door open alarm corresponding to "after 2 minutes" is met. At this time, if the notification timing of the door open alarm corresponding to "after 2 minutes" does not overlap with the notification timing of the setting system alarm, the notification control unit 154 will issue the door open alarm corresponding to "after 2 minutes". On the other hand, if the notification timing of the door open alarm corresponding to "after 2 minutes" overlaps with the notification timing of the setting system alarm, the notification control unit 154 will suppress the notification of the door open alarm corresponding to "after 2 minutes" (for example, by not issuing a notification) and issue the setting system alarm.

[0146] Then, if the notification control unit 154 detects that the door of the refrigerator 100A remains open for another minute (the second predetermined time), it determines that the notification condition (second condition) for the door open alarm corresponding to "after 3 minutes" is met. At this time, if the notification timing of the door open alarm corresponding to "after 3 minutes" does not overlap with the notification timing of the setting system alarm, the notification control unit 154 will issue the door open alarm corresponding to "after 3 minutes". On the other hand, if the notification timing of the door open alarm corresponding to "after 3 minutes" overlaps with the notification timing of the setting system alarm, the notification control unit 154 will delay the notification of the door open alarm corresponding to "after 3 minutes" and issue the setting system alarm. For example, the notification control unit 154 will delay the notification of the door open alarm until after the setting system alarm has finished, and then output the door open alarm corresponding to "after 3 minutes"

[0147] By making such adjustments, the convenience for user U can be improved. For example, the setting system notification is output in response to user U opening the door 20 of the refrigerator 100A and operating the setting operation unit 40. Therefore, when the setting system notification is issued, it can be assumed that user U is working with the door 20 of the refrigerator 100A open. For this reason, if the timing of the door open alarm notification and the timing of the setting system notification coincide, the door open alarm notification can be suppressed, thereby preventing user U, who is working with the door 20 open, from finding the door open alarm annoying.

[0148] In this embodiment, the notification control unit 154 outputs the door open alarm corresponding to "after 3 minutes have elapsed" after the completion of other notifications, even if the notification timing overlaps with that of other notifications. By making such adjustments, it is possible to reduce the possibility that user U will miss the door open alarm. In addition, the door open alarms corresponding to "after 1 minute have elapsed" and "after 2 minutes have elapsed" may also be issued after the completion of other notifications, but in that case the time until the next door open alarm would be shorter than 1 minute, which may be bothersome to user U. For this reason, when the notification control unit 154 issues the door open alarms corresponding to "after 1 minute have elapsed" and "after 2 minutes have elapsed" after the completion of other notifications, it may wait for a second predetermined time (for example, 1 minute) after issuing those door open alarms before determining whether the notification conditions for the door open alarm are met.

[0149] The above explains the processing when the notification timing of setting system notifications and the notification timing of door open alarms overlap. However, the processing described above applies not only when the notification timing of setting system notifications and the notification timing of door open alarms overlap, but also when the notification timing of notification system notifications that are issued when a door is opened (hereinafter referred to as "specific notification system notifications") overlaps with the notification timing of door open alarms.

[0150] In other words, if the first notification is a second type of notification (specific notification system notification) and the second notification is a third type of notification (door open alarm), the notification control unit 154 performs the following processing. For example, if the first condition is met and the second condition is met, the notification control unit 154 suppresses the second notification (door open alarm) and performs the first notification (specific notification system notification). For details of the processing in this case, simply replace "setting system notification" with "specific notification system notification" in the explanation above regarding the case where the notification timing of the setting system notification and the notification timing of the door open alarm overlap.

[0151] By making such adjustments, the convenience for user U can be improved. For example, the specific notification system is output when user U opens the door 20 of refrigerator 100A, so when the specific notification system is issued, it can be assumed that user U is working with the door 20 of refrigerator 100A open. Therefore, if the timing of the door open alarm and the timing of the specific notification system overlap, the door open alarm can be suppressed, thereby preventing user U, who is working with the door 20 open, from finding the door open alarm annoying.

[0152] <6.8 (Scene 8) When a door open alarm is sounded (Part 2)> In this embodiment, if the first condition is met and the second condition is met, and the first notification concerns the contents set in the refrigerator 100A by a setting operation on the setting operation unit 40 inside the refrigerator 100A, the notification control unit 154 suppresses the door open alarm notification and outputs a setting system notification. On the other hand, if the first condition is met and the second condition is met, and the first notification concerns the contents set in the refrigerator 100A by a setting operation on an operation unit other than the setting operation unit 40, the notification control unit 154 outputs both a setting system notification and a door open alarm.

[0153] In this application, "different operating unit" refers to, for example, an operating unit exposed to the outside of the refrigerator 100A, or an operating unit provided on the outside of the refrigerator 100A. "Different operating unit" refers to, for example, a setting operating unit provided on the surface of the door 20 of the refrigerator 100A (for example, the front of the refrigerator compartment door 20A), or an operating unit implemented on the display screen 301a of the terminal device 300 by the home appliance management application AP of the terminal device 300.

[0154] By making such adjustments, the convenience for user U can be improved. For example, if a setting system notification corresponding to the setting operation unit 40 inside the refrigerator 100A is output, user U can assume that the door 20 of the refrigerator 100A is open and working, so the output of the door open alarm is suppressed. On the other hand, if it is not possible to determine whether user U is open and working with the door 20 of the refrigerator 100A, the door open alarm is output. This makes it easier for user U to notice unintended door open states.

[0155] <6.9 (Scene 9) Changing the volume of the notification> In this embodiment, when the notification control unit 154 performs at least some notifications that are not caused by user U operations (for example, notifications that are performed immediately when a reason for notification arises), it performs the notification at a louder volume compared to when it performs notifications caused by user U operations.

[0156] Figure 22 is a diagram illustrating the volume of the notification. In this embodiment, the notification system includes notifications that are executed immediately when a reason for notification occurs (hereinafter referred to as "immediate notification system") and notifications that are executed when the door 20 is opened after a reason for notification has occurred (hereinafter referred to as "door open notification system"). Examples of immediate notification system notifications include "refrigerator malfunction," "end of each mode," and "end of operation of other home appliances." Examples of door open notification system notifications include "refrigerator malfunction," "reminder," "expired best before date," "water container empty," and "recipe update."

[0157] In this case, unlike when a door-open notification is issued, when an immediate notification is issued, there is a high probability that user U is not near the refrigerator 100A. Therefore, in this embodiment, when an immediate notification is issued, the notification control unit 154 issues the notification at a louder volume (for example, at a volume of "+1") compared to when a door-open notification or a setting notification is issued. By making such adjustments, the likelihood that the immediate notification will reach user U can be increased.

[0158] On the other hand, when operating the washing machine 100B in the middle of the night, there may be cases where you do not want the notification to be triggered. In such cases, the notification control unit 154 may set a time period during which the notification is not triggered or the volume of the notification is reduced by obtaining time information from the server 200 via the communication unit 50, installing an illuminance sensor on the refrigerator 100A, or utilizing the GNSS (Global Navigation Satellite System) function of the terminal device 300. Furthermore, for the door open alarm, the volume of the notification may be increased according to the elapsed time since the door 20 was detected to be open.

[0159] <7.Second decision method> Next, I will explain the second decision method. As mentioned earlier, if the timing of multiple notifications overlap, the notification control unit 154 may determine the content or manner of the notification based on the second decision method described below, instead of the first decision method described above.

[0160] The second decision method is a method for determining the content or manner of notification when the notification timings of multiple notifications overlap, based on the detection results of the detection unit 152, which detects the actions of user U, etc. For example, the refrigerator 100A has a detection unit 152 that can detect the actions of user U related to the refrigerator 100A, or the state occurring in the refrigerator 100A or the terminal device 300 used by user U due to the actions of user U. The notification control unit 154 then determines the content or manner of notification by the speaker device 70 based on the detection results of the detection unit 152 when the first condition is met and the second condition is met.

[0161] In this embodiment, when the first condition is met and the second condition is met, the notification control unit 154 determines, based on the detection result from the detection unit 152, which of the first notification and the second notification to prioritize. In this application, "prioritize notification" means the following process. For example, when the timing of one announcement (hereinafter referred to as "Announcement D1") and the timing of another announcement (hereinafter referred to as "Announcement D2") overlap, "prioritizing the announcement of Announcement D1" means (1) announcing Announcement D1 first, regardless of the chronological order in which Announcement D1 and Announcement D2 satisfy their announcement conditions (or when the announcement conditions for Announcement D1 are met later), (2) issuing Announcement D1 but suppressing Announcement D2 (for example, not issuing Announcement D2), (3) delaying the announcement of Announcement D2, or (4) simplifying the announcement of Announcement D2 compared to Announcement D1.

[0162] In the above-mentioned explanation of the first determination method, the case where one of the first and second notifications is a first-type notification (e.g., a setting system notification), and the other of the first and second notifications is a second-type notification different from the first-type notification (e.g., an alert system notification or a door open alarm), was mainly explained. However, in the explanation of the second determination method described below, the types of notifications for the first and second notifications are not limited. For example, both the first and second notifications may be first-type notifications (e.g., setting system notifications), or both the first and second notifications may be second-type notifications (e.g., an alert system notification or a door open alarm).

[0163] <7.1 When detecting an operation on the setting control unit> In this embodiment, the detection unit 152 can detect user U operations on the setting operation unit 40 as user U operations related to the refrigerator 100A. The notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the detection result of the detection unit 152 regarding user U operations on the setting operation unit 40, when the first condition is met and the second condition is met. In the example described below, at least one of the first condition and the second condition is related to the detection of user U operations on the setting operation unit 40 by the detection unit 152.

[0164] (Scenario A: When the first condition is met in relation to user action) In this embodiment, the notification control unit 154 provides a first notification and a second notification when the first condition is met in relation to an operation by user U on the setting operation unit 40, and when the second condition is met for reasons other than those of user U. "The first condition is met in relation to an operation by user U on the setting operation unit 40" means, for example, that the notification condition is met in response to user U operating the setting operation unit 40. "The notification condition is met for reasons other than those of user U" means, for example, that the notification condition is met when a change in state occurs in the refrigerator 100A at a time different from that of user U, or when the refrigerator 100A receives information from an external source.

[0165] In this embodiment, when the first condition is met in relation to an operation by user U on the setting operation unit 40, and the second condition is met for a reason other than the operation by user U, the notification control unit 154 delays the timing of the second notification compared to when the second condition is met without a scheduled notification of the first notification. For example, the notification control unit 154 performs the first notification as scheduled, while delaying the timing of the second notification, performing the second notification after the completion of the first notification.

[0166] Figure 23 is a diagram illustrating the notification control in scenario A. Scenario A is the same situation as scenario 1, which was explained in relation to the first decision method. In this example, first, the temperature setting of the refrigerator compartment 11A is changed by user U's operation, and the detection unit 152 detects user U's operation on the setting operation unit 40, thus satisfying the first condition corresponding to the first notification (setting system notification). Therefore, the notification control unit 154 starts a notification as the first notification, indicating that the temperature setting of the refrigerator compartment 11A has been changed.

[0167] In this example, during the first notification, the refrigerator 100A receives a notification from the server 200 indicating that the washing machine 100B has finished operating. For reasons unrelated to user U's actions, the second condition corresponding to the second notification (announcement-type notification) is met. Therefore, a notification overlap state is established, which is "when the first condition is met and the second condition is also met."

[0168] In this embodiment, the notification control unit 154 performs the following processing in the notification overlap state, based on the detection unit 152 detecting an operation by user U related to the first condition, while the second condition is met for reasons other than the operation by user U. For example, the notification control unit 154 does not start the second notification and keeps the second notification on standby, while continuing to perform the first notification until the end. Then, after the first notification is completed, the notification control unit 154 starts the second notification that had been kept on standby.

[0169] By making such adjustments, the user's convenience can be improved. For example, setting notifications (e.g., setting notifications corresponding to the last set content) can be conveyed to the user, and by conveying notification notifications that arise for reasons unrelated to the user's actions last, the user is more likely to pay attention to notification notifications, and notification notifications can be conveyed to the user more reliably. Furthermore, the second decision method, based on the detection results of the user's actions, can achieve the same processing as the first decision method without relying on complex table information or complex judgment processes.

[0170] (Scenario B: When the second condition is met in relation to user actions) In this embodiment, if the first condition is met for a reason other than the user U's operation, and the second condition is met in relation to the user U's operation on the setting operation unit 40, the control unit 154 will issue a first notification and suppress the second notification. For example, the notification control unit 154 will not issue a second notification.

[0171] Figure 24 is a diagram illustrating the notification control in scenario B. Scenario B is the same situation as scenario 2, which was explained in relation to the first decision method, for example. In this example, the first condition corresponding to the first notification (announcement system notification) is met for reasons different from user U's operation, when the refrigerator 100A receives a notification from the server 200 indicating a reminder. Therefore, the notification control unit 154 starts a notification as the first notification, indicating the content of the reminder (for example, "Today is combustible waste collection day").

[0172] In this embodiment, during the execution of the first notification, the temperature setting of the refrigerator compartment 11A is changed by user U's operation, and the detection unit 152 detects user U's operation on the setting operation unit 40, thus satisfying the second condition corresponding to the second notification (setting system notification). Therefore, a notification overlap state is established, which is "when the first condition is satisfied and the second condition is also satisfied".

[0173] In this embodiment, the notification control unit 154 performs the following processing in the notification overlap state, based on the fact that the first condition is met for reasons unrelated to the user U's operation, while the detection unit 152 has detected an operation by the user U related to the second condition. For example, the notification control unit 154 decides to continue the first notification that is currently being executed until the end, and decides not to send a notification for the second notification, and discards the information related to the second notification.

[0174] By making such adjustments, the convenience for user U can be improved. For example, if user U intentionally operates the setting operation unit 40 while an notification system is being executed, it can be assumed that user U is familiar with the settings operation of the refrigerator 100A, and at the very least, the priority of the setting system notification for that operation can be judged to be low. For this reason, it is assumed that there is little need to wait for the notification system notification to finish before issuing the setting system notification, and by deliberately not issuing the setting system notification, it is possible to suppress the length of the notification execution time, and by conveying the notification system notification, which is of high importance as a notification, to user U last, it is possible to make user U more likely to pay attention to the notification system notification. Furthermore, according to the second decision method, by based on the detection results of user U's actions, it is possible to achieve the same processing as the first decision method without relying on complex table information or complex judgment processing.

[0175] (Scenario C: When conditions 1 and 2 are met in relation to user actions) In this embodiment, when the first condition is met in relation to the user U's operation on the setting operation unit 40, the notification control unit 154 suppresses the first notification (preliminary notification) and performs the second notification (subsequent notification) in relation to the user U's operation on the setting operation unit 40. For example, the notification control unit 154 stops the preceding notification that is currently being executed and performs the subsequent notification.

[0176] Figure 25 is a diagram illustrating the notification control in scenario C. Scenario C is the same situation as scenario 3, which was explained in relation to the first decision method. In this example, first, the temperature setting of the refrigerator compartment 11A is changed by user U's operation, and the detection unit 152 detects user U's operation on the setting operation unit 40, thus satisfying the first condition corresponding to the first notification (setting system notification). Therefore, the notification control unit 154 starts a notification as a preliminary notification, indicating that the temperature setting of the refrigerator compartment 11A has been changed.

[0177] In this example, during the first notification, user U changes the setting to turn on the sterilization mode. The detection unit 152 detects user U's operation on the setting operation unit 40, and the second condition corresponding to the second notification (setting system notification) is met. As a result, a notification overlap state is established, which is "when the first condition is met and the second condition is also met."

[0178] In this embodiment, the notification control unit 154 performs the following processing in the notification overlap state, based on the detection of user U operations related to the first condition by the detection unit 152, and similarly, the detection of user U operations related to the second condition by the detection unit 152. For example, in the notification overlap state, the notification control unit 154 stops the preceding notification midway and starts the subsequent notification. Then, the notification control unit 154 completes the subsequent notification.

[0179] By making these adjustments, delays in notification can be avoided, and important information from the configuration system notifications can be conveyed to the user U first. Furthermore, the second decision method allows for the same processing as the first decision method to be achieved without relying on complex table information or complex judgment processes, by basing the decision on the detection results of the user U's actions.

[0180] <7.2 When detecting the running status of an application on a terminal device> In this embodiment, the detection unit 152 can detect the activation status of a predetermined functional unit (e.g., a home appliance management application AP) in the terminal device 300 as a state occurring in the terminal device 300 used by user U due to user U's actions. The notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the detection result regarding the activation status of the predetermined functional unit when the first condition is met and the second condition is met.

[0181] For example, if the first condition is met and the second condition is met, the notification control unit 154 will perform both the first and second notifications if the detection unit 152 has detected the activation state of the predetermined functional unit. For example, the notification control unit 154 will perform the first notification as is, while delaying the timing of the second notification, performing the second notification after the completion of the first notification.

[0182] On the other hand, if the first condition is met and the second condition is met, the notification control unit 154 will suppress the notification for at least one of the first notification and the second notification if the detection unit 152 has not detected the activation state of the predetermined functional unit, or it will suppress the first notification and give the second notification, and if the first condition is still met after a predetermined time, it will give the first notification, or it will suppress the second notification and give the first notification, and if the second condition is still met after a predetermined time, it will give the second notification.

[0183] Figure 26 is a diagram illustrating the notification control in scenario D. In this example, first, the setting of the interior lighting is changed by user U, and the detection unit 152 detects user U's operation on the setting operation unit 40, thus satisfying the first condition corresponding to the first notification (setting system notification). Therefore, the notification control unit 154 starts a notification as the first notification, indicating that the setting of the interior lighting has been changed.

[0184] In this embodiment, during the first notification, the door 20 remains open for longer than a first predetermined time, thus satisfying the notification condition (second condition) corresponding to the door open alarm. Therefore, a notification overlap state is established, which is the case when "the second condition is satisfied in addition to the first condition being satisfied."

[0185] At this time, the detection unit 152 detects whether or not the home appliance management application AP of the terminal device 300 is running. Then, in the above notification overlap state, if the detection unit 152 detects that the home appliance management application AP is running, the notification control unit 154 will proceed with the first notification (setting system notification) as is, while delaying the timing of the second notification (door open alarm), and will perform the second notification after the first notification has finished.

[0186] On the other hand, if the notification control unit 154 does not detect that the home appliance management application AP is running in the above notification overlap state, it suppresses the second notification (door open alarm) and performs the first notification (setting system notification). For example, the notification control unit 154 does not perform the second notification (door open alarm). Then, if the notification control unit 154 continues to detect that the door of the refrigerator 100A is open after a second predetermined waiting period, it performs the second notification (door open alarm) after the second predetermined period has elapsed.

[0187] By making such adjustments, for example, if the home appliance management app AP is running, a door open alarm will be output after the notification of the interior lighting setting, but if the home appliance management app AP is not running, the door open alarm will not be issued immediately after the notification of the interior lighting setting, and will be issued after a second predetermined time if the door 20 is still open. This helps to prevent forgetting to close the door 20 even when the home appliance management app AP is running and user U is concentrating on operating the terminal device 300 and is likely to forget to close the door 20. On the other hand, if the home appliance management app AP is not running, there is a high possibility that the user is operating the setting operation unit 40 or checking the condition of the storage room 11 immediately after such operation, so it is possible to suppress the notification of a door open alarm to urge the user to close the door at this time.

[0188] In the example using Figure 26, the first notification is a first-type notification (setting system notification), and the second notification is a second-type notification (door open alarm). Therefore, when the first condition is met and the second condition is met, if the detection unit 152 has not detected the activation state of the predetermined function unit, the notification control unit 154 suppresses the second notification and issues the first notification, and after waiting for a predetermined time, issues the second notification if the second condition is still met. Alternatively, if the first notification is a second-type notification (door open alarm) and the second notification is a first-type notification (setting system notification), the process described above is reversed. That is, when the first condition is met and the second condition is met, if the detection unit 152 has not detected the activation state of the predetermined function unit, the notification control unit 154 suppresses the first notification and issues the second notification, and after waiting for a predetermined time, issues the first notification if the first condition is still met.

[0189] <7.3 Detecting the open (or closed) state of a home appliance door (Part 1)> In this embodiment, the door open detection sensor 110 can detect the door open state of the door 20 as a state occurring in the refrigerator 100A due to the actions of user U. The notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the detection result regarding the door open state when the first condition is met and when the second condition is met. The door open detection sensor 110 is an example of a "detection unit".

[0190] For example, if the first condition is met and the second condition is met, and the door open state is detected by the door open detection sensor 110, the notification control unit 154 may suppress the notification of at least one of the first notification and the second notification, swap the order of the first notification and the second notification, suppress the first notification and give the second notification, wait for a predetermined time and if the first condition is still met, give the first notification, or suppress the second notification and give the first notification and wait for a predetermined time and if the second condition is still met, give the second notification.

[0191] Figure 27 is a diagram illustrating the notification control in scenario E. In this example, the first condition corresponding to the first notification (notification system notification) is met when the water supply container runs out of water, as detected by the detection unit 152. Therefore, the notification control unit 154 starts a notification indicating that the water supply container is running low, as the first notification.

[0192] In this example, during the first notification, the refrigerator 100A receives a notification from the server 200 informing it that the washing machine 100B has finished operating, thus satisfying the second condition corresponding to the second notification (announcement system notification). Therefore, a notification overlap state is established, which is "when the first condition is satisfied and the second condition is also satisfied."

[0193] At this time, the door open detection sensor 110 detects whether or not the door 20 of the refrigerator 100A is in an open state. Then, in the above notification overlap state, if the door open state is detected by the door open detection sensor 110, the notification control unit 154 stops the first notification (notification system notification) and puts it into standby mode, and then performs the second notification (notification system notification). In this case, when the door 20 is subsequently closed, the notification control unit 154 determines whether or not the notification condition (first condition) corresponding to the stopped and standby first notification is still met (for example, whether or not the water supply container is still detected to be empty). If the notification control unit 154 determines that the notification condition (first condition) corresponding to the stopped and standby first notification is still met, it restarts the stopped and standby first notification. On the other hand, if it determines that the notification condition (first condition) corresponding to the stopped and standby first notification has been resolved, it determines that the first notification is unnecessary and discards the stopped and standby first notification.

[0194] On the other hand, in the above-mentioned overlapping notification state, if the door open detection sensor 110 detects that the door is closed, the notification control unit 154 stops the first notification (notification system notification) and puts it into standby mode, and then performs the second notification (notification system notification). In this case, when the next door open state of the door 20 is detected, the notification control unit 154 performs the first notification that was put into standby mode.

[0195] By making such adjustments, the convenience for user U can be improved. For example, if the door 20 is open when the second condition is met after the first condition related to refrigerator 100A (e.g., the first condition related to the parts of refrigerator 100A) has been met, user U is working on refrigerator 100A and may respond to the notification reason without being notified (e.g., filling the water container), so other notifications (e.g., notification conditions unrelated to the parts of refrigerator 100A, such as the end of operation of other home appliances, reminders, recipe updates, etc.) are given priority. Then, after the door 20 is closed, if the notification conditions related to refrigerator 100A are still met, the notification is given.

[0196] On the other hand, if the door 20 is closed when the second condition is met after the first condition related to refrigerator 100A has been met, it is possible that user U has moved away from refrigerator 100A. For this reason, by stopping the first notification and putting it into standby mode, and then issuing the first notification the next time the door is opened, the notification content can be conveyed to user U more reliably.

[0197] <7.4 Detecting the open (or closed) state of a home appliance door (Part 2)> In this embodiment, when the first condition is met and the second condition is met, if the door open state is detected by the door open detection sensor 110 (in other words, if the door open state is not detected), the notification control unit 154 determines the notification order for multiple notifications based on a predetermined priority and performs notifications in the determined order. In this case, the "predetermined priority" is set such that, for example, notifications related to the refrigerator 100A have a higher priority, and notifications related to other home appliances 100 have a lower priority. Therefore, when the door 20 is detected to be closed, notifications related to the refrigerator 100A are performed first, and notifications related to other home appliances 100 are performed later.

[0198] On the other hand, when the first condition is met and the second condition is met, and the door open state is detected by the door open detection sensor 110, the notification control unit 154 determines the notification order for at least some notifications based on a priority order opposite to the predetermined priority order, and makes notifications in the determined notification order. That is, when the door 20 is detected to be open, notifications related to other home appliances 100 are made first, and notifications related to the refrigerator 100A are made later.

[0199] Figure 28 is a diagram illustrating the notification control in scenario F. In this example, the first condition corresponding to the first notification (notification system notification) is met when the end of the cooling mode is detected by the detection unit 152. Therefore, the notification control unit 154 starts a notification to indicate the end of the cooling mode as the first notification.

[0200] In this example, during the first notification, the refrigerator 100A receives a notification from the server 200 informing it that the washing machine 100B has finished operating, thus satisfying the second condition corresponding to the second notification (announcement system notification). Therefore, a notification overlap state is established, which is "when the first condition is satisfied and the second condition is also satisfied."

[0201] At this time, the door open detection sensor 110 detects whether the door 20 of the refrigerator 100A is closed or not in the notification overlap state described above. Then, in the notification overlap state described above, if the door open detection sensor 110 detects that the door 20 is closed, the notification control unit 154 determines the notification order for the first and second notifications based on the predetermined priority order described above, and makes the notifications in the determined notification order. That is, if the door 20 is detected to be closed, notifications related to the refrigerator 100A are made first, and notifications related to other home appliances 100 are made afterward.

[0202] In the example shown in Figure 28, when the door closed state is detected, the notification control unit 154 issues the first notification (a notification related to the refrigerator 100A) as is, and also puts the second notification (a notification related to the washing machine 100B) into standby mode, and issues the second notification after the first notification has finished. If the second notification is put into standby mode, a determination may be made at the end of the first notification or after a predetermined waiting period whether the second condition is still met, and the second notification may be issued only if the second condition is still met.

[0203] On the other hand, in the above-mentioned overlapping notification state, if the door open state is detected by the door open detection sensor 110, the notification control unit 154 determines the notification order for the first and second notifications based on a priority reversed from the predetermined priority order, and performs notifications in the determined notification order. That is, if the door 20 is detected to be open, notifications related to other home appliances 100 are performed first, and notifications related to the refrigerator 100A are performed later.

[0204] In the example shown in Figure 28, when the door open state is detected, the notification control unit 154 stops the first notification (a notification related to the refrigerator 100A) and puts it into standby mode, and starts the second notification (a notification related to the washing machine 100B). Then, after the second notification is completed, the first notification is given. If the first notification is put into standby mode, a determination may be made at the end of the second notification or after a predetermined waiting period whether the first condition is still met, and the first notification may be given only if the first condition is still met.

[0205] By making such adjustments, the convenience for user U can be improved. For example, if the closed state of door 20 is detected, user U is likely not near refrigerator 100A, so by providing notifications related to refrigerator 100A first, it becomes easier to guide user U closer to refrigerator 100A. On the other hand, if the open state of door 20 is detected, user U is likely not near refrigerator 100A, so by providing notifications related to other home appliances 100 first, it becomes easier to guide user U closer to other home appliances 100.

[0206] In the example using Figure 28, the first notification is related to refrigerator 100A, and the second notification is related to other home appliances 100. Alternatively, the first notification may be related to other home appliances 100, and the second notification may be related to refrigerator 100A. In this case, the relationship between the "first notification" and the "second notification" in the process described above will be reversed.

[0207] <7.5 When detecting the usage status of output devices> In this embodiment, the detection unit 152 can detect the usage status of the output device 90 (speaker 70A or display device 80) of the refrigerator 100A as a state occurring in the refrigerator 100A due to the actions of user U. The notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the detection result regarding the usage status of the output device 90 when the first condition is met and the second condition is met.

[0208] For example, when the first condition is met and the second condition is met, the notification control unit 154, when the detection unit 152 detects that the output device 90 is in use, determines the notification order for multiple notifications based on a predetermined priority and performs notifications in the determined order. In this case, the "predetermined priority" is such that, for example, notifications related to the refrigerator 100A have a lower priority, and notifications related to other home appliances 100 have a higher priority. Therefore, when the use of the output device 90 is detected, notifications related to other home appliances 100 are performed first, and notifications related to the refrigerator 100A are performed later.

[0209] On the other hand, if the first condition is met and the second condition is met, and the detection unit 152 has detected that the output device 90 is not in use, the notification control unit 154 will determine the notification order for at least some of the notifications based on a priority order opposite to the predetermined priority order, and will issue notifications in the determined notification order. That is, if the output device 90 is detected to be not in use, notifications related to the refrigerator 100A will be issued first, and notifications related to other home appliances 100 will be issued later.

[0210] Figure 29 is a diagram illustrating the notification control in scenario G. In this example, the first condition corresponding to the first notification (notification system notification) is met when the end of the cooling mode is detected by the detection unit 152. Therefore, the notification control unit 154 starts a notification to indicate the end of the cooling mode as the first notification.

[0211] In this example, during the first notification, the refrigerator 100A receives a notification from the server 200 informing it that the washing machine 100B has finished operating, thus satisfying the second condition corresponding to the second notification (announcement system notification). Therefore, a notification overlap state is established, which is "when the first condition is satisfied and the second condition is also satisfied."

[0212] At this time, the detection unit 152 detects whether or not the output device 90 is in use during the notification overlap state. Then, if the detection unit 152 detects that the output device 90 is in use during the notification overlap state, the notification control unit 154 determines the notification order for the first and second notifications according to the predetermined priority order and makes the notifications in the determined order. That is, if the output device 90 is detected to be in use, notifications related to other home appliances 100 are made first, and then notifications related to the refrigerator 100A are made first.

[0213] On the other hand, in the above-mentioned overlapping notification state, if the detection unit 152 detects that the output device 90 is not in use, the notification control unit 154 determines the notification order for the first and second notifications according to a priority reversed from the predetermined priority order, and performs notifications in the determined notification order. That is, if the output device 90 is detected to be not in use, a notification related to the refrigerator 100A is given, and then notifications related to other home appliances 100 are given.

[0214] By making such adjustments, the convenience for user U can be improved. For example, if the use of output device 90 is detected, user U is likely to be near refrigerator 100A, so notifications related to other home appliances 100 are given first to make it easier to guide user U closer to those appliances 100. On the other hand, if the non-use state of output device 90 is detected, user U is likely not near refrigerator 100A, so notifications related to refrigerator 100A are given first to make it easier to guide user U closer to refrigerator 100A.

[0215] <8. Advantages> As a comparative example, consider a notification system that, when the notification times of multiple notifications overlap, determines the notification order according to a predetermined priority, and omits notifications with lower priority. However, the usage patterns of home appliances 100 (e.g., refrigerator 100A) vary among users U, and it is likely that some users U may require information with lower priority.

[0216] <8.1 Advantages of the First Decision Method> In one aspect of this embodiment, the notification system has a notification control unit 154 capable of controlling the speaker device 70 to make a first notification when a first condition is met and a second notification when a second condition is met. One of the first and second notifications is a first type of notification (setting system notification) relating to content that can be set on the home appliance 100 by the user U. The other of the first and second notifications is a second type of notification. When the first condition is met and the second condition is met, the notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the relationship including the type of notification between the first and second notifications.

[0217] With this configuration, when the notification timings of multiple notifications overlap, it is possible to distinguish between setting-related notifications that user U is likely to be aware of and other types of notifications, and to adjust the content or manner of the notifications as needed. This reduces the inconvenience of notifications while still conveying useful information to user U. This improves user U's convenience.

[0218] <8.2 Advantages of the Second Decision Method> In another aspect of this embodiment, the notification system includes detection units 110 and 152 capable of detecting user U actions related to the home appliance 100, or states occurring in the home appliance 100 or a terminal device 300 used by the user due to user U actions, and a notification control unit 154 capable of controlling the speaker device 70 to make a first notification when a first condition is met, and a second notification when a second condition is met. When the first condition is met and the second condition is met, the notification control unit 154 determines the content or manner of notification by the speaker device 70 based on the detection result by the detection unit 152.

[0219] With this configuration, when the notification timings of multiple notifications overlap, the content or manner of the notifications can be adjusted based on the user's actions. In other words, by basing notifications on the user's actions, it becomes possible to determine what information is necessary or unnecessary for the user. This reduces the inconvenience of notifications while still conveying useful information to the user. This improves the user's convenience.

[0220] <9. Variation> Next, some modifications of the above-described embodiment will be explained. Note that, apart from the configurations described below, each modification is the same as that of the above-described embodiment.

[0221] <First variation> Figure 30 shows a home appliance management system 1A of the first modified example. In the first modified example, a speaker device 400 exists separately from the refrigerator 100A. The speaker device 400 is, for example, a smart speaker and exists independently of the refrigerator 100A. The speaker device 400 is an example of an "audio output device". A server 500 for controlling the speaker device 400 is connected to the network NW.

[0222] In this embodiment, for example, an example of a "notification system" is realized using a refrigerator 100A. The refrigerator 100A can communicate with a speaker device 400 using short-range wireless communication such as Bluetooth. The notification control unit 154 of the refrigerator 100A transmits notification information to the speaker device 400, causing the speaker device 400 to output an audio notification.

[0223] Alternatively, the refrigerator 100A may communicate with the server 500 via the server 200 or directly. The notification control unit 154 of the refrigerator 100A may send notification information to the server 500, causing the speaker device 400 to output an audio notification. In this application, "controlling the audio output device" is not limited to directly controlling the audio output device, but also includes sending control commands to an external server that manages the audio output device.

[0224] <Second variation> Figure 31 shows a second modified example of the home appliance management system 1B. In the embodiment described above, the information acquisition unit 151, the detection unit 152, the condition fulfillment determination unit 153, and the notification control unit 154 are provided in the refrigerator 100A. However, some or all of these functional units may be provided in the server 200 instead of / in addition to the refrigerator 100A. In this case, the server 200 only needs to provide notification through at least one of the speaker device 70 of the refrigerator 100A and the speaker device 400 provided separately from the refrigerator 100A.

[0225] <Third variation> In the embodiment described above, the home appliance 100 equipped with the speaker device 70 is a refrigerator 100A. However, the home appliance 100 equipped with the speaker device 70 is not limited to a refrigerator 100A, and may include a washing machine 100B or other home appliances 100 as appropriate.

[0226] <Fourth variation> In the embodiment described above, various processes are performed by estimating the position or movement of user U based on the open state of door 20 or the usage state of output device 90. In addition to / or instead of the detection result of the door open detection sensor 110 or the detection unit 152, the refrigerator 100A may also perform various processes by estimating the position or movement of user U based on the detection result of a proximity sensor 130 provided in the refrigerator 100A. For this reason, in the processing of the embodiment described above, "when the door 20 is detected to be open" or "when the usage state of output device 90 is detected" may be read as "when user U is detected by the proximity sensor 130", and "when the door 20 is detected to be closed" or "when the output device 90 is detected to be not in use" may be read as "when user U is not detected by the proximity sensor 130".

[0227] According to at least one embodiment described above, the control unit of the notification system determines the content or manner of notification by the voice output device based on the relationship between the first notification and the second notification, including the type of notification, when the first condition is met and the second condition is met. With such a configuration, convenience can be improved.

[0228] While several embodiments of the present invention have been described, these embodiments are presented as examples only and are not intended to limit the scope of the invention. These embodiments can be carried out in a variety of other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their variations are included in the scope and spirit of the invention, as well as in the claims and their equivalents. [Explanation of symbols]

[0229] 1,1A,1B...Home appliance management system, 100...Home appliance equipment, 100A...Refrigerator, 100B...Washing machine (clothes processing machine), 70...Speaker device (sound output device), 70A...Speaker (output device, sound emitter), 80...Display device (output device), 151...Information acquisition unit, 152...Detection unit, 153...Condition fulfillment determination unit, 154...Notification control unit.

Claims

1. A notification system that provides notification via an audio output device, A control unit capable of controlling the audio output device to issue a first notification when the first condition is met, and a second notification when the second condition is met. Equipped with, One of the first notification and the second notification is a first type of notification relating to settings that can be configured by the user on the home appliance, The other of the first and second notifications is a second type of notification. The control unit, when the first condition is met and the second condition is met, determines the content or manner of notification by the audio output device based on the relationship between the first notification and the second notification, including the type of notification. Notification system.

2. The control unit determines the content or manner of the notification by the audio output device based on both the type of notification of the first notification and the second notification, and the sequence of events in which the first type of notification and the second type of notification satisfy the notification conditions. The notification system according to claim 1.

3. Determining the content or manner of the notification includes, for at least one of the first notification and the second notification, suppressing the notification or changing the timing of the notification. The notification system according to claim 1 or claim 2.

4. The second type of notification is a notification different from the notification that informs the user of the settings performed in response to the user's operation, and is a notification concerning a change in state that has occurred in the home appliance, or a notification concerning information received by the home appliance. The notification system according to claim 1 or claim 2.

5. The first notification is a notification of the first type, The second notification is the second type of notification, The control unit causes the content or manner of notification by the audio output device to differ depending on whether the first condition is met first and then the second condition is met, or whether the second condition is met first and then the first condition is met. The notification system according to claim 4.

6. The first notification is a notification of the first type, The second notification is the second type of notification, The control unit, when the first condition is met and the second condition is met, delays the timing of the second notification compared to when the second condition is met but there is no scheduled notification of the first notification. The notification system according to claim 4.

7. The first notification is a notification of the first type, The second notification is the second type of notification, The control unit shall, if the first condition is met and the second condition is met, perform the first notification, and after the completion of the first notification, perform the second notification. The notification system according to claim 4.

8. When a preceding condition corresponding to one of the first types of notification, which is a preceding notification, is met, and a succeeding condition corresponding to another of the first types of notification, which is a succeeding notification, is met, the control unit suppresses the preceding notification and performs the succeeding notification. The notification system according to claim 7.

9. When the preceding condition is met, and the second condition and the subsequent condition as the first condition are also met, the control unit suppresses the preceding notification, performs the subsequent notification, and performs the second notification after the subsequent notification has finished. The notification system according to claim 8.

10. The first notification is the second type of notification, The second notification is the first type of notification, The control unit, when the first condition is met and the second condition is met, provides the first notification and suppresses the second notification. The notification system according to claim 4.

11. The first notification is a notification of the first type, The second notification is a second type of notification that indicates the door of the home appliance remains open for a period of time exceeding a first predetermined time. The control unit, when the first condition is met and the second condition is met, suppresses the second notification and performs the first notification. The notification system according to claim 1 or claim 2.

12. The control unit, when the first condition is met and the second condition is met, suppresses the second notification and performs the first notification; and when the door of the home appliance is detected to be open after a second predetermined waiting period, performs the second notification. The notification system according to claim 11.

13. The aforementioned home appliance has a setting operation unit provided inside the home appliance, The first notification is a notification of the first type. The second notification is a second type of notification that indicates the door of the home appliance remains open for a predetermined period of time, The control unit, If the first condition is met and the second condition is met, and the first notification is a notification relating to the content set on the home appliance by an operation on the setting operation unit, the second notification is suppressed. If the first condition is met and the second condition is met, and the first notification is a notification relating to the contents set on the home appliance by an operation on an operation unit other than the setting operation unit, the second notification is performed. The notification system according to claim 1 or claim 2.

14. When the control unit provides a notification that is not caused by user operation and is executed immediately when the reason for notification occurs, it provides the notification at a louder volume than a notification caused by user operation. The notification system according to claim 1 or claim 2.

15. A notification system that provides notification via an audio output device, A control unit capable of controlling the audio output device to perform the notification when the conditions for the notification are met, Equipped with, The aforementioned notification is different from a notification that informs the user of settings performed in response to user operations, and is a notification concerning a change in state that has occurred in the home appliance, or a notification concerning information received by the home appliance. The control unit, If multiple conditions corresponding to each of the multiple notifications are met, it is decided to issue the multiple notifications in order based on a predetermined priority. If, before all of the aforementioned multiple notifications are made, the conditions corresponding to one or more notifications included in the multiple notifications that have not yet been made are no longer met, then the notification for that one or more notifications will be made when the conditions corresponding to that one or more notifications are met again. Notification system.

16. The control unit, If, before all of the aforementioned multiple notifications are made, the conditions corresponding to a notification with a relatively higher priority among the multiple notifications are no longer met, and the conditions corresponding to a notification with a relatively lower priority that has not yet been made among the multiple notifications are met, then the notification with the relatively lower priority shall be given priority over the notification with the relatively higher priority. The notification system according to claim 15.

17. One or more computers, The audio output device is controlled to issue a first notification when the first condition is met, and a second notification when the second condition is met. This includes, One of the first notification and the second notification is a first type of notification relating to settings that can be configured by the user on the home appliance, The other of the first and second notifications is a second type of notification. Controlling the audio output device includes determining the content or manner of notification by the audio output device based on the relationship between the first notification and the second notification, including the types of notifications, when the first condition is met and when the second condition is met. Notification method.

18. A refrigerator that provides notification via an audio output device, A control unit capable of controlling the audio output device to issue a first notification when the first condition is met, and a second notification when the second condition is met. Equipped with, One of the first notification and the second notification is a first type of notification relating to the contents that can be set by the user in the refrigerator, The other of the first and second notifications is a second type of notification. The control unit, when the first condition is met and the second condition is met, determines the content or manner of notification by the audio output device based on the relationship between the first notification and the second notification, including the type of notification. refrigerator.

Images