Information Processing System

Abstract

To provide an information processing system capable of checking the state of a person who does not possess a mobile terminal.SOLUTION: An information processing system according to an embodiment includes a refrigerator, an information processing device, and an information terminal. The refrigerator includes a communication unit that communicates with the information processing device, and a display control unit that displays, on a display unit, information received by the communication unit from the information terminal via the information processing device. The information processing device includes a communication unit that communicates with the information terminal and the refrigerator. The information terminal includes a communication unit that communicates with the information processing device.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] FIELD An embodiment of the present invention relates to an information processing system. [Background technology]

[0002] There are parents who do not want their young children to have mobile devices such as smartphones. There are also elderly people who do not want to own mobile devices such as smartphones because their operation is complicated. For people who do not have mobile devices, it is difficult to exchange information via a communication network, and it can be difficult to check the safety and other status of the person. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-009294 A [Patent Document 2] Utility Model Registration No. 3106792 [Patent Document 3] JP 2002-022329 A [Patent Document 4] JP 2018-077877 A Summary of the Invention [Problem to be solved by the invention]

[0004] An object of the present invention is to provide an information processing system that can check the status of a person who does not carry a mobile terminal. [Means for solving the problem]

[0005] The information processing system according to the embodiment includes: a refrigerator having a display device, a communication unit that communicates with an information processing device, and a display control unit that causes first information received by the communication unit from an information terminal via the information processing device to be displayed on the display device; the information processing device having a communication unit that communicates with the information terminal and the refrigerator, the information terminal having a communication unit that communicates with the information processing device, and a home appliance other than a refrigerator provided in a building in which the refrigerator is installed, the home appliance transmitting, when the home appliance becomes operable, to the information processing device, identification information of the home appliance and transmission information indicating that the home appliance has become operable, and when the information processing device receives the transmission information from the home appliance, it notifies a refrigerator having identification information associated with the identification information included in the received transmission information that information has been received. . [Brief description of the drawings]

[0006] [Figure 1]FIG. 1 is a diagram showing an example of the overall configuration of an information processing system according to a first embodiment. [Diagram 2] FIG. 1 is a block diagram showing an example of a configuration of a refrigerator according to a first embodiment. [Diagram 3] FIG. 2 is a block diagram showing an example of the configuration of a server according to the first embodiment. [Figure 4] FIG. 4 is a diagram showing an example of a communication history in the first embodiment. [Diagram 5] FIG. 2 is a block diagram showing an example of the configuration of an information terminal according to the first embodiment. [Figure 6] FIG. 1 is a first diagram showing an example of a processing flow of the information processing system of the first embodiment. [Figure 7] FIG. 2 is a second diagram showing an example of the processing flow of the information processing system of the first embodiment. [Figure 8] FIG. 1 is a first diagram showing an example of a display on a display device of an information terminal according to a first embodiment. [Figure 9] FIG. 2 is a second diagram showing an example of a display on the display device of the information terminal of the first embodiment. [Figure 10] FIG. 2 is a diagram showing an example of a display by the display device of the refrigerator according to the first embodiment. [Figure 11] FIG. 13 is a third diagram showing an example of a display on the display device of the information terminal according to the first modified example of the first embodiment; [Figure 12] FIG. 11 is a first diagram showing an example of a processing flow of an information processing system according to a second modified example of the first embodiment; [Figure 13] FIG. 2 is a second diagram showing an example of a processing flow of the information processing system according to the second modified example of the first embodiment; [Figure 14] FIG. 13 is a diagram showing an example of a display on a display device of an information terminal according to a second modified example of the first embodiment. [Figure 15] FIG. 11 is a diagram showing an example of a display by a display device of a refrigerator according to a second modified example of the first embodiment. [Figure 16] FIG. 13 is a diagram showing an example of the overall configuration of an information processing system according to a second embodiment. [Figure 17] FIG. 13 is a diagram showing an example of the overall configuration of an information processing system according to a third embodiment. [Figure 18] FIG. 13 is a block diagram showing an example of the configuration of a refrigerator according to a fourth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0007] Hereinafter, an information processing system according to an embodiment will be described with reference to the drawings. In the following description, the same reference numerals are used for configurations having the same or similar functions. Then, duplicated descriptions of those configurations may be omitted. "Based on XX" means "based on at least XX" and may include cases based on other elements in addition to XX. "Based on XX" is not limited to cases where XX is directly used, but may also include cases where XX is based on an element that has been subjected to calculation or processing. "XX or YY" is not limited to either one of XX and YY, but may include both XX and YY. This also applies to cases where there are three or more selective elements. "XX" and "YY" are any elements (for example, any information).

[0008] First Embodiment (Overall configuration of information processing system) FIG. 1 is a diagram showing an example of the overall configuration of an information processing system 1 of the first embodiment. The information processing system 1 includes, for example, a refrigerator 10, a server 20 (an example of an information processing device), and information terminals 30a and 30b. The information terminals 30a and 30b are collectively referred to as information terminals 30. The information processing system 1 is a system that can monitor a person living in a residence where the refrigerator 10 is located by having the server 20 provide information to the information terminal 30 according to whether or not the information notified by the refrigerator 10 has been confirmed. For example, the server 20 is a server operated by a company that manufactures the refrigerator 10, and the information processing system 1 is realized by having the refrigerator 10 and the information terminal 30 install a dedicated application program for monitoring a person living in the residence where the refrigerator 10 is located.

[0009] The refrigerator 10 is placed in the residence H1. The refrigerator 10 can communicate with the server 20 via a wireless router R and a network NW. The network NW may be, for example, the Internet, a cellular network, a Wi-Fi (registered trademark) network, a Low Power Wide Area (LPWA), a Wide Area Network (WAN), a Local Area Network (LAN), or other public lines or dedicated lines, depending on the situation.

[0010] The server 20 manages the communication between the refrigerator 10 and the information terminal 30, and the communication between the information terminals 30. The server 20 is composed of one or more server devices (e.g., a cloud server). The server 20 may be called a "server system." The server 20 may include an information processing unit that performs edge computing or fog computing, such as an information processing unit included in a router in the network NW. The server 20 will be described in detail later.

[0011] The information terminal 30 is, for example, a portable terminal device such as a smartphone or a tablet terminal. The information terminal 30 displays information received from the server 20. The information terminal 30 also notifies information indicating whether the information notified by the refrigerator 10 has been confirmed. The details of the information terminal 30 will be described later.

[0012] (Refrigerator configuration) 2 is a block diagram showing an example of the configuration of the refrigerator 10 of the first embodiment. The refrigerator 10 includes, for example, a refrigerator temperature sensor 101, a vegetable compartment temperature sensor 102, a freezer compartment temperature sensor 103, a refrigerator cooler temperature sensor 104, a freezer cooler temperature sensor 105, an ambient temperature sensor 106, an interior camera 107, a refrigerator door switch 108, a vegetable compartment door switch 109, a freezer door switch 110, a current detection unit 111, a compressor 121, a refrigerant switching valve 122, a refrigerator cooling fan 123, a freezer cooling fan 124, a damper 125, a heater 126, a display device 130 (an example of a display unit, an example of an input unit), a wireless module (communication module) 140 (an example of a refrigerator communication unit), a memory unit 150, and a control unit 160 (an example of a display control unit, an example of a refrigerator notification unit). In addition to the above-mentioned configuration, the refrigerator 10 includes a general configuration of a refrigerator (such as a housing, a door, and a cooler).

[0013] Refrigerator compartment temperature sensor 101 is provided in the refrigerator compartment of refrigerator 10 and detects the temperature of the refrigerator compartment. Crisper compartment temperature sensor 102 is provided in the vegetable compartment of refrigerator 10 and detects the temperature of the vegetable compartment. Freezer compartment temperature sensor 103 is provided in the freezer compartment of refrigerator 10 and detects the temperature of the freezer compartment. Each of refrigerator compartment temperature sensor 101, vegetable compartment temperature sensor 102, and freezer compartment temperature sensor 103 is an example of an "interior temperature sensor" that detects the interior temperature of refrigerator 10. Hereinafter, refrigerator compartment temperature sensor 101, vegetable compartment temperature sensor 102, and freezer compartment temperature sensor 103 will be collectively referred to as "interior temperature sensor RS."

[0014] The refrigeration cooler temperature sensor 104 is attached to the refrigeration cooler and detects the temperature of the refrigeration cooler. The refrigeration cooler is an evaporator to which refrigerant is supplied from the compressor 121 and which cools the air that cools the refrigerator compartment and the vegetable compartment. The freezer cooler temperature sensor 105 is attached to the freezer cooler and detects the temperature of the freezer cooler. The freezer cooler is an evaporator to which refrigerant is supplied from the compressor 121 and which cools the air that cools the freezer compartment. Hereinafter, the refrigeration cooler temperature sensor 104 and the freezer cooler temperature sensor 105 are collectively referred to as "cooler temperature sensor ES". In addition, the refrigeration cooler and the freezer cooler are collectively referred to as "cooler".

[0015] Ambient temperature sensor 106 detects the temperature around refrigerator 10 (i.e., the room temperature of the room in which refrigerator 10 is installed). Interior camera 107 is a camera that is provided in, for example, the refrigerator compartment, the vegetable compartment, or the freezer compartment, and captures the state inside refrigerator 10. Interior camera 107 is a detection unit that detects the putting in and taking out of food into and from the refrigerator compartment, the vegetable compartment, or the freezer compartment and / or the amount of food stored inside (cooling load).

[0016] Refrigerator door switch 108 detects whether the refrigerator door of refrigerator 10 is open or closed. Vegetable door switch 109 detects whether the vegetable door of refrigerator 10 is open or closed. Freezer door switch 110 detects whether the freezer door of refrigerator 10 is open or closed. Hereinafter, refrigerator door switch 108, vegetable door switch 109, and freezer door switch 110 are collectively referred to as "door switch DS."

[0017] Current detection unit 111 detects the value of a current flowing through an electric component included in refrigerator 10. The electric component is, for example, compressor 121, refrigerator cooling fan 123, freezer cooling fan 124, ice tray motor, water supply motor, heater 126, or the like.

[0018] The compressor 121 compresses the refrigerant supplied to the refrigerating cooler and the freezing cooler. The refrigerant switching valve 122 selectively connects the flow path through which the refrigerant compressed by the compressor 121 flows to a flow path that supplies the refrigerating cooler and a flow path that supplies the freezing cooler. The refrigerating cooling fan 123 circulates the cold air cooled by the refrigerating cooler in the refrigerator compartment and the vegetable compartment. The freezing cooling fan 124 circulates the cold air cooled by the freezing cooler in the freezing compartment. Hereinafter, the refrigerating cooling fan 123 and the freezing cooling fan 124 are collectively referred to as "cooling fan F". The damper 125 is provided in the air flow path in the refrigerator 10 and opens and closes the air flow path. The heater 126 is, for example, a heater for defrosting. The heater 126 is provided in the cooler, and is heated when the amount of frost attached to the cooler increases, melting the frost attached to the cooler.

[0019] The display device 130 is, for example, a liquid crystal display or an organic EL (Electro Luminescence) display. Under the control of the control unit 160, the display device 130 displays information received by the wireless module 140 from another refrigerator 10 or the information terminal 30 via the network NW. For example, the display device 130 is equipped with a touch panel, and when an operation to check information is performed on the touch panel, the control unit 160 transmits information indicating that the operation to check information has been performed together with identification information of the refrigerator 10 (for example, account information with which the refrigerator 10 communicates) to the server 20. In the refrigerator 10, the display device 130 is provided, for example, below the top door as shown in FIG. 1.

[0020] The wireless module 140 includes a high-frequency circuit and an antenna, and communicates with the server 20 and the information terminal 30 via the wireless router R and the network NW.

[0021] The storage unit 150 is realized by, for example, a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), a flash memory, or a combination of a plurality of these. The storage unit 150 stores control amount information CI.

[0022] The control amount information CI is information in which basic control amounts of the compressor 121, the cooling fan F, the heater 126, and the like in each operation mode are registered. The basic control amount is a control amount initially set in the refrigerator 10, and is a control amount when the refrigerator 10 is normal. For example, the control amount information CI registers basic control amounts such as the operation frequency of the compressor 121 and the number of revolutions of the cooling fan F (or the operation frequency of the compressor 121 and the number of revolutions of the cooling fan F according to the difference between the cooling target temperature and the inside temperature) in each of the cases where the strength of the refrigeration operation is "weak", "medium", and "strong", the threshold temperature of the cooler at which defrosting of the cooler is started, and the amount of electricity supplied to the heater 126. The control unit 160 operates each component of the refrigerator 10 based on the control amount of each component registered in the control amount information CI.

[0023] The control unit 160 is realized, for example, by a hardware processor such as a CPU (Central Processing Unit) mounted on the refrigerator 10 executing a program (software). However, all or a part of the control unit 160 may be realized by hardware (including circuitry) such as an ASIC (Application Specific Integrated Circuit), a PLD (Programmable Logic Device), or an FPGA (Field Programmable Gate Array), or may be realized by a combination of software and hardware.

[0024] The control unit 160 controls the refrigerator 10 based on the detection results of the interior temperature sensor RS, the cooler temperature sensor ES, the ambient temperature sensor 106, the interior camera 107, the door switch DS, and the current detection unit 111.

[0025] Furthermore, the control unit 160 causes the display device 130 to display information that the wireless module 140 has received from the information terminal 30 via the network NW. Furthermore, the control unit 160 notifies the wireless module 140 that it has received information from the information terminal 30 via the server 20. The information is, for example, a message or an image. The message or image includes, for example, an image or text handwritten on a touch panel. For example, the refrigerator 10 and the information terminal 30 are set as one group to transmit and receive information. When the wireless module 140 receives information from the information terminal 30 via the server 20, the control unit 160 notifies the display device 130 that the information has been received by displaying the information. Note that this notification is not limited to displaying the information on the display device 130. In another embodiment, the refrigerator 10 may be provided with a speaker, and the control unit 160 may notify the reception of information from the information terminal 30 by outputting sound (including voice) from the speaker. In another embodiment, the refrigerator 10 may be provided with a light-emitting unit (e.g., an LED (Light Emitting Diode)), and the control unit 160 may notify that the refrigerator 10 has received information from the information terminal 30 by causing the light-emitting unit to emit light.

[0026] Furthermore, when the control unit 160 determines that an operation to check information has been performed in the refrigerator 10, it transmits to the server 20 information indicating that an operation to check information has been performed in the refrigerator 10.

[0027] (Server configuration) 3 is a block diagram showing an example of the configuration of server 20 in the first embodiment. Server 20 includes wireless module 201 (an example of a communication unit included in an information processing device), a control device 202, and a storage unit 203. Server 20 is, for example, a server operated by a company that provides refrigerator 10 and a dedicated application program to information terminal 30.

[0028] The wireless module 201 includes a high-frequency circuit and an antenna. The wireless module 201 communicates with the refrigerator 10 and the information terminal 30 via the wireless router R and the network NW.

[0029] The control device 202 includes a control unit 202a and a management device 202b. The control unit 202a is realized, for example, by a hardware processor such as a CPU mounted on the server 20 executing a program (software). However, all or a part of the control unit 202a may be realized by hardware (including circuitry) such as an ASIC, PLD, or FPGA, or may be realized by cooperation between software and hardware. The control unit 202a controls the server 20.

[0030] Management device 202b manages communication between refrigerator 10 and information terminal 30, and between information terminals 30, via server 20. Management device 202b includes management section 202b1 and judgment section 202b2 (one example of a judgment section included in an information processing device). These functional sections are realized, for example, by a hardware processor such as a CPU mounted on server 20 executing a program (software). However, all or part of these functional sections may be realized by hardware (including circuitry) such as ASIC, PLD, or FPGA, or may be realized by a combination of software and hardware. Furthermore, the hardware processor that realizes management device 202b may be the same hardware processor that realizes control section 202a.

[0031] Management unit 202b1 manages communications between refrigerator 10 and information terminal 30, and between information terminals 30, based on identification information of refrigerator 10 (e.g., account information of refrigerator 10) and identification information of information terminal 30 (e.g., account information of information terminal 30). For example, management unit 202b1 records in storage unit 203 a history of communications between refrigerator 10 and information terminal 30, and between information terminals 30. FIG. 4 is a diagram showing an example of a communication history in the first embodiment. Specifically, management unit 202b1 associates identification information of refrigerator 10 and information terminal 30 with the date and time of communication and records the information in storage unit 203, as shown in FIG. 4.

[0032] Furthermore, when the determination unit 202b2 determines that an operation to check information has been performed in the refrigerator 10, the management unit 202b1 transmits, together with the identification information of the refrigerator 10, read information indicating that the information has been read, to the information terminal 30 in the group via the wireless module 201.

[0033] The determination unit 202b2 determines whether or not an operation to check information has been performed in the refrigerator 10. For example, when the determination unit 202b2 receives information indicating that an operation to check information has been performed from the refrigerator 10, the determination unit 202b2 determines that an operation to check information has been performed in the refrigerator 10.

[0034] The storage unit 203 stores various information necessary for the processing performed by the server 20. For example, the storage unit 203 stores the identification information of the refrigerator 10 and the information terminal 30 that have communicated with each other in association with the date and time of the communication.

[0035] (Information terminal configuration) 5 is a block diagram showing an example of the configuration of the information terminal 30 of the first embodiment. The information terminal 30 includes a display device 301, a wireless module 302, a storage unit 303, and a control device 304.

[0036] The display device 301 is, for example, a liquid crystal display or an organic EL display. The display device 301 displays information received by the wireless module 302 from the refrigerator 10 or another information terminal 30 via the network NW under the control of a control unit 304b (described later) included in the control device 304. The display device 301 also includes a touch panel and receives input of information.

[0037] The wireless module 302 includes a high-frequency circuit and an antenna. The wireless module 302 communicates with the information terminal 30 via the network NW (or via a wireless router R in some cases). The storage unit 303 stores various information necessary for processing performed by the information terminal 30. For example, the storage unit 303 stores a dedicated application program.

[0038] The control device 304 includes an execution device 304a and a control unit 304b. The execution device 304a includes an execution unit 304a1. The execution unit 304a1 executes a dedicated application program to make the information terminal 30 capable of communicating with the refrigerator 10 via the server 20. When the wireless module 302 receives already-read information from the server 20, the execution unit 304a1 reports the already-read information in a manner that distinguishes it from other information. For example, when the wireless module 302 receives already-read information from the server 20, the execution unit 304a1 displays the already-read information among the information displayed on the display device 301 in a more noticeable manner than other information, such as in bold characters, characters in a highly visible color, or blinking characters. Details of the display of the already-read information will be described later.

[0039] (Processing performed by information processing system) Next, the process performed by the information processing system 1 of the first embodiment will be described. Figs. 6 to 7 are diagrams showing an example of a process flow of the information processing system 1 of the first embodiment. Here, the process performed by the information processing system 1 shown in Figs. 6 to 7 will be described. In the process shown here, the refrigerator 10, the information terminal 30a, and the information terminal 30b are set as one group, a message is sent as information from the information terminal 30a used by the mother to the refrigerator 10, and when the server 20 determines that the message has been confirmed, the read information of the refrigerator 10 is sent to the information terminal 30a and the information terminal 30b used by the father, and each information terminal 30 reports the read information, distinguishing it from other information. Also, it is assumed that the refrigerator 10 and the information terminal 30 are set by a dedicated application program to a state in which messages can be sent and received according to accounts, which are identification information.

[0040] The mother performs an operation to input a message on the touch panel of the display device 301 of the information terminal 30a. The execution unit 304a1 of the information terminal 30a generates a message in response to the operation (step S1). The mother inputs a message such as "I've put some dessert in the refrigerator" to the information terminal 30. The mother then performs an operation to transmit the message to the refrigerator 10 and the information terminal 30, which are set in the group, on the touch panel of the display device 301 of the information terminal 30a. The execution unit 304a1 of the information terminal 30a transmits the account of the information terminal 30a, which is the source of the message, the account of the refrigerator 10 and the account of the information terminal 30b, which are the destinations, and the message to the server 20 via the wireless module 302 (step S2).

[0041] Management unit 202b1 of server 20 receives the account of information terminal 30a as the sender, the account of refrigerator 10 as the sender, the account of information terminal 30b as the sender, and the message via wireless module 201 (step S3). Management unit 202b1 records the received account and message, the time of receiving them, and information indicating whether the message has been read at the sender in memory unit 203 (step S4). At this time, the message has not yet been sent to the sender, so the message is unread at the sender. Management unit 202b1 transmits the account of the sender and the message to refrigerator 10 and information terminal 30b as the sender indicated by the account (step S5). Then, judgment unit 202b2 of server 20 starts judging whether an operation to check the message has been performed on refrigerator 10 (step S6). When a certain time has passed, judgment unit 202b2 performs the process of step S6, and if it is determined that an operation to check the message has not been performed, performs the process again when a certain time has passed.

[0042] The execution unit 304a1 of the information terminal 30b receives the sender account and the message via the wireless module 302 (step S7). The execution unit 304a1 of the information terminal 30b notifies the display device 301 of the information terminal 30b that the message has been received (step S8).

[0043] The control unit 160 of the refrigerator 10 receives the sender account and the message via the wireless module 140 (step S9). The control unit 160 notifies the display device 130 that the message has been received (step S10). Note that the processes of steps S7 to S8 and steps S9 to S10 are executed in parallel.

[0044] Next, the child performs an operation to check the message on the touch panel of the display device 130 of the refrigerator 10. In response to the operation, the control unit 160 transmits information indicating that an operation to check the message has been performed to the server 20 via the wireless module 140 (step S11).

[0045] Determination unit 202b2 of server 20 receives information indicating that an operation to check the message has been performed from refrigerator 10 via wireless module 201 (step S12). When determination unit 202b2 receives this information, it determines that an operation to check the message has been performed in refrigerator 10 (YES in step S6).

[0046] If the determining unit 202b2 determines that an operation to check the message has been performed on the refrigerator 10 (YES in step S6), the managing unit 202b1 transmits read information about the refrigerator 10 to each of the information terminals 30 (step S13). This transmission is, for example, a push notification realized by a dedicated application program.

[0047] Execution unit 304a1 of information terminal 30a receives the read information of refrigerator 10 from server 20 via wireless module 302 (step S14). Execution unit 304a1 of information terminal 30a distinguishes the received read information from other information and displays it on display device 301 of information terminal 30a (step S15). FIG. 8 is a diagram showing an example of display on display device 301 of information terminal 30a. Execution unit 304a1 of information terminal 30a displays the read information of refrigerator 10, such as "Refrigerator: Read (2019 / 12 / 03 15:56)" shown in FIG. 8, on display device 301 of information terminal 30a so that it stands out more than other information, for example, in bold, highly visible color, or blinking characters.

[0048] The execution unit 304a1 of the information terminal 30b receives the read information of the refrigerator 10 from the server 20 via the wireless module 302 (step S16). The execution unit 304a1 of the information terminal 30b distinguishes the received read information from other information and displays it on the display device 301 of the information terminal 30b (step S17). FIG. 9 is a diagram showing an example of a display on the display device 301 of the information terminal 30b. The execution unit 304a1 of the information terminal 30b displays the read information of the refrigerator 10, such as "Refrigerator: Read (2019 / 12 / 03 15:56)" shown in FIG. 9, on the display device 301 of the information terminal 30b so that it stands out more than other information, for example, in bold, highly visible colored characters, blinking characters, etc. FIG. 10 is a diagram showing an example of a display on the display device 130 of the refrigerator 10. For example, as shown in FIG. 10, the control unit 160 causes the display device 130 to display the information transmitted from the refrigerator 10 and the information received by the refrigerator 10 as is.

[0049] (advantage) The information processing system 1 of the first embodiment has been described above. The information processing system 1 has a refrigerator 10, a server 20 (an example of an information processing device), and an information terminal 30. The refrigerator 10 has a wireless module 140 (an example of a communication unit) that communicates with the server 20, and a control unit 160 (an example of a display control unit) that displays information received by the wireless module 140 from the information terminal 30 via the server 20 on the display device 130 (an example of a display unit). The server 20 has a wireless module 201 (an example of a communication unit) that communicates with the information terminal 30 and the refrigerator 10. The information terminal 30 has a wireless module 302 (an example of a communication unit) that communicates with the server 20.

[0050] This information processing system 1 enables the refrigerator 10 to communicate with the information terminal 30, and the status of a person (for example, a child or an elderly person) who does not have a mobile terminal can be confirmed via the information terminal 30.

[0051] The server 20 includes a determination unit 202b2 that determines whether or not an operation to check information such as a message or an image has been performed. When the determination unit 202b2 determines that an operation to check the information has been performed, the wireless module 201 of the server 20 transmits to the information terminal 30 read information indicating that an operation to check the information has been performed.

[0052] When an operation to check information is performed on the refrigerator 10, the server 20 can reliably notify the information terminal 30 that an operation to check information has been performed on the refrigerator 10, i.e., that people who may be operating the refrigerator 10, such as children or elderly people, are in a safe state.

[0053] The information terminal 30 includes an execution unit (an example of a notification unit) that, when the wireless module 302 of the information terminal 30 receives already-read information, notifies the already-read information by distinguishing it from other information.

[0054] When read information is received by this information terminal 30, it notifies the user in an easily recognizable manner that an operation to check the information has been performed on the refrigerator 10, so that people who may be operating the refrigerator 10, such as children or elderly people, can be sure to know that the refrigerator 10 is in a safe state.

[0055] <First Modification of First Embodiment> In the information processing system 1 of the first embodiment described above, the execution unit 304a1 of the information terminal 30, when receiving read information about the refrigerator 10 via the wireless module 302, has been described as displaying the read information about the refrigerator 10 together with information about messages that have been read, as shown in Fig. 8 and Fig. 9 as examples of what is displayed on the display device 301 of the information terminal 30. However, in a first modified example of the first embodiment, the execution unit 304a1 of the information terminal 30 may always notify the read information about the refrigerator 10, distinguishing it from other information, even if the information notified by the information terminal 30 has switched to a message from the father, as shown in Fig. 11, for example.

[0056] (advantage) This information processing system 1 always reports read information separately from other information, making it possible to quickly confirm that people who may be operating the refrigerator 10, such as children or elderly people, are safe.

[0057] <Second Modification of First Embodiment> In the information processing system 1 of the first embodiment described above, the determination unit 202b2 of the server 20 has been described as determining whether or not an operation to check information has been performed in the refrigerator 10. However, in the second modification of the first embodiment, the determination unit 202b2 of the server 20 may also determine whether or not information has been read in the information terminal 30. Figs. 12 and 13 are diagrams showing an example of a process flow performed by the information processing system 1 of the second modification of the first embodiment.

[0058] The information processing system 1 performs the processes of steps S1 and S6. The determination unit 202b2 starts to determine whether or not an operation to check a message has been performed on the information terminal 30b (step S21). When a certain time has elapsed, the determination unit 202b2 performs the processes of steps S6 and S21, and when it is determined that an operation to check a message has not been performed, performs the processes again when a certain time has elapsed.

[0059] The father performs an operation to check the message on the touch panel of the display device 301 of the information terminal 30b. In response to the operation, the execution unit 304a1 transmits information indicating that an operation to check the message has been performed to the server 20 via the wireless module 302 (step S22).

[0060] The determination unit 202b2 of the server 20 receives information indicating that an operation to check the message has been performed from the information terminal 30b via the wireless module 201 (step S23). Upon receiving the information, the determination unit 202b2 determines that an operation to check the message has been performed on the information terminal 30b (YES in step S21).

[0061] If the determining unit 202b2 determines that an operation to check the message has been performed on the information terminal 30b (YES in step S21), the managing unit 202b1 transmits read information of the information terminal 30b to the refrigerator 10 and the information terminal 30a (step S24). This transmission is, for example, a push notification realized by a dedicated application program.

[0062] The execution unit 304a1 of the information terminal 30a receives the read information of the information terminal 30b from the server 20 via the wireless module 302 (step S25). The execution unit 304a1 of the information terminal 30a distinguishes the received read information from other information and displays it on the display device 301 of the information terminal 30a (step S26). FIG. 14 is a diagram showing an example of display by the display device 301 of the information terminal 30a. The execution unit 304a1 of the information terminal 30a displays the read information of the information terminal 30b, such as "Refrigerator: Read (2019 / 12 / 03 15:56)" shown in FIG. 14, on the display device 301 of the information terminal 30a so that it stands out more than other information, for example, in bold, highly visible color, or blinking characters. Also, as shown in FIG. 14, "Information terminal 30b: Read (2019 / 12 / 03 17:05)", the read information of the information terminal 30b is displayed less conspicuously than the read information of the refrigerator 10, for example, in the same way as a normal message.

[0063] The control unit 160 of the refrigerator 10 receives the read information of the information terminal 30b from the server 20 via the wireless module 140 (step S27). The control unit 160 displays the received read information on the display device 130, distinguishing it from other information (step S28). FIG. 15 is a diagram showing an example of a display on the display device 130 of the refrigerator 10. The control unit 160 displays the read information of the information terminal 30b in the same way as a normal message, for example, "Information terminal 30b: Read (2019 / 12 / 03 17:05)" as shown in FIG. 15.

[0064] (advantage) With this information processing system 1, it is possible to check whether information other than that about the refrigerator 10 has been read or not.

[0065] <Third Modification of First Embodiment> In the information processing system 1 of the first embodiment described above, the determination unit 202b2 of the server 20 performs the process of step S6 after a certain time has passed, and if it determines that an operation to check the message has not been performed, it performs the process again when a certain time has passed, and repeats this process. However, in the third modification of the first embodiment, the determination unit 202b2 of the server 20 repeats the determination of whether or not an operation to check information such as a message or an image has been performed each time a certain time has passed, and if it determines that an operation to check the information has not been performed for a certain time, that is, if the information remains unread for a certain time, the management unit 202b1 of the server 20 may transmit unread information to notify that the information is unread to the refrigerators 10 or information terminals 30 in the group other than the refrigerator 10 or information terminal 30 that received the information. Note that this certain time can be set or changed by inputting, for example, a certain time after receiving the information, a predetermined time, or the like, from a touch panel of the refrigerator 10, the information terminal 30, or the like.

[0066] (advantage) This information processing system 1 can quickly notify the user that the information is unread, i.e., that a person who may be operating the refrigerator 10, such as a child or an elderly person, may be in a dangerous state.

[0067] <Fourth Modification of the First Embodiment> In information processing system 1 according to the fourth modified example of the first embodiment, at least one of management unit 202b1 and judgment unit 202b2 of management device 202b may be provided in refrigerator 10 instead of server 20, and management device 202b provided in refrigerator 10 may control communications between refrigerator 10 and information terminal 30, and between information terminals 30, which are realized by a dedicated application program.

[0068] (advantage) This information processing system 1 enables communication between the refrigerator 10 and the information terminal 30, and between the information terminals 30, even when communication is performed without going through the server 20 or through a server other than the server 20 operated by the company that provides the dedicated application program.

[0069] <Second embodiment> (Overall configuration of information processing system) 16 is a diagram showing an example of the overall configuration of an information processing system 1 according to the second embodiment. The information processing system 1 includes, for example, a refrigerator 10, a server 20 (an example of an information processing device), and information terminals 30a and 30b, as well as an information terminal 30c. The information terminal 30c is, for example, a refrigerator different from the refrigerator 10, and is placed in the residence H2 of the child's grandfather and grandmother.

[0070] (Information terminal configuration) Similar to the information terminal 30 shown in FIG. 5, the information terminal 30c is a block diagram showing an example of the configuration of the information terminal 30c of the second embodiment. The information terminal 30c includes a display device 301, a wireless module 302, a storage unit 303, and a control device 304. That is, similar to the information terminals 30a and 30b, the information terminal 30c can transmit information such as messages and images to the refrigerator 10 via the server 20. Similarly to the information terminals 30a and 30b, the information terminal 30c can display already read information on the display device 301. The process performed by the information terminal 30c is similar to that of the information terminal 30 in the first embodiment.

[0071] (advantage) The information processing system 1 of the second embodiment has been described above. The information processing system 1 includes a refrigerator 10, a server 20 (an example of an information processing device), an information terminal 30, and an information terminal 30c. The information terminal 30c is a refrigerator different from the refrigerator 10, and is placed in the residence H2 of the child's grandparents. This information processing system 1 enables communication between the refrigerator 10 and the information terminal 30c. That is, for example, a child who does not have a mobile terminal and his / her grandparents can communicate via the refrigerator.

[0072] <Modification of the second embodiment> In the information processing system 1 of the second embodiment described above, the information terminal 30c is, for example, a refrigerator, and has the display device 301, the wireless module 302, the storage unit 303, and the control device 304, similar to the information terminal 30. However, in the information processing system 1 of the modified example of the second embodiment, when the information terminal 30c is a refrigerator, the information terminal 30c may have both the configuration of the refrigerator 10 shown in FIG. 2 and the configuration of the information terminal 30 shown in FIG. 3. The refrigerator 10 may have both the configuration of the refrigerator 10 shown in FIG. 2 and the configuration of the information terminal 30 shown in FIG. 3. In other words, each of the refrigerator 10 and the information terminal 30c may be a refrigerator used by a person to be watched over, and may be capable of communicating with a refrigerator used by another person to be watched over. Note that parts that overlap and can be shared in the configuration of the refrigerator 10 shown in FIG. 2 and the configuration of the information terminal 30 shown in FIG. 3 may be omitted from the configuration of the refrigerator 10 or the configuration of the information terminal 30.

[0073] (advantage) The information processing system 1 according to the modified example of the second embodiment has been described above. With this information processing system 1, the refrigerator 10 and the information terminal 30c are each a refrigerator used by a person who is a target of monitoring, and can simultaneously communicate with refrigerators used by other people who are targets of monitoring.

[0074] <Third embodiment> (Overall configuration of information processing system) FIG. 17 is a diagram showing an example of the overall configuration of an information processing system 1 according to a third embodiment. The information processing system 1 includes, for example, a refrigerator 10, a server 20 (an example of an information processing device), and information terminals 30a, 30b, and 30c, as well as at least one home appliance 40 (one home appliance 40 in FIG. 17, an example of an electrical appliance). The home appliance 40 is, for example, a television, a smart speaker, an air conditioner, a lighting device, or the like, and is disposed in a residence H1. The home appliance 40 can communicate with the server 20 via a router R. The information processing system 1 according to the third embodiment is a system that notifies the person living in the residence H1 in which the refrigerator 10 is disposed that the refrigerator 10 is receiving information from at least one of the information terminals 30 or 30c when the power switch of one of the home appliances 40 is turned on and becomes operable.

[0075] Server 20 prestores in memory 203 information associating identification information of refrigerator 10 with identification information of home appliance 40. When home appliance 40 turns on and enters an operable state, it transmits its own identification information and information indicating that it has entered an operable state to server 20. When management unit 202b1 of server 20 receives the identification information and the information indicating that it has entered an operable state from home appliance 40, management unit 202b1 identifies refrigerator 10 having identification information associated with the received identification information in memory 203. Management unit 202b1 notifies refrigerator 10 having the identified identification information that it has received information by push notification.

[0076] (advantage) The information processing system 1 of the third embodiment has been described above. In the information processing system 1, the home appliance 40 is provided in the residence H1 in which the refrigerator 10 is installed. The home appliance 40 is capable of communicating with the server 20 via the router R. When the power switch of the home appliance 40 is turned on and the home appliance 40 is in an operable state, the home appliance 40 transmits its own identification information and information indicating that the home appliance 40 is in an operable state to the server 20. When the management unit 202b1 of the server 20 receives the identification information and the information indicating that the home appliance 40 is in an operable state from the home appliance 40, the management unit 202b1 identifies the refrigerator 10 having the identification information associated with the received identification information in the storage unit 203. The management unit 202b1 notifies the refrigerator 10 having the identified identification information that information is being received by push notification. This information processing system 1 can notify a person who is a monitoring target living in residence H1 in which refrigerator 10 is placed that the person is receiving information when the person is present in residence H1. In other words, the refrigerator 10 notifies the person that it is receiving information when the person is definitely present, thereby reducing unnecessary notifications such as notifications when the person is not present.

[0077] <First Modification of the Third Embodiment> In the information processing system 1 of the third embodiment described above, when the power switch of the home appliance 40 is turned on and the home appliance 40 is in an operable state, the management unit 202b1 notifies the refrigerator 10 having the specified identification information that the information is being received by a push notification. However, in the first modification of the third embodiment, when the power switch of the home appliance 40 is turned on and the home appliance 40 is in an operable state, the management unit 202b1 of the server 20 transmits its own identification information and information indicating that the home appliance 40 is in an operable state to the server 20. When the management unit 202b1 of the server 20 receives the identification information and the information indicating that the home appliance 40 is in an operable state from the home appliance 40, the management unit 202b1 identifies the refrigerator 10 having the identification information associated with the received identification information in the storage unit 203. The management unit 202b1 may notify the home appliance 40 that the refrigerator 10 having the identified identification information is receiving information by a push notification. In this case, if the home appliance 40 is, for example, a television, the refrigerator 10 may be notified by voice and image in response to the push notification that the refrigerator 10 is receiving information. Furthermore, if the home appliance 40 is, for example, a smart speaker, the refrigerator 10 may notify the user by voice in response to the push notification that the refrigerator 10 is receiving information.

[0078] (advantage) The information processing system 1 according to the first modified example of the third embodiment has been described above. This information processing system 1 can notify that the refrigerator 10 is receiving information directly from the home appliance 40, not from the refrigerator 10.

[0079] <Second Modification of the Third Embodiment> In information processing system 1 of the second modified example of the third embodiment, when home appliance 40 has its power switch turned on and is in an operable state, it transmits its own identification information and information indicating that it has become in an operable state to server 20. When management unit 202b1 of server 20 receives the identification information and the information indicating that it has become in an operable state from home appliance 40, it identifies in storage unit 203 refrigerator 10 having identification information associated with the received identification information. Then management unit 202b1 may notify a group of refrigerators 10 having the identified identification information that a person is present in residence H1 by push notification.

[0080] (advantage) The information processing system 1 according to the second modified example of the third embodiment has been described above. When the power switch of the home electric appliance 40 is turned on, the information processing system 1 can notify the group of refrigerators 10 of the presence of a person in the residence H1 by push notification.

[0081] <Third Modification of the Third Embodiment> In the information processing system 1 according to the third modification of the third embodiment, the home electric appliance 40 may communicate with the refrigerator 10 via the router R only.

[0082] (advantage) The information processing system 1 according to the third modified example of the third embodiment has been described above. With this information processing system 1, the home appliance 40 and the refrigerator 10 communicate with each other only via the router R, so that the configuration of the information processing system 1 can be simplified.

[0083] <Fourth embodiment> (Overall configuration of information processing system) As shown in FIG. 1, an information processing system 1 according to the fourth embodiment includes a refrigerator 10, a server 20 (an example of an information processing device), and information terminals 30a and 30b.

[0084] (Refrigerator configuration) 18 is a block diagram showing an example of the configuration of refrigerator 10 of the fourth embodiment. Refrigerator 10 includes, for example, refrigerator temperature sensor 101, vegetable compartment temperature sensor 102, freezer compartment temperature sensor 103, refrigerator cooler temperature sensor 104, freezer cooler temperature sensor 105, ambient temperature sensor 106, interior camera 107, refrigerator door switch 108, vegetable compartment door switch 109, freezer door switch 110, current detection unit 111, compressor 121, refrigerant switching valve 122, refrigerator cooling fan 123, freezer cooling fan 124, damper 125, heater 126, display device 130 (an example of a display unit), wireless module (communication module) 140 (an example of a refrigerator communication unit), memory unit 150, control unit 160 (an example of a display control unit, an example of a refrigerator notification unit), and camera 170. In addition to the above-mentioned configuration, refrigerator 10 includes a general configuration of a refrigerator (such as a housing, a door, and a cooler).

[0085] Camera 170 records the captured image in storage unit 150. For example, when a child operates the touch panel of display device 130, camera 170 captures a printout distributed by the school to inform parents of school events, collection of school lunch fees, and the like. Camera 170 records the captured image of the printout in storage unit 150. Then, the child operates the touch panel of display device 130 to transmit the image of the printout recorded in storage unit 150 to information terminal 30. In response to the operation, control unit 160 transmits the image of the printout recorded in storage unit 150, the identification information of the transmission source (i.e., refrigerator 10), and the transmission destination (i.e., identification information of information terminal 30) to server 20 via wireless module 140. Management unit 202b1 of server 20 transmits the image of the printout to information terminal 30 having the identification information of the transmission destination received from refrigerator 10 via wireless module 201.

[0086] (advantage) The information processing system 1 according to the fourth embodiment has been described above. This information processing system 1 makes it possible to quickly notify parents of information such as handouts distributed to their children by their schools.

[0087] Although some embodiments of the present invention have been described, these embodiments are presented as examples and are not intended to limit the scope of the invention. These embodiments can be implemented in various other forms, and various omissions, substitutions, and modifications can be made without departing from the spirit of the invention. These embodiments and their modifications are included in the scope of the invention and its equivalents described in the claims, as well as in the scope and spirit of the invention. [Explanation of symbols]

[0088] 1...information processing system, 10...refrigerator, 20...server, 30 (30a, 30b, 30c)...information terminal, 40...home appliance, 101...refrigerator temperature sensor, 102...vegetable compartment temperature sensor, 103...freezer temperature sensor, 104...refrigerator cooler temperature sensor, 105...freezer cooler temperature sensor, 106...ambient temperature sensor, 107...interior camera, 108...refrigerator door switch, 109...vegetable compartment door switch, 110...freezer door switch, 111...current detection unit, 1 21...compressor, 122...refrigerant switching valve, 123...refrigeration cooling fan, 124...freezer cooling fan, 125...damper, 126...heater, 130, 301...display device, 140, 201, 302...wireless module, 150, 203, 303...memory unit, 160, 202a, 304b...control unit, 170...camera, 202, 304...control device, 202b...management device, 202b1...management unit, 202b2...determination unit, 304a...execution device, 304a1...execution unit.

Claims

1. A refrigerator having a display device, a communication unit that communicates with an information processing device, and a display control unit that causes the display device to display first information received by the communication unit from an information terminal via the information processing device; the information processing device having a communication unit that communicates with the information terminal and the refrigerator; the information terminal having a communication unit for communicating with the information processing device; a home electric appliance different from a refrigerator provided in a building in which the refrigerator is provided, the home electric appliance transmitting, when the home electric appliance becomes operable, identification information of the home electric appliance and transmission information indicating that the home electric appliance has become operable to an information processing device; Equipped with When the information processing device receives the transmission information from the home appliance, it notifies a refrigerator having identification information associated with the identification information included in the received transmission information that information has been received.

2. The information processing device includes: a determination unit that determines whether or not an operation to confirm the first information has been performed in the refrigerator; Equipped with The communication unit of the information processing device is when the determination unit determines that an operation to check the first information has been performed in the refrigerator, transmitting read information indicating that the operation to check the first information has been performed to the information terminal. The information processing system according to claim 1 .

3. The information terminal includes: a notification unit that, when the communication unit of the information terminal receives the read information, notifies the read information among the information displayed on the display device in a manner that makes the read information more noticeable than second information, which is information other than the read information; Equipped with The information processing system according to claim 2 .

4. The notification unit is Even when the second information has been switched, the already-read information among the information displayed on the display device is notified in a more prominent manner than the second information. The information processing system according to claim 3 .

5. The home appliance comprises: a notification unit that notifies that the communication unit of the refrigerator has received the first information from the information terminal via the information processing device; The information processing system according to claim 1 .

6. The notification unit of the home appliance, when the home electric appliance other than the refrigerator becomes operable, the communication unit of the refrigerator notifies the user that the first information has been received from the information terminal via the information processing device.

6. The information processing system according to claim 5.

7. The information processing device includes: a management unit that records at least one of a history of communication between the refrigerator and the information terminal or a history of communication between the information terminal and an information terminal different from the information terminal; The information processing system according to claim 1 , further comprising:

8. The refrigerator includes: a management unit that records at least one of a history of communication between the refrigerator and the information terminal or a history of communication between the information terminal and an information terminal different from the information terminal; The information processing system according to claim 1 , further comprising:

Images