System, information terminal, and communication setting method

Abstract

In a system (1), an information terminal (10) includes: a terminal acquisition unit (11) that receives an authentication key from a server (20); a generation unit (13) that generates a reading code in which the authentication key is expressed; a display unit (15) that displays the reading code; a terminal storage unit (14) that stores user information; and a terminal transmission unit (12) that transmits the user information to the server (20). A camera device (40) includes: an image sensor (41); a decoding unit (42) that decodes the authentication key of the reading code on the basis of an image of the displayed reading code captured by the image sensor (41); a camera storage unit (43) that stores camera information; and a camera communication unit (44) that transmits the authentication key and the camera information to the server (20). The server (20) associates and stores the user information transmitted by the information terminal (10) and the camera information transmitted together with the authentication key by the camera device (40).

Description

System, information terminal, and communication setting method

[0001] The present disclosure relates to a system, an information terminal, and a communication setting method.

[0002] Patent Document 1 discloses a technique in which a device identifier and a user identifier are transmitted to a server device and linked to each other.

[0003] Japanese Patent Application Laid-Open No. 2019-101509

[0004] The present disclosure provides a system and the like that can store user information and legitimate camera information in association with each other.

[0005] A system according to one aspect of the present disclosure is a system in which a camera device having a communication function communicates with a server that can be connected to an information terminal via a network, wherein the information terminal has a terminal acquisition unit that receives an authentication key from the server, a generation unit that generates an optical read code that represents the authentication key, a display unit that displays the generated read code, a terminal memory unit that stores user information for identifying a user, and a terminal transmission unit that transmits the user information to the server, and the camera device has a decoding unit that decodes the authentication key represented by the read code based on an image obtained by capturing the read code displayed on the information terminal with an image sensor possessed by the camera device, a camera memory unit that stores camera information for identifying the camera device, and a camera communication unit that transmits the authentication key and the camera information stored in the camera memory unit to the server, and the server stores the user information transmitted by the information terminal and the camera information transmitted by the camera device together with the authentication key in association with each other.

[0006] Furthermore, an information terminal according to one aspect of the present disclosure is an information terminal in which a camera device having a communication function is communicatively connected to a server with which communication can be established via a network, and includes a terminal acquisition unit that acquires from the server an authentication key for causing the server to authenticate received information as legitimate, a generation unit that generates an optical read code in which the authentication key is expressed, a display unit that displays the read code generated by the generation unit so that it can be read by the camera device, a terminal memory unit that stores user information for identifying a user, and a terminal transmission unit that transmits the user information to the server.

[0007] Furthermore, a communication setting method according to one aspect of the present disclosure is a communication setting method for a camera device having a communication function to communicate with a server that can be connected to an information terminal via a network, wherein the information terminal acquires an authentication key from the server, the information terminal generates an optical read code that represents the authentication key, the information terminal displays the generated read code, the information terminal transmits user information for identifying the user to the server, the camera device photographs the read code displayed on the information terminal, the camera device decodes the authentication key represented by the read code based on an image obtained by photographing, the camera device transmits the authentication key and camera information for identifying the camera device to the server, and the server stores the user information transmitted by the information terminal and the camera information transmitted by the camera device together with the authentication key in association with each other.

[0008] These general or specific aspects may be realized by a device, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized by any combination of a device, a method, a system, an integrated circuit, a computer program, and a non-transitory recording medium.

[0009] The system or the like in the present disclosure can store user information and legitimate camera information in association with each other.

[0010] FIG. 1 is a diagram illustrating an overview of a system according to an embodiment. FIG. 2 is a diagram illustrating an example of a configuration of a system according to an embodiment. FIG. 3 is a sequence diagram illustrating an example of a registration process in a system according to an embodiment. FIG. 4 is a diagram illustrating a first example of a UI displayed on a display unit of an information terminal. FIG. 5 is a diagram illustrating an example of a UI displayed on an information terminal for presenting connection information. FIG. 6 is a diagram illustrating an example of a UI for receiving input of connection information from a user. FIG. 7 is a flowchart illustrating an example of a process for establishing a communication connection executed by an information terminal. FIG. 8 is a flowchart illustrating an example of a process for establishing a communication connection executed by an information terminal. FIG. 9 is a flowchart illustrating an example of a process for establishing a communication connection executed by an information terminal. FIG. 10 is a diagram illustrating a first example of a UI displayed by an information terminal during a process for establishing a communication connection. FIG. 11 is a diagram illustrating a second example of a UI displayed by an information terminal during a process for establishing a communication connection. FIG. 12 is a diagram illustrating a third example of a UI displayed by an information terminal during a process for establishing a communication connection. FIG. 13 is a diagram illustrating a fourth example of a UI displayed by an information terminal during a process for establishing a communication connection. FIG. 14 is a diagram illustrating a fifth example of a UI displayed by an information terminal during a process for establishing a communication connection. FIG. 15 is a diagram showing a sixth example of a UI displayed by an information terminal during processing to establish a communication connection. FIG. 16 is a diagram showing a seventh example of a UI displayed by an information terminal during processing to establish a communication connection. FIG. 17 is a diagram showing an eighth example of a UI displayed by an information terminal during processing to establish a communication connection. FIG. 18 is a flowchart showing an example of processing to establish a communication connection executed by a home appliance. FIG. 19 is a flowchart showing an example of processing to establish a communication connection executed by a home appliance. FIG. 20 is a sequence diagram showing a specific example of registration processing in a system according to an embodiment. FIG. 21 is a sequence diagram showing a specific example of registration processing in a system according to an embodiment. FIG. 22 is a sequence diagram showing a specific example of registration processing in a system according to an embodiment. FIG. 23 is a sequence diagram showing a specific example of registration processing in a system according to an embodiment.

[0011] A system according to a first aspect of the present disclosure is a system in which a camera device having a communication function communicates with a server that can be connected to an information terminal via a network, wherein the information terminal has a terminal acquisition unit that receives an authentication key from the server, a generation unit that generates an optical read code that represents the authentication key, a display unit that displays the generated read code, a terminal memory unit that stores user information for identifying a user, and a terminal transmission unit that transmits the user information to the server, and the camera device has a decoding unit that decodes the authentication key represented by the read code based on an image obtained by capturing the read code displayed on the information terminal with an image sensor possessed by the camera device, a camera memory unit that stores camera information for identifying the camera device, and a camera communication unit that transmits the authentication key and the camera information stored in the camera memory unit to the server, and the server stores the user information transmitted by the information terminal and the camera information transmitted by the camera device together with the authentication key in association with each other.

[0012] According to this system, the information terminal displays a read code representing an authentication key acquired from the server, has the camera device read the read code, and the camera device decodes the read code to transmit the acquired camera information to the server along with the authentication key. This allows the camera information of the camera device that the user was attempting to register to the server using the information terminal to be transmitted to the server. In other words, since the read code to be read by the camera device cannot be obtained unless the user accesses the server using the information terminal, it is possible to prevent the camera device from transmitting the camera information of the camera device by reading a counterfeit read code. In this way, the server can acquire legitimate camera information from the camera device, and therefore can store the user information and the legitimate camera information in association with each other.

[0013] A system according to a second aspect of the present disclosure is a system according to the first aspect, wherein if the authentication key received from the camera device together with the camera information is an authentication key that has already been transmitted, the server determines that the camera information is legitimate, and stores the received user information in association with the camera information that has been determined to be legitimate.

[0014] This allows the server to associate the user information with the camera information that is determined to be valid.

[0015] A system according to a third aspect of the present disclosure is a system according to the first or second aspect, wherein when the server receives the camera information from the camera device, it transmits the received camera information to the information terminal, and when the terminal transmission unit transmits the user information to the server, it transmits the camera information received from the server together with the user information to the server, and when the camera information received from the information terminal together with the user information is camera information that has already been transmitted, the server determines that the user information is legitimate and stores the user information determined to be legitimate in association with the camera information.

[0016] This allows the server to associate user information that is determined to be authentic with camera information that is determined to be authentic.

[0017] A system according to a fourth aspect of the present disclosure is a system according to any one of the first to third aspects, wherein the terminal acquisition unit further acquires connection information for connecting to the network, the generation unit generates the reading code in which the authentication key and the connection information are expressed, the decoding unit decodes the authentication key and the connection information expressed in the reading code, and the camera communication unit establishes communication with the network using the connection information, and after establishing communication, transmits the authentication key and the camera information to the server.

[0018] This allows the camera device to easily establish communication with the network.

[0019] A system according to a fifth aspect of the present disclosure is a system according to the fourth aspect, wherein the terminal acquisition unit acquires the connection information via the network from a home appliance that stores the connection information and is communicatively connected to the network using the connection information.

[0020] This allows the camera device to establish communication with the network using connection information stored in a home appliance that is already connected to the network, making it easy to establish communication with the network.

[0021] A system according to a sixth aspect of the present disclosure is a system according to the fourth aspect, wherein the terminal memory unit stores the connection information used when setting up a communication connection of a home appliance that is communicatively connected to the network using the connection information, and the terminal acquisition unit acquires the connection information from the terminal memory unit.

[0022] According to this, the camera device establishes communication with the network using the connection information used when setting up the communication connection of the home appliance, and therefore communication with the network can be easily established.

[0023] A system according to a seventh aspect of the present disclosure is a system according to the fourth aspect, wherein the information terminal further has a reception unit that receives input from a user, and the terminal acquisition unit acquires the connection information generated based on the input received by the reception unit.

[0024] According to this, the camera device establishes communication with the network using connection information generated based on input from the user, allowing the user to have the camera device establish communication using the desired connection information.

[0025] A system according to an eighth aspect of the present disclosure is a system according to any one of the first to seventh aspects, wherein the authentication key is invalidated after a first period has elapsed since it was sent by the server.

[0026] This makes it possible to prevent a third party from misusing the authentication key and storing camera information and user information in association with each other in the server.

[0027] A system according to a ninth aspect of the present disclosure is a system according to any one of the first to eighth aspects, wherein the reading code is invalidated after a second period has elapsed since it was generated by the generation unit.

[0028] This makes it possible to prevent a third party from misusing the reading code and storing camera information and user information in association with each other in the server.

[0029] An information terminal according to a tenth aspect of the present disclosure is an information terminal in which a camera device having a communication function is communicatively connected to a server with which communication can be established via a network, and includes a terminal acquisition unit that acquires from the server an authentication key for causing the server to authenticate received information as legitimate, a generation unit that generates an optical reading code that expresses the authentication key, a display unit that displays the reading code generated by the generation unit so that it can be read by the camera device, a terminal memory unit that stores user information for identifying a user, and a terminal transmission unit that transmits the user information to the server.

[0030] According to this, by displaying a read code representing an authentication key acquired by an information terminal from a server and having a camera device read the read code, it is possible to use, for example, for the camera device to transmit camera information to the server together with the authentication key acquired by decoding the read code. Since the read code to be read by the camera device cannot be obtained unless the server is accessed using an information terminal, it is possible to prevent the camera device from transmitting camera information by having the camera device read a disguised read code.

[0031] A communication setting method according to an eleventh aspect of the present disclosure is a communication setting method for a camera device having a communication function to communicate with a server that can be connected to an information terminal via a network, wherein the information terminal acquires an authentication key from the server, the information terminal generates an optical read code that represents the authentication key, the information terminal displays the generated read code, the information terminal transmits user information for identifying the user to the server, the camera device photographs the read code displayed on the information terminal, the camera device decodes the authentication key represented by the read code based on an image obtained by photographing, the camera device transmits the authentication key and camera information for identifying the camera device to the server, and the server stores the user information transmitted by the information terminal and the camera information transmitted by the camera device together with the authentication key in association with each other.

[0032] According to this system, the information terminal displays a read code representing an authentication key acquired from the server and has the camera device read the read code, and the camera device transmits the camera information to the server along with the authentication key acquired by decrypting the read code. This allows the camera information of the camera device that the user was attempting to register to the server using the information terminal to be transmitted to the server. In other words, since the read code to be read by the camera device cannot be obtained unless the user accesses the server using the information terminal, it is possible to prevent the camera device from transmitting the camera information of the camera device by reading a counterfeit read code. In this way, the server can acquire legitimate camera information from the camera device, and therefore can store the user information and the legitimate camera information in association with each other.

[0033] These general or specific aspects may be realized by a device, an integrated circuit, a computer program, or a non-transitory recording medium such as a computer-readable CD-ROM, or may be realized by any combination of a device, a method, a system, an integrated circuit, a computer program, and a non-transitory recording medium.

[0034] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. However, more detailed explanation than necessary may be omitted. For example, detailed explanation of well-known matters or redundant explanation of substantially the same configuration may be omitted. This is to avoid unnecessary redundancy in the following explanation and to facilitate understanding by those skilled in the art.

[0035] The inventors have provided the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and do not intend for them to limit the subject matter described in the claims.

[0036] (Embodiment) [1. Configuration] FIG. 1 is a diagram for explaining an overview of a system according to an embodiment.

[0037] Specifically, FIG. 1 illustrates an information terminal 10, a server 20, a server 30, a camera device 40, a home appliance 50, a network 60, and a router 61. For example, the system 1 includes the information terminal 10, the server 20, and the camera device 40 among these components. The system 1 may further include the server 30 and the home appliance 50. Note that the above components of the system 1 do not necessarily need to be hardware. The system 1 may be realized by executing necessary software among the software stored in the information terminal 10, the software stored in the server 20, the software stored in the camera device 40, and the software stored in the home appliance 50 by one or more processors included in at least one of the information terminal 10, the server 20, the camera device 40, and the home appliance 50 corresponding to the necessary software. The information terminal 10, the server 20, the server 30, the camera device 40, and the home appliance 50 are communicatively connected to each other via the network 60. The router 61 is a device that mediates communication between the camera device 40 or the home appliance 50 and the network 60. The router 61 may act as an intermediary for the information terminal 10 to connect to the network 60 for communication.

[0038] System 1 is a system for storing camera information for identifying camera device 40 and user information for identifying a user in association with each other in servers 20 and 30. System 1 may also store device information for identifying home appliance 50 and user information in association with each other in servers 20 and 30.

[0039] FIG. 2 is a diagram illustrating an example of a configuration of a system according to an embodiment.

[0040] The system 1 includes an information terminal 10, a server 20, a server 30, a camera device 40, and a home appliance 50. In Fig. 2, the router 61 is not shown.

[0041] The information terminal 10 includes a terminal acquisition unit 11, a terminal transmission unit 12, a generation unit 13, a terminal storage unit 14, a display unit 15, and a reception unit 16. The information terminal 10 is realized, for example, by a smartphone, a tablet terminal, or the like.

[0042] The terminal acquisition unit 11 receives information from at least one of the server 20, the server 30, the camera device 40, and the home appliance 50 via the network 60. Specifically, the terminal acquisition unit 11 receives an authentication key from the server 20. The terminal acquisition unit 11 may acquire connection information for connecting to the network 60.

[0043] The terminal transmission unit 12 transmits information to at least one of the server 20, the server 30, the camera device 40, and the home appliance 50 via the network 60. Specifically, the terminal transmission unit 12 may transmit user information to the server 20. Furthermore, when transmitting the user information to the server 20, the terminal transmission unit 12 may transmit the camera information received from the server 20 to the server 20 together with the user information.

[0044] The generation unit 13 generates an optical read code. Specifically, the optical read code may be a two-dimensional code such as a QR (Quick Response) code (registered trademark), a barcode, or a specific image. The read code represents an authentication key. The read code may also represent an authentication key and connection information. That is, the generation unit 13 may generate a read code representing an authentication key, or may generate a read code representing an authentication key and connection information. The read code may be invalidated when a second period has elapsed since it was generated by the generation unit 13. The second period is, for example, three minutes. The second period is not limited to three minutes, but may be one minute, five minutes, or another period.

[0045] Here, the authentication key is issued by the server 20 and is used to determine that the user information and camera information newly managed by the server 20 are correct. As described above, the connection information is information for connecting to the network 60. Specifically, the connection information is information for establishing a communication connection with the router 61, and includes the SSID of the router 61 and the corresponding password.

[0046] The terminal storage unit 14 stores user information for identifying a user. The user information may be information generated in the information terminal 10 based on an input by the user accepted by the accepting unit 16 (described later). The terminal storage unit 14 also stores a program for realizing the functions of the information terminal 10. The terminal storage unit 14 is, for example, a non-volatile memory.

[0047] The display unit 15 displays an image or a UI (User Interface) generated in the information terminal 10. Specifically, the display unit 15 displays the read code generated by the generation unit 13. The display unit 15 is, for example, a display.

[0048] The reception unit 16 receives input from the user. Specifically, the reception unit 16 receives input to the UI displayed on the display unit 15. The reception unit 16 is, for example, a touch panel. Note that the reception unit 16 is not limited to a touch panel and may be other input devices such as a keyboard or a mouse.

[0049] The server 20 includes a communication unit 21 , a storage unit 22 , and a control unit 23 .

[0050] The communication unit 21 exchanges information with at least one of the information terminal 10, the server 30, the camera device 40, and the home appliance 50 via the network 60. Specifically, the communication unit 21 receives a request for an authentication key from the information terminal 10. The communication unit 21 also transmits an authentication key to the information terminal 10. The communication unit 21 also receives the authentication key and camera information from the camera device 40. The communication unit 21 also transmits the camera information to the information terminal 10. The communication unit 21 also receives user information from the information terminal 10. The communication unit 21 also transmits a set of user information and camera information that are associated with each other to the server 30.

[0051] The communication unit 21 may be realized by, for example, a communication IF connected to a wired LAN, a communication IF connected to a wireless LAN, or a communication IF (Interface) connected to a mobile phone communication network.

[0052] The storage unit 22 stores the user information transmitted by the information terminal 10 and the camera information transmitted by the camera device 40 together with the authentication key, in association with each other. The storage unit 22 also stores a program for implementing the functions of the server 20. The storage unit 22 is implemented by a non-volatile storage device such as an SSD or an HDD (Hard Disk Drive), for example.

[0053] When the communication unit 21 receives a request for an authentication key, the control unit 23 generates an authentication key. The control unit 23 determines whether the authentication key received from the camera device 40 together with the camera information is a previously transmitted authentication key (i.e., an authentication key already transmitted by the server 20). If the authentication key received from the camera device 40 together with the camera information is a previously transmitted authentication key, the control unit 23 determines that the camera information is valid and associates the received user information with the camera information determined to be valid and stores them in the storage unit 22. On the other hand, if the authentication key received from the camera device 40 together with the camera information is not a previously transmitted authentication key, the control unit 23 may determine that the camera information is invalid and not store the camera information determined to be invalid in the storage unit 22. In other words, the control unit 23 may discard the camera information determined to be invalid. Note that, if the control unit 23 determines that the camera information is invalid, the control unit 23 may store the camera information in the storage unit 22 together with information indicating that the camera information is invalid.

[0054] The authentication key may be invalidated after a first period has elapsed since it was transmitted from the server 20 to the information terminal 10. For example, the control unit 23 may determine that camera information received together with an invalid authentication key is invalid. In other words, the control unit 23 determines that camera information received together with a valid authentication key is valid. The first period is, for example, three minutes. The first period is not limited to three minutes, but may be one minute, five minutes, or another period. The first period may be defined as a different time from the second period, or may be defined as the same time.

[0055] Furthermore, when the communication unit 21 receives camera information from the camera device 40, the control unit 23 may transmit the received camera information to the information terminal 10 via the communication unit 21. Then, the control unit 23 determines whether the camera information received from the information terminal 10 together with the user information is already-transmitted camera information. If the camera information received from the information terminal 10 together with the user information is already-transmitted camera information, the control unit 23 determines that the user information is legitimate and associates the user information determined to be legitimate with the camera information and stores them in the storage unit 22. On the other hand, if the camera information received from the information terminal 10 together with the user information is not already-transmitted camera information, the control unit 23 may determine that the user information is invalid and not store the user information determined to be invalid in the storage unit 22. In other words, the control unit 23 may discard the user information determined to be invalid. Note that, if the control unit 23 determines that the user information is invalid, the control unit 23 may store the user information in the storage unit 22 together with information indicating that the user information is invalid.

[0056] The server 30 includes a communication unit 31 , a storage unit 32 , and a control unit 33 .

[0057] The communication unit 31 exchanges information with at least one of the information terminal 10, the server 20, the camera device 40, and the home appliance 50 via the network 60. Specifically, the communication unit 31 receives camera information from the camera device 40. The communication unit 31 also receives a set of user information and camera information associated with each other from the server 20. The communication unit 31 may be realized, for example, by a communication IF connected to a wired LAN or a communication IF connected to a wireless LAN. The communication unit 31 may also be realized by a communication IF (Interface) connected to a mobile phone communication network.

[0058] The storage unit 32 stores a set of user information and camera information received from the server 20. The storage unit 32 also stores a program for implementing the functions of the server 30. The storage unit 32 is implemented by a non-volatile storage device such as an SSD or an HDD (Hard Disk Drive).

[0059] The control unit 33 realizes the functions of the server 30 .

[0060] Camera device 40 includes an image sensor 41, a decoding unit 42, a camera storage unit 43, and a camera communication unit 44. Camera device 40 is attached, for example, to the top of the door of home appliance 50 (e.g., a refrigerator). When home appliance 50 is a refrigerator, camera device 40 is a device that photographs ingredients being put in and taken out of the refrigerator, or ingredients stored in the refrigerator. Camera device 40 may be built into the refrigerator from the beginning, or may be externally attached to the refrigerator later. By analyzing the images captured by camera device 40, ingredients stored in the refrigerator can be recognized.

[0061] The image sensor 41 detects an image formed on the surface of the image sensor 41 via an optical system such as a lens (not shown), and generates an image representing the detected image.

[0062] The decoding unit 42 decodes the authentication key represented by the read code based on an image (i.e., an image including the read code) obtained by photographing the read code displayed on the information terminal 10 with the image sensor 41. When the read code represents the authentication key and connection information, the decoding unit 42 decodes the authentication key and connection information.

[0063] The camera storage unit 43 stores camera information for identifying the camera device 40. The camera storage unit 43 also stores a program for realizing the functions of the camera device 40.

[0064] Camera communication unit 44 exchanges information with at least one of information terminal 10, server 20, server 30, and home appliance 50 via network 60. Specifically, camera communication unit 44 transmits an authentication key and camera information stored in camera storage unit 43 to server 20. Camera communication unit 44 may also establish communication with network 60 using connection information decrypted by decryption unit 42, and transmit the authentication key and camera information to server 20 after establishing communication.

[0065] The home appliance 50 is a device that can communicate with at least one of the information terminal 10, the server 20, the server 30, and the camera device 40 via the network 60. The home appliance 50 is, for example, a refrigerator. Note that the home appliance 50 is not limited to a refrigerator and may be other home appliances such as a microwave oven, a toaster oven, or a washing machine.

[0066] [2. Operation] Next, the operation of the system 1 will be described.

[0067] FIG. 3 is a sequence diagram illustrating an example of a registration process in the system according to the embodiment.

[0068] When a predetermined application is executed, the information terminal 10 receives a predetermined input from the user and transmits a request for an authentication key to the server 20 (S1).

[0069] When the server 20 receives the request for the authentication key from the information terminal 10, it generates the authentication key (S2).

[0070] Next, the server 20 transmits the generated authentication key to the information terminal 10 that transmitted the request for the authentication key (S3).

[0071] When the information terminal 10 receives the authentication key from the server 20, it reads connection information for establishing communication with the router 61 from the terminal memory unit 14 and generates a read code that represents the received authentication key and the read connection information (S4).

[0072] Next, the information terminal 10 displays the generated reading code on the display unit 15 (S5). The information terminal 10 may display, for example, a UI 100 as shown in FIG.

[0073] FIG. 4 is a diagram showing a first example of a UI displayed on the display unit of the information terminal.

[0074] The UI 100 includes a message 101 that prompts the user to hold the reading code over the camera device 40 so that the code is photographed by the camera device 40, a reading code 102 that is a two-dimensional code, and a next button 103. The next button 103 is a button that accepts an input for transitioning to the next UI after the user holds the reading code 102 over the camera device 40, for example.

[0075] In this way, when the user holds the information terminal 10 on which the read code 102 is displayed over the camera device 40, the camera device 40 photographs the read code 102 (S6).

[0076] Next, the camera device 40 decodes the authentication key and connection information expressed in the reading code 102 based on the image obtained by photographing (S7).

[0077] Next, the camera device 40 uses the connection information obtained by the decryption to establish a communication connection to the router 61 (S8). As a result, the camera device 40 becomes able to communicate with the network 60 via the router 61.

[0078] Next, the camera device 40 reads out camera information for identifying the camera device 40 from the camera storage unit 43, and transmits the read camera information to the server 30 (S9).

[0079] Furthermore, the camera device 40 transmits the read camera information and the authentication key obtained by decryption to the server 20 (S10).

[0080] When the server 20 receives the camera information and the authentication key from the camera device 40, it verifies the validity of the camera information (S11). Specifically, if the authentication key received from the camera device 40 along with the camera information is an authentication key that has already been transmitted and the first period has not yet elapsed since transmission, the server 20 determines that the camera information received together with the authentication key is valid. On the other hand, if this is not the case, the server 20 determines that the camera information received together with the authentication key is invalid. If the server 20 determines that the camera information is valid, it executes the next step S12. If the server 20 determines that the camera information is invalid, it discards the camera information and terminates the process, for example.

[0081] The server 20 transmits the camera information that has been determined to be valid to the information terminal 10 (S12).

[0082] When the information terminal 10 receives the camera information from the server 20, it transmits the user information stored in the terminal storage unit 14 and the received camera information to the server 20 (S13).

[0083] When the server 20 receives the user information and camera information, it verifies the validity of the received user information (S14). Specifically, if the camera information received from the information terminal 10 together with the user information is camera information that has already been transmitted, the server 20 determines that the user information is valid. On the other hand, if this is not the case, the server 20 determines that the user information received together with the camera information is invalid. If the server 20 determines that the user information is valid, it executes the next step S15, and if it determines that the user information is invalid, it discards the user information and ends the process, for example.

[0084] Since the authenticity of both the user information and the camera information has been verified in steps S11 and S14, the server 20 stores the user information and the camera information in association with each other in the storage unit 22 (S15).

[0085] Next, the server 20 transmits the set of associated user information and camera information to the server 30 (S16).

[0086] When the server 30 receives the set of user information and camera information, it verifies the validity of the set (S17). Specifically, the server 30 determines whether the camera information received in step S9 matches the camera information included in the set received in step S16. If the camera information matches, the server 30 determines that the set is valid. On the other hand, if not, the server 30 determines that the set is invalid. If the server 30 determines that the set is valid, it executes the next step S18. If the server 30 determines that the set is invalid, it discards the set and terminates the process, for example.

[0087] Since the authenticity of the set of user information and camera information has been verified in step S17, the server 30 stores the set in the storage unit 32 (S18).

[0088] Here, when the reading code is generated in step S4, the information terminal 10 may determine the connection information included in the information represented by the reading code in the following manner.

[0089] A first example will be described. In the first example, the information terminal 10 may acquire, from the home appliance 50, connection information that the home appliance 50 uses to connect to the network 60, and use the connection information acquired from the home appliance 50 to generate a read code. That is, in this case, the read code generated by the information terminal 10 represents the connection information acquired from the home appliance 50 and an authentication key.

[0090] A second example will be described. The terminal storage unit 14 of the information terminal 10 may store connection information used when setting up the communication connection of the home appliance 50. Therefore, in the second example, the information terminal 10 may use the connection information used when setting up the home appliance 50 to connect to the network 60, which is stored in the terminal storage unit 14, to generate the read code. In other words, in this case, the read code generated by the information terminal 10 represents the connection information used when setting up the home appliance 50 to connect to the network 60, which is stored in the terminal storage unit 14, and an authentication key.

[0091] A third example will be described. In this case, the information terminal 10 may use connection information generated based on the input received by the reception unit 16 of the information terminal 10 to generate the reading code. That is, in this case, the reading code generated by the information terminal 10 represents the connection information generated based on the input received by the reception unit 16 and the authentication key.

[0092] 5 is a diagram showing an example of a UI that presents connection information and is displayed on the information terminal 10. The UI 110 may be displayed on the information terminal 10 after step S3.

[0093] UI 110 includes connection information acquired from home appliance 50 or an SSID included in connection information used when setting up a communication connection for home appliance 50. UI 110 also includes an OK button 111 that accepts input for permitting establishment of a communication connection using the presented SSID, and a designation button 112 that accepts input for transitioning to UI 120 (see FIG. 6 ) that accepts connection information designated by the user. Upon accepting input to OK button 111, information terminal 10 uses the connection information including the presented SSID to generate a reading code. Upon accepting input to designation button 112, information terminal 10 displays UI 120.

[0094] FIG. 6 is a diagram showing an example of a UI for receiving connection information input from a user.

[0095] The UI 120 includes an input box 121 for accepting input of an SSID, an input box 122 for accepting a password for authenticating a communication connection using the SSID, an OK button 123 for confirming the information entered in the input boxes 121 and 122, and a back button 124 for transitioning to the UI 110. When the information terminal 10 accepts input to the OK button 123 after input has been made to the input boxes 121 and 122, it generates connection information based on the input to the input boxes 121 and 122 and uses the generated connection information to generate a reading code. When the information terminal 10 accepts input to the back button 124, it displays the UI 110.

[0096] Next, a description will be given of a process for establishing a communication connection between the home appliance 50 and the router 61. The user connects the home appliance 50 to the router 61 in accordance with a UI provided by a predetermined application.

[0097] 7 to 9 are flowcharts showing an example of a process for establishing a communication connection executed by an information terminal, and FIGS. 10 to 17 are diagrams showing an example of a UI displayed by the information terminal during the process for establishing a communication connection.

[0098] The information terminal 10 displays a UI showing how to operate the home appliance 50 (S31). Here, the display unit 15 of the information terminal 10 displays the UI 200 shown in FIG. 10. The UI 200 allows the user to understand that the remote control button of the home appliance 50 needs to be pressed for three seconds or more. When the remote control button is pressed for three seconds or more, the home appliance 50 transitions from the normal operation mode to the communication connection mode. The normal operation mode and the communication connection mode will be described later.

[0099] Next, the information terminal 10 determines whether or not to display the next UI (S32). When the user touches the button 201 of the UI 200, the information terminal 10 determines that the next UI will be displayed (Yes in S32), and the process proceeds to step S33. On the other hand, the information terminal 10 determines that the next UI will not be displayed until the user touches the button 201 (No in S32), so it does nothing (i.e., maintains the display of the UI 200) and returns to step S32.

[0100] Next, the information terminal 10 displays a UI for the user to select a connection method for connecting the home appliance 50 to the router 61 functioning as an access point (S33). Here, the display unit 15 of the information terminal 10 displays the UI 210 shown in Fig. 11. The UI 210 allows the user to select either a simple connection or a detailed connection as a connection method for connecting the home appliance 50 to the router 61.

[0101] Next, the information terminal 10 determines whether the connection method selected by the user is a simple connection or a detailed connection (S34). When the user touches button 211 on the UI 210, the information terminal 10 determines that the connection method selected by the user is a simple connection, and the process proceeds to step S35. On the other hand, when the user touches button 212 on the UI 210, the information terminal 10 determines that the connection method selected by the user is a detailed connection, and the process proceeds to step S41 in FIG. 8.

[0102] A simple connection will now be described. A simple connection is a method for easily establishing a communication connection between the home appliance 50 and the router 61 by having the home appliance 50 and the router 61 simultaneously execute a connection process. The information terminal 10 displays a UI indicating the operation method for the home appliance 50 and the access point required for the simple connection (S35). Here, the display unit 15 of the information terminal 10 displays the UI 220 shown in FIG. 12. The UI 220 allows the user to understand the operations required for the simple connection. When the refrigeration button on the operation panel of the home appliance 50 in the communication connection mode is pressed, the home appliance 50 executes a connection process. Furthermore, the router 61 also executes a connection process at the same time as the connection process of the home appliance 50, thereby establishing a communication connection between the home appliance 50 and the router 61. The connection process executed by the home appliance 50 will be described later.

[0103] Next, the information terminal 10 determines whether or not to display the next UI (S36). When the user touches the button 221 of the UI 220, the information terminal 10 determines that the next UI will be displayed (Yes in S36), and the process proceeds to step S37. On the other hand, the information terminal 10 determines that the next UI will not be displayed until the user touches the button 221 (No in S36), so it does nothing (i.e., maintains the display of the UI 220) and returns to step S36.

[0104] Next, in step S37, information terminal 10 displays a UI that prompts the user to confirm that home appliance 50 has connected to the access point. Here, display unit 15 of information terminal 10 displays UI 230 shown in Fig. 13. UI 230 allows the user to confirm whether home appliance 50 has connected to the access point.

[0105] Next, detailed connection will be described. Detailed connection is a method of establishing a communication connection between the home appliance 50 and the router 61 by transmitting the SSID of the router 61 and a password required to connect to the router 61 from the information terminal 10 to the home appliance 50.

[0106] The information terminal 10 displays a UI showing how to operate the home appliance 50 (S41). Here, the display unit 15 of the information terminal 10 displays the UI 240 shown in Fig. 14. The UI 240 allows the user to understand that it is necessary to press a partial button on the home appliance 50. When the partial button on the operation panel of the home appliance 50 in the communication connection mode is pressed, the home appliance 50 starts operating in the soft AP mode.

[0107] Next, the information terminal 10 determines whether or not to display the next UI (S42). When the user touches the button 241 of the UI 240, the information terminal 10 determines that the next UI will be displayed (Yes in S42), and the process proceeds to step S43. On the other hand, the information terminal 10 determines that the next UI will not be displayed until the user touches the button 241 (No in S42), so it does nothing (i.e., maintains the display of the UI 240) and returns to step S42.

[0108] Next, the information terminal 10 determines whether the information terminal 10 is currently connected to an access point (S43). This determination is made by acquiring the SSID of the access point to which the information terminal 10 is connected from the OS of the information terminal 10. If the SSID of the access point to which the information terminal 10 is currently connected can be acquired from the OS, the information terminal 10 determines that the information terminal 10 is currently connected to the access point (Yes in S43), and the process proceeds to step S44. On the other hand, if the SSID of the access point to which the information terminal 10 is currently connected cannot be acquired from the OS, the information terminal 10 determines that the information terminal 10 is not currently connected to an access point (No in S43), and the process proceeds to step S48.

[0109] Next, the information terminal 10 stores the SSID of the access point to which the information terminal 10 is connected (S44). If the access point to which the information terminal 10 is connected is the router 61, the information terminal 10 stores the SSID of the router 61. By the processes of steps S43 and S44, the information terminal 10 can obtain the SSID of the access point to which the information terminal 10 is connected from the OS.

[0110] Next, the information terminal 10 connects to the home appliance 50 operating in the soft AP mode (S45). The information terminal 10 transmits a connection request to the home appliance 50 operating in the soft AP mode. In this embodiment, since the home appliance 50 is operating in the soft AP mode as described in step S41, the information terminal 10 transmits the connection request to the home appliance 50. Then, a communication connection is established between the information terminal 10 and the home appliance 50.

[0111] In order for the information terminal 10 to connect to the home appliance 50 operating in Soft AP mode, the information terminal 10 needs to identify the SSID of the home appliance 50 and the password required for connection. In this embodiment, the SSID and password of the home appliance 50 are determined in advance when the home appliance 50 is manufactured, and these SSID and password are pre-installed in the application program. As a result, the information terminal 10 can identify the SSID of the home appliance 50 and the password required for connection when the information terminal 10 is installed. From the user's perspective, there is no need to specify the SSID of the home appliance 50 on the information terminal 10 or input the password required for connection into the information terminal 10, which improves user convenience. Note that, in an operation in which a password is not required when the information terminal 10 connects to the home appliance 50 operating in Soft AP mode, only the SSID of the home appliance 50 needs to be pre-installed in the application program.

[0112] Next, the information terminal 10 determines whether or not the connection to the home appliance 50 operating in the Soft AP mode has been successful (S46). If the information terminal 10 determines that the connection to the home appliance 50 operating in the Soft AP mode has been successful (Yes in S46), the process proceeds to step S51 in Fig. 9. On the other hand, if the information terminal 10 determines that the connection to the home appliance 50 operating in the Soft AP mode has failed (No in S46), the process proceeds to step S47.

[0113] Next, the information terminal 10 displays a UI for the user to input a password required to connect to the access point (S51). Here, the display unit 15 of the information terminal 10 displays the UI 270 shown in FIG. 17. The SSID stored in step S44 (in this embodiment, the SSID of the router 61) is displayed in an area 271 of the UI 270. The user inputs a password for connecting to the access point of the SSID displayed on the UI 270 into an input box 272. Note that the password for connecting to the access point is accepted from the user because the information terminal 10 cannot obtain the password from the OS.

[0114] Next, the information terminal 10 determines whether or not password entry is complete (S52). When the user enters a password in the input box 272 and touches the button 273, the information terminal 10 determines that password entry is complete (Yes in S52), and the process proceeds to step S53. On the other hand, the information terminal 10 determines that password entry is not complete until the user enters a password in the input box 272 and touches the button 273 (No in S52), so it does nothing (i.e., keeps the UI 270 displayed), and returns to step S52.

[0115] Next, the information terminal 10 transmits the SSID stored in step S44 and the password entered by the user to the home appliance 50 via the established communication connection (S53). The information terminal 10 instructs the OS to transmit the SSID stored in step S44 and the password entered by the user, and transmission from the information terminal 10 to the home appliance 50 is realized under the control of the OS. In this embodiment, the SSID of the router 61 and the password required to connect to the router 61 are transmitted to the home appliance 50. The home appliance 50 then attempts to connect to the router 61 based on the received SSID and password.

[0116] Next, the information terminal 10 displays a UI that prompts the user to confirm that the home appliance 50 has connected to the access point (S54). Here, the display unit 15 of the information terminal 10 is the UI 230. The UI 230 allows the user to confirm whether the home appliance 50 has connected to the access point.

[0117] Next, in step S55, the information terminal 10 determines whether or not to return the connection destination of the information terminal 10 to the original access point. When the user touches the button 231 on the UI 230, or when a predetermined time (e.g., five minutes) has elapsed while the UI 230 is displayed, the information terminal 10 determines that the connection destination of the information terminal 10 will be returned to the original access point (Yes in S55), and the process proceeds to step S56. On the other hand, the information terminal 10 determines that the connection destination of the information terminal 10 will not be returned to the original access point until the user touches the button 231 (No in S55), so it does nothing (i.e., maintains the display of the UI 230) and returns to step S55.

[0118] Next, in step S56, the information terminal 10 returns the connection destination of the information terminal 10 to the original access point. The information terminal 10 instructs the OS to connect to the access point of the SSID stored in step S44, and the connection destination of the information terminal 10 returns to the original access point under the control of the OS. In this embodiment, the connection destination of the information terminal 10 returns from the home appliance 50 to the router 61.

[0119] In this embodiment, the connection destination of information terminal 10 is changed from router 61 to home appliance 50 as the detailed connection procedure proceeds. If information terminal 10 remains connected to home appliance 50, there is a problem that the user cannot use information terminal 10 as usual. In this embodiment, the connection destination of information terminal 10 can be returned to router 61 by the process of step S56, thereby improving user convenience.

[0120] Returning to the flowchart of FIG. 8, the process performed when it is determined in step S46 that the connection to the home appliance 50 operating in the soft AP mode has failed will now be described.

[0121] The information terminal 10 returns the connection destination of the information terminal 10 to the original access point (S47). The information terminal 10 instructs the OS to connect to the access point with the SSID stored in step S44, and the connection destination of the information terminal 10 returns to the original access point under the control of the OS. The fact that the information terminal 10 cannot connect to the home appliance 50 operating in soft AP mode indicates that the detailed connection cannot be continued. Therefore, in this embodiment, the connection destination of the information terminal 10 is returned to the router 61 to which the information terminal 10 was originally connected, thereby improving user convenience.

[0122] Furthermore, in step S47, the information terminal 10 may display the UI 250 of Fig. 15. If the user who has checked the UI 250 performs a detailed connection again near the home appliance 50, there is a possibility that the information terminal 10 will be successfully connected to the home appliance 50 operating in the soft AP mode.

[0123] Next, a description will be given of the processing to be performed when it is determined in step S43 that the information terminal 10 is not currently connected to an access point. In step S48, the information terminal 10 displays a UI that prompts the user to connect the information terminal to an access point. Here, the display unit 15 of the information terminal 10 is the UI 260 in FIG. 16. To perform a detailed connection, the information terminal 10 must be connected to an access point. By checking the UI 260, the user can understand that the information terminal 10 needs to be connected to an access point.

[0124] 18 and 19 are flowcharts showing an example of a process for establishing a communication connection executed by a home electric appliance.

[0125] 10 , when the user presses the remote control button on the operation panel for three seconds or more, the home appliance 50 transitions from the normal operation mode to the communication connection mode (S61). The normal operation mode is a mode in which the home appliance 50 performs normal operations, such as cooling based on the temperatures of each storage compartment, such as the refrigerator compartment and the freezer compartment, and defrosting using a defrost heater. On the other hand, the communication connection mode is a mode in which the home appliance 50 connects to an access point via a simple connection or a detailed connection.

[0126] Next, the home appliance 50 determines whether the connection method with the access point is a simple connection or a detailed connection (S62). When the user, having checked the UI 220 shown in Fig. 12, presses the refrigeration button on the operation panel, the home appliance 50 determines that a simple connection will be performed, and the process proceeds to step S63. On the other hand, when the user, having checked the UI 240 shown in Fig. 14, presses the partial button on the operation panel, the home appliance 50 determines that a detailed connection will be performed, and the process proceeds to step S68.

[0127] The functions of each button on the operation panel of the home appliance 50 are applied when the home appliance 50 is operating in the normal operation mode, but are not applied when the home appliance 50 is operating in the communication connection mode. For example, the Refrigeration button is used as a button for adjusting the temperature of the refrigerator compartment in the normal operation mode, but is not used as a button for adjusting the temperature of the refrigerator compartment in the communication connection mode. In the communication connection mode, the Refrigeration button is used as a button for the user to input into the home appliance 50 an instruction to connect the home appliance 50 to an access point. Similarly to the Refrigeration button, the Partial button is also used as a button for the user to input into the home appliance 50 an instruction to connect the home appliance 50 to an access point in the communication connection mode. By using a button used in the normal operation mode, such as a button for adjusting the temperature of a storage compartment like the Refrigeration button, in the communication connection mode, there is no need to add a new button for the communication connection mode. Furthermore, even if a new button is added for operation in the communication connection mode, the number of added buttons can be reduced. In addition, instead of a button for adjusting the temperature of the storage compartment such as a refrigeration button, a button related to the ice-making function such as a quick-freeze button may be used as a button for the user to input instructions to connect home appliance 50 to the access point.

[0128] Next, a description will be given of simple connection. The home appliance 50 executes a connection process for simple connection (S63). The home appliance 50 executes search processes according to the WPS, AOSS, and Easy Start (Easy Wireless Start) methods in a time-sharing manner or in parallel. When the home appliance 50 discovers an access point operating in any of the WPS, AOSS, and Easy Start methods at the same time, it establishes a communication connection with the discovered access point.

[0129] Next, the home appliance 50 determines whether or not the connection to the access point has been successful (S64). When a communication connection with the access point is established by the connection process of step S63, the home appliance 50 determines that the connection to the access point has been successful (Yes in S64), and the process proceeds to step S65. On the other hand, if a communication connection with the access point has not been established even after a predetermined time (e.g., two minutes) has elapsed since the start of the connection process of step S63, the home appliance 50 determines that the connection to the access point has failed (No in S64), and the process proceeds to step S67.

[0130] Next, the home appliance 50 notifies the user that it has connected to the access point (S65). The home appliance 50 notifies the user that it has connected to the access point by lighting an LED (lighting device) provided on the door of the refrigerator compartment of the home appliance 50 in a predetermined color (e.g., blue). Note that the method of notifying the user that it has connected to the access point is not limited to lighting an LED or other lighting device, and the home appliance 50 may output a voice message notifying the user that it has connected to the access point. Furthermore, the home appliance 50 may instruct a predetermined smart speaker to output a voice message notifying the user that it has connected to the access point, and the smart speaker may output the voice message.

[0131] Next, the home appliance 50 determines whether to return from the communication connection mode to the normal operation mode (S66). When a predetermined time (e.g., one minute) has elapsed since executing the process of step S65, the home appliance 50 determines that it will return from the communication connection mode to the normal operation mode (Yes in S66), and the process proceeds to step S67. On the other hand, the home appliance 50 determines that it will not return from the communication connection mode to the normal operation mode until the predetermined time has elapsed since executing the process of step S65 (No in S66), so it maintains the notification to the user and returns to step S66.

[0132] Next, the home appliance 50 returns from the communication connection mode to the normal operation mode (S67). Note that even if it is determined in step S64 that the connection to the access point has failed, the process proceeds to step S67, and the home appliance 50 returns from the communication connection mode to the normal operation mode.

[0133] Next, detailed connection will be described. The home appliance 50 starts operation in Soft AP mode (S68). The SSID of the home appliance 50 operating in Soft AP mode and the password for an external device to connect to the home appliance 50 operating in Soft AP mode are predetermined when the home appliance 50 is manufactured. Furthermore, these SSID and password match those pre-installed in the application program. Note that operation is also possible in which a password is not required when an external device connects to the home appliance 50 operating in Soft AP mode. In this operation, it is sufficient to pre-install only the SSID of the home appliance 50 in the application program.

[0134] Next, the home appliance 50 determines whether a connection request for the home appliance 50 operating in Soft AP mode has been received from an external device (S71). In the present embodiment, the information terminal 10 transmits a connection request to the home appliance 50 operating in Soft AP mode (see step S45 in FIG. 8). When the home appliance 50 receives the connection request (Yes in S71), the process proceeds to step S72. On the other hand, when a connection request for the home appliance 50 operating in Soft AP mode has not been issued within a predetermined time (e.g., two minutes) since the start of operation in Soft AP mode (No in S71), the process proceeds to step S78.

[0135] Next, the home appliance 50 establishes a communication connection with the external device that has sent the connection request (S72). In the present embodiment, a communication connection is established between the home appliance 50 and the information terminal 10.

[0136] Next, the home appliance 50 determines whether or not it has received the SSID of the access point and the password for connecting to the access point from the external device connected to the home appliance 50 (S73). In the present embodiment, the information terminal 10 transmits the SSID of the router 61 and the password for connecting to the router 61 to the home appliance 50 (see step S53 in FIG. 9 ). When the home appliance 50 receives the SSID of the access point and the password for connecting to the access point from the external device (Yes in S73), the process proceeds to step S74. On the other hand, when the home appliance 50 has not received the SSID of the access point and the password for connecting to the access point within a predetermined time (e.g., two minutes) since the communication connection between the home appliance 50 and the external device was established (No in S73), the process proceeds to step S78.

[0137] Next, the home appliance 50 connects to the access point based on the SSID and password received from the external device (S74). In this embodiment, the home appliance 50 establishes a communication connection with the access point.

[0138] Next, the home appliance 50 determines whether or not the connection to the access point has been successful (S75). If the home appliance 50 determines that the connection to the access point has been successful (Yes in S75), the process proceeds to step S76. On the other hand, if the home appliance 50 determines that the connection to the access point has failed (No in S75), the process proceeds to step S78.

[0139] Next, the home appliance 50 notifies the user that it has connected to the access point (S76). The processing of step S76 is the same as the processing described in step S65 of Fig. 18 . Note that step S76 differs from step S65 in that the home appliance 50 has established a communication connection not only with the router 61 but also with the information terminal 10. Therefore, the home appliance 50 may notify the information terminal 10 that it has connected to the access point, and the information terminal 10, having received the notification, may display on the display unit 15 that the home appliance 50 has connected to the access point.

[0140] Next, the home appliance 50 determines whether to return from the communication connection mode to the normal operation mode (S77). If a predetermined time (e.g., one minute) has elapsed since the execution of the process of step S76, or if the communication connection between the home appliance 50 and the information terminal 10 has been disconnected, the home appliance 50 determines that it will return from the communication connection mode to the normal operation mode (Yes in S77), and the process proceeds to step S78. On the other hand, the home appliance 50 determines that it will not return from the communication connection mode to the normal operation mode until the predetermined time has elapsed since the execution of the process of step S76 (No in S77), and therefore maintains the notification to the user and returns to step S77.

[0141] Next, the home appliance 50 returns from the communication connection mode to the normal operation mode (S78). Also, in step S78, the home appliance 50 ends operation in the soft AP mode. Note that, if it is determined in step S71 that a connection request has not been received from the external device, the process also proceeds to step S78, and the home appliance 50 returns from the communication connection mode to the normal operation mode. Also, if it is determined in step S73 that an SSID and a password have not been received, the process also proceeds to step S78, and the home appliance 50 returns from the communication connection mode to the normal operation mode. Also, if it is determined in step S75 that connection to the access point has failed, the process also proceeds to step S78, and the home appliance 50 returns from the communication connection mode to the normal operation mode.

[0142] As described above, in the detailed connection procedure, the information terminal 10 transmits the SSID of the router 61 and a password for connecting to the router 61 to the home appliance 50. The home appliance 50 then establishes a communication connection with the router 61 based on the received SSID and password. This allows the communication connection between the home appliance 50 and the router 61 to be established even if the user does not specify, on the home appliance 50, the router 61 to which the home appliance 50 is to be connected.

[0143] In the above-described process, the information terminal 10 and the home appliance 50 store the SSID and password, which are connection information set when the home appliance 50 establishes a communication connection to the network 60. Therefore, the information terminal 10 can generate a reading code using the connection information stored in the information terminal 10 or the connection information stored in the home appliance 50.

[0144] 3. Specific Example of Registration Processing The registration processing in the system 1 described with reference to FIG. 3 may be performed as described with reference to FIGS.

[0145] Figures 20 to 23 are sequence diagrams showing a specific example of registration processing in a system according to an embodiment. The sequence diagram in Figure 21 shows a continuation of the sequence diagram in Figure 20. The sequence diagram in Figure 22 shows a continuation of the sequence diagram in Figure 21. The sequence diagram in Figure 23 shows a continuation of the sequence diagram in Figure 22.

[0146] The information terminal 10 receives an application start operation (S101).

[0147] In step S101, the application is executed, and the information terminal 10 displays the application home screen (S102).

[0148] The information terminal 10 accepts input for logging in to the system 1 (S103). Specifically, the information terminal 10 accepts user information (user ID) and a password.

[0149] The information terminal 10 transmits the received user ID and password to the server 20 (S104).

[0150] When the server 20 receives the user ID and password from the information terminal 10, it executes a login process to the system 1 based on the received user ID and password (S105).

[0151] After executing the login process, the server 20 transmits an SSO (Single Sign On) token to the information terminal 10 (S106).

[0152] When the information terminal 10 receives the SSO token, it displays a UI for accepting an input to start setting the camera device 40, and accepts the input to start setting (S107).

[0153] When the information terminal 10 receives the input for starting the setup, it displays a license screen (S108). The license screen is a screen for receiving an input from the user as to whether or not the user agrees to the license.

[0154] When the information terminal 10 receives an input indicating consent on the license screen (S109), it requests an access token (S110). The token request may include the user ID. The access token is an example of an authentication key.

[0155] When the server 20 receives the token request, the server 20 extracts the user ID included in the token request (S111). Alternatively, the server 20 may extract the user ID from information stored in the server 20 based on the token request.

[0156] When the server 20 extracts the user ID, it generates an access token (S112) and stores the generated access token and the user ID in association with each other (S113).

[0157] The server 20 transmits the generated access token to the information terminal 10 (S114).

[0158] When the information terminal 10 receives the access token from the server 20, it generates a QR code including connection information (SSID and password) for communication connection to the network 60 and the access token (S115). The QR code is an example of a reading code.

[0159] Next, the information terminal 10 displays a screen prompting the user to turn on the power of the camera device 40 (S116).

[0160] Upon receiving the power-on operation, the camera device 40 enters a power-on state (S117).

[0161] Next, the camera device 40 determines whether or not the Wi-Fi settings have been completed (that is, whether or not the settings for the communication connection have been completed) (S118).

[0162] If the Wi-Fi setting has been completed (Yes in S118), the camera device 40 turns on the LED provided in the camera device 40 in green (S119).

[0163] Next, the camera device 40 starts up in the normal mode (S120).

[0164] Next, the camera device 40 may receive a press of the Wi-Fi setting button (S121). In this case, the camera device 40 may perform Wi-Fi resetting.

[0165] If Wi-Fi has not been set up (No in S118) or if the Wi-Fi setting button is pressed, the camera device 40 causes the LED on the camera device 40 to flash green (S122) and transitions to a state waiting for recognition of the QR code (S123).

[0166] After step S116, if the LED of the camera device 40 is not blinking, the information terminal 10 displays a screen prompting the user to press the Wi-Fi setting button of the camera device 40 (S124).

[0167] After step S124, the information terminal 10 displays the QR code (S125).

[0168] When the camera device 40 detects the QR code displayed on the information terminal 10 in multiple captured images while waiting for the QR code to be recognized (S126), it determines whether the QR code has been detected in all of the multiple images (S127).

[0169] If the camera device 40 can detect QR codes in all images (Yes in S127), the process proceeds to the next step S128, but if it cannot detect them (No in S127), the process returns to step S126. Alternatively, if the QR codes are detected but cannot be decoded (No in S127), the process returns to step S126.

[0170] The camera device 40 decodes the QR code and acquires the SSID, password, and access token (S128).

[0171] After step S128, the camera device 40 sounds the buzzer once (S129).

[0172] The camera device 40 causes the LED provided in the camera device 40 to blink in blue (S130).

[0173] The camera device 40 establishes a Wi-Fi connection using the SSID and password obtained by decryption (S131).

[0174] The camera device 40 stores the SSID and password in the local area (S132), and turns on the LED provided in the camera device 40 in blue (S133).

[0175] After step S133, the camera device 40 transmits a device registration request to the server 30 (S134). The device registration request includes camera information.

[0176] When the server 30 receives the device registration request, it transmits response information to the camera device 40 (S135).

[0177] Upon receiving the response information, the camera device 40 transmits the camera information and the access token to the server 20 (S136).

[0178] When the server 20 receives the camera information and the access token from the camera device 40, the server 20 compares the received access token with the access tokens that have already been issued by the server 20 (S137).

[0179] After step S136, the camera device 40 turns on the LED of the camera device 40 in green (S138) and sounds the buzzer twice (S139).

[0180] After step S125, the information terminal 10 transmits a request for the camera information and the product number to the server 20 (S141). The request includes the SSO token and the access token.

[0181] When the server 20 receives the request for the camera information and model number from the information terminal 10, it acquires the data (camera information and model number) using the access token included in the request as a key (S142).

[0182] The server 20 transmits the acquired camera information and product number to the information terminal 10 (S143).

[0183] The information terminal 10 monitors for a timeout after step S125 (S140). For example, the information terminal 10 starts counting after step S125 ends and repeats the process of step S141 until a predetermined time (e.g., three minutes) has elapsed, and determines whether or not the camera information and product number transmitted from the server 20 in step S143 can be received. If the camera information and product number cannot be received before the predetermined time has elapsed, the information terminal 10 may return to step S125 and repeat the processes from step S125 onwards, or may cancel the registration process and end the process. Alternatively, if the camera information and product number cannot be received before the predetermined time has elapsed, the information terminal 10 may return to step S125 and display a UI that allows the user to select whether to repeat the processes from step S125 onwards or to cancel the registration process and end the process, and then execute a process according to the input received on the UI.

[0184] After step S143, the information terminal 10 transmits a request for the device registration status to the server 20 (S144).

[0185] When the server 20 receives the request for the device registration status from the information terminal 10, the server 20 transmits the request for the device registration status to the server 30 (S145).

[0186] When the server 30 receives the request for the device registration status from the server 20, the server 30 transmits a device registration completion notification to the server 20 (S146).

[0187] When the server 20 receives the device registration completion notification from the server 30, the server 20 transmits the device registration completion notification to the information terminal 10 (S147).

[0188] The information terminal 10 receives input from the user (S148). The input received here includes information such as the purchase date of the camera device 40 and the user nickname.

[0189] The information terminal 10 transmits a device registration command including the information input in step S148 to the server 20 (S149). The device registration command includes hashed camera information, the model number of the camera device 40, and a device ID for communication.

[0190] When the server 20 receives the input information from the information terminal 10, it transmits a device registration request to the server 30 (S150). The device registration request includes an encrypted user ID and a device ID for communication.

[0191] When the server 30 receives the device registration request from the server 20, the server 30 performs registration verification by comparing the device registration status request received in step S145 with the device registration status request (S151).

[0192] If the registration check results in a match, the server 30 stores the user ID and camera information in association with each other (S152).

[0193] After step S150, the server 20 performs a home appliance registration process of storing the product number and the communication device ID in association with each other (S153).

[0194] After step S153, the server 20 transmits a device registration completion notification to the information terminal 10 (S154).

[0195] The server 20 deletes the association between the access token and the user ID (S155).

[0196] [4. Effects, etc.] System 1 according to the present embodiment includes server 20, information terminal 10 communicatively connected to server 20 via network 60, and camera device 40 having a communication function. Information terminal 10 includes a terminal acquisition unit 11 that receives an authentication key from server 20, a generation unit 13 that generates an optical read code representing the authentication key, a display unit 15 that displays the generated read code, a terminal storage unit 14 that stores user information for identifying a user, and a terminal transmission unit 12 that transmits the user information to server 20. Camera device 40 includes an image sensor 41, a decoding unit 42 that decodes the authentication key represented by the read code based on an image obtained by capturing the read code displayed on information terminal 10 with image sensor 41, a camera storage unit 43 that stores camera information for identifying camera device 40, and a camera communication unit 44 that transmits the authentication key and the camera information stored in camera storage unit 43 to server 20. The server 20 stores the user information transmitted by the information terminal 10 and the camera information transmitted by the camera device 40 together with the authentication key in association with each other.

[0197] According to this system, the information terminal 10 displays a read code representing an authentication key acquired from the server 20, has the camera device 40 read the read code, and the camera device 40 decodes the read code to transmit the acquired camera information to the server 20 along with the authentication key. This allows the camera information of the camera device that the user was attempting to register to the server using the information terminal to be transmitted to the server. In other words, since the read code to be read by the camera device 40 cannot be obtained unless the information terminal 10 accesses the server 20, it is possible to prevent the camera device 40 from transmitting the camera information of the camera device 40 by reading a counterfeit read code. In this way, the server 20 can acquire legitimate camera information from the camera device 40, and can store the user information and the legitimate camera information in association with each other.

[0198] Furthermore, in the system 1 according to this embodiment, if the authentication key received from the camera device 40 together with the camera information is an authentication key that has already been transmitted, the server 20 determines that the camera information is legitimate, and stores the received user information in association with the camera information that has been determined to be legitimate.

[0199] This allows the server 20 to associate the user information with the camera information that is determined to be valid.

[0200] Furthermore, in system 1 according to the present embodiment, when server 20 receives camera information from camera device 40, it transmits the received camera information to information terminal 10. When transmitting user information to server 20, terminal transmission unit 12 transmits the camera information received from server 20 together with the user information to server 20. If the camera information received from information terminal 10 together with the user information is camera information that has already been transmitted, server 20 determines that the user information is legitimate and stores the user information determined to be legitimate in association with the camera information.

[0201] This allows the server 20 to associate user information that is determined to be valid with camera information that is determined to be valid.

[0202] Furthermore, in the system 1 according to the present embodiment, the terminal acquisition unit 11 further acquires connection information for connecting to the network 60. The generation unit 13 generates a reading code in which an authentication key and the connection information are expressed. The decoding unit 42 decodes the authentication key and connection information expressed in the reading code. The camera communication unit 44 establishes communication with the network 60 using the connection information, and after establishing communication, transmits the authentication key and camera information to the server 20.

[0203] This allows the camera device 40 to easily establish communication with the network 60 .

[0204] Furthermore, system 1 according to the present embodiment further includes home appliance 50 that is communicatively connected to network 60 using connection information. Home appliance 50 stores the connection information. Terminal acquisition unit 11 acquires the connection information from home appliance 50 via network 60.

[0205] According to this, the camera device 40 establishes communication with the network 60 using connection information stored in the home appliance 50 that is already connected to the network 60, so that communication with the network 60 can be easily established.

[0206] The system 1 according to the present embodiment further includes a home appliance 50 that is communicatively connected to the network 60 using connection information. The terminal storage unit 14 stores the connection information that was used when setting up the communication connection of the home appliance 50. The terminal acquisition unit 11 acquires the connection information from the terminal storage unit 14.

[0207] According to this, the camera device 40 establishes communication with the network 60 using the connection information used when setting up the communication connection of the home appliance 50, so that communication with the network 60 can be easily established.

[0208] In the system 1 according to the present embodiment, the information terminal 10 further includes a reception unit 16 that receives input from a user. The terminal acquisition unit 11 acquires connection information generated based on the input received by the reception unit 16.

[0209] According to this, the camera device 40 establishes communication with the network 60 using connection information generated based on input from the user, so the user can have the camera device 40 establish communication using the desired connection information.

[0210] Furthermore, in the system 1 according to the present embodiment, the authentication key is invalidated when a first period has elapsed since it was transmitted by the server 20 .

[0211] This makes it possible to prevent a third party from misusing the authentication key and storing camera information and user information in association with each other in the server 20 .

[0212] In the system 1 according to the present embodiment, the read code is invalidated when a second period has elapsed since the code was generated by the generator 13 .

[0213] This makes it possible to prevent a third party from misusing the reading code to store camera information and user information in association with each other in the server 20 .

[0214] Moreover, the information terminal 10 according to this embodiment is the information terminal 10 in the system 1. The information terminal 10 includes a terminal acquisition unit 11 that acquires from the server 20 an authentication key for causing the server 20 to authenticate the received information as authentic, a generation unit 13 that generates an optical read code expressing the authentication key, a display unit 15 that displays the read code generated by the generation unit 13 so that the read code can be read by the camera device 40, a terminal storage unit 14 that stores user information for identifying a user, and a terminal transmission unit 12 that transmits the user information to the server 20.

[0215] According to this, by displaying a read code representing an authentication key acquired by the information terminal 10 from the server 20 and having the camera device 40 read the read code, it is possible to use, for example, for the camera device 40 to transmit camera information to the server 20 together with the authentication key acquired by decoding the read code. Since the read code to be read by the camera device 40 cannot be obtained unless the information terminal 10 is used to access the server 20, it is possible to prevent the camera device 40 from transmitting camera information by having the camera device 40 read a disguised read code.

[0216] [5. Other] In the above embodiments, each component may be configured with dedicated hardware, or may be realized by executing a software program appropriate for that component. Each component may be realized by a program execution unit such as a CPU or processor reading and executing a software program recorded on a recording medium such as a hard disk or semiconductor memory. Here, the software that realizes the system, information terminal, server, camera device, etc. of the above embodiments is a program that causes a computer to execute each step included in the flowcharts shown in the figures.

[0217] The following cases are also included in this disclosure:

[0218] (1) Specifically, each of the above devices is a computer system consisting of a microprocessor, ROM, RAM, hard disk unit, display unit, keyboard, mouse, etc. A computer program is stored in the RAM or hard disk unit. Each device achieves its function when the microprocessor operates in accordance with the computer program. Here, a computer program is composed of a combination of multiple instruction codes that indicate commands to a computer to achieve a specified function.

[0219] (2) Some or all of the components constituting each of the above devices may be configured as a single system LSI (Large Scale Integration). A system LSI is an ultra-multifunctional LSI manufactured by integrating multiple components on a single chip, and specifically, is a computer system configured to include a microprocessor, ROM, RAM, etc. A computer program is stored in the RAM. The system LSI achieves its functions by the microprocessor operating in accordance with the computer program.

[0220] (3) Some or all of the components constituting each of the above devices may be configured as an IC card or a standalone module that can be attached to each device. The IC card or module may be a computer system configured with a microprocessor, ROM, RAM, etc. The IC card or module may include the above-mentioned ultra-multifunctional LSI. The IC card or module achieves its functions when the microprocessor operates in accordance with a computer program. The IC card or module may be tamper-resistant.

[0221] (4) The present disclosure may be embodied as the above-described methods, a computer program for implementing these methods on a computer, or a digital signal comprising the computer program.

[0222] The present disclosure may also be a computer program or a digital signal recorded on a computer-readable recording medium, such as a flexible disk, a hard disk, a CD-ROM, an MO, a DVD, a DVD-ROM, a DVD-RAM, a BD (Blu-ray (registered trademark) Disc), a semiconductor memory, etc. Alternatively, the present disclosure may be a digital signal recorded on such a recording medium.

[0223] Furthermore, the present disclosure may also be applied to transmitting the computer program or the digital signal via a telecommunications line, a wireless or wired communication line, a network such as the Internet, data broadcasting, or the like.

[0224] The present disclosure may also be a computer system including a microprocessor and a memory, wherein the memory stores the computer program, and the microprocessor operates in accordance with the computer program.

[0225] The program or the digital signal may also be implemented by another independent computer system by recording it on the recording medium and transferring it, or by transferring it via the network or the like.

[0226] The present disclosure is useful as a system that can store user information and legitimate camera information in association with each other.

[0227] REFERENCE SIGNS LIST 1 System 10 Information terminal 11 Terminal acquisition unit 12 Terminal transmission unit 13 Generation unit 14 Terminal storage unit 15 Display unit 16 Reception unit 20, 30 Server 21, 31 Communication unit 22, 32 Storage unit 23, 33 Control unit 40 Camera device 41 Image sensor 42 Decoding unit 43 Camera storage unit 44 Camera communication unit 50 Home appliance 60 Network 61 Router

Claims

1. A system in which a camera device having a communication function communicates with a server that can be connected to an information terminal via a network, The information terminal a terminal acquisition unit that receives an authentication key from the server; a generator for generating an optical read code representing the authentication key; a display unit that displays the generated reading code; a terminal storage unit that stores user information for identifying a user; a terminal transmitting unit that transmits the user information to the server, The camera device a decoding unit that decodes the authentication key expressed by the read code displayed on the information terminal based on an image obtained by capturing the read code with an image sensor of the camera device; a camera storage unit that stores camera information for identifying the camera device; a camera communication unit that transmits the authentication key and the camera information stored in the camera storage unit to the server, The server When the camera information is received from the camera device, the received camera information is transmitted to the information terminal; The user information transmitted by the information terminal and the camera information transmitted by the camera device together with the authentication key are stored in association with each other. system.

2. When transmitting the user information to the server, the terminal transmission unit transmits the camera information received from the server together with the user information to the server. The system of claim 1 .

3. When the camera information received from the information terminal together with the user information is camera information that has already been transmitted, the server determines that the user information is legitimate and stores the user information determined to be legitimate in association with the camera information. The system of claim 2 .

4. If the authentication key received from the camera device together with the camera information is the authentication key that has already been transmitted, the server determines that the camera information is authentic, and stores the received user information and the camera information that has been determined to be authentic in association with each other. A system according to any one of claims 1 to 3.

5. The terminal acquisition unit further acquires connection information for connecting to the network, the generation unit generates the reading code in which the authentication key and the connection information are expressed, the decoding unit decodes the authentication key and the connection information expressed by the reading code, The camera communication unit establishes communication with the network using the connection information, and after establishing communication, transmits the authentication key and the camera information to the server. A system according to any one of claims 1 to 3.

6. The terminal acquisition unit acquires the connection information via the network from a home appliance that stores the connection information and is communicatively connected to the network using the connection information. The system of claim 5.

7. the terminal storage unit stores the connection information used when setting up a communication connection of a home appliance that is communicatively connected to the network using the connection information; The terminal acquisition unit acquires the connection information from the terminal storage unit. The system of claim 5.

8. the information terminal further includes a reception unit that receives an input from a user; The terminal acquisition unit acquires the connection information generated based on the input received by the reception unit. The system of claim 5.

9. The authentication key is invalidated a first period of time after it is sent by the server. A system according to any one of claims 1 to 3.

10. The reading code is invalidated when a second period has elapsed since the code was generated by the generating unit. A system according to any one of claims 1 to 3.

11. An information terminal in which a camera device having a communication function is communicably connected to a server via a network, a terminal acquisition unit that acquires from the server an authentication key for causing the server to authenticate the received information as authentic; a generator for generating an optical read code representing the authentication key; a display unit that displays the read code generated by the generation unit so that the read code can be read by the camera device; a terminal storage unit that stores user information for identifying a user; a terminal transmitting unit that transmits the user information to the server, The server receives camera information for identifying the camera device from the server. Information terminal.

12. A communication setting method for a camera device having a communication function to communicate with a server that can be connected to an information terminal via a network, comprising: the information terminal acquires an authentication key from the server; the information terminal generates an optical readable code representing the authentication key; the information terminal displays the generated reading code; the information terminal transmits user information for identifying the user to the server; the camera device captures the reading code displayed on the information terminal; the camera device decodes the authentication key represented by the reading code based on the image obtained by photographing; the camera device transmits the authentication key and camera information for identifying the camera device to the server; the server transmits the camera information received from the camera device to the information terminal; The server stores the user information transmitted by the information terminal and the camera information transmitted by the camera device together with the authentication key in association with each other. How to set up communication.