System, information terminal, and communication setting method

Abstract

In a system (1), an information terminal (10) is provided with: a terminal acquisition unit (11) that receives an authentication key from a server (20); a generation unit (13) that generates a read code indicating the authentication key; a display unit (15) for displaying the reading code; a terminal storage unit (14) for storing user information; and a terminal transmission unit (12) for transmitting the user information to the server (20). A camera device (40) is provided with: an image sensor (41); a decoding unit (42) that decodes the authentication key of the read code on the basis of an image obtained by imaging the displayed read code by the image sensor (41); a camera storage unit (43) that stores camera information; and a camera communication unit (44) that transmits the authentication key and the camera information to the server (20). The server (20) associates and stores the user information transmitted by the information terminal (10) with the camera information transmitted by the camera device (40) together with the authentication key.

Description

Technical Field

[0001] This disclosure relates to systems, information terminals, and communication setup methods. Background Technology

[0002] Patent document 1 discloses a technique for sending device identifiers and user identifiers to a server device and establishing an association between them.

[0003] Existing technical documents Patent documents Patent Document 1: Japanese Patent Application Publication No. 2019-101509 Summary of the Invention

[0004] The problem that the invention aims to solve This disclosure provides a system that can establish and store a correspondence between user information and legitimate camera information.

[0005] Methods for solving problems One aspect of this disclosure involves a system in which a camera device with communication capabilities communicates via a network with a server capable of communicating with an information terminal. The information terminal includes: a terminal acquisition unit that receives an authentication key from the server; a generation unit that generates an optical readout code representing the authentication key; a display unit that displays the generated readout code; a terminal storage unit that stores user information for identifying the user; and a terminal transmission unit that sends the user information to the server. The camera device includes: a decoding unit that decodes the authentication key represented by the readout code based on an image obtained by capturing an image displayed on the information terminal using an image sensor of the camera device; a camera storage unit that stores camera information for identifying the camera device; and a camera communication unit that sends the authentication key and the camera information stored in the camera storage unit to the server. The server establishes a correspondence between the user information sent by the information terminal and the camera information sent by the camera device along with the authentication key, and stores this correspondence.

[0006] Furthermore, one aspect of this disclosure involves an information terminal capable of communicating with a server via a network. The server is capable of communicating with a camera device having communication capabilities. The information terminal comprises: a terminal acquisition unit for acquiring an authentication key from the server, the authentication key being used by the server to authenticate information received together with the authentication key as legitimate; a generation unit for generating an optical readout code representing the authentication key; a display unit for displaying the readout code generated by the generation unit to enable the camera device to read it; a terminal storage unit for storing user information for identifying the user; and a terminal transmission unit for transmitting the user information to the server.

[0007] Furthermore, one aspect of the communication setup method disclosed herein involves a camera device with communication capabilities communicating via a network with a server capable of communicating with an information terminal. In this communication setup method, the information terminal obtains an authentication key from the server, generates an optical readout code representing the authentication key, displays the generated readout code, sends user information used to identify the user to the server, the camera device captures the readout code displayed on the information terminal, decodes the authentication key represented by the readout code based on the captured image, and sends the authentication key and camera information used to identify the camera device to the server. The server establishes a correspondence between the user information sent by the information terminal and the camera information sent by the camera device along with the authentication key, and stores the correspondence.

[0008] Furthermore, these general or specific methods can be implemented by non-transitory recording media such as devices, integrated circuits, computer programs, or computer-readable CD-ROMs, or by any combination of devices, methods, systems, integrated circuits, computer programs, and non-transitory recording media.

[0009] Invention Effects The systems disclosed herein are capable of establishing and storing a correspondence between user information and legitimate camera information. Attached Figure Description

[0010] Figure 1 This is a diagram used to illustrate the outline of the system involved in this embodiment.

[0011] Figure 2 This is a diagram illustrating an example of the configuration of the system involved in this embodiment.

[0012] Figure 3This is a timing diagram illustrating an example of the registration process in the system involved in this embodiment.

[0013] Figure 4 This is a diagram showing the first example of a UI displayed on the display section of an information terminal.

[0014] Figure 5 This is a diagram illustrating an example of a UI displayed on an information terminal to prompt connection information.

[0015] Figure 6 This is a diagram illustrating an example of a UI used to accept connection information from the user.

[0016] Figure 7 This is a flowchart illustrating an example of the processing performed by an information terminal to establish a communication connection.

[0017] Figure 8 This is a flowchart illustrating an example of the processing performed by an information terminal to establish a communication connection.

[0018] Figure 9 This is a flowchart illustrating an example of the processing performed by an information terminal to establish a communication connection.

[0019] Figure 10 This is a diagram illustrating the first example of a UI displayed by an information terminal during the process of establishing a communication connection.

[0020] Figure 11 This is the second example of a UI displayed by an information terminal during the process of establishing a communication connection.

[0021] Figure 12 This is the third example of a UI displayed by an information terminal during the process of establishing a communication connection.

[0022] Figure 13 This is the fourth example of the UI displayed by the information terminal during the process of establishing a communication connection.

[0023] Figure 14 This is the fifth example of the UI displayed by the information terminal during the process of establishing a communication connection.

[0024] Figure 15 This is the sixth example of a UI displayed by an information terminal during the process of establishing a communication connection.

[0025] Figure 16 This is the seventh example of a UI displayed by an information terminal during the process of establishing a communication connection.

[0026] Figure 17 This is the eighth example of a UI displayed by an information terminal during the process of establishing a communication connection.

[0027] Figure 18 This is a flowchart illustrating an example of the processes performed by a home appliance to establish a communication connection.

[0028] Figure 19 This is a flowchart illustrating an example of the processes performed by a home appliance to establish a communication connection.

[0029] Figure 20 This is a timing diagram illustrating a specific example of the registration process in the system involved in this embodiment.

[0030] Figure 21 This is a timing diagram illustrating a specific example of the registration process in the system involved in this embodiment.

[0031] Figure 22 This is a timing diagram illustrating a specific example of the registration process in the system involved in this embodiment.

[0032] Figure 23 This is a timing diagram illustrating a specific example of the registration process in the system involved in this embodiment. Detailed Implementation

[0033] The system according to the first aspect of this disclosure includes a camera device with communication function that communicates with a server that can communicate with an information terminal via a network. The information terminal includes: a terminal acquisition unit that receives an authentication key from the server; a generation unit that generates an optical readout code representing the authentication key; a display unit that displays the generated readout code; a terminal storage unit that stores user information for identifying the user; and a terminal transmission unit that sends the user information to the server. The camera device includes: a decoding unit that decodes the authentication key represented by the readout code based on an image obtained by capturing the readout code displayed on the information terminal using an image sensor of the camera device; a camera storage unit that stores camera information for identifying the camera device; and a camera communication unit that sends the authentication key and the camera information stored in the camera storage unit to the server. The server establishes a correspondence between the user information sent by the information terminal and the camera information sent by the camera device along with the authentication key, and stores the correspondence.

[0034] Accordingly, the information terminal displays a read code representing the authentication key obtained from the server, enabling the camera device to read the read code. The camera device then sends the authentication key obtained by decoding the read code, along with the camera information, to the server. This allows the camera information of the camera device that the user wants to register with the server using the information terminal to be sent to the server. In other words, without accessing the server using the information terminal, the read code for the camera device cannot be obtained; therefore, the possibility of the camera device sending camera information by reading a forged read code can be suppressed. As a result, since the server can obtain legitimate camera information from the camera device, it can establish a correspondence between user information and legitimate camera information and store it.

[0035] The system involved in the second aspect of this disclosure is based on the system involved in the first aspect. When the authentication key received by the server from the camera device along with the camera information is an authentication key that has been sent before, the server determines that the camera information is legitimate and establishes a correspondence between the received user information and the camera information that has been determined to be legitimate and stores it.

[0036] Based on this, the server can establish a correspondence between user information and camera information deemed legitimate.

[0037] The system involved in the third aspect of this disclosure is based on the system involved in the first or second aspect. When the server receives the camera information from the camera device, it sends the received camera information to the information terminal. When the terminal sending unit sends the user information to the server, it sends the camera information received from the server together with the user information to the server. If the camera information received from the information terminal along with the user information is camera information that has been sent before, the server determines that the user information is legitimate and establishes a correspondence between the user information determined to be legitimate and the camera information and stores it.

[0038] Accordingly, the server can establish a correspondence between user information deemed legitimate and camera information deemed legitimate.

[0039] The system according to the fourth aspect of this disclosure is based on the system according to any one of the first to third aspects. The terminal acquisition unit further acquires connection information for connecting to the network, the generation unit generates a reading code representing the authentication key and the connection information, the decoding unit decodes the authentication key and the connection information represented by the reading code, the camera communication unit establishes communication with the network using the connection information, and after establishing communication, sends the authentication key and the camera information to the server.

[0040] Therefore, the camera device can easily establish communication with the network.

[0041] The system according to the fifth aspect of this disclosure is based on the system according to the fourth aspect, wherein the terminal acquisition unit acquires the connection information from a home appliance that stores the connection information and has established a communication connection with the network using the connection information, via the network.

[0042] Therefore, since the camera device uses connection information stored in home appliances that are already connected to the network to establish communication with the network, it can easily establish communication with the network.

[0043] The system according to the sixth aspect of this disclosure is based on the system according to the fourth aspect. The terminal storage unit stores the connection information used when setting up a communication connection for a home appliance. The home appliance is a home appliance that has established a communication connection with the network using the connection information. The terminal acquisition unit acquires the connection information from the terminal storage unit.

[0044] Therefore, since the camera device uses the connection information used when setting up communication connections for home appliances to establish communication with the network, it can easily establish communication with the network.

[0045] The system according to the seventh aspect of this disclosure is based on the system according to the fourth aspect, wherein the information terminal further has a receiving unit for receiving input from a user, and the terminal acquiring unit acquires the connection information generated based on the input received by the receiving unit.

[0046] Accordingly, since the camera device uses connection information generated based on user input to establish communication with the network, the user can enable the camera device to establish communication with the desired connection information.

[0047] The system involved in the eighth method of this disclosure is based on the system involved in any one of the methods from the first to the seventh method, wherein the authentication key is invalidated after a first period following its transmission by the server.

[0048] Therefore, it can prevent third parties from maliciously using authentication keys to establish a correspondence between camera information and user information and store it on the server.

[0049] The system involved in the ninth aspect of this disclosure is based on the system involved in any one of the first to eighth aspects, wherein the reading code is invalidated after a second period following its generation by the generation unit.

[0050] Therefore, it can prevent third parties from maliciously using the reading code to establish a correspondence between camera information and user information and store it on the server.

[0051] The tenth aspect of this disclosure relates to an information terminal capable of communicating with a server via a network. The server is a server capable of communicating with a camera device having communication capabilities. The information terminal comprises: a terminal acquisition unit that acquires an authentication key from the server, the authentication key being used by the server to authenticate information received together with the authentication key as legitimate; a generation unit that generates an optical readout code representing the authentication key; a display unit that displays the readout code generated by the generation unit for the camera device to read; a terminal storage unit that stores user information for identifying a user; and a terminal transmission unit that transmits the user information to the server.

[0052] Accordingly, the information terminal displays a read code representing the authentication key obtained from the server, and the camera device reads it. For example, this can be used to cause the camera device to send the authentication key obtained by decoding the read code, along with camera information, to the server. Since the read code for the camera device to read cannot be obtained without accessing the server through the information terminal, it is possible to prevent the camera device from sending camera information by reading a spoofed read code.

[0053] The communication setting method disclosed in the 11th aspect is used for a camera device with communication function to communicate with a server capable of communicating with an information terminal via a network. In the communication setting method, the information terminal obtains an authentication key from the server, generates an optical readout code representing the authentication key, displays the generated readout code, sends user information used to identify the user to the server, the camera device captures the readout code displayed on the information terminal, decodes the authentication key represented by the readout code based on the captured image, and sends the authentication key and camera information used to identify the camera device to the server. The server establishes a correspondence between the user information sent by the information terminal and the camera information sent by the camera device along with the authentication key, and stores the correspondence.

[0054] Accordingly, the information terminal displays a read code representing the authentication key obtained from the server, and the camera device reads it. The camera device then decodes the read code to obtain the authentication key, which, along with the camera information, is sent to the server. This allows the camera information of the camera device that the user wants to register with the server via the information terminal to be sent to the server. In other words, without accessing the server via the information terminal, the read code for the camera device cannot be obtained; therefore, it prevents the camera device from sending camera information by reading a forged read code. In this way, since the server can obtain legitimate camera information from the camera device, it can establish a correspondence between user information and legitimate camera information and store it.

[0055] Furthermore, these general or specific methods can be implemented by non-transitory recording media such as devices, integrated circuits, computer programs, or computer-readable CD-ROMs, or by any combination of devices, methods, systems, integrated circuits, computer programs, and non-transitory recording media.

[0056] The embodiments will now be described in detail with appropriate reference to the accompanying drawings. However, there are instances where unnecessary or overly detailed descriptions are omitted. For example, detailed descriptions of matters already well-known, or repetitive descriptions of substantially the same configurations, may be omitted. This is to avoid making the following description unnecessarily lengthy and to facilitate understanding by those skilled in the art.

[0057] Furthermore, the accompanying drawings and the following description are provided by the inventors to enable those skilled in the art to fully understand this disclosure, and are not intended to limit the subject matter described in the claims.

[0058] (Implementation Method) [1. Composition] Figure 1 This is a diagram used to illustrate the outline of the system involved in this embodiment.

[0059] Specifically, in Figure 1 The diagram shows an information terminal 10, a server 20, a server 30, a camera device 40, a home appliance 50, a network 60, and a router 61. For example, System 1 includes the information terminal 10, server 20, and camera device 40 among these components. System 1 may further include a server 30 and a home appliance 50. Furthermore, the aforementioned components of System 1 do not necessarily have to be hardware; they can be implemented by executing the required software stored in the information terminal 10, server 20, camera device 40, and home appliance 50 using at least one processor from at least one of the corresponding software. The information terminal 10, server 20, server 30, camera device 40, and home appliance 50 are connected in a manner that enables communication via the network 60. The router 61 is a device that relays communication between the camera device 40 or home appliance 50 and the network 60. Router 61 can also relay the communication connection between information terminal 10 and network 60.

[0060] System 1 is a system that establishes a correspondence between camera information used to identify camera device 40 and user information used to identify users, and stores this correspondence in servers 20 and 30. System 1 can also establish a correspondence between device information used to identify home appliance 50 and user information, and store this correspondence in servers 20 and 30.

[0061] Figure 2 This is a diagram illustrating an example of the configuration of the system involved in this embodiment.

[0062] System 1 includes an information terminal 10, a server 20, a server 30, a camera device 40, and home appliances 50. Figure 2 The diagram of router 61 is omitted.

[0063] The information terminal 10 includes a terminal acquisition unit 11, a terminal transmission unit 12, a generation unit 13, a terminal storage unit 14, a display unit 15, and a receiving unit 16. The information terminal 10 is implemented, for example, by a smartphone, a tablet terminal, or the like.

[0064] The terminal acquisition unit 11 receives information from at least one of the following devices via the network 60: server 20, server 30, camera device 40, and home appliance 50. Specifically, the terminal acquisition unit 11 receives an authentication key from server 20. The terminal acquisition unit 11 may also acquire connection information for connecting to the network 60.

[0065] The terminal sending unit 12 sends information to at least one of the following devices via the network 60: server 20, server 30, camera device 40, and home appliance 50. Specifically, the terminal sending unit 12 can send user information to server 20. Furthermore, when sending user information to server 20, the terminal sending unit 12 can also send the user information along with camera information received from server 20.

[0066] The generation unit 13 generates an optical reading code. Specifically, the optical reading code can be a two-dimensional code such as a QR (Quick Response) code (registered trademark), a barcode, or a specific image. The reading code is used to represent the authentication key. Additionally, the reading code can also be used to represent the authentication key and connection information. That is, the generation unit 13 can generate a reading code to represent the authentication key, or it can generate a reading code to represent both the authentication key and connection information. The reading code expires after a second period following its generation by the generation unit 13. The second period is, for example, 3 minutes. The second period is not limited to 3 minutes; it can also be 1 minute, 5 minutes, or other periods.

[0067] Here, the authentication key is issued by server 20 and used to determine the correctness of newly managed user information and camera information by server 20. The connection information, as described above, is used to connect to network 60. Specifically, the connection information is used to establish a communication connection with router 61 and includes router 61's SSID and its corresponding password.

[0068] The terminal storage unit 14 stores user information used to identify the user. This user information may be information generated in the information terminal 10 based on input received by the user from the receiving unit 16 (described later). Additionally, the terminal storage unit 14 stores programs used to implement the functions of the information terminal 10. The terminal storage unit 14 may be, for example, a non-volatile memory.

[0069] Display unit 15 displays images or UI (User Interface) generated in information terminal 10. Specifically, display unit 15 displays reading codes generated by generation unit 13. Display unit 15 is, for example, a display screen.

[0070] The receiving unit 16 accepts input from the user. Specifically, the receiving unit 16 accepts input to the UI displayed on the display unit 15. The receiving unit 16 is, for example, a touch panel. However, the receiving unit 16 is not limited to a touch panel, and may also be other input devices such as a keyboard or mouse.

[0071] Server 20 includes a communication unit 21, a storage unit 22, and a control unit 23.

[0072] Communication unit 21 communicates with at least one of the following devices via network 60: information terminal 10, server 30, camera device 40, and home appliance 50. Specifically, communication unit 21 receives an authentication key request from information terminal 10. Furthermore, communication unit 21 sends the authentication key to information terminal 10. Also, communication unit 21 receives the authentication key and camera information from camera device 40. Furthermore, communication unit 21 sends the camera information to information terminal 10. Additionally, communication unit 21 receives user information from information terminal 10. Finally, communication unit 21 sends user information and camera information to server 30, establishing a corresponding combination between them.

[0073] The communication unit 21 can be implemented, for example, by a communication interface (IF) connected to a wired LAN, or by a communication IF connected to a wireless LAN. Alternatively, the communication unit 21 can also be implemented by a communication IF connected to a cellular mobile communication network.

[0074] The storage unit 22 establishes a correspondence between the user information sent by the information terminal 10 and the camera information sent by the camera device 40 along with the authentication key, and stores them therein. Additionally, the storage unit 22 stores programs used to implement the functions of the server 20. The storage unit 22 is implemented using, for example, a non-volatile storage device such as an SSD or HDD (Hard Disk Drive).

[0075] When the communication unit 21 receives a request for an authentication key, the control unit 23 generates an authentication key. The control unit 23 determines whether the authentication key received along with the camera information from the camera device 40 is a previously sent authentication key (i.e., an authentication key already sent by the server 20). If the authentication key received along with the camera information from the camera device 40 is a previously sent authentication key, the control unit 23 determines that the camera information is legitimate, establishes a correspondence between the received user information and the determined legitimate camera information, and stores it in the storage unit 22. Conversely, if the authentication key received along with the camera information from the camera device 40 is not a previously sent authentication key, the control unit 23 determines that the camera information is illegitimate and may not store the determined illegitimate camera information in the storage unit 22. In other words, the control unit 23 may discard the determined illegitimate camera information. Alternatively, when determining that the camera information is illegitimate, the control unit 23 may store the camera information along with information indicating its illegitimacy in the storage unit 22.

[0076] Furthermore, the authentication key becomes invalid after a first period following its transmission from server 20 to information terminal 10. For example, control unit 23 can determine that camera information received along with an expired authentication key is illegitimate. In other words, control unit 23 determines that camera information received along with a valid authentication key is legitimate. The first period is, for example, 3 minutes. The first period is not limited to 3 minutes; it can also be 1 minute, 5 minutes, or other periods. Additionally, the first period can be specified as a different time from the second period, or it can be specified as the same time as the second period.

[0077] Furthermore, when the communication unit 21 receives camera information from the camera device 40, the control unit 23 can also send the received camera information to the information terminal 10 through the communication unit 21. Then, the control unit 23 determines whether the camera information received from the information terminal 10 along with the user information is previously sent camera information. If the camera information received from the information terminal 10 along with the user information is previously sent camera information, the control unit 23 determines that the user information is legitimate, establishes a correspondence between the legitimate user information and the camera information, and stores it in the storage unit 22. Conversely, if the camera information received from the information terminal 10 along with the user information is not previously sent camera information, the control unit 23 determines that the user information is illegitimate and may not store the illegitimate user information in the storage unit 22. In other words, the control unit 23 can discard the illegitimate user information. Alternatively, when the control unit 23 determines that the user information is illegitimate, it may store the user information along with information indicating its illegitimacy in the storage unit 22.

[0078] The server 30 includes a communication unit 31, a storage unit 32, and a control unit 33.

[0079] The communication unit 31 communicates with at least one of the following devices via network 60: information terminal 10, server 20, camera device 40, and home appliance 50. Specifically, the communication unit 31 receives camera information from camera device 40. Additionally, the communication unit 31 receives a combination of user information and camera information that have been established with each other from server 20. The communication unit 31 can be implemented, for example, by a communication interface (IF) connected to a wired LAN, or by a communication interface connected to a wireless LAN. Alternatively, the communication unit 31 can also be implemented by a communication interface connected to a cellular mobile communication network.

[0080] Storage unit 32 stores a combination of user information and camera information received from server 20. Additionally, storage unit 32 stores programs used to implement the functions of server 30. Storage unit 32 is implemented using non-volatile storage devices such as SSDs or HDDs (Hard Disk Drives).

[0081] The control unit 33 implements the functions of the server 30.

[0082] The camera device 40 includes an image sensor 41, a decoding unit 42, a camera storage unit 43, and a camera communication unit 44. The camera device 40 is, for example, installed on the upper part of the door of a household appliance 50 (e.g., a refrigerator). When the household appliance 50 is a refrigerator, the camera device 40 is used to photograph food items being taken out or placed inside the refrigerator, or food items stored inside the refrigerator. The camera device 40 can be built into the refrigerator from the beginning, or it can be installed on the refrigerator as an external device later. By analyzing the images captured by the camera device 40, the food items stored inside the refrigerator can be identified.

[0083] The image sensor 41 detects the image image formed on the surface of the image sensor 41 through an optical system such as a lens (not shown) and generates an image representing the detected image.

[0084] The decoding unit 42 decodes the authentication key represented by the read code based on an image (i.e., an image containing the read code) obtained by the image sensor 41 and displayed on the information terminal 10. When the read code represents both the authentication key and connection information, the decoding unit 42 decodes both the authentication key and the connection information.

[0085] The camera storage unit 43 stores camera information used to identify the camera device 40. Additionally, the camera storage unit 43 stores programs used to implement the functions of the camera device 40.

[0086] The camera communication unit 44 communicates with at least one of the following devices via network 60: information terminal 10, server 20, server 30, and home appliance 50. Specifically, the camera communication unit 44 sends the authentication key and camera information stored in the camera storage unit 43 to the server 20. Alternatively, the camera communication unit 44 can also establish communication with network 60 using connection information decoded by the decoding unit 42, and send the authentication key and camera information to the server 20 after establishing communication.

[0087] Home appliance 50 is a device capable of communicating with at least one of the following devices via network 60: information terminal 10, server 20, server 30, and camera device 40. Home appliance 50 is, for example, a refrigerator. However, home appliance 50 is not limited to a refrigerator; it could also be other home appliances such as a microwave oven, electric oven, or washing machine.

[0088] [2. Action] Next, the operation of System 1 will be explained.

[0089] Figure 3 This is a timing diagram illustrating an example of the registration process in the system involved in this embodiment.

[0090] When executing a specified application, the information terminal 10 sends a request for an authentication key to the server 20 by accepting specified input from the user (S1).

[0091] When the server 20 receives a request for an authentication key from the information terminal 10, it generates an authentication key (S2).

[0092] Next, the server 20 sends the generated authentication key to the information terminal 10 that sent the authentication key request (S3).

[0093] When the information terminal 10 receives the authentication key from the server 20, it reads the connection information used to establish communication with the router 61 from the terminal storage unit 14 and generates a read code (S4) to represent the received authentication key and the read connection information.

[0094] Next, the information terminal 10 displays the generated reading code on the display unit 15 (S5). For example, the information terminal 10 may display on the display unit 15 the following: Figure 4 UI100 is shown.

[0095] Figure 4 This is a diagram showing the first example of a UI displayed on the display of an information terminal.

[0096] UI 100 includes: a message 101 prompting the user to align the reading code with the camera device 40 so that the reading code can be captured by the camera device 40; a reading code 102 consisting of a QR code; and a "Next" button 103. The "Next" button 103 is, for example, a button used to accept input for moving to the next UI after the user aligns the reading code 102 with the camera device 40.

[0097] In the above manner, when the user points the information terminal 10 displaying the reading code 102 at the camera device 40, the camera device 40 takes a picture of the reading code 102 (S6).

[0098] Next, the camera device 40 decodes the authentication key and connection information represented by the read code 102 based on the image obtained by shooting (S7).

[0099] Next, the camera device 40 establishes a communication connection with the router 61 using the connection information obtained through decoding (S8). Thus, the camera device 40 is in a state where it can communicate with the network 60 through the router 61.

[0100] Next, the camera device 40 reads the camera information used to identify the camera device 40 from the camera storage unit 43 and sends the read camera information to the server 30 (S9).

[0101] In addition, the camera device 40 sends the read camera information and the authentication key obtained through decoding to the server 20 (S10).

[0102] When server 20 receives camera information and authentication key from camera device 40, it verifies the legitimacy of the camera information (S11). Specifically, if the authentication key received from camera device 40 along with the camera information is a previously sent authentication key that has not yet undergone a first period since its transmission, server 20 determines that the camera information received along with that authentication key is legitimate. Conversely, if the above conditions are not met, server 20 determines that the camera information received along with that authentication key is illegitimate. When server 20 determines that the camera information is legitimate, it proceeds to the next step S12; when it determines that the camera information is illegitimate, it discards the camera information and terminates the process, for example.

[0103] The server 20 will send the camera information that is deemed legitimate to the information terminal 10 (S12).

[0104] When the information terminal 10 receives camera information from the server 20, it sends the user information stored in the terminal storage unit 14 and the received camera information to the server 20 (S13).

[0105] When server 20 receives user information and camera information, it verifies the legitimacy of the received user information (S14). Specifically, if the camera information received from information terminal 10 along with the user information is previously sent camera information, server 20 determines that the user information is legitimate. Otherwise, server 20 determines that the user information received along with the camera information is illegitimate. When server 20 determines that the user information is legitimate, it proceeds to the next step S15; when it determines that the user information is illegitimate, it discards the user information and terminates the process, for example.

[0106] Since the server 20 has verified the legitimacy of both the user information and the camera information through steps S11 and S14, it establishes an association between the user information and the camera information and stores it in the storage unit 22 (S15).

[0107] Next, server 20 sends the combination of the established user information and camera information to server 30 (S16).

[0108] When server 30 receives a combination of user information and camera information, it verifies the validity of the combination (S17). Specifically, server 30 determines whether the camera information received in step S9 is consistent with the camera information included in the combination received in step S16. If the camera information is consistent, server 30 determines the combination to be valid. Otherwise, server 30 determines the combination to be invalid. When server 30 determines the combination to be valid, it proceeds to the next step S18; when server 30 determines the combination to be invalid, it discards the combination and terminates the process, for example.

[0109] Since the server 30 has verified the legitimacy of the combination of user information and camera information through step S17, it stores the combination in storage unit 32 (S18).

[0110] Here, when the reading code is generated in step S4, the information terminal 10 can determine the connection information in the information represented in the reading code by the following method.

[0111] The first example will be explained below. In the first example, the information terminal 10 can obtain the connection information used by the home appliance 50 to connect to the network 60 from the home appliance 50, and use the connection information obtained from the home appliance 50 to generate a reading code. That is, in this case, the reading code generated by the information terminal 10 indicates the connection information obtained from the home appliance 50 and the authentication key.

[0112] The second example will now be explained. The terminal storage unit 14 of the information terminal 10 can store connection information used when setting up communication connections for the home appliance 50. Therefore, in this second example, the information terminal 10 can use the connection information used when setting up the home appliance 50 to connect to the network 60, and which is stored in the terminal storage unit 14, to generate a read code. That is, in this case, the read code generated by the information terminal 10 represents the authentication key and the connection information used when setting up the home appliance 50 to connect to the network 60, and stored in the terminal storage unit 14.

[0113] The third example will now be explained. In this case, the information terminal 10 can use the connection information generated based on the input received by the receiving unit 16 of the information terminal 10 to generate the reading code. That is, in this case, the reading code generated by the information terminal 10 represents the authentication key and the connection information generated based on the input received by the receiving unit 16.

[0114] Figure 5 This is a diagram illustrating an example of a UI displayed on an information terminal for displaying connection information. UI 110 may be displayed on information terminal 10 after step S3.

[0115] UI110 includes connection information obtained from home appliance 50, or the SSID contained in the connection information used when setting up a communication connection with home appliance 50. Additionally, UI110 includes an OK button 111 for accepting input allowing the establishment of a communication connection via the prompted SSID, and a UI120 for accepting connection information specified by the user (see UI120). Figure 6 The input is directed to the designated button 112. When the information terminal 10 receives input to the OK button 111, it uses the connection information, including the prompted SSID, to generate the read code. When the information terminal 10 receives input to the designated button 112, it displays UI 120.

[0116] Figure 6 This is a diagram illustrating an example of a UI used to accept connection information from the user.

[0117] UI120 includes an input field 121 for accepting SSID input, an input field 122 for accepting a password for authenticating a communication connection via SSID, an OK button 123 for confirming the information entered in input fields 121 and 122, and a back button 124 for transitioning to UI110. When the information terminal 10 receives input to the OK button 123 after completing input to input fields 121 and 122, it generates connection information based on the input to input fields 121 and 122, and uses this connection information in the generation of a read-code. When the information terminal 10 receives input to the back button 124, it displays UI110.

[0118] Next, the process of establishing a communication connection between home appliance 50 and router 61 will be explained. The user connects home appliance 50 to router 61 using the UI provided by the specified application.

[0119] Figures 7 to 9 This is a flowchart illustrating an example of the processes performed by an information terminal to establish a communication connection. Figures 10 to 17 This is a diagram illustrating an example of the UI displayed by the information terminal during the process of establishing a communication connection.

[0120] The information terminal 10 displays a UI (S31) explaining how to operate the home appliance 50. Here, the display unit 15 of the information terminal 10 displays... Figure 10 The UI200 is shown below. Through UI200, the user knows that they need to press and hold the "Remote Operation" button on the home appliance 50 for more than 3 seconds. When the "Remote Operation" button is pressed and held for more than 3 seconds, the home appliance 50 switches from the normal operating mode to the communication connection mode. The normal operating mode and the communication connection mode will be explained later.

[0121] Next, the information terminal 10 determines whether to display the next UI (S32). When the user touches button 201 of UI 200, the information terminal 10 determines that the next UI should be displayed (S32 is "Yes"), and proceeds to step S33. Alternatively, if the information terminal 10 determines that the next UI should not be displayed until the user touches button 201 (S32 is "No"), no processing is performed (i.e., the display of UI 200 is maintained), and the process returns to step S32.

[0122] Next, the information terminal 10 displays a UI (S33) for users to select a connection method to connect the home appliance 50 to the router 61, which acts as an access point. Here, the display unit 15 of the information terminal 10 displays... Figure 11UI210 is shown. Through UI210, users can choose between a simple connection or a detailed connection method when connecting home appliances 50 to router 61.

[0123] Next, the information terminal 10 determines whether the connection method selected by the user is a simple connection or a detailed connection (S34). When the user touches button 211 of UI 210, the information terminal 10 determines that the user has selected a simple connection method and proceeds to step S35. Conversely, when the user touches button 212 of UI 210, the information terminal 10 determines that the user has selected a detailed connection method and proceeds to step S35. Figure 8 Step S41.

[0124] The simplified connection will now be explained. A simplified connection refers to a method that easily establishes a communication connection between home appliance 50 and router 61 by having both perform connection processing simultaneously. Information terminal 10 displays a UI (S35) explaining the operation methods of home appliance 50 and access point required for the simplified connection. Here, the display unit 15 of information terminal 10 displays... Figure 12 The UI220 is shown below. Through UI220, users can easily perform the operations required for connection. When the "Refrigerator" button on the control panel of the home appliance 50 is in communication connection mode, the home appliance 50 performs connection processing. Additionally, a communication connection can be established between the home appliance 50 and the router 61 by performing the same timed connection processing as that performed by the home appliance 50. The connection processing performed by the home appliance 50 will be explained later.

[0125] Next, the information terminal 10 determines whether to display the next UI (S36). When the user touches button 221 of UI 220, the information terminal 10 determines that the next UI should be displayed (S36 is "Yes"), and proceeds to step S37. Alternatively, until the user touches button 221, the information terminal 10 determines that the next UI should not be displayed (S36 is "No"), therefore no processing is performed (i.e., the display of UI 220 is maintained), and returns to step S36.

[0126] Next, in step S37, the information terminal 10 displays a UI to prompt the user to confirm that the home appliance 50 has been connected to the access point. Here, the display unit 15 of the information terminal 10 displays... Figure 13 UI230 is shown. Through UI230, the user can confirm whether the home appliance 50 is connected to the access point.

[0127] The detailed connection will be explained below. A detailed connection refers to the method of establishing a communication connection between home appliance 50 and router 61 by sending the SSID of router 61 and the password required to connect to router 61 to home appliance 50 from information terminal 10.

[0128] The information terminal 10 displays a UI (S41) explaining how to operate the home appliance 50. Here, the display unit 15 of the information terminal 10 displays... Figure 14 UI240 is shown. Through UI240, the user knows that the "Slight Freeze" button of the home appliance 50 needs to be pressed. When the "Slight Freeze" button on the operation panel of the home appliance 50 is pressed in the communication connection mode, the home appliance 50 starts to operate in soft AP mode.

[0129] Next, the information terminal 10 determines whether to display the next UI (S42). When the user touches button 241 of UI 240, the information terminal 10 determines that the next UI should be displayed (S42 is "Yes"), and proceeds to step S43. Alternatively, until the user touches button 241, the information terminal 10 determines that the next UI should not be displayed (S42 is "No"), therefore no processing is performed (i.e., the display of UI 240 is maintained), and returns to step S42.

[0130] Next, the information terminal 10 determines whether it is currently connected to an access point (S43). This determination is made by obtaining the SSID of the access point to which the information terminal 10 is currently connected from the OS of the information terminal 10. If the SSID of the access point to which the information terminal 10 is currently connected can be obtained from the OS, the information terminal 10 determines that it is currently connected to the access point (S43 is "Yes"), and the process proceeds to step S44. Alternatively, if the SSID of the access point to which the information terminal 10 is currently connected cannot be obtained from the OS, the information terminal 10 determines that it is not currently connected to the access point (S43 is "No"), and the process proceeds to step S48.

[0131] Next, the information terminal 10 stores the SSID of the access point currently connected to it (S44). If the access point currently connected to the information terminal 10 is router 61, then the information terminal 10 stores the SSID of router 61. Through the processing of steps S43 and S44, the information terminal 10 can obtain the SSID of the access point currently connected to it from the OS.

[0132] Next, the information terminal 10 connects to the home appliance 50 operating in soft AP mode (S45). The information terminal 10 sends a connection request to the home appliance 50 operating in soft AP mode. In this embodiment, as described in step S41, the home appliance 50 is operating in soft AP mode, therefore the information terminal 10 sends a connection request to the home appliance 50. Subsequently, a communication connection is established between the information terminal 10 and the home appliance 50.

[0133] In order for the information terminal 10 to connect to the home appliance 50 operating in soft AP mode, it is necessary for the information terminal 10 to determine the SSID of the home appliance 50 and the password required for connection. In this embodiment, the SSID and password of the home appliance 50 are predetermined during manufacturing, and these SSIDs and passwords are pre-embedded in the application. Therefore, when the information terminal 10 is installed, it can determine the SSID of the home appliance 50 and the password required for connection. For the user, since it is not necessary to specify the SSID of the home appliance 50 on the information terminal 10, nor is it necessary to enter the password required for connection on the information terminal 10, user convenience is improved. In addition, in one application, if no password is required when the information terminal 10 connects to the home appliance 50 operating in soft AP mode, then it is only necessary to pre-embed the SSID of the home appliance 50 in the application.

[0134] Next, the information terminal 10 determines whether the connection to the home appliance 50 operating in soft AP mode is successful (S46). When the information terminal 10 determines that the connection to the home appliance 50 operating in soft AP mode is successful (S46 is "Yes"), processing proceeds to... Figure 9 Step S51. Additionally, when the information terminal 10 determines that the connection to the home appliance 50 operating in soft AP mode has failed (S46 is "No"), the process proceeds to step S47.

[0135] Next, the information terminal 10 displays a UI (S51) for the user to enter the password required when connecting to the access point. Here, the display unit 15 of the information terminal 10 displays... Figure 17 UI270 is shown. In area 271 of UI270, the SSID stored in step S44 (in this embodiment, the SSID of router 61) is displayed. The user enters the password used to connect to the access point corresponding to the SSID displayed in UI270 into input box 272. Furthermore, the reason for accepting the password used to connect to the access point from the user is that the information terminal 10 cannot obtain this password from the OS.

[0136] Next, the information terminal 10 determines whether the password input has been completed (S52). When the user enters the password in the input box 272 and touches the button 273, the information terminal 10 determines that the password input has been completed (S52 is "Yes"), and proceeds to step S53. Alternatively, if the user does not enter the password in the input box 272 and touch the button 273, the information terminal 10 determines that the password input has not been completed (S52 is "No"), therefore no processing is performed (i.e., the display of UI 270 is maintained), and the process returns to step S52.

[0137] Next, the information terminal 10 sends the SSID stored in step S44 and the password entered by the user to the home appliance 50 through the established communication connection (S53). The information terminal 10 instructs the OS to send the SSID stored in step S44 and the password entered by the user, realizing the transmission from the information terminal 10 to the home appliance 50 under the control of the OS. In this embodiment, the SSID of the router 61 and the password required to connect to the router 61 are sent to the home appliance 50. Then, the home appliance 50 attempts to connect to the router 61 based on the received SSID and password.

[0138] Next, the information terminal 10 displays a UI (S54) to prompt the user to confirm that the home appliance 50 has been connected to the access point. Here, the display unit 15 of the information terminal 10 displays UI 230. Through UI 230, the user can confirm whether the home appliance 50 has been connected to the access point.

[0139] Next, in step S55, the information terminal 10 determines whether to restore the connection target of the information terminal 10 to the original access point. When the user touches button 231 of UI230 or when a predetermined time (e.g., 5 minutes) has elapsed while UI230 is displayed, the information terminal 10 determines that it should restore the connection target of the information terminal 10 to the original access point (S55 is "Yes"), and proceeds to step S56. Alternatively, if the information terminal 10 determines that it should not restore the connection target of the information terminal 10 to the original access point until the user touches button 231 (S55 is "No"), therefore no processing is performed (i.e., the display of UI230 is maintained), and the process returns to step S55.

[0140] Next, in step S56, the information terminal 10 restores its connection target to the original access point. The information terminal 10 sends an instruction to the OS to connect to the access point corresponding to the SSID stored in step S44. Under the control of the OS, the connection target of the information terminal 10 is restored to the original access point. In this embodiment, the connection target of the information terminal 10 is restored from the home appliance 50 to the router 61.

[0141] In this embodiment, during the detailed connection process, the connection target of the information terminal 10 has changed from the router 61 to the home appliance 50. If the information terminal 10 remains connected to the home appliance 50, the user will be unable to use the information terminal 10 as usual. In this embodiment, since the connection target of the information terminal 10 can be restored to the router 61 through the processing in step S56, the user's convenience is improved.

[0142] Next, return to Figure 8 The flowchart below describes the process when it is determined in step S46 that the connection to the home appliance 50 operating in soft AP mode has failed.

[0143] Information terminal 10 restores its connection target to the original access point (S47). Information terminal 10 sends an instruction to the OS to connect to the access point corresponding to the SSID stored in step S44. Under the control of the OS, the connection target of information terminal 10 is restored to the original access point. Information terminal 10 cannot connect to home appliance 50 operating in soft AP mode, indicating that detailed connection processing cannot continue. Therefore, in this embodiment, by restoring the connection target of information terminal 10 to the router 61 that information terminal 10 was originally connected to, user convenience is improved.

[0144] Additionally, in step S47, the information terminal 10 can also display... Figure 15 UI250. After confirming UI250, if the user performs a detailed connection again near the home appliance 50, it is possible to successfully connect the information terminal 10 to the home appliance 50 operating in soft AP mode.

[0145] Next, the process for determining in step S43 that the information terminal 10 is not currently connected to the access point will be explained. In step S48, the information terminal 10 displays a UI to prompt the user to connect the information terminal to the access point. Here, the display unit 15 of the information terminal 10 displays... Figure 16 UI260. To perform detailed connection, information terminal 10 needs to be connected to the access point. The user can confirm the need for information terminal 10 to connect to the access point by checking UI260.

[0146] Figure 18 and Figure 19 This is a flowchart illustrating an example of the processes performed by a home appliance to establish a communication connection.

[0147] When confirmed Figure 10When the user of UI200 presses and holds the "Remote Operation" button on the control panel for more than 3 seconds, the home appliance 50 switches from the normal operation mode to the communication connection mode (S61). The normal operation mode refers to the mode in which the home appliance 50 performs normal operation, such as cooling based on the temperature of each storage compartment (refrigerator, freezer, etc.) or defrosting via a defrosting heater. The communication connection mode refers to the mode in which the home appliance 50 connects to an access point via a simple connection or a detailed connection.

[0148] Next, the appliance 50 determines whether the connection method with the access point is a simple connection or a detailed connection (S62). When confirmed... Figure 12 When the user of UI220 presses the "Refrigerate" button on the control panel, the home appliance 50 determines that a simple connection is being performed and proceeds to step S63. Additionally, when confirmation... Figure 14 When the user of UI240 presses the "Slightly Freeze" button on the operation panel, the home appliance 50 determines that a detailed connection is to be executed and proceeds to step S68.

[0149] The functions of the buttons on the control panel of appliance 50 are applicable when appliance 50 is in normal operating mode, but not when appliance 50 is in communication connection mode. For example, the "Refrigerate" button is used to adjust the refrigerator compartment temperature in normal operating mode, but not in communication connection mode. In communication connection mode, the "Refrigerate" button is used by the user to input instructions to appliance 50 to connect appliance 50 to the access point. Similarly, the "Slightly Freeze" button is also used by the user to input instructions to appliance 50 to connect appliance 50 to the access point in communication connection mode. By using buttons used in normal operating mode, such as the "Refrigerate" button for adjusting the refrigerator compartment temperature, in communication connection mode, there is no need to add new buttons for communication connection mode. Furthermore, even if new buttons are needed for operation in communication connection mode, the number of new buttons can be reduced. Alternatively, instead of using a button like the "Refrigeration" button for adjusting the storage compartment temperature, a button related to the ice-making function, such as the "Quick Ice" button, can be used as a button for the user to input instructions to the appliance 50 to connect the appliance 50 to the access point.

[0150] The simplified connection will be described next. Home appliance 50 performs connection processing for simplified connection (S63). Home appliance 50 performs search processing conforming to WPS, AOSS, and Easy Start (Easy Wireless Start) methods, either in a time-division or parallel manner. Subsequently, when home appliance 50 discovers an access point operating in any of the WPS, AOSS, or Easy Start methods at the same time interval, it establishes a communication connection with that discovered access point.

[0151] Next, the home appliance 50 determines whether the connection to the access point is successful (S64). If a communication connection has been established with the access point through the connection processing in step S63, the home appliance 50 determines that the connection to the access point is successful (S64 is "Yes"), and the process proceeds to step S65. Alternatively, if a specified time (e.g., 2 minutes) has elapsed since the start of the connection processing in step S63 and a communication connection has not been established with the access point, the home appliance 50 determines that the connection to the access point has failed (S64 is "No"), and the process proceeds to step S67.

[0152] Next, the home appliance 50 notifies the user that it has connected to the access point (S65). The home appliance 50 notifies the user of this connection by illuminating an LED (lighting device) installed on the refrigerator door of the home appliance 50 in a specified color (e.g., blue). However, the method for notifying the user of connection to the access point is not limited to illuminating an LED or other lighting device; the home appliance 50 can also output a voice message to notify the user of connection to the access point. Furthermore, the home appliance 50 can instruct a designated smart speaker to output a voice message to notify the user of connection to the access point, and the smart speaker will then output the voice message.

[0153] Next, the home appliance 50 determines whether to return from the communication connection mode to the normal operating mode (S66). If a predetermined time (e.g., 1 minute) has elapsed since the execution of step S65, the home appliance 50 determines that it has returned from the communication connection mode to the normal operating mode (S66 is "Yes"), and the process proceeds to step S67. On the other hand, if the home appliance 50 determines that it will not return from the communication connection mode to the normal operating mode (S66 is "No") after the predetermined time has elapsed since the execution of step S65, it maintains the notification to the user and returns to step S66.

[0154] Next, the home appliance 50 returns from the communication connection mode to the normal operation mode (S67). Furthermore, even if the connection to the access point is determined to have failed in step S64, the process proceeds to step S67, where the home appliance 50 returns from the communication connection mode to the normal operation mode.

[0155] The detailed connection process will now be explained. Appliance 50 begins operating in soft AP mode (S68). The SSID of appliance 50 operating in soft AP mode, and the password required for external devices to connect to appliance 50 operating in soft AP mode, are predetermined during the manufacturing of appliance 50. Furthermore, these SSIDs and passwords are consistent with those pre-embedded in the application. Additionally, when an external device connects to appliance 50 operating in soft AP mode, a password may not be required. In this mode, only the SSID of appliance 50 needs to be pre-embedded in the application.

[0156] Next, the home appliance 50 determines whether a connection request for the home appliance 50 operating in soft AP mode has been received from an external device (S71). In this embodiment, the information terminal 10 sends a connection request to the home appliance 50 operating in soft AP mode (see...). Figure 8 (Step S45). When the home appliance 50 receives a connection request (S71 is "Yes"), the process proceeds to step S72. Alternatively, if a predetermined time (e.g., 2 minutes) has elapsed since the start of operation in soft AP mode and no connection request has been made for the home appliance 50 operating in soft AP mode (S71 is "No"), the process proceeds to step S78.

[0157] Next, the home appliance 50 establishes a communication connection with the external device that sent the connection request (S72). In this embodiment, a communication connection is established between the home appliance 50 and the information terminal 10.

[0158] Next, the home appliance 50 determines whether it has received the SSID of the access point and the password required to connect to the access point from the external device connected to the home appliance 50 (S73). In this embodiment, the information terminal 10 sends the SSID of the router 61 and the password required to connect to the router 61 to the home appliance 50 (see...). Figure 9 (Step S53). When the home appliance 50 receives the SSID of the access point and the password required to connect to the access point from the external device (S73 is "Yes"), the process proceeds to step S74. Alternatively, if a predetermined time (e.g., 2 minutes) has elapsed since the home appliance 50 established a communication connection with the external device, and the home appliance 50 has still not received the SSID of the access point and the password required to connect to the access point (S73 is "No"), the process proceeds to step S78.

[0159] Next, the home appliance 50 connects to the access point based on the SSID and password received from the external device (S74). In this embodiment, a communication connection is established between the home appliance 50 and the access point.

[0160] Next, the appliance 50 determines whether the connection to the access point is successful (S75). When the appliance 50 determines that the connection to the access point is successful (S75 is "Yes"), the process proceeds to step S76. Conversely, when the appliance 50 determines that the connection to the access point fails (S75 is "No"), the process proceeds to step S78.

[0161] Next, appliance 50 notifies the user that it has been connected to the access point (S76). The processing in step S76 is related to... Figure 18 The process described in step S65 is the same. It should be noted that, unlike step S65, in step S76, the home appliance 50 establishes a communication connection not only with the router 61 but also with the information terminal 10. Therefore, the home appliance 50 can notify the information terminal 10 that it has connected to the access point, and the information terminal 10 can then display this information on the display unit 15.

[0162] Next, the home appliance 50 determines whether to return from the communication connection mode to the normal operating mode (S77). If a predetermined time (e.g., 1 minute) has elapsed after the processing of step S76, or if the communication connection between the home appliance 50 and the information terminal 10 is cut off, the home appliance 50 determines that it will return from the communication connection mode to the normal operating mode (S77 is "Yes"), and the process proceeds to step S78. Alternatively, if the home appliance 50 determines that it will not return from the communication connection mode to the normal operating mode (S77 is "No") after the predetermined time has elapsed since the processing of step S76, it maintains the notification to the user and returns to step S77.

[0163] Next, the home appliance 50 returns from the communication connection mode to the normal operation mode (S78). Furthermore, in step S78, the home appliance 50 terminates its soft AP mode operation. It should be noted that even if it is determined in step S71 that no connection request has been received from the external device, the process proceeds to step S78, and the home appliance 50 returns from the communication connection mode to the normal operation mode. Similarly, even if it is determined in step S73 that no SSID and password have been received, the process proceeds to step S78, and the home appliance 50 returns from the communication connection mode to the normal operation mode. Additionally, even if it is determined in step S75 that the connection to the access point has failed, the process proceeds to step S78, and the home appliance 50 returns from the communication connection mode to the normal operation mode.

[0164] As described above, in the detailed connection steps, the information terminal 10 sends the SSID of router 61 and the password required to connect to router 61 to the home appliance 50. Then, the home appliance 50 establishes a communication connection with router 61 based on the received SSID and password. Therefore, even if the user does not specify router 61 as the connection target of home appliance 50, a communication connection can be established between home appliance 50 and router 61.

[0165] In the above process, the information terminal 10 and the home appliance 50 store the SSID and password, which are set as connection information when the home appliance 50 establishes a communication connection with the network 60. Therefore, the information terminal 10 can use the connection information stored in the information terminal 10 or the connection information stored in the home appliance 50 to generate a reading code.

[0166] [3. Specific examples of registration processing] Figure 3 The registration process in System 1 described in this embodiment can also be as follows: Figures 20 to 23 Perform it as explained.

[0167] Figures 20 to 23 This is a timing diagram illustrating a specific example of the registration process in the system according to this embodiment. It should be noted that... Figure 21 The timing diagram shows Figure 20 The subsequent part of the timing diagram, Figure 22 The timing diagram shows Figure 21 The subsequent part of the timing diagram, Figure 23 The timing diagram shows Figure 22 The subsequent part of the timing diagram.

[0168] Information terminal 10 accepts application launch operation (S101).

[0169] In step S101, the application is executed, and the information terminal 10 displays the application home screen (S102).

[0170] Information terminal 10 accepts input for logging into system 1 (S103). Specifically, information terminal 10 accepts user information (user ID) and password.

[0171] The information terminal 10 sends the accepted user ID and password to the server 20 (S104).

[0172] When the server 20 receives the user ID and password from the information terminal 10, it performs a login process to the system 1 based on the received user ID and password (S105).

[0173] After performing the login process, server 20 sends an SSO (Single Sign On) token to information terminal 10 (S106).

[0174] When the information terminal 10 receives the SSO token, it displays a UI for accepting input for starting the camera device 40 settings and accepts the input for starting the settings (S107).

[0175] When the information terminal 10 receives the input for initial setup, it displays a usage license screen (S108). The usage license screen is a screen used to receive input from the user indicating whether they agree to the usage license.

[0176] When the information terminal 10 receives an input indicating consent on the permission screen (S109), it requests an access token (S110). The token request may include a user ID. An access token is an example of an authentication key.

[0177] When server 20 receives a request for a token, it extracts the user ID from the token request (S111). Alternatively, server 20 may also extract the user ID from information stored on server 20 based on the token request.

[0178] After retrieving the user ID, server 20 generates an access token (S112), and establishes a correspondence between the generated access token and the user ID and stores it (S113).

[0179] Server 20 sends the generated access token to information terminal 10 (S114).

[0180] When the information terminal 10 receives the access token from the server 20, it generates a QR code (S115) containing connection information (SSID and password) for establishing a communication connection with the network 60 and the access token. The QR code is an example of a code for reading.

[0181] Next, the information terminal 10 displays a screen that prompts the user to turn on the power of the camera device 40 (S116).

[0182] The camera device 40 enters the power-on state by accepting the power-on operation (S117).

[0183] Next, the camera device 40 determines whether the Wi-Fi setup has been completed (i.e., whether the communication connection setup has been completed) (S118).

[0184] When the camera device 40 has completed the Wi-Fi setup (S118 is "Yes"), the LED of the camera device 40 is lit up in green (S119).

[0185] Next, the camera device 40 is started in normal mode (S120).

[0186] Next, the camera device 40 can also accept the pressing of the Wi-Fi setting button (S121). In this case, the camera device 40 can reconfigure the Wi-Fi settings.

[0187] When the camera device 40 has not completed the Wi-Fi setup (S118 is "No"), or when the Wi-Fi setup button is pressed, the camera device 40 flashes its LED in green (S122) and enters a state of waiting to recognize the QR code (S123).

[0188] Additionally, after step S116, if the information terminal 10 finds that the LED of the camera device 40 is not flashing, it displays a screen prompting the user to press the Wi-Fi setting button of the camera device 40 (S124).

[0189] Information terminal 10 displays the QR code after step S124 (S125).

[0190] When the camera device 40 is waiting to recognize the QR code, if it detects the QR code in multiple images obtained by taking pictures of the QR code displayed on the information terminal 10 (S126), it determines whether the QR code has been detected in multiple images (S127).

[0191] When the camera device 40 detects a QR code in all images (S127 is "Yes"), the process proceeds to the next step S128. If it fails to detect a QR code (S127 is "No"), it returns to step S126. Alternatively, even if a QR code is detected but cannot be decoded (S127 is "No"), it also returns to step S126.

[0192] The camera device 40 decodes the QR code to obtain the SSID, password and access token (S128).

[0193] After step S128, the camera device 40 makes the buzzer sound once (S129).

[0194] The camera device 40 causes its LEDs to flash blue (S130).

[0195] The camera device 40 establishes a Wi-Fi connection using the SSID and password obtained through decoding (S131).

[0196] The camera device 40 stores the SSID and password in the local area (S132) and lights up its LED in blue (S133).

[0197] After step S133, camera device 40 sends a device registration request to server 30 (S134). The device registration request includes camera information.

[0198] When the server 30 receives the device registration request, it sends the response information to the camera device 40 (S135).

[0199] When the camera device 40 receives the response information, it sends the camera information and access token to the server 20 (S136).

[0200] When the server 20 receives camera information and access token from the camera device 40, it compares the received access token with the access tokens already issued by the server 20 (S137).

[0201] After step S136, the camera device 40 lights up its LED to green (S138) and makes the buzzer sound twice (S139).

[0202] After step S125, information terminal 10 sends a request to server 20 regarding camera information and model (S141). The request includes an SSO token and an access token.

[0203] When the server 20 receives a request for camera information and model from the information terminal 10, it uses the access token contained in the request as a key to obtain the data (camera information and model) (S142).

[0204] The server 20 sends the obtained camera information and model to the information terminal 10 (S143).

[0205] Additionally, the information terminal 10 begins monitoring for timeouts (S140) after step S125. For example, the information terminal 10 can start timing from the end of step S125 and repeatedly execute the process of step S141 until a specified time (e.g., 3 minutes) has elapsed, determining whether it can receive camera information and model number sent from server 20 in step S143. When the information terminal 10 fails to receive camera information and model number within the specified time, it can return to step S125 and repeat step S125 and subsequent processes; or it can cancel the registration process and end. Not limited to the above methods, when the information terminal 10 fails to receive camera information and model number within the specified time, it can display a UI for the user to choose from: returning to step S125 and repeating step S125 and subsequent processes, or choosing to cancel the registration process and end, and can perform corresponding processing based on the input received in the UI.

[0206] After step S143, the information terminal 10 sends a request for device registration status to the server 20 (S144).

[0207] When server 20 receives a request for device registration status from information terminal 10, it sends the request for device registration status to server 30 (S145).

[0208] When server 30 receives a request for device registration status from server 20, it sends a device registration completion notification to server 20 (S146).

[0209] When server 20 receives the device registration completion notification from server 30, it sends the device registration completion notification to information terminal 10 (S147).

[0210] Information terminal 10 accepts input from the user (S148). The input accepted here is information such as the purchase date of camera device 40 and user nickname.

[0211] The information terminal 10 sends a device registration instruction containing the information input in step S148 to the server 20 (S149). The device registration instruction contains hashed camera information, the model of the camera device 40, and the device ID used for communication.

[0212] When server 20 receives input information from information terminal 10, it sends a device registration request to server 30 (S150). The device registration request includes an encrypted user ID and a device ID used for communication.

[0213] When server 30 receives a device registration request from server 20, it performs a registration comparison (S151) by comparing the request with the device registration status received in step S145.

[0214] When the registration comparison results match, server 30 establishes a correspondence between the user ID and the camera information and stores it (S152).

[0215] After step S150, server 20 performs home appliance registration processing (S153) to establish a correspondence between the model number and the device ID used for communication and to store it.

[0216] After step S153, server 20 sends a device registration completion notification to information terminal 10 (S154).

[0217] Server 20 deletes the corresponding association between the access token and the user ID (S155).

[0218] [4. Effects, etc.] The system 1 according to this embodiment includes: a server 20, an information terminal 10 that can be communicatively connected to the server 20 via a network 60, and a camera device 40 with communication function. The information terminal 10 includes: a terminal acquisition unit 11 that receives an authentication key from the server 20; a generation unit 13 that generates an optical readout code representing the authentication key; a display unit 15 that displays the generated readout code; a terminal storage unit 14 that stores user information for identifying the user; and a terminal transmission unit 12 that sends the user information to the server 20. The camera device 40 includes: an image sensor 41; a decoding unit 42 that decodes the authentication key represented by the readout code based on an image obtained by capturing the image displayed on the information terminal 10 by the image sensor 41; a camera storage unit 43 that stores camera information for identifying the camera device 40; and a camera communication unit 44 that sends the authentication key and the camera information stored in the camera storage unit 43 to the server 20. The server 20 establishes a correspondence between the user information sent by the information terminal 10 and the camera information sent by the camera device 40 along with the authentication key, and stores the correspondence.

[0219] With the above configuration, the information terminal 10 displays a read code representing the authentication key obtained from the server 20, which the camera device 40 reads. The camera device 40 decodes the read code to obtain the authentication key, which, along with the camera information, is then sent to the server 20. This allows the camera information of the camera device that the user wants to register with the server using the information terminal to be sent to the server. In other words, without accessing the server 20 through the information terminal 10, the read code for the camera device 40 cannot be obtained; therefore, the possibility of the camera device 40 sending camera information by reading a fake read code is suppressed. In this way, since the server 20 can obtain legitimate camera information from the camera device 40, it can establish a correspondence between user information and legitimate camera information and store it.

[0220] Furthermore, in System 1 of this embodiment, if the authentication key received by the server 20 from the camera device 40 along with the camera information is an authentication key that has been sent before, the server 20 determines that the camera information is legitimate, and establishes a correspondence between the received user information and the camera information that has been determined to be legitimate and stores it.

[0221] Accordingly, server 20 can establish a correspondence between user information and camera information that is deemed legitimate.

[0222] Furthermore, in System 1 according to this embodiment, when the server 20 receives camera information from the camera device 40, it sends the received camera information to the information terminal 10. When the terminal sending unit 12 sends user information to the server 20, it sends the camera information received from the server 20 along with the user information to the server 20. If the camera information received from the information terminal 10 along with the user information is previously sent camera information, the server 20 determines that the user information is legitimate, and establishes a correspondence between the legitimate user information and the camera information and stores it.

[0223] Accordingly, server 20 is able to establish a correspondence between user information that is judged to be legitimate and camera information that is judged to be legitimate.

[0224] Furthermore, in System 1 according to this embodiment, the terminal acquisition unit 11 also acquires connection information for connecting to the network 60. The generation unit 13 generates a reading code representing the authentication key and connection information. The decoding unit 42 decodes the authentication key and connection information represented by the reading code. The camera communication unit 44 establishes communication with the network 60 using the connection information, and after establishing communication, sends the authentication key and camera information to the server 20.

[0225] Therefore, the camera device 40 can easily establish communication with the network 60.

[0226] Furthermore, in System 1 according to this embodiment, System 1 also includes a home appliance 50 that has established a communication connection with the network 60 using connection information. The home appliance 50 stores the connection information. The terminal acquisition unit 11 acquires the connection information from the home appliance 50 via the network 60.

[0227] Accordingly, since the camera device 40 uses the connection information stored in the home appliance 50 that is connected to the network 60 to establish communication with the network 60, it can easily establish communication with the network 60.

[0228] Furthermore, the system 1 according to this embodiment also includes a home appliance 50 that establishes a communication connection with the network 60 using connection information. The terminal storage unit 14 stores the connection information used when setting up the communication connection of the home appliance 50. The terminal acquisition unit 11 acquires the connection information from the terminal storage unit 14.

[0229] Accordingly, since the camera device 40 uses the connection information used when setting up the communication connection with the home appliance 50 to establish communication with the network 60, it can easily establish communication with the network 60.

[0230] Furthermore, in the system 1 according to this embodiment, the information terminal 10 also includes a receiving unit 16 for receiving input from a user. The terminal acquisition unit 11 acquires connection information generated based on the input received by the receiving unit 16.

[0231] Accordingly, since the camera device 40 uses connection information generated based on user input to establish communication with the network 60, the user can enable the camera device 40 to establish communication with the desired connection information.

[0232] Furthermore, in System 1 of this embodiment, the authentication key becomes invalid after a first period following its transmission by the server 20.

[0233] Therefore, it can prevent third parties from maliciously using the authentication key, and ensure that camera information and user information are linked and stored in server 20.

[0234] Furthermore, in the system 1 described in this embodiment, the reading code becomes invalid after the generation unit 13 generates it, once the second period has elapsed.

[0235] Therefore, it can prevent third parties from maliciously using the reading code, and ensure that camera information and user information are linked and stored in server 20.

[0236] Furthermore, the information terminal 10 involved in this embodiment is the information terminal 10 in system 1. The information terminal 10 includes: a terminal acquisition unit 11, which acquires an authentication key from a server 20, the authentication key being used to enable the server 20 to authenticate information received together with the authentication key as legitimate; a generation unit 13, which generates an optical reading code representing the authentication key; a display unit 15, which displays the reading code generated by the generation unit 13 for the camera device 40 to read; a terminal storage unit 14, which stores user information for identifying the user; and a terminal transmission unit 12, which transmits the user information to the server 20.

[0237] Accordingly, the information terminal 10 displays a read code representing the authentication key obtained from the server 20, and the camera device 40 reads it. For example, this can be used to make the camera device 40 send the authentication key obtained by decoding the read code, along with camera information, to the server 20. Since the read code for the camera device 40 to read cannot be obtained without accessing the server 20 through the information terminal 10, the possibility of the camera device 40 sending camera information by reading a fake read code can be suppressed.

[0238] [5. Other] Furthermore, in the above embodiments, each component can be constructed using dedicated hardware, or it can be implemented by executing software programs suitable for each component. Each component can also be implemented by having a program execution unit such as a CPU or processor read and execute software programs recorded on a recording medium such as a hard disk or semiconductor memory. Here, the software used to implement the system, information terminal, server, camera device, etc., in the above embodiments is a program that causes the computer to execute the steps included in the flowchart shown in the figure.

[0239] In addition, the following situations are also included in this disclosure.

[0240] (1) The aforementioned devices are specifically computer systems composed of microprocessors, ROM, RAM, hard disk units, display units, keyboards, mice, etc. Computer programs are stored in the RAM or hard disk units. Each device performs its function by having the microprocessor run according to the computer program. Here, the computer program is composed of a combination of instruction codes that issue instructions to the computer in order to perform the specified function.

[0241] (2) Some or all of the constituent elements of the above-mentioned devices may also be constituted by a system LSI (Large Scale Integration). A system LSI is a multifunctional LSI manufactured by integrating multiple constituent parts on a single chip. Specifically, it is a computer system composed of a microprocessor, ROM, RAM, etc. The computer program is stored in the RAM. The system LSI performs its functions by causing the microprocessor to run according to the computer program.

[0242] (3) Some or all of the constituent elements of the above-mentioned devices may also be composed of detachable IC cards or independent modules. The IC card or module is a computer system composed of a microprocessor, ROM, RAM, etc. The IC card or module may also include the aforementioned multi-functional LSI. The IC card or module performs its functions by causing the microprocessor to run according to a computer program. The IC card or module may also be tamper-resistant.

[0243] (4) This disclosure may also be the method shown above. In addition, it may be a computer program that implements these methods, or a digital signal composed of such a computer program.

[0244] Alternatively, this disclosure may also involve recording the computer program or the digital signal on a computer-readable recording medium, such as a floppy disk, hard disk, CD-ROM, MO, DVD, DVD-ROM, DVD-RAM, BD (Blu-ray Disc), semiconductor memory, etc. The digital signal may also be recorded on these recording media.

[0245] Alternatively, the computer program or the digital signal may also be transmitted via telecommunications lines, wireless or wired communication lines, networks such as the Internet, data broadcasting, etc.

[0246] Alternatively, this disclosure can also be a computer system having a microprocessor and a memory, wherein the memory stores the aforementioned computer program, and the microprocessor runs according to the computer program.

[0247] Alternatively, this disclosure can also be implemented by other independent computer systems by recording the program or the digital signal onto the recording medium and transferring it, or by transferring the program or the digital signal via the network or the like.

[0248] Industrial availability This disclosure has application value as a system that can establish a correspondence between user information and legitimate camera information and store it.

[0249] Explanation of reference numerals in the attached figures 1: System 10: Information Terminal 11: Terminal Acquisition Department 12: Terminal Transmission Unit 13: Generation Department 14: Terminal Storage Department 15: Display Section 16: Receiving Department 20, 30: Server 21, 31: Ministry of Communications 22, 32: Storage Section 23, 33: Control Department 40: Camera device 41: Image Sensor 42: Decoding Department 43: Camera Storage Department 44: Camera Communications Department 50: Home appliances 60: Network 61: Router.

Claims

1. A system in which a camera device with communication capabilities communicates via a network with a server capable of communicating with an information terminal. The information terminal has: The terminal acquisition unit receives the authentication key from the server; The generation unit generates an optical readout code representing the authentication key; The display unit displays the generated reading code; The terminal storage unit stores user information used to identify the user; as well as The terminal sending unit sends the user information to the server. The camera device has: The decoding unit decodes the authentication key represented by the reading code based on an image obtained by capturing the image of the reading code displayed on the information terminal using the image sensor of the camera device. Camera storage unit stores camera information used to identify the camera device; as well as The camera communication unit sends the authentication key and the camera information stored in the camera storage unit to the server. The server establishes a correspondence between the user information sent by the information terminal and the camera information sent by the camera device along with the authentication key, and stores them.

2. The system as described in claim 1, If the authentication key received by the server from the camera device along with the camera information is a previously sent authentication key, the server determines that the camera information is legitimate, and establishes a correspondence between the received user information and the camera information that has been determined to be legitimate, and stores it.

3. The system as described in claim 1 or 2, When the server receives the camera information from the camera device, it sends the received camera information to the information terminal. When the terminal sending unit sends the user information to the server, it also sends the camera information received from the server along with the user information to the server. If the camera information received by the server along with the user information from the information terminal is camera information that has already been sent, the server determines that the user information is legitimate, and establishes a correspondence between the user information determined to be legitimate and the camera information and stores it.

4. The system as described in claim 1 or 2, The terminal acquisition unit also acquires connection information for connecting to the network. The generation unit generates a read code representing the authentication key and the connection information. The decoding unit decodes the authentication key and the connection information represented by the read code. The camera communication unit uses the connection information to establish communication with the network, and after establishing communication, sends the authentication key and the camera information to the server.

5. The system as described in claim 4, The terminal acquisition unit acquires the connection information from a home appliance that stores the connection information and has established a communication connection with the network using the connection information, via the network.

6. The system as described in claim 4, The terminal storage unit stores the connection information used when setting up communication connections for home appliances, and the home appliances are those that have established communication connections with the network using the connection information. The terminal acquisition unit obtains the connection information from the terminal storage unit.

7. The system as described in claim 4, The information terminal also has a receiving unit for accepting input from the user. The terminal acquisition unit acquires the connection information generated based on the input received by the receiving unit.

8. The system as described in claim 1 or 2, The authentication key expires after a first period following its transmission by the server.

9. The system as described in claim 1 or 2, The reading code becomes invalid after a second period following its generation by the generation unit.

10. An information terminal capable of communicating with a server via a network, wherein the server is capable of communicating with a camera device having communication capabilities. The information terminal has the following features: The terminal acquisition unit acquires an authentication key from the server, the authentication key being used by the server to authenticate the information received together with the authentication key as legitimate; The generation unit generates an optical readout code representing the authentication key; The display unit displays the reading code generated by the generation unit in order for the camera device to read it; The terminal storage unit stores user information used to identify the user; as well as The terminal sending unit sends the user information to the server.

11. A communication setting method for a camera device with communication capabilities to communicate via a network with a server capable of communicating with an information terminal, wherein in the communication setting method, The information terminal obtains the authentication key from the server. The information terminal generates an optical readout code representing the authentication key. The information terminal displays the generated reading code. The information terminal sends user information used to identify the user to the server. The camera device captures the reading code displayed on the information terminal. The camera device decodes the authentication key represented by the read code based on the image obtained by capturing it. The camera device sends the authentication key and camera information used to identify the camera device to the server. The server establishes a correspondence between the user information sent by the information terminal and the camera information sent by the camera device along with the authentication key, and stores them.

Images