Authentication system, authentication method, authentication program, and specific system

Abstract

To provide a system that easily authenticates a smart device with a simple configuration and appropriately authenticates a specified smart device.SOLUTION: In an authentication system, a server 5 includes: a communication unit 26 that continuously receives display information 36 of a displayed state screen from each operation device 2; a storage unit 34 that stores a specific information database 42 in which a specific portion 8 of the state screen related to the display information 36 received by the communication unit 26 and the operating device 2 that transmits the display information 36 are associated with time information; a screen extraction unit 29 that obtains a screen image 37 of the state screen displayed on the display unit of the operation device 2 captured by an imaging device 21 and extracts the specific portion 8 from the screen image 37; a specification unit 45 that specifies the operating device 2 that transmits the display information 36 corresponding to the extracted specific portion 8 from the specific information database 42; and an authentication unit 47 that authenticates a smart device 10 that captures the screen image 37 in association with the specified operation device 2.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present invention relates to an authentication system, an authentication method, an authentication program, and an identification system for identifying a device, which authenticates an operating device that remotely operates the device. [Background technology]

[0002] As disclosed in Patent Document 1, an appliance (hot water supply system) may be remotely operated (remotely controlled) by a smart device (mobile terminal device) via a server. For a smart device to be able to remotely operate an appliance, the appliance and the smart device must be paired in advance. In the pairing, for example, a password is issued in response to the smart device sending identification information, and the smart device is authenticated by receiving the password, and the appliance and the smart device are paired. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2020-95650 A Summary of the Invention [Problem to be solved by the invention]

[0004] While pairing between a device and a smart device needs to be an easy procedure, it is also necessary to properly authenticate the smart device to prevent unauthorized remote control of the device.

[0005] An object of the present invention is to easily identify a smart device with a simple configuration, and further to properly authenticate the identified smart device. [Means for solving the problem]

[0006] In order to achieve the above object, a characteristic configuration of an authentication system according to one embodiment of the present invention is an authentication system that authenticates a smart device to allow remote operation of an appliance by the smart device, the authentication system including: an operation device having a display unit that displays a status screen that changes according to a state of the appliance, and that operates the corresponding appliance; an imaging device included in the smart device; a communication unit that is capable of communicating with a plurality of the operation devices and the smart device that operate the corresponding appliance, and that continuously receives display information of the displayed status screen from each of the operation devices; and a specific information database that stores a unique portion of the status screen related to the display information received by the communication unit and the operation device that transmitted the display information, together with time information. a storage unit for storing the status screen displayed on the display unit of the operation device, a screen extraction unit for acquiring a screen image captured by the imaging device of the status screen displayed on the display unit of the operation device and extracting the characteristic part from the screen image, a specification unit for specifying the operation device that transmitted the display information corresponding to the extracted characteristic part from the specific information database, and an authentication unit for authenticating the smart device that captured the screen image by linking it with the specified operation device, and allowing the authenticated smart device to operate the device, and the status screen changes to one of a plurality of status display screens, and includes a fixed part that is fixed in all of the status display screens, the characteristic part that is fixed in the same status display screen, and a changing part that changes depending on the status of the device. The specific information database associates the unique portion and the changed portion of the status screen related to the display information received by the communication unit with the operation device that transmitted the display information together with time information, the screen extraction unit extracts the changed portion in addition to the unique portion, and the identification unit identifies the operation device that transmitted the display information from the extracted unique portion and the changed portion. It is at the point.

[0007] Furthermore, a characteristic configuration of an authentication method according to an embodiment of the present invention is an authentication method for authenticating a smart device to allow remote operation of an appliance by the smart device, the authentication method comprising the steps of: continuously transmitting display information of a status screen displayed on each of a plurality of operation devices that operate the corresponding appliance from each of the operation devices; generating a specific information database in which a unique portion of the status screen related to the display information is associated with the operation device that transmitted the display information together with time information; capturing the displayed status screen of the appliance as a screen image with the smart device; extracting the unique portion from the screen image; identifying the operation device that transmitted the display information corresponding to the extracted unique portion from the specific information database; and authenticating the smart device that captured the screen image by linking it to the identified operation device; allowing the authenticated smart device to operate the appliance; the status screen changes to one of a plurality of status display screens, and includes a fixed portion that is fixed in all of the status display screens, the unique portion that is fixed in the same status display screen, and a changing portion that changes according to the state of the appliance. In the specific information database, the unique portion and the changed portion of the status screen related to the display information transmitted by the operation device are associated with the operation device that transmitted the display information together with time information, the step of extracting the unique portion from the screen image extracts the changed portion in addition to the unique portion, and the step of identifying the operation device identifies the operation device that transmitted the display information from the extracted unique portion and the changed portion. It's at the point.

[0008] Furthermore, a characteristic configuration of an authentication program according to an embodiment of the present invention is an authentication program for authenticating a smart device to allow remote operation of an appliance by the smart device, the authentication program having a computer execute a function of continuously transmitting display information of a status screen displayed on each of a plurality of operation devices that operate the corresponding appliance from the respective operation devices, generating a specific information database in which a unique portion of the status screen related to the display information is associated with the operation device that transmitted the display information together with time information, a function of acquiring a screen image of the status screen of the appliance to be displayed, a function of extracting the unique portion from the screen image, a function of identifying the operation device that transmitted the display information corresponding to the extracted unique portion from the specific information database, and a function of authenticating the smart device that captured the screen image by linking it with the identified operation device, and allowing the appliance to be operated by the authenticated smart device, the status screen changing to one of a plurality of status display screens, including a fixed portion that is fixed in all of the status display screens, the unique portion that is fixed in the same status display screen, and a variable portion that changes according to the status of the appliance. The specific information database associates the unique portion and the changed portion of the status screen related to the display information transmitted by the operation device with the operation device that transmitted the display information together with time information, the function of extracting the unique portion from the screen image extracts the changed portion in addition to the unique portion, and the function of identifying the operation device identifies the operation device that transmitted the display information from the extracted unique portion and the changed portion. It is at the point.

[0009] With this configuration, the portion of the screen image used to identify the operating device becomes clear, and the operating device displaying the status screen corresponding to the captured screen image can be easily identified. Then, by authenticating the smart device that captured the status screen displayed by the identified operating device as the smart device to be used for remotely controlling the operating device, it is possible to easily allow the authenticated smart device to remotely control the equipment while maintaining security. In addition, the same status display screen may be displayed on multiple operating devices, and it may be difficult to identify an operating device from only the unique portion. On the other hand, since the variable portion changes according to the state of the device, it is often different for each device, and it is rare for both the unique portion and the variable portion to be exactly the same as a status display screen. Therefore, by using not only the unique portion but also the changing portion, the probability of identifying the operating device displaying the status display screen is increased.

[0015] Furthermore, at least one of the storage unit, the screen extraction unit, the identification unit, and the authentication unit may be mounted on the smart device.

[0016] With this configuration, the system can be easily constructed.

[0017] The system may further include a server capable of communicating with a plurality of the operating devices and the smart device, the communication unit being mounted on the server, and at least one of the memory unit, the screen extraction unit, the identification unit, and the authentication unit being mounted on either the smart device or the server.

[0018] Such a configuration makes it easy to optimize the configuration of the smart device or the operating device.

[0019] The smart device may also be a mobile terminal.

[0020] With this configuration, a remote control configuration can be easily constructed.

[0021] Furthermore, a characteristic configuration of an identification system according to an embodiment of the present invention includes an operation device having a display unit that displays a status screen that changes depending on the status of a device and that operates the corresponding device, a smart device having an imaging device, a communication unit that can communicate with a plurality of operation devices and the smart device that operate the corresponding device and continuously receives display information of the displayed status screen from each of the operation devices, a storage unit that stores a specific information database in which a unique part of the status screen related to the display information received by the communication unit and the operation device that transmitted the display information are associated with each other together with time information, a screen extraction unit that acquires a screen image of the status screen displayed on the display unit of the operation device captured by the imaging device and extracts the unique part from the screen image, and an identification unit that identifies the operation device that transmitted the display information corresponding to the extracted unique part from the specific information database, and the status screen changes to one of a plurality of status display screens, and includes a fixed part that is fixed in all of the status display screens, the unique part that is fixed in the same status display screen, and a changing part that changes depending on the status of the device. The specific information database associates the unique portion and the changed portion of the status screen related to the display information received by the communication unit with the operation device that transmitted the display information together with time information, the screen extraction unit extracts the changed portion in addition to the unique portion, and the identification unit identifies the operation device that transmitted the display information from the extracted unique portion and the changed portion. It is at the point.

[0022] With this configuration, the portion of the screen image that is used to identify the operating device becomes clear, and the operating device that is displaying the status screen that corresponds to the captured screen image can be easily identified. In addition, the same status display screen may be displayed on multiple operating devices, and it may be difficult to identify an operating device from only the unique portion. On the other hand, since the variable portion changes according to the state of the device, it is often different for each device, and it is rare for both the unique portion and the variable portion to be exactly the same as a status display screen. Therefore, by using not only the unique portion but also the changing portion, the probability of identifying the operating device displaying the status display screen is increased. [Brief description of the drawings]

[0023] [Figure 1] 1 is a conceptual diagram illustrating a relationship between devices and a remote control for operating the devices. [Diagram 2] 11A to 11C are diagrams illustrating examples of status screens and screen transitions. [Diagram 3] FIG. 1 illustrates an example of a configuration of an authentication system. [Figure 4] FIG. 11 is a diagram showing a process flow for authenticating a mobile terminal. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0024] [Remote control] First, the remote control 2 for operating the device 1 will be described with reference to FIG.

[0025] As shown in FIG. 1, a device 1 such as a water heater is operated by a remote control (corresponding to an "operation device") 2 connected by wire or wirelessly. The remote control 2 is associated with the device 1 to be operated, and can operate the corresponding device 1. The remote control 2 includes a display unit 3 and various switches 4. The display unit 3 is a touch panel, and displays a status screen 6 (see FIG. 2) that changes depending on the state of the device 1. The remote control 2 is operated by operating the buttons and switches 4 displayed on the status screen 6 while referring to the status screen 6 displayed on the display unit 3.

[0026] The remote control 2 is connected to the server 5 via a communication line such as the Internet in a state in which wired or wireless data communication is possible. The server 5 can communicate with multiple remote controls 2, and can collect information from each remote control 2 and / or the device 1 to which each remote control 2 is connected, and can provide the information to each remote control 2 and / or the device 1.

[0027] In addition to the remote control 2, the device 1 can also be remotely controlled by a mobile terminal (corresponding to a "smart device") 10. The mobile terminal 10 is capable of wired or wireless data communication with the server 5 via a communication line such as the Internet. The mobile terminal 10 can connect to the remote control 2 via the server 5 and control the remote control 2 to remotely control the device 1. Alternatively, the remote control 2 and the mobile terminal 10 may be configured to communicate directly via a communication line. In this case, the mobile terminal 10 can directly connect to the remote control 2 without going through the server 5 and control the remote control 2 to remotely control the device 1. Furthermore, the mobile terminal 10 can directly connect to the device 1 without going through the remote control 2 to operate the device 1.

[0028] In order to enable remote control of the device 1 by the mobile terminal 10, it is necessary to authenticate the mobile terminal 10 as a terminal permitted for remote control and pair the mobile terminal 10 with the remote control 2 or the device 1. The authentication of the mobile terminal 10 will be described later.

[0029] Next, referring to Fig. 1, a status screen 6 displayed on the display unit 3 of the remote control 2 will be described using Fig. 2. Here, a hot water supply system capable of hot water supply, heating, and power generation will be described as an example of the device 1. This hot water supply system is also assumed to be capable of selling generated electricity to a power company and purchasing electricity from the power company when there is a power shortage.

[0030] 2, the status screen 6 displayed on the display unit 3 of the remote control 2 changes to a number of types of status display screens. For example, the status screen 6 changes from a screen selection screen 6M on which a selection button 18 for selecting a screen is displayed to a status display screen 6A showing power-related information, a status display screen 6B showing heat / gas-related information, a status display screen 6C showing hot water / heating information, a status display screen 6D showing fuel cell information, and so on.

[0031] The screen selection screen 6M is a screen for switching to the status display screen 6A, the status display screen 6B, the status display screen 6C, and the status display screen 6D, and selection buttons 18A, 18B, 18C, and 18D are displayed as the selection buttons 18. When the selection button 18A is touched while the screen selection screen 6M is displayed, the screen switches to the status display screen 6A. When the selection button 18B is touched while the screen selection screen 6M is displayed, the screen switches to the status display screen 6B, when the selection button 18C is touched, the screen switches to the status display screen 6C, and when the selection button 18D is touched, the screen switches to the status display screen 6D.

[0032] The status display screen 6A showing the power-related information is a status screen 6 that displays various types of power-related information related to the power of the hot water supply system. The power-related information is, for example, information on power usage, power generation, reverse flow power, etc. In addition, a selection button 18E for returning to the screen selection screen 6M is displayed on the status display screen 6A showing the power-related information.

[0033] The status display screen 6B showing heat and gas related information is a status screen 6 that displays various heat and gas related information related to heat, gas, etc. in the hot water supply system. The heat and gas related information is, for example, information related to the amount of heat used, the amount of gas used, water usage, etc. In addition, a selection button 18E for returning to the screen selection screen 6M is displayed on the status display screen 6B showing the heat and gas related information.

[0034] The status display screen 6C showing hot water supply / heating information is a status screen 6 that displays hot water supply / heating information related to hot water supply and heating in the hot water supply system. The hot water supply / heating information is information related to hot water supply temperature, heating on / off, etc. In addition, the status display screen 6C showing the hot water supply / heating information displays a selection button 18E for returning to the screen selection screen 6M.

[0035] The status display screen 6D showing the fuel cell information is a status screen 6 that displays various fuel cell information related to the fuel cell in the hot water supply system. The fuel cell information is information related to the generated power, the power used, whether power generation is in progress or power generation is stopped, etc. In addition, a selection button 18E for returning to the screen selection screen 6M is displayed on the status display screen 6D showing the fuel cell information.

[0036] Each of these status display screens 6A-6D is comprised of a fixed portion 7, a unique portion 8, and a variable portion 9. The fixed portion 7 is a portion of the status screen 6 that is displayed in the same way on all status display screens 6A-6D, and is a portion that does not change even when the status screen 6 changes. The unique portion 8 is a fixed portion that is different on each of the status display screens 6A-6D, and does not change within the same status display screen 6A-6D (each of the status display screens 6A-6D), and is, for example, a portion that is displayed as an animation. The variable portion 9 is a portion that changes depending on the state of the hot water supply system, and is, for example, a numerical value indicating power, heat amount, etc.

[0037] Specifically, the fixed portion 7 is a portion that is fixed in the status display screens 6A to 6D, and is the selection button 18E, etc. In the status display screen 6A showing the power-related information, the unique portion 8 is a portion where the title characters of the power-related information, the power usage, etc., and the characters showing the unit of the power, etc. are displayed, and the variable portion 9 is a portion where the numerical value showing the power, etc. is displayed. In the status display screen 6B showing the heat- and gas-related information, the unique portion 8 is a portion where the title characters of the heat- and gas-related information, the heat usage, etc., and the characters showing the unit, etc. are displayed, and the variable portion 9 is a portion where the numerical value showing the heat usage, etc. are displayed. In the status display screen 6C showing the hot water supply and heating information, the unique portion 8 is a portion where the title characters of the hot water supply and heating information, the hot water supply, etc., the arrow button display for operating the raising and lowering of the hot water supply temperature, the characters showing the unit of the hot water supply temperature, etc. are displayed, and the variable portion 9 is a portion where the numerical value showing the hot water supply temperature, etc. are displayed. In the status display screen 6D showing fuel cell information, the unique portion 8 is the portion where title characters such as fuel cell information and generated power, characters indicating units of power, etc. are displayed, and the variable portion 9 is the portion where numerical values ​​indicating power, etc. are displayed.

[0038] As described above, server 5 collects information from the hot water supply system, which is device 1, via remote control 2. The information includes various types of information indicating the status of the hot water supply system as display information 36 (see FIG. 3) for displaying status screen 6.

[0039] First, the remote control 2 displays the screen selection screen 6M or one of the status display screens 6A to 6D as the status screen 6, which is the current operating status of the device 1, in response to the operated selection button 18. Then, the remote control 2 receives the display information 36 via the server 5 or directly from the device 1, and displays the fixed portion 7 on the display unit 3, and also displays the unique portion 8 on the display unit 3, which corresponds to one of the status display screens 6A to 6D determined in response to the selection button 18. At the same time, the remote control 2 extracts the display contents of the variable portion 9 from the display information 36, and displays the extracted display contents on the display unit 3. In this way, the remote control 2 combines the fixed portion 7, unique portion 8, and variable portion 9 corresponding to the display information 36, and displays them on the display unit 3.

[0040] [Operation via mobile device] As described above, the mobile terminal 10 can remotely control the device 1 via the remote control 2 or directly. For example, the mobile terminal 10 has an application for remotely controlling the device 1 or the remote control 2, and remotely controls the device 1 or the remote control 2 using the application.

[0041] However, if the device 1 can be remotely controlled by an unspecified mobile terminal 10, the device 1 may be subject to unauthorized operation, which is inconvenient in terms of security.

[0042] Therefore, the mobile terminals 10 that are permitted to be operated are authenticated in advance, and only the authenticated mobile terminals 10 are paired with the remote control 2, and the mobile terminals 10 are set so as to be able to remotely operate the device 1 connected to the paired remote control 2.

[0043] In such authentication, there is a demand for easily authenticating that the mobile terminal 10 is one whose operation is permitted, while preventing unauthorized authentication and maintaining security.

[0044] Hereinafter, an authentication system, an authentication method, and an authentication program for authenticating the mobile terminal 10 will be described with reference to FIGS. 3 and 4 while also referring to FIGS.

[0045] First, the authentication system according to this embodiment includes a device 1, a remote control 2 for operating the device 1, a mobile terminal 10, and a server 5, as shown in FIG.

[0046] Although the device 1 may be any device having various functions, the following example will be described as a hot water supply system. As described above, the remote control 2 is connected to the device 1 by wire or wirelessly, and is usually associated with the device 1 on a one-to-one basis, and performs operations on the corresponding device 1. The remote control 2 includes a display unit 3 and various switches 4. The display unit 3 is, for example, a touch panel, and can display a status screen 6, and the status screen 6 is displayed including buttons for performing various operations, such as a selection button 18.

[0047] The mobile terminal 10 may be any of various smart devices, such as a mobile phone or a smartphone, and may be connected wirelessly or with a wire to a communication line, such as the Internet. The mobile terminal 10 includes a display screen 22 capable of displaying various types of information, an imaging device 21, and operation buttons 23 for accepting various operations. The display screen 22 is, for example, a touch panel, and displays buttons for accepting various operations. The mobile terminal 10 that is permitted to operate the device 1 operates the device 1 using the image displayed on the display screen 22 and the operation buttons 23. In this embodiment, when authenticating the mobile terminal 10, the mobile terminal 10 uses the imaging device 21 to capture the status screen 6 displayed on the display unit 3 of the remote control 2 as a screen image 37.

[0048] The server 5 includes a control unit 25, a communication unit 26, a screen extraction unit 29, an identification unit 45, an authentication unit 47, and a storage unit 34. Here, the control unit 25, the communication unit 26, the screen extraction unit 29, the identification unit 45, and the storage unit 34 of the server 5, the remote control 2, and the mobile terminal 10 constitute an identification system.

[0049] The control unit 25 includes a processor such as a CPU, and controls the communication unit 26, the screen extraction unit 29, the identification unit 45, the authentication unit 47, and the storage unit 34, and controls the operation of the server 5. The communication unit 26 controls data communication with the remote control 2 and the mobile terminal 10, receives information from the remote control 2 and the mobile terminal 10, and transmits information to the remote control 2 and the mobile terminal 10.

[0050] The screen extraction unit 29 extracts the unique part 8, or the unique part 8 and the changed part 9, from the fixed part 7, the unique part 8, and the changed part 9 of the status screen 6 (status display screens 6A to 6D) displayed on the remote control 2, from the screen image 37 captured by the mobile terminal 10 and received via the communication unit 26.

[0051] The identification unit 45 uses at least the unique portion 8 extracted by the screen extraction unit 29 from the identification information database 42 described later to identify the remote control 2 from which the mobile terminal 10 captured the screen image 37.

[0052] The authentication unit 47 authenticates the mobile terminal 10 that captured the screen image 37 as the mobile terminal 10 permitted to remotely operate the identified remote control 2. Then, the authentication unit 47 pairs the authenticated mobile terminal 10 with the identified remote control 2, and permits the authenticated mobile terminal 10 to operate the identified remote control 2 and to operate the device 1 connected to the remote control 2. The storage unit 34 stores various information.

[0053] Next, the processing flow of the authentication system will be described with reference to Fig. 4. Note that authentication of the mobile terminal 10 according to this embodiment may be performed by the authentication system shown in Fig. 3, or may be performed by an authentication method and authentication program that performs the processing flow shown in Fig. 4. Such an authentication method and authentication program may be performed by using the authentication system shown in Fig. 3, but can be performed by any configuration. Also, the authentication program is stored in the storage unit 34 or a storage device of the mobile terminal 10, and is executed by the control unit 25 of the server 5 or a processor provided in the mobile terminal 10.

[0054] The server 5 acquires display information 36 of the status screen 6 displayed on each remote control 2 from each remote control 2 that operates the multiple devices 1, via the communication unit 26, as needed. Then, every time the server 5 acquires the display information 36, it stores the display information 36 and the unique portion 8 and the changed portion 9 of the status screen 6 in the storage unit 34, extracts information related to the unique portion 8 and the changed portion 9 of the status screen 6 from the display information 36, generates a specific information database 42 in which each remote control 2 is associated with the extracted unique portion 8 and the changed portion 9, and stores the specific information database 42 in the storage unit 34. In other words, the specific information database 42 is a database in which each remote control 2 (the status screen 6 displayed on each remote control 2) is associated with the unique portion 8 and the changed portion 9 related to the (latest) status screen 6 currently displayed on the remote control 2. The specific information database 42 may be updated every time the display information 36 is acquired, or may be continuously stored in association with the remote control 2 and the extracted unique portion 8 and the changed portion 9 together with the time information at which the remote control 2 was acquired.

[0055] Furthermore, the remote control 2 continuously acquires, from the corresponding device 1, display information 36 that changes according to the state of the device 1, and displays, on the display unit 3, a status screen 6 according to the acquired display information 36 as needed. The remote control 2 accepts operations of the device 1 while displaying this status screen 6 (step #1 in FIG. 4).

[0056] In this state, when authenticating the mobile terminal 10, the user uses the imaging device 21 of the mobile terminal 10 to capture the status screen 6 displayed on the remote control 2 as a screen image 37 (step #2 in FIG. 4). The captured screen image 37 is transmitted to the server 5 via the communication unit 26 and stored in the storage unit 34. At this time, the screen image 37 may be transmitted to the server 5 together with time information.

[0057] When the control unit 25 of the server 5 receives the screen image 37 from the mobile terminal 10, it controls the screen extraction unit 29 to extract the fixed portion 7 from the screen image 37 with reference to the display information 36 (step #3 in FIG. 4), and to extract the unique portion 8 from the screen image 37 with reference to the display information 36 (step #4 in FIG. 4). Furthermore, the screen extraction unit 29 extracts the changed portion 9 from the screen image 37 (step #5 in FIG. 4).

[0058] Next, the identification unit 45 uses the specific information database 42 and the unique portion 8 extracted by the screen extraction unit 29 to narrow down the status screen 6 currently displayed on the remote control 2 including the unique portion 8, i.e., the remote control 2 from which the mobile terminal 10 captured the screen image 37 (step #6 in Figure 4).

[0059] Specifically, the identification unit 45 compares the unique part 8 extracted by the screen extraction unit 29 with the unique part 8 associated with the specific information database 42, and if a matching unique part 8 is found in the specific information database 42, all remote controls 2 associated with the matching unique part 8 are set as candidates for remote controls 2 whose status screens 6 corresponding to the screen image 37 are captured. In other words, of the remote controls 2 connected to the server 5, the identification unit 45 narrows down the remote controls 2 that display the status screens 6 corresponding to the extracted unique part 8.

[0060] If no matching unique portion 8 is found in the comparison in the identification unit 45, a notice to that effect is given, and the user again uses the imaging device 21 of the mobile terminal 10 to capture the status screen 6 displayed on the remote control 2 as a screen image 37 (step #7 in FIG. 4). Here, such notice can be given by any method, but for example, the notice is given by displaying a notice to that effect on the display screen 22 of the mobile terminal 10, or by playing a voice notifying the user of the fact from the mobile terminal 10.

[0061] When a matching unique portion 8 is found, next, the identification unit 45 compares the changed portion 9 extracted by the screen extraction unit 29 with the changed portion 9 of the status screen 6 displayed on the narrowed-down remote control 2, and narrows down the status screen 6 currently displayed on the remote control 2 that includes the matching changed portion 9, that is, the remote control 2 whose screen image 37 has been captured by the mobile terminal 10 (step #8 in FIG. 4). The changed portion 9 of the status screen 6 displayed on the narrowed-down remote control 2 can be extracted from the identification information database 42 in which the display information 36 transmitted from this remote control 2 is stored.

[0062] Then, when the number of remote controls 2 has been narrowed down to one, the identifying unit 45 identifies that remote control 2 as the remote control 2 whose screen image 37 has been captured by the mobile terminal 10 (step #9 in FIG. 4).

[0063] Also, when there are a plurality of remote controls 2 narrowed down, the identification unit 45 assumes that the mobile terminal 10 has failed to identify the remote control 2 whose screen image 37 was captured, and re-captures the captured state screen 6 of the remote control 2 (step #10 in FIG. 4). That is, the screen image 37 is added. At this time, a notification may be given that the identification of the remote control 2 has failed, and further, an instruction including a predetermined operation, such as a recommendation to capture again after transitioning to a predetermined state screen 6, may be given. In this case, the remote control 2 is identified by determining whether the re-captured screen image 37 is a screen image 37 captured after a specific operation is performed from the re-captured screen image 37. Then, the processing from step #3 to step #9 is repeated using the identification information database 42 extracted in step #8 until the remote control 2 is narrowed down to one remote control 2. As a result, the remote control 2 whose screen image 37 was captured by the mobile terminal 10 is identified using the plurality of screen images 37.

[0064] As described above, by photographing the status screen 6 of the remote control 2 with the mobile terminal 10 and using the photographed screen image 37 and the specific information database 42, the remote control 2 from which the status screen 6 was photographed can be easily identified.

[0065] Finally, when the remote control 2 with which the mobile terminal 10 captured the screen image 37 is identified, the authentication unit 47 authenticates the mobile terminal 10 with which the screen image 37 was captured as the mobile terminal 10 that remotely controls the identified remote control 2 to remotely control the device 1.

[0066] Then, the authentication unit 47 pairs the identified remote control 2 with the authenticated mobile terminal 10, and allows the authenticated mobile terminal 10 to remotely control the identified remote control 2.

[0067] Using a specific information database 42 in which the unique portion 8 and changed portion 9 of the status screen 6 relating to the latest display information 36 are associated with the remote control 2 that transmitted the display information 36, the remote control 2 from which the status screen 6 was photographed can be easily identified with a simple configuration in which the mobile terminal 10 simply photographs a screen image 37, and further, the mobile terminal 10 that photographed the status screen 6 can be easily and appropriately authenticated while maintaining security.

[0068] [Another embodiment] (1) In the above authentication system, each functional block is not limited to the configuration shown in the functional block in FIG. 3, and any functional block may be integrated, or any of the functional blocks may be further divided into multiple functional blocks.

[0069] (2) In each of the above embodiments, the smart device that captures the status screen 6 and displays the screen information 38 is not limited to the mobile terminal 10, and various other smart devices can be used.

[0070] (3) In each of the above embodiments, screen extraction unit 29, identification unit 45, authentication unit 47, and storage unit 34 are not limited to being provided in server 5, but some or all of them may be provided in mobile terminal 10 or remote control 2, or may be distributed among server 5, mobile terminal 10, and remote control 2. Furthermore, without providing server 5, screen extraction unit 29, identification unit 45, authentication unit 47, and storage unit 34 may be distributed among mobile terminal 10 and remote control 2.

[0071] (4) In each of the above embodiments, the identification unit 45 is not limited to a configuration in which the identification unit 45 identifies the remote control 2 using both the unique portion 8 and the changed portion 9, and may identify the remote control 2 using only one of the unique portion 8 and the changed portion 9.

[0072] (5) In each of the above embodiments, a database generating unit that generates the specific information database 42 may be provided in any of the server 5, the mobile terminal 10, the remote control 2, and the device 1.

[0073] (6) In each of the above embodiments, the status screen 6 used to identify the remote control 2 and photographed by the mobile terminal 10 is not limited to the status display screens 6A-6D, and any status screen 6 may be used. If the screen selection screen 6M displays a unique portion 8 or a changed portion 9 that can be distinguished from status screens 6 displayed on other remote controls 2, the screen selection screen 6M may be used.

[0074] (7) In each of the above embodiments, the screen image 37 captured by the imaging device 21 of the mobile terminal 10 may be a still image or a video. In this case, the manner in which the status screen 6 changes can be compared with the unique portion 8 and the like stored in the identification information database 42 together with time information to identify the remote control 2.

[0075] (8) In each of the above embodiments, the location information of the remote control 2 that transmitted the display information 36 may be stored in the identification information database 42, and the remote control 2 may be identified from the unique part 8 and the location information. This makes it possible to more accurately identify the remote control 2 that transmitted the display information 36.

[0076] In addition, the configurations disclosed in the above embodiments (including other embodiments, the same applies below) can be applied in combination with configurations disclosed in other embodiments, provided that no contradiction arises. Furthermore, the embodiments disclosed in this specification are illustrative, and the embodiments of the present invention are not limited thereto, and can be appropriately modified within the scope that does not deviate from the purpose of the present invention. [Industrial Applicability]

[0077] The present invention can be applied to various types of equipment, remote controls for operating the equipment, and smart devices for remotely operating the remote controls. [Explanation of symbols]

[0078] 1 equipment 2 Remote control (operating device) 3 Display section 5 Server 6 Status screen 7 Fixed part 8 Unique parts 9. Changes 10 Mobile terminals (smart devices) 21 Imaging device 26 Communications Department 29 Screen extraction part 34 Storage section 36 Display information 37 Screen Image 38 Screen Information 42 Specific Information Database 45 Specific part 47 Authentication Section

Claims

1. An authentication system for authenticating a smart device to allow remote operation of an appliance by the smart device, comprising: an operation device having a display unit for displaying a status screen that changes according to a status of the device and for operating the corresponding device; An imaging device included in the smart device; a communication unit capable of communicating with a plurality of the operation devices and the smart device that operate the corresponding devices, and continuously receiving display information of the displayed status screen from each of the operation devices; a storage unit configured to store a specific information database in which a unique portion of the status screen related to the display information received by the communication unit and the operation device that transmitted the display information are associated with each other together with time information; a screen extraction unit that acquires a screen image of the status screen displayed on the display unit of the operation device by the imaging device, and extracts the unique portion from the screen image; an identification unit that identifies, from the identification information database, the operation device that transmitted the display information corresponding to the extracted unique portion; an authentication unit that authenticates the smart device that captured the screen image by associating the smart device with the specified operation device, Allowing the authenticated smart device to operate the appliance; the status screen changes to one of a plurality of status display screens, and includes a fixed portion which is fixed in any of the status display screens, the specific portion which is fixed in the same status display screen, and a variable portion which changes according to the status of the device, the specific information database associates the unique portion and the changed portion of the status screen related to the display information received by the communication unit with the operation device that transmitted the display information together with time information; The screen extraction unit extracts the change portion in addition to the unique portion, The identification unit is an authentication system that identifies the operation device that transmitted the display information from the extracted unique portion and the changed portion.

2. The authentication system according to claim 1 , wherein at least one of the storage unit, the screen extraction unit, the identification unit, and the authentication unit is mounted on the smart device.

3. The system further includes a server capable of communicating with the plurality of operation devices and the smart device, The communication unit is mounted on the server, The authentication system according to claim 1 , wherein at least one of the storage unit, the screen extraction unit, the identification unit, and the authentication unit is mounted on either the smart device or the server.

4. The authentication system according to claim 1 , wherein the smart device is a mobile terminal.

5. 1. An authentication method for authenticating a smart device to allow remote operation of an appliance by the smart device, comprising: a step of continuously transmitting display information of a status screen displayed on each of a plurality of operation devices which operate the corresponding device from each of the operation devices, and generating a specific information database in which a unique portion of the status screen related to the display information is associated with the operation device which transmitted the display information together with time information; capturing a screen image of the displayed status screen of the device using the smart device; extracting the characteristic portion from the screen image; Identifying the operation device that transmitted the display information corresponding to the extracted unique portion from the specific information database; and authenticating the smart device that captured the screen image by associating the smart device with the identified operating device; Allowing the authenticated smart device to operate the appliance; the status screen changes to one of a plurality of status display screens, and includes a fixed portion which is fixed in any of the status display screens, the specific portion which is fixed in the same status display screen, and a variable portion which changes according to the status of the device, the specific information database associates the unique portion and the changed portion of the status screen related to the display information transmitted by the operation device with the operation device that transmitted the display information together with time information; The step of extracting the characteristic portion from the screen image includes extracting the change portion in addition to the characteristic portion, The step of identifying the operation device includes identifying the operation device that has transmitted the display information from the extracted unique portion and the extracted changed portion.

6. An authentication program for authenticating a smart device to allow remote operation of an appliance by the smart device, comprising: a function of continuously transmitting display information of a status screen displayed on each of a plurality of operation devices which operate the corresponding device from each of the operation devices, and generating a specific information database in which a unique portion of the status screen related to the display information is associated with the operation device which transmitted the display information together with time information; A function of acquiring a screen image of the status screen of the device to be displayed; extracting the characteristic portion from the screen image; a function of identifying the operation device that transmitted the display information corresponding to the extracted unique portion from the specific information database; and authenticating the smart device that captured the screen image by associating the smart device with the identified operation device. Allowing the authenticated smart device to operate the appliance; the status screen changes to one of a plurality of status display screens, and includes a fixed portion which is fixed in any of the status display screens, the specific portion which is fixed in the same status display screen, and a variable portion which changes according to the status of the device, the specific information database associates the unique portion and the changed portion of the status screen related to the display information transmitted by the operation device with the operation device that transmitted the display information together with time information; The function of extracting the characteristic portion from the screen image includes extracting the change portion in addition to the characteristic portion, The function of identifying the operation device is an authentication program that identifies the operation device that transmitted the display information from the extracted unique portion and the changed portion.

7. an operation device having a display unit for displaying a status screen that changes according to the status of a corresponding device, and for operating the corresponding device; A smart device having an imaging device; a communication unit capable of communicating with a plurality of the operation devices and the smart device that operate the corresponding devices, and continuously receiving display information of the displayed status screen from each of the operation devices; a storage unit configured to store a specific information database in which a unique portion of the status screen related to the display information received by the communication unit and the operation device that transmitted the display information are associated with each other together with time information; a screen extraction unit that acquires a screen image of the status screen displayed on the display unit of the operation device by the imaging device, and extracts the unique portion from the screen image; a specification unit that specifies, from the specification information database, the operation device that has transmitted the display information corresponding to the extracted unique portion; the status screen changes to one of a plurality of status display screens, and includes a fixed portion which is fixed in any of the status display screens, the specific portion which is fixed in the same status display screen, and a variable portion which changes according to the status of the device, the specific information database associates the unique portion and the changed portion of the status screen related to the display information received by the communication unit with the operation device that transmitted the display information together with time information; The screen extraction unit extracts the change portion in addition to the unique portion, The identification unit is an identification system that identifies the operation device that transmitted the display information from the extracted unique portion and the changed portion.

Images