Control method and display device

Abstract

The present application provides a control method and display device, which relate to the field of terminal technology. In this method, after obtaining a control request sent by a first device, the display device can display an interface for instructing the user to perform operations, and in response to the user's operation, search for a second device that is relatively close to it, collect the identity information of the user in the same environment as the display device through the second device, and use a third device to authenticate the identity information, and determine whether to issue a control instruction to the first device based on the authentication result, thereby achieving the goal of not paying attention to the identity of the second device when controlling the first device, nor paying attention to the information of the accounts on each device, and also allowing the user in the same environment as the display device to issue control instructions, thereby improving the convenience and security of control.

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a control method and a display device. Background Art

[0002] Smart door locks are now increasingly common in homes. They interact with devices in the user's home, allowing those inside to determine whether to unlock the door. However, currently, anyone can control the unlocking process, making smart door locks less secure. Summary of the Invention

[0003] The present application provides a control method, a display device, a computer storage medium, and a computer program product, which can improve the convenience and security of controlling a smart door lock.

[0004] In the first aspect, the present application provides a control method, which is applied to a display device, and the method includes: in response to an acquired first request, displaying a first interface, the first interface being at least used to instruct a target user to issue a control instruction to the first device, the target user and the display device being in the same environment, the first request being sent by the first device, and being used to request control of the first device; in response to the first control instruction issued by the target user, determining a second device from the environment in which the display device is located; sending a first message to the second device, the first message being used to instruct the second device to obtain the target identity information of the target user; in response to the acquired target identity information sent by the second device, sending a second request to a third device, the second request being used to request the third device to authenticate the target identity information; in response to the acquired authentication result sent by the third device, when the authentication result indicates that the authentication is successful, sending a first control instruction to the first device.

[0005] In this way, after obtaining the control request sent by the first device, the display device can display an interface for instructing the user to perform operations, and in response to the user's operation, search for a second device that is closer to it, and collect the identity information of the user in the same environment as the display device through the second device, and use the third device to authenticate the identity information, and determine whether to issue a control instruction to the first device based on the authentication result, thereby achieving the goal of not paying attention to the identity of the second device when controlling the first device, nor paying attention to the information of the accounts on each device, and also allowing users in the same environment as the display device to issue control instructions, thereby improving the convenience and security of control.

[0006] For example, the display device may be a smart TV, the first device may be a smart door lock, the second device may be a mobile terminal (such as a mobile phone), and the third device may be an identity authentication device. The first request may be an unlock request, and the first control instruction may be an unlock instruction.

[0007] In one possible implementation, the first interface includes a first sub-interface and a second sub-interface, wherein the first sub-interface is used to prompt the target user to perform the target operation, and the second sub-interface is used to instruct the target user to confirm the execution of the target operation; the second sub-interface is the interface displayed after the target user performs the target operation on the first sub-interface.

[0008] In a possible implementation, the second sub-interface is a trusted user interface.

[0009] In a possible implementation, the second device is the device closest to the display device.

[0010] In one possible implementation, the first device is a smart door lock, the second device is a mobile terminal, and the third device is an identity authentication device.

[0011] In a second aspect, the present application provides a control method, which is applied to a system including a display device, a first device, a second device and a third device, the method including: the first device sends a first request to the display device in response to an operation request of a first user, the first request being used to control the first device; the display device displays a first interface in response to the obtained first request, the first interface being at least used to instruct a target user to issue a control instruction to the first device, and the target user and the display device are in the same environment; the display device determines a second device from the environment in which the display device is located in response to the first control instruction issued by the target user; the display device sends a first message to the second device, the first message being used to instruct the second device to obtain target identity information of the target user; the second device obtains the target identity information of the target user in response to the first message, and sends the target identity information to the display device; the display device sends a second request to the third device in response to the obtained target identity information, the second request being used to request the third device to authenticate the target identity information; the third device authenticates the target identity information based on pre-stored identity information in response to the obtained second request, and sends the authentication result to the display device; the display device sends a first control instruction to the first device in response to the obtained authentication result, when the authentication result indicates successful authentication.

[0012] In one possible implementation, the first interface includes a first sub-interface and a second sub-interface, wherein the first sub-interface is used to prompt the target user to perform the target operation, and the second sub-interface is used to instruct the target user to confirm the execution of the target operation; the second sub-interface is the interface displayed after the target user performs the target operation on the first sub-interface.

[0013] In a possible implementation, the second sub-interface is a trusted user interface.

[0014] In a possible implementation, the second device is the device closest to the display device.

[0015] In one possible implementation, the first device is a smart door lock, the second device is a mobile terminal, and the third device is an identity authentication device.

[0016] In a third aspect, the present application provides a control method applied to a display device, the method comprising:

[0017] In response to the obtained first request, display a first interface, where the first interface is at least used to instruct a target user to issue a control instruction to the first device, the target user and the display device being in the same environment, and the first request being sent by the first device and being used to request control of the first device;

[0018] In response to a first control instruction issued by a target user, determining a second device from an environment where the display device is located;

[0019] Sending a first message to the second device, where the first message is used to instruct the second device to obtain target identity information of a target user;

[0020] authenticating the target identity information in response to the acquired target identity information sent by the second device;

[0021] When the authentication result indicates that the authentication is successful, a first control instruction is sent to the first device.

[0022] In a possible implementation, the first interface includes a first sub-interface and a second sub-interface, wherein the first sub-interface is used to prompt the target user to perform the target operation, and the second sub-interface is used to instruct the target user to confirm the execution of the target operation;

[0023] The second sub-interface is the interface displayed after the target user performs the target operation on the first sub-interface.

[0024] In a possible implementation, the second sub-interface is a trusted user interface.

[0025] In a possible implementation, the second device is the device closest to the display device.

[0026] In one possible implementation, the first device is a smart door lock, and the second device is a mobile terminal.

[0027] In a fourth aspect, the present application provides a display device comprising: a display screen; at least one memory for storing programs; and at least one processor for executing the programs stored in the memory. When the programs stored in the memory are executed, the processor is used to execute the method provided in the first aspect or the third aspect.

[0028] In a fifth aspect, the present application provides a computer-readable storage medium storing a computer program. When the computer program runs on an electronic device, the electronic device executes the method provided in the first aspect or the third aspect.

[0029] In a sixth aspect, the present application provides a computer program product, characterized in that when the computer program product is run on an electronic device, the electronic device executes the method provided in the first aspect or the third aspect.

[0030] It can be understood that the beneficial effects of the second to sixth aspects mentioned above can be found in the relevant description of the first aspect mentioned above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] Figure 1 This is a schematic diagram of an application scenario provided by an embodiment of the present application;

[0032] Figure 2 This is a schematic diagram of the hardware structure of a display device provided in an embodiment of the present application;

[0033] Figure 3 This is a schematic diagram of the hardware structure of a smart door lock provided in an embodiment of the present application;

[0034] Figure 4 This is a schematic diagram of the hardware structure of a mobile terminal provided in an embodiment of the present application;

[0035] Figure 5 This is a schematic diagram of the hardware structure of an identity authentication device provided in an embodiment of the present application;

[0036] Figure 6 This is a communication diagram of a control method provided in an embodiment of the present application;

[0037] Figure 7 This is a schematic diagram of a display interface of a display device provided in an embodiment of the present application;

[0038] Figure 8 This is a schematic diagram of switching between a display interface of a display device and an on-chip interface of the display device provided in an embodiment of the present application;

[0039] Figure 9 This is a communication diagram of another control method provided by an embodiment of the present application;

[0040] Figure 10 It is a structural diagram of a control device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0041] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0042] The term "and / or" as used herein describes an association between related objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A exists alone, A and B exist simultaneously, or B exists alone. The symbol " / " as used herein indicates that the related objects are in an "or" relationship, for example, A / B means either A or B.

[0043] The terms "first" and "second" in this specification and claims are used to distinguish different objects rather than to describe a specific order of objects. For example, "first response message" and "second response message" are used to distinguish different response messages rather than to describe a specific order of response messages.

[0044] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0045] In the description of the embodiments of the present application, unless otherwise specified, "multiple" means two or more, for example, multiple processing units means two or more processing units, etc.; multiple elements means two or more elements, etc.

[0046] For example, Figure 1 An application scenario is shown. Figure 1As shown, this scenario mainly involves the following devices: display device 100, smart door lock 200, mobile terminal 300 and identity authentication device 400. After obtaining the unlocking request sent by the smart door lock 200, the display device 100 can display the unlocking information, request the mobile terminal 300 to obtain the identity information of the user who instructs to unlock, and send the identity information to the identity authentication device 400 for authentication. When the identity authentication device 400 successfully authenticates the identity information sent by the display device 100, it can send authentication success information to the display device 100. After the display device 100 obtains the authentication success information fed back by the identity authentication device 400, it can send an opening instruction to the smart door lock 200. After the smart door lock 200 obtains the opening instruction, it executes the unlocking action.

[0047] In the embodiment of the present application, the display device 100 and the smart door lock 200 can be connected via a wireless network, the display device 100 and the mobile terminal 300 can be connected via a wireless network, the display device 100 and the identity authentication device 400 can be connected via a wired network or a wireless network, and the mobile terminal 300 and the identity authentication device 400 can be connected via a wired network or a wireless network. In one example, both the wired network and the wireless network can be local area networks (LANs) or wide area networks (WANs) (e.g., the Internet). The network between different devices can be implemented using any known network communication protocol, which can be various wired or wireless communication protocols, such as Ethernet, universal serial bus (USB), Firewire, global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), new radio (NR), Bluetooth, wireless fidelity (Wi-Fi), etc. For example, the display device 100 and the smart door lock 200 can communicate via Bluetooth, ultra wide band (UWB), Zigbee or wireless wireless fidelity (Wi-Fi). The display device 100 and the mobile terminal 300 may also communicate with each other via Bluetooth, ultra wide band (UWB), Zigbee, or wireless fidelity (Wi-Fi).The display device 100 and the identity authentication device 400 may also communicate via Bluetooth, ultra wide band (UWB), Zigbee, or wireless fidelity (Wi-Fi).

[0048] In some embodiments of the present application, the mobile terminal 300 and the identity authentication device 400 may communicate directly or indirectly. For example, the mobile terminal 300 may communicate with the identity authentication device 400 via the display device 100. In the embodiments of the present application, the communication method between the mobile terminal 300 and the identity authentication device 400 is not limited.

[0049] In some embodiments of the present application, the display device 100 may be a device with a display function, including but not limited to a smart TV. The smart TV referred to in the embodiments of the present application may be a TV or other electronic device with a large screen that can interact with a mobile device such as a smartphone or tablet. For example, the user interface in a smartphone can be wirelessly transmitted and displayed on the smart TV, and the user's operations on the smart TV can also affect the smartphone. It is understandable that the display device 100 can also be replaced with other devices with a display function, such as a monitor, and the replaced solution is still within the scope of protection of this application.

[0050] The smart door lock 200 is an improved lock that is different from the traditional mechanical lock and is more intelligent and simple in terms of user security, identification, and manageability. Exemplarily, the smart door lock 200 may include an image acquisition device, such as a camera, so that the smart door lock 200 transmits the image of the person requesting to unlock the door to the display device 100. The image acquisition device can be integrated into the smart door lock 200 or arranged separately from the smart door lock 200. The specific method can be determined according to actual conditions and is not limited here. It is understandable that in the embodiments of the present application, the smart door lock 200 can also be replaced by other electronic devices that require user consent to use, such as laptop computers, vehicles, wearable devices, smart home devices, etc. The replaced solution is still within the scope of protection of this application.

[0051] The mobile terminal 300 may be a mobile phone, tablet computer, laptop computer, ultra-mobile personal computer (UMPC), netbook, wearable device, smart home device, etc. The embodiment of the present application does not impose any special restrictions on the specific type of the mobile terminal 300.

[0052] The identity authentication device 400 is a device with identity authentication capabilities. The identity authentication device 400 can be integrated with the display device 100, meaning the two are part of the same device, or it can be deployed separately from the display device 100. In one example, to prevent leakage of a user's private data, the identity authentication device 400 can be a device with identity authentication capabilities that is located in the user's home and not connected to the internet.

[0053] For example, Figure 2 FIG. 1 shows a hardware structure of a display device 100. Figure 2 As shown, the display device 100 may include: a processor 110 , a memory 120 , a communication module 130 and a display screen 140 .

[0054] The processor 110 is the computing core and control core of the display device 100. The processor 110 may include one or more processing units. For example, the processor 110 may include one or more of an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0055] The memory 120 may store a program that can be executed by the processor 110, so that the processor 110 can at least execute the method performed by the display device 100 provided in the embodiments of the present application. The memory 120 may also store data. The processor 110 can read the data stored in the memory 120. The memory 120 and the processor 110 may be provided separately. Alternatively, the memory 120 may be integrated into the processor 110.

[0056] The communication module 130 is mainly used for the display device 100 to communicate with other electronic devices (such as: smart door lock 200, mobile terminal 300, identity authentication device 400, etc.) to complete data interaction.

[0057] The display screen 140 can be used to display images, videos, etc. The display screen 140 may include a display panel. The display panel may be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the display screen 140 may also be used to display information of the user requesting unlocking, such as a facial image of the user, after the display device 100 receives an unlocking request from the smart door lock 200.

[0058] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the display device 100. In other embodiments of the present application, the display device 100 may include more or fewer components than shown, or may combine or separate certain components, or may have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0059] For example, Figure 3 FIG. 2 shows a hardware structure of a smart door lock 200. Figure 3 As shown, the smart door lock 200 may include: a data acquisition module 210 and a communication module 220.

[0060] The data collection module 210 may be used to collect information input by the user, such as unlocking request, etc. In some embodiments, the data collection module 210 may also be used to collect image information of the user.

[0061] The communication module 220 is primarily used for the smart door lock 200 to communicate with other electronic devices (such as the display device 100) to exchange data. For example, after the data acquisition module 210 receives an unlock request from the user, the smart door lock 200 can send an unlock request to the display device 100 via the communication module 220, and receive unlock instructions or unlock prohibition instructions from the display device 100.

[0062] It is understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the smart door lock 200. In other embodiments of this application, the smart door lock 200 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0063] For example, Figure 4 FIG. 3 shows a hardware structure of a mobile terminal 300. Figure 4 As shown, the mobile terminal 300 may include: a processor 310 , a memory 320 , a communication module 330 and a data acquisition module 340 .

[0064] The processor 310 is the computing core and control core of the mobile terminal 300. The processor 310 may include one or more processing units. For example, the processor 310 may include one or more of an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0065] The memory 320 may store programs that can be executed by the processor 310, so that the processor 310 can at least execute the method performed by the mobile terminal 300 provided in the embodiments of the present application. The memory 320 may also store data. The processor 310 can read the data stored in the memory 320. The memory 320 and the processor 310 may be provided separately. Alternatively, the memory 320 may be integrated into the processor 310.

[0066] The communication module 330 is mainly used for the mobile terminal 300 to communicate with other electronic devices (such as the display device 100, the identity authentication device 400, etc.) to complete data exchange.

[0067] The data acquisition module 340 can be used to collect the user's identity information when the mobile terminal 300 obtains the identity information of the user requesting to unlock the door sent by the display device 100 through the communication module 330; and to collect the user's identity information when the user configures various data, so that the identity authentication device 400 can obtain the identity information configured by the user and authenticate the user's identity based on the identity information.

[0068] It is understood that the structures illustrated in the embodiments of the present application do not constitute specific limitations on the mobile terminal 300. In other embodiments of the present application, the mobile terminal 300 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0069] For example, Figure 5 FIG. 4 shows a hardware structure of an identity authentication device 400. Figure 4 As shown, the identity authentication device 400 may include: a processor 410 , a memory 420 and a communication module 430 .

[0070] The processor 410 is the computing core and control core of the identity authentication device 400. The processor 410 may include one or more processing units. For example, the processor 410 may include one or more of an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0071] The memory 420 may store a program that can be executed by the processor 410, so that the processor 410 can at least execute the method performed by the identity authentication device 400 provided in the embodiments of the present application. The memory 420 may also store data. The processor 410 may read the data stored in the memory 420. The memory 420 and the processor 410 may be provided separately. Alternatively, the memory 420 may be integrated into the processor 410. For example, the memory 420 may be used to store identity information pre-configured by the user.

[0072] The communication module 430 is mainly used for the identity authentication device 400 to communicate with other electronic devices (such as the display device 100, the mobile terminal 300, etc.) to complete data exchange.

[0073] It should be understood that the structure illustrated in the embodiments of this application does not constitute a specific limitation on the identity authentication device 400. In other embodiments of this application, the identity authentication device 400 may include more or fewer components than shown, or may combine or separate certain components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0074] Next, based on the above description, the control method in the embodiment of the present application is introduced.

[0075] For example, Figure 6 A communication diagram of a control method is shown. Figure 6 The main hardware devices involved include: display device 100, smart door lock 200, mobile terminal 300 and identity authentication device 400. Among them, the smart door lock 200 can also be replaced with other devices. When the smart door lock 200 is replaced with other devices, Figure 6 The names of the corresponding requests and control instructions can also be replaced adaptively. For the convenience of description, the following mainly uses the smart door lock 200 as an example. Figure 6 As shown, the control method may include the following steps:

[0076] S601. The smart door lock 200 sends an unlocking request to the display device 100.

[0077] Specifically, after the smart door lock 200 obtains the unlocking requirement, it can send an unlocking request to the display device 100.

[0078] S602: The display device 100 displays an unlocking interface, where the unlocking interface at least includes content indicating whether to unlock the door.

[0079] Specifically, after the display device 100 receives the unlocking request, it can display an unlocking interface on its display interface. The unlocking interface at least includes content for indicating whether to unlock, and the content mainly allows the user to choose whether to agree to unlock. In one example, when the image acquisition device matched with the smart door lock 200 captures an image of a user with an unlocking request, and the display device 100 acquires the image, the image can also be displayed on the display device 100, so that the user in the same environment as the display device 100 can choose whether to agree to unlock. For example, Figure 7 As shown, the display device 100 can display an unlocking interface in the area z1 on its display screen, so that the user can choose whether to unlock the lock. Figure 7 , the image of the user captured by the image acquisition device supporting the smart door lock 200 can also be displayed in area z1, so that users in the same environment as the display device 100 can know the identity of the user who currently needs to unlock the door, and then decide whether to unlock the door.

[0080] S603: The display device 100 obtains an unlocking instruction.

[0081] Specifically, after the display device 100 displays the unlocking interface, a user in the same environment as the display device (e.g., indoors) can issue an unlocking command. The user in the same environment as the display device (e.g., indoors) can issue the unlocking command by, but is not limited to, voice, keystroke, etc.

[0082] S604 : The display device 100 determines the mobile terminal 300 from n devices in the environment, where n is a positive integer greater than or equal to 1.

[0083] Specifically, after the display device 100 receives the unlock instruction, the display device 100 can discover the devices in the environment through the discovery mechanism of the soft bus, and select the mobile terminal 300 from the n devices in the environment. For example, the mobile terminal 300 can be the device closest to the display device 100.

[0084] As a possible implementation, after receiving the unlock command, the display device 100 can initiate a device scan and select the mobile terminal 300 from n devices in the same environment. In one example, the display device 100 can perform the device scan using a first short-range wireless communication method. For example, the first short-range wireless communication method can be a peer-to-peer (P2P) communication method, or a Bluetooth communication method, etc.

[0085] Furthermore, after the display device 100 performs device scanning, the display device 100 can filter out the mobile terminal 300 closest to the display device 100 from the n devices based on the wireless communication signal strengths between the n devices in the environment. Since the wireless communication signal strength between two devices is strongest when the two devices are closest, the display device 100 can select the device with the strongest wireless communication signal strength when wirelessly communicating with it as the mobile terminal 300.

[0086] S605: The display device 100 sends a first message to the mobile terminal 300. The first message is used to obtain target identity information of a target user. The target user includes the user who issues the unlocking instruction.

[0087] Specifically, after determining the mobile terminal 300 , the display device may send a message to the mobile terminal 300 for acquiring the target identity information of the user who issues the unlocking instruction.

[0088] S606: The mobile terminal 300 obtains the target identity information of the target user.

[0089] Specifically, after the mobile terminal 300 receives the first message sent by the display device 100, it can obtain the target identity information of the target user. For example, the target identity information may include, but is not limited to, biometric information of the target user, such as fingerprint, voice, face image, etc.

[0090] In some embodiments of the present application, after receiving the first message, the mobile terminal 300 may display on its display interface a message for the user to select whether to collect the user's identity information, and inform the user that the collection of the user's identity information is used to determine whether to unlock the smart door lock 200. When the user agrees to collect the user's identity information, the mobile terminal 300 may use the data collection device thereon to collect the user's identity information.

[0091] S607 : The mobile terminal 300 sends the target identity information of the target user to the display device 100 .

[0092] Specifically, after acquiring the target identity information, the mobile terminal 300 may send the target identity information to the display device 100 .

[0093] S608 : The display device 100 sends an identity authentication request for authenticating the target identity information to the identity authentication device 400 .

[0094] Specifically, after the display device 100 obtains the target identity information sent by the mobile terminal 300 , it may send an identity authentication request for authenticating the target identity information to the identity authentication device 400 , so that the identity authentication device 400 authenticates the target identity information.

[0095] S609: The identity authentication device 400 authenticates the target identity information based on the pre-stored identity information.

[0096] Specifically, the identity authentication device 400 may pre-store user-configured identity information. After receiving an identity authentication request, the identity authentication device 400 may compare the target identity information contained in the identity authentication request with its pre-stored identity information. If the similarity between the target identity information and any of the pre-stored identity information exceeds a preset similarity threshold, the authentication is successful, indicating that the target identity information is credible. Otherwise, the authentication fails, indicating that the target identity information is untrustworthy.

[0097] In some embodiments of the present application, the mobile terminal 300 may communicate directly or indirectly with the identity authentication device 400 in advance, so as to store the trusted user's identity information collected by the mobile terminal 300 in the identity authentication device 400 in advance.

[0098] S610 : The identity authentication device 400 sends an authentication result to the display device 100 .

[0099] Specifically, after authenticating the target identity information, the identity authentication device 400 may send an authentication result to the display device 100 . The authentication result may be used to indicate that the authentication is successful or that the authentication has failed.

[0100] S611. When the authentication result indicates that the authentication is successful, the display device 100 sends an unlocking instruction to the smart door lock 200.

[0101] Specifically, when the authentication result indicates that the authentication is successful, the display device 100 can send an unlock instruction to the smart door lock 200. The smart door lock 200 then executes the unlock instruction. It is understood that when the authentication result indicates that the authentication fails, the display device 100 can send a command to prohibit unlocking to the smart door lock 200, thereby prohibiting the smart door lock 200 from being opened.

[0102] Therefore, in the control method provided in the embodiment of the present application, after the display device 100 obtains the unlocking request, it can search for a mobile terminal that is relatively close to it, and collect the identity information of the user in the same environment as the display device 100 through the terminal, and use the identity authentication device 400 to authenticate the identity information, and determine whether to issue an unlocking instruction based on the authentication result, thereby achieving the goal of not having to pay attention to the identity of the mobile terminal when unlocking, nor to the information of the accounts on each device, and also allowing the user in the same environment as the display device 100 to issue an unlocking instruction, thereby improving the convenience of control.

[0103] It should be noted that the control method provided by the embodiment of the present application allows the display device to transfer the identity authentication when "unlocking" to the mobile terminal without having to consider which mobile terminal to transfer to, but can directly select the mobile terminal in the same environment as the display device, thereby expanding the scope of use. For example, when it is necessary to consider transferring to a mobile phone logged in with the same account, when the display device transfers the "unlocking" identity authentication to the mobile phone, it needs to consider transferring to the mobile phone with the same account, which limits the scope of use. For example, the display device is logged in with the account of user A, and user A is not at home. At this time, only user B is at home, but the display device will not transfer the "unlocking" identity authentication to user B's mobile phone, but needs to transfer it to user A's mobile phone. This makes it impossible for user B to choose whether to unlock independently, and user A cannot be sure whether it is safe to unlock at the moment, etc. The control method provided by the embodiment of the present application solves this problem very well, improving the convenience and safety of unlocking.

[0104] In some embodiments of the present application, two isolated operating environments, namely a trusted execution environment (TEE) and a rich execution environment (REE), may be configured in the display device 100. For example, the isolation of the hardware resources of REE and TEE can be achieved through the TrustZone mechanism, and the isolation between the applications corresponding to REE and TEE can be achieved through virtualization technology. The data and work accessible to the application corresponding to TEE are very strictly restricted so that its security level meets specific security requirements. Therefore, TEE can be considered a secure execution environment. REE is an operating environment outside of TEE, and compared to TEE, it can also be a non-secure execution environment.

[0105] An application running in a TEE may be a trusted application (TA), and there may be one or more TAs. The interface of a TA may be called a trusted user interface (TUI). An application running in a REE may be a client application (CA), and there may be one or more CAs. The interface of a CA may be called a user interface (TUI). A TA is a security application corresponding to a CA, and is used to input the sensitive information involved in the CA. A TA running in a TEE may provide security-related functions or services for the CA in the REE or other TAs in the TEE. A trusted operating system running in a TEE may provide a TEE internal interface to the TA, and the TA obtains access rights to security resources and services through the TEE internal interface. These security resources and access rights include but are not limited to: a trusted user interface TUI, etc. In one example, a Bluetooth dual protocol stack may be deployed in the REE and the TEE in the display device 100 to achieve smooth switching between the REE and the TEE through the dual protocol stack, thereby achieving lossless service.

[0106] Among them, in an embodiment of the present application, after the display device 100 displays the unlocking interface, when it obtains the user's operation instruction, it can display the trusted user interface TUI corresponding to the unlocking application, so that the display device 100 only receives events in the TEE at this time. In addition, the input of the uart interface of the chip at the bottom of the display device 100 can be directly switched to the TEE, so that when the user operates (such as through a remote control), the operation event can be directly passed to the TEE for processing. This is to avoid the click event simulated on the REE side triggering the unlocking instruction. In addition, when the unlocking is completed, the display device 100 can control the TUI interface to disappear, and its underlying chip can switch the uart interface input from TEE to REE, thereby restoring the connection before opening the door.

[0107] For example, Figure 8 As shown in (A), after the display device 100 receives the unlock request, it can display the unlock interface, which can include an "unlock" button. When the user selects the "unlock" button, as shown in FIG. Figure 8 As shown in (B), the display device 100 may display a trusted user interface TUI, in which the user may choose whether to unlock the phone. Figure 8As shown in (C), the input of the UART interface of the chip at the bottom of the display device 100 can be switched from REE to TEE. This improves the security of user operations. It is understandable that the trusted user interface TUI displayed by the display device 100 can be displayed in full screen or in a specific area, which can be determined according to actual conditions and is not limited here.

[0108] In some embodiments of the present application, in the above S602, the unlocking interface displayed by the display device 100 may include two interfaces. One of the interfaces may be Figure 8 The interface displayed in the upper left corner of the display device 100 in (A) can be used to prompt the user to unlock the door; the other interface can be Figure 8 The interface in (B) is a trusted user interface TUI for the user to choose whether to unlock.

[0109] For example, Figure 9 A communication diagram of another control method is shown. Figure 9 The main hardware devices involved include: display device 100, smart door lock 200 and mobile terminal 300. Among them, the smart door lock 200 can also be replaced with other devices. When the smart door lock 200 is replaced with other devices, Figure 9 The names of the corresponding requests and control instructions can also be replaced adaptively. For the convenience of description, the following mainly uses the smart door lock 200 as an example. Figure 9 For the contents of S901 to S907, please refer to the above Figure 6 The description of S601 to S607 will not be repeated here. Figure 9 As shown, the control method may include the following steps:

[0110] S901. The smart door lock 200 sends an unlocking request to the display device 100.

[0111] S902: The display device 100 displays an unlocking interface, which at least includes content indicating whether to unlock the door.

[0112] S903: The display device 100 obtains an unlocking instruction.

[0113] S904 : The display device 100 determines the mobile terminal 300 from n devices in the environment, where n is a positive integer greater than or equal to 1.

[0114] S905: The display device 100 sends a first message to the mobile terminal 300. The first message is used to obtain target identity information of a target user. The target user includes the user who issues the unlocking instruction.

[0115] S906: The mobile terminal 300 obtains the target identity information of the target user.

[0116] S907 : The mobile terminal 300 sends the target identity information of the target user to the display device 100 .

[0117] S908: The display device 100 authenticates the target identity information.

[0118] Specifically, after the display device 100 obtains the target identity information sent by the mobile terminal 300, it can authenticate the target identity information.

[0119] As a possible implementation, user-configured identity information may be pre-stored in the display device 100. The display device 100 compares the target identity information with the pre-stored identity information. If the similarity between the target identity information and any of the pre-stored identity information exceeds a preset similarity threshold, authentication succeeds, indicating that the target identity information is credible. Otherwise, authentication fails, indicating that the target identity information is untrustworthy.

[0120] S909. When the authentication is successful, the display device 100 sends an unlocking instruction to the smart door lock 200.

[0121] Specifically, when the display device 100 succeeds in authentication, it can send an unlock instruction to the smart door lock 200. Thereafter, the smart door lock 200 executes the unlock instruction. It is understood that when the display device 100 fails in authentication, the display device 100 can send a prohibit unlock instruction to the smart door lock 200 to prohibit the smart door lock 200 from being opened.

[0122] Therefore, in the control method provided in the embodiment of the present application, after the display device 100 obtains the unlocking request, it can search for a mobile terminal that is relatively close to it, and collect the identity information of the user in the same environment as the display device 100 through the terminal, and authenticate the identity information, and determine whether to issue an unlocking instruction based on the authentication result, thereby achieving the goal of not having to pay attention to the identity of the mobile terminal or the information of the accounts on each device when unlocking, and also allowing the user in the same environment as the display device 100 to issue an unlocking instruction, thereby improving the convenience of control.

[0123] It is understood that the method provided in any embodiment of the present application is executed by any device, equipment, platform, or device cluster with computing and processing capabilities. In addition, the execution order of the various steps in any embodiment of the present application can be adjusted according to actual conditions without contradiction, and the adjusted technical solution is also within the scope of the present application. In addition, the various steps in any embodiment of the present application can also be selectively executed, which is not limited here. In addition, all or part of any features of any embodiment of the present application can be freely and arbitrarily combined without contradiction, and the combined technical solution is also within the scope of protection of the present application.

[0124] Based on the method in the above embodiment, the present application embodiment also provides a control device. Figure 10 , Figure 10 This is a schematic diagram of the structure of a control device provided in an embodiment of the present application. Figure 10 As shown, the control device 1000 includes one or more processors 1001 and an interface circuit 1002. Optionally, the control device 1000 may further include a bus 1003.

[0125] The processor 1001 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by an integrated logic circuit of the hardware in the processor 1001 or an instruction in the form of software. The above-mentioned processor 1001 can be a general-purpose processor, a digital communicator (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. The various methods and steps disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc. The interface circuit 1002 can be used for sending or receiving data, instructions or information. The processor 1001 can use the data, instructions or other information received by the interface circuit 1002 to process, and the processing completion information can be sent out through the interface circuit 1002.

[0126] Optionally, the control device further includes a memory, which may include a read-only memory and a random access memory, and provides operating instructions and data to the processor. A portion of the memory may also include non-volatile random access memory (NVRAM). Optionally, the memory stores executable software modules or data structures, and the processor can execute corresponding operations by calling operating instructions stored in the memory (the operating instructions may be stored in the operating system).

[0127] Optionally, the interface circuit 1002 may be configured to output the execution result of the processor 1001 .

[0128] It should be noted that the corresponding functions of the processor 1001 and the interface circuit 1002 can be implemented through hardware design, software design, or a combination of hardware and software, and there is no limitation here.

[0129] It should be understood that each step of the above method embodiment can be completed by a hardware logic circuit or a software instruction in a processor. Figure 1 In any device involved in, to implement the method provided in the embodiments of this application.

[0130] It is understood that the processor in the embodiments of the present application may be a central processing unit (CPU), or may be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The general-purpose processor may be a microprocessor or any conventional processor.

[0131] The method steps in the embodiments of the present application can be implemented by hardware or by a processor executing software instructions. The software instructions can be composed of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, mobile hard disks, CD-ROMs or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an ASIC.

[0132] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted via the computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0133] It will be understood that the various numerical numbers involved in the embodiments of the present application are merely distinctions for the convenience of description and are not intended to limit the scope of the embodiments of the present application.

Claims

1. A control method, characterized in that: Applied to a display device, the method includes: In response to the obtained first request, display a first interface, where the first interface is at least used to instruct a target user to issue a control instruction to a first device, the target user and the display device being in the same environment, and the first request being sent by the first device and being used to request control of the first device; In response to a first control instruction issued by the target user, determining a second device from an environment where the display device is located; the second device is a device closest to the display device; Sending a first message to the second device, where the first message is used to instruct the second device to obtain target identity information of the target user; In response to the acquired target identity information sent by the second device, sending a second request to a third device, where the second request is used to request the third device to authenticate the target identity information; In response to the acquired authentication result sent by the third device, when the authentication result indicates that the authentication is successful, the first control instruction is sent to the first device.

2. The method according to claim 1, characterized in that The first interface includes a first sub-interface and a second sub-interface, wherein the first sub-interface is used to prompt the target user to perform a target operation, and the second sub-interface is used to instruct the target user to confirm the execution of the target operation; The second sub-interface is an interface displayed after the target user performs a target operation on the first sub-interface.

3. The method according to claim 2, characterized in that The second sub-interface is a trusted user interface.

4. The method according to any one of claims 1 to 3, characterized in that: The first device is a smart door lock, the second device is a mobile terminal, and the third device is an identity authentication device.

5. A control method, characterized in that: Applied to a system including a display device, a first device, a second device, and a third device, the method includes: The first device sends a first request to the display device in response to an operation request of a first user, where the first request is used to control the first device; The display device displays a first interface in response to the acquired first request, where the first interface is at least used to instruct a target user to issue a control instruction to the first device, and the target user and the display device are in the same environment; The display device determines a second device from the environment where the display device is located in response to the first control instruction issued by the target user; the second device is the device closest to the display device; The display device sends a first message to the second device, where the first message is used to instruct the second device to obtain the target identity information of the target user; The second device obtains the target identity information of the target user in response to the first message, and sends the target identity information to the display device; In response to the acquired target identity information, the display device sends a second request to the third device, where the second request is used to request the third device to authenticate the target identity information; The third device authenticates the target identity information based on the pre-stored identity information in response to the acquired second request, and sends an authentication result to the display device; The display device sends the first control instruction to the first device in response to the acquired authentication result when the authentication result indicates that the authentication is successful.

6. The method according to claim 5, characterized in that The first interface includes a first sub-interface and a second sub-interface, wherein the first sub-interface is used to prompt the target user to perform a target operation, and the second sub-interface is used to instruct the target user to confirm the execution of the target operation; The second sub-interface is an interface displayed after the target user performs a target operation on the first sub-interface.

7. The method according to claim 6, characterized in that The second sub-interface is a trusted user interface.

8. The method according to any one of claims 5 to 7, characterized in that: The first device is a smart door lock, the second device is a mobile terminal, and the third device is an identity authentication device.

9. A control method, characterized in that: Applied to a display device, the method includes: In response to the obtained first request, display a first interface, where the first interface is at least used to instruct a target user to issue a control instruction to a first device, the target user and the display device being in the same environment, and the first request being sent by the first device and being used to request control of the first device; In response to the first control instruction issued by the target user, a second device is determined from the environment where the display device is located; the second device is the device closest to the display device Sending a first message to the second device, where the first message is used to instruct the second device to obtain target identity information of the target user; In response to the acquired target identity information sent by the second device, authenticating the target identity information; When the authentication result indicates that the authentication is successful, the first control instruction is sent to the first device.

10. The method according to claim 9, characterized in that The first interface includes a first sub-interface and a second sub-interface, wherein the first sub-interface is used to prompt the target user to perform a target operation, and the second sub-interface is used to instruct the target user to confirm the execution of the target operation; The second sub-interface is an interface displayed after the target user performs a target operation on the first sub-interface.

11. The method according to claim 10, characterized in that The second sub-interface is a trusted user interface.

12. The method according to any one of claims 9 to 11, characterized in that: The first device is a smart door lock, and the second device is a mobile terminal.

13. A display device comprising: Display screen; at least one memory for storing a program; At least one processor is used to execute the program stored in the memory. When the program stored in the memory is executed, the processor is used to execute the method according to any one of claims 1 to 4, or to execute the method according to any one of claims 9 to 12.

14. A computer-readable storage medium storing a computer program, wherein when the computer program is executed on an electronic device, the electronic device executes the method according to any one of claims 1 to 4, or executes the method according to any one of claims 9 to 12.

15. A computer program product, characterized in that When the computer program product is run on an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 4, or execute the method according to any one of claims 9 to 12.

Images