Display device and device interconnection method
Through image detection technology, the sliding input of the control device is detected and the target surrounding equipment is determined and the equipment is interconnected, which solves the problem of cumbersome display device interconnection operation in the prior art, and improves the efficiency and user experience of equipment interconnection.
Patent Information
- Application Number
- CN202210753648.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-06-28
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2042-06-28
AI Technical Summary
In the prior art, the operation process of interconnecting the display device with surrounding devices is cumbersome and low efficiency. Especially when the display device does not have the touch screen function, the process of controlling the interconnection of the device through traditional control devices is particularly complicated.
Through image detection technology, the sliding input of the control device is detected, the identification of the target surrounding equipment is determined, and the equipment is interconnected, so as to quickly determine and control the interconnection between the display device and the target surrounding equipment is improved, and the efficiency of the device interconnected is improved.
The interconnection of the display device with surrounding devices can be quickly determined and controlled without complex key input, improving operational efficiency and user experience.
Smart Images

Figure CN115243085B_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of terminal technology, and more specifically, to a display device and a device interconnection method. Background Art
[0002] At present, display devices have the ability to interconnect with surrounding devices to form super terminals. After the devices are interconnected, they can become each other's functional modules, and can achieve smart office or smart home experience with device collaboration or task continuation through mutual assistance and resource sharing. The display device can quickly connect with any surrounding device (mobile phone, tablet, display, smart screen device, headset, speaker, mouse, keyboard, printer, etc.) that is close to the display device and discovered by the display device to form a super terminal. For example, after the display device is connected to the surrounding device mobile phone discovered by the display device, multiple applications in the mobile phone can be opened on the display device to achieve multitasking.
[0003] When the display device has a touch screen function, it can usually be quickly connected to surrounding devices through a "pull to connect" method to form a super terminal; when the display device (such as a TV, etc.) does not have a touch screen function, it is necessary to control the display device through a traditional control device (such as a remote control, etc.) to connect to the surrounding devices to form a super terminal.
[0004] However, the operation process of controlling the interconnection between the display device and the peripheral devices through the traditional control device is too complicated and time-consuming, and the efficiency of interconnecting the display device and the peripheral devices is low. Summary of the invention
[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the present application provides a display device, a device interconnection method, a storage medium and a program product, which can improve the read and write performance of the operating system.
[0006] In the first aspect, an embodiment of the present application provides a display device, which is controlled by a control device, including: a display, configured to: display a first identifier and at least one second identifier located around the first identifier on a target interface, the first identifier being used to indicate the display device, and each second identifier being used to indicate a surrounding device discovered by the display device through a device discovery technology; a controller, configured to: when a first sliding input of the control device is detected through image detection technology, determine the second identifier corresponding to the first sliding input as a target identifier; and control the display device to interconnect with the target surrounding devices indicated by the target identifier.
[0007] In some embodiments of the present application, the first sliding input satisfies the first condition, or the first sliding input satisfies the first condition and the second condition; wherein the first condition includes: the angle between the sliding direction of the first sliding input and the target direction is less than or equal to the first angle threshold, and the target direction is the direction where the target identifier is located with reference to the first identifier; the second condition includes: the length of the input trajectory of the first sliding input is within the target length range corresponding to the target identifier.
[0008] In some embodiments of the present application, the controller is further configured to: after determining the second identifier corresponding to the first sliding input as the target identifier, move the focus of the display device from the first identifier to the target identifier, and the identifier on which the focus is located is the identifier in a selected state; the controller is specifically configured to: when the second sliding input of the control device is detected by the image detection technology, control the display device to interconnect the device with the target surrounding devices.
[0009] In some embodiments of the present application, the controller is specifically configured to: after determining the second identifier corresponding to the first sliding input as the target identifier, display the target identifier in a first specific display mode; receive a confirmation key command from the control device; and in response to the confirmation key command, move the focus of the display device from the first identifier to the target identifier.
[0010] In some embodiments of the present application, the second sliding input satisfies the third condition, or the second sliding input satisfies the third condition and the fourth condition; the third condition includes: the angle between the sliding direction of the second sliding input and the preset direction is less than or equal to the second angle threshold; the fourth condition includes: the length of the input trajectory of the second sliding input is within the preset length range corresponding to the target identifier.
[0011] In some embodiments of the present application, the controller is further configured to: during the process of detecting the second sliding input, control the target identifier to move in a direction corresponding to the sliding direction of the second sliding input; and / or, after the display device and the target surrounding device complete device interconnection, display the target identifier in a second specific display mode to indicate that the target surrounding device and the display device are in a connected state.
[0012] In some embodiments of the present application, the controller is further configured to: discover multiple surrounding devices through the device discovery technology; determine at least one surrounding device that meets the target condition from the multiple surrounding devices, each surrounding device corresponds to a second identifier; and / or, when a surrounding device discovered by the display device meets a predetermined condition, display the second identifier corresponding to the surrounding device in the display area corresponding to the predetermined condition; wherein the target condition includes at least one of the following: the signal strength of the device is greater than or equal to the strength threshold, the manufacturer of the device is a preset manufacturer, the type of the device is a preset type, and the identifier of the device is a preset identifier; wherein the predetermined condition includes at least one of the following: the signal strength of the device is within the target strength range, the manufacturer of the device is a predetermined manufacturer, the type of the device is a predetermined type, and the identifier of the device is a predetermined identifier.
[0013] In some embodiments of the present application, the display is further configured to: display a third identifier on the target interface, the third identifier is used to indicate the control device, and the positional relationship between the third identifier and the first identifier is used to indicate the relative position of the control device and the display device; the controller is further configured to: perform real-time positioning of the control device through 3D camera positioning technology to determine the relative position; update the target display position of the third identifier on the target interface according to the relative position obtained at different times; and determine the first sliding input of the control device according to the change in the target display position.
[0014] In some embodiments of the present application, the controller is further configured to: determine the position of a human face in the target image based on a captured target image before detecting the first sliding input of the control device through image detection technology; determine the target area where the hand is located in the target image based on the position of the human face; and detect the control device in the target area to determine the starting position of the first sliding input based on the position of the control device in the target image.
[0015] In the second aspect, the present application provides a device interconnection method, which is applied to a display device controlled by a control device, and the method also includes: displaying a first identifier and at least one second identifier located around the first identifier on a target interface, the first identifier being used to indicate the display device, and each second identifier being used to indicate a surrounding device discovered by the display device through a device discovery technology; when a first sliding input of the control device is detected through image detection technology, the second identifier corresponding to the first sliding input is determined as a target identifier; and the display device is controlled to perform device interconnection with the target surrounding device indicated by the target identifier.
[0016] In some embodiments of the present application, the first sliding input satisfies the first condition, or the first sliding input satisfies the first condition and the second condition; wherein the first condition includes: the angle between the sliding direction of the first sliding input and the target direction is less than or equal to the first angle threshold, and the target direction is the direction where the target identifier is located with reference to the first identifier; the second condition includes: the length of the input trajectory of the first sliding input is within the target length range corresponding to the target identifier.
[0017] In some embodiments of the present application, after determining the second identifier corresponding to the first sliding input as the target identifier, the method further includes: moving the focus of the display device from the first identifier to the target identifier, the identifier on which the focus is located is the identifier in a selected state;
[0018] The controlling of the display device to interconnect with the target surrounding device indicated by the target identifier includes: when a second sliding input of the control device is detected by the image detection technology, controlling the display device to interconnect with the target surrounding device.
[0019] In some embodiments of the present application, moving the focus of the display device from the first identifier to the target identifier includes: displaying the target identifier in a first specific display mode; receiving a confirmation key command from the control device; and moving the focus of the display device from the first identifier to the target identifier in response to the confirmation key command.
[0020] In some embodiments of the present application, the second sliding input satisfies the third condition, or the second sliding input satisfies the third condition and the fourth condition; the third condition includes: the angle between the sliding direction of the second sliding input and the preset direction is less than or equal to the second angle threshold; the fourth condition includes: the length of the input trajectory of the second sliding input is within the preset length range corresponding to the target identifier.
[0021] In some embodiments of the present application, the method also includes: in the process of detecting a second sliding input, controlling the target identifier to move in a direction corresponding to the sliding direction of the second sliding input; and / or, after the display device and the target surrounding device complete device interconnection, displaying the target identifier in a second specific display mode to indicate that the target surrounding device and the display device are in a connected state.
[0022] In some embodiments of the present application, before displaying the first identifier and at least one second identifier located around the first identifier on the target interface, the method also includes: discovering multiple surrounding devices through the device discovery technology; determining at least one surrounding device that meets the target condition from the multiple surrounding devices, each surrounding device corresponds to a second identifier; and / or, when a surrounding device discovered by the display device meets a predetermined condition, displaying the second identifier corresponding to the surrounding device in the display area corresponding to the predetermined condition; wherein the target condition includes at least one of the following: the signal strength of the device is greater than or equal to the strength threshold, the manufacturer of the device is a preset manufacturer, the type of the device is a preset type, and the identifier of the device is a preset identifier; wherein the predetermined condition includes at least one of the following: the signal strength of the device is within the target strength range, the manufacturer of the device is a predetermined manufacturer, the type of the device is a predetermined type, and the identifier of the device is a predetermined identifier.
[0023] In some embodiments of the present application, the method also includes: displaying a third identifier on the target interface, the third identifier is used to indicate the control device, and the positional relationship between the third identifier and the first identifier is used to indicate the relative position of the control device and the display device; using 3D camera positioning technology, real-time positioning of the control device to determine the relative position; updating the target display position of the third identifier on the target interface according to the relative position obtained at different times; and determining the first sliding input of the control device according to the change in the target display position.
[0024] In some embodiments of the present application, the method also includes: before detecting the first sliding input of the control device through image detection technology, determining the position of a human face in the target image based on the captured target image; determining the target area where the hand is located in the target image based on the position of the human face; and detecting the control device in the target area to determine the starting position of the first sliding input based on the position of the control device in the target image.
[0025] In a third aspect, the present application provides a computer-readable storage medium, including: a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the device interconnection method shown in the second aspect is implemented.
[0026] In a fourth aspect, the present application provides a computer program product, characterized in that it includes: when the computer program product runs on a computer, it enables the computer to implement the device interconnection method shown in the second aspect.
[0027] The technical solution provided by the embodiment of the present application has the following advantages compared with the prior art: In the embodiment of the present application, in the embodiment of the present application, the display device includes a display and a controller, and the display is configured to: display a first identifier (used to indicate the display device) and at least one second identifier located around the first identifier on the target interface (each second identifier is used to indicate a surrounding device discovered by the display device through the device discovery technology); the controller is configured to: when the first sliding input of the control device is detected by the image detection technology, the second identifier corresponding to the first sliding input is determined as the target identifier; and the display device is controlled to interconnect with the target surrounding device indicated by the target identifier. When the display device does not have a touch screen function, the solution can detect the sliding input of the control device through the image detection technology, and then determine the second identifier corresponding to the surrounding device that needs to be interconnected according to the detected sliding input. Therefore, when the first sliding input of the control device is detected by the image detection technology, the second identifier corresponding to the first sliding input is determined as the target identifier; and the display device is controlled to interconnect with the target surrounding device indicated by the target identifier. Therefore, it is unnecessary to input complicated buttons on the control device, and the target peripheral devices that need to be interconnected can be quickly determined, and the display device can be controlled to interconnect with the target peripheral devices, thereby improving the efficiency of interconnecting the display device with the peripheral devices. BRIEF DESCRIPTION OF THE DRAWINGS
[0028] In order to more clearly illustrate the implementation methods in the embodiments of the present application or the related technologies, the following is a brief introduction to the drawings required for use in the embodiments or the related technology descriptions. Obviously, the drawings described below are some embodiments of the present application, and a person skilled in the art can also obtain other drawings based on these drawings.
[0029] Figure 1 An operation scenario between a display device and a control device according to some embodiments is shown;
[0030] Figure 2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;
[0031] Figure 3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;
[0032] Figure 4 One of the schematic diagrams of a target interface according to some embodiments is shown;
[0033] Figure 5 A second schematic diagram of a target interface according to some embodiments is shown;
[0034] Figure 6A third schematic diagram of a target interface according to some embodiments is shown;
[0035] Figure 7 A fourth schematic diagram of a target interface according to some embodiments is shown;
[0036] Figure 8 A fifth schematic diagram of a target interface according to some embodiments is shown;
[0037] Fig. 9 A sixth schematic diagram showing a target interface according to some embodiments;
[0038] Fig.10 FIG7 shows a seventh schematic diagram of a target interface according to some embodiments;
[0039] Fig.11 FIG7 shows a seventh schematic diagram of a target interface according to some embodiments;
[0040] Fig.12 One of the flowcharts of the device interconnection method according to some embodiments is shown;
[0041] Fig.13 A second flow chart of a method for interconnecting devices according to some embodiments is shown;
[0042] Fig.14 A third flowchart of a method for interconnecting devices according to some embodiments is shown;
[0043] Fig.15 A fourth flowchart of a method for interconnecting devices according to some embodiments is shown;
[0044] Fig.16 A fifth flowchart of a method for interconnecting devices according to some embodiments is shown;
[0045] Fig.17 A sixth flowchart of a device interconnection method according to some embodiments is shown;
[0046] Fig.18 FIG. 7 shows a seventh flow chart of a method for interconnecting devices according to some embodiments. DETAILED DESCRIPTION
[0047] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.
[0048] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0049] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0050] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device. DETAILED DESCRIPTION
[0052] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.
[0053] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.
[0054] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
[0055] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.
[0056] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 and Figure 2 This is a specific implementation of the display device of the present application.
[0057] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, a mobile phone, a tablet computer, a laptop computer, a PDA, an in-vehicle electronic device, etc. Figure 1 and Figure 2 This is a specific implementation of the display device of the present application.
[0058] Figure 1 FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment, wherein the control device includes an intelligent device or a control apparatus. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .
[0059] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.
[0060] In some embodiments, a smart device 300 (such as a mobile terminal, a tablet computer, a computer, a laptop computer, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the smart device.
[0061] In some embodiments, the display device may not use the above-mentioned smart device or control device to receive instructions, but may receive user control through touch or gestures.
[0062] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.
[0063] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.
[0064] Figure 2 Schematically shows a block diagram of a configuration of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input / output interface 140, an external memory, and a power supply. The control device 100 can receive an input operation instruction from a user, and convert the operation instruction into an instruction that can be recognized and responded to by the display device 200, playing the role of an interactive intermediary between the user and the display device 200.
[0065] like Figure 3 The display device 200 includes at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a user interface 280, an external memory, and a power supply.
[0066] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.
[0067] The display 260 includes a display screen component for presenting images, and a driving component for driving image display, which is used to receive image signals output from the controller, and display video content, image content, and menu control interface components and user control UI interface.
[0068] The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.
[0069] The communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, and other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The display device 200 can establish transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.
[0070] The user interface 280 can be used to receive control signals from the control device 100 (such as an infrared remote controller, etc.) It can also be used to directly receive user input operation instructions and convert the operation instructions into instructions that the display device 200 can recognize and respond to, which can be called a user input interface.
[0071] The detector 230 is used to collect signals from the external environment or the external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.
[0072] The external device interface 240 may include, but is not limited to, any one or more of the following interfaces: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.
[0073] The tuner-demodulator 210 receives broadcast television signals via wired or wireless reception, and demodulates audio and video signals, such as EPG data signals, from a plurality of wireless or wired broadcast television signals.
[0074] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.
[0075] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory (internal memory or external memory). The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 260, the controller 250 can perform operations related to the object selected by the user command.
[0076] In some embodiments, the controller includes a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), and at least one of a random access memory (RAM), a read-only memory (ROM), a first interface to an nth interface for input / output, a communication bus, etc.
[0077] Among them, RAM, also called main memory, is an internal memory that directly exchanges data with the controller. It can be read and written at any time (except when refreshed), and it is very fast. It is usually used as a temporary data storage medium for operating systems or other running programs. The biggest difference between it and ROM is the volatility of data, that is, once the power is cut off, the stored data will be lost. RAM is used in computers and digital systems to temporarily store programs, data and intermediate results. ROM works in a non-destructive read-out mode and can only read but not write information. Once the information is written, it is fixed, and even if the power is cut off, the information will not be lost, so it is also called fixed memory.
[0078] The user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command through a specific sound or gesture, and the user input interface recognizes the sound or gesture through a sensor to receive the user input command.
[0079] "User interface" is the medium interface for interaction and information exchange between applications or operating systems and users. It realizes the conversion between the internal form of information and the form acceptable to users. The commonly used form of user interface is the Graphical User Interface (GUI), which refers to the user interface related to computer operation displayed in a graphical way. It can be an icon, window, control or other interface element displayed on the display screen of a display device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets and other visual interface elements.
[0080] The embodiment of the present application provides a display device, which is controlled by a control device. The display device includes: a controller and a display, corresponding to the above Figure 3 The controller 250 and the display 260 are shown in FIG.
[0081] In some embodiments of the present application, the display is configured to: display a first identifier and at least one second identifier located around the first identifier on a target interface, the first identifier being used to indicate the display device, and each second identifier being used to indicate a surrounding device discovered by the display device through a device discovery technology; the controller is configured to: when a first sliding input of the control device is detected through an image detection technology, determine the second identifier corresponding to the first sliding input as a target identifier; and control the display device to interconnect with the target surrounding devices indicated by the target identifier.
[0082] The first identifier and each second identifier may be any of the following: the name of the corresponding device, the model of the corresponding device, the manufacturer of the corresponding device, the media access control (MAC) address of the corresponding device, and the user name identifier of the corresponding device. The specific identifier may be determined according to the actual situation and is not limited here.
[0083] Among them, different sliding inputs correspond to different second identifiers, and different second identifiers correspond to different surrounding devices. When different sliding inputs of the control device are detected by image detection technology, different second identifiers are determined as target identifiers to control the display device to interconnect with different surrounding devices.
[0084] The first mark may be located at the center, and at least one second mark may be located around the first mark. The relative position relationship between each second mark and the first mark may be randomly set or may be set according to a preset rule, which may be determined according to actual conditions and is not limited here. The preset rule may also be determined according to actual conditions and is not limited here.
[0085] The device discovery technology includes but is not limited to any of the following: Bluetooth discovery technology, WiFi discovery technology. The device discovery technology can be determined based on actual usage and is not limited here.
[0086] The surrounding device indicated by each second identifier can be any of the following devices: a tablet, a mouse, a mobile phone, a speaker, a headset, a display; it can also be other devices, which can be determined according to actual conditions and are not limited here.
[0087] It is understood that the first sliding input can be determined based on the position information of the control device detected in each frame of the continuous multiple frames of images by capturing multiple consecutive frames of images including the control device. Specifically, the image detection technology can refer to the existing related technology and is not limited here.
[0088] In an embodiment of the present application, when the display device does not have a touch screen function, the sliding input of the control device can be detected by image detection technology, and then the second identifier corresponding to the surrounding device that needs to be interconnected can be determined based on the detected sliding input. Therefore, when the first sliding input of the control device is detected by image detection technology, the second identifier corresponding to the first sliding input is determined as the target identifier; the display device is controlled to interconnect with the target surrounding device indicated by the target identifier. Therefore, there is no need to input complex buttons on the control device, so that the target surrounding device that needs to be interconnected can be quickly determined, and the display device can be controlled to interconnect with the target surrounding device, thereby improving the efficiency of interconnecting the display device with the surrounding devices.
[0089] In some embodiments of the present application, the first sliding input satisfies a first condition; wherein the first condition includes: the angle between the sliding direction of the first sliding input and the target direction is less than or equal to a first angle threshold, and the target direction is the direction where the target identifier is located with reference to the first identifier.
[0090] The first angle threshold may be determined based on actual conditions and is not limited here.
[0091] For example, Figure 4 As shown, the mark "1" located at the center is the first mark, indicating the display device; the marks "2", "3", "4", "5", and "6" located around the mark "1" are second marks, indicating the surrounding device 1, the surrounding device 2, the surrounding device 3, the surrounding device 4, and the surrounding device 5 respectively. Among them, the mark "4" is the target mark, and the mark "4" is 30° above and to the right of the mark "1", and the target direction is 30° above and to the right.
[0092] It can be understood that with the first identifier as a reference, different second identifiers are located in different directions, that is, different identifiers correspond to different target directions. Then, when the angle between the first sliding input and different target directions is less than or equal to the first threshold, the different second identifiers are determined as target identifiers, and the display device is controlled to interconnect with different surrounding devices.
[0093] In an embodiment of the present application, a first condition is provided to better detect the sliding input of the control device through image detection technology, and then select the target surrounding device required by the user according to the detected sliding input, and interconnect the device with the display device.
[0094] In some embodiments of the present application, the first sliding input satisfies a first condition and a second condition; wherein the first condition includes: the angle between the sliding direction of the first sliding input and the target direction is less than or equal to a first angle threshold, and the target direction is the direction where the target identifier is located with reference to the first identifier; the second condition includes: the length of the input trajectory of the first sliding input is within the target length range corresponding to the target identifier.
[0095] The description of the first condition can refer to the above description of the first condition, which will not be repeated here. The target length range can be determined according to actual conditions and is not limited here.
[0096] Among them, the target length ranges corresponding to different second identifiers can be the same (for example, the second identifier 1 corresponds to the first target length range, and the second identifier 2 corresponds to the second target length range), or can be different (for example, the second identifier 3 corresponds to the third target length range, and the second identifier 4 corresponds to the third target length range); the target length range corresponding to each second identifier can be completely different, and the target length range corresponding to each second identifier can also be partially the same and partially different, and the target length range corresponding to each second identifier can be completely the same, which can be determined according to actual conditions and is not limited here.
[0097] It can be understood that the second condition includes the length of the input trajectory of the first sliding input being within the target length range corresponding to the target identifier, so that the target identifier can be determined more accurately, and then the device interconnection with the target surrounding devices indicated by the target identifier can be carried out. Moreover, setting the length of the input trajectory of the first sliding input to be within the target length range corresponding to the target identifier can avoid the device interconnection between the target surrounding devices and the display device due to misoperation, which can improve the accuracy of selecting devices that need to be interconnected and improve operating efficiency.
[0098] Among them, the first condition may also include other conditions, which may be determined according to actual conditions and are not limited here. The second condition may also include other conditions, which may be determined according to actual conditions and are not limited here. The first sliding input may also meet other conditions, which may be determined according to actual conditions and are not limited here.
[0099] In some embodiments of the present application, the controller is further configured to: after determining the second identifier corresponding to the first sliding input as the target identifier, move the focus of the display device from the first identifier to the target identifier, and the identifier on which the focus is located is the identifier in a selected state; the controller is specifically configured to: when the second sliding input of the control device is detected by the image detection technology, control the display device to interconnect the device with the target surrounding devices.
[0100] It can be understood that the display device includes a focus, and the identifier where the focus is located is an identifier in a selected state. Before the surrounding device to be interconnected is selected, the focus is on the first identifier by default. When the first sliding input of the control device is detected by image detection technology, and the first sliding input satisfies the first condition or the first sliding input satisfies the first condition and the second condition, after determining that the second identifier corresponding to the first sliding input is the target identifier, the focus of the display device is moved from the first identifier to the target identifier. This indicates that the user selects the target surrounding device indicated by the target identifier, and uses the target surrounding device as a device for interconnecting the display device, and when the second sliding input of the control device is detected by the image detection technology, the display device is controlled to interconnect the target surrounding device with the target surrounding device. In this way, the movement of the focus can prompt the user that the currently selected device is the target surrounding device. The user can then determine whether the surrounding device that needs to be interconnected is the target surrounding device. If so, the display device can be controlled to interconnect with the target surrounding device by further operating the control device (i.e., the second sliding input); if not, the surrounding device that needs to be interconnected can be reselected by operating the control device, thereby avoiding the display device from being interconnected with surrounding devices that are not required by the user, thereby improving the user experience.
[0101] For example, Figure 4 As shown in the figure, the bold mark indicates that the focus is on the mark, and the mark is the mark currently in the selected state. Initially, the focus of the display device is on the mark "1", and the mark in the selected state is "1". In the case where the first sliding input of the control device is detected by the image detection technology, as shown in FIG. Figure 5 As shown, the focus of the display device moves from the mark "1" to the mark "4", the mark "1" changes from the selected state to the unselected state, and the mark "4" changes from the unselected state to the selected state.
[0102] In some embodiments of the present application, when the first sliding input of the control device is detected through image detection technology, after the second identifier corresponding to the first sliding input is determined as the target identifier, the display device can also display a first prompt message, and the first prompt message is used to prompt whether to determine the second identifier corresponding to the first sliding input as the target identifier, receive a user's key input operation for the first prompt message, and in response to the key input operation, if the choice is to determine the second identifier corresponding to the first sliding input as the target identifier, then move the focus of the display device from the first identifier to the target identifier, otherwise the focus remains displayed on the first identifier, and the user can change the different sliding inputs of the control device detected by the display device by controlling the movement of the control device, and reselect other second identifiers.
[0103] In some embodiments of the present application, the first sliding input satisfies the first condition and the second condition; the controller is also configured to: when it is detected through image detection technology that the length of the sliding track of the sliding input of the control device is less than or equal to the length threshold, the focus of the display device remains displayed on the first mark.
[0104] It can be understood that in order to prevent misoperation, a length threshold is set in the embodiment of the present application. When the image detection technology detects that the length of the sliding trajectory of the sliding input of the control device is less than or equal to the length threshold, the focus of the display device remains displayed on the first mark, which means that by detecting the sliding input of the control device, when the length of the sliding trajectory of the sliding input of the control device is less than or equal to the length threshold, it indicates that the user's operation to move the control device is invalid. The operation is not an operation to select the target surrounding devices for device interconnection with the display device, and there is no need to make a focus transfer response.
[0105] In some embodiments of the present application, the controller is specifically configured to: after determining the second identifier corresponding to the first sliding input as the target identifier, display the target identifier in a first specific display mode; receive a confirmation key command from the control device; and in response to the confirmation key command, move the focus of the display device from the first identifier to the target identifier.
[0106] Among them, the first specific display mode may include at least one of the following: flashing animation, specific color, specific position, display prompt information (such as "determine the surrounding devices indicated by the target identifier as devices to be connected"), etc. The first specific display mode can be determined according to actual conditions and is not limited here.
[0107] In an embodiment of the present application, after the second identifier corresponding to the first sliding input is determined as the target identifier, the target identifier is displayed through a first specific display method, which can better prompt the user whether to determine the surrounding devices indicated by the target identifier as devices to be connected, and then according to the received case confirmation instruction, determine that the surrounding devices indicated by the target identifier are devices to be connected, move the focus of the display device from the first identifier to the target identifier, and select the target identifier.
[0108] In some embodiments of the present application, the second sliding input satisfies a third condition; the third condition includes: an angle between a sliding direction of the second sliding input and a preset direction is less than or equal to a second angle threshold.
[0109] Among them, the specific description of the third condition, the second sliding input, the preset direction, and the second angle threshold can refer to the above-mentioned description of the first condition, the first sliding input, the target direction, and the first angle threshold, and will not be repeated here.
[0110] The second angle threshold may be the same as or different from the first angle threshold, and may be determined based on actual conditions, which is not limited here.
[0111] The preset direction may be a target direction, a direction opposite to the target direction, or any other pre-set direction. The specific direction may be determined according to actual conditions and is not limited here.
[0112] Among them, if the preset direction is the same as the target direction, the preset direction is the direction where the target identifier is located with reference to the first identifier; if the preset direction is opposite to the target direction, the preset direction is the direction where the first identifier is located with reference to the target identifier.
[0113] In an embodiment of the present application, a third condition is provided to better detect the sliding input of the control device through image detection technology, and then trigger the display device to interconnect with the target surrounding devices according to the detected sliding input.
[0114] In some embodiments of the present application, the second sliding input satisfies the third condition and the fourth condition; the third condition includes: the angle between the sliding direction of the second sliding input and the preset direction is less than or equal to the second angle threshold; the fourth condition includes: the length of the input trajectory of the second sliding input is within the preset length range corresponding to the target identifier.
[0115] The preset length range and the target length range may be the same or different, and may be determined according to actual conditions, which is not limited here.
[0116] The preset length ranges corresponding to different second identifiers may be the same or different; the preset length ranges corresponding to each second identifier may be completely different, the preset length ranges corresponding to each second identifier may be partially the same and partially different, and the preset length ranges corresponding to each second identifier may be completely the same. The specific length range can be determined based on actual conditions and is not limited here.
[0117] If the preset length range corresponding to each second identifier is not completely the same, the preset length range corresponding to each second identifier may be determined according to the distance between the corresponding second identifier and the first identifier.
[0118] Among them, for the specific description of the fourth condition and the preset length range, reference can be made to the above-mentioned description of the second condition and the target length range, which will not be repeated here.
[0119] It can be understood that the fourth condition includes the length of the input trajectory of the second sliding input, which is within the preset length range corresponding to the target identifier. In this way, it can be more accurately determined that the device that needs to be interconnected with the display device is the target surrounding device indicated by the target identifier. Moreover, setting the length of the input trajectory of the second sliding input to be within the preset length range corresponding to the target identifier can avoid the target surrounding device from being interconnected with the display device due to misoperation, which can improve the accuracy of device interconnection, improve operating efficiency, and improve user experience.
[0120] Among them, the third condition may also include other conditions, which may be determined according to actual conditions and are not limited here. The fourth condition may also include other conditions, which may be determined according to actual conditions and are not limited here. The second sliding input may also meet other conditions, which may be determined according to actual conditions and are not limited here.
[0121] In some embodiments of the present application, when a second sliding input of the control device is detected by the image detection technology, the display device may further display a second prompt message, the second prompt message being used to prompt whether to control the display device to interconnect with the target surrounding devices, receive a key input operation of the user for the second prompt message, and respond to the key input operation. If the key input operation chooses to control the display device to interconnect with the target surrounding devices, the display device is controlled to interconnect with the target surrounding devices; otherwise, the display device is not controlled to interconnect with the target surrounding devices, and other feasible operations may be performed.
[0122] In some embodiments of the present application, the controller is further configured to: during the process of detecting the second sliding input, control the target identifier to move in a direction corresponding to the sliding direction of the second sliding input.
[0123] The direction corresponding to the sliding direction of the second sliding input may be a direction having a mapping relationship with the sliding direction of the second sliding input, and the mapping relationship may be determined according to actual conditions and is not limited here. For example, the direction corresponding to the sliding direction of the second sliding input may be the sliding direction of the second sliding input.
[0124] In an embodiment of the present application, during the process of detecting the second sliding input, the target identifier is controlled to move in a direction corresponding to the sliding direction of the second sliding input, which can further facilitate the user to determine that the surrounding device currently selected by the display device is the target surrounding device, and the display device is about to interconnect with the target surrounding device. If the target surrounding device is not the device required by the user, the user can reselect the surrounding device that needs to be interconnected with the display device through other input operations, which can improve the user experience and avoid the situation where the display device is interconnected with surrounding devices that the user does not need due to misoperation or misidentification of the user's input operation by the display device, thereby improving the operational efficiency of device interconnection.
[0125] In some embodiments of the present application, the second sliding input satisfies the third condition and the preset direction is opposite to the target direction. Then, in the process of detecting the second sliding input, the target identifier is controlled to move in a direction corresponding to the sliding direction of the second sliding input. In the process of detecting the second sliding input, the target identifier is controlled to move in a direction corresponding to the sliding direction of the second sliding input. An animation effect of controlling the target identifier to move toward the first identifier is achieved, and an effect similar to the drag input (one-pull-to-connect) on a device with a touch screen function is achieved, which can improve operating efficiency and user experience.
[0126] For example, in combination Figure 5 ,like Figure 6 As shown, the preset direction is the direction opposite to the target direction. On the target interface, the target identifier (identifier "4") moves in the direction corresponding to the sliding direction of the second sliding input (the direction indicated by the arrow in the figure is the direction corresponding to the sliding direction of the second sliding input).
[0127] In some embodiments of the present application, after the display device and the target surrounding device complete device interconnection, the target identifier is displayed in a second specific display mode to indicate that the target surrounding device and the display device are in a connected state.
[0128] Among them, displaying the target identifier in the second specific display mode may include at least one of the following: marking and displaying the target identifier may include at least one of the following: displaying prompt information on the target identifier, and displaying the target identifier in a specific display area. The method of marking and displaying the target identifier may also include other methods, which can be determined according to actual conditions and are not limited here.
[0129] The prompt information may be color prompt information, text prompt information, shadow prompt information or connection prompt information, etc., which may be determined according to actual conditions and is not limited here. The prompt information may be used to determine that the peripheral device indicated by the indicator displaying the prompt information is a peripheral device connected to the display device.
[0130] The connection prompt information may be a solid line or a dotted line, a straight line or a curve, which may be determined according to actual conditions and is not limited here.
[0131] For example, in combination Figure 4 ,like Figure 7 As shown, the prompt information is connection prompt information, and the connection line between the mark "4" and the mark "1" is used to indicate that the target surrounding device is connected to the display device. Figure 4 ,like Figure 8 As shown, the prompt information is shadow prompt information, and the shadow in the mark "4" is used to indicate that the target surrounding device is in a connected state with the display device.
[0132] By displaying the target logo in a specific display area, it can be understood that the surrounding devices connected to the display device are displayed in the specific display area, so that it can be determined that the surrounding devices indicated by the logo displayed in the specific display area are the surrounding devices connected to the display device.
[0133] In an embodiment of the present application, after the display device completes device interconnection with the target surrounding device, the target identifier is displayed in a second specific display mode, so that it can be determined which second identifiers, among at least one second identifier currently displayed on the target interface, indicate surrounding devices that are connected to the display device, thereby improving the user experience.
[0134] In some embodiments of the present application, the controller is further configured to: discover multiple surrounding devices through the device discovery technology; determine at least one surrounding device that meets the target condition from the multiple surrounding devices, and each surrounding device corresponds to a second identifier; wherein the target condition includes at least one of the following: the signal strength of the device is greater than or equal to the strength threshold, the manufacturer of the device is a preset manufacturer, the type of the device is a preset type, and the identifier of the device is a preset identifier.
[0135] Exemplarily, taking the device discovery technology as Bluetooth discovery technology, and the target condition including the signal strength of the device being greater than or equal to a strength threshold, the display device starts to perform device scanning. When the Bluetooth signal strength of a scanned surrounding device is greater than the set Bluetooth strength threshold, the surrounding device is determined as one of the at least one surrounding devices, and a second identifier corresponding to the surrounding device is displayed on the target interface.
[0136] Among them, the target conditions include at least one of the following: the manufacturer of the device is a preset manufacturer, the type of the device is a preset type, and the identifier of the device is a preset identifier, that is, at least one surrounding device is determined by setting a whitelist mechanism (target condition). Only the scanned surrounding devices that comply with the whitelist mechanism can be determined as one of the at least one surrounding devices, and the corresponding second identifier is displayed on the target interface.
[0137] The whitelist mechanism may be a factory setting of the device or a user setting, which may be determined based on actual conditions and is not limited here.
[0138] Exemplarily, the target condition includes that the manufacturer of the device is a preset manufacturer, then the display device can determine at least one surrounding device whose manufacturer is a preset manufacturer based on whether the manufacturer indicated by the manufacturer information in the manufacturer field of the Bluetooth Low Energy (BLE) broadcast packet sent by the surrounding device is a preset manufacturer in the whitelist, or the display device can determine at least one surrounding device whose manufacturer is a preset manufacturer based on whether the manufacturer indicated by the private protocol field of the BLE broadcast packet sent by the surrounding device is a preset manufacturer in the whitelist. The display device can also determine at least one surrounding device whose manufacturer is a preset manufacturer based on whether the manufacturer indicated by the Universally Unique Identifier (UUID) of the surrounding device obtained (obtained through the broadcast packet or through service discovery) is a preset manufacturer in the whitelist.
[0139] Among them, the preset type may include at least one of the following: speaker type devices, keyboard and mouse type devices; the preset type may also include other device types, which can be determined according to actual conditions and are not limited here.
[0140] Exemplarily, the target condition includes that the type of the device is a preset type, and the display device can also determine at least one surrounding device of the preset type based on whether the acquired type of the surrounding device (class of device (COD) of traditional Bluetooth Basic Rate (BR) and Enhanced Data Rate (EDR) or the appearance (apperance) type of BLE or the type of UUID) is a preset type in the whitelist.
[0141] The device identifier is used to uniquely indicate a device, and the preset identifier may be a device identifier preset by a user.
[0142] Exemplarily, the target condition includes that the identifier of the device is a preset identifier, and the display device may also determine at least one surrounding device with the preset identifier according to whether the obtained identifier of the surrounding device is a preset identifier in the whitelist.
[0143] It should be noted that the description of other device discovery technologies can refer to the above description of Bluetooth discovery technology, which will not be repeated here.
[0144] In the embodiment of the present application, by setting the target condition (i.e., setting the whitelist mechanism), it can be ensured that at least one surrounding device indicated by at least one second identifier is a trusted device, which can improve communication security and avoid leakage of user information.
[0145] It should be noted that in the process of discovering at least one surrounding device through device discovery technology, setting a blacklist mechanism and screening out surrounding devices belonging to the blacklist are the same or similar concepts as the method of setting a whitelist mechanism in the above embodiment and are within the protection scope of this application.
[0146] In some embodiments of the present application, when a surrounding device discovered by the display device meets a predetermined condition, a second identifier corresponding to the surrounding device is displayed in the display area corresponding to the predetermined condition; wherein the predetermined condition includes at least one of the following: the signal strength of the device is within the target strength range, the manufacturer of the device is the predetermined manufacturer, the type of the device is the predetermined type, and the identifier of the device is a predetermined identifier.
[0147] Different predetermined conditions correspond to different display areas, which may include different relative positional relationships between the display area and the first identifier, or different relative distances between the display area and the first identifier, which may be determined based on actual conditions and are not limited here.
[0148] The predetermined condition includes that the signal strength of the device is within a target strength range, and the second identifiers corresponding to the surrounding devices with signal strengths within different target strength ranges can be displayed in different display areas.
[0149] Exemplarily, when the display device scans multiple surrounding devices through device discovery technology, the signal strength of each surrounding device can be obtained, and the relative distance between the second identifier corresponding to a surrounding device and the first identifier can be determined based on the signal strength of the surrounding device. The stronger the signal strength of the surrounding device, the smaller the relative distance between the second identifier corresponding to the surrounding device and the first identifier.
[0150] The predetermined condition includes that the manufacturer of the device is a predetermined manufacturer. The description of the predetermined manufacturer can refer to the above description of the preset manufacturer, which will not be repeated here. The second identifiers corresponding to the peripheral devices of different manufacturers can be displayed in different display areas.
[0151] Exemplarily, when the display device scans multiple surrounding devices through device discovery technology, it can obtain the manufacturer information of each surrounding device. If the manufacturer information of a surrounding device indicates a preset manufacturer, the second identifier corresponding to the surrounding device can be preferentially displayed in a display area closer to the first identifier.
[0152] The predetermined condition includes that the type of the device is a predetermined type. The description of the predetermined type can refer to the above description of the preset type, which will not be repeated here. The second identifiers corresponding to different types of surrounding devices can be displayed in different display areas.
[0153] In some embodiments of the present application, different areas can be divided according to device types, and second identifiers corresponding to surrounding devices of different device types can be displayed in different display areas around the first identifier.
[0154] For example, Fig. 9 As shown, the second identifier corresponding to the A type device is located above the first identifier, the second identifier corresponding to the B type device is located to the right of the first identifier, the second identifier corresponding to the C type device is located below the first identifier, and the second identifier corresponding to the D type device is located to the left of the first identifier. Fig. 9 , the user can select type A device by moving the control device upward, select type B device by moving the control device rightward, select type C device by moving the control device downward, and select type D device by moving the control device leftward.
[0155] The predetermined condition includes that the identifier of the device is a predetermined identifier. The description of the predetermined identifier can refer to the above description of the preset identifier, which will not be repeated here. The second identifiers corresponding to the surrounding devices with different identifiers can be displayed in different display areas.
[0156] Exemplarily, when the display device scans multiple surrounding devices through device discovery technology, it can obtain the identification of each surrounding device. If the identification of a surrounding device is an identification preset by the user, the second identification corresponding to the surrounding device can be preferentially displayed in a display area closer to the first identification.
[0157] In some embodiments of the present application, relevant prompt information can also be displayed in the display area corresponding to the predetermined condition. The prompt information may include the manufacturer information, identification information, and type information of the surrounding equipment indicated by the second logo displayed in the display area. It may also include color information (displaying a background of a preset color in the display area), animation information (the second logo displayed in the display area includes a flashing animation effect), etc. The specific information can be determined based on actual conditions.
[0158] In an embodiment of the present application, the second identification corresponding to the surrounding devices that meet different predetermined conditions is displayed in different display areas of the first identification, which can facilitate the management of the surrounding devices and the user's operation. For example, the second identification of the surrounding devices that meet a certain predetermined condition is displayed at a position close to the first identification. This makes it convenient for the user to complete the determination of the target surrounding devices by controlling the control device, and control the display device to interconnect the target surrounding devices, thereby improving operational efficiency.
[0159] In some embodiments of the present application, the display is further configured to: display a third identifier on the target interface, the third identifier is used to indicate the control device, and the positional relationship between the third identifier and the first identifier is used to indicate the relative position of the control device and the display device; the controller is further configured to: perform real-time positioning of the control device through 3D camera positioning technology to determine the relative position; update the target display position of the third identifier on the target interface according to the relative position obtained at different times; and determine the first sliding input of the control device according to the change in the target display position.
[0160] It can be understood that in the embodiment of the present application, the sliding input of the control device is detected by image detection technology. Specifically, the relative position between the control device and the display device within a certain period of time can be located by 3D camera positioning technology, and then the target display position of the control device on the target interface is mapped according to the relative position between the control device and the display device. Then, the sliding input of the control device is determined according to the change of the target display position within a certain period of time.
[0161] It can be understood that after the control device is positioned in real time by using the 3D camera positioning technology to obtain the relative position of the control device and the display device, the relative position relationship between the third identifier and the first identifier can be mapped in the target interface based on the relative position obtained by the positioning, and the mapping can be performed specifically according to a preset mapping rule. The preset mapping rule can be determined according to actual conditions and is not limited here.
[0162] The display position of the third identifier on the target interface or the relative position relationship between the third identifier and the first identifier is determined based on the positioning information of the display device to the control device. The relative position relationship between the third identifier and the first identifier is used to indicate the relative position of the control device and the display device.
[0163] Wherein, if the change of the target display position meets the first preset condition within the first preset duration, the first sliding input is determined, the first preset condition includes the first condition, or the first preset condition includes the first condition and the second condition, the first condition includes any of the following: the first change direction of the target display position remains unchanged within the first preset duration, and the angle between the first change direction and the target direction is less than or equal to the first angle threshold, the target direction is the direction where the target identifier is located with the first identifier as a reference (the angle between the sliding direction corresponding to the first sliding input and the target direction is less than or equal to the first angle threshold, the target direction is the direction where the target identifier is located with the first identifier as a reference); within the first preset duration, the position change trajectory of the target display position passes through the display area corresponding to the target identifier. The second condition includes: the length of the position change trajectory of the target display position within the first preset duration is within the first length range corresponding to the target identifier (the length of the input trajectory corresponding to the first sliding input is within the target length range corresponding to the target identifier, the first length range and the target length range have a target length mapping relationship, the target length mapping relationship can be determined according to actual conditions, and is not limited here. For example, the target length mapping relationship can be equal).
[0164] The first preset duration can be determined according to actual conditions and is not limited here. The first condition can also be determined according to actual conditions and is not limited here.
[0165] It can be understood that the first condition includes that the position change trajectory of the target display position passes through the display area corresponding to the target identifier within the first preset time period, and the movement trajectory of the third identifier on the target interface passes through the display area corresponding to the target identifier.
[0166] Among them, the display area corresponding to the target logo can be the display area occupied by the target logo; it can also be a circular area with the display area occupied by the target logo as the center and a radius of a preset size (the preset size can be determined according to actual conditions and is not limited here); the specific size can be determined according to actual conditions and is not limited here.
[0167] Combination Figure 4 ,like Fig.10 As shown, the mark "7" located around the mark "1" is a third mark, indicating a control device.
[0168] It can be understood that the first condition includes that the first change direction of the target display position remains unchanged within the first preset time period, and the angle between the first change direction and the target direction is less than or equal to the first angle threshold. This means that within the first preset time period, the control device is making a linear and translational motion, and it is a linear and translational motion away from the display device. It can also be said that the third identifier is making a linear and translational motion away from the first identifier. The movement of the third identifier in the target interface and the movement of the control device can be similar to the sliding input in touch screen input.
[0169] It can be understood that the first condition includes that the first change direction of the target display position remains unchanged within the first preset time length, and the angle between the first change direction and the target direction is less than or equal to the first angle threshold, and the position change trajectory of the target display position passes through the display area corresponding to the target identifier within the first preset time length. That is to say, within the first preset time length, the third identifier is making a linear and translational motion away from the first identifier, and the movement trajectory of the third identifier passes through the display area corresponding to the target identifier, which is similar to the third identifier making a sliding input from the first identifier to the target identifier, and the trajectory of the sliding input passes through the area corresponding to the target identifier.
[0170] In an embodiment of the present application, a variety of first preset conditions are provided, and a suitable first preset condition can be selected according to actual conditions to better map the changes in the target display position of the third identifier on the target interface by positioning the control device and detecting the movement of the control device, and then select the target surrounding devices required by the user to interconnect the devices with the display device.
[0171] In some embodiments of the present application, the first preset condition includes a first condition and a second condition: the second condition includes: the length of the position change trajectory of the target display position within the first preset time length is within the target length range corresponding to the target identifier.
[0172] Among them, the first length ranges corresponding to different second identifiers may be the same or different; the first length ranges corresponding to each second identifier may be completely different, the first length ranges corresponding to each second identifier may be partially the same and partially different, and the first length ranges corresponding to each second identifier may be completely the same. The specific details can be determined based on actual conditions and are not limited here.
[0173] It can be understood that the first preset condition includes the length of the position change trajectory of the target display position within the first preset time period, which is within the first length range corresponding to the target identifier. In this way, the target identifier can be determined more accurately, and then the device interconnection with the target surrounding devices indicated by the target identifier can be carried out. Moreover, setting the length of the position change trajectory of the target display position within the first length range corresponding to the target identifier can avoid the device interconnection between the target surrounding devices and the display device due to misoperation, which can improve the accuracy of selecting devices that need to be interconnected and improve operational efficiency.
[0174] In some embodiments of the present application, in the target case, such as Fig.11 As shown, the third identifier (identifier "7") can be displayed by default in a circular area with the first identifier as the center and a radius of a preset value (the circular area shown by the shadow in the figure), and the focus of the display device remains displayed on the first identifier during the movement of the third identifier in the circular area. Among them, the target situation includes at least one of the following: the initial moment of displaying the target interface in response to the user's input operation (i.e., the relative position relationship between the third identifier and the first identifier is initially set according to the relative position of the control device and the display device), and after each completion of the device interconnection between the display device and the surrounding devices after the third preset time (i.e., the relative position relationship between the third identifier and the first identifier is reset according to the relative position of the control device and the display device), and the length of the position change trajectory (straight line motion trajectory) of the third identifier within the fourth preset time is detected to be less than or equal to the target length (i.e., the relative position relationship between the third identifier and the first identifier is reset according to the relative position change of the control device and the display device).
[0175] It should be noted that the initial setting of the relative position relationship between the third identifier and the first identifier and the resetting of the relative position relationship between the third identifier and the first identifier are only direction mapping, without distance mapping, that is, the relative position of the control device and the display device obtained by positioning and the relative position relationship between the third identifier and the first identifier in the target interface are in the same direction, but there is no corresponding relationship in distance. In the process of the user operating the control device to move, the change of the relative position of the control device and the display device obtained by positioning and the change of the relative position relationship between the third identifier and the first identifier in the target interface include both direction mapping and distance mapping, that is, within the same time, if the direction in which the user operates the control device relative to the display device is mapped to the direction in which the third identifier is relative to the target display position of the first identifier in the target interface, and the greater the distance the user operates the control device relative to the display device, the longer the length of the change track of the third identifier relative to the target display position of the first identifier in the target interface, the distance the user operates the control device relative to the display device is proportional to the length of the change track of the third identifier relative to the target display position of the first identifier in the target interface.
[0176] Wherein, if the change of the target display position meets the second preset condition within the second preset time, the second sliding input is determined, the second preset condition includes the third condition, or the second preset condition includes the third condition and the fourth condition, and the third condition includes any one of the following: the second change direction of the target display position remains unchanged within the second preset time, and the angle between the second change direction and the preset direction is less than or equal to the second angle threshold (the angle between the sliding direction corresponding to the second sliding input and the preset direction is less than or equal to the second angle threshold); within the second preset time, the target display position passes through the display area corresponding to the first identifier. The fourth condition includes: the length of the position change trajectory of the target display position within the second preset time is within the second length range corresponding to the target identifier (the length of the input trajectory corresponding to the second sliding input is within the preset length range corresponding to the target identifier, and there is a preset length mapping relationship between the second length range and the preset length range. The preset length mapping relationship can be determined according to actual conditions and is not limited here. For example, the preset length mapping relationship can be equal).
[0177] The second preset duration can be determined according to actual conditions, and is not limited here. The second preset duration can be the same as or different from the first preset duration, and can be determined according to actual conditions.
[0178] Among them, the specific description of the second preset condition, the second preset time duration, the second change direction, the preset direction, and the second angle threshold can refer to the above-mentioned description of the first preset condition, the first preset time duration, the first change direction, the target direction, and the first angle threshold, and will not be repeated here.
[0179] The second preset duration may be the same as or different from the first preset duration, which may be determined according to actual conditions and is not limited here. The second angle threshold may be the same as or different from the first angle threshold, which may be determined according to actual conditions and is not limited here.
[0180] In some embodiments of the present application, when the third condition only includes that the second change direction of the target display position remains unchanged within the second preset time length, and the angle between the second change direction and the preset direction is less than or equal to the second angle threshold, the preset direction can be the target direction, or the direction opposite to the target direction, or any other direction, which can be determined based on actual conditions and is not limited here.
[0181] In some embodiments of the present application, the third condition includes: the second change direction of the target display position remains unchanged within the second preset time length, and the angle between the second change direction and the preset direction is less than or equal to the second angle threshold; and when the target display position passes through the display area corresponding to the first identifier within the second preset time length, the preset direction is the opposite direction to the target direction.
[0182] In an embodiment of the present application, a variety of second preset conditions are provided, and a suitable second preset condition can be selected according to actual conditions to better map the changes in the target display position of the third identifier on the target interface by positioning the control device and detecting the movement of the control device, thereby triggering the display device to interconnect with the target surrounding devices.
[0183] The second length range may be the same as or different from the first length range, and may be determined based on actual conditions, which is not limited here.
[0184] The second length ranges corresponding to different second identifiers may be the same or different; the second length ranges corresponding to each second identifier may be completely different, the second length ranges corresponding to each second identifier may be partially the same and partially different, and the second length ranges corresponding to each second identifier may be completely the same. The specific details can be determined based on actual conditions and are not limited here.
[0185] If the second length range corresponding to each second identifier is not completely the same, the second length range corresponding to each second identifier may be determined according to the distance between the corresponding second identifier and the first identifier.
[0186] Among them, the specific description of the fourth condition and the second length range can refer to the above-mentioned related description of the second condition and the first length range, which will not be repeated here.
[0187] It can be understood that the fourth condition includes the length of the position change trajectory of the target display position within the second preset time period, which is within the second length range corresponding to the target identifier. In this way, it can be more accurately determined that the device that needs to be interconnected with the display device is the target surrounding device indicated by the target identifier. Moreover, setting the length of the position change trajectory of the target display position within the second length range corresponding to the target identifier can avoid the target surrounding devices from being interconnected with the display device due to misoperation, which can improve the accuracy of device interconnection, improve operating efficiency, and improve user experience.
[0188] In some embodiments of the present application, in the process of detecting the second sliding input, controlling the target identifier to move in a direction corresponding to the sliding direction of the second sliding input can be: controlling the target identifier to move following the third identifier within a second preset time period. In this way, it can be further convenient for the user to determine that the surrounding device currently selected by the display device is the target surrounding device, and the display device is about to interconnect with the target surrounding device. If the preset direction is the opposite direction to the target direction, then within the second preset time period, the target identifier is controlled to move following the third identifier, thereby achieving an animation effect of controlling the target identifier to move toward the first identifier within the second preset time period, achieving an effect similar to the drag input on a device with a touch screen function, which can improve operating efficiency and user experience.
[0189] In some embodiments of the present application, the controller is further configured to: determine the position of a human face in the target image based on a captured target image before detecting the first sliding input of the control device through image detection technology; determine the target area where the hand is located in the target image based on the position of the human face; and detect the control device in the target area to determine the starting position of the first sliding input based on the position of the control device in the target image.
[0190] It can be understood that after the position of the face in the target image is detected, the target area where the hand is located in the target image is determined according to the human body segmentation ratio, thereby reducing the detection area of the detection control device and improving the detection efficiency. Detecting the control device in the target area can specifically be detecting a feature model of the hand holding the control device. After the position of the control device in the target image is detected, the starting position of the first sliding input can also be confirmed by triggering a key input to the control device.
[0191] In the embodiment of the present application, before the first sliding input of the control device is detected by the image detection technology, the position of the face is first detected by the target image, and then the target area where the hand is located in the target image is inferred based on the position of the face, and then the control device is detected in the target area to determine the starting position of the first sliding input, and then the control device is tracked based on the starting position to detect the first sliding input. Since the face detection technology is more mature than the control device detection technology, after the face position is detected, the detection area is narrowed and the control device can be quickly detected, so compared with directly detecting the control position in the image, the detection efficiency can be improved.
[0192] Optionally, after determining the starting position of the first sliding input, the target display position of the third identifier may be mapped on the target interface according to the starting position of the first sliding input.
[0193] In some embodiments of the present application, after the starting position of the first sliding input is determined, a third prompt information can be displayed, and the third prompt information is used to prompt that the control device has been detected. In this way, the control device can be controlled to move, and then the first sliding input is detected.
[0194] In some embodiments of the present application, when the display device does not have a touch screen function, the sliding input of the control device can be detected by image detection technology, and then the second identifier corresponding to the surrounding device that needs to be interconnected can be determined based on the detected sliding input. Therefore, when the first sliding input of the control device is detected by image detection technology, the second identifier corresponding to the first sliding input is determined as the target identifier; the display device is controlled to interconnect with the target surrounding device indicated by the target identifier. Therefore, there is no need to input complex buttons on the control device, so that the target surrounding device that needs to be interconnected can be quickly determined, and the display device can be controlled to interconnect with the target surrounding device, thereby improving the efficiency of interconnecting the display device with the surrounding devices.
[0195] In order to explain this scheme in more detail, the following will be combined in an exemplary manner Figures 12 to 16 To explain, it is understandable that Figures 12 to 16 The steps involved may include more steps or fewer steps in actual implementation, and the order of these steps may also be different, subject to the device interconnection method provided in the embodiment of the present application being able to be implemented. The device interconnection method is applied to a display device controlled by a control device, and the execution subject of the device interconnection method may be a display device, or a functional module or functional entity in the display device that can implement the device interconnection method, which is not limited here. Moreover, the specific description of the device interconnection method provided in the embodiment of the present application can refer to the relevant description of the above-mentioned display device, and the same or similar technical effects can be achieved, which will not be repeated here.
[0196] Fig.12 A flowchart of a method for interconnecting devices according to one or more embodiments of the present application is provided. The method for interconnecting devices may include:
[0197] S201: Display a first logo and at least one second logo around the first logo on a target interface.
[0198] The first identifier is used to indicate the display device, and each second identifier is used to indicate a surrounding device discovered by the display device through the device discovery technology.
[0199] S1202: When a first sliding input of the control device is detected by image detection technology, a second identifier corresponding to the first sliding input is determined as a target identifier.
[0200] S1203: Control the display device to interconnect with the target surrounding devices indicated by the target identifier.
[0201] In some embodiments of the present application, the first sliding input satisfies the first condition, or the first sliding input satisfies the first condition and the second condition; wherein the first condition includes: the angle between the sliding direction of the first sliding input and the target direction is less than or equal to the first angle threshold, and the target direction is the direction where the target identifier is located with reference to the first identifier; the second condition includes: the length of the input trajectory of the first sliding input is within the target length range corresponding to the target identifier.
[0202] In some embodiments of the present application, Fig.12 ,like Fig.13 As shown, after S1202, the method further includes the following S1204, and the above S1203 can be specifically implemented through the following step S1203a.
[0203] S1204: Move the focus of the display device from the first identifier to the target identifier.
[0204] The mark on which the focus is located is the mark in the selected state.
[0205] S1203a: When a second sliding input of the control device is detected by the image detection technology, control the display device to interconnect with the target surrounding device.
[0206] In some embodiments of the present application, the above S1204 can be specifically implemented through the following S1204a to S1204c.
[0207] S1204a. Display the target identifier in a first specific display manner.
[0208] S1204b, receiving a confirmation key command from the control device.
[0209] S1204c: In response to the confirmation key instruction, move the focus of the display device from the first identifier to the target identifier.
[0210] In some embodiments of the present application, the second sliding input satisfies the third condition, or the second sliding input satisfies the third condition and the fourth condition; the third condition includes: the angle between the sliding direction of the second sliding input and the preset direction is less than or equal to the second angle threshold; the fourth condition includes: the length of the input trajectory of the second sliding input is within the preset length range corresponding to the target identifier.
[0211] In some embodiments of the present application, Fig.13 ,like Fig.14 As shown, after S1204, the method further includes the following S1205.
[0212] S1205. During the process of detecting the second sliding input, control the target identifier to move in a direction corresponding to the sliding direction of the second sliding input.
[0213] In some embodiments of the present application, Fig.14 ,like Fig.15 As shown, after S1203, the method further includes the following S1206.
[0214] S1206: After the display device and the target surrounding device complete device interconnection, the target identifier is displayed in a second specific display mode to indicate that the target surrounding device and the display device are in a connected state.
[0215] In some embodiments of the present application, Fig.15 ,like Fig.16 As shown, before S1201, the method also includes the following S1207 to S1208.
[0216] S1207. Discover multiple surrounding devices through the device discovery technology.
[0217] S1208: Determine at least one surrounding device that meets the target condition from the multiple surrounding devices.
[0218] The target condition includes at least one of the following: the signal strength of the device is greater than or equal to a strength threshold, the manufacturer of the device is a preset manufacturer, the type of the device is a preset type, and the identifier of the device is a preset identifier.
[0219] Each surrounding device corresponds to a second identifier.
[0220] In some embodiments of the present application, the above-mentioned S1201 includes the following S1201a.
[0221] S1201a: When a surrounding device discovered by the display device meets a predetermined condition, a second identifier corresponding to the surrounding device is displayed in a display area corresponding to the predetermined condition.
[0222] The predetermined condition includes at least one of the following: the signal strength of the device is within a target strength range, the manufacturer of the device is a predetermined manufacturer, the type of the device is a predetermined type, and the identifier of the device is a predetermined identifier.
[0223] In some embodiments of the present application, Fig.16 ,like Fig.17 As shown, before S1202, the method also includes the following S1209 to S1212.
[0224] S1209: Display a third identifier on the target interface.
[0225] The third identifier is used to indicate the control device, and the positional relationship between the third identifier and the first identifier is used to indicate the relative position of the control device and the display device.
[0226] S1210. Using 3D camera positioning technology, the control device is positioned in real time to determine the relative position.
[0227] S1211. Update the target display position of the third marker on the target interface according to the relative positions obtained by positioning at different times.
[0228] S1212: Determine a first sliding input of the control device according to the change of the target display position.
[0229] In some embodiments of the present application, Fig.17 ,like Fig.18 As shown, before S1209, the method also includes the following S1213 to S1215.
[0230] S1213: Before detecting the first sliding input of the control device by using the image detection technology, determine the position of the face in the target image according to the captured target image.
[0231] S1214: Determine the target area where the hand is located in the target image according to the position of the face.
[0232] S1215: Detect the control device in the target area to determine a starting position of the first sliding input according to the position of the control device in the target image.
[0233] An embodiment of the present invention also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the above-mentioned device interconnection method are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
[0234] The computer readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.
[0235] The present invention provides a computer program product, comprising: when the computer program product is run on a computer, the computer is enabled to implement the above-mentioned device interconnection method.
[0236] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.
[0237] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.
Claims
1. A display device, characterized in that: The display device is controlled by a control device, including: The display is configured to: display a first identifier and at least one second identifier located around the first identifier on a target interface, wherein the first identifier is used to indicate the display device, and each second identifier is used to indicate a surrounding device discovered by the display device through a device discovery technology; The controller is configured to: in a case where a first sliding input of the control device is detected by an image detection technology, determine a second identifier corresponding to the first sliding input as a target identifier, the first sliding input satisfies a first condition, the first condition comprising: an angle between a sliding direction of the first sliding input and a target direction is less than or equal to a first angle threshold, the target direction is a direction where the target identifier is located with reference to the first identifier; The display device is controlled to interconnect with the target surrounding devices indicated by the target identifier.
2. The display device according to claim 1, characterized in that The first sliding input also satisfies a second condition; The second condition includes: the length of the input track of the first sliding input is within the target length range corresponding to the target identifier.
3. The display device according to claim 1 or 2, characterized in that: The controller is further configured to: After determining the second identifier corresponding to the first sliding input as the target identifier, moving the focus of the display device from the first identifier to the target identifier, the identifier on which the focus is located is the identifier in a selected state; The controller is specifically configured as follows: In a case where a second sliding input of the control device is detected by the image detection technology, the display device is controlled to interconnect with the target surrounding devices.
4. The display device according to claim 3, characterized in that The controller is specifically configured as follows: After determining the second identifier corresponding to the first sliding input as the target identifier, displaying the target identifier in a first specific display manner; receiving a confirmation key command from the control device; In response to the confirmation key instruction, the focus of the display device is moved from the first identifier to the target identifier.
5. The display device according to claim 3, characterized in that The second sliding input satisfies the third condition, or the second sliding input satisfies the third condition and the fourth condition; The third condition includes: The angle between the sliding direction of the second sliding input and the preset direction is less than or equal to a second angle threshold; The fourth condition includes: the length of the input track of the second sliding input is within a preset length range corresponding to the target identifier.
6. The display device according to claim 3, characterized in that The controller is further configured to: During the process of detecting the second sliding input, controlling the target identifier to move along a direction corresponding to a sliding direction of the second sliding input; and / or, After the display device and the target surrounding device complete device interconnection, the target identifier is displayed in a second specific display mode to indicate that the target surrounding device and the display device are in a connected state.
7. The display device according to claim 1 or 2, characterized in that: The controller is further configured to: Discovering multiple surrounding devices through the device discovery technology; Determine at least one surrounding device that meets the target condition from the multiple surrounding devices, each surrounding device corresponds to a second identifier; and / or, When a surrounding device discovered by the display device satisfies a predetermined condition, a second identifier corresponding to the surrounding device is displayed in a display area corresponding to the predetermined condition; The target condition includes at least one of the following: The signal strength of the device is greater than or equal to the strength threshold, the manufacturer of the device is the preset manufacturer, the type of the device is the preset type, and the identifier of the device is the preset identifier; The predetermined condition includes at least one of the following: The signal strength of the device is within a target strength range, the manufacturer of the device is a predetermined manufacturer, the type of the device is a predetermined type, and the identifier of the device is a predetermined identifier.
8. The display device according to claim 1 or 2, characterized in that: The display is further configured as: Displaying a third identifier on the target interface, the third identifier is used to indicate the control device, and the positional relationship between the third identifier and the first identifier is used to indicate the relative position of the control device and the display device; The controller is further configured to: By using 3D camera positioning technology, the control device is positioned in real time to determine the relative position; According to the relative positions obtained by positioning at different times, updating the target display position of the third mark on the target interface; The first sliding input of the control device is determined according to the change of the target display position.
9. The display device according to claim 1 or 2, characterized in that: The controller is further configured to: Before detecting the first sliding input of the control device by using the image detection technology, determining the position of the face in the target image according to the captured target image; Determine the target area where the hand is located in the target image according to the position of the face; The control device is detected in the target area to determine a starting position of the first sliding input according to a position of the control device in the target image.
10. A device interconnection method, characterized in that: Applied to a display device controlled by a control device, the method further includes: Displaying a first identifier and at least one second identifier located around the first identifier on the target interface, wherein the first identifier is used to indicate the display device, and each second identifier is used to indicate a surrounding device discovered by the display device through a device discovery technology; In a case where a first sliding input of the control device is detected by an image detection technology, a second identifier corresponding to the first sliding input is determined as a target identifier, and the first sliding input satisfies a first condition, wherein the first condition includes: an angle between a sliding direction of the first sliding input and a target direction is less than or equal to a first angle threshold, and the target direction is a direction where the target identifier is located with reference to the first identifier; The display device is controlled to interconnect with the target surrounding devices indicated by the target identifier.
