Display device control method and system, and display device and readable storage medium

Abstract

Provided in the present application are a display device control method and system, and a display device and a readable storage medium. By using a pointing remote control device, a user can easily acquire relevant information regarding a target object in a region corresponding to a pointing indication of the pointing remote control device, that is, by using the pointing remote control device, the user can easily search for content of interest in a specific region in an image displayed by a display device, thereby reducing the time cost of acquiring relevant information regarding the content of interest by the user, and improving the user experience.

Description

Display device control method and system, display device, and readable storage medium

[0001] The present application claims priority from the Chinese patent application No. 202411400415.8 filed with the State Intellectual Property Office on September 30, 2024 and entitled "Display device control method and system, display device, and readable storage medium", the whole content of which is incorporated herein by reference. TECHNICAL FIELD

[0002] The present application relates to the technical field of terminal, and in particular to a display device control method and system, a display device, and a readable storage medium. BACKGROUND

[0003] The smart TV is a kind of television product using Internet technology. The smart TV has a full open platform and carries an operating system, and the user can install and uninstall software and game applications and the like by himself. The smart TV can meet the diversified and personalized needs of users, and therefore gradually becomes the mainstream of the television market.

[0004] Similar to the traditional television product, the current smart TV realizes the interaction with the user by receiving and executing the instruction of the user based on the remote controller. The interaction mode based on the remote controller makes the information search function of the smart TV still weak. For example, when the content of interest of the user (such as the goods liked by the user or the actor interested by the user, etc.) appears in the interface displayed by the smart TV, if the user wants to obtain the related information of the content of interest, the user needs to realize it through a relatively complex operation, which leads to the high time cost and difficulty of the user to obtain the related information. SUMMARY

[0005] The present application provides a display device control method and system, a display device, and a readable storage medium, and the user can easily obtain the related information of the target object corresponding to the pointing instruction of the pointing remote control device by using the pointing remote control device. That is, the user can easily realize the search of the content of interest in a specific region of the picture displayed by the display device by using the pointing remote control device, reduce the time cost of the user to obtain the related information of the content of interest, and improve the user experience.

[0006] In a first aspect, a display device control system is provided, which includes a display device and a pointing remote control device, the display device including a display screen in which a picture is displayed, wherein: the pointing remote control device is configured to receive a first operation of a user; the pointing remote control device is configured to send a first control signal to the display device in response to the first operation; the display device is configured to display a pointing indication of the pointing remote control device on the display screen according to the first control signal, the pointing indication including at least one position point representing an intersection of a pointing direction of the pointing remote control device and a plane in which the display screen of the display device is located; the display device is configured to display a target area on the picture according to the pointing indication; and the display device is configured to display related information of a target object in the target area on the display screen.

[0007] In the display device control system provided in the first aspect, the pointing remote control device receives the first operation of the user, and then the pointing remote control device sends the first control signal to the display device in response to the first operation of the user; the display device displays the pointing indication of the pointing remote control device on the display screen according to the first control signal, and then the display device displays the target area on the displayed picture according to the pointing indication, and displays the related information of the target object in the target area on the display screen. The user selects the target area in which the user wants to search for information through the first operation on the pointing remote control device, the user can clearly perceive the selection process of the target area through the display of the pointing indication of the pointing remote control device on the display screen, and then the related information of the target object in the target area is displayed on the display screen, so that the user can easily search for the related information of the target object in the target area through the first operation; the complexity of the user operation is reduced, the efficiency of the user in obtaining the content of interest in the picture displayed by the display device is improved, and the user experience is improved.

[0008] For example, the display device can be a smart television, a smart screen, etc., and the specific type of the display device is not limited in the present application.

[0009] For example, the pointing remote control device can be implemented by using Ultra Wide Band (UWB) technology, NearLink technology, millimeter wave radar technology, electromagnetic technology, ultrasonic technology, etc., which will not be described herein.

[0010] For example, the pointing remote control device can be an Ultra Wide Band pointing remote control device, such as a telepathic pointing remote control device.

[0011] For another example, the pointing remote control device can also be a NearLink pointing remote control device.

[0012] In a possible implementation of the first aspect, the picture is a frame image in a video, and when the first control signal is received, the video is paused, and the picture is an image displayed on the display screen when the video is paused. In this implementation, when the first control signal is received, the video on the display screen of the display device is paused, that is, the picture is displayed on the display screen statically. The picture is a frame image in the video. By pausing the video and displaying the picture statically, the user can conveniently select an object in the picture.

[0013] In a possible implementation of the first aspect, the picture is a frame image in a video, and the display screen includes a first display area and a second display area. The picture is displayed in the first display area, and the video is continuously played in the second display area. In this implementation, the picture and the video are displayed in the display screen in a regionized manner, that is, the picture is displayed while the video is continuously played. In this way, the user can continuously watch the video while conveniently selecting an object in the picture, thereby improving the user experience.

[0014] For example, the first display area in which the picture is displayed can be a partial display area of the display screen, and the second display area in which the video is played can be a partial display area of the display screen other than the first display area. Alternatively, the first display area can be the entire display area of the display screen, and the second display area can be a partial area in the first display area. The second display area in which the video is continuously played can be displayed in the form of a small window in a partial display area close to an edge of the display screen.

[0015] It can be understood that the pointing indication includes at least one position point. Depending on the first operation, the pointing indication can include one position point or multiple position points.

[0016] In a possible implementation of the first aspect, the first operation includes that the user clicks a button on the pointing remote control device. In this implementation, the user can control the display device to display the related information of the target object in the target area on the display screen by clicking the button on the pointing remote control device. The method is simple, the operation is convenient, and the user experience is good.

[0017] It can be understood that the button can be a button specially set on the pointing remote control device for displaying the related information. Alternatively, the button can be an existing button on the pointing remote control device, and the operation of clicking the existing button is associated with the display of the related information.

[0018] For example, when the first operation includes that the user clicks a button on the pointing remote control device, the pointing indication includes a first position point. Since the first operation includes that the user clicks the button on the pointing remote control device, the first position point is the intersection of the pointing direction of the pointing remote control device and the display screen when the user clicks the button on the pointing remote control device.

[0019] In a possible implementation of the first aspect, the pointing indication is a first position point, and the display device is further configured to: determine a target object from the picture according to the first position point; and process the target object to obtain a target region. In this implementation, the pointing indication includes one position point, and the target region is determined according to the position point, so that the method is simple and has low computational cost.

[0020] For example, the pointing indication is a first position point, that is, the pointing indication includes one position point, and the display device displays the pointing indication by displaying the first position point on the display screen.

[0021] It should be understood that the first position point can be displayed in various styles, for example, an icon including but not limited to a dot, an arrow, a pentagram, or the like.

[0022] In a possible implementation of the first aspect, the target region is a partial region in the picture, and the target region is displayed on the display screen in the form of a screenshot. In this implementation, the display device displays the target region in the form of a screenshot, that is, the display device control system can realize the screenshot of the partial region in the picture.

[0023] In a possible implementation of the first aspect, the pointing indication is a line connecting a plurality of position points. In this implementation, the pointing indication includes a plurality of position points, and the plurality of position points are position points generated by the user moving the pointing remote control device. By displaying the line connecting the plurality of position points, the user can obtain the experience of approximately drawing a line directly on the display screen of the display device by using the pointing remote control device, thereby improving the fluency and comfort of the user operation.

[0024] In a possible implementation of the first aspect, the pointing indication is a line connecting a plurality of position points, and the pointing indication is a closed figure or an unclosed figure. In this implementation, the pointing indication can be a closed figure or an unclosed figure. Accordingly, the user can move the pointing remote control device according to the track of the closed figure, or can also move the pointing remote control device according to the track of the unclosed figure, so that the user can be provided with various operation modes, and can select a suitable mode to move the pointing remote control device according to the user's habits and preferences. It should be understood that the pointing indication can also be an unclosed figure. Embodiments of the present application do not limit the specific shape of the pointing indication.

[0025] In a possible implementation of the first aspect, the display device is further configured to: determine a rectangle including a plurality of position points on the picture; and determine a region in the picture located in the rectangle as the target region. In this implementation, the process of determining the target region is simple and easy to implement.

[0026] Exemplarily, the rectangle used for determining the target region can be a minimum circumscribed rectangle of the plurality of position points, or can also be a rectangle obtained by expanding the minimum circumscribed rectangle towards the periphery. For example, the minimum circumscribed rectangle can be expanded by 5 mm towards the periphery respectively to obtain a rectangle including the plurality of position points, and the application does not limit the specific value of the expansion.

[0027] In a possible implementation of the first aspect, the first operation comprises: long-pressing a key on the pointing remote control device and moving the pointing remote control device. In this implementation, the user can select a target region in a picture displayed on the display screen by long-pressing a key on the pointing remote control device and moving the pointing remote control device, and the display device displays the related information of the target object in the target region, so that the method is simple, the operation is convenient, and the user experience is good.

[0028] In a possible implementation of the first aspect, the pointing indication follows the movement of the pointing remote control device and is displayed on the display screen. In this implementation, the pointing indication is gradually generated and displayed along with the movement of the pointing remote control device by the user, so that the user can obtain an operation experience similar to that of directly drawing a line on the display screen.

[0029] In a possible implementation of the first aspect, before displaying the related information of the target object in the target region on the display screen, the display device is further configured to: display at least one prompt information, and different prompt information corresponds to different related information of the target object.

[0030] The pointing remote control device is configured to receive a second operation of the user, and the second operation is used to select a first prompt information in the at least one prompt information.

[0031] The pointing remote control device is configured to send a second control signal to the display device in response to the second operation.

[0032] The display device is configured to display first related information associated with the first prompt information on the display screen in response to the second control signal.

[0033] In this implementation, the display device displays at least one prompt information, so that the user can select different types of related information by selecting the prompt information, thereby improving the matching degree between the related information displayed on the display screen and the user demand, and improving the user experience.

[0034] Exemplarily, the first prompt information comprises at least one of: prompt information for identifying the target object, and prompt information for obtaining recommended content related to the target object.

[0035] For example, the first prompt information can comprise identification or shopping.

[0036] In a second aspect, a display device control method is provided, applied to a display device including a display screen in which a picture is displayed, the method comprising: receiving a first control signal sent by a pointing remote control device, the first control signal being sent by the pointing remote control device in response to a first operation of a user; displaying a pointing indication on the display screen according to the first control signal, the pointing indication representing position information of the pointing remote control device pointing at the display screen, the pointing indication including at least one position point representing an intersection of a pointing direction of the pointing remote control device and a plane in which the display screen of the display device is located; displaying a target region on the picture according to the pointing indication; and displaying related information of a target object in the target region on the display screen.

[0037] In a possible implementation manner of the second aspect, the target region is a partial region in the picture, and the target region is displayed on the display screen in a screenshot manner.

[0038] In a possible implementation manner of the second aspect, the pointing indication includes a first position point, and the method further comprises: determining the target object from the picture according to the first position point; and processing the target object to obtain the target region.

[0039] In a possible implementation manner of the second aspect, the first operation includes: a user clicking a button on the pointing remote control device.

[0040] In a possible implementation manner of the second aspect, the pointing indication is a line connecting a plurality of position points.

[0041] In a possible implementation manner of the second aspect, the pointing indication is a closed figure or an unclosed figure.

[0042] In a possible implementation manner of the second aspect, the method further comprises: determining a rectangle including a plurality of position points on the picture; and determining a region in the picture located in the rectangle as the target region.

[0043] In a possible implementation manner of the second aspect, the first operation includes: a user long-pressing a button on the pointing remote control device and moving the pointing remote control device.

[0044] In a possible implementation manner of the second aspect, the pointing indication is displayed on the display screen following movement of the pointing remote control device.

[0045] In a possible implementation manner of the second aspect, before displaying the related information of the target object in the target region on the display screen, the method further includes: displaying at least one prompt information, different prompt information corresponding to different related information of the target object; receiving a second control signal sent by the pointing remote control device, the second control signal being sent by the pointing remote control device in response to a second operation of the user, the second operation being used for selecting a first prompt information in the at least one prompt information; and in response to the second control signal, displaying first related information associated with the first prompt information on the display screen.

[0046] In a possible implementation manner of the second aspect, the picture is an image frame in a video, and when the first control signal is received, the video is paused, and the picture is an image displayed on the display screen when the video is paused.

[0047] In a possible implementation manner of the second aspect, the picture is an image frame in a video, and the display screen includes a first display region and a second display region, and when the picture is displayed in the first display region, the video is continuously played in the second display region.

[0048] It should be understood that the second aspect also has some other possible implementation manners, and details can be referred to the content in the possible implementation manners of the first aspect; the second aspect and the technical effects that can be achieved by each implementation manner in the second aspect can also be referred to the description of the technical effects of the first aspect and the implementation manners in the first aspect. In order to avoid repetition and redundancy of the content, details are not described herein.

[0049] In a third aspect, a communication apparatus is provided, which includes units for each step of the method in the second aspect or any possible implementation manner of the second aspect.

[0050] In a fourth aspect, a communication apparatus is provided, which includes at least one processor and a memory, the processor and the memory being coupled, and the memory storing program instructions, when the program instructions stored in the memory are executed by the processor, the method in the second aspect or any possible implementation manner of the second aspect is executed.

[0051] In a fifth aspect, a communication apparatus is provided, which includes at least one processor and an interface circuit, and the at least one processor is configured to execute: the method in the second aspect or any possible implementation manner of the second aspect.

[0052] In a sixth aspect, a display device is provided, which includes any communication apparatus provided in the second aspect, the third aspect or the fourth aspect.

[0053] In a seventh aspect, a display device is provided, comprising a display screen, a processor and a memory for storing instructions, the processor being configured to read the instructions to perform the method of the second aspect or any possible implementation of the second aspect.

[0054] For example, the display device can comprise a smart television, a smart screen, etc.

[0055] The specific type of the display device in the above examples is merely an example and does not limit the display device in the embodiments of the present application.

[0056] In an eighth aspect, a program product (also referred to as a computer program product) is provided, comprising a program configured to perform the method of the second aspect or any possible implementation of the second aspect when executed by a processor.

[0057] In a ninth aspect, a readable storage medium (also referred to as a readable storage medium) is provided, in which a program is stored, and the program is configured to perform the method of the second aspect or any possible implementation of the second aspect when executed.

[0058] In a tenth aspect, a chip is provided, comprising a processor configured to call and run a program from a memory, so that an electronic device installed with the chip performs the method of the second aspect or any possible implementation of the second aspect.

[0059] It can be understood that the beneficial effects of the above-mentioned second aspect to tenth aspect can be referred to the related description in the first aspect, which will not be repeated here. BRIEF DESCRIPTION OF DRAWINGS

[0060] FIG. 1 is a schematic diagram of an example of a display device control system according to an embodiment of the present application;

[0061] FIG. 2 is a schematic diagram of a display interface change of a display device in a display device control process according to an embodiment of the present application;

[0062] FIG. 3 is a schematic diagram of a display interface change of a display device in a display device control process according to an embodiment of the present application;

[0063] FIG. 4 is a schematic diagram of a display interface change of a display device in a display device control process according to an embodiment of the present application;

[0064] FIG. 5 is a schematic diagram of a display interface change of a display device in a display device control process according to an embodiment of the present application;

[0065] FIG. 6 is a schematic diagram of a display interface change of a display device in a display device control process according to an embodiment of the present application;

[0066] FIG. 7 is a schematic diagram of a display interface of a display device in a display device control process according to an embodiment of the present application;

[0067] FIG. 8 is a schematic diagram of a display interface of a display device in a display device control process according to an embodiment of the present application;

[0068] FIG. 9 is a schematic diagram of a display interface of a display device in a display device control process according to an embodiment of the present application;

[0069] FIG. 10 is a schematic diagram of a display interface of a display device in a display device control process according to an embodiment of the present application;

[0070] FIG. 11 is a schematic diagram of a display interface of a display device in a display device control process according to an embodiment of the present application;

[0071] FIG. 12 is a schematic diagram of a display device control method according to an embodiment of the present application;

[0072] FIG. 13 is a schematic diagram of a method for determining a minimum bounding rectangle according to an embodiment of the present application;

[0073] FIG. 14 is a schematic diagram of a display device structure according to an embodiment of the present application;

[0074] FIG. 15 is a schematic diagram of a chip system according to an embodiment of the present application. DETAILED DESCRIPTION

[0075] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the drawings in the embodiments of the present application.

[0076] The terms used in the following embodiments are only for the purpose of describing specific embodiments and are not intended to be limiting of the present application. As used in the specification and the appended claims of the present application, the singular forms “a,” “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “one or more” as used herein refers to one or two or more (including two); “and / or” describes the associated relationship of associated objects, which means that there can be three relationships; for example, A and / or B, which means that A exists alone, A and B exist together, B exists alone, and A, B can be singular or plural. The character “ / ” generally represents an “or” relationship between the associated objects.

[0077] Reference within this specification to "one embodiment" or "some embodiments" means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearances of the phrase "in one embodiment" or "in some embodiments" in various places within this specification are not necessarily all referring to the same embodiment, although it can. The terms "including," "comprising," "having" and variations thereof are meant to encompass the items listed thereafter and equivalents thereof as well as additional items. The terms "coupled" and "connected," along with variations thereof, are used broadly and encompass both direct and indirect couplings or connections.

[0078] The plurality referred to in the embodiments of the present application means greater than or equal to two. It should be noted that in the description of the embodiments of the present application, the terms "first", "second", and the like are used only for the purpose of distinguishing the described embodiments, and cannot be understood as indicating or implying relative importance, nor can they be understood as indicating or implying an order.

[0079] In addition, various aspects or features of the disclosure can be realized as methods, apparatus, or articles of manufacture using standard programming and / or engineering techniques. The term "article of manufacture" as used in the embodiments of the present application encompasses a computer program accessible from any computer-readable device, carrier, or media. For example, computer-readable media can include, but are not limited to, magnetic storage devices (e.g., hard disk, floppy disk, or magnetic tape), optical storage devices (e.g., compact disk (CD), digital versatile disk (DVD), etc.), smart cards, and flash memory devices (e.g., EPROM, EEPROM, or flash memory). Additionally, the various storage media described herein can represent one or more devices and / or other machine-readable media for storing information. The term "machine-readable medium" can include, without being limited to, wireless channels and various other media capable of storing, containing, and / or carrying instruction and / or data.

[0080] At present, the interaction mode between the smart television and the user is still mainly based on the remote control, that is, the user mainly issues instructions to the smart television through the remote control to realize corresponding functions. The interaction mode based on the remote control makes the information search function of the smart television weak. For example, when the interface displayed by the smart television has content of interest to the user, if the user wants to obtain related information of the content of interest, the user needs to perform relatively complex operations, resulting in high difficulty and time cost for the user to obtain the related information.

[0081] For example, the user can first use a mobile phone or a tablet computer to take a photo of the interface displayed by the smart television to obtain a photo, and then search in the mobile phone or the tablet computer based on the obtained photo to obtain the related information. Such a method is relatively complex to operate.

[0082] For example, some smart TVs have a screenshot function, and a user can control the smart TV to take a screenshot of a displayed interface through a remote control, and then control the smart TV to send the screenshot to a mobile phone or a tablet computer through the remote control, and finally search for information based on the screenshot in the mobile phone or the tablet computer. Such a method is not only complicated to operate, but also the screenshot of the displayed interface by the smart TV is a full-screen screenshot, the method searches for information for the full-screen screenshot, and can only search for all the content in the interface displayed by the smart TV at the same time, and it is difficult to search for partial content in the interface displayed by the smart TV, that is, it is impossible to directly search for a target object of interest to the user, and therefore there must be a lot of information that the user does not need in the information obtained by the search, and therefore the method is difficult to meet the actual needs of the user.

[0083] For another example, some smart TVs support the installation of third-party software with a search function, but the search function of the third-party software can only search within the software, and the user still needs to control the smart TV through a remote control to import a corresponding photo or screenshot into the third-party software for a search for related information. Such a method is still very complicated to operate.

[0084] Therefore, the present application provides a display device control method and system, which can be used by a user to easily obtain related information of content of interest in a display device, reduce the time cost of the user to obtain the related information of the content of interest, and improve the user experience.

[0085] It should be understood that the display device control method in the embodiments of the present application can be applied to a smart screen or a smart TV, and the main use scenario is that when a user is watching a video or viewing an image using a display device and sees content of interest (such as an actor or an object), the user uses a pointing remote control device (such as an ultra-wideband pointing remote control) to select the content of interest on the display screen of the display device, and the display device control method in the embodiments of the present application can realize the taking of a screenshot of the selected content and the search for the screenshot, and then present the search result in real time on the display device.

[0086] Referring to FIG. 1, it is a schematic diagram of a display device control system provided by an embodiment of the present application. As shown in FIG. 1, the system includes a display device 110 and a pointing remote control device 120, the display device 110 is a device including a display screen, and a user can control the display device 110 through the pointing remote control device 120.

[0087] As shown in FIG. 1, a user uses a pointing remote control device 120 to point to a display screen of a display device 110, and the display screen displays a cursor 130. The position of the cursor 130 on the display screen is the intersection of the pointing direction of the pointing remote control device 120 and the display screen. When the user operates the pointing remote control device 120, the pointing remote control device 120 sends a control signal to the display device 110, so that the display device 110 displays content corresponding to the control signal according to the control signal.

[0088] In some embodiments, the control signal sent by the pointing remote control device 120 to the display device 110 can be one or more of an ultra-wideband (UWB) signal, a millimeter wave radar signal, an electromagnetic signal, an ultrasonic signal, etc.

[0089] For example, the display device 110 can be a smart television or a smart screen.

[0090] For example, the pointing remote control device 120 can be an ultra-wideband pointing remote control device, such as a NearLink pointing remote control device.

[0091] For another example, the pointing remote control device 120 can also be a NearLink pointing remote control device. The specific types of the display device 110 and the pointing remote control device 120 are not limited in the present application.

[0092] For example, when the user uses the pointing remote control device 120 to point to the display screen of the display device 110 and moves the pointing remote control device 120, the cursor 130 displayed on the display screen will move following the movement of the pointing remote control device 120; the movement track of the cursor 130 on the display screen corresponds to the movement track of the pointing remote control device 120.

[0093] It can be understood that the position of the cursor 130 on the display screen can also be referred to as a position point.

[0094] The interaction process between the pointing remote control device 120 and the display device 110 will be described below.

[0095] In some embodiments, the display screen of the display device 110 displays a static image, and the user wants to search for a first object in the static image. In this case, the interaction process between the pointing remote control device 120 and the display device 110 is as follows:

[0096] (1) The user holds the pointing remote control device 120 to point to the display screen of the display device 110, and the pointing remote control device 120 sends a control signal A1 to the display device 110. After receiving the control signal A1, the display device 110 displays the cursor 130 on the display screen based on the control signal A1, and the cursor 130 is displayed at a first position of the static image.

[0097] (2) The user then long-presses the first button and moves the pointing remote control device 120, and in the process of moving, the pointing remote control device 120 sends a plurality of control signals B1 to the display device 110; the display device 110 receives the plurality of control signals B1 one by one, moves the display cursor 130 on the display screen based on the plurality of control signals B1, and displays the track of the movement of the display cursor 130, which can be displayed step by step along with the movement of the pointing remote control device.

[0098] (3) When the user determines that the cursor 130 moves to the second position in the static image that the user desires, the user releases the first button, and the pointing remote control device 120 sends a control signal C1 to the display device 110; after the display device 110 receives the control signal C1, the display device 110 searches the target region in the static image based on the control signal C1; the target region is the region in the static image corresponding to the track of the movement of the display cursor 130; and then the display device 110 displays the information obtained by the search on the display screen.

[0099] In some other embodiments, the display screen of the display device 110 displays a static image, and the user wants to search for a first object in the static image, in which case the interaction process between the pointing remote control device 120 and the display device 110 is as follows:

[0100] (1) The user points the pointing remote control device 120 at the display screen of the display device 110, and the pointing remote control device 120 sends a control signal A2 to the display device 110; after the display device 110 receives the control signal A2, the display device 110 displays the cursor 130 on the display screen based on the control signal A2, and the cursor 130 is displayed at a first position in the static image.

[0101] (2) In the case where the cursor 130 is displayed at the first position in the static image, the user clicks a second button on the pointing remote control device 120, and the pointing remote control device 120 sends a control signal B2 to the display device 110; after the display device 110 receives the control signal B2, the display device 110 extracts the object corresponding to the first position in the static image based on the control signal B2, and displays the extracted object for highlighting.

[0102] (3) Then the display device 110 searches for the extracted object, and displays the information obtained by the search on the display screen.

[0103] In some embodiments, the display screen of the display device 110 is playing a video, and the current frame image in the video is a picture that the user is interested in, i.e., the user wants to search for a second object in the current frame image, in which case the interaction process between the pointing remote control device 120 and the display device 110 is as follows:

[0104] (1) The user holds the pointing remote control device 120 and points to the display screen of the display device 110, the pointing remote control device 120 sends a control signal A3 to the display device 110, the display device 110 displays a cursor 130 on the display screen based on the control signal A3 after receiving the control signal A3, and the cursor 130 is displayed at a first position in the current frame image.

[0105] (2) The user immediately long-presses the first button and moves the pointing remote control device 120, the pointing remote control device 120 sends multiple control signals B3 to the display device 110, the display device 110 receives the multiple control signals B3 one by one, controls the video to pause and display a static current frame image on the display screen based on the first control signal B3, then moves the display cursor 130 on the display screen based on other control signals B3, and displays a track of the movement of the cursor 130, which can be displayed gradually along with the movement of the pointing remote control device.

[0106] (3) When the user determines that the cursor 130 moves to a second position in the current frame image that the user expects, the user releases the first button, the pointing remote control device 120 sends a control signal C3 to the display device 110, the display device 110 displays information obtained by searching a target region in the current frame image based on the control signal C3 after receiving the control signal C3, and the target region is a region in the current frame image corresponding to the track of the movement of the display cursor 130.

[0107] In some embodiments, the display screen of the display device 110 is playing a video, the current frame image in the video is a picture that the user is interested in, i.e., the user wants to search for a second object in the current frame image, in this case, the interaction process between the pointing remote control device 120 and the display device 110 is as follows:

[0108] (1) The user holds the pointing remote control device 120 and points to the display screen of the display device 110, the pointing remote control device 120 sends a control signal A4 to the display device 110, the display device 110 displays a cursor 130 on the display screen based on the control signal A4 after receiving the control signal A4, and the cursor 130 is displayed at a first position in the current frame image.

[0109] (2) In the case that the cursor 130 is displayed at the first position in the current frame image, the user clicks a second button on the pointing remote control device 120, the pointing remote control device 120 sends a control signal B4 to the display device 110, the display device 110 performs cutout on an object corresponding to the first position in the current frame image based on the control signal B4 after receiving the control signal B4, and displays the cutout object for highlighting.

[0110] (3) Then the display device 110 searches the object in the matting and displays the information obtained by the search on the display screen.

[0111] It can be understood that the above-mentioned interaction process between the pointing remote control device 120 and the display device 110 is only an example and does not constitute a limitation on the interaction process between the pointing remote control device 120 and the display device 110.

[0112] For the convenience of understanding, the interface changes displayed on the display screen of the display device are exemplarily described below in combination with the accompanying drawings.

[0113] Referring to FIG. 2, it is a schematic diagram of the display interface changes of the display device in the process of controlling the display device by the pointing remote control device according to an embodiment of the present application.

[0114] As shown in FIG. 2a, the display device 110 is playing a video, the user holds the pointing remote control device 120 (not shown in FIG. 2) and points to the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, and a target object 201 is displayed in the frame. A cursor 202 is also displayed in the display interface. In the display interface shown in FIG. 2a, the position of the cursor 202 on the display screen is the starting position, which is the intersection of the pointing direction of the pointing remote control device 120 and the display screen of the display device 110 when the pointing remote control device 120 points to the display device 110. After the user holds the pointing remote control device 120 and points to the display screen of the display device 110, the user clicks the first button (not shown in FIG. 2) on the pointing remote control device 120, and the display interface of the display device 110 is switched from that shown in FIG. 2a to that shown in FIG. 2b.

[0115] Exemplarily, the position of the cursor 202 on the display screen can also be referred to as the position point.

[0116] As shown in FIG. 2b, the frame displayed in the display interface is the same frame as that shown in FIG. 2a. The difference between the display interface shown in FIG. 2b and the display interface shown in FIG. 2a is that the video in the display interface shown in FIG. 2b is in a paused state. After the user clicks the first button on the pointing remote control device 120, the user long-presses the first button and moves the pointing remote control device 120; as the pointing remote control device 120 moves, the display interface of the display device 110 is gradually switched from that shown in FIG. 2b to that shown in FIG. 2c.

[0117] As shown in FIG. 2, as the user moves the pointing device 120, the cursor 202 slides from the starting point along the direction of the dashed arrow 203 until it returns to the starting point, and the points passed by the cursor 202 are connected by curves, thereby gradually displaying the trajectory 204 shown in FIG. 2c in the display interface. In this embodiment, since the cursor 202 slides from the starting point and gradually returns to the starting point, the trajectory 204 formed in the display interface is a closed figure. As shown in FIG. 2c, the trajectory 204 is formed around the target object 201. After the trajectory 204 is formed, or after the cursor returns to the starting point, the user releases the first button of the pointing device 120, and the display interface of the display device 110 jumps from that shown in FIG. 2c to that shown in FIG. 2d.

[0118] As shown in FIG. 2d, the display interface shown in FIG. 2d displays a rectangular frame 205 around the target object 201, and also displays a region screenshot 206 and an information box 207. The region screenshot 206 is a screenshot of the region in which the rectangular frame 205 is located, and the information box 207 displays the relevant information of the target object 201. In this embodiment, the relevant information of the target object 201 includes the name of the target object 201, i.e., “Wang XX”, the occupation of the target object 201, i.e., “parkour athlete”, and the career profile of the target object 201.

[0119] In some embodiments, one of the rectangular frame 205 and the region screenshot 206 shown in the display interface shown in FIG. 2d can not be displayed, or neither of the rectangular frame 205 and the region screenshot 206 can be displayed, and the embodiments of the present application do not limit this.

[0120] In some embodiments, the rectangular frame 205 can also be replaced by a frame of other shapes, and the embodiments of the present application do not limit this.

[0121] In some embodiments, the information box 207 in the display interface shown in FIG. 2d can also be replaced by a box of other shapes, or the edge lines of the information box 207 can not be displayed, and the region in which the information box 207 is located can be displayed in a transparent or semi-transparent manner, and the embodiments of the present application do not limit this.

[0122] In some embodiments, the display interface shown in FIG. 2d also displays a control 208. The user points to the display screen of the pointing device 120, and the cursor 202 is located on the control 208. After the user clicks the second button of the pointing device, the rectangular frame 205, the region screenshot 206, and the information box 207 stop being displayed, and the video in the display device 110 switches from the paused state to the playing state.

[0123] For example, the first key and the second key can be different keys on the remote control device. For example, the first key can be a key specially set for the screenshot search, and the second key can be an OK key. Of course, the first key and the second key can be the same key on the remote control device. For example, the key can be a key specially set for the screenshot search. The embodiments of the present application do not limit the specific forms of the first key and the second key.

[0124] In some other embodiments, the rectangular frame 205, the region screenshot 206 and the information frame 207 shown in FIG. 2d can automatically stop displaying after displaying for a preset time length, and the video is automatically switched from the paused playing state to the playing state.

[0125] Of course, the rectangular frame 205, the region screenshot 206 and the information frame 207 can also stop displaying in response to other operations of the user on the remote control device 120, and the embodiments of the present application do not limit the same.

[0126] In some other embodiments, the cursor 202 can slide from the starting point in the direction of the dotted arrow 203, and can not return to the starting point, so that the formed track is a non-closed figure, and the embodiments of the present application do not limit the same.

[0127] In some embodiments, the cursor 202 can also slide in other directions from the starting point to form a track with other shapes, and the embodiments of the present application do not limit the same.

[0128] It can be understood that the shape of the track 204 depends on the track of the user moving the remote control device 120, and the embodiments of the present application do not limit the same.

[0129] It should be understood that the dotted arrow 203 in the display interface is designed for convenience of narration and understanding, and the dotted arrow 203 can not be displayed in the display interface in actual application.

[0130] Referring to FIG. 3, a display interface change schematic diagram of a display device in a process of controlling the display device by a pointing remote control device according to an embodiment of the present application is provided.

[0131] The display interface shown in a of FIG. 3 is the same as the display interface shown in a of FIG. 2. As shown in a of FIG. 3, the display device 110 is playing a video, the user holds the pointing remote control device 120 (not shown in FIG. 3) to point at the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, in which the target object 301 and the cursor 302 are displayed. The specific description of the target object 301 and the cursor 302 can be referred to the description of the target object 201 and the cursor 202 in FIG. 2, which will not be repeated here. After the user holds the pointing remote control device 120 to point at the display screen of the display device 110, the user clicks the first button (not shown in FIG. 3) on the pointing remote control device 120, and the display interface of the display device 110 is switched from a of FIG. 3 to b of FIG. 3.

[0132] As shown in b of FIG. 3, the display interface displays the frame shown in a of FIG. 3, which is displayed in the form of a static image; meanwhile, the display interface also displays the cursor 302 and the window 310, in which the video is continuously played. After the user clicks the first button on the pointing remote control device 120, the user long-presses the first button and moves the pointing remote control device 120; along with the movement of the pointing remote control device 120, the display interface of the display device 110 is gradually switched from b of FIG. 3 to c of FIG. 3.

[0133] As shown in c of FIG. 3, during the movement of the pointing remote control device 120 by the user, the cursor 302 slides from the starting point to the starting point along the direction of the dashed arrow 303, and the positions through which the cursor 302 slides are connected by a curve, thereby gradually displaying the track 304 shown in c of FIG. 3 in the display interface. In this embodiment, since the cursor 302 slides from the starting point to the starting point, the track 304 formed in the display interface is a closed figure. As shown in c of FIG. 3, the track 304 is formed around the target object 301. In addition, the window 310 in which the video is continuously played is also displayed in the display interface shown in c of FIG. 3. After the track 304 is formed, or after the cursor returns to the starting point, the user releases the first button of the pointing remote control device 120, and the display interface of the display device 110 is switched from c of FIG. 3 to d of FIG. 3.

[0134] As shown in d of FIG. 3, the display interface displays the rectangular frame 305, the region screenshot 306 and the information box 307. The specific description of the rectangular frame 305, the region screenshot 306 and the information box 307 can be referred to the description of the rectangular frame 205, the region screenshot 206 and the information box 207 in FIG. 2, which will not be repeated here.

[0135] In some embodiments, one of the rectangular frame 305 and the region screenshot 306 can also not be displayed in the display interface shown in FIG. 3d, or neither of the rectangular frame 305 and the region screenshot 306 can be displayed.

[0136] In some embodiments, the rectangular frame 305 can also be replaced by a frame of other shapes, which is not limited in the embodiments of the present application.

[0137] In some embodiments, the information frame 307 in the display interface shown in FIG. 3d can also be replaced by a frame of other shapes, or the edge line of the information frame 307 can not be displayed, and the region where the information frame 307 is located can be displayed in a transparent or semi-transparent manner, which is not limited in the embodiments of the present application.

[0138] In some embodiments, as shown in FIG. 3d, the display interface further displays a control 308. The user points the pointing display screen of the remote control device 120, and the cursor 302 is located on the control 308. After the user clicks the second button of the pointing remote control device, the rectangular frame 305, the region screenshot 306 and the information frame 307 stop being displayed, and the video played in the window 310 is switched to full-screen playing.

[0139] In some other embodiments, as shown in FIG. 3d, the rectangular frame 305, the region screenshot 306 and the information frame 307 can automatically stop being displayed after being displayed for a preset time length, and the video played in the window 310 is automatically switched to full-screen playing.

[0140] Of course, the rectangular frame 305, the region screenshot 306 and the information frame 307 can also stop being displayed in response to other operations of the user on the pointing remote control device 120, and the video played in the window 310 can also be switched to full-screen playing in response to other operations of the user on the pointing remote control device 120, which is not described herein again.

[0141] It should be understood that in the embodiments shown in FIG. 3, the video is continuously played during the switching of the display interface.

[0142] It can be understood that the first button and the second button can be different buttons on the pointing remote control device. For example, the first button can be a button specially set for screenshot searching, and the second button can be an OK button. Of course, the first button and the second button can be the same button on the pointing remote control device. For example, it can be a button specially set for screenshot searching. The specific forms of the first button and the second button are not limited in the embodiments of the present application.

[0143] In some other embodiments, the cursor 302 can slide from the starting point in the direction of the dotted arrow 303, and can not return to the starting point, so that the trajectory formed is a non-closed figure, which will not be described herein.

[0144] In some embodiments, the cursor 302 can also slide in other directions from the starting point to form trajectories of other shapes, which will not be described herein.

[0145] It can be understood that the shape of the trajectory 304 depends on the trajectory of the user moving the pointing remote control device 120, which will not be described herein.

[0146] It should be understood that the dotted arrow 303 in the display interface is designed for convenience of description and understanding, and in actual applications, the dotted arrow 303 can not be displayed in the display interface.

[0147] Referring to FIG. 4, FIG. 4 is a schematic diagram of changes of a display interface of a display device in a process of controlling the display device by a pointing remote control device according to an embodiment of the present application.

[0148] The display interface shown in FIG. 4a is the same as the display interface shown in FIG. 2a, as shown in FIG. 4a, the display device 110 is playing a video, a user holds the pointing remote control device 120 (not shown in FIG. 4) and points to the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, and the frame of the video displays a target object 401 and a cursor 402. The target object 401 and the cursor 402 will not be described herein, and the descriptions of the target object 401 and the cursor 402 can be referred to the descriptions of the target object 201 and the cursor 202 in FIG. 2. After the user holds the pointing remote control device 120 and points to the display screen of the display device 110, the user immediately clicks a first button (not shown in FIG. 4) on the pointing remote control device 120, and the display interface of the display device 110 is switched from that shown in FIG. 4a to that shown in FIG. 4b.

[0149] As shown in FIG. 4b, the display interface is the same as the display interface shown in FIG. 3b, and the frame is displayed in the form of a static image in the display interface; meanwhile, the cursor 402 and a window 410 are also displayed in the display interface, and the video is continuously played in the window 410. After the user clicks the first button on the pointing remote control device 120, the user immediately long-presses the first button and moves the pointing remote control device 120; along with the movement of the pointing remote control device 120, the display interface of the display device 110 is gradually switched from that shown in FIG. 4b to that shown in FIG. 4c.

[0150] As shown in FIG. 4c, the display interface is the same as that shown in FIG. 3c, and the display interface displays the target object 401, the cursor 402, the dashed arrow 403, and the track 404. For specific descriptions of the target object 401, the cursor 402, the dashed arrow 403, and the track 404, refer to the related descriptions of the target object 301, the cursor 302, the dashed arrow 303, and the track 304 in FIG. 3, which are not repeated here. In addition, the display interface shown in FIG. 4c further displays a window 410 in which the video is continuously played. After the track 404 is formed, or after the cursor returns to the starting point, the user releases the first button of the pointing remote control device 120, and the display interface of the display device 110 jumps from that shown in FIG. 4c to that shown in FIG. 4d.

[0151] As shown in FIG. 4d, the display interface displays a split-screen line 409, which divides the display interface into a left region 405 and a right region 407. In the left region 405, the video is continuously played. In the right region 407, a region screenshot 406 of the track 404 in the screen shown in FIG. 4c is displayed, and the related information of the target object 401 is further displayed in the right region 407. In this embodiment, the related information of the target object 401 includes the name “XX Wang” of the target object 401, the occupation “parkour athlete”, and the career profile.

[0152] In some embodiments, the display interface shown in FIG. 4d further displays a control 408 in the right region 407. The user points to the display screen of the pointing remote control device 120, and the cursor 402 is located on the control 408. After the user clicks the second button of the pointing remote control device, the split-screen line 409 and the content displayed in the right region 407 stop being displayed, and the video is played in the left region 405 and switched to full-screen playing.

[0153] In some embodiments, the content displayed in the split-screen line 409 and the right region 407 shown in FIG. 4d can automatically stop being displayed after a preset time length, and the video is switched from playing in the left region 405 to full-screen playing.

[0154] Of course, the content displayed in the split-screen line 409 and the right region 407 can also stop being displayed in response to other operations of the user on the pointing remote control device 120, which are not repeated here.

[0155] It should be understood that in the embodiments shown in FIG. 4, the video is continuously played during the switching of the display interface.

[0156] It can be understood that the first key and the second key can be different keys on the remote control device. For example, the first key can be a key specially set for the screenshot search, and the second key can be an OK key. Of course, the first key and the second key can be the same key on the remote control device. For example, the key can be a key specially set for the screenshot search. Embodiments of the present application do not limit the specific forms of the first key and the second key.

[0157] In some embodiments, the cursor 402 can slide from the starting point in the direction of the dotted arrow 403, and can not return to the starting point, so that a non-closed figure is formed. The present application does not repeat the description.

[0158] In some embodiments, the cursor 402 can also slide in other directions from the starting point to form a track of other shapes. The present application does not repeat the description.

[0159] It can be understood that the shape of the track 404 depends on the track of the user moving the pointing remote control device 120. The present application does not repeat the description.

[0160] It should be understood that the dotted arrow 403 in the display interface is designed for convenience of description and understanding. In actual application, the dotted arrow 403 can not be displayed in the display interface.

[0161] Referring to FIG. 5, FIG. 5 is a schematic diagram of changes of a display interface of a display device in a process of controlling the display device by a pointing remote control device according to an embodiment of the present application.

[0162] As shown in FIG. 5a, the display device 110 is playing a video, and a user holds a pointing remote control device 120 (not shown in FIG. 5) to point at the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110. A cursor 502 is displayed in the display interface. In the display interface shown in FIG. 5a, the point on the display screen where the cursor 502 is located is a starting point, which is the intersection of the pointing of the pointing remote control device 120 and the display screen of the display device 110 when the pointing remote control device 120 points at the display device 110. After the user holds the pointing remote control device 120 to point at the display screen of the display device 110, the user immediately clicks a first key (not shown in FIG. 5) on the pointing remote control device 120, and the display interface of the display device 110 is switched from that shown in FIG. 5a to that shown in FIG. 5b.

[0163] For example, the point on the display screen where the cursor 502 is located can also be referred to as a position point.

[0164] As shown in FIG. 5b, the display interface displays the same frame as shown in FIG. 5a. The difference between the display interface shown in FIG. 5b and the display interface shown in FIG. 5a is that the video in the display interface shown in FIG. 5b is in a paused state. After the user clicks the first button on the pointing remote control device 120, the user long-presses the first button and moves the pointing remote control device 120. As the pointing remote control device 120 moves, the display interface of the display device 110 gradually changes from that shown in FIG. 5b to that shown in FIG. 5c.

[0165] As shown in FIG. 5c, as the user moves the pointing remote control device 120, the cursor 502 slides from the starting point in the direction of the dashed arrow 503 until it returns to the starting point. The points through which the cursor 502 slides are connected by a curve, and thus the trajectory 504 shown in FIG. 5c is gradually displayed in the display interface. In this embodiment, the trajectory 504 formed in the display interface is a closed figure because the cursor 502 slides from the starting point and gradually returns to the starting point. As shown in FIG. 5c, the trajectory 504 is formed around the target object 501, which is a hat worn on the head of a person in the frame in this embodiment. After the trajectory 504 is formed, or after the cursor 502 returns to the starting point, the user releases the first button of the pointing remote control device 120, and the display interface of the display device 110 jumps from that shown in FIG. 5c to that shown in FIG. 5d.

[0166] As shown in FIG. 5d, a rectangular frame 505 is displayed in the display interface, and the rectangular frame 505 surrounds the target object 501, which is a hat worn on the head of a person in the frame in this embodiment. An information box 507 is also displayed in the display interface, and the information box 507 displays recommended content related to the target object 501, specifically, information about a similar product to the target object 501. The information can be linked to a shopping website, and the user can jump to the shopping website to purchase the product by clicking the information.

[0167] In some embodiments, the display interface shown in FIG. 5d can not display the rectangular frame 505.

[0168] In some embodiments, the rectangular frame 505 can also be replaced by a frame of another shape, which is not limited in the embodiments of this application.

[0169] In some embodiments, the information box 507 in the display interface shown in FIG. 5d can also be replaced by a frame of another shape, or the edge line of the information box 507 can not be displayed, and the area where the information box 507 is located can be displayed in a transparent or semi-transparent manner, which is not limited in the embodiments of this application.

[0170] In some embodiments, the display interface shown in FIG. 5d further displays a control 508. The user points the pointing display screen of the pointing remote control device 120, and the cursor 502 is located on the control 508. After the user clicks a second button of the pointing remote control device, the information box 507 and the content displayed therein stop displaying, and the video displayed on the display device 110 switches from the pause state to the play state.

[0171] It can be understood that the first button and the second button can be different buttons on the pointing remote control device. For example, the first button can be a button specially set for the screenshot search, and the second button can be an OK button. Of course, the first button and the second button can be the same button on the pointing remote control device. For example, the button can be a button specially set for the screenshot search. The embodiments of the present application do not limit the specific forms of the first button and the second button.

[0172] In some other embodiments, the information box 507 and the content displayed therein shown in FIG. 5d can automatically stop displaying after a preset time length is displayed, and the video automatically switches from the pause play state to the play state.

[0173] Of course, the information box 507 and the content displayed therein can also stop displaying in response to other operations of the user on the pointing remote control device 120, and the embodiments of the present application do not limit the same.

[0174] In some other embodiments, the cursor 502 can slide along the direction of the dashed arrow 503 from the starting point and can not return to the starting point, so that the formed track is a non-closed figure, and the embodiments of the present application do not limit the same.

[0175] In some embodiments, the cursor 502 can also slide in other directions from the starting point to form a track of other shapes, and the embodiments of the present application do not limit the same.

[0176] It can be understood that the shape of the track 504 depends on the track of the user moving the pointing remote control device 120, and the embodiments of the present application do not limit the same.

[0177] It should be understood that the dashed arrow 503 in the display interface is designed for the convenience of description and understanding, and in actual application, the dashed arrow 503 can not be displayed in the display interface.

[0178] Referring to FIG. 6, it is a display interface change diagram of the display device in a process of controlling the display device by the pointing remote control device provided by the embodiments of the present application.

[0179] As shown in FIG. 6a, the display interface is basically the same as the display interface shown in FIG. 5a. Wherein: the display device 110 is playing a video, the user holds the pointing remote control device 120 (not shown in FIG. 6) to point to the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110. The cursor 602 is displayed in the display interface, and the position of the cursor 602 on the display screen is the starting position; the cursor 602 in FIG. 6 is only slightly different from the cursor 502 in FIG. 5 in that the specific position in the interface is slightly different, so the detailed description of the cursor 602 can refer to the description of the cursor 502 in FIG. 5, and will not be repeated here. After the user holds the pointing remote control device 120 to point to the display screen of the display device 110, the first button (not shown in FIG. 6) on the pointing remote control device 120 is clicked, and the display interface of the display device 110 is switched from that shown in FIG. 6a to that shown in FIG. 6b.

[0180] As shown in FIG. 6b, the display interface is basically the same as the display interface shown in FIG. 5b. The video in the display interface shown in FIG. 6b is in a paused state. After the user clicks the first button on the pointing remote control device 120, the first button is long-pressed and the pointing remote control device 120 is moved; along with the movement of the pointing remote control device 120, the display interface of the display device 110 is gradually switched from that shown in FIG. 6b to that shown in FIG. 6c.

[0181] As shown in FIG. 6c, along with the movement of the pointing remote control device 120 by the user, the cursor 602 slides from the starting position to the starting position along the direction of the dashed arrow 603, and the positions passed by the cursor 602 are connected by a curve, and then the trajectory 604 shown in FIG. 6c is gradually displayed in the display interface. In this embodiment, since the cursor 602 gradually slides from the starting position to the starting position, the trajectory 604 formed in the display interface is a closed figure. As shown in FIG. 6c, the trajectory 604 is formed around the target object 601, which is the upper body of the person in the picture in this embodiment. After the trajectory 604 is formed, or after the cursor 602 returns to the starting position, the user releases the first button of the pointing remote control device 120, and the display interface of the display device 110 jumps from that shown in FIG. 6c to that shown in FIG. 6d.

[0182] As shown in Fig. 6d, the display interface displays a rectangular frame 605 surrounding the target object 601, which is the upper body of the person in the picture in this embodiment. The first control 606 and the second control 607 are also displayed in the rectangular frame 605, the first control 606 displays the prompt information "shopping", and the second control 607 displays the prompt information "recognition". If the user points the pointing display screen of the remote control device 120 and the cursor 602 is located on the first control 606, and then the user clicks the second button of the remote control device, the display interface shown in Fig. 6d jumps to the display interface shown in Fig. 6e.

[0183] In some embodiments, the display interface shown in Fig. 6d can also not display the rectangular frame 605, for example, the edge line of the rectangular frame 605 can also not be displayed, and the area where the rectangular frame 605 is located is displayed in a transparent or semi-transparent form.

[0184] In some embodiments, the rectangular frame 605 can also be replaced by other shapes of frames, which are not limited in the embodiments of the present application.

[0185] As shown in Fig. 6e, the display interface displays a first information box 608, which displays the shopping recommendation information related to the target object 601. Specifically, the shopping recommendation information includes the related information of the goods similar to the hat and shirt worn by the person in the target object 601, which can be linked to a shopping website, and the user can jump to the shopping website to select and purchase the goods by clicking the related information.

[0186] In some embodiments, the first information box 608 in the display interface shown in Fig. 6e can also be replaced by other shapes of frames, or the edge line of the first information box 608 can also not be displayed, and the area where the first information box 608 is located is displayed in a transparent or semi-transparent form, which are not limited in the embodiments of the present application.

[0187] In some embodiments, the display interface shown in Fig. 6e also displays a control 609. If the user points the pointing display screen of the remote control device 120 and the cursor 602 is located on the control 609, and then the user clicks the second button of the remote control device, the first information box 608 and the content displayed therein stop displaying, the rectangular frame 605 and the content displayed therein also stop displaying, and the video in the display device 110 switches from the pause state to the play state.

[0188] In some embodiments, the display interface shown in Fig. 6e also displays a control 610. If the user points the pointing display screen of the remote control device 120 to the control 610 and the cursor 602 is located on the control 610, after the user clicks the second button of the remote control device, the first information box 608 and the content displayed therein stop displaying, and the display interface shown in Fig. 6e jumps to that shown in Fig. 6d.

[0189] In the display interface shown in Fig. 6d, if the user points the pointing display screen of the remote control device 120 to the second control 607 and the cursor 602 is located on the second control 607, after the user clicks the second button of the remote control device, the display interface shown in Fig. 6d jumps to that shown in Fig. 6f.

[0190] As shown in Fig. 6f, the display interface displays a second information box 611, which displays information related to the target object 601. Specifically, the information related to the target object 601 includes a portrait 612 of a person in the target object 601 and introduction information of the person in the target object 601.

[0191] It can be understood that the portrait 612 can also be displayed in other forms, or the portrait 612 can not be displayed, which are not limited in the embodiments of the present application.

[0192] In some embodiments, the second information box 611 in the display interface shown in Fig. 6f can also be replaced by a box of other shapes; or the edge line of the second information box 611 can not be displayed, and the area where the second information box 611 is located is displayed in a transparent or semi-transparent form, which are not limited in the embodiments of the present application.

[0193] In some embodiments, the display interface shown in Fig. 6f also displays a control 613. If the user points the pointing display screen of the remote control device 120 to the control 613 and the cursor 602 is located on the control 613, after the user clicks the second button of the remote control device, the second information box 611 and the content displayed therein stop displaying, the rectangular box 605 and the content displayed therein also stop displaying, and the video in the display device 110 switches from the pause state to the play state.

[0194] In some embodiments, the display interface shown in Fig. 6f also displays a control 614. If the user points the pointing display screen of the remote control device 120 to the control 614 and the cursor 602 is located on the control 614, after the user clicks the second button of the remote control device, the second information box 611 and the content displayed therein stop displaying, and the display interface shown in Fig. 6f jumps to that shown in Fig. 6d.

[0195] In some embodiments, the display interface shown in Fig. 6f further displays a control 615. If the user points the pointing display screen of the pointing remote control device 120 and the cursor 602 is located on the control 615, more information related to the person in the target object 601 is displayed in the second information box 611 after the user clicks the second button of the pointing remote control device.

[0196] For example, since the person in the target object 601 is an actor, the more related information can include video information of the movies and TV shows in which the actor has appeared. The video information can be linked to a video playing address. If the user points the cursor 602 of the pointing remote control device to the video information and clicks the second button of the pointing remote control device, the related video can be played directly or the user can be directed to a video website to play the related video.

[0197] Of course, the user can also obtain other types of information through the control 615, which will not be described herein.

[0198] It can be understood that the first button and the second button can be different buttons on the pointing remote control device. For example, the first button can be a button specially set for the screenshot search, and the second button can be an OK button. Of course, the first button and the second button can be the same button on the pointing remote control device. For example, the button can be a button specially set for the screenshot search. The specific form of the first button and the second button will not be limited in the embodiments of the present application.

[0199] In some embodiments, the rectangular box 605 shown in Fig. 6d and the content displayed therein can be automatically stopped from being displayed after a preset time period, and the video is automatically switched from the paused playing state to the playing state. Of course, the rectangular box 605 and the content displayed therein can also be stopped from being displayed in response to other operations of the user on the pointing remote control device 120, which will not be described herein.

[0200] In some embodiments, the first information box 608 shown in Fig. 6e and the content displayed therein can be automatically stopped from being displayed after a preset time period, and the video is automatically switched from the paused playing state to the playing state. Of course, the first information box 608 and the content displayed therein can also be stopped from being displayed in response to other operations of the user on the pointing remote control device 120, which will not be described herein.

[0201] In some embodiments, the second information box 611 shown in Fig. 6e and the content displayed therein can be automatically stopped from being displayed after a preset time period, and the video is automatically switched from the paused playing state to the playing state. Of course, the second information box 611 and the content displayed therein can also be stopped from being displayed in response to other operations of the user on the pointing remote control device 120, which will not be described herein.​​​​​​

[0202] In some embodiments, the cursor 602 can slide from the starting point in the direction of the dotted arrow 603, and can not return to the starting point, so that the trajectory formed is a non-closed figure, which will not be described herein.

[0203] In some embodiments, the cursor 602 can also slide in other directions from the starting point to form trajectories of other shapes, which will not be described herein.

[0204] It can be understood that the shape of the trajectory 604 depends on the trajectory of the user moving the pointing remote control device 120, which will not be described herein.

[0205] It should be understood that the dotted arrow 603 in the display interface is designed for convenience of description and understanding, and in actual application, the dotted arrow 603 can not be displayed in the display interface.

[0206] Referring to FIG. 7, it is a schematic diagram of changes of a display interface of a display device in a process of controlling the display device by a pointing remote control device according to an embodiment of the present application.

[0207] As shown in FIG. 7a, the display device 110 is playing a video, a user holds a pointing remote control device 120 (not shown in FIG. 7) and points to the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, and a target object 701 is displayed in the frame. A cursor 702 is also displayed in the display interface. The cursor 702 in FIG. 7a is different from the cursor 202 in FIG. 2a in that the specific positions in the interface are different, and thus the detailed description of the cursor 702 can refer to the description of the cursor 202 in FIG. 2, which will not be described herein. After the user holds the pointing remote control device 120 and points to the display screen of the display device 110, the user immediately clicks a first button (not shown in FIG. 7) on the pointing remote control device 120, and the display interface of the display device 110 is switched from that shown in FIG. 7a to that shown in FIG. 7b.

[0208] For example, the position of the cursor 702 on the display screen can also be referred to as a position point.

[0209] As shown in FIG. 7b, the frame of the video displayed in the display interface is the same as that shown in FIG. 7a. The difference between the display interface shown in FIG. 7b and that shown in FIG. 7a is that the video in the display interface shown in FIG. 7b is in a paused state. After the user clicks the first button on the pointing remote control device 120, the user immediately releases the first button; and the display interface of the display device 110 is gradually switched from that shown in FIG. 7b to that shown in FIG. 7c.

[0210] As shown in FIG. 7(c), the target object 706 is displayed with a highlighted contour in the display interface, specifically, the outer contour of the target object 706 shown in FIG. 7(c) is thicker than the outer contour of the target object 701 shown in FIG. 7(b), thereby achieving a highlighting effect.

[0211] Of course, the contour highlighting of the target object 706 can be in other manners, for example, the outer contour of the target object 706 can be dynamically changed, such as being alternatively displayed in at least two different colors, or alternatively displayed in a thick contour and a thin contour; the present application does not limit this.

[0212] For example, the contour highlighting of the target object 706 can be a display state after performing a cutout processing on the target object 701 in the picture.

[0213] In the display interface shown in FIG. 7(c), an information box 703 is also displayed, and the information box 703 displays an avatar 704 of the target object and related information of the target object. In this embodiment, the related information of the target object includes the name of the target object "Wang XX", the occupation of the target object "parkour athlete", and a career profile of the target object.

[0214] It can be understood that the avatar 704 can also be displayed in other forms, or the avatar 704 can not be displayed, and the embodiments of the present application do not limit this.

[0215] In some embodiments, the information box 703 in the display interface shown in FIG. 7(c) can also be replaced by a box with other shapes; or the edge line of the information box 703 can not be displayed, and the area where the information box 703 is located is displayed in a transparent or semi-transparent form; the embodiments of the present application do not limit this.

[0216] In some embodiments, as shown in FIG. 7(c), a control 705 is also displayed in the display interface. If the user points the remote control device 120 to the display screen, and the cursor 702 is located on the control 705, and then the user clicks the second button of the remote control device, the information box 703 and the content displayed therein stop being displayed, and the video in the display device 110 is switched from the pause state to the play state.

[0217] It can be understood that the first button can be a button specially set for the screenshot search, or the first button can be an OK button, and the present application does not limit the specific form of the first button.

[0218] In some embodiments, as shown in FIG. 7(c), the information box 703 can automatically stop being displayed after a preset time length, and the video is automatically switched from the pause play state to the play state.

[0219] Of course, the information box 703 can also stop displaying in response to other operations of the pointing remote control device 120, and the embodiments of the present application do not repeat the description.

[0220] It can be understood that the cursor 702 is a track in this embodiment, and the track in this embodiment includes a position point, and the present application does not repeat the description.

[0221] Referring to FIG. 8, it is a schematic diagram of the display interface of the display device in a process of controlling the display device by the pointing remote control device according to an embodiment of the present application.

[0222] The display interface shown in FIG. 8a is the same as the display interface shown in FIG. 7a. As shown in FIG. 8a, the display device 110 is playing a video, and a user holds the pointing remote control device 120 (not shown in FIG. 8) to point at the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, and a target object 801 is displayed in the frame. A cursor 802 is also displayed in the display interface, and the detailed description of the cursor 802 can refer to the description of the cursor 702 in FIG. 7, and the present application does not repeat the description. After the user holds the pointing remote control device 120 to point at the display screen of the display device 110, the user immediately clicks a first button (not shown in FIG. 8) on the pointing remote control device 120, and the display interface of the display device 110 is switched from that shown in FIG. 8a to that shown in FIG. 8b.

[0223] For example, the position point of the cursor 802 on the display screen can also be referred to as a position point.

[0224] As shown in FIG. 8b, the frame displayed in the display interface is the same as that shown in FIG. 8a, and the video continues to play in the display interface shown in FIG. 8b. The difference between the display interface shown in FIG. 8b and the display interface shown in FIG. 8a is that the display interface shown in FIG. 8b further displays a window 806. The target object 807 is displayed in the window 806 with a highlighted outline; specifically, the outer outline of the target object 807 shown in the window 806 is thicker than that of the target object 801 shown in FIG. 8a. In this embodiment, the time of the user clicking the first button is short, and thus the frame shown in FIG. 8b is still the same as that shown in FIG. 8a, that is, the video continues to play within the length of time of the user clicking the first button, but the frame of the video does not switch due to the short time. If the user holds the first button for a longer time after clicking the first button on the pointing remote control device 120, the frame in the display interface shown in FIG. 8b will be switched to another frame of the video.

[0225] It can be understood that the detailed introduction about the target object 807 highlighted by the outline can refer to the description about the target object 706 in FIG. 7, which is not repeated here.

[0226] In the display interface shown in FIG. 8b, the user clicks the first button on the pointing remote control device 120 and then releases the first button; the display interface of the display device 110 is gradually switched from that shown in FIG. 8b to that shown in FIG. 8c.

[0227] As shown in FIG. 8c, the display interface displays an information box 803, and the information box 803 displays the avatar 804 of the target object and related information. In this embodiment, the related information of the target object includes the name of the target object "Wang XX", the occupation "parkour athlete", and the career profile.

[0228] It can be understood that the avatar 804 can also be displayed in other forms, or the avatar 804 can not be displayed, which is not limited in the embodiments of the present application.

[0229] In some embodiments, the information box 803 in the display interface shown in FIG. 8c can also be replaced by a box of other shapes; or the edge line of the information box 803 can not be displayed, and the area where the information box 803 is located is displayed in a transparent or semi-transparent form; which is not limited in the embodiments of the present application.

[0230] In some embodiments, as shown in FIG. 8c, the display interface also displays a control 805. If the user points the display screen of the pointing remote control device 120, and the cursor 802 is located on the control 805, and then the user clicks the second button on the pointing remote control device, the information box 803 and the content displayed therein stop displaying.

[0231] It can be understood that the first button can be a button specially set for screenshot search, or the first button can be an OK button, and the specific form of the first button is not limited in the present application.

[0232] In some embodiments, the information box 803 shown in FIG. 8c can automatically stop displaying after displaying for a preset time length. Of course, the information box 803 can also stop displaying in response to other operations of the user on the pointing remote control device 120, which is not repeated here in the embodiments of the present application.

[0233] It can be understood that the cursor 802 is the trajectory in this embodiment, that is, the trajectory in this embodiment includes a position point, which is not repeated here in the present application.

[0234] Referring to FIG. 9, in an example process of controlling the display device by the pointing remote control device provided in the embodiments of the present application, a schematic diagram of the change of the display interface of the display device is provided.

[0235] The display interface shown in FIG. 9a is the same as the display interface shown in FIG. 7a. As shown in FIG. 9a, the display device 110 is playing a video, the user points the remote control device 120 (not shown in FIG. 9) at the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, in which a target object 901 is displayed. In the display interface, a cursor 902 is also displayed. For details of the cursor 902, refer to the description of the cursor 702 in FIG. 7, which will not be repeated here. After the user points the remote control device 120 at the display screen of the display device 110, the user immediately clicks a first button (not shown in FIG. 9) on the remote control device 120, and the display interface of the display device 110 is switched from that shown in FIG. 9a to that shown in FIG. 9b.

[0236] For example, the position of the cursor 902 on the display screen can also be referred to as a position point.

[0237] The display interface shown in FIG. 9b is the same as the display interface shown in FIG. 8b. The video in the display interface shown in FIG. 9b continues to play. The display interface shown in FIG. 9b displays a window 906, in which a target object 907 is displayed with a highlighted outline. For details of the target object 907, refer to the description of the target object 807 in FIG. 8, which will not be repeated here. In this embodiment, the user clicks the first button for a very short time, so the frame shown in FIG. 9b is still the same as that shown in FIG. 9a, i.e., the video continues to play within the time length during which the user clicks the first button, but the frame of the video does not change because the time is very short. If the user holds the first button for a longer time after clicking the first button on the remote control device 120, the frame in the display interface shown in FIG. 9b will be switched to another frame of the video.

[0238] In the display interface shown in FIG. 9b, the user immediately releases the first button after clicking the first button on the remote control device 120. The display interface of the display device 110 is gradually switched from that shown in FIG. 9b to that shown in FIG. 9c.

[0239] As shown in Fig. 9(c), the display interface displays a split screen line 903, which divides the display interface into a left region 907 and a right region 908. The video is continuously played in the left region 907. The right region 908 displays a head portrait 904 of the target object 901 in the screen shown in Fig. 9(b), and displays the related information of the target object, which includes the name of the target object "Wang XX", the occupation "parkour athlete", and the career profile of the target object.

[0240] It can be understood that the head portrait 904 can also be displayed in other forms, or the head portrait 904 can not be displayed, which is not limited in the embodiments of the present application.

[0241] In some embodiments, as shown in Fig. 9(c), the display interface further displays a control 905 in the right region 908. The user points the pointing display screen of the remote control device 120, and the cursor 902 is located on the control 905. After the user clicks the second button of the pointing remote control device, the split screen line 903 and the content displayed in the right region 908 stop displaying, and the video is switched from playing in the left region 907 to full screen playing.

[0242] In some embodiments, the content displayed in the split screen line 903 and the right region 908 shown in Fig. 9(c) can automatically stop displaying after a preset time length, and the video is switched from playing in the left region 907 to full screen playing.

[0243] Of course, the content displayed in the split screen line 903 and the right region 908 can also stop displaying in response to other operations of the user on the pointing remote control device 120, which is not described herein again.

[0244] It can be understood that the first button can be a button specially set for screenshot search, or the first button can be an OK button, and the specific form of the first control is not limited in the present application.

[0245] It can be understood that the cursor 902 is a track in this embodiment, that is, the track in this embodiment includes a position point, which is not described herein again.

[0246] Referring to Fig. 10, it is a display interface change diagram of a display device in a process of controlling the display device by a pointing remote control device according to an embodiment of the present application.

[0247] The display interface shown in a of FIG. 10 is the same as the display interface shown in a of FIG. 7. As shown in a of FIG. 10, the display device 110 is playing a video, the user holds the pointing remote control device 120 (not shown in FIG. 10) to point at the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, in which the target object 1001 is displayed. In the display interface, the cursor 1002 is also displayed. For details of the cursor 1002, refer to the description of the cursor 702 in FIG. 7, which will not be repeated here. After the user holds the pointing remote control device 120 to point at the display screen of the display device 110, the user immediately clicks the first button (not shown in FIG. 10) on the pointing remote control device 120, and the display interface of the display device 110 is switched from that shown in a of FIG. 10 to that shown in b of FIG. 10.

[0248] For example, the position of the cursor 1002 on the display screen can also be referred to as a position point.

[0249] As shown in b of FIG. 10, the display interface displays the frame shown in a of FIG. 10 in the form of a static image, and displays the window 1006 in which the video is continuously played. In this embodiment, the user clicks the first button for a very short time, so the frame displayed in the window 1006 is still the same as that shown in a of FIG. 10, that is, the video is continuously played within the time length during which the user clicks the first button, but the frame of the video does not change because the time is very short. If the user holds the first button on the pointing remote control device 120 for a longer time after clicking the first button, the frame in the window 1006 shown in b of FIG. 10 will be switched to another frame of the video.

[0250] In the display interface shown in b of FIG. 10, the user immediately releases the first button on the pointing remote control device 120 after clicking the first button. The display interface of the display device 110 is gradually switched from that shown in b of FIG. 10 to that shown in c of FIG. 10.

[0251] As shown in c of FIG. 10, the target object 1007 is displayed in the display interface with a highlighted outline. Specifically, the outer outline of the target object 1007 shown in c of FIG. 10 is thicker than that of the target object 1001 shown in b of FIG. 10, thereby achieving the effect of highlighting.

[0252] Of course, the outline of the target object 1007 can be highlighted in other ways. For example, the outer outline of the target object 1007 can be dynamically changed, such as being displayed in at least two different colors in turn, or being alternately displayed in a thick outline and a thin outline. The present application does not limit or repeat the description of this.

[0253] For example, the contour highlighting of the target object 1007 can be a display state after performing a cutout processing on the target object 1001 in the picture.

[0254] In the display interface shown in FIG. 10C, a window 1006 for playing a video continuously is also displayed.

[0255] In the display interface shown in FIG. 10C, an information box 1003 is also displayed, and the information box 1003 displays an avatar 1004 of the target object and related information of the target object. In this embodiment, the related information of the target object includes the name of the target object “Wang XX”, the occupation of the target object “parkour athlete”, and a career profile of the target object.

[0256] It can be understood that the avatar 1004 can also be displayed in other forms, or the avatar 1004 can not be displayed, and the embodiments of the present application do not limit this.

[0257] In some embodiments, the information box 1003 in the display interface shown in FIG. 10C can also be replaced by a box of other shapes; or the edge line of the information box 1003 can not be displayed, and the area where the information box 1003 is located is displayed in a transparent or semi-transparent form; and the embodiments of the present application do not limit this.

[0258] In some embodiments, the information box 1003 also displays a control 1005. If the user points the pointing display screen of the remote control device 120 and the cursor 1002 is located on the control 1005, and then the user clicks the second button of the pointing remote control device, the information box 1003 and the content displayed therein stop displaying, and the video playing in the window 1006 is switched to full-screen playing.

[0259] It can be understood that the first button can be a button specially set for the screenshot search, or the first button can be an OK button.

[0260] In some embodiments, the information box 1003 shown in FIG. 10C can automatically stop displaying after displaying for a preset time length, and the video playing in the window 1006 is automatically switched to full-screen playing.

[0261] Of course, the information box 1003 can also stop displaying in response to other operations of the user on the pointing remote control device 120, and the embodiments of the present application do not limit this.

[0262] It can be understood that the cursor 1002 is the track in this embodiment, that is, the track in this embodiment includes a position point, and the present application does not limit this.

[0263] Referring to FIG. 11, a schematic diagram of a display interface of a display device in a process of controlling the display device by a pointing remote control device according to an embodiment of the present application is shown.

[0264] The display interface shown in FIG. 11a is the same as the display interface shown in FIG. 7a. As shown in FIG. 11a, the display device 110 is playing a video, and a user points the pointing remote control device 120 (not shown in FIG. 11) at the display screen of the display device 110, and a frame of the video is displayed in the display interface of the display device 110, and a target object 1101 is displayed in the frame. A cursor 1102 is also displayed in the display interface. Details of the cursor 1102 can refer to the description of the cursor 702 in FIG. 7, and will not be repeated here. After the user points the pointing remote control device 120 at the display screen of the display device 110, the user clicks a first button (not shown in FIG. 11) on the pointing remote control device 120, and the display interface of the display device 110 is switched from that shown in FIG. 11a to that shown in FIG. 11b.

[0265] For example, the position of the cursor 1102 on the display screen can also be referred to as a position point.

[0266] As shown in FIG. 11b, the display interface displays the frame shown in FIG. 11a, and the frame is displayed in the form of a static image; meanwhile, a window 1106 is displayed in the display interface, and the video is continuously played in the window 1106. In this embodiment, the user clicks the first button for a very short time, and thus the frame displayed in the window 1106 is still the same as the frame shown in FIG. 11a, i.e., the video is continuously played within the time length of the user clicking the first button, but the frame of the video does not switch because the time is very short. If the user holds the first button on the pointing remote control device 120 for a longer time after clicking the first button, the frame in the window 1106 shown in FIG. 11b will switch to another frame of the video.

[0267] In the display interface shown in FIG. 11b, the user releases the first button on the pointing remote control device 120 immediately after clicking the first button; and the display interface of the display device 110 is gradually switched from that shown in FIG. 11b to that shown in FIG. 11c.

[0268] As shown in FIG. 11c, the target object 1107 is displayed in the display interface with an outline highlighted. Specifically, the outer outline of the target object 1107 shown in FIG. 11c is thicker than the outer outline of the target object 1101 shown in FIG. 11b, so as to achieve a highlighting effect.

[0269] Of course, the contour highlighting of the target object 1107 can adopt other manners, for example, the contour of the target object 1107 can be dynamically changed, for example, at least two different colors can be displayed in turn, or the thick contour and the thin contour can be displayed alternately; the present application does not limit and elaborate on this. For example, the contour highlighting of the target object 1107 can be the display state after the target object 1101 in the picture is cut out.

[0270] As shown in FIG. 11C, when the display duration reaches the preset duration, the display interface of the display device 110 is gradually switched from that shown in FIG. 11C to that shown in FIG. 11D.

[0271] As shown in FIG. 11D, in the display interface, the split-screen line 1103 is displayed, which divides the display interface into left and right regions, i.e., the left region 1108 and the right region 1109. In the left region 1108, the video is in a continuous playing state. In the right region 1109, the avatar 1104 of the target object is displayed, which is the avatar of the target object 1101 in the picture shown in FIG. 11B. In the right region 1109, the related information of the target object is also displayed. In this embodiment, the related information of the target object includes the name of the target object, i.e., “Wang XX”, the occupation, i.e., “parkour athlete”, and the career profile.

[0272] It can be understood that the avatar 1104 can also be displayed in other forms, or the avatar 1104 can not be displayed. The present application does not limit this.

[0273] In some embodiments, as shown in FIG. 11D, the display interface further displays the control 1105 in the right region 1109. The user points the remote control device 120 to the display screen, and the cursor 1102 is located on the control 1105. After the user clicks the second button of the remote control device, the split-screen line 1103 and the content displayed in the right region 1109 stop being displayed, and the video is switched from playing in the left region 1108 to full-screen playing.

[0274] In some embodiments, the content displayed in the split-screen line 1103 and the right region 1109 shown in FIG. 11D can automatically stop being displayed after a preset duration, and the video is switched from playing in the left region 1108 to full-screen playing.

[0275] Of course, the content displayed in the split-screen line 1103 and the right region 1109 can also stop being displayed in response to other operations of the user on the remote control device 120. The present application does not elaborate on this.

[0276] It can be understood that the first key can be a key specially set for the screenshot search, or the first key can be an OK key, and the application does not limit the specific form of the first control.

[0277] It can be understood that the cursor 1102 is the track in this embodiment, that is, the track in this embodiment includes a position point, and details are not described herein.

[0278] It should be understood that the various interfaces displayed by the various example display devices 110, the various operations of the user, and the like described above in various embodiments of the application are merely illustrative and do not constitute a specific limitation of the embodiments of the application. For example, in some other embodiments of the application, the icons on the interfaces displayed by the various display devices 110 described above can include more or fewer icons than those displayed on any one of the interfaces shown in the above figures, or some icons can be combined, or some icons can be split, or different icons, and the like. The embodiments of the application are not limited herein.

[0279] It should be understood that the above is an exemplary description of the application scenarios involved in the display device control method provided by the embodiments of the application, and does not constitute a limitation on the application scenarios of the display device control method. It is known to those of ordinary skill in the art that the application scenarios can be adjusted according to application requirements as the business requirements change, and the embodiments of the application do not enumerate them one by one.

[0280] Based on the above application scenarios and the above examples, the display device control method provided by the embodiments of the application is described in detail below. The method is described in detail below by combining the foregoing FIG. 2 to FIG. 11 and FIG. 12, and through the interaction process between the pointing remote control device and the display device.

[0281] FIG. 12 is a schematic flowchart of the display device control method provided by an embodiment of the application, and it should be understood that the steps shown in FIG. 12 can be implemented by a device or a chip configured in the device. As shown in FIG. 12, the method includes S1210-S1250.

[0282] S1210, the pointing remote control device receives a first operation of the user.

[0283] It can be understood that when a display screen of a display device displays a picture, the user points the pointing remote control device to the display screen and performs a first operation on the pointing remote control device, and the picture can be a frame of image in a video played in the display screen, or the picture can be a static image displayed in the display screen, and the application does not limit the specific type of the picture.

[0284] For example, when the display screen of the display device is displaying a picture, the user sees that the picture has content of interest to the user, at this time the user points the pointing remote control device at the display screen and performs a first operation on the pointing remote control device, in this way the user can search for the content of interest.

[0285] For example, in the embodiment shown in FIG. 2, the pictures shown in FIGS. a-d of FIG. 2 are all frames of images in a video played on the display screen. It can be understood that the pictures in FIG. 2 refer to content in the display interface other than the cursor 202, the dashed arrow 203, the track 204, the rectangular frame 205, the region screenshot 206, the information box 207, and the control 208.

[0286] In some embodiments, the display device displays a cursor at the intersection of the pointing direction of the pointing remote control device and the display screen.

[0287] S1220, the pointing remote control device sends a first control signal to the display device in response to the first operation.

[0288] It should be understood that the first control signal corresponds to the first operation, that is, the pointing remote control device sends the first control signal to the display device based on the received first operation.

[0289] For example, the specific type of the first control signal is related to the working principle of the pointing remote control device, for example, the first control signal can be an ultra-wideband signal, a millimeter wave radar signal, an electromagnetic signal, or an ultrasonic signal, etc., which is not limited in the present application.

[0290] S1230, the display device displays a pointing indication on the display screen according to the first control signal, the pointing indication includes at least one position point, the position point represents the intersection of the pointing direction of the pointing remote control device and the plane on which the display screen of the display device is located.

[0291] It can be understood that the first control signal can include one or more control signals, that is, the first control signal can include one control signal or a series of control signals, the number of control signals included in the first control signal is related to the first operation and the actual effect of the first operation.

[0292] For example, when the user wants to select a point on the picture displayed on the display screen by the first operation, the first operation can be clicking a button on the pointing remote control device, at this time the first control signal includes one control signal, which can be a selection confirmation signal.

[0293] For example, when the user wants to select a region of a picture displayed on the display screen or draw a line on the picture by a first operation, the first operation can be that the user presses a button on the pointing remote control device and moves the pointing remote control device. In this case, the first control signal includes multiple control signals. For example, the multiple control signals include a start point signal, multiple intermediate position signals, and an end point signal. When the user presses the button, the pointing remote control device sends the start point signal to the display device; during the process in which the user presses the button and moves the pointing remote control device, the pointing remote control device sends the multiple intermediate position signals to the display device; and when the user stops pressing the button and moves the pointing remote control device, the pointing remote control device sends the end point signal to the display device.

[0294] The above explanation of the first control signal is merely an example and does not limit the first control signal of the embodiments of the present application.

[0295] It should be understood that the pointing indication represents position information of the pointing remote control device pointing to the display screen, or in other words, the pointing indication represents position information on the display screen corresponding to the pointing of the pointing remote control device. The pointing indication can also be referred to as a pointing graph, a pointing track, etc., which is not limited in the present application.

[0296] It should be understood that the pointing indication can include one position point or multiple position points. The number of position points included in the pointing indication is related to the specific form of the first operation. Specifically, if the first operation causes the pointing remote control device to point to one position on the display screen, the pointing indication includes one position point; if the first operation causes the pointing remote control device to point to multiple positions on the display screen, the pointing indication includes multiple position points; or in other words, each time the pointing remote control device points to one position on the display screen, one position point appears.

[0297] In some embodiments, the first operation includes that the user presses a button on the pointing remote control device and moves the pointing remote control device. In this case, the movement of the pointing remote control device generates multiple position points, and thus the pointing indication includes multiple position points. When the multiple position points are dense enough, the pointing indication formed by the multiple position points appears as a line. Alternatively, the pointing indication is a line connecting the multiple position points, that is, the display device can form the pointing indication by connecting the multiple position points.

[0298] It should be understood that the "line" or "connecting line" can form a closed figure or a non-closed figure.

[0299] For example, in the embodiment shown in FIG. 2, the first operation is to long-press the first button and move the pointing direction to the remote control device 120. The pointing indication is the trajectory 204 shown in FIG. 2c. It can be understood that in the embodiments shown in FIGS. 3-6, the first operation is the same as that in the embodiment shown in FIG. 2, and the pointing indication is the corresponding trajectory, which will not be described herein.

[0300] In some embodiments, the first operation includes that the user clicks a button on the pointing remote control device; in this case, the pointing indication includes a position point, which can be referred to as a first position point.

[0301] For example, in the embodiment shown in FIG. 7, the first operation is that the user clicks the first button on the pointing remote control device 120, and the pointing indication is the cursor 702 shown in FIG. 7b, and the position point where the cursor 702 is located is the first position point. It can be understood that in the embodiments shown in FIGS. 8-11, the first operation is the same as that in the embodiment shown in FIG. 7, and the pointing indication is also the corresponding cursor, which will not be described herein.

[0302] It should be understood that the style of the cursor can be various, for example, the style of the cursor includes but is not limited to a dot, an arrow, a pentagram, etc. In the embodiment shown in FIG. 7, the first position point is displayed by using a circular cursor 702, and in other embodiments, the first position point can also be displayed by using other forms.

[0303] It can be understood that the intersection of the pointing direction of the pointing remote control device and the plane where the display screen of the display device is located is calculated according to the control signal, so there will inevitably be some errors, that is, the position point displayed on the display screen and the intersection of the pointing direction of the pointing remote control device and the plane where the display screen of the display device is located, can not be completely coincident, but as long as the error is within an acceptable range, the calculated position point can be considered accurate.

[0304] In some embodiments, the pointing indication is a closed figure. As shown in the embodiments shown in FIGS. 2-6, the pointing indication is an irregular circle, and in other embodiments, the pointing indication can also be a closed figure of other shapes.

[0305] In some other embodiments, the pointing indication can also be a non-closed figure, for example, it can be a straight line, or a curve with two ends not intersecting, and the embodiments of the present application will not be described herein.

[0306] In some embodiments, the pointing indication can be a straight line, which is not parallel to the X-axis and the Y-axis shown in FIG. 13.

[0307] In some embodiments, the pointing indication is displayed on the display screen following the movement of the pointing remote control device. In this embodiment, as the user moves the pointing remote control device, the pointing indication gradually forms, from the perspective of the user, as the user draws the pointing indication on the display screen as the user moves the pointing remote control device.

[0308] At S1240, the display device displays the target region on the screen according to the pointing indication.

[0309] It should be understood that the target region can be an image in the screen that includes content of interest to the user, and the target region can be a partial image or the entire image of the screen. The pointing indication is formed by the user operating the pointing remote control device, and thus the pointing indication is necessarily related to content of interest to the user, and thus the target region can be determined from the screen according to the pointing indication. In addition, by displaying the target region, the user can obtain clear feedback after operating the pointing remote control device, thereby improving the user experience.

[0310] In the embodiments of the present application, different ways can be used to determine and display the target region according to different pointing indications, and the embodiments of the present application do not limit and elaborate on this.

[0311] In some embodiments, the pointing indication includes a first position point, in which case: the display device first determines a target object from the screen according to the first position point; and then the display device processes the target object to obtain the target region.

[0312] For example, in determining the target object: a plurality of objects can be obtained by performing image recognition on the screen, and then the object to which the first position point belongs is determined to be the target object. It should be understood that existing image recognition technology can be used to implement image recognition on the screen. For example, a deep learning-based method can be used, and the embodiments of the present application do not limit and elaborate on the image recognition technology used.

[0313] For example, processing the target object to obtain the target region can specifically include: performing cutout processing on the target object in the screen, and the image region including the target object obtained by performing cutout processing on the screen is the target region. It should be understood that performing cutout processing on the target object in the screen can be implemented using existing cutout technology, and the embodiments of the present application do not limit and elaborate on the cutout technology used.

[0314] In some other embodiments, the pointing indication includes a plurality of position points, in which case: the display device first determines a rectangle including the plurality of position points on the screen; and then the display device determines a region in the screen within the rectangle to be the target region.

[0315] For example, the rectangle can be a minimum circumscribed rectangle including the plurality of position points.

[0316] It is understandable that connecting multiple points in sequence with straight lines can define a polygon, and the smallest bounding rectangle of this polygon is the smallest bounding rectangle of the multiple points.

[0317] For example, Figure 13 is a schematic diagram of the method for determining the minimum bounding rectangle in an embodiment of this application. As shown in Figure 13, in this embodiment, the interface displayed by the display device shows a pointing indicator 1301 and a minimum bounding rectangle 1302 corresponding to the pointing indicator 1301. A coordinate system is established in the display interface, with the X-axis and Y-axis of the coordinate system parallel to one side of the display screen of the display device, and the two sides perpendicular to each other. Assume that the pointing indicator 1301 includes n position points, where n is an integer greater than 1, and the coordinates of the n position points are: (x1, y1)...(x... n ,y n If the minimum bounding rectangle 1302 has four corner points, then the points on the four corners are A, B, C, and D. Therefore:

[0318] The coordinates of point A are (x, y). A ,y A In ), x A For {x1……x n The minimum value in}, y A For {y1……y n The maximum value in};

[0319] The coordinates of point B are (x, y). B ,y B In ), x B For {x1……x n The maximum value in}, y B For {y1……y n The maximum value in};

[0320] The coordinates of point C (x) C ,y C In ), x C For {x1……x n The minimum value in}, y C For {y1……y n The minimum value in};

[0321] The coordinates of point D (x) D ,y D In ), x D For {x1……x n The maximum value in}, y D For {y1……y n The minimum value in}.

[0322] According to the above, after the coordinates of the n position points are determined, the coordinates of the points on the four corners of the minimum circumscribed rectangle 1302 can be determined, and the coordinates of the points A, B, C and D on the four corners can be used to determine the minimum circumscribed rectangle 1301.

[0323] In some embodiments, the rectangle including the plurality of position points can also be a rectangle obtained by expanding the minimum circumscribed rectangle towards the four corners. For example, the minimum circumscribed rectangle can be expanded by 5 mm towards the four corners to obtain a rectangle including the plurality of position points, and the specific value of the expansion is not limited in the present application.

[0324] For example, in the embodiment shown in FIG. 2, the rectangular frame 205 shown in FIG. 2d can be a minimum circumscribed rectangle corresponding to the trajectory 404, or can be a rectangle obtained by expanding the minimum circumscribed rectangle corresponding to the trajectory 404. In the embodiments shown in FIGS. 3-6, the rectangular frames therein can be minimum circumscribed rectangles corresponding to the trajectories in the embodiments, or can be rectangles obtained by expanding the minimum circumscribed rectangles corresponding to the trajectories in the embodiments, and the present application will not repeat the description.

[0325] In some embodiments, the target region is a part of the image in the picture, or in other words, the target region is a part of the region in the picture, and the target region is displayed on the display screen in the form of a screenshot. For example, in the embodiment shown in FIG. 2, the region screenshot 206 is a screenshot of the target region; in the embodiment shown in FIG. 3, the region screenshot 306 is a screenshot of the target region; in the embodiment shown in FIG. 4, the region screenshot 406 is a screenshot of the target region.

[0326] In S1250, the display device displays the related information of the target object in the target region on the display screen.

[0327] In the embodiments of the present application, the target object includes an object in the target region, and the target object can include part of the image in the target region or all of the image in the target region, and the present application will not repeat the description.

[0328] It should be understood that the related information of the target object refers to information related to the target object, and the specific content of the related information is related to the category of the target object.

[0329] For example, when the target object is a person, the related information can be the name, biography, and famous works of the famous person; when the target object is a famous building, the related information can be the country or region to which the famous building belongs, and the formation time of the building; when the target object is an ordinary article, the related information can be a purchase link of the article or a purchase link of an article similar to the article; when the target object is food, the related information can be the eating method or cooking method of the food. The above examples of target objects and corresponding related information are only examples and do not limit the target objects and related information in the present application.

[0330] It should be understood that the target region is an image of a region of interest content circled by the user, and the target region is part of the image or the whole image in the picture. After determining the target region, the display device can obtain the related information of the target object in the target region in different ways.

[0331] In some embodiments, the display device can send the target region to the server and determine the information returned by the server as the related information of the target object.

[0332] For example, the server is configured to perform image recognition on the target region to obtain the target object, and search for information related to the target object; and the server returns the obtained target object and the related information of the target object to the display device.

[0333] In some embodiments, the display device can also input the target region into a preset model to output the related information of the target object.

[0334] In some embodiments, the display device inputs the target region into an image recognition model to output the target object, and then inputs the target object into a large model to output the related information of the target object.

[0335] In some embodiments, the display device can input the target region into a preset model to output the related information of multiple objects; and the display device filters the related information of the multiple objects by using a recommendation algorithm based on big data to obtain the related information of the target object. It can be understood that the filtering of the related information of the multiple objects by the recommendation algorithm based on big data can include filtering of the objects and filtering of the related information of each object, so that the user can be recommended the objects that the user can be interested in and / or the related information of the type that the user can be interested in, thereby improving the user experience.

[0336] For example, the preset model can be a large model that can recognize the target object from the target region and obtain the related information of the target object. Any large model that can realize the above functions can be applied in the embodiments of the present application, and the specific type of the large model is not limited in the embodiments of the present application.

[0337] It can be understood that the preset model, the image recognition model and the large model involved in the embodiments of the present application can be obtained by pre-training, and the model can be trained by a conventional manner, which will not be described herein.

[0338] It should also be understood that the recommendation algorithm based on big data can be any recommendation algorithm that can implement the step of screening the related information of the plurality of objects in the embodiments of the present application, and the present application does not limit and describe it in detail.

[0339] It should be understood that the above method for determining the related information of the target object according to the target area is only an example and does not constitute a limitation on the present application.

[0340] Of course, the present application does not limit the specific implementation of the related information of the target object according to the target area, and any way that can achieve the purpose can be applied to the present application.

[0341] The display device control method provided by the embodiments of the present application is that the pointing remote control device receives the first operation of the user, and then the pointing remote control device sends the first control signal to the display device in response to the first operation of the user; the display device displays the pointing indication of the pointing remote control device on the display screen according to the first control signal, and then the display device displays the target area on the picture and displays the related information of the target object in the target area on the display screen according to the pointing indication. The user selects the target area which the user wants to search for information by the first operation on the pointing remote control device, the user can clearly perceive the selection process of the target area by the first operation through the display of the pointing indication of the pointing remote control device on the display screen, and then the related information of the target object in the target area is displayed on the display screen, so that the user can easily search for the related information of the target object in the target area through the first operation; the complexity of the user operation is reduced, the efficiency of the user to obtain the interested content in the picture displayed by the display device is improved, and the user experience is improved.

[0342] In some embodiments, before step S1250, the display device control method further includes: the display device displays at least one prompt information on the display screen, different prompt information corresponds to different related information of the target object; the pointing remote control device receives the second operation of the user, the second operation is used to select the first prompt information in the at least one prompt information; the pointing remote control device sends the second control signal to the display device in response to the second operation; the display device displays the first related information associated with the first prompt information on the display screen in response to the second control signal.

[0343] It can be understood that the related information of the target object in step S1250 includes the first related information. By displaying at least one prompt information on the display screen, the user can point to the first prompt information by using the remote control device, and then the first related information associated with the first prompt information is displayed on the display screen. Each prompt information can prompt the user to the type of the related information corresponding to the prompt information, so that the user can select the related information type while selecting the target region, and improve the user experience.

[0344] In some embodiments, the first prompt information includes at least one of: prompt information for identifying the target object, and prompt information for obtaining recommended content related to the target object.

[0345] For example, the prompt information for identifying the target object can include "identify". For example, when the first prompt information selected by the user is "identify", the target object is a well-known object displayed in the target region, for example, a well-known person, a well-known building, a well-known scenic spot, etc. The first related information can include introduction information related to the well-known object, which can be in the form of text, image, audio, video or network address link, etc. It can be understood that when a well-known film and television actor is displayed in the target region, the first related information can also include the film and television works of the well-known film and television actor.

[0346] For example, the prompt information for identifying the target object can also include "word selection mode". For example, when the first prompt information selected by the user is "word selection mode", the target object is a text or a word in the target region, and the first related information is translation content or explanation content related to the text or the word.

[0347] For example, the prompt information for obtaining recommended content related to the target object can include "shopping" or "buy the same". For example, when the first prompt information selected by the user is "shopping" or "buy the same", the target object is an object displayed in the target region, and the first related information includes a shopping link of the same product as the object and / or a shopping link of a similar product to the object.

[0348] In some embodiments, the prompt information can be displayed on the corresponding control, and when the second operation of the user is to select a control, it is determined to display the related information corresponding to the prompt information on the control on the display screen.

[0349] For example, as shown in FIG. 6d, the prompt information "shopping" is displayed on the first control 606, and the prompt information "identify" is displayed on the second control 607. In the embodiment shown in FIG. 6:

[0350] (1) When the first prompt information is "shopping", the second operation is that the user points the pointing display screen of the remote control device 120 and the cursor 602 is located on the first control 606, and then the user clicks the second button of the pointing remote control device; and the first related information is the content in the first information box 608 shown in the e diagram of FIG. 6.

[0351] (2) When the first information is "identification", the second operation is that the user points the pointing display screen of the remote control device 120 and the cursor 602 is located on the second control 607, and then the user clicks the second button of the pointing remote control device; and the first related information is the content in the second information box 611 shown in the f diagram of FIG. 6.

[0352] In some embodiments, the picture is an image in a frame of a video, and when the first control signal is received, the video is paused, and the picture is an image displayed on the display screen when the video is paused. In this implementation, when the first control signal is received, the video on the display screen of the display device is paused, and the display screen statically displays the picture, which facilitates the user to select and operate the object in the picture.

[0353] For example, in the embodiment shown in FIG. 2, the pictures shown in the a diagram to the d diagram of FIG. 2 are all pictures, which are images in a frame of a video played on the display screen. When the display screen displays the interface shown in the a diagram of FIG. 2, the user clicks the first button on the pointing remote control device 120; and the pointing remote control device sends a first control signal to the display device based on the operation of the user clicking the first button. When the display device receives the first control signal, the video is paused, and the display screen displays the interface shown in the b diagram of FIG. 2.

[0354] In some embodiments, the picture is an image in a frame of a video, and the display screen includes a first display area and a second display area, and the second display area continuously plays the video while the first display area displays the picture. In this implementation, the picture and the video are displayed in the display screen in a region, which facilitates the user to operate the picture and continue to watch the video, and improves the user experience.

[0355] In some embodiments, the first display area can be the entire display area of the display screen, and the second display area is a partial area in the first display area, and the second display area continuously playing the video is displayed in the form of a small window near a corner of the display screen.

[0356] For example, in the embodiment shown in FIG. 3, the picture is an image in a frame of a video played on the display screen. The first display area is the entire display area of the display screen, and the second display area is the area covered by the window 310, which is located near a corner of the display screen. The picture is always displayed in the first display area, and the video is continuously played in the window 310.

[0357] In some embodiments, the first display area of the display screen can be a partial display area of the display screen, and the second display area playing the video can be a partial display area of the display screen other than the first display area. For example, the first display area and the second display area can be two areas after split-screen display of the display screen, and the present application does not repeat the description here.

[0358] Of course, the first display area and the second display area can also be displayed in other ways, which are not limited by the present application.

[0359] The display device control method in the embodiments of the present application, when applied to display devices such as smart screens, smart televisions and the like, can realize the screenshot of the specified area in the picture and the search of the screenshot, so that the user can easily realize the search of the content of interest in the picture. Or, it can also be said that the display device control method in the embodiments of the present application, when applied to display devices such as smart screens, smart televisions and the like, enables the smart screen, the smart television and the like to have a quick circle search function.

[0360] For ease of understanding, the structure of the display device is exemplarily described below.

[0361] The embodiments of the present application provide a display device, which includes a display screen, a processor and a memory. The memory is configured to store instructions, and the processor is configured to read the instructions to perform the steps executed by the display device in any of the display device control methods provided by the embodiments of the present application.

[0362] For ease of understanding, the structure of the display device is exemplarily described below.

[0363] FIG. 14 shows a schematic diagram of a structure of a display device 1400 provided by the present application. The display device 1400 can be any of the display devices in the above embodiments (for example, it can be a large-screen device or a smart television, etc.).

[0364] As shown in FIG. 14, the display device 1400 can include one or more processors 1410, one or more memories 1420 and one or more transceivers 1430. The transceiver 1430 is configured to perform specific signal transceiving under the control of the processor 1410. The processor can also be referred to as a processing module, and the transceiver can also be referred to as a communication unit or a communication module. The device 1400 is configured to perform the steps executed by any of the above task examples or display any of the interfaces.

[0365] It can be understood that the structure shown in the embodiments of the present application does not constitute a specific limitation on the display device 1400. In some other embodiments of the present application, the display device 1400 can include more or fewer components than those shown, or combine some components, or split some components, or different arrangement of components. The components shown can be implemented in hardware, software or a combination of software and hardware.

[0366] In some embodiments, the display device 1400 can correspond to the display device described in the display device control method, or be a chip or component applied to the display device, and each module or unit in the display device 1400 is used to perform each action or processing process performed by the display device in any possible implementation manner of the display device control method.

[0367] It should be understood that the specific processes of each unit in the display device 1400 performing the corresponding steps are described above in conjunction with the first device related description of the display device control method related embodiments. For brevity, they will not be repeated here.

[0368] Optionally, the transceiver 1430 can include a receiving unit (module) and a sending unit (module) for performing the steps of receiving information and sending information by the display device in the display device control method embodiments.

[0369] For example, the transceiver 1430 can be a transceiver unit, an input / output interface or an interface circuit. The memory 1420 is used to store instructions executed by the transceiver 1430 and the processor 1410. The transceiver 1430, the processor 1410 and the memory 1420 are coupled to each other. The memory 1420 stores instructions, the processor 1410 is used to execute the instructions stored in the memory 1420, and the transceiver 1430 is used to perform specific signal transceiving under the control of the processor 1410.

[0370] For example, the transceiver 1430 can receive a control signal sent by a remote control device.

[0371] For example, the display device 1400 further includes a display screen for displaying images, interfaces, dynamic effects, videos, etc.

[0372] Of course, the device 1400 can also include a charging management module, a power management module, a battery, a key, an indicator, and one or more SIM card interfaces, etc., which are not limited by the embodiments of the present application.

[0373] The embodiment can also divide the display sub-device into functional modules according to the display device control method. For example, the display sub-device can be divided into functional modules corresponding to respective functions, or two or more functions can be integrated into one processing module. The integrated module can be implemented in the form of hardware. It should be noted that the division of the modules in the embodiment is illustrative, and is only a logical division. In actual implementation, another division manner can be used.

[0374] It should be noted that the related content of each step involved in the method embodiment can be cited in the function description of the corresponding functional module, and will not be described here.

[0375] The display device provided by the embodiment of the present application is used to execute the steps performed by the display device in any of the display device control methods provided by the above method embodiments, and thus the same effects as the above methods can be achieved. In the case of an integrated unit, the display device can include a processing module, a storage module, and a communication module. The processing module can be used to control and manage the actions of the display device. For example, the processing module can be used to support the display device to execute the steps executed by the processing unit. The storage module can be used to support the storage of program codes and data, etc. The communication module can be used to support the communication between the display device and other devices. The processing module can be a processor or a controller. The processing module can implement or execute various exemplary logical rectangular boxes, modules, and circuits described in combination with the disclosure of the present application. The processor can also be a combination of computing functions, such as a combination of one or more microprocessors, a combination of a digital signal processor and a microprocessor, etc. The storage module can be a memory. The communication module can be a radio frequency circuit, a Bluetooth chip, a Wi-Fi chip, or other devices for interacting with other electronic devices.

[0376] The embodiment of the present application also provides a chip system, as shown in FIG. 15. The chip system includes at least one processor 1501 and at least one interface circuit 1502. The processor 1501 and the interface circuit 1502 can be interconnected by a line. For example, the interface circuit 1502 can be used to receive signals from other devices (such as the memory of any of the display devices described above). For another example, the interface circuit 1502 can be used to send signals to other devices (such as the processor 1501). For example, the interface circuit 1502 can read the instructions stored in the memory and send the instructions to the processor 1501. When the instructions are executed by the processor 1501, the electronic device can execute each step performed by any of the display devices in the above embodiments. Of course, the chip system can also include other discrete devices, and the embodiment of the present application does not specifically limit this.

[0377] The display device control apparatus according to any one of the embodiments of the present application can be included in a display device. The display device control apparatus has a function of implementing the behavior of the display device in any one of the embodiments of the present application. The function can be implemented by hardware, or by hardware executing corresponding software. The hardware or software includes at least one module or unit corresponding to the function.

[0378] The present application also provides an electronic device including the display device control apparatus according to any one of the embodiments of the present application.

[0379] The present application also provides a readable storage medium (also referred to as a computer readable storage medium) for storing a program, the program including instructions for executing the steps implemented by the display device in the display device control method according to any one of the embodiments of the present application. The readable medium can be a read-only memory or a random access memory, and the embodiments of the present application do not limit the readable medium.

[0380] The present application also provides a program product (also referred to as a computer program product) including instructions for causing the display device to execute the steps of the display device or the display interface according to any one of the embodiments of the present application.

[0381] The present application also provides a chip including a processing unit and a communication unit. The processing unit can be a processor, and the communication unit can be an input / output interface, a pin, a circuit, or the like. The processing unit can execute instructions to cause the display device to execute the steps implemented by the display device in the display device control method according to any one of the embodiments of the present application.

[0382] Optionally, the instructions are stored in a storage unit.

[0383] Optionally, the storage unit is a storage unit in the chip, such as a register, a cache, or the like. The storage unit can also be a storage unit outside the chip in the terminal, such as a ROM or a random RAM that can store static information and instructions. The processor mentioned in any one of the above embodiments can be a CPU, a microprocessor, an ASIC, or one or more integrated circuits for controlling the execution of the program of the display and control method of the electronic device. The processing unit and the storage unit can be decoupled and arranged on different physical devices, and connected by wired or wireless means to implement the respective functions of the processing unit and the storage unit to support the system chip to implement various functions in the embodiments. Alternatively, the processing unit and the storage unit can be coupled on the same device.

[0384] The electronic device, the apparatus, the readable storage medium, the program product or the chip provided in the embodiments can achieve the beneficial effects of the corresponding method provided above, and thus the beneficial effects of the corresponding method provided above are not repeated here.

[0385] The embodiments of the present application also provide a graphical user interface on an electronic device, the electronic device having a display screen, a camera, a memory, and one or more processors configured to execute one or more computer programs stored in the memory, the graphical user interface comprising the graphical user interface displayed when the electronic device executes the steps performed by the display device in any of the above embodiments.

[0386] The above merely provides a specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any change or replacement within the technical scope disclosed in the present application should be covered in the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A display device control method characterized by comprising: The method is applied to a display device, the display device comprising a display screen in which a picture is displayed, and the method comprising: receiving a first control signal sent by a pointing remote control device, the first control signal being sent by the pointing remote control device in response to a first operation of a user; displaying a pointing indication on the display screen according to the first control signal, the pointing indication comprising at least one position point representing an intersection of a pointing direction of the pointing remote control device and a plane in which the display screen of the display device is located; displaying a target region on the picture according to the pointing indication; and displaying relevant information of a target object in the target region on the display screen.

2. The method of claim 1, wherein, The pointing indication is a first position point, and the method further comprises: determining the target object from the picture according to the first position point; and processing the target object to obtain the target region.

3. The method of claim 2, wherein, The first operation comprises the user clicking a button on the pointing remote control device.

4. The method of claim 1, wherein, The pointing indication is a line connecting a plurality of position points, and the pointing indication is a closed figure or an unclosed figure.

5. The method of claim 4, wherein, The method further comprises: determining a rectangle comprising the plurality of position points on the picture; and determining a region in the picture within the rectangle as the target region.

6. The method according to claim 4 or 5, characterized in that, The first operation comprises the user pressing a button on the pointing remote control device for a long time and then moving the pointing remote control device.

7. The method according to any one of claims 1 to 6, characterized in that, Before displaying the relevant information of the target object in the target region on the display screen, the method further comprises: displaying at least one prompt information, different prompt information corresponding to different relevant information of the target object; receiving a second control signal sent by the pointing remote control device, the second control signal being sent by the pointing remote control device in response to a second operation of a user, the second operation being used to select a first prompt information from the at least one prompt information; and displaying first relevant information associated with the first prompt information on the display screen in response to the second control signal. The picture is an image frame in a video, and the video is paused when the first control signal is received, the picture being an image displayed by the display screen when the video is paused.

8. The method according to any one of claims 1 to 7, characterized in that, The picture is an image frame in a video, and the display screen comprises a first display region and a second display region, the second display region continuously playing the video while the first display region displays the picture.

9. The method according to any one of claims 1 to 7, characterized in that, The display device comprises a display screen, a processor and a memory, the memory being used to store instructions, and the processor being used to read the instructions to execute the method according to any one of claims 1 to 9.

10. A display device, characterized by comprising: The system comprises the display device according to claim 10 and a pointing remote control device, the pointing remote control device being used to receive a first operation of a user and send a first control signal to the display device in response to the first operation.

11. A display device control system characterized by comprising: The readable storage medium stores a program, the program comprising program instructions, the program instructions being executed by a processor to execute the method according to any one of claims 1 to 9.

12. A readable storage medium, characterized by, ​ 13. A program product, characterized by The program product comprises a program which, when executed by a processor, is for performing the method of any one of claims 1 to 9.

14. A chip, characterized by comprises: a processor for calling and running a program from a memory, so that an electronic device in which the chip is installed performs the method of any one of claims 1 to 9.

Images