Display device and circle selection screenshot method

Abstract

The invention relates to a display device and a circle selection screenshot method. The display equipment comprises a display and a controller, and the controller is configured to perform screen capture on a display interface of the display in response to a received preset pressing instruction to obtain a screen image, control the display to display the screen image under the condition that a dynamic picture is displayed on the current interface, perform screen capture in the screen image according to a circled area, and display the screen image according to the circled area. And when the current interface displays the static picture, deleting the screen image, performing screenshot in the static picture according to the circled region to obtain the region image, and performing image recognition according to the character in the region image to display the object information of the character in the region image. By the adoption of the method, when the dynamic picture is displayed on the displayer, it can be guaranteed that the picture seen by a user when circling drawing is completed is consistent with the circling display interface, and therefore the accuracy of circling screenshot is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a display device and a method for circling and taking screenshots. Background Art

[0002] With the development of devices (such as smart TVs), some devices have integrated screenshot functions (such as circled screenshots and full-screen screenshots) to meet users' diverse information query needs for the device's displayed interface. For example, a device can take a screenshot of a portion of the displayed content on the displayed interface and search based on the captured partial image to display search results for the partial image to the user.

[0003] However, when taking a circled screenshot of a dynamic image, it takes a certain amount of time for the user to draw the circled range with the cursor. The image will keep changing during the circled selection process. When the circled range is drawn, the played image has changed, which may easily lead to inconsistency between the image when the circle selection is completed and the interface displayed by the circle, thereby reducing the accuracy of the circled screenshot. Summary of the Invention

[0004] The present application provides a display device and a circle selection screenshot method, which can ensure that the picture seen by the user when the circle selection drawing is completed is consistent with the circle selection display interface when the display displays a dynamic picture, thereby ensuring the accuracy of the circle selection screenshot.

[0005] In a first aspect, some embodiments provide a display device, including:

[0006] Display and controller;

[0007] The controller is configured as:

[0008] In response to the received preset pressing instruction, a screen shot of the display interface is taken to obtain a screen image; wherein the preset pressing instruction indicates that a preset button in the remote control is pressed;

[0009] When the current interface displays a dynamic image, the display is controlled to display a screen image, and a screenshot is taken from the screen image according to a circled area to obtain a regional image; wherein the circled area is determined according to a pointing parameter sent by the pointing remote control, and the pointing parameter changes with the movement of the pointing remote control;

[0010] When a static image is displayed on the current interface, the screen image is deleted and a screenshot is taken from the static image according to the circled area to obtain the area image;

[0011] Image recognition is performed based on the person in the area image to display object information of the person in the area image.

[0012] The above technical solution, on the one hand, takes a screenshot of the display interface of the display when a preset pressing instruction is received to obtain a screen image, and controls the display to display the screen image when a dynamic picture is displayed on the current interface. Since the screen image displayed to the user is captured when the user triggers the preset button in the pointing remote control and is a static picture, a screenshot is taken in the screen image according to the circled area determined based on the pointing parameters sent by the pointing remote control. The obtained regional image matches the actual needs of the user, that is, when the display shows a dynamic picture, the picture seen by the user when the circle selection is completed is consistent with the interface displayed by the circle selection, thereby ensuring the accuracy of the circled screenshot; on the other hand, when the current interface displays a static picture, a screenshot is taken directly in the static picture displayed on the display, so that the regional image displayed to the user has a higher resolution. In addition, this solution can select the corresponding circled screenshot method according to the type of picture displayed on the current interface (dynamic / static), which not only broadens the use scenarios of the screenshot function of the display device, but also improves the user experience.

[0013] In some embodiments, when the current interface displays a dynamic image, the controller is configured to:

[0014] Obtaining a status identifier of the multimedia player; wherein, when the status identifier indicates that the multimedia player is in a playing state, the current interface displays a dynamic image; and when the status identifier indicates that the multimedia player is in a non-playing state, the current interface displays a static image;

[0015] Accordingly, when the controller controls the display to display a screen image when the current interface displays a dynamic image, the controller is configured to:

[0016] When the state identifier indicates that the multimedia player is in a playing state, controlling the display to display a screen image;

[0017] When the controller deletes the screen image while the current interface is displaying a static image, it is configured as follows:

[0018] When the state identifier indicates that the multimedia player is in a non-playing state, the screen image is deleted.

[0019] The above technical solution introduces the status identifier of the multimedia player. By obtaining the status identifier of the multimedia player at the current moment, it is determined whether the multimedia player is in the playing state. Then, based on the judgment result, the corresponding screen image processing method is selected to ensure the rationality of the screen image processing.

[0020] In some embodiments, when the controller executes the process of obtaining a status identifier of the multimedia player, the controller is configured to:

[0021] When a preset pressing instruction is received, a state parameter representing a switch state of a directional switch of the directional remote controller is read from a local device;

[0022] When the state parameter indicates that the pointing switch is in the on state, the state identifier of the multimedia player is obtained; wherein the pointing switch is a switch on the pointing remote control that controls the sending of pointing parameters. When the pointing switch is in the on state, the pointing remote control sends the pointing parameters; when the pointing switch is in the off state, the pointing remote control does not send the pointing parameters.

[0023] In the above technical solution, on the one hand, a pointing switch is configured in the remote control, which provides a prerequisite for the smooth operation of the circle selection screenshot function; on the other hand, it can be determined whether a circle selection screenshot is required based on the switch state of the pointing switch, and when it is determined that a circle selection screenshot is required, the status identifier of the multimedia player is obtained, which provides a restriction condition for obtaining the status identifier, and also provides a restriction condition for the circle selection screenshot, thereby ensuring the standardization of the circle selection screenshot processing.

[0024] In some embodiments, before the controller controls the display to display a screen image when the current interface displays a dynamic image, the controller is further configured to:

[0025] Get the application status of the homepage application; the homepage application is the application currently interacting with the user on the display device; when the application status indicates that the homepage application is playing media content, the current interface displays a dynamic image; when the application status indicates that the homepage application is not playing media content, the current interface displays a static image;

[0026] Accordingly, when the controller controls the display to display a screen image when the current interface displays a dynamic image, the controller is configured to:

[0027] When the application state represents that the homepage application is playing media content, controlling the display to display the screen image;

[0028] When the controller deletes the screen image while the current interface is displaying a static image, it is configured as follows:

[0029] When the application state indicates that the homepage application is not playing media content, the screen image is deleted.

[0030] The above technical solution introduces the application status of the homepage application. By judging whether the homepage application is playing media content based on the application status of the homepage application, and then selecting the corresponding screen image processing method based on the judgment result, the rationality of the screen image processing can be ensured.

[0031] In some embodiments, when the controller controls the display to display a screen image, the controller is configured to:

[0032] Keep the dynamic picture playing and display the screen image on the upper layer of the dynamic picture.

[0033] The above technical solution introduces a layer above the dynamic picture. By maintaining the playback of the dynamic picture during the circle selection screenshot process and displaying the screen image on the layer above the dynamic picture, the circle selection screenshot processing can be completed without affecting the playback of the dynamic picture, thereby improving the convenience of circle selection screenshot.

[0034] In some embodiments, when the current scene is a dynamic scene, after obtaining the regional image, the controller is further configured to:

[0035] Cancel the display of the screen image, and display the screen image and search indication information in the preset display area of ​​the layer above the dynamic image; wherein the area of ​​the preset display area is smaller than the display area of ​​the dynamic image, and the area outside the preset display area in the upper layer is a transparent area, and the search indication information is used to inform the user that an image search is being performed on the screen image.

[0036] The above technical solution introduces a layer above the dynamic picture. By canceling the display of the screen image during the image search process, the user can continue to watch the dynamic picture; further, the screen image and search indication information are displayed in the preset display area of ​​the layer above the dynamic picture, which enables the user to intuitively understand the progress of the image search and improve the user experience.

[0037] In some embodiments, when the controller takes a screenshot of the target image based on the circled area to obtain the area image, the controller is configured to:

[0038] Generate a trajectory line according to the pointing parameters received from the pointing remote controller, and determine a preset shape area according to the trajectory line as the circled area corresponding to the pointing parameters; wherein the area circled by the preset shape corresponds to the area represented by the trajectory line;

[0039] A screenshot is taken of the area corresponding to the circled area in the target image to obtain a regional image; wherein the target image is a screen image or a static picture.

[0040] In the above technical solution, in the circling and screenshot scenario, no matter what shape of trajectory line the user circles, a preset shape area containing all trajectory lines can be determined based on the trajectory line, and the target image can be screenshoted based on the determined preset shape area. On the one hand, since there are no restrictions on the shape and regularity of the trajectory line, the difficulty of the user circling and screenshoting is reduced, the user experience is improved, and the subsequent image search is carried out smoothly, which improves the efficiency of obtaining image search results; on the other hand, since the determined preset shape area contains all trajectory lines, it can be guaranteed that the regional image obtained by the screenshot is consistent with the user's actual query requirements, that is, the accuracy of the regional image acquisition is guaranteed.

[0041] In some embodiments, the preset shape area is a rectangular area; when the controller determines the preset shape area based on the trajectory line, it is configured to:

[0042] From the coordinate data of the track points on the track line, select the minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate and the maximum value of the vertical coordinate;

[0043] The minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate, and the maximum value of the vertical coordinate are combined horizontally and vertically to obtain at least two vertex coordinates; wherein the at least two vertex coordinates are used to represent the rectangular area.

[0044] The above technical solution determines the vertex coordinates of a rectangular area based on the minimum, maximum, and minimum and maximum values ​​of the horizontal and vertical coordinates in the coordinate data of the trajectory points. This provides an alternative method for quickly determining the rectangular area while ensuring that the subsequently acquired regional image contains valid image information. Furthermore, this solution presents the area determined by the trajectory line as a rectangle, a presentation method that is compatible with the way a display device presents a page, thereby making the captured regional image more reasonable.

[0045] In some embodiments, the preset shape area is a rectangular area; when the controller takes a screenshot of the area corresponding to the circled area in the target image and obtains the area image, the controller is configured to:

[0046] If the aspect ratio of the selected area is different from the screen aspect ratio of the display device, the selected area is modified according to the screen aspect ratio; wherein the aspect ratio of the modified selected area is the same as the screen aspect ratio;

[0047] A screenshot is taken of the area in the target image corresponding to the corrected circled area to obtain a regional image.

[0048] The above technical solution corrects the circled area according to the screen aspect ratio to obtain a regional image with the same aspect ratio as the screen, thereby ensuring the adaptability between the regional image and the currently displayed page, thereby making the captured regional image more reasonable.

[0049] In a second aspect, some embodiments further provide a circle selection screenshot method, applied to a display device, comprising:

[0050] In response to the received preset pressing instruction, a screen shot of the display interface is taken to obtain a screen image; wherein the preset pressing instruction indicates that a preset button in the remote control is pressed;

[0051] When the current interface displays a dynamic image, the display is controlled to display a screen image, and a screenshot is taken from the screen image according to a circled area to obtain a regional image; wherein the circled area is determined according to a pointing parameter sent by the pointing remote control, and the pointing parameter changes with the movement of the pointing remote control;

[0052] When a static image is displayed on the current interface, the screen image is deleted and a screenshot is taken from the static image according to the circled area to obtain the area image;

[0053] Image recognition is performed based on the person in the area image to display object information of the person in the area image.

[0054] The above technical solution, on the one hand, takes a screenshot of the display interface of the display when a preset pressing instruction is received to obtain a screen image, and controls the display to display the screen image when a dynamic picture is displayed on the current interface. Since the screen image displayed to the user is captured when the user triggers the preset button in the pointing remote control and is a static picture, a screenshot is taken in the screen image according to the circled area determined based on the pointing parameters sent by the pointing remote control. The obtained regional image matches the actual needs of the user, that is, when the display shows a dynamic picture, the picture seen by the user when the circle selection is completed is consistent with the interface displayed by the circle selection, thereby ensuring the accuracy of the circled screenshot; on the other hand, when the current interface displays a static picture, a screenshot is taken directly in the static picture displayed on the display, so that the regional image displayed to the user has a higher resolution. In addition, this solution can select the corresponding circled screenshot method according to the type of picture displayed on the current interface (dynamic / static), which not only broadens the use scenarios of the screenshot function of the display device, but also improves the user experience.

[0055] In a third aspect, some embodiments further provide a circled screenshot device, applied to a display device, comprising:

[0056] An image acquisition module is configured to take a screenshot of the interface currently displayed on the display in response to a received preset pressing instruction to obtain a screen image; wherein the preset pressing instruction indicates that a preset button in the remote control has been pressed;

[0057] A first screenshot module is configured to control the display to display a screen image when a dynamic image is displayed on the current interface, and to take a screenshot of a selected area in the screen image to obtain a regional image; wherein the selected area is determined based on a pointing parameter sent by a pointing remote control, and the pointing parameter changes with the movement of the pointing remote control;

[0058] The second screenshot module is used to delete the screen image when a static image is displayed on the current interface, and take a screenshot of the static image according to the circled area to obtain a regional image;

[0059] The image recognition module is used to perform image recognition based on the person in the area image to display object information of the person in the area image.

[0060] In a fourth aspect, a computer-readable storage medium is provided, which stores a computer program. When the computer program is executed by a data display device, the data display device executes a circle selection and screenshot method in the second aspect.

[0061] In a fifth aspect, a computer program product is provided, comprising: a computer program, which, when executed by a data display device, causes the data display device to execute a circled screenshot method in the second aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the technical solutions in some embodiments or related technologies, the following briefly introduces the drawings required for use in the descriptions of some embodiments or related technologies. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without any creative work.

[0063] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0064] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0065] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0066] Figure 4A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0067] Figure 5 A schematic diagram of a process for circling and taking screenshots provided in some embodiments of the present application;

[0068] Figure 6 A schematic diagram of a process for obtaining a status identifier provided in some embodiments of the present application;

[0069] Figure 7 Schematic diagram of an image search page provided for some embodiments of the present application;

[0070] Figure 8 Schematic diagram of displaying object information provided in some embodiments of the present application;

[0071] Figure 9 A schematic diagram of a process for determining a regional image provided in some embodiments of the present application;

[0072] Figure 10 A schematic diagram of a process for determining a rectangular area provided in some embodiments of the present application;

[0073] Figure 11 Schematic diagram for determining the rectangular area corresponding to the regular trajectory provided in some embodiments of the present application;

[0074] Figure 12 Schematic diagram for determining the rectangular area corresponding to the irregular trajectory provided in some embodiments of the present application;

[0075] Figure 13 A schematic diagram of a process for correcting a circled area provided in some embodiments of the present application;

[0076] Figure 14 A schematic diagram illustrating determination of a rectangular area corresponding to a trajectory line with invalid width provided in some embodiments of the present application;

[0077] Figure 15 A schematic diagram of the interaction between various devices in the circle selection and screenshot process provided in other embodiments of the present application;

[0078] Figure 16 1 is a structural block diagram of a circled screenshot device in some embodiments. DETAILED DESCRIPTION

[0079] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0080] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0081] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0082] The terms "comprise," "comprises," and "having," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0083] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0084] In some embodiments, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes, but is not limited to, a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, and the like.

[0085] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0086] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 for data exchange. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling communication via a network communication protocol for one-to-one control and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0087] like Figure 1As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0088] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol Television (IPTV), etc.

[0089] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0090] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0091] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0092] In some embodiments, the display 260 includes a display component for presenting images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0093] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 that includes international wireless local area network standard (Wireless Fidelity, WiFi) functionality. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 that includes Bluetooth functionality.

[0094] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0095] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0096] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0097] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0098] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0099] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0100] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure is as follows. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0101] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0102] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0103] In some embodiments, as Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0104] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and external and internal data processing functions.

[0105] The communication interface 130 communicates control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0106] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0107] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, which can encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and send them to the display device 200.

[0108] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0109] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0110] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling the hardware and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0111] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0112] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer and the kernel layer.

[0113] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0114] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0115] like Figure 4As shown, in some embodiments, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0116] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0117] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0118] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4 As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0119] It should be noted that the above example is only a simple division of the operating system functions and does not limit the specific operating system form of the display device 200 in some embodiments. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0120] With the development of devices (such as smart TVs), some devices have integrated screenshot functions (such as circled screenshots and full-screen screenshots) to meet users' diverse information query needs for the device's displayed interface. For example, a device can take a screenshot of a portion of the displayed content on the displayed interface and search based on the captured partial image to display search results for the partial image to the user.

[0121] However, when circling a screenshot of a dynamic image, it takes a certain amount of time for the user to draw the circled range with the cursor. The image will keep changing during the circling process, and when the circling range is completed, the played image has changed. Since the actual image recognition uses a screenshot of the moment when the user triggers the circling (the starting moment of drawing the circling range), it is easy to cause the picture seen by the user when the circling is completed to be inconsistent with the circling display interface (the screenshot of the starting moment of drawing the circling range), thereby reducing the accuracy of the circling screenshot.

[0122] Based on this, in some embodiments, a method for circling and taking screenshots is provided. The method for circling and taking screenshots can be implemented by the cooperation of a display device and a mobile terminal (such as a remote control). In an optional embodiment, the method for circling and taking screenshots is applied to a controller in a display device as an example, wherein the display device includes a display and a controller; the communication connection between the display and the controller can be a wired communication connection or a wireless communication connection. Figure 5 As shown, the specific steps include:

[0123] S510 , in response to the received preset pressing instruction, taking a screenshot of the display interface to obtain a screen image.

[0124] The so-called screen image is the interface image on which the user is to perform the circle selection operation. The so-called preset press instruction indicates that a preset button on the remote control is pressed. The preset button can be a screenshot control on the remote control. Furthermore, the so-called screenshot control is a control that can activate the screenshot function on the display device.

[0125] A pointing remote control is a remote control with an integrated pointing device. When the pointing device is turned on, it can obtain the remote control's location information in real time, generate pointing parameters based on the remote control's location information, and transmit the pointing parameters to the display device in the form of electrical signals using infrared or Bluetooth transmission at a preset parameter transmission frequency. Upon receiving the pointing parameters, the display device converts the electrical signals into digital signals and displays the location indicated by the pointing parameters as a cursor within the current interface displayed on the display device.

[0126] Alternatively, if a user wishes to circle a screenshot, they can press a preset button on a pointing remote control to send a preset press command to the display device. Accordingly, in an optional embodiment, upon receiving the preset press command, the display device can launch a screenshot application, which then invokes the screenshot function provided by the display device's entire system to capture the interface currently displayed on the display, generating a screen image. The screen image can then be cached in the local space.

[0127] It is worth noting that due to the certain delay between the moment when the user requests a screenshot (the moment when the user presses the pointing remote control) and the moment when the display device executes the screenshot, the screen image obtained by the display device may be inconsistent with the image that the user wants to capture. Based on this, in another optional implementation, the played historical images (i.e., the interface displayed on the display) can be cached in the local space while the dynamic picture is playing. After the display device receives the preset press instruction, it can determine the user's actual screenshot requirement moment based on the current moment and the preset image acquisition delay; thereafter, the screen image is obtained in the local cache based on the screenshot requirement moment.

[0128] The image acquisition delay can be determined by, for each user associated with the display device, pre-collecting the user's behavioral data when circling a screenshot (which may include action image data of the user pressing a preset button), and then analyzing the image acquisition delay corresponding to the user based on the user's behavioral data (for example, the time difference between the moment the user presses the preset button and the moment the preset pressing instruction is sent by pointing to the remote control is used as the image acquisition delay), and the image acquisition delay of the user is associated with the identity information and stored in the local space. Further, when it is detected that any user sends a preset pressing instruction by pointing to the remote control, the user's facial image can be captured by an image acquisition device (for example, a camera device) to confirm the user's identity information, and then the image acquisition delay corresponding to the user is obtained in the local cache based on the user's identity information.

[0129] For example, when the image acquisition delay of user A is 1 second, if a preset press command sent by user A using a pointing remote control is received at the current moment, it is determined that the user's actual screenshot requirement moment is 1 second before the current moment. At this time, the historical image corresponding to the moment 1 second before the current moment stored in the cache can be used as the screen image.

[0130] S520 , when the current interface displays a dynamic image, controlling the display to display a screen image, and taking a screenshot of the screen image according to the circled area to obtain a regional image.

[0131] The so-called current interface refers to the current display interface of the display, which can display dynamic images or static images. The so-called dynamic image is an image whose screen image changes in real time, such as a video playback image; the so-called static image is an image whose screen image does not change, such as a non-playback page such as the homepage or query page. When the current interface displays a dynamic image, the so-called area image is the image corresponding to the circled area in the screen image.

[0132] The so-called selected area is determined based on the pointing parameters sent by the pointing remote control, and is used to represent the area that the user wants to select. The pointing parameters are used to represent the pointing situation of the pointing remote control on the current interface displayed by the display device. The pointing parameters change with the movement of the pointing remote control and may include but are not limited to the position information of the pointing remote control.

[0133] In some embodiments, the position information contained in the pointing parameter is the position information relative to the display device in the geodetic coordinate system. Therefore, in order to more accurately present the position indicated by the pointing parameter in the current interface, the display device can use the lower left corner of the current interface as the origin and convert the position information in the geodetic coordinate system into horizontal and vertical coordinate information in the screen coordinate system in the screen coordinate system of the current display device according to the resolution of the display device (most of which are 1920*1080).

[0134] In some embodiments, the pointing parameter includes horizontal and vertical coordinate information of the screen coordinate system of the display device after the coordinate conversion of the pointing remote controller. The display device can directly determine the display position of the cursor based on the received horizontal and vertical coordinate information.

[0135] In an optional manner, whether the current interface displays a dynamic image can be determined based on the operating status of the display device. Exemplarily, the operating status may include the playback status of the multimedia player and / or the application status of the current interactive application. Furthermore, whether the current interface displays a dynamic image can be determined based on the playback status of the multimedia player and / or the application status of the current interactive application. For example, when the playback status of the multimedia player is playing and / or the current interactive application is playing media content, it is confirmed that the current interface displays a dynamic image.

[0136] In another optional manner, whether the current interface displays a dynamic image can be determined based on the changes between the locally cached frames of historical images. For example, if there are changes between the cached consecutive frames of historical images, it is determined that the current interface displays a dynamic image.

[0137] If it is determined that the current interface displays a dynamic image, to ensure the accuracy of the user's circle selection, the display can be controlled to display the screen image. Using a preset coordinate conversion method, the position information in the acquired pointing parameters is converted into coordinate information corresponding to the circle selection cursor in the current interface. Based on the changes in the coordinates of the circle selection cursor, the circled area is determined in the displayed screen image. Alternatively, the circled area can be directly determined in the displayed screen image based on the horizontal and vertical coordinate information contained in the pointing parameters. A screenshot is then taken of the area corresponding to the circled area in the screen image to obtain a regional image. Thereafter, step S540 is executed.

[0138] S530: When the current interface displays a static image, the screen image is deleted, and a screenshot is taken from the static image according to the circled area to obtain an area image.

[0139] Among them, when the current interface displays a static picture, the so-called regional image is the image corresponding to the circled area in the static picture.

[0140] Optionally, when it is determined that the current interface displays a static picture, since the picture displayed by the display has not changed, the saved screen image can be deleted and a screenshot can be taken directly in the static picture. Specifically, the position information in the acquired pointing parameter can be converted into the coordinate information corresponding to the circled cursor in the current interface through a preset coordinate conversion method, and then the circled area can be determined in the static picture according to the change in the coordinates of the circled cursor; or, the circled area can be determined in the static picture directly according to the horizontal and vertical coordinate information contained in the pointing parameter. Further, the area corresponding to the circled area in the static picture is screenshoted to obtain a regional image. Thereafter, step S540 is executed.

[0141] S540: Perform image recognition based on the person in the area image to display object information of the person in the area image.

[0142] The object information is information about the person objects contained in the region image. Furthermore, the person objects include people and objects, which can be animals, plants, characters played by actors, daily products, and other objects that can be displayed in the form of images.

[0143] Optionally, an image acquisition path corresponding to the regional image can be generated based on the device identification information of the display device; the regional image and the image acquisition path of the regional image can then be uploaded simultaneously to an image recognition system in the cloud associated with the display device. To improve image upload efficiency, the regional image can be compressed before uploading, and the resulting compressed image and the image acquisition path of the regional image can be uploaded to the image recognition system.

[0144] After acquiring a regional image, the image recognition system can identify the regional image and, based on the image acquisition path, feed the recognition results as object information of the objects in the regional image back to the display device. For example, the image recognition system can segment the regional image based on the image features in the regional image to obtain the objects contained in each sub-image. Then, for each object contained in the sub-image, the object can be used as index information to perform a consistency match on the object among various standard objects contained in a predetermined image library, and the object information corresponding to the standard object with the highest degree of match is used as the object information of the object. After acquiring the object information of the objects contained in each sub-image, the object information is simultaneously fed back to the display device.

[0145] Alternatively, an image search may be performed directly on the regional image in the locally stored image information to obtain object information of the objects in the regional image.

[0146] Optionally, after obtaining the object information, the display device may determine an information display floating layer on the current interface and display the object information at a preset display position. Alternatively, the display device may display the object information on the information display floating layer based on the position information of each object in the display area image. For example, if there is only one object in the area image, the object information of the object is directly displayed on the information display floating layer. If there are multiple objects in the area image, the object information of each object may be displayed sequentially in the information display floating layer based on the position arrangement of the objects.

[0147] The above technical solution, on the one hand, takes a screenshot of the display interface of the display when a preset pressing instruction is received to obtain a screen image, and controls the display to display the screen image when a dynamic picture is displayed on the current interface. Since the screen image displayed to the user is captured when the user triggers the preset button in the pointing remote control and is a static picture, a screenshot is taken in the screen image according to the circled area determined based on the pointing parameters sent by the pointing remote control. The obtained regional image matches the actual needs of the user, that is, when the display shows a dynamic picture, the picture seen by the user when the circle selection is completed is consistent with the interface displayed by the circle selection, thereby ensuring the accuracy of the circled screenshot; on the other hand, when the current interface displays a static picture, a screenshot is taken directly in the static picture displayed on the display, so that the regional image displayed to the user has a higher resolution. In addition, this solution can select the corresponding circled screenshot method according to the type of picture displayed on the current interface (dynamic / static), which not only broadens the use scenarios of the screenshot function of the display device, but also improves the user experience.

[0148] Based on the above embodiments, in an embodiment of the present application, an optional method for determining whether the current interface displays a dynamic picture or a static picture is provided. Specifically, a status identifier of the multimedia player is obtained, and based on the status identifier, it is determined whether the current interface displays a dynamic picture or a static picture. That is, when the status identifier indicates that the multimedia player is in a playing state, the current interface displays a dynamic picture; when the status identifier indicates that the multimedia player is in a non-playing state, the current interface displays a static picture.

[0149] The so-called status identifier is an identifier used to represent the status of the multimedia player, namely MEDIAPLAYER, and its value can be represented by a numerical value. For example, when the status identifier is 1, the multimedia player is determined to be in the playing state, that is, the current interface displays a dynamic image; when the status identifier is 0, the multimedia player is determined to be in the non-playing state, that is, the current interface displays a static image.

[0150] Optionally, after receiving the preset pressing instruction, the status identifier of the multimedia player at the current moment may be queried in the entire system of the display device according to the device identification of the multimedia player.

[0151] Based on this, an optional method for processing screen images is provided, specifically, when the status identifier indicates that the multimedia player is in the playing state, the display is controlled to display the screen image; when the status identifier indicates that the multimedia player is in the non-playing state, the screen image is deleted.

[0152] Optionally, after obtaining the status identifier, read the value of the status identifier. When its value is 1, it indicates that the multimedia player is in the playing state, and the display can be controlled to display the screen image; when its value is 0, it indicates that the multimedia player is in the non-playing state, and the screen image can be deleted.

[0153] The above technical solution introduces the status identifier of the multimedia player. By obtaining the status identifier of the multimedia player at the current moment, it is determined whether the multimedia player is in the playing state. Then, based on the judgment result, the corresponding screen image processing method is selected to ensure the rationality of the screen image processing.

[0154] On the basis of the above embodiment, in the embodiment of the present application, the process of obtaining the status identifier of the multimedia player is refined, such as Figure 6 As shown, the specific steps include:

[0155] S610: When a preset pressing instruction is received, a state parameter representing a switch state of a directional switch of a directional remote controller is read from a local computer.

[0156] The so-called pointing switch is a switch on the pointing remote control that controls the transmission of pointing parameters. Furthermore, when the pointing device is turned on, the pointing remote control can send pointing parameters to the display device, and when the pointing device is turned off, the pointing remote control cannot send pointing parameters to the display device. The so-called state parameter is a string that can represent the switch state. For example, a state parameter of 1 indicates that the pointing switch is on, and a state parameter of 0 indicates that the pointing switch is off.

[0157] Optionally, the user can modify the on / off state of the pointing switch by triggering the pointing switch on the pointing remote control. When the on / off state of the pointing switch on the pointing remote control changes, the pointing remote control sends a status update request containing the current status parameters of the pointing switch to the display device. After receiving the status update request, the display device locally stores the current status parameters.

[0158] It is understandable that whether the pointing remote control can send pointing parameters to the display device is related to the image processing method triggered by the display device. The display device can support multiple image processing functions at the same time, and different image processing functions correspond to different function triggering methods. Specifically, it can include image processing functions such as screen recording, full-screen screenshots, and circle screenshots. Therefore, in response to the preset press command sent by the pointing remote control, the state parameter representing the switch state of the pointing switch of the pointing remote control can be obtained from the current device information stored locally.

[0159] It is worth noting that when the pointing switch is on, the remote control can send pointing parameters to the display device regardless of whether the user presses the screenshot control. However, the pointing parameters at this time will not constitute a circled area, but will be presented in the form of a moving cursor.

[0160] S620: When the status parameter indicates that the switch is in the on state, obtain a status identifier of the multimedia player.

[0161] Optionally, if the state parameter indicates that the pointing switch is off, the pointing remote control will not send pointing parameters. In other words, the display device cannot execute the processing logic for circle selection screenshot. In this case, the image processing method triggered by the display device may be screen recording / full screen screenshot. If the state parameter indicates that the pointing switch is on, the pointing remote control can send pointing parameters. In this case, the image processing method triggered by the display device may be circle selection screenshot.

[0162] Afterwards, when it is determined that the image processing mode triggered by the display device is circle selection screenshot, the state identifier of the multimedia player can be obtained to identify the scene of the current interface, and then perform subsequent circle selection screenshot processing.

[0163] In an optional embodiment, to facilitate the display device's identification of the user's image processing needs, a corresponding function triggering method can be pre-configured for each image processing function based on the duration of the screenshot control's press, thereby determining the corresponding image processing method based on the user's triggering method. For example, upon detecting that the user has pressed the screenshot control, the pointing remote control can continuously send timing parameters to the display device. Upon detecting the timing parameters, the display device records the start timestamp of the timing parameters received and triggers the timing operation.

[0164] Specifically, the triggering method for full-screen screenshot can be configured as pressing the screenshot control for a short period of time. That is, when a stop screenshot command is detected and the timer duration does not exceed a preset time, the image processing method is determined to be a full-screen screenshot. The so-called full-screen screenshot is an image obtained by taking a screenshot of the entire current interface. The stop screenshot command can be a command sent when a preset control on the remote control is lifted.

[0165] The trigger for capturing a circled screenshot can be configured as pressing the screenshot control for a long period of time while the pointing switch is on. Specifically, if the timer duration exceeds a preset duration and the state parameter indicates that the pointing switch is on, the image processing method is determined to be circled screenshot. For example, when the user presses the preset control, the pressing parameter is 100, and when the user releases the preset control, the pressing parameter is 85. This means that if the received pressing parameter is 100, it indicates that the user has continued to press the preset control. If the received pressing parameter changes to 85, it indicates that a stop screenshot instruction has been detected.

[0166] Optionally, if the timer duration exceeds a preset duration and the status parameter indicates that the switch is off, the display device triggers the screen recording processing logic to record the current interface and obtain the recording results. The recording results are then stored locally for subsequent processing such as sending the recording to the user.

[0167] The above technical solution, on the one hand, configures a pointing switch in the remote control, providing a prerequisite for the smooth operation of the circle selection screenshot function; on the other hand, the switch state of the pointing switch can be used to determine whether a circle selection screenshot is required. When a circle selection screenshot is determined to be required, the multimedia player's status identifier is obtained, which provides restrictions on obtaining the status identifier and, in turn, on the circle selection screenshot, ensuring the standardization of the circle selection screenshot processing. In addition, this embodiment can also select different image processing methods based on the switch state of the pointing switch, which not only expands the use scenarios of the display device but also improves the user experience.

[0168] Based on the above embodiments, in an embodiment of the present application, another optional method for determining whether the current interface displays a dynamic picture or a static picture is provided. Specifically, the application status of the homepage application is obtained, and based on the application status, whether the current interface displays a dynamic picture or a static picture is determined. That is, when the application status indicates that the homepage application is playing media content, the current interface displays a dynamic picture; when the application status indicates that the homepage application is not playing media content, the current interface displays a static picture.

[0169] The homepage application is the application currently interacting with the user on the display device, i.e., a desktop application. A desktop application can be the default application that is enabled on the display device and can be used to support the display device in playing media data. In some embodiments, a desktop application is a pre-installed application that can serve as a signal source for the display device. The application state refers to the current running state of the homepage application.

[0170] Optionally, the application status of the homepage application may be acquired in the entire system of the display device according to the application identifier of the homepage application.

[0171] Based on this, an optional method for processing screen images is provided. Specifically, when the application state indicates that the home application is playing media content, the display is controlled to display the screen image; when the application state indicates that the home application is not playing media content, the screen image is deleted.

[0172] Optionally, when the application status indicates that the home application is playing media content, it proves that the current interface displays a dynamic picture. At this time, the display can be controlled to display the screen image; when the application status indicates that the home application is not playing media content, it proves that the current interface displays a static picture. At this time, the screen image can be deleted.

[0173] For example, when it is analyzed that the application status of the homepage application is playing video B, the display can be controlled to display the screen image B′ pre-acquired from video B, and the screenshot selection operation can be performed in the screen image B′; when it is analyzed that the application status of the homepage application is displaying the static picture of the image selection interface C, the pre-acquired screen image C′ can be deleted, and the screenshot selection operation can be performed directly in the image selection interface C.

[0174] The above technical solution introduces the application status of the homepage application. By judging whether the homepage application is playing media content based on the application status of the homepage application, and then selecting the corresponding screen image processing method based on the judgment result, the rationality of the screen image processing can be ensured.

[0175] On the basis of the above-mentioned embodiment, in the embodiment of the present application, the process of controlling the display to display the screen image is refined, specifically, maintaining the playback of the dynamic picture and displaying the screen image in a layer above the dynamic picture.

[0176] Among them, the layer above the dynamic picture is the display layer covering the dynamic picture.

[0177] It is worth noting that when you circle a screenshot of a dynamic image, in order to not affect the continuous playback of the dynamic image, you can display the screen image in a layer above the dynamic image while keeping the dynamic image playing. In this case, if the dynamic image contains audio data, the user can hear the audio.

[0178] The above technical solution introduces a layer above the dynamic picture. By maintaining the playback of the dynamic picture during the circle selection screenshot process and displaying the screen image on the layer above the dynamic picture, the circle selection screenshot processing can be completed without affecting the playback of the dynamic picture, thereby improving the convenience of circle selection screenshot.

[0179] Based on this, after the user circles and takes a screenshot of the screen image displayed in the layer above the dynamic picture and obtains the area image, a method of information display is also provided, specifically, canceling the display of the screen image, and displaying the screen image in the preset display area of ​​the layer above the dynamic picture, as well as search indication information.

[0180] The so-called preset display area is the area where the screen image and search indication information are displayed during the image search process. For example, the upper left corner of the layer above the dynamic picture is used as the preset display area. Furthermore, the area of ​​the preset display area is smaller than the display area of ​​the dynamic picture, and the area outside the preset display area in the upper layer is a transparent area, that is, the dynamic picture played in the area outside the preset display area can be viewed normally. The so-called search indication information is used to inform the user that an image search is being performed on the screen image. For example, it can be a text message "Circle content recognition" or "The following results are recognized for you".

[0181] Optionally, after obtaining the regional image, in order not to affect the display of the dynamic picture, the full-screen display of the screen image can be canceled; then the screen image is displayed in the preset display area of ​​the layer above the dynamic picture, as well as the search indication information generated when the image recognition of the person in the regional image is performed. For example, refer to Figure 7 The image search page diagram shown in the figure, when the upper left corner of the layer above the dynamic picture is used as the preset display area, can display the screen image 1 and the search indication information 2 "Circling content recognition..." in the upper left corner of the layer above the dynamic picture.

[0182] It is worth noting that in addition to presetting a fixed area as the preset display area, in order to ensure the rationality of the preset display area, the preset display area can also be determined based on the location information of the preset elements that cannot be obstructed in the current dynamic image. For example, the preset display area can be selected from an area other than the area where the preset elements that cannot be obstructed are located.

[0183] Optionally, after the object information of the person in the identified area image is obtained, the object information of the person can be displayed in a preset display area in the layer above the dynamic image. Figure 8 The object information display diagram shown in the figure sets the upper left corner of the layer above the dynamic picture as the preset display area, and after the object information of the person in the identified area image is identified, the object information 3 of the person and the search indication information 4 "the following results have been identified for you" can be displayed while setting the upper left corner of the layer above the dynamic picture as the preset display area.

[0184] The above technical solution introduces a layer above the dynamic picture. By canceling the display of the screen image during the image search process, the user can continue to watch the dynamic picture; further, the screen image and search indication information are displayed in the preset display area of ​​the layer above the dynamic picture, which enables the user to intuitively understand the progress of the image search and improve the user experience.

[0185] Based on the above embodiment, in the embodiment of the present application, steps S520 and S530 are refined. Figure 9 As shown, the specific steps include:

[0186] S910: Generate a trajectory line according to the received pointing parameter sent by the pointing remote controller, and determine a preset shape area according to the trajectory line as a circled area corresponding to the pointing parameter.

[0187] The area enclosed by the preset shape corresponds to the area represented by the trajectory line, and can be the enclosed area containing all the trajectory lines. Optionally, the preset shape area can be a rectangular area (including a square area, a rectangular area), a circular area, an elliptical area, a triangular area, etc.

[0188] Optionally, when the position information contained in the pointing parameter is the position information relative to the display device in the geodetic coordinate system, and when it is determined based on the user's current trigger method that the user uses the circle screenshot function, the display device can convert the position information in the pointing parameter received and sent by the pointing remote control into the coordinate information of the corresponding track point in the current interface through a preset coordinate conversion method, and store the coordinate information of the track point in the track array associated with the current interface.

[0189] Optionally, when the pointing parameters include the horizontal and vertical coordinate information of the screen coordinate system on the display device after the coordinate conversion of the pointing remote control, based on the user's current trigger method, when it is determined that the user uses the circle screenshot function, the display device can use the position information in the pointing parameters received and sent by the pointing remote control as the coordinate information of the corresponding track point in the current interface, and store the coordinate information of the track point in the track array associated with the current interface.

[0190] Then, based on the order in which the trajectory points in the trajectory array were sent and the coordinate information corresponding to each trajectory point, the coordinate changes between the trajectory points are determined. Then, based on the coordinate changes between the trajectory points, a trajectory line is generated in the current interface being displayed. For example, the trajectory points can be connected in the order in which they were sent to generate the trajectory line.

[0191] It is understood that to prevent the screen image from being modified by the circle selection operation, when executing the above-mentioned circle selection screenshot process, the display device will overlay a transparent canvas on the screen image and perform the trajectory line generation operation on the transparent canvas. This allows the user to directly see the circle selection results on the screen image without modifying the screen image. In addition, if the user makes a mistake in the circle selection, the trajectory line on the transparent canvas can be cleared and the circle selection screenshot can be taken again.

[0192] For example, when it is detected that a circle selection screenshot process is being executed, a brush can be initialized, and when a new track point is received, the brush is used to depict the position information corresponding to the track point on the transparent canvas, thereby generating a track line; when a circle selection stop event is detected, the current brush will be destroyed, that is, the circle selection operation at this time will be ended.

[0193] Optionally, a preset shape area can be determined based on the horizontal and vertical coordinate parameters of each coordinate in the trajectory array associated with the trajectory line. It is worth noting that only one preset shape area can be configured to determine the preset shape area corresponding to the area represented by the trajectory line; multiple candidate preset shape areas can also be configured at the same time. Before determining the preset shape area corresponding to the trajectory line, the target preset shape area that best matches the trajectory line can be selected from the multiple candidate preset shape areas based on the selection trend of the trajectory line, thereby determining the preset shape area corresponding to the area represented by the trajectory line.

[0194] For example, when the preset shape area is a rectangle, the minimum abscissa value, the maximum abscissa value, the minimum ordinate value, and the maximum ordinate value can be screened from the horizontal and vertical coordinates of the coordinates of each track point to perform a horizontal and vertical combination to obtain the four vertices of the rectangular area, thereby determining the rectangular area. For example, based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max, the coordinate points (X-min, Y-min), (X-min, Y-max), (X-max, Y-max), and (X-max, Y-max) can be determined, thereby determining the rectangular area based on the above coordinate points.

[0195] For example, if the preset shaped area is a circle, the maximum horizontal and vertical difference values ​​can be determined based on the coordinates of each track point, and the larger of the two values ​​is used as the diameter of the circular area. The center point of the circular area is then determined based on the average horizontal and vertical values ​​of the coordinates of each track point. In this case, an initial circular area can be determined based on the center point and diameter of the circular area.

[0196] Furthermore, it is determined whether the initial circular area completely contains all the trajectory points. If so, the initial circular area is directly used as the determined circular area; if not, the initial circular area is expanded based on the center of the circle until the initial circular area contains all the trajectory points, thereby determining the circular area.

[0197] Alternatively, the trajectory line is input into a trained preset shape region determination model, and the preset shape region determination model determines and outputs the preset shape region based on the position information of the trajectory line and model parameters.

[0198] It's worth noting that no matter what shape the user circles, a pre-defined area containing all the track lines can be determined based on the track lines. Furthermore, since there are no restrictions on the shape or regularity of the track lines, this step simplifies the difficulty of circling the screenshot, improves the user experience, and ensures smooth subsequent image searches.

[0199] It is understood that, to facilitate subsequent image search operations, when determining the preset shape area, the preset shape area can also be optimized based on the page type of the current interface. If the page type of the current interface is a play page, since the play page does not include page controls, the above method can be used to determine the preset shape area based solely on the trajectory line.

[0200] In the case where the page type of the current interface is a non-playing page, since there are multiple page controls (which may include picture controls and text controls) in the non-playing page, in order to improve the accuracy of the image search, the page controls can be used as auxiliary information for the image search. Specifically, the track-related controls associated with the track line can be determined based on the position information of the track line, and then the preset shape area containing both the track line and the track-related controls can be determined based on the coordinate information of the track-related controls in the current interface and the position information of the track line. Among them, only the page controls located on the track line and within the track line can be used as track-related controls; the page controls associated with the images within the track line can also be used as track-related controls, and there is no restriction on this.

[0201] S920 , taking a screenshot of the area corresponding to the circled area in the target image to obtain a regional image.

[0202] Among them, the target image is a screen image or a static picture, that is, when the current interface displays a dynamic picture, the target image is a screen image, and when the current interface displays a static picture, the target image is a static picture.

[0203] Optionally, a region corresponding to the preset shape region in the target image may be captured based on the coordinate information of the preset shape region, thereby obtaining a region image. For example, if the preset shape region is a rectangular region, a region corresponding to the rectangular region in the target image may be captured based on the coordinate information of the rectangular region, thereby obtaining a region image.

[0204] In some embodiments, when the preset shape area is a rectangular area, to ensure compatibility between the image area and the display page, a screenshot of the image framed by the rectangular area in the target image can be taken to obtain the original image, which can then be optimized based on the aspect ratio of the display page to obtain the regional image. For example, when the aspect ratio of the display page is 16:9, the original image can be adjusted to a regional image with an aspect ratio of 16:9 without modifying the image length; or the original image can be adjusted to a regional image with an aspect ratio of 16:9 without modifying the image width.

[0205] In the above technical solution, in the circling and screenshot scenario, no matter what shape of trajectory line the user circles, a preset shape area containing all trajectory lines can be determined based on the trajectory line, and the target image can be screenshoted based on the determined preset shape area. On the one hand, since there are no restrictions on the shape and regularity of the trajectory line, the difficulty of the user circling and screenshoting is reduced, the user experience is improved, and the subsequent image search is carried out smoothly, which improves the efficiency of obtaining image search results; on the other hand, since the determined preset shape area contains all trajectory lines, it can be guaranteed that the regional image obtained by the screenshot is consistent with the user's actual query requirements, that is, the accuracy of the regional image acquisition is guaranteed.

[0206] On the basis of the above embodiment, in the embodiment of the present application, the preset shape area is a rectangular area, and step S920 is refined. Figure 10 As shown, the specific steps include:

[0207] S1010 , selecting a minimum abscissa value, a maximum abscissa value, a minimum ordinate value, and a maximum ordinate value from coordinate data of track points on the track line.

[0208] Among them, the so-called minimum value of the horizontal coordinate is the smallest horizontal coordinate value in the trajectory line; the so-called maximum value of the horizontal coordinate is the largest horizontal coordinate value in the trajectory line; the so-called minimum value of the vertical coordinate is the smallest vertical coordinate value in the trajectory line; the so-called maximum value of the vertical coordinate is the largest vertical coordinate value in the trajectory line.

[0209] It is understandable that in actual applications, there may be a problem that the user's non-standard circle selection may result in a shorter circle length in a certain direction, which will cause the determined preset shape area to be smaller, and thus the accuracy of the image search results cannot be guaranteed.

[0210] Based on this, in order to ensure the rationality of the determination of the preset shape area, the width value of the trajectory line in the width direction of the screen and the length value in the length direction of the screen can be compared with the first threshold value respectively, and when the width value is greater than or equal to the first threshold value, or the length value is greater than or equal to the first threshold value, the trajectory line is determined to be valid. At this time, the minimum horizontal coordinate value, the maximum horizontal coordinate value, the minimum vertical coordinate value and the maximum vertical coordinate value can be selected from the coordinate data of the track point on the trajectory line.

[0211] Among them, the width value is the maximum horizontal coordinate difference between the horizontal coordinate differences of the track points on the track line, and the length value is the maximum vertical coordinate difference between the vertical coordinate differences of the track points on the track line. For example, when the coordinate unit in the current interface is pixel, for the horizontal coordinates x1, x2 and x3, the difference between x1 and x2 is 5 pixels, the difference between x1 and x3 is 10 pixels, and the difference between x2 and x3 is 5 pixels. At this time, the width value is 10 pixels; for the vertical coordinates y1, y2 and y3, the difference between y1 and y2 is 4 pixels, the difference between y1 and y3 is 10 pixels, and the difference between y2 and y3 is 6 pixels. At this time, the length value is 10 pixels. The so-called first threshold is the value used to determine whether the track line is valid. For example, the first threshold can be 100 pixels. In some embodiments, the first threshold can be set based on the experience of those skilled in the art, or it can be determined based on a large amount of experimental data, without limitation.

[0212] In addition, when both the width value and the length value are less than the first threshold, a screenshot failure message is output. The so-called screenshot failure message is the prompt information displayed by the display device when the circled screenshot fails, which may include but is not limited to the reason for the screenshot failure.

[0213] Optionally, if both the width and length of the track line are less than a first threshold, indicating that the area selected by the user is too small, the selected area is invalid. The display device may then generate a floating layer on the target image and output a screenshot failure message in the form of text in the floating layer. For example, the floating layer may output text such as "The selected area is too small. Please reselect."

[0214] S1020 , performing horizontal and vertical combinations on the minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate, and the maximum value of the vertical coordinate to obtain at least two vertex coordinates.

[0215] Wherein, at least two vertex coordinates are used to represent the rectangular area.

[0216] Optionally, after combining the minimum abscissa value, the maximum abscissa value, the minimum ordinate value, and the maximum ordinate value horizontally and vertically, at least two vertex coordinates may be obtained; and then, a rectangular area may be determined based on the obtained vertex coordinates.

[0217] It is understood that when only two vertex coordinates are determined, the two vertex coordinates must be diagonal coordinates. For example, when only two vertex coordinates are determined based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max, the two vertex coordinates can be (X-min, Y-min) and (X-max, Y-max), or (X-min, Y-max) and (X-max, Y-max).

[0218] For example, reference Figure 11 Schematic diagram of determining the rectangular area corresponding to the regular trajectory line shown. When the width and length values ​​of the trajectory line 5 are both greater than the first threshold, the coordinate points (X-min, Y-min) and (X-max, Y-max) can be directly determined based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max in the trajectory line 5, thereby determining the rectangular area 6 based on the above coordinate points.

[0219] It is understandable that when the trajectory line is an irregular curve that intersects, the rectangular area can also be determined based on the extreme values ​​of the horizontal and vertical coordinates of the trajectory points. Figure 12 Schematic diagram of determining the rectangular area corresponding to the irregular trajectory line shown. When the width and length values ​​of the trajectory line 7 are both greater than the first threshold, the coordinate points (X-min, Y-min) and (X-max, Y-max) can be directly determined based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max in the trajectory line 7, thereby determining the rectangular area 8 based on the above coordinate points.

[0220] The above technical solution determines the vertex coordinates of a rectangular area based on the minimum, maximum, and minimum and maximum values ​​of the horizontal and vertical coordinates in the coordinate data of the trajectory points. This provides an alternative method for quickly determining the rectangular area while ensuring that the subsequently acquired regional image contains valid image information. Furthermore, this solution presents the area determined by the trajectory line as a rectangle, a presentation method that is compatible with the way a display device presents a page, thereby making the captured regional image more reasonable.

[0221] On the basis of the above embodiment, in the embodiment of the present application, the preset shape area is a rectangular area, and step S920 is further refined. Figure 13 As shown, the specific steps include:

[0222] S1310: If the aspect ratio of the selected area is different from the screen aspect ratio of the display device, modify the selected area according to the screen aspect ratio.

[0223] The aspect ratio of the modified selected area is the same as the screen aspect ratio.

[0224] Optionally, after determining the circled area, you can first determine the aspect ratio of the circled area, and compare the aspect ratio of the rectangular area with the screen aspect ratio. When the aspect ratio of the circled area and the screen aspect ratio are the same, you can directly take a screenshot of the area corresponding to the circled area in the target image to obtain a regional image; when the aspect ratio of the circled area and the screen aspect ratio are different, the circled area needs to be corrected according to the screen aspect ratio.

[0225] For example, when the aspect ratio of the rectangular area is greater than the aspect ratio of the screen, the length of the rectangular area can be shortened based on the center point of the rectangular area, so that the aspect ratio of the modified rectangular area is the same as the aspect ratio of the screen. When the aspect ratio of the rectangular area is less than the aspect ratio of the screen, the width of the rectangular area can be shortened based on the center point of the rectangular area, so that the aspect ratio of the modified rectangular area is the same as the aspect ratio of the screen. For example, if the aspect ratio of the rectangular area is 16:10, the aspect ratio of the screen is 16:9, and the width of the rectangular area is 100 pixels, the width of the rectangular area needs to be reduced, that is, the width needs to be reduced by 10 pixels without changing the length of the rectangular area. In this case, the center point of the rectangular area can be used as a reference, and both sides can be shrunk inward by 5 pixels to obtain the modified rectangular area.

[0226] S1320 , taking a screenshot of the area in the target image corresponding to the corrected circled area to obtain a regional image.

[0227] Optionally, a screenshot may be taken of an area in the target image corresponding to the corrected circled area, thereby obtaining an image of the area with the same aspect ratio as the screen aspect ratio.

[0228] The above technical solution corrects the circled area according to the screen aspect ratio to obtain a regional image with the same aspect ratio as the screen, thereby ensuring the adaptability between the regional image and the currently displayed page, thereby making the captured regional image more reasonable.

[0229] Furthermore, in order to generate a valid rectangular area when the trajectory line is invalid (either the length value or the width value is invalid), the target value can be calculated based on the valid values ​​of the length value and the width value, and the screen aspect ratio of the display device. Exemplarily, when the length value of the trajectory line is invalid, the optimized length value can be calculated based on the width value and the screen aspect ratio. For example, when the length value of the trajectory line is 10 pixels, the width value is 90 pixels, and the screen aspect ratio is 16:9, the optimized length value can be calculated to be 160 pixels. When the width value of the trajectory line is invalid, the optimized width value can be calculated based on the length value and the screen aspect ratio. For example, when the width value of the trajectory line is 10 pixels, the length value is 160 pixels, and the screen aspect ratio is 16:9, the optimized width value can be calculated to be 90 pixels.

[0230] Next, the corresponding expansion direction is determined based on the selected direction of the trajectory line, and the selected area is expanded according to the corresponding expansion direction to obtain the expanded selected area. If the trajectory line is a straight line, the expansion direction cannot be determined. In this case, the image richness on both sides of the trajectory line can be used as the expansion direction.

[0231] For example, if the width value is valid and the length value is invalid, an initial selected area can be determined based on the current width and length values. Then, based on the trajectory line's selection direction, a length extension direction for the initial selected area is determined, and the length of the initial selected area is extended to a target value in the length extension direction, thereby obtaining an extended selected area. Alternatively, if the length value is valid and the width value is invalid, an initial selected area can be determined based on the current width and length values. Then, based on the trajectory line's selection direction, a width extension direction for the initial selected area is determined, and the width of the initial selected area is extended to a target value in the width extension direction, thereby obtaining an extended selected area.

[0232] Optionally, after the expanded selected area is determined, the minimum horizontal coordinate value, the maximum horizontal coordinate value, the minimum vertical coordinate value, and the maximum vertical coordinate value in the expanded selected area may be combined horizontally and vertically to obtain at least two vertex coordinates.

[0233] For example, refer to Figure 14Schematic diagram of determining the rectangular area corresponding to a track line with an invalid width. An initial rectangle 10 can be determined to completely encompass track line 9. In this case, the width of initial rectangle 10 is invalid. Based on the direction of the selected track line 9, the expansion direction of initial rectangle 10 can be determined to be downward. In this case, an optimized width value can be calculated based on the length of initial rectangle 10 and the screen aspect ratio. The width of initial rectangle 10 is then extended downward to the optimized width value, thereby forming rectangular area 11.

[0234] In another optional embodiment, a standard rectangular area can be determined based on the screen aspect ratio, and based on the coordinate values ​​of each trajectory coordinate in the trajectory line, two coordinate points corresponding to the first value can be determined; then, based on the two coordinate points, the standard rectangular area is scaled so that the length of one side in the scaled standard rectangular area is the first value, and the scaled standard rectangular area contains the trajectory line, thereby obtaining a rectangular area.

[0235] Based on the technical solutions of the above embodiments, the display device is a television device as an example for explanation, wherein the television device includes a television system and a screenshot application. The television system is the entire system of the television device. Through the cooperation of the television system and the screenshot application, a screenshot function for the display interface is provided. Furthermore, in the case where the display interface is a dynamic picture, an optional embodiment is provided. Figure 15 The diagram below shows the interaction between devices during the circled screenshot process, including:

[0236] S1501: When the pointing remote control detects a user pressing a preset control, the pointing remote control sends a preset pressing instruction to the television system.

[0237] S1502: After receiving the preset pressing instruction, the television system sends a start instruction to the screenshot application.

[0238] S1503: After the screenshot application is started, a screenshot method provided by the television system is called to take a screenshot of the display interface to obtain a screen image.

[0239] Specifically, the screenshot application sends a screenshot instruction to the television system, and the television system takes a screenshot of the display interface and sends the captured screen image to the screenshot application.

[0240] S1504: When the screenshot application detects that the pressing time of the preset control exceeds the preset time, it sends a status query instruction for the pointing switch of the pointing remote control to the television system.

[0241] S1505: The television system feeds back a state parameter representing the switch state of the pointing switch of the pointing remote controller to the screenshot application.

[0242] S1506: When the status parameter indicates that the pointing switch is in the on state, the screenshot application obtains a status identifier of the multimedia player.

[0243] S1507: When the state identifier indicates that the multimedia player is in the playing state, the screenshot application maintains the playing of the dynamic picture and controls the display to display the screen image in a layer above the dynamic picture.

[0244] S1508: The screenshot application generates a trajectory line according to the received pointing parameters sent by the pointing remote controller, and determines a rectangular area according to the trajectory line as the circled area corresponding to the pointing parameters.

[0245] S1509: The screenshot application sends a circled screenshot instruction including coordinate information of the circled area to the television system.

[0246] S1510: The television system takes a screenshot of the screen image according to the rectangular region coordinate information to obtain a region image, and sends the region image and a path for obtaining the screenshot of the region image to a screenshot application.

[0247] S1511, the screenshot application uploads the area image and the screenshot acquisition path to the image recognition system, and at the same time cancels the display of the screen image, and displays the screen image and search indication information in the preset display area of ​​the layer above the display interface.

[0248] S1512 , the image recognition system performs an image search based on the region image to determine object information of the person in the region image, and feeds back the object information of the person in the region image to the screenshot application based on the screenshot acquisition path.

[0249] S1513, taking a screenshot of the object information of the person in the preset display area image of the layer above the display interface.

[0250] In this embodiment, when the status identifier indicates that the multimedia player is in a non-playing state, the screenshot application deletes the screen image and, after determining the selected area based on the pointing parameters received from the pointing remote control, sends a circled screenshot instruction containing the coordinates of the selected area to the television system. The television system then takes a screenshot of the display interface based on the rectangular area coordinates to obtain an image of the area. The system then sends the image and the path to obtain the screenshot of the area to the screenshot application. Step S1511 is then executed.

[0251] Furthermore, the specific process of the above S1501-S1513 can be found in the description of the above method embodiment. The implementation principles and technical effects are similar and will not be repeated here.

[0252] Based on the same inventive concept, some embodiments further provide a circled screenshot device for implementing the circled screenshot method described above. The solution provided by this device is similar to the solution described in the method described above. Therefore, the specific limitations of one or more embodiments of the circled screenshot device provided below can be found in the limitations of the circled screenshot method described above and will not be further elaborated here.

[0253] In an exemplary embodiment, Figure 16 As shown, a circle selection screenshot device 1 is provided, which is configured on a display device and includes: an image acquisition module 10, a first screenshot module 20, a second screenshot module 30 and an image recognition module 40, wherein:

[0254] The image acquisition module 10 is configured to take a screenshot of the interface currently displayed on the display in response to a received preset pressing instruction to obtain a screen image; wherein the preset pressing instruction indicates that a preset button in the remote control is pressed;

[0255] A first screenshot module 20 is configured to control the display to display a screen image when a dynamic image is displayed on the current interface, and to take a screenshot of a selected area in the screen image to obtain a regional image; wherein the selected area is determined based on a pointing parameter sent by a pointing remote controller, and the pointing parameter changes with the movement of the pointing remote controller;

[0256] The second screenshot module 30 is used to delete the screen image when the current interface displays a static image, and take a screenshot of the static image according to the circled area to obtain a regional image;

[0257] The image recognition module 40 is configured to perform image recognition based on the person in the area image to display object information of the person in the area image.

[0258] In an exemplary embodiment, when the current interface displays a dynamic image, before controlling the display to display the screen image, the circling screenshot device 1 further includes an identifier acquisition module, wherein the identifier acquisition module is specifically configured to: acquire a status identifier of the multimedia player; wherein, when the status identifier indicates that the multimedia player is in a playing state, the current interface displays a dynamic image; and when the status identifier indicates that the multimedia player is in a non-playing state, the current interface displays a static image;

[0259] Accordingly, the first screenshot module 20 is specifically configured to: when the state identifier indicates that the multimedia player is in a playing state, control the display to display the screen image;

[0260] The second screenshot module 30 is specifically configured to delete the screen image when the state identifier indicates that the multimedia player is in a non-playing state.

[0261] In an exemplary embodiment, the identifier acquisition module is further configured to:

[0262] When a preset press instruction is received, the status parameter representing the switch state of the pointing switch of the pointing remote control is read locally; when the status parameter represents that the pointing switch is in the on state, the status identifier of the multimedia player is obtained; wherein the pointing switch is a switch for controlling the sending of pointing parameters on the pointing remote control, and when the pointing switch is in the on state, the pointing remote control sends the pointing parameters; when the pointing switch is in the off state, the pointing remote control does not send the pointing parameters.

[0263] In an exemplary embodiment, when the current interface displays a dynamic image, before controlling the display to display the screen image, the circling screenshot device 1 further includes a state recognition module, wherein the state recognition module is specifically used to: obtain the application state of the homepage application; wherein the homepage application is an application in the display device that currently interacts visually with the user; when the application state indicates that the homepage application is playing media content, the current interface displays a dynamic image; when the application state indicates that the homepage application is not playing media content, the current interface displays a static image;

[0264] Accordingly, the first screenshot module 20 is specifically configured to: when the application state indicates that the homepage application is playing media content, control the display to display the screen image;

[0265] The second screenshot module 30 is specifically configured to delete the screen image when the application state indicates that the homepage application is not playing media content.

[0266] In an exemplary embodiment, the first screenshot module 20 is specifically configured to maintain the playback of the dynamic picture and display the screen image in a layer above the dynamic picture.

[0267] In an exemplary embodiment, when the current scene is a dynamic picture scene, after obtaining the area image, the circle selection screenshot device 1 further includes an information display module, wherein the information display module is specifically used to:

[0268] Cancel the display of the screen image, and display the screen image and search indication information in the preset display area of ​​the layer above the dynamic image; wherein the area of ​​the preset display area is smaller than the display area of ​​the dynamic image, and the area outside the preset display area in the upper layer is a transparent area, and the search indication information is used to inform the user that an image search is being performed on the screen image.

[0269] In an exemplary embodiment, the screenshot unit in the first screenshot module 20 / the second screenshot module 30 is specifically configured to:

[0270] A trajectory line is generated based on the pointing parameters received from the pointing remote control, and a preset shape area is determined based on the trajectory line as the circled area corresponding to the pointing parameters; wherein the area circled by the preset shape corresponds to the area represented by the trajectory line; a screenshot is taken of the area corresponding to the circled area in the target image to obtain a regional image; wherein the target image is a screen image or a static picture.

[0271] In an exemplary embodiment, the preset shape area is a rectangular area; the screenshot unit in the first screenshot module 20 / the second screenshot module 30 is further configured to:

[0272] From the coordinate data of the trajectory points on the trajectory line, the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate are selected; the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate are combined horizontally and vertically to obtain at least two vertex coordinates; wherein, the at least two vertex coordinates are used to represent the rectangular area.

[0273] In an exemplary embodiment, the preset shape area is a rectangular area; the screenshot unit in the first screenshot module 20 / the second screenshot module 30 is further configured to:

[0274] When the aspect ratio of the selected area is different from the screen aspect ratio of the display device, the selected area is corrected according to the screen aspect ratio; wherein the aspect ratio of the modified selected area is the same as the screen aspect ratio; and a screenshot is taken of the area within the target image corresponding to the corrected selected area to obtain a regional image.

[0275] Each module in the aforementioned circled screenshot device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a computer in the form of software.

[0276] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0277] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0278] It should be noted that the data involved in this application (including but not limited to image data, etc.) are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0279] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile memory and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a programmable logic unit (PLC), a data processing logic unit based on quantum computing, an artificial intelligence (AI) processor, and the like.

[0280] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0281] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A display device, characterized in that: include: Display and controller; The controller is configured to: In response to the received preset press instruction, taking a screenshot of the display interface of the display to obtain a screen image; wherein the preset press instruction indicates that a preset button in the remote control is pressed; When a dynamic image is displayed on the current interface, controlling the display to display the screen image, and taking a screenshot of the screen image according to the circled area to obtain a regional image; wherein the circled area is determined according to the pointing parameter sent by the pointing remote control, and the pointing parameter changes with the movement of the pointing remote control; When a static image is displayed on the current interface, the screen image is deleted, and a screenshot is taken in the static image according to the circled area to obtain a regional image; Image recognition is performed based on the person in the area image to display object information of the person in the area image.

2. The display device according to claim 1, wherein Before the controller controls the display to display the screen image when the current interface displays a dynamic image, the controller is further configured to: Obtaining a status identifier of the multimedia player; wherein, when the status identifier indicates that the multimedia player is in a playing state, the current interface displays a dynamic image; and when the status identifier indicates that the multimedia player is in a non-playing state, the current interface displays a static image; Accordingly, when the controller controls the display to display the screen image when the current interface displays a dynamic image, the controller is configured to: When the state identifier indicates that the multimedia player is in a playing state, controlling the display to display the screen image; When the controller deletes the screen image when a static image is displayed on the current interface, the controller is configured to: When the state identifier indicates that the multimedia player is in a non-playing state, the screen image is deleted.

3. The display device according to claim 2, wherein When the controller executes the acquisition of the status identifier of the multimedia player, the controller is configured to: When a preset pressing instruction is received, a state parameter representing a switch state of the directional switch of the directional remote controller is read from a local device; When the state parameter indicates that the pointing switch is in the on state, a state identifier of the multimedia player is obtained; wherein the pointing switch is a switch on the pointing remote control that controls the sending of pointing parameters, and when the pointing switch is in the on state, the pointing remote control sends pointing parameters; when the pointing switch is in the off state, the pointing remote control does not send pointing parameters.

4. The display device according to claim 1, wherein Before the controller controls the display to display the screen image when the current interface displays a dynamic image, the controller is further configured to: Obtaining an application state of a homepage application; wherein the homepage application is an application currently visually interacting with a user on the display device; when the application state indicates that the homepage application is playing media content, the current interface displays a dynamic image; when the application state indicates that the homepage application is not playing media content, the current interface displays a static image; Accordingly, when the controller controls the display to display the screen image when the current interface displays a dynamic image, the controller is configured to: When the application state indicates that the homepage application is playing media content, controlling the display to display the screen image; When the controller deletes the screen image when a static image is displayed on the current interface, the controller is configured to: When the application state indicates that the homepage application is not playing media content, the screen image is deleted.

5. The display device according to claim 1, wherein When the controller controls the display to display the screen image, the controller is configured to: The dynamic picture is kept playing, and the screen image is displayed on the upper layer of the dynamic picture.

6. The display device according to claim 5, wherein: In the case where the current scene is a dynamic picture scene, after obtaining the regional image, the controller is further configured to: Cancel the display of the screen image, and display the screen image and search indication information in the preset display area of ​​the layer above the dynamic picture; wherein the area of ​​the preset display area is smaller than the display area of ​​the dynamic picture, the area outside the preset display area in the upper layer is a transparent area, and the search indication information is used to inform the user that an image search is being performed on the screen image.

7. The display device according to claim 1, wherein When the controller takes a screenshot of the target image according to the circled area to obtain the area image, the controller is configured to: Generate a trajectory line according to the received pointing parameters sent by the pointing remote control, and determine a preset shape area according to the trajectory line as the circled area corresponding to the pointing parameters; wherein the area circled by the preset shape corresponds to the area represented by the trajectory line; A screenshot is taken of an area in a target image corresponding to the circled area to obtain a regional image; wherein the target image is the screen image or the static picture.

8. The display device according to claim 7, wherein: The preset shape area is a rectangular area; when the controller performs the step of determining the preset shape area according to the trajectory line, the controller is configured to: From the coordinate data of the track points on the track line, select the minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate and the maximum value of the vertical coordinate; The minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate, and the maximum value of the vertical coordinate are combined horizontally and vertically to obtain at least two vertex coordinates; wherein the at least two vertex coordinates are used to represent the rectangular area.

9. The display device according to claim 7, wherein: The preset shape area is a rectangular area; when the controller takes a screenshot of the area corresponding to the circled area in the target image to obtain the area image, the controller is configured to: If the aspect ratio of the selected area is different from the screen aspect ratio of the display device, modifying the selected area according to the screen aspect ratio; wherein the modified aspect ratio of the selected area is the same as the screen aspect ratio; A screenshot is taken of the area in the target image corresponding to the corrected circled area to obtain a regional image.

10. A method for circling and taking screenshots, characterized in that: Applied to display devices, including: In response to the received preset pressing instruction, taking a screenshot of the display interface of the display to obtain a screen image; wherein the preset pressing instruction indicates that a preset button in the remote control is pressed; When a dynamic image is displayed on the current interface, controlling the display to display the screen image, and taking a screenshot of the screen image according to the circled area to obtain a regional image; wherein the circled area is determined according to the pointing parameter sent by the pointing remote control, and the pointing parameter changes with the movement of the pointing remote control; When a static image is displayed on the current interface, the screen image is deleted, and a screenshot is taken in the static image according to the circled area to obtain a regional image; Image recognition is performed based on the person in the area image to display object information of the person in the area image.

Images