Display device and circle selection screenshot method

Abstract

The invention relates to a display device and a circle selection screenshot method. The display device comprises a display and a controller, the controller is configured to receive a pointing parameter sent by a remote controller and generate a trajectory according to the received pointing parameter, the pointing parameter changes along with the movement of the remote controller, a preset shape area is determined according to the trajectory, and the preset shape area corresponds to the preset shape area. The preset shape region corresponds to the region represented by the trajectory, performing screenshot on the region corresponding to the preset shape region in the current display page to obtain a region image, and performing image search according to the region image to display object information of the object in the region image. According to the method, no matter which shape of the trajectory is selected by the user, the preset shape area containing all the trajectories can be determined based on the trajectories, so that smooth proceeding of subsequent image search is guaranteed.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a display device and a method for circling and taking screenshots. Background Art

[0002] With the development of devices (such as smart TVs), some devices have integrated the ability to circle and capture screenshots (or partial or segmented screenshots) to meet users' diverse information needs on the device's displayed interface. For example, a device can capture a portion of the displayed content on the displayed interface and perform a search based on the captured portion of the image, displaying search results for the portion of the image to the user.

[0003] However, in the related art, the device can only recognize a circled area of ​​a single shape. When the user circles an area of ​​another shape, the screenshot cannot be processed, which makes subsequent image search impossible. Summary of the Invention

[0004] The present application provides a display device and a method for circling and taking screenshots. No matter what shape of trajectory line the user circles, a preset shape area containing all the trajectory lines can be determined based on the trajectory line, thereby ensuring the smooth progress of subsequent image search.

[0005] In a first aspect, some embodiments provide a display device, including:

[0006] Display and controller;

[0007] The controller is configured as:

[0008] receiving a pointing parameter sent by the remote control and generating a trajectory line according to the received pointing parameter; wherein the pointing parameter changes with the movement of the remote control;

[0009] Determine a preset shape area according to the trajectory line; wherein the preset shape area corresponds to the area represented by the trajectory line;

[0010] Taking a screenshot of the area corresponding to the preset shape area in the current display page to obtain an area image;

[0011] An image search is performed based on the region image to display object information of objects in the region image.

[0012] In the above technical solution, in the circling screenshot scenario, no matter what shape of trajectory line the user circles, a preset shape area corresponding to the trajectory line representation area can be determined based on the trajectory line, and a screenshot of the current display page can be taken based on the determined preset shape area. On the one hand, since there are no restrictions on the shape and regularity of the trajectory line, the difficulty of the user circling the screenshot is reduced, the user experience is improved, and the subsequent image search is carried out smoothly, which improves the efficiency of obtaining image search results; on the other hand, since the determined preset shape area corresponds to the area represented by all trajectory lines, it can be guaranteed that the regional image obtained by the screenshot is consistent with the user's actual query needs, that is, the accuracy of the regional image acquisition is guaranteed, and thus the accuracy of the image search results displayed to the user is guaranteed.

[0013] In some embodiments, when the controller receives the pointing parameters sent by the remote controller and generates a trajectory line based on the received pointing parameters, the controller is configured to:

[0014] In response to a press event for a screenshot control sent by the remote control, executing a timing operation;

[0015] When a lift event representing the lifting of the screenshot control is detected and the timing duration does not exceed the preset duration, a full-screen screenshot of the current display page is taken;

[0016] When the timing duration exceeds the preset duration and no lift event indicating that the screenshot control is lifted is detected within the timing duration, the pointing parameter sent by the remote control is received, and a trajectory line is generated according to the received pointing parameter.

[0017] The above technical solution, on the one hand, configures a screenshot control in the remote control, which provides convenience for users to take screenshots of the pages displayed on the display device; on the other hand, based on the length of time the user presses the screenshot control, two screenshot methods are provided, namely, a full-screen screenshot of the currently displayed page in a short press scenario (the timing duration exceeds the preset duration, and a lift event representing the lifting of the screenshot control is detected within the timing duration), and a circled screenshot of the currently displayed page in a long press scenario (the timing duration exceeds the preset duration, and no lift event representing the lifting of the screenshot control is detected within the timing duration). This not only expands the screenshot scenarios of the display device, but also further improves the user experience.

[0018] In some embodiments, when the timing duration exceeds a preset duration and no lift event indicating that the screenshot control is lifted is detected within the timing duration, the controller receives the pointing parameters sent by the remote control and generates a trajectory line based on the received pointing parameters, and is configured to:

[0019] Reading a status parameter representing the switch status of the pointing switch of the remote controller from the local device;

[0020] When the timing duration exceeds the preset duration, no lift event indicating that the screenshot control is lifted is detected within the timing duration, and the state parameter indicates that the pointing switch is in the on state, the pointing parameter sent by the remote control is received, and a trajectory line is generated based on the received pointing parameter; wherein the pointing switch is a switch on the remote control that controls the sending of the pointing parameter, and when the pointing switch is in the on state, the remote control sends the pointing parameter;

[0021] When the timing duration exceeds the preset duration, no lift event representing the lifting of the screenshot control is heard within the timing duration, and the state parameter represents that the pointing switch is in the off state, the current display page is recorded; wherein, when the pointing switch is in the off state, the remote control does not send the pointing parameter.

[0022] The above technical solution, on the one hand, configures a pointing switch in the remote control, which provides a prerequisite for the smooth operation of the circle selection screenshot function; on the other hand, based on the switch state of the pointing switch, provides two processing methods: screen recording and circle selection screenshot, which not only expands the usage scenarios of the display device, but also improves the user experience.

[0023] In some embodiments, when the controller determines the preset shape area based on the trajectory line, it is configured to:

[0024] Compare the width of the track line in the width direction of the screen and the length of the track line in the length direction of the screen with the first threshold value respectively; wherein the width value is the maximum abscissa difference between the abscissa differences of the track points on the track line, and the length value is the maximum ordinate difference between the ordinate differences of the track points on the track line;

[0025] When the width value is greater than or equal to the first threshold, or the length value is greater than or equal to the first threshold, determining a preset shape area according to the trajectory line;

[0026] When both the width value and the length value are smaller than the first threshold value, a screenshot failure message is output.

[0027] The above technical solution introduces a first threshold to verify the width and length of the track line in the screen width direction to determine whether the track line is valid. Only if the track line is valid can the operation of determining the preset shape area based on the track line be performed. This ensures that the regional image obtained based on the preset shape area contains valid image information, thereby improving the accuracy of image search results. In addition, if the track line is invalid, a screenshot failure message can be output to notify the user, further enhancing the user experience.

[0028] In some embodiments, when the preset shape area is a rectangular area, the controller is configured to:

[0029] When the first value is greater than a first threshold value and the second value is greater than a second threshold value, selecting a minimum abscissa value, a maximum abscissa value, a minimum ordinate value, and a maximum ordinate value from the coordinate data of the track point on the track line; wherein the first threshold value is greater than the second threshold value; wherein the first value is one of a length value and a width value, and the second value is the other of the length value and the width value;

[0030] At least two vertex coordinates are obtained by performing horizontal and vertical combinations according to the minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate and the maximum value of the vertical coordinate; wherein the at least two vertex coordinates are used to represent the rectangular area.

[0031] The above technical solution introduces a second threshold to verify the validity of length / width values ​​less than the first threshold. If the length / width value less than the first threshold is valid, the vertex coordinates of the rectangular area are directly determined based on the minimum horizontal coordinate, maximum horizontal coordinate, minimum vertical coordinate, and maximum vertical coordinate in the coordinate data of the trajectory point. This provides an optional method for quickly determining the rectangular area while ensuring that the subsequently acquired regional image contains valid image information. In addition, this solution presents the area determined by the trajectory line as a rectangle, and its presentation method is compatible with the way the display device presents the page, thereby making the captured regional image more reasonable.

[0032] In some embodiments, when the preset shape area is a rectangular area, the controller is configured to:

[0033] When the first value is greater than the first threshold and the second value is less than the second threshold, at least two vertex coordinates are determined based on the first value, the trajectory point on the trajectory line corresponding to the first value, and the screen aspect ratio of the display device; wherein the aspect ratio of the rectangular area represented by the at least two vertex coordinates is the same as the screen aspect ratio, and the first threshold is greater than the second threshold; the first value is one of the length value and the width value, and the second value is the other of the length value and the width value.

[0034] The above technical solution, by introducing the screen aspect ratio of the display device, does not require the user to manually modify the trajectory line when the value in any direction of the screen is small or invalid. Instead, the rectangular area is determined based on the screen aspect ratio and the value of the trajectory line in the effective screen direction. On the one hand, it can improve the convenience of user selection; on the other hand, it provides an optional method for quickly determining the rectangular area while ensuring that the subsequent acquired area image can contain valid image information. In addition, this solution presents the area determined by the trajectory line as a rectangle, and its presentation method is adapted to the way the display device presents the page, thereby making the captured area image more reasonable.

[0035] In some embodiments, when the preset shape area is a rectangular area, the controller takes a screenshot of the area within the preset shape area on the current display page to obtain the area image, and is configured to:

[0036] When the aspect ratio of the rectangular area is different from the screen aspect ratio of the display device, the rectangular area is modified according to the screen aspect ratio; wherein the aspect ratio of the modified rectangular area is the same as the screen aspect ratio;

[0037] A screenshot is taken of the area within the corrected rectangular area of ​​the current display page to obtain a regional image.

[0038] The above technical solution corrects the rectangular area according to the screen aspect ratio to obtain a regional image with the same aspect ratio as the screen, thereby ensuring the adaptability between the regional image and the current display page, thereby making the captured regional image more reasonable.

[0039] In a second aspect, some embodiments further provide a circle selection screenshot method, applied to a display device, comprising:

[0040] receiving a pointing parameter sent by the remote control and generating a trajectory line according to the received pointing parameter; wherein the pointing parameter changes with the movement of the remote control;

[0041] Determine a preset shape area according to the trajectory line; wherein the preset shape area corresponds to the area represented by the trajectory line;

[0042] Taking a screenshot of the area corresponding to the preset shape area in the current display page to obtain an area image;

[0043] An image search is performed based on the region image to display object information of objects in the region image.

[0044] The above technical solution receives a pointing parameter sent by a remote control that changes with the movement of the remote control, and generates a trajectory line based on the received pointing parameter; then, based on the trajectory line, determines a preset shape area corresponding to the area represented by the trajectory line, and takes a screenshot of the area corresponding to the preset shape area on the current display page to obtain a regional image; then, an image search is performed based on the regional image to display object information of the object in the regional image. Using the above method, in the circling screenshot scenario, no matter what shape of trajectory line the user circles, a preset shape area corresponding to the area represented by the trajectory line can be determined based on the trajectory line, and the current display page can be screenshoted based on the determined preset shape area. On the one hand, since there are no restrictions on the shape or regularity of the trajectory line, the difficulty of circling the screenshot for the user is reduced, the user experience is improved, and the subsequent image search is smoothly carried out, which improves the efficiency of obtaining image search results. On the other hand, since the determined preset shape area corresponds to the areas represented by all the trajectory lines, it can be ensured that the regional image obtained by the screenshot is consistent with the user's actual query requirements, that is, the accuracy of the regional image acquisition is guaranteed, and thus the accuracy of the image search results displayed to the user is guaranteed.

[0045] In a third aspect, some embodiments further provide a circled screenshot device, applied to a display device, comprising:

[0046] A trajectory generation module is configured to receive a pointing parameter sent by the remote controller and generate a trajectory based on the received pointing parameter; wherein the pointing parameter changes with the movement of the remote controller;

[0047] An area determination module is used to determine a preset shape area according to the trajectory line; wherein the preset shape area corresponds to the area represented by the trajectory line;

[0048] A screenshot module is used to take a screenshot of an area corresponding to a preset shape area in the current display page to obtain an area image;

[0049] The image search module is used to perform image search based on the region image to display object information of objects in the region image.

[0050] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the following steps are implemented:

[0051] receiving a pointing parameter sent by the remote control and generating a trajectory line according to the received pointing parameter; wherein the pointing parameter changes with the movement of the remote control;

[0052] Determine a preset shape area according to the trajectory line; wherein the preset shape area corresponds to the area represented by the trajectory line;

[0053] Taking a screenshot of the area corresponding to the preset shape area in the current display page to obtain an area image;

[0054] An image search is performed based on the region image to display object information of objects in the region image.

[0055] The readable storage medium provided by the above embodiment, during the execution of the stored computer program, in the circling screenshot scenario, no matter what shape of trajectory line the user circles, a preset shape area corresponding to the trajectory line representation area can be determined based on the trajectory line, and a screenshot of the current display page can be taken based on the determined preset shape area. On the one hand, since there are no restrictions on the shape and regularity of the trajectory line, the difficulty of the user circling the screenshot is reduced, the user experience is improved, and the subsequent image search is carried out smoothly, which improves the efficiency of obtaining image search results; on the other hand, since the determined preset shape area corresponds to the area represented by all trajectory lines, it can be ensured that the regional image obtained by the screenshot is consistent with the user's actual query requirements, that is, the accuracy of the regional image acquisition is guaranteed, and the accuracy of the image search results displayed to the user is guaranteed.

[0056] In a fifth aspect, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0057] receiving a pointing parameter sent by the remote control and generating a trajectory line according to the received pointing parameter; wherein the pointing parameter changes with the movement of the remote control;

[0058] Determine a preset shape area according to the trajectory line; wherein the preset shape area corresponds to the area represented by the trajectory line;

[0059] Taking a screenshot of the area corresponding to the preset shape area in the current display page to obtain an area image;

[0060] An image search is performed based on the region image to display object information of objects in the region image.

[0061] The computer program provided by the above embodiment, during the execution of the computer program, in the circling and screenshot scenario, no matter what shape of trajectory line the user circles, a preset shape area corresponding to the trajectory line representation area can be determined based on the trajectory line, and a screenshot of the current display page can be taken based on the determined preset shape area. On the one hand, since there are no restrictions on the shape and regularity of the trajectory line, the difficulty of the user circling and screenshot is reduced, the user experience is improved, and the subsequent image search is carried out smoothly, which improves the efficiency of obtaining image search results; on the other hand, since the determined preset shape area corresponds to the area represented by all trajectory lines, it can be ensured that the regional image obtained by the screenshot is consistent with the user's actual query requirements, that is, the accuracy of the regional image acquisition is guaranteed, and the accuracy of the image search results displayed to the user is guaranteed. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the technical solutions in some embodiments or related technologies, the following briefly introduces the drawings required for use in the descriptions of some embodiments or related technologies. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without any creative work.

[0063] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0064] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0065] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0066] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0067] Figure 5 A schematic diagram of a process for circling and taking screenshots provided in some embodiments of the present application;

[0068] Figure 6 A schematic diagram of a process for generating trajectory lines provided in some embodiments of the present application;

[0069] Figure 7 A schematic diagram of a process for generating trajectory lines provided in other embodiments of the present application;

[0070] Figure 8 A schematic diagram of a process for determining a rectangular area provided in some embodiments of the present application;

[0071] Figure 9 A schematic diagram of a process for determining a rectangular area provided in other embodiments of the present application;

[0072] Figure 10 Schematic diagram for determining the rectangular area corresponding to the regular trajectory provided in some embodiments of the present application;

[0073] Figure 11 Schematic diagram for determining the rectangular area corresponding to the irregular trajectory provided in some embodiments of the present application;

[0074] Figure 12 A schematic diagram illustrating determination of a rectangular area corresponding to a trajectory line with invalid width provided in some embodiments of the present application;

[0075] Figure 13 A schematic diagram of the screenshot processing process provided in some embodiments of the present application;

[0076] Figure 14 A schematic diagram of the interaction between various devices in the circle selection and screenshot process provided in other embodiments of the present application;

[0077] Figure 15 A structural block diagram of a circled screenshot device in some embodiments;

[0078] Figure 16 FIG. 1 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0079] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0080] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0081] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0082] The terms "comprise," "comprises," and "having," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0083] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0084] In some embodiments, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes, but is not limited to, a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, and the like.

[0085] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0086] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0087] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0088] The display device 200 can provide a broadcast receiving television function, and can also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol Television (IPTV), etc.

[0089] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0090] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0091] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0092] In some embodiments, the display 260 includes a display component for displaying images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be configured to display video content, image content, menu control interface components, and a user control UI interface.

[0093] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 that includes international wireless local area network standard (Wireless Fidelity, WiFi) functionality. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 that includes Bluetooth functionality.

[0094] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0095] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0096] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0097] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260, and the user input interface receives the user input command through the graphical user interface (GUI).

[0098] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0099] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0100] Figure 3 Some embodiments of this application provide Figure 1 The hardware configuration diagram of the control device in the figure is as follows. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0101] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, playing the role of an interactive intermediary between the user and the display device 200 .

[0102] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0103] In some embodiments, as Figure 1As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0104] The controller 110 includes a processor 112, RAM 113, ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between internal components and the external and internal data processing functions.

[0105] Under the control of the controller 110, the communication interface 130 communicates control signals and data signals with the display device 200. The communication interface 130 may include at least one of a WiFi chip 131, a Bluetooth module 132, an NFC module 133, or other near field communication modules.

[0106] The user input / output interface 140 includes at least one of a microphone 141 , a touch panel 142 , a sensor 143 , a button 144 and other input interfaces.

[0107] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with the communication interface 130, such as a WiFi, Bluetooth, or NFC module, to encode user input commands via the WiFi protocol, Bluetooth protocol, or NFC protocol and transmit them to the display device 200.

[0108] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0109] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0110] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling the hardware and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0111] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0112] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely the application layer (abbreviated as "application layer"), the application framework layer (abbreviated as "framework layer"), the system library layer and the kernel layer.

[0113] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0114] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0115] like Figure 4 As shown, in some embodiments, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0116] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0117] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0118] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 4 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIF1 driver, USB driver, HDM1 driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0119] It should be noted that the above example is only a simple division of the operating system functions and does not limit the specific operating system form of the display device 200 in some embodiments. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0120] With the development of devices (such as smart TVs), some devices have integrated the ability to circle and capture screenshots (or partial or segmented screenshots) to meet users' diverse information needs on the device's displayed interface. For example, a device can capture a portion of the displayed content on the displayed interface and perform a search based on the captured portion of the image, displaying search results for the portion of the image to the user.

[0121] However, in the related art, the device can only identify regular circled areas. When the user circles an irregular area, the device cannot perform screenshot processing, which makes subsequent image search impossible.

[0122] Based on this, in some embodiments, a method for circling and taking screenshots is provided. The method for circling and taking screenshots can be implemented by the cooperation of a display device and a mobile terminal (such as a remote control). In an optional embodiment, the method for circling and taking screenshots is applied to a controller in a display device as an example, wherein the display device includes a display and a controller; the communication connection between the display and the controller can be a wired communication connection or a wireless communication connection. Figure 5 As shown, the specific steps include:

[0123] S510: Receive a pointing parameter sent by a remote controller, and generate a trajectory line according to the received pointing parameter.

[0124] The so-called pointing parameter is used to characterize the pointing situation of the remote control to the current display page displayed by the display device; further, the pointing parameter changes with the movement of the remote control, and may include but is not limited to the position information of the remote control.

[0125] Optionally, the remote control can be a pointing remote control, i.e., a remote control with an integrated pointing device. When the pointing device is turned on, the remote control's position information can be acquired in real time. Pointing parameters are generated based on the remote control's position information. The pointing parameters can then be transmitted to the display device in the form of electrical signals, using infrared or Bluetooth transmission, based on a preset parameter transmission frequency. Upon receiving the pointing parameters, the display device can convert the electrical signals into digital signals and display the position indicated by the pointing parameters as a cursor on the current display page displayed on the display device.

[0126] Alternatively, the remote control can be an air mouse remote control, i.e., a remote control with an integrated gyroscope. Because the air mouse remote control is equipped with a gyroscope, it can sense changes in direction and speed when the user operates the remote control, and generate pointing parameters based on these changes. The pointing parameters are then sent to the display device.

[0127] It is worth noting that the location information contained in the pointing parameter is the longitude and latitude information in the geodetic coordinate system. Therefore, in order to more accurately present the location indicated by the pointing parameter in the current display page, the lower left corner of the current display page can be used as the origin. According to the resolution of the display device (mostly 1920*1080), a two-dimensional plane coordinate system can be determined in the current display page. Then, the longitude and latitude information in the geodetic coordinate system is converted into the horizontal and vertical coordinate information in the plane coordinate system. Among them, the so-called current display page is the page displayed by the display device at the current moment. It can be a playback page or a non-playback page (such as the homepage or query page, etc.).

[0128] A display device can support multiple image processing functions simultaneously, and different image processing functions correspond to different function triggering methods. Specifically, it can include image processing functions such as screen recording, full-screen screenshot, and circle screenshot. For example, the image processing function used by the user can be determined based on the length of time the user presses the screenshot control and / or the open or closed state of the pointing device. The screenshot control is located in the remote control.

[0129] Optionally, when it is determined that the user uses the circle screenshot function based on the user's current trigger method, the display device can convert the position information in the pointing parameter into the coordinate information of the corresponding track point in the current display page through a preset coordinate conversion method, and store the coordinate information of the track point in the track array associated with the current display page.

[0130] Then, based on the order in which the trajectory points in the trajectory array were sent and the coordinate information corresponding to each trajectory point, the coordinate changes between the trajectory points are determined. Then, based on the coordinate changes between the trajectory points, a trajectory line is generated on the current display page. For example, the trajectory points can be connected in the order in which they were sent to generate the trajectory line.

[0131] It's understood that to prevent the circling operation from modifying the displayed page, when executing the aforementioned circling screenshot process, the display device overlays a transparent canvas on the current displayed page and performs the trajectory line generation operation within the transparent canvas. This allows the user to directly see the circling results on the current displayed page without modifying the current displayed page. Furthermore, if the user circling incorrectly, the trajectory line on the transparent canvas can be cleared and the circling screenshot can be taken again.

[0132] For example, when it is detected that a circle selection screenshot process is being executed, a brush can be initialized, and when a new track point is received, the brush is used to depict the position information corresponding to the track point on the transparent canvas, thereby generating a track line; when a circle selection stop event is detected, the current brush will be destroyed, that is, the circle selection operation at this time will be ended.

[0133] S520: Determine a preset shape area according to the trajectory line.

[0134] The so-called preset shape area is the circled area containing all the track lines, that is, the preset shape area corresponds to the area represented by the track lines. Optionally, the preset shape area can be a rectangular area (including a square area, a rectangular area), a circular area, an elliptical area, a triangular area, etc.

[0135] Optionally, a preset shape area can be determined based on the horizontal and vertical coordinate parameters of each coordinate in the trajectory array associated with the trajectory line. It is worth noting that only one preset shape area can be configured to determine the preset shape area corresponding to the area represented by the trajectory line; multiple candidate preset shape areas can also be configured at the same time. Before determining the preset shape area corresponding to the trajectory line, the target preset shape area that best matches the trajectory line can be selected from the multiple candidate preset shape areas based on the selection trend of the trajectory line, thereby determining the preset shape area corresponding to the area represented by the trajectory line.

[0136] For example, when the preset shape area is a rectangle, the minimum abscissa value, the maximum abscissa value, the minimum ordinate value, and the maximum ordinate value can be screened from the horizontal and vertical coordinates of the coordinates of each track point to perform a horizontal and vertical combination to obtain the four vertices of the rectangular area, thereby determining the rectangular area. For example, based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max, the coordinate points (X-min, Y-min), (X-min, Y-max), (X-max, Y-max), and (X-max, Y-max) can be determined, thereby determining the rectangular area based on the above coordinate points.

[0137] For example, if the preset shaped area is a circle, the maximum horizontal and vertical difference values ​​can be determined based on the coordinates of each track point, and the larger of the two values ​​is used as the diameter of the circular area. The center point of the circular area is then determined based on the average horizontal and vertical values ​​of the coordinates of each track point. In this case, an initial circular area can be determined based on the center point and diameter of the circular area.

[0138] Furthermore, it is determined whether the initial circular area completely contains all the trajectory points. If so, the initial circular area is directly used as the determined circular area; if not, the initial circular area is expanded based on the center of the circle until the initial circular area contains all the trajectory points, thereby determining the circular area.

[0139] Alternatively, the trajectory line is input into a trained preset shape region determination model, and the preset shape region determination model determines and outputs the preset shape region based on the position information of the trajectory line and model parameters.

[0140] It's worth noting that no matter what shape the user circles, a pre-defined area containing all the track lines can be determined based on the track lines. Furthermore, since there are no restrictions on the shape or regularity of the track lines, this step simplifies the difficulty of circling the screenshot, improves the user experience, and ensures smooth subsequent image searches.

[0141] It is understood that, to facilitate subsequent image search operations, when determining the preset shape area, the preset shape area can also be optimized based on the page type of the currently displayed page. If the page type of the currently displayed page is a play page, since the play page does not include page controls, the above method can be used to determine the preset shape area based solely on the trajectory line.

[0142] In the case where the page type of the currently displayed page is a non-playing page, since there are multiple page controls (which may include image controls and text controls) in the non-playing page, in order to improve the accuracy of the image search, the page controls can be used as auxiliary information for the image search. Specifically, the track-related controls associated with the track line can be determined based on the position information of the track line, and then the preset shape area containing both the track line and the track-related controls can be determined based on the coordinate information of the track-related controls on the currently displayed page and the position information of the track line. Among them, only the page controls located on the track line and within the track line can be used as track-related controls; the page controls associated with the images within the track line can also be used as track-related controls, and there is no restriction on this.

[0143] S530: Take a screenshot of an area corresponding to a preset shape area in the current display page to obtain an area image.

[0144] The so-called regional image is the image in the corresponding preset shape area in the current display page.

[0145] Optionally, a screenshot of the area corresponding to the preset shape area on the current display page may be taken based on the coordinate information of the preset shape area, thereby obtaining a regional image. For example, if the preset shape area is a rectangular area, a screenshot of the area corresponding to the rectangular area on the current display page may be taken based on the coordinate information of the rectangular area, thereby obtaining a regional image.

[0146] In some embodiments, when the preset shape area is a rectangular area, to ensure compatibility between the image area and the displayed page, a screenshot of the image framed by the rectangular area on the current display page can be taken to obtain the original image, which can then be optimized based on the aspect ratio of the displayed page to obtain the regional image. For example, when the aspect ratio of the displayed page is 16:9, the original image can be adjusted to a regional image with an aspect ratio of 16:9 without modifying the image length; or the original image can be adjusted to a regional image with an aspect ratio of 16:9 without modifying the image width.

[0147] S540: Perform image search based on the region image to display object information of objects in the region image.

[0148] The so-called object information is information related to the objects contained in the regional image. Furthermore, the objects may be animals, plants, characters played by actors, daily products, and other objects that can be displayed in the form of images.

[0149] Optionally, an image acquisition path corresponding to the regional image can be generated based on the device identification information of the display device; the regional image and the image acquisition path of the regional image can then be uploaded simultaneously to an image recognition system in the cloud associated with the display device. To improve image upload efficiency, the regional image can be compressed before uploading, and the resulting compressed image and the image acquisition path of the regional image can be uploaded to the image recognition system.

[0150] After acquiring a regional image, the image recognition system can identify the regional image and, based on the image acquisition path, feed the recognition results as object information of the objects in the regional image back to the display device. For example, the image recognition system can segment the regional image based on the image features in the regional image to obtain the objects contained in each sub-image. Then, for each object contained in the sub-image, the object can be used as index information to perform a consistency match on the object among various standard objects contained in a predetermined image library, and the object information corresponding to the standard object with the highest degree of match is used as the object information of the object. After acquiring the object information of the objects contained in each sub-image, the object information is simultaneously fed back to the display device.

[0151] Alternatively, an image search may be performed directly on the regional image in the locally stored image information to obtain object information of the objects in the regional image.

[0152] Optionally, after obtaining the object information, the display device may determine an information display floating layer on the current display page and display the object information at a preset display position. Alternatively, the display device may display the object information on the information display floating layer based on the position information of each object in the display area image. For example, if there is only one object in the area image, the object information of the object is directly displayed on the information display floating layer. If there are multiple objects in the area image, the object information of each object may be displayed sequentially in the information display floating layer based on the position arrangement of the objects.

[0153] The above technical solution receives a pointing parameter sent by a remote control that changes with the movement of the remote control, and generates a trajectory line based on the received pointing parameter; then, based on the trajectory line, determines a preset shape area that includes any trajectory point on the trajectory line, and takes a screenshot of the area corresponding to the preset shape area on the current display page to obtain a regional image; then, an image search is performed based on the regional image to display object information of the object in the regional image. Using the above method, in the circled screenshot scenario, regardless of the shape of the trajectory line selected by the user, a preset shape area that includes all the trajectory lines can be determined based on the trajectory line, and the current display page can be screenshoted based on the determined preset shape area. On the one hand, because there are no restrictions on the shape or regularity of the trajectory line, the difficulty of the user's circled screenshot is reduced, the user experience is improved, and the subsequent image search is smoothly carried out, which improves the efficiency of obtaining image search results. On the other hand, because the determined preset shape area includes all the trajectory lines, it can be guaranteed that the regional image obtained by the screenshot is consistent with the user's actual query requirements, that is, the accuracy of the regional image acquisition is guaranteed, and thus the accuracy of the image search results displayed to the user is guaranteed.

[0154] Based on the above embodiments, in some embodiments, the process of generating the trajectory line is refined, such as Figure 6 As shown, the specific steps include:

[0155] S610: Execute a timing operation in response to a press event for a screenshot control sent by the remote controller.

[0156] Among them, the so-called screenshot control is a control that can enable the screenshot function in the display device; the so-called press event is an indication event sent to the display device when the user presses the screenshot control, which may include the timestamp when the user presses the screenshot control.

[0157] It is understandable that in order to facilitate the display device to distinguish the user's image processing requirements, the corresponding function triggering method can be pre-configured for each image processing function based on the pressing duration of the screenshot control, so as to determine the corresponding image processing method based on the user's triggering method.

[0158] Optionally, when the remote controller detects that the user has pressed the screenshot control on the remote controller, it can continuously send timing parameters to the display device. When the display device detects the timing parameters, it records the start timestamp of the timing parameters and triggers the timing operation.

[0159] S620: When a lift event indicating that the screenshot control is lifted is monitored and the timing duration does not exceed a preset duration, a full-screen screenshot of the current display page is taken.

[0160] Among them, the so-called lift event is the indication event corresponding to when the user releases the screenshot control; the so-called timing duration is used to measure the length of the press event. Furthermore, when the duration of the press event exceeds or is equal to the timing duration, it is determined that the user long presses the screenshot control. When the duration of the press event does not exceed the timing duration, it is determined that the user short presses the screenshot control.

[0161] It is understandable that in order to improve the efficiency of full-screen screenshot, the triggering method of full-screen screenshot can be configured as pressing the screenshot control for a short period of time. Among them, the so-called full-screen screenshot is an image obtained by taking a screenshot of the entire current display page.

[0162] Optionally, the remote control can stop sending timing parameters to the display device when it detects that the user has released the screenshot control on the remote control (i.e., the screenshot control is lifted). When the display device no longer detects the timing parameters, it is considered to have detected a lift event indicating that the screenshot control has been lifted. At this time, the display device records the stop timestamp when it stopped receiving the timing parameters.

[0163] Alternatively, you can continuously monitor changes in the press parameter corresponding to the press event, and deem changes in the press parameter to be a lift event indicating that the screenshot control has been lifted. For example, when the user presses the screenshot control, the press parameter is 100, and when the user releases the screenshot control, the press parameter is 85. That is, if the received press parameter is 100, it proves that the user has continued to press the screenshot control, and when the received press parameter changes to 85, a lift event has been monitored.

[0164] In an optional embodiment, when a lift event representing the lifting of a screenshot control is monitored and the timing duration does not exceed a preset duration, it proves that the user short-pressed the screenshot control. At this time, the full-screen screenshot processing logic will be triggered, and a full-screen screenshot will be taken of the currently displayed page, thereby obtaining a full-screen image.

[0165] Furthermore, after obtaining the full-screen image, an image acquisition path for the full-screen image can be generated based on the device identification information of the display device. The compressed full-screen image and the image acquisition paths of the regional images can then be simultaneously uploaded to an image recognition system associated with the display device. After acquiring the full-screen image, the image recognition system can identify the full-screen image and, based on the image acquisition path, feed the recognition result back to the display device as object information of the object in the full-screen image. After acquiring the object information, the display device can determine an information display overlay on the current display page and display the object information at a preset display location.

[0166] S630: When the timing duration exceeds the preset duration and no lift event indicating that the screenshot control is lifted is detected within the timing duration, receiving a pointing parameter sent by the remote control, and generating a trajectory line according to the received pointing parameter.

[0167] It is understandable that since it takes a long time to circle the screenshot, the triggering method of circle the screenshot can be configured to press the screenshot control for a long time.

[0168] Optionally, if the timing duration exceeds the preset duration and no lift event representing the lifting of the screenshot control is detected within the timing duration, it proves that the user has long pressed the screenshot control. At this time, the processing logic for circling the screenshot will be triggered, thereby receiving the pointing parameters sent by the remote control, and after converting the pointing parameters into trajectory points, the trajectory line is determined based on the coordinate information of the trajectory points.

[0169] It's worth noting that to ensure the accuracy of trajectory generation in circled screenshots, the pointing parameters sent by the remote control are also acquired and stored before the user's request for a circled screenshot is confirmed. After the circled screenshot processing logic is triggered, the trajectory is generated based on the already acquired pointing parameters and the pointing parameters acquired in real time. Referring to steps S520 and S530 above, after determining the preset shape area based on the coordinate information of each track point in the trajectory, a screenshot of the area corresponding to the preset shape area on the current display page can be taken to obtain a regional image. The processing logic for image search based on the regional image is then executed.

[0170] The above technical solution, on the one hand, configures a screenshot control in the remote control, which provides convenience for users to take screenshots of the pages displayed on the display device; on the other hand, based on the length of time the user presses the screenshot control, two screenshot methods are provided, namely, a full-screen screenshot of the currently displayed page in a short press scenario (the timing duration exceeds the preset duration, and a lift event representing the lifting of the screenshot control is detected within the timing duration), and a circled screenshot of the currently displayed page in a long press scenario (the timing duration exceeds the preset duration, and no lift event representing the lifting of the screenshot control is detected within the timing duration). This not only expands the screenshot scenarios of the display device, but also further improves the user experience.

[0171] Based on the above embodiments, in some embodiments, the process of generating the trajectory line is further refined, such as Figure 7 As shown, the specific steps include:

[0172] S710: Read a state parameter representing the switch state of a pointing switch of the remote controller from a local device.

[0173] The so-called pointing switch is a switch on the remote control that controls the transmission of pointing parameters. Furthermore, when the pointing device is turned on, the remote control can send pointing parameters to the display device, and when the pointing device is turned off, the remote control cannot send pointing parameters to the display device. The so-called state parameter is a string that can represent the switch state. For example, a state parameter of 1 indicates that the pointing switch is on, and a state parameter of 0 indicates that the pointing switch is off.

[0174] Optionally, the user can change the state of the pointing switch by triggering it on the remote control. When the state of the pointing switch changes, the remote control sends a status update request containing the current state parameters of the pointing switch to the display device. Upon receiving the status update request, the display device stores the current state parameters locally.

[0175] It is understood that whether the remote control can send pointing parameters to the display device is related to the image processing mode triggered by the display device. Therefore, in response to the press event sent by the remote control for the screenshot control, the state parameter representing the on / off state of the remote control's pointing switch can be obtained from the locally stored information.

[0176] It is worth noting that when the pointing switch is on, the remote control can send pointing parameters to the display device regardless of whether the user presses the screenshot control. However, the pointing parameters at this time will not constitute a trajectory line, but will be presented in the form of a moving cursor.

[0177] S720, when the timing duration exceeds the preset duration, no lift event representing the lifting of the screenshot control is detected within the timing duration, and the state parameter represents that the pointing switch is in the on state, receiving the pointing parameter sent by the remote control, and generating a trajectory line based on the received pointing parameter.

[0178] When the pointing switch is in the on state, the remote controller sends the pointing parameter.

[0179] It is understandable that when the pointing switch is on, the remote control sends the pointing parameters. At this time, the display device can execute the processing logic of circling the screenshot based on the pointing parameters.

[0180] Optionally, if the timing duration exceeds a preset duration, no lift event indicating that the screenshot control has been lifted is detected within the timing duration, and the state parameter indicates that the pointing switch is on, the pointing parameter sent by the remote control is received, and a trajectory line is generated based on the trajectory points corresponding to the pointing parameter. Subsequently, referring to steps S520 and S530 above, after determining the preset shape area based on the coordinate information of each trajectory point in the trajectory line, a screenshot can be taken of the area corresponding to the preset shape area on the current display page to obtain an area image.

[0181] Based on the device identification information of the display device, an image acquisition path for the regional image is generated. The compressed regional image and the image acquisition path are then uploaded simultaneously to the image recognition system associated with the display device. After acquiring the regional image, the image recognition system can identify the regional image and, based on the image acquisition path, feed the recognition result as object information of the object in the regional image back to the display device. After acquiring the object information, the display device can determine an information display overlay on the current display page and display the object information at the preset display location.

[0182] S730: When the timing duration exceeds the preset duration, no lift event indicating that the screenshot control is lifted is detected within the timing duration, and the state parameter indicates that the switch is in the off state, the current display page is recorded.

[0183] It is understandable that when the pointing switch is in the off state, the remote control will not send the pointing parameter to the display device, that is, the display device cannot execute the processing logic of circling the screenshot. At this time, the screen recording processing logic can be configured for the display device. That is, when the timing duration exceeds the preset duration, no lift event representing the lifting of the screenshot control is heard within the timing duration, and the state parameter represents that the pointing switch is in the off state, the display device will trigger the screen recording processing logic, record the current display page, and obtain the screen recording result. The screen recording result is then stored locally for subsequent processing such as screen recording and sending by subsequent users.

[0184] The above technical solution, on the one hand, configures a pointing switch in the remote control, which provides a prerequisite for the smooth operation of the circle selection screenshot function; on the other hand, based on the switch state of the pointing switch, provides two processing methods: screen recording and circle selection screenshot, which not only expands the usage scenarios of the display device, but also improves the user experience.

[0185] Furthermore, based on the above embodiment, the image processing logic can also be determined based solely on the state parameters of the switch state. Specifically, the state parameters representing the switch state of the remote control's pointing switch are read locally; if the state parameters indicate that the pointing switch is in the off state, the current displayed page is recorded; if the state parameters indicate that the pointing switch is in the on state, the pointing parameters sent by the remote control are received, and a trajectory line is generated based on the received pointing parameters.

[0186] In order to ensure the accuracy of determining the preset shape area, based on the above embodiments, in some embodiments, the process of determining the preset shape area is refined, such as Figure 8 As shown, the specific steps include:

[0187] S810 : Compare the width value of the track line in the width direction of the screen and the length value of the track line in the length direction of the screen with a first threshold value respectively.

[0188] The width value is the maximum horizontal coordinate difference between the horizontal coordinate differences between the track points on the track line, and the length value is the maximum vertical coordinate difference between the vertical coordinate differences between the track points on the track line. For example, if the coordinate unit in the current display page is pixel, for the horizontal coordinates x1, x2, and x3, the difference between x1 and x2 is 5 pixels, the difference between x1 and x3 is 10 pixels, and the difference between x2 and x3 is 5 pixels, then the width value is 10 pixels; for the vertical coordinates y1, y2, and y3, the difference between y1 and y2 is 4 pixels, the difference between y1 and y3 is 10 pixels, and the difference between y2 and y3 is 6 pixels, then the length value is 10 pixels.

[0189] The so-called first threshold is a value used to determine whether the trajectory line is valid. For example, the first threshold can be 100 pixels. In some embodiments, the first threshold can be set based on the experience of those skilled in the art or determined based on a large amount of experimental data, without limitation.

[0190] It is understandable that in actual applications, there may be a problem that the user's non-standard circle selection may result in a shorter circle length in a certain direction, which will cause the determined preset shape area to be smaller, and thus the accuracy of the image search results cannot be guaranteed.

[0191] Based on this, in order to ensure the rationality of the preset shape area determination, the width value of the trajectory line in the screen width direction and the length value in the screen length direction can be compared with the first threshold value respectively, and the subsequent preset shape area determination processing can be performed according to the comparison results.

[0192] S820: When the width value is greater than or equal to the first threshold, or the length value is greater than or equal to the first threshold, determine a preset shape area according to the trajectory line.

[0193] It is understood that the width value being greater than or equal to the first threshold, or the length value being greater than or equal to the first threshold, can include two situations: both the width value and the length value being greater than or equal to the first threshold, and only one of the width value and the length value being greater than or equal to the first threshold. In both cases, the area selected by the user is valid.

[0194] Optionally, when the width and length values ​​of the trajectory line are both greater than or equal to the first threshold, it proves that the area selected by the user is valid in both length and width directions. At this time, the preset shape area can be determined directly based on the coordinate information of each trajectory point in the trajectory line.

[0195] If either the width or length of the trajectory line is less than a first threshold, further verification can be performed to determine whether the length / width value less than the first threshold is valid. If the length / width value less than the first threshold is valid, the predetermined shape region can still be determined based on the trajectory line. If the length / width value less than the first threshold is invalid, the length / width value less than the first threshold needs to be optimized to determine the predetermined shape region. For example, the length / width value less than the first threshold can be replaced with a predetermined valid length to determine the predetermined shape region.

[0196] S830: When both the width value and the length value are smaller than the first threshold value, output screenshot failure information.

[0197] Among them, the so-called screenshot failure information is the prompt information displayed by the display device when the screenshot fails, which may include but is not limited to information such as the reason for the screenshot failure.

[0198] Optionally, if both the width and length of the track line are less than the first threshold, it indicates that the area selected by the user is too small and the selected area is invalid. The display device may then display a pop-up window on the current display page and display a screenshot failure message in the form of text in the pop-up window. For example, the pop-up window may display text such as "The selected area is too small. Please reselect."

[0199] The above technical solution introduces a first threshold to verify the width and length of the track line in the screen width direction to determine whether the track line is valid. Only if the track line is valid can the operation of determining the preset shape area based on the track line be performed. This ensures that the regional image obtained based on the preset shape area contains valid image information, thereby improving the accuracy of image search results. In addition, if the track line is invalid, a screenshot failure message can be output to notify the user, further enhancing the user experience.

[0200] In the case where the preset shape area is a rectangular area, in order to ensure the accuracy of the rectangular area determination, based on the above embodiment, in some embodiments, the rectangular area determination process is further refined, such as Figure 9 As shown, the specific steps include:

[0201] S910 , when the first value is greater than the first threshold and the second value is greater than the second threshold, selecting the minimum abscissa value, the maximum abscissa value, the minimum ordinate value, and the maximum ordinate value from the coordinate data of the track point on the track line.

[0202] The first value is one of the length and width, and the second value is the other of the length and width. The first threshold is greater than the second threshold. Furthermore, the second threshold is a value used to determine whether the length and width of the trajectory are valid. For example, the second threshold can be 20 pixels. In some embodiments, the second threshold can be set based on the experience of those skilled in the art or determined based on a large amount of experimental data, without limitation.

[0203] The first value is greater than the second value. For example, when the length value is greater than the width value, the length value is the first value and the width value is the second value; when the width value is greater than the length value, the width value is the first value and the length value is the second value.

[0204] Optionally, when the first value of the length value and the width value is greater than the first threshold and the second value is greater than the second threshold, it is proved that both the length value and the width value are valid. At this time, the minimum horizontal coordinate value, the maximum horizontal coordinate value, the minimum vertical coordinate value and the maximum vertical coordinate value can be filtered out from the coordinate data of each track point in the track line.

[0205] It is worth noting that the second value of the length and width being greater than the second threshold also includes the second value of the length and width being greater than the first threshold. Therefore, in both cases, step S920 can be executed if both the length and width are greater than the first threshold, or if the first value of the length and width is greater than the first threshold and the second value is between the first and second thresholds.

[0206] S920 , performing horizontal and vertical combinations according to the minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate, and the maximum value of the vertical coordinate to obtain at least two vertex coordinates.

[0207] Wherein, at least two vertex coordinates are used to represent the rectangular area.

[0208] Optionally, after combining the minimum abscissa value, the maximum abscissa value, the minimum ordinate value, and the maximum ordinate value horizontally and vertically, at least two vertex coordinates may be obtained; and then, a rectangular area may be determined based on the obtained vertex coordinates.

[0209] It is understood that when only two vertex coordinates are determined, the two vertex coordinates must be diagonal coordinates. For example, when only two vertex coordinates are determined based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max, the two vertex coordinates can be (X-min, Y-min) and (X-max, Y-max), or (X-min, Y-max) and (X-max, Y-max).

[0210] For example, reference Figure 10Schematic diagram of determining the rectangular area corresponding to the regular trajectory line shown. When the width and length values ​​of trajectory line 1 are both greater than the first threshold, the coordinate points (X-min, Y-min) and (X-max, Y-max) can be directly determined based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max in trajectory line 1, thereby determining rectangular area 2 based on the above coordinate points.

[0211] It is understandable that, when the first value of the width and length of the track line is greater than the first threshold value, and the second value is greater than the second threshold value, if the track line is an intersecting irregular curve, the rectangular area can also be determined based on the extreme values ​​of the horizontal and vertical coordinates of the track points. Figure 11 Schematic diagram of determining the rectangular area corresponding to the irregular trajectory line shown. When the width and length values ​​of the trajectory line 3 are both greater than the first threshold, the coordinate points (X-min, Y-min) and (X-max, Y-max) can be directly determined based on the minimum abscissa value X-min, the maximum abscissa value X-max, the minimum ordinate value Y-min, and the maximum ordinate value Y-max in the trajectory line 3, thereby determining the rectangular area 4 based on the above coordinate points.

[0212] The above technical solution introduces a second threshold to verify the validity of length / width values ​​less than the first threshold. If the length / width value less than the first threshold is valid, the vertex coordinates of the rectangular area are directly determined based on the minimum horizontal coordinate, maximum horizontal coordinate, minimum vertical coordinate, and maximum vertical coordinate in the coordinate data of the trajectory point. This provides an optional method for quickly determining the rectangular area while ensuring that the subsequently acquired regional image contains valid image information. In addition, this solution presents the area determined by the trajectory line as a rectangle, and its presentation method is compatible with the way the display device presents the page, thereby making the captured regional image more reasonable.

[0213] When the preset shape area is a rectangular area, based on the above embodiments, in some embodiments, another optional method for determining vertex coordinates is provided. Specifically, when the first value is greater than the first threshold and the second value is less than the second threshold, at least two vertex coordinates are determined based on the first value, the trajectory point on the trajectory line corresponding to the first value, and the screen aspect ratio of the display device.

[0214] The first value is one of the length and width, and the second value is the other of the length and width. The so-called screen aspect ratio is the proportional relationship between the screen length and screen width, which can be the ratio between the length and width of the currently displayed page. The aspect ratio of the rectangular area represented by at least two vertex coordinates is the same as the screen aspect ratio, and the first threshold is greater than the second threshold. If the second value of the length and width is less than the second threshold, the length / width value of the trajectory line that is less than the second threshold is invalid, that is, the length / width of the selected area is invalid.

[0215] In an optional embodiment, the target value can be calculated based on the valid values ​​of the length value and the width value, and the screen aspect ratio of the display device. Exemplarily, when the length value of the trajectory line is invalid, the optimized length value can be calculated based on the width value and the screen aspect ratio. For example, when the length value of the trajectory line is 10 pixels, the width value is 90 pixels, and the screen aspect ratio is 16:9, the optimized length value can be calculated to be 160 pixels. When the width value of the trajectory line is invalid, the optimized width value can be calculated based on the length value and the screen aspect ratio. For example, when the width value of the trajectory line is 10 pixels, the length value is 160 pixels, and the screen aspect ratio is 16:9, the optimized width value can be calculated to be 90 pixels.

[0216] Next, the corresponding expansion direction is determined based on the selected direction of the trajectory line, and the selected area is expanded according to the corresponding expansion direction to obtain the expanded selected area. If the trajectory line is a straight line, the expansion direction cannot be determined. In this case, the image richness on both sides of the trajectory line can be used as the expansion direction.

[0217] For example, if the width value is valid and the length value is invalid, an initial selected area can be determined based on the current width and length values. Then, based on the trajectory line's selection direction, a length extension direction for the initial selected area is determined, and the length of the initial selected area is extended to a target value in the length extension direction, thereby obtaining an extended selected area. Alternatively, if the length value is valid and the width value is invalid, an initial selected area can be determined based on the current width and length values. Then, based on the trajectory line's selection direction, a width extension direction for the initial selected area is determined, and the width of the initial selected area is extended to a target value in the width extension direction, thereby obtaining an extended selected area.

[0218] Optionally, after the expanded selected area is determined, the minimum horizontal coordinate value, the maximum horizontal coordinate value, the minimum vertical coordinate value, and the maximum vertical coordinate value in the expanded selected area may be combined horizontally and vertically to obtain at least two vertex coordinates.

[0219] For example, refer to Figure 12 Schematic diagram of determining the rectangular area corresponding to a track line with an invalid width. An initial rectangle 6 can be determined to completely encompass track line 5. In this case, the width of initial rectangle 6 is invalid. Based on the direction of the selected track line 5, the expansion direction of initial rectangle 6 can be determined to be downward. In this case, an optimized width value can be calculated based on the length of initial rectangle 6 and the screen aspect ratio. The width of initial rectangle 6 is then extended downward to the optimized width value, thereby forming rectangular area 7.

[0220] In another optional embodiment, a standard rectangular area can be determined based on the screen aspect ratio, and based on the coordinate values ​​of each trajectory coordinate in the trajectory line, two coordinate points corresponding to the first value can be determined; then, based on the two coordinate points, the standard rectangular area is scaled so that the length of one side in the scaled standard rectangular area is the first value, and the scaled standard rectangular area contains the trajectory line, thereby obtaining a rectangular area.

[0221] The above technical solution, by introducing the screen aspect ratio of the display device, does not require the user to manually modify the trajectory line when the value in any direction of the screen is small or invalid. Instead, the rectangular area is determined based on the screen aspect ratio and the value of the trajectory line in the effective screen direction. On the one hand, it can improve the convenience of user selection; on the other hand, it provides an optional method for quickly determining the rectangular area while ensuring that the subsequent acquired area image can contain valid image information. In addition, this solution presents the area determined by the trajectory line as a rectangle, and its presentation method is adapted to the way the display device presents the page, thereby making the captured area image more reasonable.

[0222] In the case where the preset shape area is a rectangular area, based on the above embodiment, in some embodiments, the screenshot processing process is further refined, such as Figure 13 As shown, the specific steps include:

[0223] S1310 : When the aspect ratio of the rectangular area is different from the screen aspect ratio of the display device, correct the rectangular area according to the screen aspect ratio.

[0224] The aspect ratio of the modified rectangular area is the same as the aspect ratio of the screen.

[0225] Optionally, after determining the rectangular area, you can first determine the aspect ratio of the rectangular area, and compare the aspect ratio of the rectangular area with the screen aspect ratio. When the aspect ratio of the rectangular area and the screen aspect ratio are the same, you can directly take a screenshot of the area corresponding to the rectangular area in the current display page to obtain the area image; when the aspect ratio of the rectangular area and the screen aspect ratio are different, the rectangular area needs to be corrected according to the screen aspect ratio.

[0226] For example, when the aspect ratio of the rectangular area is greater than the aspect ratio of the screen, the length of the rectangular area can be shortened based on the center point of the rectangular area, so that the aspect ratio of the modified rectangular area is the same as the aspect ratio of the screen; when the aspect ratio of the rectangular area is less than the aspect ratio of the screen, the width of the rectangular area can be shortened based on the center point of the rectangular area, so that the aspect ratio of the modified rectangular area is the same as the aspect ratio of the screen.

[0227] For example, if the aspect ratio of the rectangular region is 16:10, the screen aspect ratio is 16:9, and the width of the rectangular region is 100 pixels, the width of the rectangular region needs to be reduced. That is, the width needs to be reduced by 10 pixels without changing the length of the rectangular region. In this case, the center point of the rectangular region can be used as the reference point, and both sides can be simultaneously contracted inward by 5 pixels to obtain the modified rectangular region.

[0228] S1320: Take a screenshot of the area within the corrected rectangular area in the current display page to obtain a regional image.

[0229] Optionally, a screenshot may be taken of an area within the corrected rectangular area of ​​the current display page, thereby obtaining an area image having the same aspect ratio as the screen aspect ratio.

[0230] The above technical solution corrects the rectangular area according to the screen aspect ratio to obtain a regional image with the same aspect ratio as the screen, thereby ensuring the adaptability between the regional image and the current display page, thereby making the captured regional image more reasonable.

[0231] Based on the technical solutions of the above embodiments, an optional embodiment is provided when the display device includes a television system and functional applications, and the preset shape area is a rectangular area. Figure 14 The diagram below shows the interaction between devices during the circled screenshot process, including:

[0232] S1401: When the remote control detects a user pressing operation on the screenshot space, the remote control sends a pressing event on the screenshot control to the television system.

[0233] S1402: After receiving the pressing event, the television system sends a start instruction to the screenshot application to instruct the screenshot application to perform a timing operation.

[0234] S1403: When the timing duration exceeds the preset duration and a lift event indicating that the screenshot control is lifted is detected within the timing duration, the screenshot application sends a full-screen screenshot instruction to the television system.

[0235] S1404: The television system takes a full-screen screenshot of the current display page to obtain a target screenshot, and executes S1414.

[0236] S1405: When the timing duration exceeds the preset duration and no lift event indicating that the screenshot control is lifted is detected within the timing duration, the screenshot application sends a switch status acquisition request to the television system.

[0237] S1406: The television system reads a state parameter representing the switch state of the pointing switch of the remote controller from the local computer, and feeds back the state parameter to the screenshot application.

[0238] S1407, the screenshot application determines whether the pointing switch is on according to the state parameter. If not, execute S1408; if so, execute

[0239] S1408: The screenshot application sends a screen recording instruction to the television system to instruct the television system to record the current display page.

[0240] S1409: The remote control continues to send the pointing parameter to the television system to instruct the television system to send the pointing parameter to the screenshot application.

[0241] S1410: The screenshot application receives the pointing parameters sent by the remote control, and generates a trajectory line according to the received pointing parameters when a lift event is detected.

[0242] S1411, the screenshot application determines a rectangular area according to the trajectory line, and sends a circle screenshot instruction containing coordinate information of the rectangular area to the television system.

[0243] S1412: The television system takes a screenshot of the current display page according to the rectangular area coordinate information to obtain a target screenshot.

[0244] S1413: The television system sends the target screenshot and the screenshot acquisition path of the target screenshot to the screenshot application.

[0245] S1414, the screenshot application uploads the target screenshot and the screenshot acquisition path to the image recognition system.

[0246] S1415 , the image recognition system performs an image search based on the target screenshot to determine object information of the object in the target screenshot, and feeds back the object information of the object in the target screenshot to the screenshot application based on the screenshot acquisition path.

[0247] S1416 , the screenshot application sends the object information of the object in the target screenshot to the television system, so that the object information is displayed on the television system.

[0248] It should be noted that if the remote control's pointing switch is on, the remote control can periodically send pointing parameters to the television system. That is, if the user presses the screenshot control on the remote control and the pointing switch is on, the remote control can include the pointing parameters when sending the screenshot control press event to the television system, i.e., in S1401. The above embodiment describes the remote control sending pointing parameters to the television system in S1409, but this does not mean that the remote control has not sent pointing parameters to the television system before S1409. This is merely an example.

[0249] Furthermore, the specific process of the above S1401-S1416 can be found in the description of the above method embodiment. The implementation principles and technical effects are similar and will not be repeated here.

[0250] Based on the same inventive concept, some embodiments further provide a circled screenshot device for implementing the circled screenshot method described above. The solution provided by this device is similar to the solution described in the method described above. Therefore, the specific limitations of one or more embodiments of the circled screenshot device provided below can be found in the limitations of the circled screenshot method described above and will not be further elaborated here.

[0251] In an exemplary embodiment, Figure 15 As shown, a circle selection screenshot device 1 is provided, which is configured on a management server and includes: a trajectory line generation module 10, an area determination module 20, a screenshot module 30 and an image search module 40, wherein:

[0252] The trajectory generation module 10 is configured to receive the pointing parameters sent by the remote controller and generate a trajectory based on the received pointing parameters, wherein the pointing parameters vary with the movement of the remote controller;

[0253] The region determination module 20 is configured to determine a region of a preset shape according to the trajectory line; wherein the region of the preset shape corresponds to the region represented by the trajectory line;

[0254] A screenshot module 30 is used to take a screenshot of an area corresponding to a preset shape area in the current display page to obtain an area image;

[0255] The image search module 40 is configured to perform an image search based on the region image to display object information of objects in the region image.

[0256] In an exemplary embodiment, the trajectory line generation module 10 is specifically used to: perform a timing operation in response to a press event for a screenshot control sent by a remote control; take a full-screen screenshot of the current display page when a lift event representing the lifting of the screenshot control is detected and the timing duration does not exceed a preset duration; receive pointing parameters sent by the remote control and generate a trajectory line based on the received pointing parameters when the timing duration exceeds the preset duration and no lift event representing the lifting of the screenshot control is detected within the timing duration.

[0257] In an exemplary embodiment, the trajectory line generation module 10 is also used to: read the status parameters representing the switch state of the pointing switch of the remote control from the local; when the timing time exceeds the preset time, no lift event representing the lifting of the screenshot control is detected within the timing time, and the status parameter represents that the pointing switch is in the on state, receive the pointing parameters sent by the remote control, and generate a trajectory line based on the received pointing parameters; wherein, when the pointing switch is in the on state, the remote control sends the pointing parameters; when the timing time exceeds the preset time, no lift event representing the lifting of the screenshot control is detected within the timing time, and the status parameter represents that the pointing switch is in the off state, record the current display page; wherein, the pointing switch is a switch on the remote control that controls the sending of pointing parameters, and when the pointing switch is in the off state, the remote control does not send pointing parameters.

[0258] In an exemplary embodiment, the area determination module 20 is specifically used to: compare the width value of the trajectory line in the width direction of the screen and the length value in the length direction of the screen with a first threshold value respectively; wherein the width value is the maximum horizontal coordinate difference between the horizontal coordinate differences of the trajectory points on the trajectory line, and the length value is the maximum vertical coordinate difference between the vertical coordinate differences of the trajectory points on the trajectory line; when the width value is greater than or equal to the first threshold value, or the length value is greater than or equal to the first threshold value, determine a preset shape area according to the trajectory line; when both the width value and the length value are less than the first threshold value, output a screenshot failure message.

[0259] In an exemplary embodiment, when the preset shape area is a rectangular area, the area determination module 20 is also used to: when the first value is greater than the first threshold and the second value is greater than the second threshold, select the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate from the coordinate data of the trajectory point on the trajectory line; wherein the first threshold is greater than the second threshold; wherein the first value is one of the length value and the width value, and the second value is the other of the length value and the width value; perform horizontal and vertical combination according to the minimum horizontal coordinate, the maximum horizontal coordinate, the minimum vertical coordinate and the maximum vertical coordinate to obtain at least two vertex coordinates; wherein the at least two vertex coordinates are used to characterize the rectangular area.

[0260] In an exemplary embodiment, when the preset shape area is a rectangular area, the area determination module 20 is further used to: when the first value is greater than the first threshold and the second value is less than the second threshold, determine at least two vertex coordinates based on the first value, the trajectory point corresponding to the first value on the trajectory line, and the screen aspect ratio of the display device; wherein the aspect ratio of the rectangular area represented by the at least two vertex coordinates is the same as the screen aspect ratio, and the first threshold is greater than the second threshold; the first value is one of the length value and the width value, and the second value is the other of the length value and the width value.

[0261] In an exemplary embodiment, when the preset shape area is a rectangular area, the screenshot module 30 is specifically used to: when the aspect ratio of the rectangular area is different from the screen aspect ratio of the display device, correct the rectangular area according to the screen aspect ratio; wherein the aspect ratio of the modified rectangular area is the same as the screen aspect ratio; and take a screenshot of the area within the corresponding corrected rectangular area in the current display page to obtain an area image.

[0262] Each module in the above-mentioned circle screenshot device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the computer in the form of software.

[0263] In an exemplary embodiment, a computer device is provided. The computer device may be a terminal, and its internal structure diagram may be as shown in FIG. Figure 16As shown. The computer device includes a processor, a memory, an input / output interface, a communication interface, a display unit and an input device. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface, the display unit and the input device are connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal in a wired or wireless manner, and the wireless manner can be implemented through Wi-Fi, a mobile cellular network, near field communication (NFC) or other technologies. When the computer program is executed by the processor, a method for circling and taking a screenshot is implemented. The display unit of the computer device is used to form a visually visible picture, which can be a display screen, a projection device or a virtual reality imaging device. The display screen may be a liquid crystal display screen or an electronic ink display screen, and the input device of the computer device may be a touch layer covering the display screen, or a key, trackball or touchpad provided on the computer device housing, or an external keyboard, touchpad or mouse. Those skilled in the art will understand that Figure 16 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different component arrangement.

[0264] In an alternative embodiment, Figure 16 The computer device shown may be the aforementioned display device.

[0265] In one embodiment, a computer device is further provided, including a memory and a processor. The memory stores a computer program, and the processor implements the steps in the above method embodiments when executing the computer program.

[0266] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned method embodiments are implemented.

[0267] In one embodiment, a computer program product is provided, including a computer program, which implements the steps in the above method embodiments when executed by a processor.

[0268] It should be noted that the data involved in this application (including but not limited to image data, etc.) are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0269] Those skilled in the art will appreciate that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, database or other media used in the embodiments provided in this application may include at least one of non-volatile memory and volatile memory. Non-volatile memory may include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory may include random access memory (RAM) or external cache memory, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in the various embodiments provided herein may include at least one of a relational database and a non-relational database. Non-relational databases may include, but are not limited to, distributed databases based on blockchains. The processor involved in the various embodiments provided herein may be, but are not limited to, a general-purpose processor, a central processing unit (CPU), a graphics processing unit (GPU), a digital signal processor (DSP), a programmable logic unit (PLC), a data processing logic unit based on quantum computing, an artificial intelligence (AI) processor, and the like.

[0270] The technical features of the above embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0271] The above-described embodiments merely represent several implementation methods of the present application. While the descriptions are relatively specific and detailed, they should not be construed as limiting the scope of the present application. It should be noted that a person of ordinary skill in the art may make various modifications and improvements without departing from the spirit of the present application, and these modifications and improvements fall within the scope of protection of the present application. Therefore, the scope of protection of the present application shall be determined by the appended claims.

Claims

1. A display device, characterized in that: include: Display and controller; The controller is configured to: receiving a pointing parameter sent by a remote controller, and generating a trajectory line according to the received pointing parameter; wherein the pointing parameter changes with the movement of the remote controller; Determine a preset shape area according to the trajectory line; wherein the area enclosed by the preset shape corresponds to the area represented by the trajectory line; Taking a screenshot of the area corresponding to the preset shape area in the current display page to obtain an area image; An image search is performed based on the area image to display object information of objects in the area image.

2. The display device according to claim 1, wherein When the controller receives the pointing parameters sent by the remote controller and generates a trajectory line according to the received pointing parameters, the controller is configured as follows: In response to a press event for a screenshot control sent by the remote control, executing a timing operation; Upon monitoring a lift event indicating that the screenshot control is lifted, and if the timing duration does not exceed a preset duration, taking a full-screen screenshot of the current display page; When the timing duration exceeds the preset duration and no lifting event indicating that the screenshot control is lifted is monitored within the timing duration, the pointing parameter sent by the remote control is received, and a trajectory line is generated according to the received pointing parameter.

3. The display device according to claim 2, wherein When the controller receives the pointing parameter sent by the remote control and generates a trajectory line based on the received pointing parameter when the timing duration exceeds a preset duration and no lift event indicating that the screenshot control is lifted is detected within the timing duration, the controller is configured to: Reading a state parameter representing the switch state of the pointing switch of the remote controller from a local device; When the timing duration exceeds a preset duration, no lift event indicating that the screenshot control is lifted is detected within the timing duration, and the state parameter indicates that the pointing switch is in the on state, receiving the pointing parameter sent by the remote control, and generating a trajectory line based on the received pointing parameter; wherein the pointing switch is a switch on the remote control that controls the sending of the pointing parameter, and when the pointing switch is in the on state, the remote control sends the pointing parameter; When the timing duration exceeds the preset duration, no lift event indicating that the screenshot control is lifted is detected within the timing duration, and the state parameter indicates that the pointing switch is in the off state, the current display page is recorded; wherein, when the pointing switch is in the off state, the remote control does not send the pointing parameter.

4. The display device according to any one of claims 1 to 3, characterized in that: When the controller determines the preset shape area according to the trajectory line, the controller is configured to: Comparing the width of the track line in the screen width direction and the length of the track line in the screen length direction with a first threshold value, respectively; wherein the width is the maximum abscissa difference between the abscissa differences of the track points on the track line, and the length is the maximum ordinate difference between the ordinate differences of the track points on the track line; When the width value is greater than or equal to the first threshold, or the length value is greater than or equal to the first threshold, determining a preset shape area according to the trajectory line; When both the width value and the length value are smaller than the first threshold value, a screenshot failure message is output.

5. The display device according to claim 4, wherein: The preset shape area is a rectangular area; when the controller determines the preset shape area according to the trajectory line, it is configured to: When the first value is greater than the first threshold and the second value is greater than the second threshold, selecting the minimum value of the horizontal coordinate, the maximum value of the horizontal coordinate, the minimum value of the vertical coordinate, and the maximum value of the vertical coordinate from the coordinate data of the trajectory point on the trajectory line; wherein the first threshold is greater than the second threshold; wherein the first value is one of the length value and the width value, and the second value is the other of the length value and the width value; At least two vertex coordinates are obtained by performing horizontal and vertical combinations based on the minimum abscissa value, the maximum abscissa value, the minimum ordinate value, and the maximum ordinate value; wherein the at least two vertex coordinates are used to characterize the rectangular area.

6. The display device according to claim 4, wherein: The preset shape area is a rectangular area; when the controller determines the preset shape area according to the trajectory line, it is configured to: When the first value is greater than the first threshold and the second value is less than the second threshold, at least two vertex coordinates are determined based on the first value, the trajectory point on the trajectory line corresponding to the first value, and the screen aspect ratio of the display device; wherein the aspect ratio of the rectangular area represented by the at least two vertex coordinates is the same as the screen aspect ratio, and the first threshold is greater than the second threshold; the first value is one of the length value and the width value, and the second value is the other of the length value and the width value.

7. The display device according to any one of claims 1 to 3, characterized in that: The preset shape area is a rectangular area; when the controller takes a screenshot of the area corresponding to the preset shape area in the current display page to obtain the area image, the controller is configured to: When the aspect ratio of the rectangular area is different from the aspect ratio of the screen of the display device, the rectangular area is modified according to the aspect ratio of the screen; wherein the aspect ratio of the modified rectangular area is the same as the aspect ratio of the screen; A screenshot is taken of the area within the corrected rectangular area in the current display page to obtain a regional image.

8. A method for circling and taking screenshots, characterized in that: Applied to display devices, including: receiving a pointing parameter sent by a remote controller, and generating a trajectory line according to the received pointing parameter; wherein the pointing parameter changes with the movement of the remote controller; Determining a preset shape area according to the trajectory line; wherein the preset shape area corresponds to the area represented by the trajectory line; Taking a screenshot of the area corresponding to the preset shape area in the current display page to obtain an area image; An image search is performed based on the area image to display object information of objects in the area image.

9. The method according to claim 8, characterized in that The receiving of the pointing parameter sent by the remote controller and generating a trajectory line according to the received pointing parameter includes: In response to a press event for a screenshot control sent by the remote control, executing a timing operation; Upon monitoring a lift event indicating that the screenshot control is lifted, and if the timing duration does not exceed a preset duration, taking a full-screen screenshot of the current display page; When the timing duration exceeds the preset duration and no lifting event indicating that the screenshot control is lifted is monitored within the timing duration, the pointing parameter sent by the remote control is received, and a trajectory line is generated according to the received pointing parameter.

10. The method according to claim 8 or 9, characterized in that When the timing duration exceeds a preset duration and no lift event indicating that the screenshot control is lifted is detected within the timing duration, receiving a pointing parameter sent by the remote control, and generating a trajectory line according to the received pointing parameter, including: Reading a state parameter representing the switch state of the pointing switch of the remote controller from a local device; When the timing duration exceeds a preset duration, no lift event indicating that the screenshot control is lifted is detected within the timing duration, and the state parameter indicates that the pointing switch is in the on state, receiving the pointing parameter sent by the remote control, and generating a trajectory line based on the received pointing parameter; wherein the pointing switch is a switch on the remote control that controls the sending of the pointing parameter, and when the pointing switch is in the on state, the remote control sends the pointing parameter; When the timing duration exceeds the preset duration, no lift event indicating that the screenshot control is lifted is detected within the timing duration, and the state parameter indicates that the pointing switch is in the off state, the current display page is recorded; wherein, when the pointing switch is in the off state, the remote control does not send the pointing parameter.

Images