A display device and memory integration method

Abstract

This application provides a display device and a memory consolidation method. The method, in response to a control command for memory consolidation, acquires a first backlight brightness of a first screen and a second backlight brightness of a second screen. Display areas with a brightness difference less than or equal to a difference threshold are marked to obtain target areas. The backlight similarity between the first and second backlight brightness is calculated based on the area ratio of the target area to the display area corresponding to the second backlight brightness. If the backlight similarity is greater than or equal to the similarity threshold, the duration of the backlight similarity is recorded. When the duration is greater than or equal to the duration threshold, memory consolidation is performed on memory fragments through a first task process. This application calculates the backlight similarity between screens, thereby determining the screen change based on the duration of the backlight similarity. When the screen content changes slightly, memory consolidation is performed, reducing the stuttering effect of memory consolidation on the screen.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a memory integration method. Background Technology

[0002] Display devices have various applications installed. When these applications run, the system allocates memory to them. Over long periods of operation, the repeated allocation and deallocation of memory creates numerous memory fragments. These fragments are small and discontinuous, making it impossible to respond to tasks requiring large amounts of memory.

[0003] Display devices periodically consolidate memory fragments into contiguous blocks of memory that can respond to large memory requests. However, memory consolidation can impact the performance of current applications, causing issues such as application lag.

[0004] To reduce lag, the display device can perform memory consolidation after entering standby mode. However, this method of memory consolidation requires the display device to enter standby mode, which is lagging. If the display device is always in running mode, memory consolidation cannot be performed, affecting the efficiency of memory consolidation. Summary of the Invention

[0005] This application provides a display device and a memory integration method to solve the problem of low efficiency in memory integration performed by the display device.

[0006] In a first aspect, some embodiments of this application provide a display device, including a display configured to display a user interface; and a controller configured to:

[0007] During the display process of the display device displaying the screen, the first backlight brightness of the first screen and the second backlight brightness of the second screen are obtained, and the second screen is the screen displayed after the first screen;

[0008] A mark is added to the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to the difference threshold to obtain the target area;

[0009] The backlight similarity between the first backlight brightness and the second backlight brightness is calculated based on the area ratio of the target area to the display area corresponding to the second backlight brightness.

[0010] If the backlight similarity is greater than or equal to the similarity threshold, record the duration of the backlight similarity.

[0011] When the duration is greater than or equal to the duration threshold, the first task process performs memory consolidation on the memory fragments to obtain memory blocks with contiguous addresses.

[0012] The above technical solution has the following beneficial effects or advantages: By comparing the backlight brightness between two consecutive frames, it can be determined whether the image has changed. When the backlight similarity is greater than or equal to the similarity threshold, it indicates that the display device is displaying a static image and the user has not operated the display device. At this time, the display device's memory consolidation of memory fragments will not affect the normal display of the application, thereby consolidating memory fragments in non-standby mode and improving memory consolidation efficiency.

[0013] In some embodiments, the controller performs the step of adding a mark to the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to a difference threshold, specifically configured as follows:

[0014] The number of partitions is obtained based on the device configuration information of the display device, and the display area of ​​the display device is divided into at least one sub-region based on the number of partitions.

[0015] Calculate the partition brightness difference between the first backlight brightness and the second backlight brightness corresponding to at least one sub-region;

[0016] The sub-regions whose brightness difference between the partitions is less than or equal to the difference threshold are marked as the target regions.

[0017] The above technical solution has the following beneficial effects or advantages: by dividing the display area of ​​the display device into at least one sub-region based on the number of partitions, and by determining the sub-region in the second screen whose partition brightness difference is less than or equal to the difference threshold through the partition brightness difference between the first backlight brightness and the second backlight brightness corresponding to the sub-region, the target area is obtained.

[0018] In some embodiments, the step of the controller calculating the backlight similarity between the first backlight brightness and the second backlight brightness based on the area ratio of the target area to the display area corresponding to the second backlight brightness is specifically configured as follows:

[0019] Obtain the number of the target regions to obtain the number of target partitions;

[0020] The backlight similarity is obtained by calculating the ratio of the number of target partitions to the number of partitions in the second image.

[0021] The above technical solution has the following beneficial effects or advantages: the target area represents the partitions with the same brightness value in the first partition area and the second partition area. By calculating the ratio of the number of target partitions in the target area to the number of partitions in the second partition area, the partition areas whose backlight brightness does not change during the change of the image are determined, thereby calculating the backlight similarity.

[0022] In some embodiments, after the controller performs the step of obtaining the number of partitions based on the device configuration information of the display device, it is further configured to:

[0023] If the number of partitions is less than or equal to the first partition number threshold, then the first threshold is set as the similarity threshold;

[0024] If the number of partitions is greater than the first partition number threshold and less than or equal to the second partition number threshold, then the second threshold is set as the similarity threshold, and the second threshold is less than the first threshold.

[0025] If the number of partitions is greater than the second partition number threshold, then the third threshold is set as the similarity threshold, and the third threshold is less than the second threshold.

[0026] The above technical solution has the following beneficial effects or advantages: the display device can set different similarity thresholds according to different numbers of partitions, so as to set more reasonable similarity thresholds according to display devices with different configuration specifications and improve the accuracy of judging backlight similarity.

[0027] In some embodiments, the controller performs a step of memory consolidation of memory fragments through a first task process, specifically configured as follows:

[0028] Retrieve the preset process file used to create the first task process from the local configuration file;

[0029] A trigger value is written into the preset process file to create the first task process;

[0030] The first task process performs memory consolidation on the memory fragments collected in the system memory to obtain contiguous memory blocks.

[0031] The above technical solution has the following beneficial effects or advantages: by writing a trigger value to a preset process file, the first task process is automatically created, and memory fragments are integrated according to the memory of the first task process, thus automatically obtaining memory blocks with contiguous addresses and improving the efficiency of integrating memory fragments.

[0032] In some embodiments, if the backlight similarity is greater than or equal to a similarity threshold, the controller is further configured to:

[0033] Update the second backlight brightness to the first backlight brightness;

[0034] Mark the backlight brightness of the next frame of the second image as the second backlight brightness;

[0035] The target area is updated based on the updated first backlight brightness and the current second backlight brightness.

[0036] The above technical solution has the following beneficial effects or advantages: If the backlight similarity is greater than or equal to the similarity threshold, the target area between the next frame and the second frame can be determined. For this purpose, the second backlight brightness can be updated to the first backlight brightness, and the second backlight brightness of the next frame of the second frame can be obtained. Thus, the target area can be updated according to the updated first backlight brightness and the current second backlight brightness, so as to update the target area in the scene where the screen is in dynamic playback.

[0037] In some embodiments, the controller performing the step of recording the duration of the backlight similarity is further configured to:

[0038] If the target region is updated, the backlight similarity is updated based on the updated target region;

[0039] If the updated backlight similarity is less than the similarity threshold, then the duration is reset.

[0040] The above technical solution has the following beneficial effects or advantages: When the target area changes, the backlight similarity also changes accordingly. In order to improve the accuracy of the backlight similarity judgment, the backlight similarity is updated according to the changed target area. When the updated backlight similarity is less than the similarity threshold, the backlight similarity changes and the duration is interrupted. Therefore, the duration can be reset according to the updated backlight similarity to improve the accuracy of recording the duration of backlight similarity.

[0041] In some embodiments, the controller performs a step of memory consolidation of memory fragments through a first task process, specifically configured as follows:

[0042] Iterate through the application processes currently running on the display device to obtain the application load.

[0043] Calculate the first load of the display device based on the application load;

[0044] If the first load is greater than the load threshold, memory consolidation is performed on the memory fragments through the first task process.

[0045] The above technical solution has the following beneficial effects or advantages: When the load usage is less than the load threshold, the display device's memory consolidation of memory fragments will increase the load usage, causing application lag. Therefore, when the load usage is less than the load threshold, the display device does not perform memory consolidation of memory fragments. When the load usage is less than the load threshold, memory consolidation of memory fragments is performed through the first task process, thereby improving the smoothness of the display device's operation.

[0046] In some embodiments, if the first load is less than or equal to a load threshold, the controller is further configured to:

[0047] Get the runtime of each application process running in the background;

[0048] Shut down application processes whose runtime is greater than or equal to the runtime threshold to release the application load of the application processes.

[0049] The above technical solution has the following beneficial effects or advantages: When the load usage exceeds the load threshold, the display device closes application processes whose running time is greater than or equal to the running time threshold, so as to release the load usage corresponding to these application processes, thereby providing load space for memory consolidation of memory fragments, reducing the stuttering of application processes during operation, and improving the smoothness of the display device operation.

[0050] Secondly, some embodiments of this application provide a memory consolidation method applied to the display device described in the first aspect, the display device including a display configured to display a user interface; and a controller; the method includes:

[0051] During the display process of the display device displaying the screen, the first backlight brightness of the first screen and the second backlight brightness of the second screen are obtained, and the second screen is the screen displayed after the first screen;

[0052] A mark is added to the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to the difference threshold to obtain the target area;

[0053] The backlight similarity between the first backlight brightness and the second backlight brightness is calculated based on the area ratio of the target area to the display area corresponding to the second backlight brightness.

[0054] If the backlight similarity is greater than or equal to the similarity threshold, record the duration of the backlight similarity.

[0055] When the duration is greater than or equal to the duration threshold, the first task process performs memory consolidation on the memory fragments to obtain memory blocks with contiguous addresses.

[0056] As can be seen from the above technical solutions, this application provides a display device and a memory consolidation method. The method, in response to a control command for memory consolidation, acquires a first backlight brightness of a first screen and a second backlight brightness of a second screen. It marks display areas where the brightness difference between the first and second backlight brightness is less than or equal to a difference threshold to obtain target areas. It calculates the backlight similarity between the first and second backlight brightness based on the area ratio of the target area to the display area corresponding to the second backlight brightness. If the backlight similarity is greater than or equal to the similarity threshold, it records the duration of the backlight similarity. When the duration is greater than or equal to the duration threshold, it performs memory consolidation on memory fragments through a first task process. This application calculates the backlight similarity between screens, thereby determining the screen change based on the duration of the backlight similarity. When the screen content changes little, it performs memory consolidation, reducing the stuttering effect of memory consolidation on the screen. Attached Figure Description

[0057] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0058] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0059] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0060] Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0061] Figure 4 A flowchart illustrating the memory consolidation process performed by a display device according to some embodiments of this application;

[0062] Figure 5 Timing diagrams for memory consolidation performed by a display device according to some embodiments of this application;

[0063] Figure 6 A flowchart illustrating how a display device obtains a first backlight brightness based on a first screen, provided in some embodiments of this application;

[0064] Figure 7 A flowchart illustrating the determination of a target area for a display device provided in some embodiments of this application;

[0065] Figure 8This application provides some embodiments of a display device that divides a display area into sub-regions;

[0066] Figure 9 A flowchart illustrating how a display device determines a brightness difference based on partition data, provided in some embodiments of this application;

[0067] Figure 10 A flowchart illustrating how a display device sets a similarity threshold based on the number of partitions, as provided in some embodiments of this application;

[0068] Figure 11 A flowchart illustrating the duration of reset after updating the target area of ​​a display device, provided in some embodiments of this application;

[0069] Figure 12 This application provides a flowchart for a display device that determines the execution of memory consolidation based on a load threshold, according to some embodiments of the present application. Detailed Implementation

[0070] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0071] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0072] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0073] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0074] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0075] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0076] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0077] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0078] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0079] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0080] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0081] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0082] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0083] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0084] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0085] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0086] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0087] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0088] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0089] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0090] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0091] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0092] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0093] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0094] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0095] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0096] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0097] like Figure 3 As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0098] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0099] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0100] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0101] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0102] In some embodiments, after the display device 200 is powered on, it can display a user interface. The user interface may include application controls corresponding to multiple applications to provide the user with application functions that the display device 200 can perform, such as playing songs, querying information, playing videos, etc.

[0103] When running an application, the display device 200 needs to allocate memory to the application so that it can run normally with the allocated memory. Different applications require different amounts of memory, therefore, the display device 200 can allocate different amounts of memory to different applications through the display device 200's system.

[0104] It should be noted that, in order to ensure the normal operation of the application, the display device 200 needs to allocate contiguous memory for the application, that is, allocate memory as a whole.

[0105] When the memory allocated by the display device 200 does not match the memory required by the application, memory fragmentation occurs. For example, if the application requires 90MB of memory, but the display device 200 allocates 100MB, the application will split the 100MB of memory into 90MB of contiguous memory to support its operation, and the remaining 10MB will be fragmented into 10MB memory fragments. Therefore, in the above memory allocation process, although the total memory size does not change, the allocated 100MB of contiguous memory is divided into 90MB of contiguous memory and 10MB of memory fragments. This results in only 90MB of contiguous memory out of a total of 100MB, which is insufficient to support the operation of an application with a memory requirement of 100MB.

[0106] Memory fragmentation also occurs when the memory released by the display device 200 does not match the memory required to close an application. For example, if an application requires 90MB of memory to run, the display device 200 should release 90MB of memory when the application is closed to free up memory space. When the memory that should be released is not equal to the memory that is actually released, the unreleased portion will also be classified as memory fragmentation.

[0107] When the system runs for a long time, it will repeatedly allocate and release memory based on the running and closing status of each application. This will result in a large number of memory fragments being formed during the repeated allocation and release of memory. Memory fragments cannot be allocated by applications through accumulation and stacking, resulting in low memory utilization.

[0108] To improve memory utilization, the display device 200 periodically consolidates memory fragments. For example, it consolidates five memory fragments, each 10MB in size, into a single 50MB contiguous memory block to allocate memory to applications that meet the memory requirements.

[0109] Memory consolidation requires a load on the display device 200. When the load on the display device 200 is high, it will affect the operation of applications, causing running applications to lag. To reduce lag, the display device 200 can perform memory consolidation after entering standby mode. However, this memory consolidation method requires waiting for the display device 200 to enter standby mode, which is lagging. If the display device 200 is always in running mode, memory consolidation cannot be performed, affecting the efficiency of memory consolidation.

[0110] To address the issue of low efficiency in memory consolidation, some embodiments of this application provide a display device 200, including a display 260 configured to display a user interface; and a controller 250 configured to execute a memory consolidation method to solve the problem of low efficiency in memory consolidation. To facilitate the execution of the above method, the controller 250 may include a backlight brightness module, a data comparison module, and a memory consolidation module. The backlight brightness module is configured to acquire the backlight brightness of the screen displayed on the display device 200, the data comparison module is configured to compare the difference data between the backlight brightness of two frames, and the memory consolidation module is configured to perform memory consolidation on memory fragments. Figure 4 This is a flowchart illustrating the memory consolidation process performed by a display device according to some embodiments of this application. Figure 5 Timing diagrams for memory consolidation performed by a display device according to some embodiments of this application. The display device 200 follows... Figure 5 The timing relationships shown indicate the execution of memory consolidation; see [link / reference]. Figure 4 and Figure 5 The method includes the following:

[0111] S100: During the display process of the display device displaying the screen, the first backlight brightness of the first screen and the second backlight brightness of the second screen are obtained.

[0112] During the display process on the display device 200, the controller 250 can automatically enter a state of consolidating memory fragments to obtain the first backlight brightness of the first screen and the second backlight brightness of the second screen. The first screen is the image currently being displayed by the display device 200.

[0113] In some embodiments, the user can also actively send control commands for memory consolidation to the display device 200 via the control device 100. After receiving the control commands, the controller 250 can switch the display device 200 to a state of consolidating memory fragments in response to the control commands.

[0114] The first backlight brightness is the backlight brightness of the first image. When the display device 200 displays an image, it can emit backlight to the screen to improve the image display effect of the display device 200. Therefore, the display device 200 may also include a backlight component, which can be disposed inside the screen of the monitor 260, for emitting backlight to the screen when the display device 200 displays an image, thereby improving the display effect of the display device 200. When the backlight component emits backlight, it generates a backlight brightness, which is used to represent the backlight brightness emitted by the backlight component at the corresponding screen position. The image displayed by the display device 200 may include multiple areas of different colors. Therefore, the backlight brightness needs to be adjusted according to the different colors to emit backlight of different brightness to the corresponding color areas on the screen, so that the entire image maintains the same display effect. Therefore, the backlight brightness data values ​​are different in different color areas. The depth of the color is positively correlated with the backlight brightness. That is, the darker the color, the harder it is to see the corresponding area of ​​the picture, and the higher the required backlight brightness is so that the display device 200 can clearly display the picture content in the dark color area. Similarly, the lighter the color, the easier it is to see the corresponding area of ​​the picture, and the display device 200 can reduce the backlight brightness in the light color area.

[0115] It should be noted that in the above embodiments, the dark color area and the light color area are relative color display areas. In practical applications, the display device 200 can determine the data value of the backlight brightness data through the color values ​​of different display areas, thereby emitting backlight with different data values ​​in the corresponding display areas through the backlight component, so as to maintain the display effect of different display areas in the same screen.

[0116] The first backlight brightness is the backlight brightness data corresponding to the backlight emitted by the backlight component to the screen when the display device 200 displays the first image. Based on the content of the first image, the first image may include different color display areas. Therefore, the first backlight brightness may include the backlight brightness of different display areas, such as... Figure 6 As shown, the first screen includes two display areas of different colors. For the shadowed display areas, the backlight assembly emits a first brightness of backlight, resulting in backlight brightness 1. For the blank display areas, the backlight assembly emits a second brightness of backlight, resulting in backlight brightness 2. The display device 200 can then combine the area backlights according to backlight brightness 1 and backlight brightness 2 to obtain the first backlight brightness.

[0117] The second frame is the frame displayed after the first frame. For example, the second frame could be the next frame after the first frame, or it could be the frame one second after the first frame. The second backlight brightness is the backlight brightness of the second frame. The display device 200 can obtain the second frame while displaying or about to display the first frame. For example, when playing video data, the display device 200 will pre-cache the content to be played via the network. Therefore, the display device 200 can determine the second frame based on the cached content.

[0118] After determining the second screen, the display device 200 can iterate through the color values ​​corresponding to each display area in the second screen, and calculate the backlight brightness of the display area in the second screen based on the corresponding color values ​​to obtain the backlight brightness of that area, and then summarize the backlight brightness of each area into the second backlight brightness of the entire second screen.

[0119] S200: Mark the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to the difference threshold to obtain the target area.

[0120] After obtaining the first backlight brightness and the second backlight brightness, the display device 200 can use the data comparison module to obtain the display area where there is a difference in backlight brightness between the first and second images, i.e., the target area. During this process, such as... Figure 7 As shown, the display device 200 can compare the first backlight brightness and the second backlight brightness to calculate the brightness difference between the two backlight brightnesses, and mark the display areas where the brightness difference is less than or equal to the difference threshold to obtain the target area. During the comparison, the display device 200 needs to compare based on the backlight brightness of the same area to improve the accuracy of the calculated brightness difference.

[0121] When the brightness of the first and second backlights varies significantly within the same display area, it indicates that the content of the first and second images has changed, and the display device 200 is in a dynamic playback state. In this case, performing memory consolidation on fragmented memory will cause stuttering in the playback, affecting the user's viewing experience. Conversely, when the brightness of the first and second backlights varies little within the same display area, it indicates that the content of the first and second images has changed little, or that the display device 200 is in a static display state. In this case, performing memory consolidation on fragmented memory, even if it causes stuttering, will not affect the currently statically displayed content.

[0122] Therefore, the display device 200 can set a difference threshold to determine the change between the first backlight brightness and the second backlight brightness. The display device 200 can compare the brightness difference with the difference threshold and mark the display area where the brightness difference between the first and second backlight brightness is less than or equal to the difference threshold as the target area. For ease of comparison, the display device 200 can add a mark to the display area in the second screen where the brightness difference is less than or equal to the difference threshold to obtain the target area. It should be understood that the target area can be a local area where the screen content changes between the first and second backlight brightness; if the entire screen changes, the target area can also be the entire second screen. The target area can include multiple local areas or a whole area.

[0123] In some embodiments, the display device 200 can also obtain the target area on a partition-by-partition basis, that is, the display device 200 calculates the partition brightness difference between the first backlight brightness and the second backlight brightness within the same partition. For example... Figure 8 As shown, the display device 200 may include multiple partitions, and the number of partitions can be determined according to the device configuration information of the display device 200. For example, the larger the screen size of the display device 200, the more partitions it has; the smaller the screen size of the display device 200, the fewer partitions it has. Figure 9 As shown, the display device 200 can obtain the number of partitions based on the device configuration information, and divide the display area of ​​the display device 200 into multiple sub-regions based on the number of partitions.

[0124] Corresponding to the first and second screens, the display device 200 can divide the display area corresponding to the first backlight brightness into multiple first partition areas according to the distribution position of the sub-regions in the display area, and divide the display area corresponding to the second backlight brightness into multiple second partition areas according to the distribution position of the sub-regions on the screen. The number of first partition areas and the number of second partition areas are the same as the number of partitions. The first partition brightness is the first backlight brightness within the corresponding sub-region, and the second partition brightness is the second backlight brightness within the corresponding sub-region. After dividing the sub-regions, the display device 200 needs to calculate the partition brightness difference between the first backlight brightness and the second backlight brightness corresponding to the sub-region, that is, the brightness difference between the first partition brightness and the second partition brightness of the same sub-region.

[0125] When the brightness difference between sub-regions is less than or equal to a difference threshold, the display device 200 can mark the corresponding sub-region as the target region. Since the second screen is displayed after the first screen, and a comparison of the first and second backlight brightness is required, in this embodiment, the display device 200 can mark the target region within the sub-region corresponding to the display area of ​​the second screen for comparison. After calculating the brightness difference between each sub-region and comparing it with the difference threshold, all marked sub-regions form the final target region.

[0126] It should be noted that since the brightness difference is the difference in backlight brightness between two frames, the same difference threshold can be used as the judgment threshold for comparing the backlight brightness of the overall area and the backlight brightness of the partitioned area.

[0127] This embodiment divides the display area corresponding to the first backlight brightness and the display area corresponding to the second backlight brightness into multiple sub-regions, using partitions as units. The brightness difference between each sub-region is then calculated to improve the accuracy of obtaining the target area.

[0128] During the calculation of brightness differences, the display device 200 can set the sub-region calculation order to calculate the brightness differences of the sub-regions sequentially according to the sub-region calculation order. For example, the sub-region calculation order can take the first sub-region in the upper right corner as the first sub-region to calculate the brightness difference, and calculate the brightness difference sequentially in the horizontal direction, or it can calculate the brightness difference sequentially in the vertical direction. This application does not limit the specific order in which the sub-region calculation order is set.

[0129] Therefore, based on multiple sub-regions, the first backlight brightness and the second backlight brightness can also be represented by a set, where the first backlight brightness is L1 = {l 11 l 12 l 13 ...l 1n The second backlight brightness is L2 = {l} 21 l 22 l 23 ...l 2n When determining the target area, if the brightness difference between the first partition of the first partition area and the second partition of the corresponding partition area is less than or equal to a difference threshold, a first marker (e.g., 1) can be added to the corresponding partition area; if the brightness difference is greater than the difference threshold, a second marker (e.g., 0) can be added to the corresponding partition area. Therefore, the partition areas after calculating the brightness difference can be represented as ΔL = {1, 0, 1, ... 1}. The partition area with the first marker is the target area.

[0130] S300: Calculate the backlight similarity between the first backlight brightness and the second backlight brightness based on the area ratio of the target area to the display area corresponding to the second backlight brightness.

[0131] The target area can represent the display area of ​​the display device 200 where the backlight brightness changes little when switching from the first screen to the second screen. Therefore, the display device 200 can calculate the backlight similarity between the first backlight brightness and the second backlight brightness based on the area ratio of the target area to the display area corresponding to the second backlight brightness.

[0132] In some embodiments, the display device 200 can also calculate backlight similarity based on the number of partitions. Backlight similarity is a ratio result. For example, the display device 200 divides its display area into 100 sub-regions based on the number of partitions. That is, the display area corresponding to the first backlight brightness and the display area corresponding to the second backlight brightness each include 100 partition regions. If the brightness difference between only one of the 100 partition regions is greater than the difference threshold, and the brightness differences between the remaining partition regions are less than or equal to the difference threshold, then the backlight similarity between the first backlight brightness and the second backlight brightness is 99%.

[0133] Therefore, in the process of calculating backlight similarity, the display device 200 can obtain the number of target areas and thus the number of target partitions. After obtaining the number of target partitions, the ratio of the number of target partitions to the number of partitions in the second partition area is calculated to obtain the backlight similarity.

[0134] S400: If the backlight similarity is greater than or equal to the similarity threshold, record the duration of the backlight similarity.

[0135] If the backlight similarity is greater than or equal to the similarity threshold, it indicates that the first and second frames are identical. In this case, the display device 200 is in static display mode, and memory consolidation can be performed to address memory fragmentation. If the display device 200 responds to a user's pause command and briefly pauses the media being played, and then the user inputs a playback command to resume playback, the content of the current and next frames changes due to the resumed playback, reducing the backlight similarity. Even with memory consolidation to address memory fragmentation, stuttering will still occur.

[0136] Therefore, when the backlight similarity is greater than or equal to the similarity threshold, the display device 200 starts a timing program to record the duration of the backlight similarity, thereby determining the duration of the display device 200 in static display mode.

[0137] S500: When the duration is greater than or equal to the duration threshold, the first task process performs memory consolidation on the memory fragments to obtain memory blocks with contiguous addresses.

[0138] When the duration of backlight similarity is greater than or equal to the duration threshold, it indicates that the display device 200 remains unchanged for an extended period, unaffected by stuttering or other issues. In this case, the display device 200 can perform memory consolidation on fragmented memory through the first task process to obtain contiguous memory blocks.

[0139] It should be noted that while recording the duration of backlight similarity, the display device 200 will continue to calculate the backlight similarity based on the screen to be displayed. At this time, the display device 200 can update the first screen based on the currently displayed screen, update the second screen based on the next frame of the currently displayed screen, and calculate the backlight similarity based on the first backlight brightness of the updated first screen and the second backlight brightness of the updated second screen.

[0140] If the backlight similarity changes, it indicates that the backlight similarity has been continuously interrupted. The timing is terminated, and the current duration of the backlight similarity is obtained. If the current duration is less than the duration threshold, memory consolidation is performed on the memory fragments through the first task process.

[0141] The memory consolidation method provided in the above embodiments determines whether the displayed image has changed by calculating the similarity between the first backlight brightness of the first image and the second backlight brightness of the second image. When the backlight similarity is greater than or equal to a similarity threshold, the duration of the backlight similarity is recorded. When the duration is greater than or equal to a duration threshold, memory consolidation is performed on memory fragments through a first task process. This allows memory consolidation of memory fragments to be performed while the display device 200 is in operation, thereby improving the efficiency of memory consolidation.

[0142] In some embodiments, display devices 200 with different configurations may include different numbers of partitions, and different similarity thresholds may be set for different numbers of partitions. The larger the screen size of the display device 200, the more partitions are included in the same screen area; therefore, when the screen changes, the number of partitions that change accordingly also increases. Thus, as... Figure 10 As shown, the display device 200 can determine a similarity threshold based on the number of partitions. If the number of partitions X is less than or equal to a first partition number threshold X1, the display device 200 can set the first threshold as the similarity threshold. When the number of partitions X is greater than the first partition number threshold X1 and less than or equal to a second partition number threshold X2, the display device 200 can set a second threshold that is less than the first threshold as the similarity threshold. If the number of partitions X is greater than the second partition number threshold X2, then a third threshold that is less than the second threshold is set as the similarity threshold.

[0143] The above embodiments are described in detail below with examples. For example, the first threshold for the number of partitions can be 100, the second threshold for the number of partitions can be 500, the first threshold is 100%, the second threshold is 90%, and the third threshold is 80%. When the number of partitions is less than or equal to 100, the similarity threshold is the first threshold, i.e., 100%; when the number of partitions is greater than 100 and less than or equal to 500, the similarity threshold is the second threshold, i.e., 90%; when the number of partitions is greater than 500, the similarity threshold is the third threshold, i.e., 80%.

[0144] The aforementioned technical features, by setting different similarity thresholds based on different device configuration information of the display device 200, improve the accuracy of judging the backlight similarity between the first backlight brightness and the second backlight brightness.

[0145] In some embodiments, if the backlight similarity is less than the similarity threshold, it indicates that there is a significant change in the content of the first and second screens. Therefore, it is not advisable to perform memory consolidation on memory fragments in order to reduce the screen stuttering caused by memory consolidation to the display device 200.

[0146] In some embodiments, the process by which the display device 200 records the duration of backlight similarity is a dynamic process, that is, it continuously calculates the backlight similarity based on the backlight brightness of the current frame (first frame) and the backlight brightness of the next frame (second frame). During this dynamic process, the display device 200 can update the second frame to the current first frame and update the third frame (the frame following the second frame) to the current second frame during frame switching. Corresponding to backlight brightness, the display device 200 can update the second backlight brightness to the current first backlight brightness, mark the backlight brightness of the next frame (the third frame) as the second backlight brightness, and then re-execute the brightness difference calculation process based on the updated first backlight brightness and the current second backlight brightness to update the target area.

[0147] The display device 200 records the duration of backlight similarity. If the display device 200 switches to dynamic playback mode at this time, that is, the content of the current first screen and the current second screen changes, the brightness of the first backlight and the brightness of the second backlight also change accordingly, and the target area between the first screen and the second screen is updated.

[0148] Because the target area has been updated, such as Figure 11 As shown, the display device 200 needs to update the backlight similarity based on the updated target area. If the updated backlight similarity is greater than or equal to the similarity threshold, it means that although the content of the screen has changed, the change is very small and the changed backlight similarity is still greater than or equal to the similarity threshold, so the duration can continue to be recorded.

[0149] When the updated backlight similarity is less than the similarity threshold, it indicates that the content of the screen has changed significantly. The display device 200 switches from a static display state to a dynamic playback state. At this time, the display device 200 should not perform the memory consolidation process for memory fragments. Therefore, the display device 200 can reset the duration.

[0150] In some embodiments, such as Figure 12 As shown, before the display device 200 performs memory consolidation on memory fragments through the first task process, it can also traverse the application processes currently running on the display device 200 to obtain the application load. The application load is the total load occupied by the application processes currently running on the display device 200. Based on the application load, the display device 200 can calculate the currently available first load, that is, calculate the difference between the total load and the application load to obtain the first load.

[0151] To ensure the normal operation of the display device 200, it typically reserves a certain amount of load. The display device 200 can set a load threshold based on this reserved load. If the initial load is less than or equal to the load threshold, it indicates that the display device 200 is already under heavy load. Performing memory consolidation on fragmented memory at this time would increase the load on the display device 200, causing it to stutter. Therefore, when the initial load is less than or equal to the load threshold, memory consolidation is not performed on fragmented memory. When the initial load exceeds the load threshold, memory consolidation is performed on fragmented memory through the first task process.

[0152] In some embodiments, when the first load is less than or equal to a load threshold, the display device 200 can release some application processes to provide available load resources for the first task process. To do this, the display device 200 can obtain the running time of each application process running in the background. If the application has a long running time in the background, it indicates that the application process may be an application process that the user does not use frequently. Therefore, the application load of the application process can be released to free up load resources.

[0153] To accurately determine application processes that users do not use frequently, the display device 200 can set a runtime threshold. If the runtime of an application running in the background is greater than or equal to the runtime threshold, the application will be closed to release its application load and provide load resources for the primary task process.

[0154] The first task process is used to perform memory consolidation on fragmented memory. The display device 200 can retrieve a preset process file for creating the first task process from its local configuration file; for example, the ` / proc / sys / vm / compact_memory` file could be a preset process file. The display device 200 can write trigger values ​​to the preset process file; for example, writing a trigger value of "1" to the ` / proc / sys / vm / compact_memory` file triggers the task node to create the first task process, initiating its creation. After the first task process is created, the display device 200 can use it to detect memory fragmentation in system memory and perform memory consolidation on the fragments. For example, consolidating ten 1GB memory fragments into one 10GB contiguous memory block results in complete memory consolidation and the final memory result.

[0155] In some embodiments, the detection of the application load of the display device 200 can also be performed before obtaining the first backlight brightness and the second backlight brightness. The embodiments of this application can implement the execution order of the application load detection process, the backlight similarity between the first backlight brightness and the second backlight brightness, and the process of recording the duration of the backlight similarity.

[0156] Some embodiments of this application also provide a memory consolidation method applied to a display device 200. To facilitate the execution of the above method, the display device 200 should at least include a display 260 configured to display a user interface and a controller 250. The method includes:

[0157] S100: During the process of displaying a screen on the display device, the first backlight brightness of the first screen and the second backlight brightness of the second screen are obtained.

[0158] The second screen is the screen displayed after the first screen.

[0159] S200: Mark the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to the difference threshold to obtain the target area.

[0160] S300: Calculate the backlight similarity between the first backlight brightness and the second backlight brightness based on the area ratio of the target area to the display area corresponding to the second backlight brightness.

[0161] S400: If the backlight similarity is greater than or equal to the similarity threshold, record the duration of the backlight similarity.

[0162] S500: When the duration is greater than or equal to the duration threshold, the first task process performs memory consolidation on the memory fragments to obtain memory blocks with contiguous addresses.

[0163] As can be seen from the above technical solutions, this application provides a display device and a memory consolidation method. The method, in response to a control command for memory consolidation, acquires a first backlight brightness of a first screen and a second backlight brightness of a second screen. It marks display areas where the brightness difference between the first and second backlight brightness is less than or equal to a difference threshold to obtain target areas. It calculates the backlight similarity between the first and second backlight brightness based on the area ratio of the target area to the display area corresponding to the second backlight brightness. If the backlight similarity is greater than or equal to the similarity threshold, it records the duration of the backlight similarity. When the duration is greater than or equal to the duration threshold, it performs memory consolidation on memory fragments through a first task process. This application calculates the backlight similarity between screens, thereby determining the screen change based on the duration of the backlight similarity. When the screen content changes little, it performs memory consolidation, reducing the stuttering effect of memory consolidation on the screen.

[0164] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0165] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0166] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0167] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the user interface; The controller is configured as follows: During the display process of the display device displaying the screen, the first backlight brightness of the first screen and the second backlight brightness of the second screen are obtained, and the second screen is the screen displayed after the first screen; A mark is added to the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to the difference threshold to obtain the target area; The backlight similarity between the first backlight brightness and the second backlight brightness is calculated based on the area ratio of the target area to the display area corresponding to the second backlight brightness. If the backlight similarity is greater than or equal to the similarity threshold, record the duration of the backlight similarity. When the duration is greater than or equal to the duration threshold, the first task process performs memory consolidation on the memory fragments to obtain memory blocks with contiguous addresses.

2. The display device according to claim 1, characterized in that, The controller performs the step of adding a mark to the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to a difference threshold, specifically configured as follows: The number of partitions is obtained based on the device configuration information of the display device, and the display area of ​​the display device is divided into at least one sub-region based on the number of partitions. Calculate the partition brightness difference between the first backlight brightness and the second backlight brightness corresponding to at least one sub-region; The sub-regions whose brightness difference between the partitions is less than or equal to the difference threshold are marked as the target regions.

3. The display device according to claim 2, characterized in that, The controller performs the step of calculating the backlight similarity between the first backlight brightness and the second backlight brightness based on the area ratio of the target area to the display area corresponding to the second backlight brightness, specifically configured as follows: Obtain the number of the target regions to obtain the number of target partitions; The backlight similarity is obtained by calculating the ratio of the number of target partitions to the number of partitions in the second partition area.

4. The display device according to claim 2, characterized in that, After executing the step of obtaining the number of partitions based on the device configuration information of the display device, the controller is further configured to: If the number of partitions is less than or equal to the first partition number threshold, then the first threshold is set as the similarity threshold; If the number of partitions is greater than the first partition number threshold and less than or equal to the second partition number threshold, then the second threshold is set as the similarity threshold, and the second threshold is less than the first threshold. If the number of partitions is greater than the second partition number threshold, then the third threshold is set as the similarity threshold, and the third threshold is less than the second threshold.

5. The display device according to claim 1, characterized in that, The controller executes the step of memory consolidation of memory fragments through the first task process, specifically configured as follows: Retrieve the preset process file used to create the first task process from the local configuration file; A trigger value is written into the preset process file to create the first task process; The first task process performs memory consolidation on the memory fragments collected in the system memory to obtain contiguous memory blocks.

6. The display device according to claim 1, characterized in that, If the backlight similarity is greater than or equal to the similarity threshold, the controller is further configured to: Update the second backlight brightness to the first backlight brightness; Mark the backlight brightness of the next frame of the second image as the second backlight brightness; The target area is updated based on the updated first backlight brightness and the current second backlight brightness.

7. The display device according to claim 6, characterized in that, The controller is further configured to perform the step of recording the duration of the backlight similarity. If the target region is updated, the backlight similarity is updated based on the updated target region; If the updated backlight similarity is less than the similarity threshold, then the duration is reset.

8. The display device according to claim 1, characterized in that, The controller executes the step of memory consolidation of memory fragments through the first task process, specifically configured as follows: Iterate through the application processes currently running on the display device to obtain the application load. Calculate the first load of the display device based on the application load; If the first load is greater than the load threshold, the first task process performs memory consolidation on the memory fragments to obtain memory blocks with contiguous addresses.

9. The display device according to claim 8, characterized in that, If the first load is less than or equal to the load threshold, the controller is further configured to: Get the runtime of each application process running in the background; Shut down application processes whose runtime is greater than or equal to the runtime threshold to release the application load of the application processes.

10. A memory consolidation method, characterized in that, Applied to a display device, the display device including a display, configured to display a user interface; Controller; the method includes: During the display process of the display device displaying the screen, the first backlight brightness of the first screen and the second backlight brightness of the second screen are obtained, and the second screen is the screen displayed after the first screen; A mark is added to the display area where the brightness difference between the first backlight brightness and the second backlight brightness is less than or equal to the difference threshold to obtain the target area; The backlight similarity between the first backlight brightness and the second backlight brightness is calculated based on the area ratio of the target area to the display area corresponding to the second backlight brightness. If the backlight similarity is greater than or equal to the similarity threshold, record the duration of the backlight similarity. When the duration is greater than or equal to the duration threshold, the first task process performs memory consolidation on the memory fragments to obtain memory blocks with contiguous addresses.

Images