Screen control method and device, equipment and medium

Abstract

The embodiment of the invention provides a screen control method and device, equipment and a medium, which are used for reducing the power consumption of an optical machine and improving the cruising ability of display equipment. Obtaining an index parameter of a target frame of a projection picture of the ray machine; determining the picture complexity of the target frame of the projection picture of the ray machine according to the index parameters; determining a target screen display resolution according to the picture complexity; and controlling an optical machine to display the target frame of the projection picture of the optical machine at the target screen display resolution. In the application, a common method of displaying all pictures with the same resolution is changed, different pictures are displayed with different resolutions, and on the premise of ensuring the same or similar display effects, the power consumption of an optical machine is reduced, and the cruising ability of the display equipment is improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of display devices, and specifically to a screen control method and its apparatus, equipment, and medium. Background Art

[0002] In recent years, an optical machine, an optical machine control method and an AR near-eye display device have emerged. The optical machine includes: an image source; a projection component, which is arranged in the light emitting direction of the image source; a micro-motion component, which is physically connected to the image source to drive the image source, and / or physically connected to the projection component to drive the projection component; a control and driving component, which is connected to the image source and the micro-motion component to control the image source and the micro-motion component; during the micro-motion component driving process, the position of the projection component projected on the projection plane of the optical machine moves and the image source can be lit several times. The light emitted by the image source is projected out through the projection component. During the projection process, the micro-motion component drives the image source and / or the projection component to move rapidly with a small pitch, so that the position and / or angle of the light changes, and the position of the projection component projected on the projection plane of the optical machine moves, which increases the number of light emitted within a preset time interval and improves the resolution of the image observed by the human eye.

[0003] In order to ensure a good display effect and user experience, the display device in the related art requires the optical machine to maintain a high resolution for display, which results in high power consumption and poor battery life. Summary of the invention

[0004] The embodiments of the present application provide a screen control method and its apparatus, device, and medium, which are used to reduce the power consumption of an optical machine and improve the battery life of a display device.

[0005] A first aspect of an embodiment of the present application provides a screen control method, which is applied to a display device, and the method includes:

[0006] Obtain the index parameters of the target frame of the optical machine projection screen;

[0007] Determine the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0008] Determining a target screen display resolution according to the picture complexity;

[0009] The optical machine is controlled to display the target frame of the optical machine projection picture at the target screen display resolution.

[0010] Based on the first aspect of the embodiment of the present application, in a first implementation manner of the first aspect of the embodiment of the present application, determining the target screen display resolution according to the picture complexity includes:

[0011] If the picture complexity is greater than or equal to a preset complexity threshold, determining the default resolution as the target screen display resolution;

[0012] or,

[0013] If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0014] Based on the first aspect of the embodiment of the present application or the first implementation of the first aspect, in the second implementation of the first aspect of the embodiment of the present application, determining the target screen display resolution according to the picture complexity includes:

[0015] Acquire a preset number of the most recent continuous frames before the target frame of the optical-mechanical projection picture;

[0016] Calculating the comprehensive picture complexity of the preset number of most recent consecutive frames;

[0017] If the difference between the comprehensive complexity of the picture and the preset complexity threshold is less than the difference threshold, the target screen display resolution of the optical projection picture target frame is determined to be the same as the previous frame of the optical projection picture target frame.

[0018] Based on the first aspect of the embodiment of the present application, any one of the first implementation manner and the second implementation manner of the first aspect, in a third implementation manner of the first aspect of the embodiment of the present application, the method further includes:

[0019] If the difference between the comprehensive picture complexity and the preset complexity threshold is greater than or equal to the difference threshold, determining whether the picture complexity is less than the preset complexity threshold;

[0020] If the picture complexity is greater than or equal to the preset complexity threshold, determining the default resolution as the target screen display resolution;

[0021] If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0022] Based on the first aspect of the embodiment of the present application, and any one of the first implementation to the third implementation of the first aspect, in a fourth implementation of the first aspect of the embodiment of the present application, determining the picture complexity of the target frame of the optical machine projection picture according to the indicator parameter includes:

[0023] If the target frame of the optical machine projection picture is a grayscale image, the picture complexity is calculated using an entropy calculation formula according to the index parameter, and the index parameter includes grayscale information;

[0024] If the target frame of the optical projection picture is a color image, the color image is converted into multiple grayscale images according to the color channel, and the picture complexity of each grayscale image is calculated using the entropy calculation formula according to the index parameters of each grayscale image, and the picture complexity of the target frame of the optical projection picture is calculated according to the picture complexity of the multiple grayscale images.

[0025] Based on the first aspect of the embodiment of the present application, and any one of the first implementation manner to the fourth implementation manner of the first aspect, in a fifth implementation manner of the first aspect of the embodiment of the present application, after determining the target screen display resolution according to the picture complexity, after determining the target screen display resolution according to the picture complexity, the method further includes:

[0026] According to the target screen display resolution, the display parameters of the target frame of the optical machine projection picture are adjusted, and after adjusting the display parameters, the step of controlling the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution is performed, wherein the display parameters include at least one of the following: sharpness, contrast and saturation.

[0027] Based on the first aspect of the embodiment of the present application, and any one of the first implementation to the fifth implementation of the first aspect, in a sixth implementation of the first aspect of the embodiment of the present application, after obtaining the index parameters of the target frame of the optical machine projection screen, the method further includes:

[0028] Determine the rendering calculation amount of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0029] Computing power is allocated according to the rendering calculation amount to render the target frame of the optical machine projection picture.

[0030] A second aspect of an embodiment of the present application provides a screen control device, including:

[0031] An acquisition unit, used to acquire index parameters of a target frame of an optical-mechanical projection image;

[0032] A complexity determination unit, used to determine the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0033] A resolution determination unit, used to determine a target screen display resolution according to the picture complexity;

[0034] The display unit is used to control the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution.

[0035] Based on the second aspect of the embodiment of the present application, in a first implementation manner of the second aspect of the embodiment of the present application, the resolution determination unit is specifically used to:

[0036] If the picture complexity is greater than or equal to a preset complexity threshold, determining the default resolution as the target screen display resolution;

[0037] or,

[0038] If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0039] Based on the second aspect of the embodiment of the present application or the first implementation of the second aspect, in the second implementation of the second aspect of the embodiment of the present application, the resolution determination unit is specifically used to:

[0040] Acquire a preset number of the most recent continuous frames before the target frame of the optical-mechanical projection picture;

[0041] Calculating the comprehensive picture complexity of the preset number of most recent consecutive frames;

[0042] If the difference between the comprehensive complexity of the picture and the preset complexity threshold is less than the difference threshold, the target screen display resolution of the optical projection picture target frame is determined to be the same as the previous frame of the optical projection picture target frame.

[0043] Based on the second aspect of the embodiment of the present application, the first implementation manner of the second aspect, and any one of the second implementation manners, in a third implementation manner of the second aspect of the embodiment of the present application, the device further includes a judgment unit, which is used to:

[0044] If the difference between the comprehensive picture complexity and the preset complexity threshold is greater than or equal to the difference threshold, determining whether the picture complexity is less than the preset complexity threshold;

[0045] If the picture complexity is greater than or equal to the preset complexity threshold, determining the default resolution as the target screen display resolution;

[0046] If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0047] Based on the second aspect of the embodiment of the present application, and any one of the first implementation manner to the third implementation manner of the second aspect, in a fourth implementation manner of the second aspect of the embodiment of the present application, the complexity determination unit is specifically used to:

[0048] If the target frame of the optical machine projection picture is a grayscale image, the picture complexity is calculated using an entropy calculation formula according to the index parameter, and the index parameter includes grayscale information;

[0049] If the target frame of the optical projection picture is a color image, the color image is converted into multiple grayscale images according to the color channel, and the picture complexity of each grayscale image is calculated using the entropy calculation formula according to the index parameters of each grayscale image, and the picture complexity of the target frame of the optical projection picture is calculated according to the picture complexity of the multiple grayscale images.

[0050] Based on the second aspect of the embodiment of the present application and any one of the first to fourth implementations of the second aspect, in a fifth implementation of the second aspect of the embodiment of the present application, the device further includes a post-optimization unit, which is used to:

[0051] According to the target screen display resolution, the display parameters of the target frame of the optical machine projection picture are adjusted, and after adjusting the display parameters, the step of controlling the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution is performed, wherein the display parameters include at least one of the following: sharpness, contrast and saturation.

[0052] Based on the second aspect of the embodiment of the present application and any one of the first to fifth implementations of the second aspect, in a sixth implementation of the second aspect of the embodiment of the present application, the apparatus further includes a rendering unit, which is used to:

[0053] Determine the rendering calculation amount of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0054] Computing power is allocated according to the rendering calculation amount to render the target frame of the optical machine projection picture.

[0055] It can be seen from the above technical solutions that the embodiments of the present application have the following advantages:

[0056] In this application, the common method of displaying all pictures with the same resolution is changed, and different resolutions are used for displaying different pictures. The higher the picture complexity, the higher the screen display resolution is used for display; the lower the picture complexity, the lower the screen display resolution is used for display. At the same time, in order to quantify the complexity of the picture, the picture complexity is calculated using indicator parameters. Since the higher the screen display resolution of the optical machine is displayed, the higher the power consumption of the optical machine is; the lower the screen display resolution of the optical machine is displayed, the lower the power consumption of the optical machine is. For pictures with low picture complexity, using a higher screen display resolution will not significantly improve the display effect. Therefore, adjusting the screen display resolution according to the complexity of the picture can reduce the power consumption of the optical machine and improve the battery life of the display device while ensuring the same or similar display effect.

[0057] A third aspect of the embodiments of the present application provides a computer device, including:

[0058] CPU, memory, input and output interfaces, wired or wireless network interfaces, and power supply;

[0059] The memory is either transient storage memory or persistent storage memory;

[0060] The central processing unit is configured to communicate with the memory and execute instructions in the memory to perform the method of the first aspect.

[0061] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium, which includes instructions. When the instructions are executed on a computer, the computer executes the method of the first aspect.

[0062] A fifth aspect of the embodiments of the present application provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to execute the method of the first aspect.

[0063] The sixth aspect of an embodiment of the present application provides a chip system, which includes at least one processor and a communication interface, the communication interface and at least one processor are interconnected through lines, and the at least one processor is used to run a computer program or instruction to execute the method of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0064] Figure 1 , Figures 4 to 8 are various flow charts of the screen control method of the embodiment of the present application;

[0065] Figures 2 to 3 Schematic diagrams of various structures of the screen control device according to the embodiment of the present application;

[0066] Fig. 9 It is an architectural diagram of a computer device according to an embodiment of the present application. DETAILED DESCRIPTION

[0067] like Figure 1 As shown, the present application provides a screen control method, which is applied to a display device, and the method includes:

[0068] 101. Obtain index parameters of a target frame of an optical machine projection image;

[0069] The optical projection picture target frame is a frame selected from the picture to be displayed. Optionally, the optical projection picture target frame can be the next frame of the picture currently displayed by the display device, or other frames, without specific restrictions. The index parameters of the optical projection picture target frame are determined by the optical projection picture target frame itself, and are used to describe the properties of the optical projection picture target frame. The display device uses an optical machine as a light source, and the optical machine is a light projector. The optical machine projects the picture onto the imaging plane of the display device, so that the display device can display the picture.

[0070] The embodiments of the present application may be applied to extended reality (Extended Reality, XR), which includes augmented reality (Augmented Reality, AR), virtual reality (Virtual Reality, VR) and mixed reality (Mixed Reality, MR), etc. The embodiments of the present application may also be applied to other display devices, without specific limitation.

[0071] 102. Determine the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0072] The image complexity of the target frame of the optical projection screen is analyzed using the index parameters. After the index parameters of the target frame of the optical projection screen are collected, the index parameters are used to measure the image complexity of the target frame of the optical projection screen. The higher the image complexity, the more details, differences and contrasts there are in the image. It is generally believed that the higher the image complexity, the higher the screen display resolution required to achieve the same or similar display effect.

[0073] 103. Determine a target screen display resolution according to the picture complexity;

[0074] Adjust the target screen display resolution according to the complexity of the picture. In principle, the lower the picture complexity, the lower the target screen display resolution. When adjusting the target screen display resolution, the picture complexity is used as the basis. Generally speaking, high picture complexity corresponds to high target screen display resolution, and low picture complexity corresponds to low target screen display resolution. In order to achieve the same or similar display effect, pictures with higher picture complexity need to be displayed at a higher screen display resolution; pictures with lower picture complexity need to be displayed at a lower screen display resolution. The higher the screen display resolution, the greater the optical power consumption; the lower the screen display resolution, the lower the optical power consumption. Because high screen display resolution is not used to display pictures with low picture complexity, it can reduce the optical power consumption while ensuring the user experience.

[0075] 104. Control the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution.

[0076] Each frame of the optical machine projection screen is played in sequence, and the target frame of the optical machine projection screen is a frame selected from the screen to be displayed. The screen display resolution of each frame of the optical machine projection screen is determined, and each frame of the optical machine projection screen is displayed at the corresponding screen display resolution. The optical machine projects the screen on the screen to complete the display.

[0077] Optionally, the optical engine may be a MicroLED optical engine. In addition, other optical engines may be selected without any specific restrictions.

[0078] Optionally, before step 101, vertical synchronization (Vertical Synchronization, VSync) and synchronization fence technology are used to draw the target frame of the optical projection screen to achieve the refresh of the user interface (User Interface, UI). Specifically, after generating the optical projection screen drawing application, insert the synchronization fence; request the VSync signal from the VSync signal generation and dispatching server; after receiving the VSync signal returned by the VSync signal generation and dispatching server, delete the synchronization fence and refresh the UI. It should be noted that in addition to using vertical synchronization and synchronization fence technology to draw the target frame of the optical projection screen, other methods can also be used to draw the target frame of the optical projection screen.

[0079] In this application, the common method of displaying all pictures with the same resolution is changed, and different resolutions are used for displaying different pictures. The higher the picture complexity, the higher the screen display resolution is used for display; the lower the picture complexity, the lower the screen display resolution is used for display. At the same time, in order to quantify the complexity of the picture, the picture complexity is calculated using indicator parameters. Since the higher the screen display resolution of the optical machine is displayed, the higher the power consumption of the optical machine is; the lower the screen display resolution of the optical machine is displayed, the lower the power consumption of the optical machine is. For pictures with low picture complexity, using a higher screen display resolution will not significantly improve the display effect. Therefore, adjusting the screen display resolution according to the complexity of the picture can reduce the power consumption of the optical machine and improve the battery life of the display device while ensuring the same or similar display effect.

[0080] In one implementation of the embodiment of the present application, the indicator parameters include image resolution, brightness, contrast or saturation.

[0081] Calculate the image resolution, brightness, contrast or saturation and other index parameters of the target frame of the optical projection picture. After calculating the values ​​of the index parameters, calculate the picture complexity of the target frame of the optical projection picture according to the values ​​of the index parameters. When using the index parameters to calculate the picture complexity, you can use weighted summation, weighted average and other methods, without specific restrictions. Generally speaking, the higher the image resolution, the higher the picture complexity, and the lower the image resolution, the lower the picture complexity; the higher the brightness, the higher the picture complexity, and the lower the brightness, the lower the picture complexity; the higher the contrast, the higher the picture complexity, and the lower the contrast, the lower the picture complexity; the higher the saturation, the higher the picture complexity, and the lower the saturation, the lower the picture complexity.

[0082] It should be noted that the indicator parameters may also include file size, file format, etc., without specific limitation.

[0083] Optionally, the indicator parameters include sharpness, contrast and saturation. The values ​​of sharpness, contrast and saturation are mainly used for statistical features, texture, edge information, etc.

[0084] For example: use the values ​​of sharpness, contrast and saturation to calculate some simple statistical features, such as mean: (Σpixel) / number of pixels, variance: (Σ(pixel-mean)^2) / number of pixels, skewness: [(Σ(pixel-mean)^3) / number of pixels] / (standard deviation^3), kurtosis: [(Σ(pixel-mean)^4) / number of pixels] / (standard deviation^4), etc.

[0085] These statistical features can be used to describe the overall brightness distribution, contrast variation, and color saturation of an image.

[0086] like Figure 4 As shown, in one implementation of the embodiment of the present application, determining the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter includes:

[0087] 401. If the target frame of the optical machine projection picture is a grayscale image, the picture complexity is calculated using an entropy calculation formula according to the index parameter, and the index parameter includes grayscale information;

[0088] If the target frame of the optical machine projection image is a grayscale image, the image complexity is calculated using the index parameters and the entropy calculation formula;

[0089] The entropy calculation formula is used to calculate the complexity of the picture, for example:

[0090] Grayscale image H = -Σ(p(i)*log2(p(i)));

[0091] Among them, H represents the entropy of the image, and p(i) represents the probability of gray level i in the image. For each gray level i, its frequency of occurrence in the image can be calculated and divided by the total number of pixels in the image to obtain p(i).

[0092] 402. If the target frame of the optical projection picture is a color image, the color image is converted into multiple grayscale images according to the color channel, and the picture complexity of each grayscale image is calculated using the entropy calculation formula according to the index parameters of each grayscale image, and the picture complexity of the target frame of the optical projection picture is calculated according to the picture complexity of the multiple grayscale images.

[0093] Since grayscale information is needed, the processing of grayscale images and color images is not exactly the same. Color images are multi-channel images, and the entropy calculation formula for each channel can be calculated separately, and the entropy of all channels can be averaged to obtain the overall entropy of the image.

[0094] Steps to calculate entropy of color images: 1. Convert color to grayscale image and perform weighted average on each channel (such as using the formula Y=0.299R+0.587G+0.114B); 2. Calculate the frequency of occurrence of each grayscale level; 3. Use the entropy calculation formula.

[0095] Either step 401 or step 402 is performed.

[0096] In one implementation of the embodiment of the present application, the image complexity of the target frame of the optical machine projection image is analyzed by using the index parameter, specifically including:

[0097] The graph database and deep learning algorithm are used to analyze the index parameters of the target frame of the optical-mechanical projection image, and the image complexity of the target frame of the optical-mechanical projection image is obtained.

[0098] The graphic database can be an image processing library (such as OpenCV) or a graphics programming library (such as OpenGL ES). Use the OpenCV image processing library to perform image processing and analysis operations on each frame of the optical projection screen; or use the OpenGLES graphics programming library to process and analyze pixel data on each frame of the optical projection screen. The graphic database can also be called a graph database, which is a database used for computer vision and machine learning. There are a large number of structured or labeled images in the graphic database, which can be used as training materials for machine learning. The data in the graphic database is used as training data. The training data is a graph that has been annotated with the complexity of the picture, and the index parameters of the training data are also known. Use the graphic database and the deep learning algorithm to train a neural network. This neural network can establish a connection between the index parameters and the complexity of the picture, that is, input the index parameters to the neural network, and the neural network can output the complexity of the picture. Therefore, the various index parameters of the target frame of the optical projection picture are input into the neural network, and the neural network outputs the picture complexity of the target frame of the optical projection picture.

[0099] like Figure 5 As shown, in one implementation of the embodiment of the present application, after obtaining the index parameters of the target frame of the optical machine projection screen, the method further includes:

[0100] 501. Determine the rendering calculation amount of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0101] The amount of rendering calculation refers to the computing resources required to render the image. Generally speaking, the higher the complexity of the picture, the greater the amount of rendering calculation; the lower the complexity of the picture, the smaller the amount of rendering calculation. The indicator parameters can be used to calculate the amount of rendering calculation of the target frame of the optical projection picture.

[0102] 502. Allocate computing power according to the rendering calculation amount to render the target frame of the optical machine projection picture.

[0103] The larger the rendering calculation amount, the more processing cores are allocated, or faster processing cores are allocated, or longer core occupation time is allocated; the smaller the rendering calculation amount, the fewer processing cores are allocated, or slower processing cores are allocated, or shorter core occupation time is allocated, so as to shorten the rendering time and achieve better rendering effect.

[0104] In addition to using a graph database and a deep learning algorithm to obtain the complexity of the picture, you can also use a graph database and a deep learning algorithm to obtain the amount of computation required to process the picture. At this time, the data in the graph database is needed as training data. The training data is a graph that has been labeled with the amount of computation required to process the picture, and the index parameters of the training data are also known. Use a graph database and a deep learning algorithm to train a neural network. This neural network can establish a connection between the index parameters and the amount of computation required to process the picture, that is, input the index parameters into the neural network, and the neural network can output the amount of computation required to process the picture. The amount of computation required to process the picture refers to the amount of computation required to render, position, and other processing of the optical machine projection picture. Obtaining the amount of computation required to process the picture can reasonably allocate the system's computing resources.

[0105] It should be noted that in addition to using deep learning algorithms to analyze indicator parameters, the complexity of the picture can also be obtained by manually setting weights for each indicator parameter and adding them up.

[0106] like Figure 6 As shown, in one implementation of the embodiment of the present application, determining the target screen display resolution according to the picture complexity includes:

[0107] 601. If the picture complexity is greater than or equal to a preset complexity threshold, determine a default resolution as the target screen display resolution;

[0108] Use default resolution as the default screen display resolution.

[0109] or,

[0110] 602. If the picture complexity is less than the preset complexity threshold, determine that the adjusted resolution is the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0111] Optionally, if the image complexity exceeds the preset complexity threshold, the default screen display resolution is maintained, and no larger resolution is used, to ensure that power consumption does not increase. On the contrary, if the image complexity does not exceed the preset complexity threshold, the resolution is adjusted to a smaller resolution than the default screen display resolution, thereby reducing the overall output power consumption of the optical machine and the power consumption of the system load operation.

[0112] Set the complexity threshold. If the picture complexity is greater than the complexity threshold, select a higher screen display resolution; if the picture complexity is less than or equal to the complexity threshold, select a lower screen display resolution. You can set multiple complexity thresholds, corresponding to multiple screen display resolutions, to achieve fine-tuning of the screen display resolution and make the display effect more stable. For example, if two complexity thresholds are set, the picture complexity is divided into three segments, corresponding to three different sizes of screen display resolutions; if three complexity thresholds are set, the picture complexity is divided into four segments, corresponding to four different sizes of screen display resolutions.

[0113] In actual use, you can choose a brightness range of 80-120cd / m 2 The contrast range is between 800:1 and 1000:1, and the applicable resolution range is 720P-1080P. Select 720P as the screen display resolution to reduce the overall system load, reduce optical power consumption, and improve battery life.

[0114] Step 601 to step 602 are executed one by one.

[0115] like Figure 7 As shown, in one implementation of the embodiment of the present application, determining the target screen display resolution according to the picture complexity includes:

[0116] 701. Acquire a preset number of the most recent continuous frames before the target frame of the optical-mechanical projection picture;

[0117] The most recent consecutive frames of the optical projection screen target frame refer to the previous consecutive frames based on the optical projection screen target frame. For example, a video has 1000 frames, the optical projection screen target frame is the 101st frame, and the preset number is 10, then the preset number of the most recent consecutive frames is the 91st frame to the 100th frame. The preset number of the most recent consecutive frames can be 1, 2, 3, 4, 5, 6, 7, 8... There is no specific limitation.

[0118] 702. Calculate the comprehensive picture complexity of the preset number of most recent consecutive frames;

[0119] The comprehensive picture complexity may be the average or median of the picture complexity of a preset number of most recent consecutive frames. For example, if the preset number is 16, the picture complexity of the 16 frames is averaged to obtain the comprehensive picture complexity. The comprehensive picture complexity may also be other statistical values, which are not specifically limited.

[0120] 703. If the difference between the comprehensive complexity of the picture and the preset complexity threshold is less than the difference threshold, the target screen display resolution of the optical-mechanical projection picture target frame is determined to be the same as the previous frame of the optical-mechanical projection picture target frame.

[0121] Determine the same target screen display resolution for the previous frame of the optical-mechanical projection picture target frame and the optical-mechanical projection picture target frame. Take the absolute value of the difference between the comprehensive complexity of the picture and the preset complexity threshold. If the absolute value of the difference is less than the difference threshold, it means that the comprehensive complexity of the picture is very close to the preset complexity threshold. In this case, the most recent continuous frames and the optical-mechanical projection picture target frame may frequently cross the preset complexity threshold. For example, among the 4 most recent continuous frames, the first frame is greater than the preset complexity threshold, the second frame is less than the preset complexity threshold, the third frame is greater than the preset complexity threshold, and the fourth frame is less than the preset complexity threshold. At the same time, the optical-mechanical projection picture target frame is greater than the preset complexity threshold. If the screen display resolution is adjusted only according to the picture complexity of each frame itself, the screen display resolution will be frequently adjusted, which will increase power consumption. Therefore, when determining the screen display resolution of each frame, it is necessary to consider a preset number of the most recent consecutive frames. If the comprehensive picture complexity of the preset number of the most recent consecutive frames is far from the preset complexity threshold, there is no need to consider how to avoid the problem of frequent adjustment of the screen display resolution; if the comprehensive picture complexity of the preset number of the most recent consecutive frames is close to the preset complexity threshold, it is necessary to consider how to avoid the problem of frequent adjustment of the screen display resolution. The way to avoid frequent adjustment of the screen display resolution is that if the difference between the comprehensive picture complexity and the preset complexity threshold is less than the difference threshold, the screen display resolution is not changed, that is, the target screen display resolution of the optical projection picture target frame remains the same as the previous frame of the optical projection picture target frame.

[0122] like Figure 8 As shown, in one implementation of the embodiment of the present application, the method further includes:

[0123] 801. If the difference between the comprehensive picture complexity and the preset complexity threshold is greater than or equal to the difference threshold, determine whether the picture complexity is less than the preset complexity threshold;

[0124] If the difference between the comprehensive picture complexity and the preset complexity threshold is greater than or equal to the difference threshold, it means that the comprehensive picture complexity of the preset number of most recent consecutive frames is far from the preset complexity threshold, so there is no need to consider how to avoid the problem of frequent adjustment of the screen display resolution. The picture complexity of the optical projection picture target frame is compared with the preset complexity threshold to determine the target screen display resolution of the optical projection picture target frame based on the picture complexity of the optical projection picture target frame.

[0125] 802. If the picture complexity is greater than or equal to the preset complexity threshold, determine the default resolution as the target screen display resolution;

[0126] Step 802 is similar to step 601 and will not be described again here.

[0127] 803. If the picture complexity is less than the preset complexity threshold, determine that the adjusted resolution is the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0128] Step 803 is similar to step 602 and will not be described again here.

[0129] In an implementation of the embodiment of the present application, after determining the target screen display resolution according to the picture complexity, after determining the target screen display resolution according to the picture complexity, the method further includes:

[0130] According to the target screen display resolution, the display parameters of the target frame of the optical machine projection picture are adjusted, and after adjusting the display parameters, the step of controlling the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution is performed, wherein the display parameters include at least one of the following: sharpness, contrast and saturation.

[0131] Before controlling the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution, the display parameters such as sharpness, contrast or saturation of the target frame of the optical machine projection picture are adjusted according to the target screen display resolution to compensate for the display effect degradation caused by the resolution reduction, so that the display effect can be as close as possible to that before the resolution reduction. In addition, the display parameters may also include other parameters, which are not specifically limited.

[0132] In order to minimize or eliminate the degradation of display effect caused by reducing the screen display resolution, after adjusting the screen display resolution, the target frame of the optical projection screen is debugged to improve the image clarity and color reproduction, so as to improve the display effect of the target frame of the optical projection screen.

[0133] Generally speaking, in order to improve the display effect, the sharpness, contrast and saturation need to be improved. The specific amount of improvement needs to be determined according to the difference or ratio between the adjusted resolution and the default resolution. The larger the difference or ratio between the adjusted resolution and the default resolution, the more the sharpness, contrast and saturation are improved; the smaller the difference or ratio between the adjusted resolution and the default resolution, the less the sharpness, contrast and saturation are improved.

[0134] Optionally, a matrix operation is performed on the target frame of the optical projection picture so that the target frame of the optical projection picture is adjusted to the target screen display resolution. The optical projection picture is stored in the form of a matrix, and the target frame of the optical projection picture is adjusted using matrix operations, which is convenient and efficient. Matrix operations include scaling, rotation, translation, etc. Then, according to the parameters used in the matrix operation, the target frame of the optical projection picture at the target screen display resolution is debugged. The parameters used in the matrix operation can be scaling ratio, rotation angle, translation distance, etc., or intermediate quantities without physical meaning. The parameters used in the matrix operation are used to adjust the sharpness, contrast or saturation of the target frame of the optical projection picture. Among them, the parameters used in the matrix operation can be used through convolution operations, linear transformations, spatial transformations, etc.

[0135] The following is an explanation of "adjusting the sharpness, contrast or saturation of the target frame of the optical projection screen by using the parameters used in the matrix operation":

[0136] Sharpness is the clarity of edges and details in an image. Increasing sharpness can make the edges of an image clearer and the details more prominent. For example, according to the parameters used in the matrix operation, through convolution operations, the changes in pixel values ​​are emphasized, thereby enhancing edges and details.

[0137] Contrast is the degree of difference between light and dark pixels in an image. Increasing contrast can make the light and dark areas of an image more distinct, improving the visual effect of the image. For example, according to the parameters used in matrix operations, by linear transformation and scaling to a certain ratio, the difference between pixel values ​​can be enlarged, thereby increasing contrast.

[0138] Saturation refers to the vividness of the colors in an image. Increasing saturation can make the colors of an image more vivid, while decreasing saturation will make the colors more diluted. For example: according to the parameters used in the matrix operation, convert from RGB color space to HSV (hue, saturation, value) color space, and then adjust the value of the saturation channel to change the saturation of the image.

[0139] The comprehensive application of convolution operations, linear transformations, spatial conversions and other methods can achieve comprehensive optimization of screen display effects, improve image clarity, color reproduction and detail retention, meet user demands for picture quality, and compensate for the reduction in picture quality caused by reducing the screen display resolution.

[0140] Convolution operations, linear transformations, spatial conversions and other methods can all be used to adjust images using image processing libraries (such as OpenCV) or graphics programming libraries (such as OpenGLES). Graphics databases provide a wealth of image processing functions and algorithms, and the specific implementation steps and parameter settings can be adjusted and optimized based on the selected libraries and algorithms.

[0141] In addition, other image processing algorithms can be used to improve picture quality and ensure that details and colors are preserved.

[0142] like Figure 2 As shown, the present application provides a screen control device, comprising:

[0143] An acquisition unit 201 is used to acquire index parameters of a target frame of an optical machine projection picture;

[0144] A complexity determination unit 202, configured to determine the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0145] A resolution determination unit 203, configured to determine a target screen display resolution according to the picture complexity;

[0146] The display unit 204 is used to control the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution.

[0147] In one implementation of the embodiment of the present application, the resolution determination unit 203 is specifically configured to:

[0148] If the picture complexity is greater than or equal to a preset complexity threshold, determining the default resolution as the target screen display resolution;

[0149] or,

[0150] If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0151] In one implementation of the embodiment of the present application, the resolution determination unit 203 is specifically configured to:

[0152] Acquire a preset number of the most recent continuous frames before the target frame of the optical-mechanical projection picture;

[0153] Calculating the comprehensive picture complexity of the preset number of most recent consecutive frames;

[0154] If the difference between the comprehensive complexity of the picture and the preset complexity threshold is less than the difference threshold, the target screen display resolution of the optical projection picture target frame is determined to be the same as the previous frame of the optical projection picture target frame.

[0155] like Figure 3 As shown, in one implementation of the embodiment of the present application, the device further includes a judging unit 301, which is used to:

[0156] If the difference between the comprehensive picture complexity and the preset complexity threshold is greater than or equal to the difference threshold, determining whether the picture complexity is less than the preset complexity threshold;

[0157] If the picture complexity is greater than or equal to the preset complexity threshold, determining the default resolution as the target screen display resolution;

[0158] If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

[0159] In one implementation of the embodiment of the present application, the complexity determination unit 202 is specifically configured to:

[0160] If the target frame of the optical machine projection picture is a grayscale image, the picture complexity is calculated using an entropy calculation formula according to the index parameter, and the index parameter includes grayscale information;

[0161] If the target frame of the optical projection picture is a color image, the color image is converted into multiple grayscale images according to the color channel, and the picture complexity of each grayscale image is calculated using the entropy calculation formula according to the index parameters of each grayscale image, and the picture complexity of the target frame of the optical projection picture is calculated according to the picture complexity of the multiple grayscale images.

[0162] In one implementation of the embodiment of the present application, the apparatus further includes a post-optimization unit 302, which is configured to:

[0163] According to the target screen display resolution, the display parameters of the target frame of the optical machine projection picture are adjusted, and after adjusting the display parameters, the step of controlling the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution is performed, wherein the display parameters include at least one of the following: sharpness, contrast and saturation.

[0164] In an implementation of the embodiment of the present application, the device further includes a rendering unit 303, which is used to:

[0165] Determine the rendering calculation amount of the target frame of the optical-mechanical projection picture according to the indicator parameter;

[0166] Computing power is allocated according to the rendering calculation amount to render the target frame of the optical machine projection picture.

[0167] like Fig. 9 As shown, the embodiment of the present application further provides a computer device 900, including:

[0168] CPU 901, memory 905, input / output interface 904, wired or wireless network interface 903 and power supply 902;

[0169] The memory 905 is a temporary storage memory or a permanent storage memory;

[0170] The CPU 901 is configured to communicate with the memory 905 and execute instructions in the memory 905 to perform the following operations: Figure 1 The method in the illustrated embodiment.

[0171] The embodiment of the present application also provides a computer-readable storage medium, the computer-readable storage medium includes instructions, when the instructions are executed on a computer, the computer executes the following Figure 1 The method in the illustrated embodiment.

[0172] The present application also provides a computer program product including instructions, which, when executed on a computer, causes the computer to execute the following Figure 1 The method in the illustrated embodiment.

[0173] The embodiment of the present application also provides a chip system, which includes at least one processor and a communication interface, wherein the communication interface and the at least one processor are interconnected through a line, and the at least one processor is used to run a computer program or instruction to execute the following steps: Figure 1 The method in the illustrated embodiment.

[0174] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0175] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0176] The terms "first", "second", "third", "fourth", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that shown or described herein.

[0177] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.

[0178] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0179] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0180] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, read-only memory), random access memory (RAM, random access memory), disk or optical disk and other media that can store program code.

Claims

1. A screen control method, characterized in that: The screen control method is applied to a display device, and the method comprises: Obtain the index parameters of the target frame of the optical machine projection screen; Determine the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter; Determining a target screen display resolution according to the picture complexity; The optical machine is controlled to display the target frame of the optical machine projection picture at the target screen display resolution.

2. The screen control method according to claim 1, characterized in that: The determining the target screen display resolution according to the picture complexity includes: If the picture complexity is greater than or equal to a preset complexity threshold, determining the default resolution as the target screen display resolution; or, If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

3. The screen control method according to claim 1, characterized in that: The determining the target screen display resolution according to the picture complexity includes: Acquire a preset number of the most recent continuous frames before the target frame of the optical-mechanical projection picture; Calculating the comprehensive picture complexity of the preset number of most recent consecutive frames; If the difference between the comprehensive complexity of the picture and the preset complexity threshold is less than the difference threshold, the target screen display resolution of the optical projection picture target frame is determined to be the same as the previous frame of the optical projection picture target frame.

4. The screen control method according to claim 3, characterized in that: The method further comprises: If the difference between the comprehensive picture complexity and the preset complexity threshold is greater than or equal to the difference threshold, determining whether the picture complexity is less than the preset complexity threshold; If the picture complexity is greater than or equal to the preset complexity threshold, determining the default resolution as the target screen display resolution; If the picture complexity is less than the preset complexity threshold, the adjusted resolution is determined to be the target screen display resolution, and the adjusted resolution is less than the default resolution.

5. The screen control method according to claim 1, characterized in that: The determining the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter includes: If the target frame of the optical machine projection picture is a grayscale image, the picture complexity is calculated using an entropy calculation formula according to the index parameter, and the index parameter includes grayscale information; If the target frame of the optical projection picture is a color image, the color image is converted into multiple grayscale images according to the color channel, and the picture complexity of each grayscale image is calculated using the entropy calculation formula according to the index parameters of each grayscale image, and the picture complexity of the target frame of the optical projection picture is calculated according to the picture complexity of the multiple grayscale images.

6. The screen control method according to claim 1, characterized in that: After determining the target screen display resolution according to the picture complexity, after determining the target screen display resolution according to the picture complexity, the method further includes: According to the target screen display resolution, the display parameters of the target frame of the optical projection picture are adjusted, and after adjusting the display parameters, the step of controlling the optical machine to display the target frame of the optical projection picture at the target screen display resolution is performed, wherein the display parameters include at least one of the following: sharpness, contrast and saturation 。 7. The screen control method according to claim 1, characterized in that: After obtaining the index parameters of the target frame of the optical-mechanical projection picture, the method further includes: Determine the rendering calculation amount of the target frame of the optical-mechanical projection picture according to the indicator parameter; Computing power is allocated according to the rendering calculation amount to render the target frame of the optical machine projection picture.

8. A screen control device, characterized in that: include: An acquisition unit, used to acquire index parameters of a target frame of an optical-mechanical projection image; A complexity determination unit, used to determine the picture complexity of the target frame of the optical-mechanical projection picture according to the indicator parameter; A resolution determination unit, used to determine a target screen display resolution according to the picture complexity; The display unit is used to control the optical machine to display the target frame of the optical machine projection picture at the target screen display resolution.

9. A computer device, characterized in that: include: CPU, memory, input and output interfaces, wired or wireless network interfaces, and power supply; The memory is either transient storage memory or persistent storage memory; The central processing unit is configured to communicate with the memory and execute instructions in the memory to perform the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises instructions, and when the instructions are executed on a computer, the computer is caused to perform the method according to any one of claims 1 to 7.

Images