A display module, a display device, an image display method and a storage medium

Abstract

The embodiments of the present application disclose a display module, a display device, an image display method and a storage medium, wherein the display module comprises at least a zoom module and an on-screen display module, wherein the zoom module has a pre-zoom function and a post-zoom function; wherein, when the zoom module is configured as a pre-zoom module, the zoom module is used to pre-zoom an image in a frame buffer of a preset layer, and transmit the pre-zoomed image to the on-screen display module; or, when the zoom module is configured as a post-zoom module, the zoom module is used to post-zoom an image superimposed and mixed by the on-screen display module.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a display module, a display device, an image display method and a storage medium. Background Art

[0002] In recent years, with the application of digital video technology in many fields such as home appliances, monitoring systems, and handheld devices, various advanced algorithms have been applied to display modules to provide consumers with clearer and smoother images. On Screen Display (OSD) display technology has become an indispensable part.

[0003] Here, in addition to the OSD module, the display module also mainly includes a zoom module (Zoom Module, Scaler). Among them, the scaler includes a pre-scaling module (Pre Scaler) and a post-scaling module (Post Scaler). The Pre Scaler is used to scale the frame buffer of a layer (Layer) according to user needs so that the subsequent OSD module can perform superposition and mixing; and the Post Scaler is used to scale the superimposed and mixed data according to the size of the display screen, so that the processed data can be displayed on the screen.

[0004] At present, existing display technologies use scalers many times, and scalers have line caches due to algorithm requirements, especially when the algorithm complexity is high, scalers have multiple line caches. In this way, as the display screen increases, the line cache of the scaler will cause the area of ​​the display module in the chip to become larger and larger. Summary of the invention

[0005] The present application proposes a display module, a display device, an image display method and a storage medium, which adopt a Scaler sharing solution, can flexibly configure the Scaler position in the display module according to user needs, reduce the Scaler hardware resources of the display module, thereby achieving the purpose of saving chip area and reducing power consumption.

[0006] The technical solution of this application is implemented as follows:

[0007] In a first aspect, an embodiment of the present application provides a display module, which includes at least a zoom module and an on-screen display module, wherein the zoom module has a front zoom function and a rear zoom function; wherein:

[0008] In the case where the scaling module is configured as a pre-scaling module, the scaling module is used to pre-scale the image in the frame buffer of the preset layer, and transmit the pre-scaled image to the on-screen display module; or

[0009] In the case where the scaling module is configured as a post-scaling module, the scaling module is used to perform post-scaling on the image after being superimposed and mixed by the on-screen display module.

[0010] Optionally, when the zoom module is configured as a front zoom module, the zoom module does not have a rear zoom function; or,

[0011] When the zoom module is configured as a post-zoom module, the zoom module does not have a pre-zoom function.

[0012] Optionally, the display module further includes an image processing module and a screen; wherein,

[0013] The image processing module is used to perform image processing on the received image to be processed to obtain a target image;

[0014] The screen is used to display the target image.

[0015] Optionally, when the zoom module is configured as a front zoom module,

[0016] The on-screen display module is used to superimpose and mix the images received in the frame buffer of several layers, determine the superimposed and mixed image as the image to be processed and transmit it to the image processing module;

[0017] The plurality of layers include preset layers and non-scaling layers, the preset layers indicate that the pre-scaling processing is performed via the scaling module, and the non-scaling layers indicate that the pre-scaling processing is not performed via the scaling module.

[0018] Optionally, when the scaling module is configured as a post-scaling module,

[0019] The on-screen display module is used to superimpose and mix the images received in the frame buffer of several layers, transmit the superimposed and mixed images to the scaling module, obtain the image to be processed after post-scaling by the scaling module and transmit it to the image processing module;

[0020] The plurality of layers include preset layers and non-scaling layers, and both the preset layers and the non-scaling layers indicate that no pre-scaling processing is performed by the scaling module.

[0021] Optionally, the scaling module integrates a plurality of preset algorithms; wherein the plurality of preset algorithms at least include: a bilinear algorithm, a bicubic algorithm and a Lanczos algorithm.

[0022] Optionally, the scaling module is further configured to configure four rows of row caches as shared row caches for the multiple preset algorithms.

[0023] Optionally, the zoom module is further configured to select a preset algorithm corresponding to a scene to perform zoom processing according to different scenes in which the zoom module is configured as a front zoom module or a rear zoom module.

[0024] Optionally, the display module further includes a direct memory access module; wherein,

[0025] All modules in the display module except the screen are integrated into the same chip.

[0026] In a second aspect, an embodiment of the present application provides a display device, which includes at least a display module as described in any one of the first aspects.

[0027] In a third aspect, an embodiment of the present application provides an image display method, the method comprising:

[0028] Obtaining an image to be processed through a zoom module and an on-screen display module; wherein the zoom module has a pre-zoom function and a post-zoom function, and the zoom module uses the pre-zoom function or the post-zoom function alone;

[0029] Performing image processing on the image to be processed by an image processing module to obtain a target image;

[0030] The target image is displayed on a screen.

[0031] Optionally, obtaining the image to be processed through the zoom module and the on-screen display module includes:

[0032] In the case where the scaling module is configured as a front scaling module, the on-screen display module performs superposition and mixing of images received in the frame buffer of several layers, and determines the superposition and mixing image as the image to be processed;

[0033] The plurality of layers include preset layers and non-scaling layers, the preset layers indicate that the pre-scaling processing is performed via the scaling module, and the non-scaling layers indicate that the pre-scaling processing is not performed via the scaling module.

[0034] Optionally, obtaining the image to be processed through the zoom module and the on-screen display module includes:

[0035] In the case where the scaling module is configured as a post-scaling module, the on-screen display module performs superposition and mixing of images received in the frame buffer of several layers to obtain a superposition and mixed image;

[0036] Post-scaling the superimposed and mixed image by the scaling module, and determining the post-scaling image as the image to be processed;

[0037] The plurality of layers include preset layers and non-scaling layers, and both the preset layers and the non-scaling layers indicate that no pre-scaling processing is performed by the scaling module.

[0038] Optionally, the scaling module incorporates multiple preset algorithms; the method further includes:

[0039] The four-row line cache is configured as a shared line cache of the plurality of preset algorithms; wherein the plurality of preset algorithms at least include: a Bilinear algorithm, a Bicubic algorithm and a Lanczos algorithm.

[0040] Optionally, the method further comprises:

[0041] According to different scenarios in which the zoom module is configured as a front zoom module or a rear zoom module, a preset algorithm corresponding to the scenario is selected to perform zoom processing.

[0042] In a fourth aspect, an embodiment of the present application provides a computer storage medium, which stores a computer program. When the computer program is executed by a display device, it implements the method as described in any one of the third aspects.

[0043] A display module, a display device, an image display method and a storage medium provided in an embodiment of the present application, wherein the display module comprises at least a zoom module and an on-screen display module, wherein the zoom module has a pre-zoom function and a post-zoom function; wherein, when the zoom module is configured as a pre-zoom module, the zoom module is used to pre-zoom an image in a frame buffer of a preset layer, and transmit the pre-zoomed image to the on-screen display module; or, when the zoom module is configured as a post-zoom module, the zoom module is used to post-zoom an image superimposed and mixed by the on-screen display module. In this way, by adopting the Scaler sharing solution, the Scaler position in the display module can be flexibly configured according to user needs. That is to say, the scaling module can be used as both a front scaling module and a rear scaling module, reducing the Scaler hardware resources of the display module. Moreover, the Scaler sharing algorithm solution in the display module can also enable different scaling algorithms to use the same row cache on the hardware resources, thereby achieving the purpose of saving chip area. In addition, the data of the display module needs to be refreshed and output in real time, and the related clock is in a high-frequency normally-on state, which makes the flip rate of the semiconductor components inside the Scaler high and the power consumption high. However, the Scaler sharing solution can reduce the semiconductor components, thereby achieving the purpose of reducing power consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] Figure 1A structural schematic diagram of a display module provided for a related technical solution;

[0045] Figure 2 A schematic diagram of the structure of a display module provided in an embodiment of the present application;

[0046] Figure 3 A schematic diagram of an algorithm fusion architecture of a scaling module provided in an embodiment of the present application;

[0047] Figure 4 A schematic diagram of the structure of a display device provided in an embodiment of the present application;

[0048] Figure 5 A flowchart of an image display method provided in an embodiment of the present application. DETAILED DESCRIPTION

[0049] The following will be combined with the accompanying drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. It is understood that the specific embodiments described herein are only used to explain the related applications, rather than to limit the applications. It should also be noted that, for the convenience of description, only the parts related to the related applications are shown in the accompanying drawings.

[0050] System on Chip (SoC) refers to a technology that integrates a complete system on a single chip and packages all or part of the necessary electronic circuits. Here, the display module is an important part of the SOC, which is mainly used to display the processed data (also called images) on the screen.

[0051] Generally speaking, if Figure 1 As shown, the display module 10 can generally be composed of a direct memory access (DMA) module 101, a pre-scaling (Pre Scaler) module 102, an on-screen display (OSD) module 103, a post-scaling (Post Scaler) module 104, an image processing (Image Process) module 105 and a screen (Screen) 106. Among them, the purpose of the DMA module 101 is to transfer the frame buffer (FrameBuffer) of a certain layer to the display module, and the purpose of the Pre Scaler module 102 is to scale the frame buffer of a certain layer according to user needs so that the subsequent OSD module 103 can perform superposition and mixing.

[0052] Specifically, the DMA module 101 may include DMA 0, DMA 1, DMA2 and DMA 3, and the Pre Scaler module 102 may include Pre Scaler 0, Pre Scaler 1, Pre Scaler 2 and Pre Scaler3; that is, DMA0 transfers the Frame Buffer of Layer 0 to Pre Scaler 0, and Pre Scaler 0 scales the Frame Buffer of Layer 0 according to user requirements and transmits it to the OSD module 103; DMA 1 transfers the Frame Buffer of Layer 1 to Pre Scaler 1, and Pre Scaler1 scales the Frame Buffer of Layer 1 according to user requirements and transmits it to the OSD module 103; DMA2 transfers the Frame Buffer of Layer 2 to Pre Scaler 2, and Pre Scaler 2 scales the Frame Buffer of Layer 2 according to user requirements and transmits it to the OSD module 103; DMA3 transfers the Frame Buffer of Layer 3 to Pre Scaler 3, and Pre Scaler 1 Scaler 3 scales the Frame Buffer of Layer 3 according to user requirements and transmits it to the OSD module 103 .

[0053] In this way, after receiving the Frame Buffers of several layer layers, the OSD module 103 is used to superimpose and mix the Frame Buffers of several layer layers; the Post Scaler module 104 is used to scale the superimposed and mixed data according to the size of the screen; and the Image Process module 105 is used to perform image processing on the superimposed and mixed data, so that the processed data can be displayed on the screen 106.

[0054] For the display module 10, the existing display technology will use the scaler many times, and the scaler will have a line cache due to the needs of the algorithm, especially when the algorithm complexity is high, the scaler will have multiple line caches. In this way, as the display screen continues to increase, the line cache of the scaler will cause the area of ​​the display module in the chip to become larger and larger.

[0055] Based on this, an embodiment of the present application provides a display module, which includes at least a zoom module and an on-screen display module, and the zoom module has a pre-zoom function and a post-zoom function; wherein, when the zoom module is configured as a pre-zoom module, the zoom module is used to pre-zoom the image in the frame buffer of a preset layer, and transmit the pre-zoomed image to the on-screen display module; or, when the zoom module is configured as a post-zoom module, the zoom module is used to post-zoom the image superimposed and mixed by the on-screen display module. In this way, by adopting the Scaler sharing solution, the Scaler position in the display module can be flexibly configured according to user needs. That is to say, the scaling module can be used as both a front scaling module and a rear scaling module, reducing the Scaler hardware resources of the display module. Moreover, the Scaler sharing algorithm solution in the display module can also enable different scaling algorithms to use the same row cache on the hardware resources, thereby achieving the purpose of saving chip area. In addition, the data of the display module needs to be refreshed and output in real time, and the related clock is in a high-frequency normally-on state, which makes the flip rate of the semiconductor components inside the Scaler high and the power consumption high. However, the Scaler sharing solution can reduce the semiconductor components, thereby achieving the purpose of reducing power consumption.

[0056] The embodiments of the present application will be described in detail below with reference to the accompanying drawings.

[0057] In one embodiment of the present application, see Figure 2 , which shows a schematic diagram of the structure of a display module provided by an embodiment of the present application. Figure 2 As shown, the display module 20 at least includes: a zoom module 201 and an on-screen display module 202, wherein the zoom module 201 has a front zoom function and a rear zoom function; wherein,

[0058] When the scaling module 201 is configured as a pre-scaling module, the scaling module 201 is used to pre-scale the image in the frame buffer of the preset layer, and transmit the pre-scaled image to the on-screen display module 202; or,

[0059] In the case where the scaling module 201 is configured as a post-scaling module, the scaling module 201 is used to perform post-scaling on the image after being superimposed and mixed by the on-screen display module 202 .

[0060] It should be noted that the display module 20 can adopt a scaler sharing solution. In other words, the front scaling module and the rear scaling module can share a set of scaler hardware resources; however, in the display module 20, the front scaling module and the rear scaling module cannot be used for image scaling at the same time, that is, a set of scaler hardware resources can only be used by the front scaling module or the rear scaling module alone.

[0061] In some embodiments, when the zoom module 201 is configured as a front zoom module, the zoom module 201 does not have a rear zoom function; or, when the zoom module 201 is configured as a rear zoom module, the zoom module 201 does not have a front zoom function.

[0062] That is to say, although the zoom module 201 has the pre-zoom function and the post-zoom function, that is, the zoom module 201 can be configured as both a pre-zoom module and a post-zoom module; however, it should be noted that the zoom module 201 cannot be configured as both a pre-zoom module and a post-zoom module at the same time.

[0063] In this way, the embodiment of the present application adopts a Scaler sharing solution to flexibly configure the Scaler position in the display module according to user needs, that is, the scaling module 201 is shared at different nodes of the display module, reducing the Scaler hardware resources of the display module and achieving the effect of optimizing the display module area.

[0064] In some embodiments, Figure 2 Based on the display module 20 shown in FIG. Figure 2 As shown, the display module 20 may further include an image processing module 203 and a screen 204; wherein,

[0065] The image processing module 203 is used to perform image processing on the received image to be processed to obtain a target image;

[0066] The screen 204 is used to display the target image.

[0067] Further, in some embodiments, when the zoom module 201 is configured as a front zoom module,

[0068] The on-screen display module 202 is used to superimpose and mix the images received in the frame buffer of several layers, determine the superimposed and mixed images as the image to be processed and transmit them to the image processing module 203;

[0069] The plurality of layers include preset layers and non-scaling layers. The preset layers indicate that the pre-scaling process is performed by the scaling module 201 , and the non-scaling layers indicate that the pre-scaling process is not performed by the scaling module 201 .

[0070] It should be noted that the display module 20 generally includes several layers, such as layer 0, layer 1, layer 2, and layer 3. As for layer 3, it is generally used to lay the background of the screen. If the background size of the screen does not meet the needs of the user, it needs to be pre-scaled by the scaling module 201 to meet the needs of the user; that is, the preset layer can be layer 3. As for layer 0, layer 1, and layer 2, the user can set the size through the front-end module in the SOC chip or the user through software customization. At this time, it is not necessary to pre-scale them through the scaling module 201, that is, the non-scaling layers can be layer 0, layer 1, and layer 2.

[0071] It should also be noted that, under normal circumstances, whether it is layer 0, layer 1, layer 2, or layer 3, the size can be customized by the user through the front-end module in the SOC chip or the user through software, that is, several layers such as layer 0, layer 1, layer 2 and layer 3 can be pre-scaled without going through the scaling module 201; that is to say, the scaling module 201 is basically used as a post-scaling module.

[0072] Further, in some embodiments, when the scaling module 201 is configured as a post-scaling module,

[0073] The on-screen display module 202 is used to superimpose and mix the images received in the frame buffer of several layers, transmit the superimposed and mixed images to the scaling module 201, obtain the image to be processed after post-scaling by the scaling module 201 and transmit it to the image processing module 203;

[0074] The plurality of layers include preset layers and non-scaling layers, and both the preset layers and the non-scaling layers indicate that no pre-scaling processing is performed by the scaling module 201 .

[0075] That is to say, when the scaling module 201 is configured as a post-scaling module, the images in the frame buffers of these several layers do not need to be pre-scaling processed by the scaling module 201; at this time, the on-screen display module 202 directly overlays and mixes the images in the frame buffers of these several layers, and transmits the overlaid and mixed images to the scaling module 201 for post-scaling processing. At this time, the images can be scaled according to the size of the screen 204 to obtain the image to be processed, and then transmitted to the image processing module 203.

[0076] It should be noted that, since the image to be processed has been pre-scaled or post-scaled by the scaling module, the size of the image to be processed can meet the needs of the user or conform to the size of the screen, so that it can be displayed on the screen later.

[0077] Furthermore, in some embodiments, Figure 2 Based on the display module 20 shown in FIG. Figure 2 As shown, the display module 20 may further include a direct memory access module 205; wherein,

[0078] The direct memory access module 205 is used to transmit the images in the frame buffer of several layers to the display module 20 .

[0079] Here, the direct memory access module is a functional module provided by some computer bus architectures that enables data to be sent directly from an attached device (such as a disk drive) to the computer's main memory. In other words, direct memory access is a hardware mechanism that allows input / output (I / O) data to be directly transferred between peripheral devices and main memory without the involvement of the system processor. Using this mechanism can greatly improve the throughput of communication with devices.

[0080] Here, in Figure 2 In the embodiment, the direct memory access module 205 may also include DMA0, DMA1, DMA2 and DMA3. Among them, DMA 0 is to transfer the image in the Frame Buffer of Layer 0 to the on-screen display module 202 in the display module 20; DMA 1 is to transfer the image in the Frame Buffer of Layer 1 to the on-screen display module 202 in the display module 20; DMA 2 is to transfer the image in the Frame Buffer of Layer 2 to the on-screen display module 202 in the display module 20; DMA 3 is to transfer the image in the Frame Buffer of Layer 3 to the on-screen display module 202 in the display module 20. It should be noted that if Layer 3 needs to be pre-scaled by the scaling module 201, then DMA 3 first transfers the image in the Frame Buffer of Layer 3 to the scaling module 201 for pre-scaling, and then transfers it to the on-screen display module 202 in the display module 20, so that these images can be superimposed and mixed by the on-screen display module 202.

[0081] Furthermore, in some embodiments, for the display module 20 , except for the screen 204 , the scaling module 201 , the on-screen display module 202 , the image processing module 203 , and the direct memory access module 205 are all integrated into the same chip.

[0082] In the embodiment of the present application, the structure of the display module 20 is shown as follows: Figure 2 Here, the pre-scaling module (PreScaler) and the post-scaling module (Post Scaler) share the same set of Scaler hardware resources, that is, the Pre Scaler and the Post Scaler cannot be used for image scaling at the same time. In other words, a set of Scaler hardware resources can only be used by the Pre Scaler or the Post Scaler alone. In this way, when the scaling module 201 is selected as the Pre Scaler, Layer 0, Layer 1 and Layer 2 are used as non-scaling layers, and the user can set the size through the front-stage module in the SOC chip or the user through the software, that is, no scaling is performed, and Layer 3 generally serves to pave the background of the screen. If the size of the screen background does not meet the user's needs, the image in the Frame Buffer of Layer 3 can be scaled through the Pre Scaler; when the scaling module 201 is selected as the Post Scaler, the user can set the size of Layer 0, Layer 1, Layer 2 and Layer 3 through the front-stage module in the SOC chip or the user through the software, that is, no scaling is performed, but after the on-screen display module 202 superimposes and mixes Layer 0, Layer 1, Layer 2 and Layer 3, the Post Scaler scales the superimposed and mixed image and finally displays it on the screen 204.

[0083] In addition, the solution of the embodiment of the present application not only supports a shared Scaler design, but can also utilize the characteristics that multiple Scaler algorithms in the display module 20 are different but have the same functions to integrate the design of multiple Scaler preset algorithms in the same scaling module.

[0084] In some embodiments, the scaling module 201 integrates multiple preset algorithms, wherein the multiple preset algorithms at least include: a bilinear algorithm, a bicubic algorithm, and a Lanczos algorithm.

[0085] Here, image scaling refers to the process of resizing the size of an image. Specifically, image scaling is the act of mapping points in the original image to points in the target image through a preset algorithm to change the size of the image. Currently, there are many types of image scaling algorithms, which can be Bilinear algorithms, Bicubic algorithms, Lanczos algorithms, or even nearest neighbor difference algorithms, etc., which are not specifically limited in the embodiments of the present application.

[0086] It should be noted that the nearest neighbor interpolation algorithm is the simplest interpolation algorithm. When the image is enlarged, the missing pixels are directly generated by using the original pixels closest to them. The principle is to select the pixel closest to the inserted pixel and use the gray value of the pixel to replace the inserted pixel. Although the nearest neighbor interpolation method has a small amount of calculation, it may cause discontinuity in the grayscale of the generated image, and obvious jaggedness may appear in the change area.

[0087] The Bilinear algorithm can be regarded as bilinear interpolation, also known as bilinear interpolation. Among them, bilinear interpolation is a linear interpolation extension of the interpolation function with two variables. Its core idea is to perform linear interpolation in two directions to achieve image scaling. Here, the Bilinear algorithm has a large amount of calculation, but the image quality is high after scaling, and there will be no discontinuous pixel values; however, it has the characteristics of low-pass filtering, which damages the high-frequency components and blurs the image contour to a certain extent.

[0088] In addition, the Bicubic algorithm is the most commonly used interpolation method in two-dimensional space, which can be obtained by weighted average of the nearest sixteen sampling points in a rectangular grid. The Bicubic algorithm has a large amount of calculation, but the image effect is better than the Bilinear algorithm. In addition, the Lanczos algorithm is an algorithm that transforms a symmetric matrix into a symmetric tridiagonal matrix through an orthogonal similarity transformation to achieve image zooming in and out. Its principle is actually to take a small window in the original image and map it to a pixel in the new image by calculating the weight. Here, the Lanczos algorithm has the highest computational complexity, but the image effect is also the best.

[0089] In the embodiment of the present application, taking the three mainstream preset algorithms such as Bilinear algorithm, Bicubic algorithm and Lanczos algorithm as examples, since the Bilinear algorithm requires two lines of line buffer (Line Buffer), and the Bicubic algorithm and Lanczos algorithm require four lines of line buffer, then the current mainstream preset algorithm is designed with shared line buffer in the scaling module 201, and four lines of line buffer can be selected as the shared line buffer. Therefore, in some embodiments, the scaling module 201 is also used to configure the four lines of line buffer as the shared line buffer of the multiple preset algorithms.

[0090] Furthermore, in some embodiments, the zoom module 201 is further configured to select a preset algorithm corresponding to a scene to perform zoom processing according to different scenes in which the zoom module 201 is configured as a front zoom module or a rear zoom module.

[0091] For example, see Figure 3 , which shows a schematic diagram of an algorithm fusion architecture of a scaling module provided in an embodiment of the present application. Figure 3 As shown, three mainstream preset algorithms are integrated into the zoom module 201, that is, the mainstream preset algorithms are designed in the zoom module using a shared row cache, and the same parts of the three mainstream preset algorithms can share the algorithm reuse module. The three mainstream preset algorithms may include a bilinear algorithm, a bicubic algorithm, and a Lanczos algorithm; wherein the Bilinear algorithm requires two rows of row cache, and the Bicubic algorithm and the Lanczos algorithm require four rows of row cache, so the zoom module will take four rows of row cache as a shared row cache. It should also be noted that different preset algorithms can adapt to different scenarios, and when the zoom module is configured as a front zoom module or a rear zoom module, the mainstream preset algorithm can be selected.

[0092] In short, the embodiment of the present application supports a shared Scaler design, and utilizes the characteristics of different Scaler algorithms in multiple locations in the display module but consistent functions to integrate and design multiple Scaler algorithms in the same scaling module, and share the scaling module at different nodes of the display module according to user needs, thereby achieving the effect of optimizing the display module area. In other words, the scaling module in the embodiment of the present application can be flexibly configured at different positions in the display module according to the application scenarios required by the user, including the pre-position (Pre Scaler) before the OSD module and the post-position (Post Scaler) after the OSD module; and the same Scaler integrates multiple scaling algorithms of different complexity, such as Bilinear algorithm, Bicubic algorithm, and Lanczos algorithm. In this way, the display module of the embodiment of the present application can achieve the following technical effects:

[0093] (1) The Scaler shared algorithm solution in the display module can select the current mainstream scaling algorithms according to user needs, including Bilinear algorithm, Bicubic algorithm and Lanczos algorithm, so that users can choose the appropriate solution according to different application scenarios;

[0094] (2) The scaler sharing solution can reduce the scaler hardware resources in the display module. The scaler sharing algorithm solution can enable different scaling algorithms to use the same line cache on the hardware resources, thereby achieving the purpose of area optimization;

[0095] (3) The data of the display module needs to be refreshed and output in real time. The related clock is in a high-frequency normally-on state, which makes the flip rate of the semiconductor components inside the scaling module high and the power consumption high. The scaler sharing solution can reduce the semiconductor components, thereby achieving the purpose of reducing power consumption.

[0096] This embodiment provides a display module, which at least includes a scaling module and an on-screen display module, wherein the scaling module has a pre-scaling function and a post-scaling function; wherein, when the scaling module is configured as a pre-scaling module, the scaling module is used to pre-scale the image in the frame buffer of the preset layer, and transmit the pre-scaled image to the on-screen display module; or, when the scaling module is configured as a post-scaling module, the scaling module is used to post-scale the image after superimposing and mixing via the on-screen display module. In this way, by adopting the Scaler sharing scheme, the Scaler position in the display module can be flexibly configured according to the needs of the user, that is, the scaling module can be used as both a pre-scaling module and a post-scaling module, which reduces the Scaler hardware resources of the display module, and the Scaler sharing algorithm scheme in the display module can also enable different scaling algorithms to use the same line cache on the hardware resources, and the Scaler sharing scheme can also reduce semiconductor components, thereby achieving the purpose of saving chip area and reducing power consumption.

[0097] In another embodiment of the present application, see Figure 4 , which shows a schematic diagram of the composition structure of a display device provided by an embodiment of the present application. Figure 4 As shown, the display device 40 may at least include the display module 20 described in any one of the aforementioned embodiments.

[0098] Here, the display device 40 may be a device with display capability, such as a smart phone, a tablet computer, a laptop computer, a PDA, a user terminal, a navigation device, a wearable device, or the like.

[0099] In the embodiment of the present application, the display device 40 includes a display module 20. In this way, when the display device 40 displays an image, by adopting a Scaler sharing solution, the Scaler position in the display module can be flexibly configured according to user needs. That is, the scaling module can be used as both a front scaling module and a rear scaling module, thereby reducing the Scaler hardware resources of the display module, thereby achieving the purpose of saving chip area and reducing power consumption.

[0100] In another embodiment of the present application, see Figure 5 , which shows a schematic flow chart of an image display method provided by an embodiment of the present application. Figure 5 As shown, the method includes:

[0101] S501: obtaining an image to be processed through a zoom module and an on-screen display module; wherein the zoom module has a pre-zoom function and a post-zoom function, and the zoom module uses the pre-zoom function or the post-zoom function alone;

[0102] It should be noted that the method is applied to the display module 20 described in the aforementioned embodiment, or a display device integrated with the display module 20 described in the aforementioned embodiment. Here, since the display module 20 can adopt a Scaler sharing solution. In other words, the front scaling module and the rear scaling module can share a set of Scaler hardware resources; however, in the display module 20, the front scaling module and the rear scaling module cannot be used for image scaling at the same time, that is, a set of Scaler hardware resources can only be used by the front scaling module or the rear scaling module alone, that is, the scaling module uses the front scaling function or the rear scaling function alone.

[0103] It should also be noted that when the zoom module is configured as a front zoom module, the zoom module does not have a rear zoom function; or when the zoom module is configured as a rear zoom module, the zoom module 201 does not have a front zoom function.

[0104] That is to say, although the zoom module has both the pre-zoom function and the post-zoom function, that is, the zoom module can be configured as both the pre-zoom module and the post-zoom module; however, it should be noted that the zoom module cannot be configured as both the pre-zoom module and the post-zoom module at the same time.

[0105] In some embodiments, for S501, obtaining the image to be processed by the zoom module and the on-screen display module may include:

[0106] In the case where the scaling module is configured as a front scaling module, the on-screen display module performs superposition and mixing of images received in the frame buffer of several layers, and determines the superposition and mixing image as the image to be processed;

[0107] The plurality of layers include preset layers and non-scaling layers, the preset layers indicate that the pre-scaling processing is performed via the scaling module, and the non-scaling layers indicate that the pre-scaling processing is not performed via the scaling module.

[0108] It should be noted that the display module 20 generally includes several layers, such as layer 0, layer 1, layer 2, and layer 3. Layer 3 is generally used to lay the background of the screen. If the background size of the screen does not meet the needs of the user, it needs to be pre-scaled by the scaling module to meet the needs of the user; that is, the preset layer can be layer 3. As for layer 0, layer 1, and layer 2, the user can set the size through the front-end module in the SOC chip or the user through software customization. At this time, it is not necessary to pre-scale them through the scaling module, that is, the non-scaling layers can be layer 0, layer 1, and layer 2.

[0109] It should also be noted that, under normal circumstances, whether it is layer 0, layer 1, layer 2, or layer 3, the size can be customized by the user through the front-end module in the SOC chip or the user through software, that is, several layers such as layer 0, layer 1, layer 2 and layer 3 can be pre-scaled without going through the scaling module; that is to say, the scaling module is basically used as a post-scaling module.

[0110] In some embodiments, for S501, obtaining the image to be processed by the zoom module and the on-screen display module may include:

[0111] In the case where the scaling module is configured as a post-scaling module, the on-screen display module performs superposition and mixing of images received in the frame buffer of several layers to obtain a superposition and mixed image;

[0112] Post-scaling the superimposed and mixed image by the scaling module, and determining the post-scaling image as the image to be processed;

[0113] The plurality of layers include preset layers and non-scaling layers, and both the preset layers and the non-scaling layers indicate that no pre-scaling processing is performed by the scaling module.

[0114] It should be noted that when the scaling module is configured as a post-scaling module, the images in the frame buffers of these several layers do not need to be pre-scaling processed by the scaling module; at this time, the on-screen display module directly superimposes and mixes the images in the frame buffers of these several layers, and transmits the superimposed and mixed images to the scaling module for post-scaling processing. At this time, the images can be scaled according to the size of the screen 204 to obtain the image to be processed.

[0115] It should also be noted that, since the image to be processed has been pre-scaled or post-scaled by the scaling module, the size of the image to be processed can meet the needs of the user or conform to the size of the screen, so that it can be displayed on the screen later.

[0116] S502: performing image processing on the image to be processed by an image processing module to obtain a target image;

[0117] S503: Displaying the target image on a screen.

[0118] Here, the display module also includes an image processing module and a screen. In this way, after obtaining the image to be processed, the image to be processed can be transmitted to the image processing module, and then after the image to be processed is processed by the image processing module, a target image can be obtained, and finally the target image is displayed on the screen.

[0119] It should also be noted that the solution of the embodiment of the present application not only supports a shared scaler design, but also can utilize the characteristics of different scaler algorithms in multiple locations in the display module but with the same functions to integrate multiple scaler preset algorithms in the same scaling module. Therefore, multiple preset algorithms can be integrated in the scaling module; wherein the multiple preset algorithms include at least: Bilinear algorithm, Bicubic algorithm and Lanczos algorithm.

[0120] In some embodiments, the method may further include:

[0121] The four row caches are configured as shared row caches for the plurality of preset algorithms.

[0122] It should be noted that, taking the three mainstream preset algorithms, namely the Bilinear algorithm, the Bicubic algorithm and the Lanczos algorithm, as examples, since the Bilinear algorithm requires two rows of cache, and the Bicubic algorithm and the Lanczos algorithm require four rows of cache, the current mainstream preset algorithms are designed using shared cache in the scaling module. At this time, four rows of cache can be selected as the shared cache to implement the Scaler shared algorithm solution.

[0123] It should also be noted that, in some embodiments, the method may further include:

[0124] According to different scenarios in which the zoom module is configured as a front zoom module or a rear zoom module, a preset algorithm corresponding to the scenario is selected to perform zoom processing.

[0125] That is to say, different preset algorithms can adapt to different scenarios, and when the zoom module is configured as a front zoom module or a rear zoom module, a mainstream preset algorithm can be selected.

[0126] In this way, since the Scaler shared algorithm solution in the display module can select the current mainstream scaling algorithm according to user needs, and the shared algorithm solution in the Scaler can enable different scaling algorithms to use the same line cache on hardware resources, the purpose of area optimization can be achieved. However, all modules in the display module except the screen (such as the scaling module, the on-screen display module, the image processing module, and the direct memory access module) are all integrated in the same chip, that is, the area optimization of the embodiment of the present application is to save chip area.

[0127] This embodiment provides an image display method, wherein an image to be processed is obtained through a scaling module and an on-screen display module; wherein the scaling module has a pre-scaling function and a post-scaling function, and the scaling module uses the pre-scaling function or the post-scaling function alone; the image to be processed is processed by an image processing module to obtain a target image; and the target image is displayed on the screen. In this way, due to the use of a Scaler sharing scheme, the Scaler position can be flexibly configured in the display module according to user needs, that is, the scaling module can be used as both a pre-scaling module and a post-scaling module, reducing the Scaler hardware resources of the display module, and the Scaler sharing algorithm scheme in the display module can also enable different scaling algorithms to use the same row cache on the hardware resources, thereby achieving the purpose of saving chip area; in addition, the data of the display module needs to be refreshed and output in real time, and the related clock is in a high-frequency normally open state, which makes the flip rate of the semiconductor components inside the Scaler high and the power consumption high, but the Scaler sharing scheme can reduce the semiconductor components, thereby achieving the purpose of reducing power consumption.

[0128] It can be understood that the display module of the embodiment of the present application can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above method embodiment can be completed by the hardware integrated logic circuit in the display module combined with instructions in the form of software. Based on this understanding, some functions of the technical solution of the present application can be embodied in the form of a software product; therefore, this embodiment provides a computer storage medium, which stores a computer program, and when the computer program is executed by the display device, it implements the steps of the image display method described in the above embodiment.

[0129] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0130] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0131] It should be noted that, in this application, the terms "include", "comprises" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "includes a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0132] The serial numbers of the above-mentioned embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0133] The methods disclosed in several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.

[0134] The features disclosed in several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.

[0135] The features disclosed in several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.

[0136] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art who is familiar with the present technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A display module, characterized in that: The display module at least includes a zoom module and an on-screen display module, and the zoom module has a front zoom function and a rear zoom function; wherein, In the case where the scaling module is configured as a pre-scaling module, the scaling module is used to pre-scale the image in the frame buffer of the preset layer, and transmit the pre-scaled image to the on-screen display module; or In the case where the scaling module is configured as a post-scaling module, the scaling module is used to perform post-scaling on the image superimposed and mixed by the on-screen display module; Wherein, when the zoom module is configured as a front zoom module, the zoom module does not have a rear zoom function; or, when the zoom module is configured as a rear zoom module, the zoom module does not have a front zoom function.

2. The display module according to claim 1, characterized in that: The display module also includes an image processing module and a screen; wherein, The image processing module is used to perform image processing on the received image to be processed to obtain a target image; The screen is used to display the target image.

3. The display module according to claim 2, characterized in that: In the case where the zoom module is configured as a front zoom module, The on-screen display module is used to superimpose and mix the images received in the frame buffer of several layers, determine the superimposed and mixed image as the image to be processed and transmit it to the image processing module; The plurality of layers include preset layers and non-scaling layers, the preset layers indicate that the pre-scaling processing is performed via the scaling module, and the non-scaling layers indicate that the pre-scaling processing is not performed via the scaling module.

4. The display module according to claim 2, characterized in that: In the case where the scaling module is configured as a post-scaling module, The on-screen display module is used to superimpose and mix the images received in the frame buffer of several layers, transmit the superimposed and mixed images to the scaling module, obtain the image to be processed after post-scaling by the scaling module and transmit it to the image processing module; The plurality of layers include preset layers and non-scaling layers, and both the preset layers and the non-scaling layers indicate that no pre-scaling processing is performed by the scaling module.

5. The display module according to claim 1, characterized in that: The scaling module integrates a plurality of preset algorithms; wherein the plurality of preset algorithms at least include: a bilinear algorithm, a bicubic algorithm and a Lanczos algorithm.

6. The display module according to claim 5, characterized in that: The scaling module is further configured to configure four row caches as shared row caches for the multiple preset algorithms.

7. The display module according to claim 5, characterized in that: The zoom module is further used to select a preset algorithm corresponding to the scene to perform zoom processing according to different scenarios in which the zoom module is configured as a front zoom module or a rear zoom module.

8. The display module according to claim 2, characterized in that: The display module also includes a direct memory access module; wherein, All modules in the display module except the screen are integrated into the same chip.

9. A display device, characterized in that: The display device at least comprises the display module according to any one of claims 1 to 8.

10. An image display method, characterized in that: The method comprises: Obtaining an image to be processed through a zoom module and an on-screen display module; wherein the zoom module has a pre-zoom function and a post-zoom function, and the zoom module uses the pre-zoom function or the post-zoom function alone; Performing image processing on the image to be processed by an image processing module to obtain a target image; Displaying the target image on a screen; Among them, when the scaling module is configured as a pre-scaling module, the scaling module is used to perform pre-scaling on the image in the frame buffer of the preset layer, and transmit the pre-scaled image to the on-screen display module; or, when the scaling module is configured as a post-scaling module, the scaling module is used to perform post-scaling on the image superimposed and mixed by the on-screen display module.

11. The method according to claim 10, characterized in that The method of obtaining the image to be processed by the zoom module and the on-screen display module includes: In the case where the scaling module is configured as a front scaling module, the on-screen display module performs superposition and mixing of images received in the frame buffer of several layers, and determines the superposition and mixing image as the image to be processed; The plurality of layers include preset layers and non-scaling layers, the preset layers indicate that the pre-scaling processing is performed via the scaling module, and the non-scaling layers indicate that the pre-scaling processing is not performed via the scaling module.

12. The method according to claim 10, characterized in that The method of obtaining the image to be processed by the zoom module and the on-screen display module includes: In the case where the scaling module is configured as a post-scaling module, the on-screen display module performs superposition and mixing of images received in the frame buffer of several layers to obtain a superposition and mixed image; Post-scaling the superimposed and mixed image by the scaling module, and determining the post-scaling image as the image to be processed; The plurality of layers include preset layers and non-scaling layers, and both the preset layers and the non-scaling layers indicate that no pre-scaling processing is performed by the scaling module.

13. The method according to claim 10, characterized in that The scaling module incorporates multiple preset algorithms; The method further comprises: The four-row line cache is configured as a shared line cache of the plurality of preset algorithms; wherein the plurality of preset algorithms at least include: a Bilinear algorithm, a Bicubic algorithm and a Lanczos algorithm.

14. The method according to claim 13, characterized in that The method further comprises: According to different scenarios in which the zoom module is configured as a front zoom module or a rear zoom module, a preset algorithm corresponding to the scenario is selected to perform zoom processing.

15. A computer storage medium, characterized in that The computer storage medium stores a computer program, and when the computer program is executed by the display device, the method according to any one of claims 10 to 14 is implemented.

Images