Image processing method and device, equipment and medium

Abstract

The invention provides an image processing method and device, equipment and a medium. The method includes acquiring a first fused image frame and a second fused image frame and sequentially displaying the first fused image frame and the second fused image frame. According to the method provided by the invention, the fused image frame obtained by fusing the image frame and the grayscale image frame can be displayed, and the grayscale image frame is obtained by performing graying processing on the corresponding area in the frame adjacent to the image frame, so that the display brightness can be compensated, the power consumption can be reduced, and the displayed fused image frame is brighter than before; therefore, the final brightness perceived by human eyes is higher. Besides, the grayscale image frame in the method provided by the invention is further smoothed after being subjected to grayscale processing, so that content details or contours in the grayscale image frame can be removed, and content crosstalk during subsequent brightness compensation can be avoided.

Description

Technical Field

[0001] The present disclosure relates to the field of image processing, and more specifically, to a method, apparatus, device and medium for image processing. Background Art

[0002] At present, more and more display devices support two-dimensional (2D) and three-dimensional (3D) hybrid display. In the 2D-3D hybrid display mode supported by the display device, the display device can display local 2D content in full-screen 3D mode, or display local 3D content in full-screen 2D mode. The 2D area and the 3D area will be combined to cover the entire screen of the display device, that is, the 2D area and the 3D area are complementary on the entire screen, so that the user can see 2D and 3D content at the same time.

[0003] Currently, in 2D frames, areas other than the local 2D part will be displayed black, and in 3D frames, areas other than the local 3D part will also be displayed black. Then the final brightness perceived by the human eye will be reduced.

[0004] Therefore, a method is needed to solve the above problems. Summary of the invention

[0005] In response to the above problems, the present disclosure provides a method for image processing. Since the method provided by the present disclosure can display a fused image frame obtained based on the fusion of an image frame and a grayscale image frame, and the grayscale image frame is obtained based on grayscale processing of a corresponding area in a frame adjacent to the image frame, it is possible to compensate for the display brightness, so that the displayed fused image frame is brighter than before, thereby making the final brightness perceived by the human eye brighter.

[0006] An embodiment of the present disclosure provides a method for image processing, including: acquiring a first fused image frame and a second fused image frame; displaying the first fused image frame and the second fused image frame in sequence, wherein the first fused image frame is obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and the second fused image frame is obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0007] According to an embodiment of the present disclosure, the first grayscale image frame is obtained by grayscale processing the second area and smoothing the processed second area, and / or the second grayscale image frame is obtained by grayscale processing the fourth area and smoothing the processed fourth area.

[0008] According to an embodiment of the present disclosure, the acquiring of the first fused image frame and the second fused image frame includes: acquiring the first fused image frame and the second fused image frame that are pre-stored.

[0009] According to an embodiment of the present disclosure, the acquiring of the first fused image frame and the second fused image frame includes: acquiring the first fused image frame and the second fused image frame generated by real-time processing.

[0010] According to an embodiment of the present disclosure, the first region is complementary to the fourth region, and the second region is complementary to the third region.

[0011] An embodiment of the present disclosure provides an apparatus for image processing, comprising: an acquisition unit, configured to acquire a first fused image frame and a second fused image frame; a display unit, configured to display the first fused image frame and the second fused image frame in sequence, wherein the first fused image frame is obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and the second fused image frame is obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0012] According to an embodiment of the present disclosure, the first grayscale image frame is obtained by grayscale processing the second area and smoothing the processed second area, and / or the second grayscale image frame is obtained by grayscale processing the fourth area and smoothing the processed fourth area.

[0013] According to an embodiment of the present disclosure, the acquisition unit is configured to: acquire a pre-stored first fused image frame and a pre-stored second fused image frame.

[0014] According to an embodiment of the present disclosure, the acquisition unit is configured to: acquire a first fused image frame and a second fused image frame generated by real-time processing.

[0015] According to an embodiment of the present disclosure, the first region is complementary to the fourth region, and the second region is complementary to the third region.

[0016] An embodiment of the present disclosure provides a device for image processing, comprising: a component for acquiring a first fused image frame and a second fused image frame; and a component for sequentially displaying the first fused image frame and the second fused image frame, wherein the first fused image frame is obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and the second fused image frame is obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0017] An embodiment of the present disclosure provides a device for image processing, comprising: a processor, and a memory, wherein the memory stores computer executable instructions, and when the computer executable instructions are executed by the processor, the processor is prompted to execute any of the above methods.

[0018] An embodiment of the present disclosure provides a computer-readable recording medium storing computer-executable instructions, wherein when the computer-executable instructions are executed by a processor, the processor is prompted to execute any of the above methods.

[0019] The present disclosure provides methods, devices, equipment and media for image processing. The method provided by the present disclosure can display a fused image frame obtained by fusing an image frame with a grayscale image frame, and the grayscale image frame is obtained by grayscale processing based on the corresponding area in the frame adjacent to the image frame, so as to compensate for the display brightness and reduce power consumption, so that the displayed fused image frame is brighter than before, so that the final brightness perceived by the human eye is brighter. In addition, the grayscale image frame in the method provided by the present disclosure is further smoothed after the grayscale processing, so that the content details or contours in the grayscale image frame can be removed to avoid content crosstalk during subsequent brightness compensation. In addition, the above-mentioned grayscale processing, smoothing processing and fusion processing can be pre-performed processing, and can also be real-time processing, so that the method provided by the present disclosure has good flexibility. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some exemplary embodiments of the present disclosure, and a person of ordinary skill in the art can obtain other drawings based on these drawings without creative work.

[0021] Figure 1 A schematic diagram of a frame according to an embodiment of the present disclosure is shown;

[0022] Figure 2 A schematic diagram showing a mixed display result in the prior art according to an embodiment of the present disclosure;

[0023] Figure 3 A flowchart of a method 300 for image processing according to an embodiment of the present disclosure is shown;

[0024] Figure 4 A schematic diagram showing a mixed display result based on the method provided by the present disclosure according to an embodiment of the present disclosure is shown;

[0025] Figure 5 A block diagram of an apparatus 500 for image processing according to an embodiment of the present disclosure is shown;

[0026] Figure 6 is a block diagram showing a device 600 for image processing according to an embodiment of the present disclosure;

[0027] Figure 7 A schematic diagram of a recording medium 700 according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0029] Unless otherwise defined, the technical terms or scientific terms used in the present disclosure should be understood by people with ordinary skills in the field to which the present disclosure belongs. The "first", "second" and similar words used in the present disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, similar words such as "one", "one" or "the" do not indicate quantity restrictions, but indicate that there is at least one. Similar words such as "include" or "comprise" mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Similar words such as "connect" or "connected" are not limited to physical or mechanical connections, but can include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the described object changes, the relative positional relationship may also change accordingly.

[0030] In the prior art, the 2D-3D hybrid display mode can display local 2D content in full-screen 3D mode, or display local 3D content in full-screen 2D mode. All displayed frames can be divided into two groups, such as odd frames of 2D content and even frames of 3D content (such as Figure 1 2D and 3D content are displayed alternately frame by frame. When displayed, it can be displayed by means of backlight. At this time, the 2D backlight and the 3D backlight can be switched alternately in synchronization with the 2D and 3D frame timing. Optionally, it can also be displayed by means of a liquid crystal lens. The 2D area and the 3D area will be combined to cover the entire full screen, that is, the 2D area and the 3D area are complementary on the entire screen, so that the user can see 2D and 3D content at the same time.

[0031] However, in existing hybrid display methods, such as Figure 2 As shown, in a 2D frame (such as frame 1), the area other than the local 2D part (i.e., marked as 2D in the figure) will be displayed in black. Specifically, it can be achieved in the following way: in the case of the backlight method, the 2D backlight corresponding to the 2D part is turned on and the 3D backlight corresponding to the 3D part is turned off; in the case of the liquid crystal lens method, the part corresponding to the 3D part is removed from the entire displayed frame (after removal, the part is black).

[0032] In a 3D frame (such as frame 2), the area other than the local 3D part (i.e., marked as 3D in the figure) will also be displayed in black. Specifically, this can be achieved in the following way: in the case of the backlight method, the 2D backlight corresponding to the 2D part is turned off and the 3D backlight corresponding to the 3D part is turned on; in the case of the liquid crystal lens method, the part corresponding to the 2D part is removed from the entire displayed frame (after removal, the part is black).

[0033] The final brightness that humans get is the result of mixing 2D frames and 3D frames. In this way, the content displayed on the entire screen will be mixed black, either 3D mixed black or 2D mixed black, and then the final brightness perceived by the human eye will be reduced.

[0034] In order to solve the above problems, the present disclosure provides a method for image processing. Since the above method provided by the present disclosure can display a fused image frame obtained based on the fusion of an image frame and a grayscale image frame, and the grayscale image frame is obtained based on the grayscale processing of the corresponding area in the frame adjacent to the image frame, it is possible to compensate for the display brightness, so that the displayed fused image frame is brighter than before, thereby making the final brightness perceived by the human eye brighter.

[0035] The above method provided by the present disclosure will be described in detail below with reference to the accompanying drawings.

[0036] Figure 3 A flowchart of a method 300 for image processing according to an embodiment of the present disclosure is shown. The method 300 may be executed by any suitable device, apparatus, etc.

[0037] Reference Figure 3 In step S310, a first fused image frame and a second fused image frame may be acquired.

[0038] According to an embodiment of the present disclosure, a first fused image frame may be obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and a second fused image frame may be obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame may be obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame may be obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0039] As an example, image frames may be stored in a buffer in the form of a sequence.

[0040] As an example, the first image frame and the second image frame may be any frame in a sequence of image frames.

[0041] As an example, the image frame adjacent to the first image frame may be an image frame immediately next to the first image frame, or may be an image frame spaced N image frames from the first image frame, where N is a positive integer. For example, the image frame adjacent to the first image frame may be the third frame after the first image frame, or may be the third frame before the first image frame. It should be noted that the above-mentioned image frame adjacent to the first image frame is only an example, and the image frame adjacent to the first image frame may also be an image frame obtained based on multiple image frames adjacent to the first image frame.

[0042] As an example, the image frame adjacent to the second image frame may be an image frame immediately next to the second image frame, or may be an image frame separated from the second image frame by M image frames, where M is a positive integer. For example, the image frame adjacent to the second image frame may be the fifth frame after the second image frame, or may be the fifth frame before the second image frame. It should be noted that the above-mentioned image frame adjacent to the second image frame is only an example, and the image frame adjacent to the second image frame may also be an image frame obtained based on multiple image frames adjacent to the second image frame.

[0043] As an example, the first image frame may be a 2D image. The first region in the first image frame may be Figure 2 The second area in the image frame adjacent to the first image frame corresponding to the first area in the first image frame may be Figure 2 The 3D area shown in frame 2 (i.e., the area surrounded by the black area) can be grayed by any suitable graying algorithm (such as an averaging method, a method based on human eye perception, a desaturation method, a maximum value or minimum value method, etc.) to obtain a first grayscale image frame.

[0044] As an example, the second image frame may be a 3D image. The third area in the second image frame may be Figure 2 The fourth area in the image frame adjacent to the second image frame corresponding to the third area in the second image frame may be Figure 2 The 2D region shown in frame 1 (i.e., the region other than the black region) can be grayed by any suitable graying algorithm (such as an averaging method, a method based on human eye perception, a desaturation method, a maximum value or minimum value method, etc.) to obtain a second grayscale image frame.

[0045] It can be seen from the above two examples that the first region and the fourth region may be complementary. The second region and the third region may be complementary.

[0046] As an example, by Figure 2 By fusing the second image frame (such as frame 1 in FIG. 1 ) with the first grayscale image frame obtained above, the first fused image frame can be obtained. Figure 2 The second fused image frame can be obtained by fusing the frame 2 in the image with the second grayscale image frame obtained above. The two image frames can be fused by any suitable fusion algorithm, such as a pixel-level image fusion algorithm, a feature-level image fusion algorithm, a decision-level image fusion algorithm, etc.

[0047] Through the above fusion method, the black parts of the 2D and 3D frames will be replaced by the grayscale map (i.e., grayscale image frame) created according to the content of the corresponding area. For example, the black part in the 2D area will be replaced by the grayscale map, which can be created according to the content in the corresponding area of ​​the upcoming or previous 3D frame to supplement the brightness of the 3D content; and the black part in the 3D area will be replaced by the grayscale map created from the content in the corresponding area of ​​the upcoming or previous 2D frame to compensate for the brightness of the 2D content. As a result, the brightness of the mixed result of the 2D frame and the 3D frame is increased, thereby increasing the brightness perceived by the human eye.

[0048] According to an embodiment of the present disclosure, the first grayscale image frame may be obtained by graying the second region and smoothing the processed second region, and / or the second grayscale image frame may be obtained by graying the fourth region and smoothing the processed fourth region. The above-mentioned smoothing may be implemented by any suitable smoothing algorithm, such as a smoothing algorithm based on mean filtering, Gaussian filtering, bilateral filtering, etc.

[0049] As an example, the first grayscale image frame or the second grayscale image frame obtained by the grayscale processing is only black and white. After the first grayscale image frame or the second grayscale image frame after the grayscale processing is further smoothed, the content details or contours in the grayscale image frame can be removed to avoid content crosstalk when the brightness is subsequently compensated.

[0050] By taking the first image frame (such as Figure 2 The frame 1 in the image is merged with the first grayscale image frame obtained through grayscale processing and smoothing to obtain the first fused image frame (such as Figure 4 By combining the second image frame (such as Figure 2 The second fused image frame (such as Figure 4 The mixed display result of the first fused image frame and the second fused image frame can be Figure 4It can be seen that the final brightness perceived by the human eye is significantly higher than Figure 2 The blended result is brighter.

[0051] According to the embodiment of the present disclosure, the first fused image frame and the second fused image frame stored in advance may be acquired. In this case, the first fused image frame and the second fused image frame are both frames that have been processed in advance.

[0052] According to the embodiment of the present disclosure, the first fused image frame and the second fused image frame generated by real-time processing can be acquired. At this time, both the first fused image frame and the second fused image frame are generated by real-time processing.

[0053] Continue to refer to Figure 3 In step S320, the first fused image frame and the second fused image frame may be displayed in sequence.

[0054] The effect displayed is Figure 4 As mentioned above, the final brightness perceived by the human eye is obviously higher than Figure 2 The blended result is brighter.

[0055] The above has been referred to Figures 1 to 4 A method for image processing according to an embodiment of the present disclosure is described. According to the method of the embodiment of the present disclosure, a fused image frame obtained by fusing an image frame with a grayscale image frame can be displayed, and the grayscale image frame is obtained by grayscale processing based on the corresponding area in the frame adjacent to the image frame, so that the display brightness can be compensated and power consumption can be reduced, so that the displayed fused image frame is brighter than before, so that the final brightness perceived by the human eye is brighter. In addition, in the method provided in the present disclosure, the grayscale image frame is further smoothed after the grayscale processing, so that the content details or contours in the grayscale image frame can be removed to avoid content crosstalk during subsequent brightness compensation. In addition, the above-mentioned grayscale processing, smoothing processing and fusion processing can be processing that has been completed in advance, and can also be processing performed in real time, so that the method provided in the present disclosure has good flexibility.

[0056] In addition, the above method provided by the present disclosure can be applied to any existing device that supports 2D and 3D mixed display, such as the device that supports 2D and 3D mixed display through backlight as described above or the device that supports 2D and 3D mixed display through liquid crystal lens (lens).

[0057] In addition to providing the above-mentioned method for image processing, the present disclosure also provides an apparatus for image processing. Figure 5 This is explained.

[0058] Figure 5FIG. 5 is a block diagram of an apparatus 500 for image processing according to an embodiment of the present disclosure. The above description of the method for image processing is also applicable to the apparatus 500, unless otherwise explicitly stated.

[0059] Reference Figure 5 , the apparatus 500 for image processing may include an acquisition unit 510 and a display unit 520 .

[0060] According to an embodiment of the present disclosure, the acquisition unit 510 may be configured to acquire a first fused image frame and a second fused image frame.

[0061] According to an embodiment of the present disclosure, a first fused image frame may be obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and a second fused image frame may be obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame may be obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame may be obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0062] As an example, image frames may be stored in a buffer in the form of a sequence.

[0063] As an example, the first image frame and the second image frame may be any frame in a sequence of image frames.

[0064] As an example, the image frame adjacent to the first image frame may be an image frame immediately next to the first image frame, or may be an image frame spaced N image frames from the first image frame, where N is a positive integer. For example, the image frame adjacent to the first image frame may be the third frame after the first image frame, or may be the third frame before the first image frame. It should be noted that the above-mentioned image frame adjacent to the first image frame is only an example, and the image frame adjacent to the first image frame may also be an image frame obtained based on multiple image frames adjacent to the first image frame.

[0065] As an example, the image frame adjacent to the second image frame may be an image frame immediately next to the second image frame, or may be an image frame separated from the second image frame by M image frames, where M is a positive integer. For example, the image frame adjacent to the second image frame may be the fifth frame after the second image frame, or may be the fifth frame before the second image frame. It should be noted that the above-mentioned image frame adjacent to the second image frame is only an example, and the image frame adjacent to the second image frame may also be an image frame obtained based on multiple image frames adjacent to the second image frame.

[0066] As an example, the first image frame may be a 2D image. The first region in the first image frame may be Figure 2 The second area in the image frame adjacent to the first image frame corresponding to the first area in the first image frame may be Figure 2 The 3D area shown in frame 2 (i.e., the area surrounded by the black area) can be grayed by any suitable graying algorithm (such as an averaging method, a method based on human eye perception, a desaturation method, a maximum value or minimum value method, etc.) to obtain a first grayscale image frame.

[0067] As an example, the second image frame may be a 3D image. The third area in the second image frame may be Figure 2 The fourth area in the image frame adjacent to the second image frame corresponding to the third area in the second image frame may be Figure 2 The 2D region shown in frame 1 (i.e., the region other than the black region) can be grayed by any suitable graying algorithm (such as an averaging method, a method based on human eye perception, a desaturation method, a maximum value or minimum value method, etc.) to obtain a second grayscale image frame.

[0068] It can be seen from the above two examples that the first region and the fourth region may be complementary. The second region and the third region may be complementary.

[0069] As an example, by Figure 2 By fusing the second image frame (such as frame 1 in FIG. 1 ) with the first grayscale image frame obtained above, the first fused image frame can be obtained. Figure 2 The second fused image frame can be obtained by fusing the frame 2 in the image with the second grayscale image frame obtained above. The two image frames can be fused by any suitable fusion algorithm, such as a pixel-level image fusion algorithm, a feature-level image fusion algorithm, a decision-level image fusion algorithm, etc.

[0070] Through the above fusion method, the black parts of the 2D and 3D frames will be replaced by the grayscale map (i.e., grayscale image frame) created according to the content of the corresponding area. For example, the black part in the 2D area will be replaced by the grayscale map, which can be created according to the content in the corresponding area of ​​the upcoming or previous 3D frame to supplement the brightness of the 3D content; and the black part in the 3D area will be replaced by the grayscale map created from the content in the corresponding area of ​​the upcoming or previous 2D frame to compensate for the brightness of the 2D content. As a result, the brightness of the mixed result of the 2D frame and the 3D frame is increased, thereby increasing the brightness perceived by the human eye.

[0071] According to an embodiment of the present disclosure, the first grayscale image frame may be obtained by graying the second region and smoothing the processed second region, and / or the second grayscale image frame may be obtained by graying the fourth region and smoothing the processed fourth region. The above-mentioned smoothing may be implemented by any suitable smoothing algorithm, such as a smoothing algorithm based on mean filtering, Gaussian filtering, bilateral filtering, etc.

[0072] As an example, the first grayscale image frame or the second grayscale image frame obtained by the grayscale processing is only black and white. After the first grayscale image frame or the second grayscale image frame after the grayscale processing is further smoothed, the content details or contours in the grayscale image frame can be removed to avoid content crosstalk when the brightness is subsequently compensated.

[0073] By taking the first image frame (such as Figure 2 The frame 1 in the image is merged with the first grayscale image frame obtained through grayscale processing and smoothing to obtain the first fused image frame (such as Figure 4 By combining the second image frame (such as Figure 2 The second fused image frame (such as Figure 4 The mixed display result of the first fused image frame and the second fused image frame can be Figure 4 It can be seen that the final brightness perceived by the human eye is significantly higher than Figure 2 The blended result is brighter.

[0074] According to the embodiment of the present disclosure, the first fused image frame and the second fused image frame stored in advance may be acquired. In this case, the first fused image frame and the second fused image frame are both frames that have been processed in advance.

[0075] According to the embodiment of the present disclosure, the first fused image frame and the second fused image frame generated by real-time processing can be acquired. At this time, both the first fused image frame and the second fused image frame are generated by real-time processing.

[0076] Continue to refer to Figure 5 , the display unit 520 may be configured to sequentially display the first fused image frame and the second fused image frame.

[0077] The effect displayed is Figure 4 As mentioned above, the final brightness perceived by the human eye is obviously higher than Figure 2 The blended result is brighter.

[0078] The above has been referred to Figures 1 to 5A method and apparatus for image processing according to an embodiment of the present disclosure are described. According to the method and apparatus of the embodiment of the present disclosure, a fused image frame obtained by fusing an image frame with a grayscale image frame can be displayed, and the grayscale image frame is obtained by grayscale processing based on the corresponding area in the frame adjacent to the image frame, so that the display brightness can be compensated and power consumption can be reduced, so that the displayed fused image frame is brighter than before, so that the final brightness perceived by the human eye is brighter. In addition, in the method and apparatus provided in the present disclosure, the grayscale image frame is further smoothed after the grayscale processing, so that the content details or contours in the grayscale image frame can be removed to avoid content crosstalk during subsequent brightness compensation. In addition, the above-mentioned grayscale processing, smoothing processing and fusion processing can be processing that has been completed in advance, and can also be processing performed in real time, so that the method provided in the present disclosure has good flexibility.

[0079] In addition to providing the above-mentioned method and apparatus for image processing, the present disclosure also provides a device for image processing. Figure 6 The above description of the method and apparatus for image processing is also applicable to the device described below, unless otherwise explicitly stated.

[0080] Figure 6 is a block diagram illustrating an apparatus 600 for image processing according to an embodiment of the present disclosure.

[0081] See also Figure 6 , the device 600 may include a processor 601 and a memory 602. The processor 601 and the memory 602 may be connected via a bus 603.

[0082] The processor 601 can perform various actions and processes according to the program stored in the memory 602. Specifically, the processor 601 can be an integrated circuit chip with signal processing capabilities. The above-mentioned processor can be a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The various methods, steps and logic block diagrams disclosed in the embodiments of the present application can be implemented or executed. The general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc., which can be an X86 architecture or an ARM architecture.

[0083] The memory 602 stores computer instructions, and when the computer instructions are executed by the processor 601, the above-mentioned method for image processing is implemented. The memory 602 can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous connection dynamic random access memory (SLDRAM) and direct memory bus random access memory (DR RAM). It should be noted that the memory of the method described herein is intended to include but is not limited to these and any other suitable types of memory.

[0084] The present disclosure also provides another device for image processing, including: a component for acquiring a first fused image frame and a second fused image frame; a component for sequentially displaying the first fused image frame and the second fused image frame, wherein the first fused image frame is obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and the second fused image frame is obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0085] According to yet another embodiment of the present disclosure, a computer-readable recording medium is also provided. Figure 7 A schematic diagram of a recording medium 700 according to an embodiment of the present disclosure is shown.

[0086] like Figure 7As shown, the recording medium 700 stores computer executable instructions 710. When the computer executable instructions 710 are executed by the processor, the method according to the embodiment of the present disclosure described with reference to the above figures can be executed. The computer-readable recording medium in the embodiment of the present disclosure can be a volatile memory or a non-volatile memory, or can include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous connection dynamic random access memory (SLDRAM) and direct memory bus random access memory (DR RAM). It should be noted that memory of the methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.

[0087] It should be noted that the flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment, or a part of a code, and the module, program segment, or a part of the code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of boxes in the block diagram and / or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0088] In general, various example embodiments of the present disclosure may be implemented in hardware or dedicated circuits, software, firmware, logic, or any combination thereof. Certain aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device. When various aspects of the embodiments of the present disclosure are illustrated or described as block diagrams, flow charts, or using some other graphical representation, it will be understood that the blocks, devices, systems, techniques, or methods described herein may be implemented in hardware, software, firmware, dedicated circuits or logic, general purpose hardware or controllers or other computing devices, or some combination thereof as non-limiting examples.

[0089] The exemplary embodiments of the present invention described in detail above are merely illustrative, rather than restrictive. It should be understood by those skilled in the art that various modifications and combinations may be made to these embodiments or their features without departing from the principles and spirit of the present invention, and such modifications should fall within the scope of the present invention.

[0090] In the above specific embodiments, it can be seen that different features are combined together in the examples. This disclosure should not be understood as an intention that the example clauses have more features than the features explicitly mentioned in each clause. On the contrary, various aspects of the present disclosure may include fewer features than all the features of the disclosed single example clauses. Therefore, the following clauses should be considered to be included in the specification, where each clause itself can be used as a separate example. Although each subordinate clause in these clauses can refer to a specific combination with one of the other clauses, the aspects of the subordinate clauses are not limited to specific combinations. It should be understood that other example clauses may also include a combination of the subject matter of the subordinate clauses with any other subordinate clauses or independent clauses, or any combination of features with other subordinate clauses and independent clauses. Various aspects disclosed herein explicitly include these combinations, unless it is explicitly expressed or it can be easily inferred that a specific combination is not intended (for example, contradictory aspects, such as defining an element as both an insulator and a conductor). In addition, it is also intended that various aspects of the clauses may also be included in any other independent clauses, even if the clause is not directly subordinate to the independent clause.

[0091] The following numbered clauses describe implementation examples:

[0092] Clause 1. A method for image processing, comprising: acquiring a first fused image frame and a second fused image frame; displaying the first fused image frame and the second fused image frame in sequence, wherein the first fused image frame is obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and the second fused image frame is obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0093] Clause 2. A method according to Clause 1, wherein the first grayscale image frame is obtained by grayscale processing the second area and smoothing the processed second area, and / or the second grayscale image frame is obtained by grayscale processing the fourth area and smoothing the processed fourth area.

[0094] Clause 3. The method according to clause 1 or 2, wherein the acquiring of the first fused image frame and the second fused image frame comprises: acquiring the first fused image frame and the second fused image frame which are pre-stored.

[0095] Clause 4. The method according to any one of clauses 1-3, wherein acquiring the first fused image frame and the second fused image frame comprises: acquiring the first fused image frame and the second fused image frame generated by real-time processing.

[0096] Clause 5. The method according to any one of clauses 1 to 4, wherein the first region is complementary to the fourth region, and the second region is complementary to the third region.

[0097] Clause 6. A device for image processing, comprising: an acquisition unit, configured to acquire a first fused image frame and a second fused image frame; a display unit, configured to display the first fused image frame and the second fused image frame in sequence, wherein the first fused image frame is obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and the second fused image frame is obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0098] Clause 7. An apparatus according to Clause 6, wherein the first grayscale image frame is obtained by grayscale processing the second region and smoothing the processed second region, and / or the second grayscale image frame is obtained by grayscale processing the fourth region and smoothing the processed fourth region.

[0099] Clause 8. The apparatus according to clause 6 or 7, wherein the acquisition unit is configured to: acquire a pre-stored first fused image frame and a pre-stored second fused image frame.

[0100] Clause 9. The device according to any one of clauses 6 to 8, wherein the acquisition unit is configured to: acquire a first fused image frame and a second fused image frame generated by real-time processing.

[0101] Clause 10. The device of any of clauses 6-9, wherein the first region is complementary to the fourth region and the second region is complementary to the third region.

[0102] Item 11. A device for image processing, comprising: a component for acquiring a first fused image frame and a second fused image frame; a component for sequentially displaying the first fused image frame and the second fused image frame, wherein the first fused image frame is obtained by fusing a first image frame in an image frame sequence with a first grayscale image frame, and the second fused image frame is obtained by fusing a second image frame in the image frame sequence with a second grayscale image frame, wherein the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to a first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to a third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

[0103] Clause 12. A device for image processing, comprising: a processor, and a memory, wherein the memory stores computer executable instructions, which, when executed by the processor, cause the processor to perform the method as described in any one of Clauses 1-5.

[0104] Clause 13. A computer-readable recording medium storing computer-executable instructions, wherein the computer-executable instructions, when executed by a processor, cause the processor to perform the method as described in any one of Clauses 1-5.

Claims

1. A method for image processing, comprising: Acquire a first fused image frame and a second fused image frame; sequentially displaying the first fused image frame and the second fused image frame, The first fused image frame is obtained by fusing the first image frame in the image frame sequence with the first grayscale image frame, and the second fused image frame is obtained by fusing the second image frame in the image frame sequence with the second grayscale image frame. Among them, the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to the first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to the third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

2. The method according to claim 1, wherein: The first grayscale image frame is obtained by graying the second region and smoothing the processed second region, and / or the second grayscale image frame is obtained by graying the fourth region and smoothing the processed fourth region.

3. The method according to claim 1, wherein: The acquiring of the first fused image frame and the second fused image frame includes: acquiring the first fused image frame and the second fused image frame which are pre-stored.

4. The method according to claim 1, wherein: The acquiring of the first fused image frame and the second fused image frame includes: acquiring the first fused image frame and the second fused image frame generated by real-time processing.

5. The method according to claim 1, wherein: The first region is complementary to the fourth region, and the second region is complementary to the third region.

6. A device for image processing, comprising: An acquisition unit, configured to acquire a first fused image frame and a second fused image frame; A display unit is configured to sequentially display the first fused image frame and the second fused image frame, The first fused image frame is obtained by fusing the first image frame in the image frame sequence with the first grayscale image frame, and the second fused image frame is obtained by fusing the second image frame in the image frame sequence with the second grayscale image frame. Among them, the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to the first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to the third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

7. The device according to claim 6, wherein: The first grayscale image frame is obtained by graying the second region and smoothing the processed second region, and / or the second grayscale image frame is obtained by graying the fourth region and smoothing the processed fourth region.

8. The device according to claim 6, wherein: The acquisition unit is configured to acquire the pre-stored first fused image frame and the second fused image frame.

9. The device according to claim 6, wherein: The acquisition unit is configured to acquire a first fused image frame and a second fused image frame generated by real-time processing.

10. The device according to claim 6, wherein: The first region is complementary to the fourth region, and the second region is complementary to the third region.

11. A device for image processing, comprising: A component for acquiring a first fused image frame and a second fused image frame; A component for sequentially displaying a first fused image frame and a second fused image frame, The first fused image frame is obtained by fusing the first image frame in the image frame sequence with the first grayscale image frame, and the second fused image frame is obtained by fusing the second image frame in the image frame sequence with the second grayscale image frame. Among them, the first grayscale image frame is obtained based on grayscale processing of a second area in an image frame adjacent to the first image frame corresponding to the first area in the first image frame, and the second grayscale image frame is obtained based on grayscale processing of a fourth area in an image frame adjacent to the second image frame corresponding to the third area in the second image frame, wherein the first image frame is a 2D image and the second image frame is a 3D image.

12. A device for image processing, comprising: processor, and A memory storing computer executable instructions, which, when executed by a processor, cause the processor to perform the method according to any one of claims 1 to 5.

13. A computer-readable recording medium storing computer-executable instructions, wherein: The computer executable instructions, when executed by a processor, cause the processor to perform the method of any one of claims 1-5.

Images