IMAGE PROCESSING METHOD, APPARATUS, ELECTRONIC DEVICE, AND READABLE STORAGE MEDIUM

Abstract

The present disclosure relates to an image processing method, apparatus, electronic device, and readable storage medium, where the method includes traversing a plurality of multimedia materials and determining multimedia materials of a non-target color display standard contained in the plurality of multimedia materials based on a target color display standard; converting the multimedia materials of the non-target color display standard into multimedia materials of a target color display standard; and image rendering the plurality of multimedia materials based on the target color display standard, so that the image rendering results can be presented or exported as a video file of a specific format according to the image rendering results.

Description

[Technical field]

[0001] [CROSS REFERENCE TO RELATED APPLICATIONS] This application claims priority from Chinese Patent Application No. 202111658426.2, filed on December 30, 2021, the entire disclosure of which is hereby incorporated by reference in its entirety into this application.

[0002] [Technical field] The present disclosure relates to the field of image processing technology, and in particular to an image processing method, device, electronic device, and readable storage medium. [Background technology]

[0003] When editing a video, multiple multimedia materials are always edited together to generate a video that meets an expected display effect. Summary of the Invention

[0004] The present disclosure provides an image processing method, an apparatus, an electronic device, and a readable storage medium.

[0005] According to a first aspect, the present disclosure provides an image processing method, the method comprising: determining, based on the target color display standard, multimedia materials having a non-target color display standard included in the plurality of multimedia materials; converting the non-target color display standard multimedia material into the target color display standard multimedia material; The method includes image-rendering the plurality of multimedia materials based on the target color display standard, and presenting the plurality of multimedia materials on a display screen of an electronic device according to the image rendering result, or exporting the plurality of multimedia materials as a video file of a specific format according to the image rendering result.

[0006] In some embodiments, before determining, based on the target color display standard, multimedia material of a non-target color display standard included in the plurality of multimedia materials, the method further comprises: The method further includes determining the target color display standard.

[0007] In some embodiments, determining the target color display standard comprises: determining the target color display standard based on color display standards corresponding to each of the plurality of multimedia materials;

[0008] In some embodiments, determining the target color display standard based on color display standards corresponding to each of the plurality of multimedia materials comprises: determining the target color display standard based on a color display standard having the widest color space among the color display standards corresponding to each of the plurality of multimedia materials;

[0009] In some embodiments, determining the target color display standard includes determining the target color display standard based on a pre-specified color display standard.

[0010] In some embodiments, converting the non-target color display standard multimedia material to the target color display standard multimedia material comprises: converting the non-target color display standard multimedia material into the target color display standard multimedia material if the non-target color display standard multimedia material was generated based on a video frame image at a freeze-frame position of another non-target color display standard multimedia material among the plurality of multimedia materials; or This includes not converting the multimedia material of the non-target color display standard if the multimedia material of the non-target color display standard was generated based on a video frame image at the freeze frame position of the multimedia material of the target color display standard among the plurality of multimedia materials.

[0011] In some embodiments, the target color display standard is a perceptually quantized (PQ) color display standard, and the non-target color display standard includes a standard dynamic range (SDR) color display standard and / or a hybrid log gamma curve (HLG) color display standard; or The target color display standard is an SDR color display standard, and the non-target color display standard includes an HLG color display standard and / or a PQ color display standard; or The target color display standard is the HLG color display standard, and the non-target color display standard includes the SDR color display standard and / or the PQ color display standard.

[0012] In some embodiments, prior to said image rendering of said plurality of multimedia materials based on said target color display standard, said method further comprising: The method further includes processing the plurality of multimedia materials according to a clip manipulation scheme corresponding to each of one or more clip types.

[0013] According to a second aspect, the present disclosure provides an image processing apparatus, the apparatus comprising: an identification module for determining non-target color display standard multimedia materials included in the plurality of multimedia materials based on the target color display standard; a conversion module for converting the non-target color display standard multimedia material into the target color display standard multimedia material; a rendering module for image rendering of the plurality of multimedia materials; and a control module for controlling the plurality of multimedia materials to be presented on a display screen of an electronic device according to the image rendering result, or for controlling the plurality of multimedia materials to be exported as a video file of a specific format according to the image rendering result.

[0014] According to a third aspect, the present disclosure provides an electronic device, the electronic device including a memory and a processor; the memory is configured to store computer program instructions; The processor is configured to execute the computer program instructions to cause the electronic device to implement the image processing method according to the first aspect.

[0015] According to a fourth aspect, the present disclosure provides a readable storage medium, the readable storage medium comprising computer program instructions: At least one processor of the electronic device executes the computer program instructions to implement the image processing method according to the first aspect.

[0016] According to a fifth aspect, the present disclosure provides a computer program product, which, when executed by a computer, causes the computer to implement the image processing method according to the first aspect.

[0017] According to a sixth aspect, the present disclosure provides a computer program comprising instructions which, when executed by a processor, cause the processor to implement the image processing method according to the first aspect.

[0018] The present disclosure provides an image processing method, apparatus, electronic device, and readable storage medium, where the method includes traversing a plurality of multimedia materials and determining, based on a target color display standard, multimedia materials of a non-target color display standard contained in the plurality of multimedia materials; converting the multimedia materials of the non-target color display standard into multimedia materials of a target color display standard; and image-rendering the plurality of multimedia materials based on the target color display standard, so that the image rendering results can be presented or exported as a video file of a specific format according to the image rendering results. [Brief description of the drawings]

[0019] The drawings herein are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification serve to explain the principles of the present disclosure.

[0020] In order to more clearly explain the technical solutions in the embodiments or related technologies of the present disclosure, the following briefly introduces drawings that need to be used in the embodiments or related technology description, and it is obvious that those skilled in the art can also derive other drawings based on these drawings without exerting creative efforts. [Figure 1] 1 is a flowchart of an image processing method according to an embodiment of the present disclosure. [Figure 2A] 4 is a flowchart of an image processing method according to another embodiment of the present disclosure. [Figure 2B] 4 is a flowchart of an image processing method according to another embodiment of the present disclosure. [Diagram 3] 4 is a flowchart of an image processing method according to another embodiment of the present disclosure. [Figure 4] FIG. 1 is a structural schematic diagram of an image processing device according to an embodiment of the present disclosure. [Diagram 5] FIG. 1 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0021] In order to make the above objectives, features and advantages of the present disclosure more clearly understandable, the present disclosure will be further described below. It should be noted that, unless contradictory, the embodiments and features in the embodiments of the present disclosure can be combined with each other.

[0022] In order to facilitate a thorough understanding of the present disclosure, numerous specific details are set forth in the following description; however, the present disclosure may be implemented in other ways different from those described herein, and it is apparent that the embodiments in the specification are merely some embodiments of the present disclosure, and not all embodiments.

[0023] If the color display standards of multiple multimedia materials are the same, the video obtained by editing can meet the expected display effect. However, since the parameters of different color display standards such as color space and luminance range are all different, if the color display standards of multiple multimedia materials are not completely the same, the composite video obtained by editing and the preview during editing cannot achieve the expected display effect if they are displayed according to the original color display standards of each multimedia material. For example, the first multimedia material is a multimedia material of a standard dynamic range (SDR) color display standard, and the second multimedia material is a multimedia material of a high dynamic range (HDR) color display standard. The color space of the SDR color display standard is bt.709 and the luminance range is 0-100nit, while the color space of the HDR color display standard is bt.2020 and the luminance range is 0-10000nit. Therefore, after editing, if the first multimedia material is displayed according to the SDR color display standard and the second multimedia material is displayed according to the HDR color display standard, the visual difference between the two multimedia materials will be relatively large, the expected display effect cannot be achieved, and the user experience will be greatly reduced.

[0024] Based on this, the present disclosure provides an image processing method, an apparatus, an electronic device, a readable storage medium and a computer program product, in which the method converts multimedia materials of a non-target color display standard among a plurality of multimedia materials into multimedia materials of a target color display standard, thereby matching the color display standards of the plurality of multimedia materials, and in the composite video obtained based on this, each multimedia material is presented according to the target color display standard, so as to match the visual effects, thereby realizing that the display effect of the multimedia materials meets expectations.

[0025] Exemplarily, the image processing method according to the present disclosure may be performed by an image processing device according to the present disclosure, and the image processing device may be implemented in any software and / or hardware manner. Exemplarily, the image processing device may include, but is not limited to, tablet computers, mobile phones (e.g., folding screen mobile phones, large screen mobile phones, etc.), notebook computers, ultra-mobile personal computers (UMPCs), netbooks, personal digital assistants (PDAs), internet of things (IOT) devices such as smart TVs, smart screens, high definition TVs, 4K TVs, and smart projectors, servers, server clusters, cloud servers, etc., and the present disclosure does not impose any limitations on the specific types of electronic devices.

[0026] In the embodiment of the present disclosure, an electronic device is used as an example in which a video editing application program (abbreviated as Application 1) is installed in the electronic device, and multiple multimedia materials can be edited by Application 1. The image processing method according to the present disclosure will be described in detail in conjunction with drawings and application scenarios.

[0027] The image processing method according to the present disclosure can be used in the following scenarios:

[0028] Scenario 1: Application 1 is launched and multimedia material is introduced for the first time.

[0029] Scenario 2: When editing multiple multimedia materials, you want to add new multimedia materials.

[0030] Scenario 3: Using the freeze frame function provided by application 1 to insert specified multimedia material into the freeze frame position, where the "freeze frame function" refers to saving a video frame image at a specified position as an image, and inserting a corresponding number of this image into the specified position according to the playback rate.

[0031] Of course, the method according to the present disclosure is not limited to being used in the above scenarios, and the above scenarios 1 to 3 are merely examples.

[0032] 1 is a flowchart of an image processing method according to an embodiment of the present disclosure. Referring to FIG. 1, the method according to the present embodiment includes the following steps:

[0033] S101, determining multimedia materials of non-target color display standards included in a plurality of multimedia materials according to a target color display standard;

[0034] The present disclosure is not limited to the type of multimedia material, for example, the multimedia material may be any one of the types of materials such as photos, images, videos, etc. Furthermore, the present disclosure is not limited to the number of multimedia materials.

[0035] In addition, the color display standards corresponding to the multiple multimedia materials may not be completely the same or may be the same, and the present disclosure is not limited thereto. For example, there are five multimedia materials, three of which are multimedia materials of the PQ color display standard, one of which is multimedia materials of the HLG color display standard, and the other of which is multimedia materials of the SDR color display standard.

[0036] The present disclosure is not limited to the target color display standard and the non-target color display standard. Illustratively, the target color display standard is the PQ color display standard, and the non-target color display standard includes the SDR color display standard and / or the HLG color display standard, or the target color display standard is the SDR color display standard, and the non-target color display standard includes the HLG color display standard and / or the PQ color display standard, or the target color display standard is the HLG color display standard, and the non-target color display standard includes the SDR color display standard and / or the PQ color display standard.

[0037] It should be noted that the target color display standard and the non-target color display standard are not limited to the above cases, for example, the target color display standard may be a color display standard having a wider color space and a higher luminance range.

[0038] The present disclosure is not limited to the implementation manner of the electronic device acquiring multiple multimedia materials. For example, the electronic device may launch an application 1 and acquire multiple multimedia materials from the local storage space of the electronic device through related entries provided by the application 1. In addition, while the electronic device acquires the multimedia materials, it acquires related attribute information of each multimedia material, and determines a target color display standard corresponding to the multimedia materials according to the related attribute information of the multimedia materials.

[0039] For example, the related attribute information of the multimedia material may include color space information, color description information (color transfer information), etc., and the electronic device can determine the color display standard corresponding to the multimedia material based on the color description information corresponding to the multimedia material.

[0040] For example, assume that the format of color description information corresponding to multimedia material is as follows:

[0041] "color_transfer": "smpte2840", or "color_transfer": "arib-std-b67".

[0042] According to "smpte2840" or "arib-std-b67", it can be determined that the color display standard corresponding to this multimedia material is HDR.

[0043] Based on this, the application 1 can determine the color display standard corresponding to each of the multiple multimedia materials by traversing the related information of the multiple multimedia materials, and determine the multimedia materials of the non-target color display standard included in the multiple multimedia materials by comparing the color display standard corresponding to each multimedia material with the target color display standard, where the multimedia materials of the non-target color display standard may be one or more.

[0044] For example, if there are five multimedia materials, three of which are multimedia materials of PQ color display standard, one of which is multimedia material of HLG color display standard, and one of which is multimedia material of SDR color display standard, and the target color display standard is the PQ color display standard, the multimedia materials of non-target color display standards include multimedia materials of HLG color display standard and multimedia materials of SDR color display standard.

[0045] In some cases, when inserting an image at a specified position using the freeze frame function provided by the application 1, if the color display standard of the original multimedia material of the acquired image is different from the color display standard of the image to be saved, a color difference will occur in the inserted image. For example, the original multimedia material corresponding to the specified position is of HDR color display standard, but the electronic device only supports saving the image at the specified position as an image in JPEG format, but the image in JPEG format is of SDR color display standard, resulting in a color difference between the inserted image and the original multimedia material.

[0046] Therefore, when the freeze frame function is used to save an image extracted from an original multimedia material, a description file can be generated for the image, and the description file can store relevant attribute information of the image, such as information on the color display standard corresponding to the image source (i.e., the original multimedia material). When inserting the image, if it is determined based on the description file that the image originates from multimedia material of the target color display standard, the image is saved as a non-target color display standard, but no conversion is required; if it is determined based on the description file that the image originates from multimedia material of the non-target color display standard, the image is determined to be multimedia material of the non-target color display standard that needs conversion.

[0047] That is, when one of the multiple multimedia materials is generated based on another of the multiple multimedia materials, the color display standard of the original multimedia material is used to determine whether the multimedia material needs to be converted.

[0048] S102, converting the multimedia material of the non-target color display standard into the multimedia material of the target color display standard.

[0049] In some embodiments, implementing step S102 may include the following steps.

[0050] Step a: decoding the multimedia material in a non-target color display standard to obtain color values ​​in the non-target color display standard of each pixel point of the multimedia material, that is, obtaining a first set of color values;

[0051] Step b: converting each color value in the first color value set into an optical signal in the non-target color display standard according to an electro-optical transfer function (EOTF) corresponding to the non-target color display standard to obtain a first optical signal set.

[0052] Here, the electrical-optical conversion function is a function for describing the relationship between the non-linear color values ​​of the input display (digitally encoded pixel values, electrical signals) and the linear color values ​​(optical signals) displayed by the display.

[0053] Because what is stored and transmitted in the device is an electrical signal (i.e., color value), and the electrical-optical conversion functions corresponding to different color display standards are different, when converting the color values ​​of each pixel point of the multimedia material in the non-target color display standard to the color values ​​of the target color display standard, in order to realize the conversion of color values ​​of different color spaces in linear space, it is necessary to first convert the color values ​​of each pixel point of the multimedia material in the non-target color display standard into optical signals.

[0054] Step c, converting each optical signal in the first optical signal set according to an optical-to-optical transfer function (OOTF) to obtain a second optical signal set in the target color display standard.

[0055] Between optical signals of different color display standards, there is a specific conversion function (which may be understood as a conversion matrix), i.e., a light-to-light conversion function, which can realize the conversion of optical signals of non-target color display standards into optical signals of the target color display standard.

[0056] Step d, converting each optical signal in the second set of optical signals into a color value according to an optical-electrical conversion function (OETF) corresponding to the target color display standard to obtain a second set of color values ​​in the target color display standard of the multimedia material.

[0057] By converting the optical signal in the target color display standard into an electrical signal (color value) in the target color display standard, it is possible to obtain the color value in the target color display standard of each pixel point of the multimedia material.

[0058] In the above conversion process, the multimedia material may be converted on a frame-by-frame basis.

[0059] For example, the target color display standard is the PQ color display standard, and the non-target color display standard is the HLG color display standard.

[0060] Here, multimedia material in accordance with the HLG color display standard is abbreviated as HLG material, and multimedia material in accordance with the PQ color display standard is abbreviated as PQ material.

[0061] First, the HLG material is decoded to obtain the RGB values ​​in the HLG color display standard of each pixel point of the HLG material. Then, based on the EOTF of the HLG color display standard, each RGB value in the HLG color display standard is converted into an optical signal in the HLG color display standard. Based on an optical-to-optical conversion function between the HLG color display standard and the PQ color display standard, each optical signal in the HLG color display standard is converted into an optical signal in the PQ color display standard. Based on the optical-to-electrical conversion function of the PQ color display standard, each optical signal in the PQ color display standard is further converted into an RGB value in the PQ color display standard, thereby realizing conversion of the HLG material into an SDR material.

[0062] It should be noted that when the target color display standard and the non-target color display standard are in other situations, the implementation methods are similar, and the difference lies in the differences in the adopted electrical-to-optical conversion function, optical-to-optical conversion function and optical-to-electrical conversion function, and thus no examples will be given here one by one.

[0063] In some possible embodiments, after converting each optical signal of the non-target color display standard into an optical signal of the target color display standard by the above step c, a gamut mapping process may be performed to align color values ​​in different color display standards. The present disclosure is not limited to a specific implementation of the gamut mapping process.

[0064] For example, when the target color display standard is the SDR color display standard and the non-target color display standard is the PQ color display standard, the same RGB values ​​represent different colors in the PQ color display standard and the SDR color display standard. Therefore, after converting an optical signal of the PQ color display standard into an optical signal of the SDR color display standard, a color gamut mapping process may be performed on each optical signal to align the color values ​​in the different color display standards.

[0065] For example, referring to the embodiment shown in FIG. 2B, when converting multimedia material of the SDR color display standard into multimedia material of the PQ color display standard, each optical signal in the SDR color display standard may be converted into an optical signal in the PQ color display standard by an optical-optical conversion function, and then a color gamut mapping process may be performed on each optical signal. Then, the optical signal obtained by the color gamut mapping process in the PQ color display standard may be converted into an electrical signal in the PQ color display standard.

[0066] Similarly, a color gamut mapping process may be performed when converting a multimedia material in accordance with PQ color display standard into a multimedia material in accordance with SDR color display standard, and when converting a multimedia material in accordance with HLG color display standard into a multimedia material in accordance with SDR color display standard, the implementation of which is similar to that shown in FIG. 2B, and for the sake of brevity, will not be further described here.

[0067] In practical application, the application 1 can achieve step S102 by calling an application programming interface (API) provided by a function module that realizes the conversion between the different color display standards.

[0068] For example, a functional module that realizes conversion from multimedia material of the HLG color display standard to multimedia material of the PQ color display standard provides an API with the API name "TECoreHLG2PQCore", and application 1 can convert multimedia material of the HLG color display standard to multimedia material of the PQ color display standard by calling the API with the name "TECoreHLG2PQCore" through the implementation of the API.

[0069] A functional module for realizing the conversion from multimedia material of the SDR color display standard to multimedia material of the PQ color display standard provides an API with an API name "TECoreSDR2PQCore", and application 1 can convert multimedia material of the SDR color display standard to multimedia material of the PQ color display standard by calling the API "TECoreSDR2PQCore" through the implementation of the API.

[0070] In other situations where the target color display standard and the non-target color display standard are present, the manner of realizing the conversion through the API is similar to this example, and for the sake of brevity, will not be further described here.

[0071] S103, image-rendering the plurality of multimedia materials according to a target color display standard, and presenting the plurality of multimedia materials on a display screen of an electronic device according to the image-rendering result, or exporting the plurality of multimedia materials as a video file of a specific format according to the image-rendering result.

[0072] Visual rendering of the multimedia material may be accomplished using any currently existing rendering technology, and this disclosure is not limited to any particular implementation for visual rendering.

[0073] In a scenario where multimedia materials are presented on a display screen of an electronic device, the electronic device can convert the RGB color values ​​of pixel points of each multimedia image material into optical signals according to an electro-optical conversion function corresponding to a target color display standard and an image rendering result, and can present some or all of the multiple multimedia materials according to different scenarios.

[0074] For example, when a user is editing a number of multimedia materials through application 1, when the user is positioned at a specific video frame position, the multimedia materials corresponding to this specific position can be displayed according to the target color display standard.

[0075] For example, when a user is editing multiple multimedia materials using application 1, when playback of the multiple multimedia materials is triggered, the multiple multimedia materials can be played in sequence according to the order of the target color display standard.

[0076] When the multiple multimedia materials after color display standard conversion are exported as video files of a specific format, they can be encoded according to RGB color value information corresponding to the multimedia materials of the target color display standard based on the image rendering result, and saved as video files of a specific format, for example, mp4 format.

[0077] The method according to the present embodiment traverses a plurality of multimedia materials, and determines the multimedia materials of non-target color display standards contained in the plurality of multimedia materials according to a target color display standard, converts the multimedia materials of non-target color display standards into multimedia materials of target color display standard, and performs image rendering of the plurality of multimedia materials according to the target color display standard, so as to present the plurality of multimedia materials on a display screen of an electronic device according to the image rendering result, or export the plurality of multimedia materials as a video file of a certain format according to the image rendering result, thereby realizing the display effect of the multimedia materials to meet expectations.

[0078] Based on the embodiment shown in FIG. 1, the multimedia materials may be clipped before the multiple multimedia materials are image-rendered based on a target color display standard, for example, the multimedia materials may be clipped according to a clip operation method corresponding to each of one or more clip types provided by an application program.

[0079] Here, the clip type includes, for example, a filter, an effect, a sticker, etc. The clip operation manner is a specific clip manner provided by the clip type. For example, the filter may include a landscape filter, a gourmet filter, etc.

[0080] 3 is a flowchart of an image processing method according to an embodiment of the present disclosure. Referring to FIG. 3, the method according to the present embodiment includes the following steps:

[0081] S301, determining target color display standards;

[0082] In some embodiments, the target color display standard may be determined based on an adaptation policy, i.e., the adaptation policy is a policy that represents a change in the target color display standard with respect to the target color display standards corresponding to each of the plurality of multimedia materials. Exemplarily, the target color display standard may be a color display standard having a widest color space among the color display standards corresponding to each of the plurality of multimedia materials.

[0083] For example, when three multimedia materials are introduced by application 1, the color display standards corresponding to the three multimedia materials are the same, and all three multimedia materials are multimedia materials of the SDR color display standard. During the video editing process, a new multimedia material is introduced, and this newly introduced multimedia material is a multimedia material of the PQ color display standard. Based on the adaptation policy, it can be determined that the target color display standard is the PQ color display standard, that is, the three previously introduced multimedia materials need to be converted to the PQ color display standard.

[0084] In another possible embodiment, the target color display standard may be a pre-specified color display standard, for example, the target color display standard may be a color display standard specified by the application 1.

[0085] Here, when determining the target color display standard, it is necessary to take into account the color display standard supported by the electronic device to avoid the occurrence of errors. Therefore, before determining the target color display standard using the above-mentioned adaptation policy or a method specified by the application program, the color display standard supporting the screen display of the electronic device may be detected.

[0086] Exemplarily, a target color display standard that an electronic device supports for top screen display may be determined by checking related parameters in a specific API. For example, when an electronic device using an Android system determines whether it supports the top screen display HDR color display standard, it checks display parameters supported by the screen of the electronic device and checks a graphics API, and if both checks are passed, it is determined that the electronic device supports the top screen display HDR color display standard. This is merely an example, and a specific implementation method is not limited to being implemented by checking display parameters supported by the screen of the electronic device and checking a graphics API.

[0087] S302, determining multimedia materials of non-target color display standards included in the plurality of multimedia materials according to the target color display standard.

[0088] S303, converting the multimedia material of the non-target color display standard into the multimedia material of the target color display standard.

[0089] S304, image-rendering the plurality of multimedia materials based on the target color display standard, and presenting the plurality of multimedia materials on a display screen of an electronic device according to the image rendering result, or exporting the plurality of multimedia materials as a video file of a specific format according to the image rendering result.

[0090] Steps S302 to S304 in this embodiment are similar to steps S101 to S103 in the embodiment shown in FIG. 1, respectively, and reference may be made to the detailed description of the embodiment shown in FIG. 1, and for the sake of brevity, they will not be further described here.

[0091] The method according to the present embodiment traverses a plurality of multimedia materials, and determines the multimedia materials of non-target color display standards contained in the plurality of multimedia materials according to a target color display standard, converts the multimedia materials of non-target color display standards into multimedia materials of a target color display standard, and performs image rendering of the plurality of multimedia materials according to the target color display standard, so that the image rendering result can be displayed on a screen or exported as a video file of a specific video format, thereby solving the problem that the composite video display effect obtained by editing the multimedia materials of different color display standards is abnormal. In addition, the target color display standard can be determined according to an adaptive policy or a specified manner during application, which can improve the flexibility of image processing.

[0092] Illustratively, the present disclosure further provides an image processing apparatus.

[0093] 4 is a structural schematic diagram of an image processing device according to an embodiment of the present disclosure. Referring to FIG. 4, an image processing device 400 according to this embodiment includes:

[0094] The identification module 401 is used for determining, based on the target color display standard, multimedia materials of non-target color display standards contained in the plurality of multimedia materials.

[0095] The conversion module 402 is used to convert the multimedia material in the non-target color display standard into the multimedia material in the target color display standard.

[0096] The rendering module 403 is used to perform image rendering of the plurality of multimedia materials based on the target color display standard to obtain an image rendering result.

[0097] The image processing device 400 may further include a control module 404 for controlling to display the multiple multimedia materials on a display screen of an electronic device according to the image rendering result, or to export the multiple multimedia materials as a video file of a specific format according to the image rendering result.

[0098] In some embodiments, the identification module 401 is also used to determine a target color display standard based on the target color display standard before determining multimedia materials of non-target color display standards contained in the plurality of multimedia materials.

[0099] In some embodiments, the identification module 401 is specifically used to determine the target color display standard based on the color display standards corresponding to each of the plurality of multimedia materials.

[0100] In some embodiments, the identification module 401 is specifically used to determine the target color display standard based on the color display standard with the widest color space among the color display standards corresponding to each of the multiple multimedia materials.

[0101] In some embodiments, the identification module 401 is specifically used to determine the target color display standard based on a pre-specified color display standard.

[0102] In some embodiments, the conversion module 402 is specifically used to convert the multimedia material of the non-target color display standard into multimedia material of the target color display standard if the multimedia material of the non-target color display standard was generated based on a video frame image at a freeze frame position of another multimedia material of the non-target color display standard among the plurality of multimedia materials, or to not convert the multimedia material of the non-target color display standard if the multimedia material of the non-target color display standard was generated based on a video frame image at the freeze frame position of another multimedia material of the target color display standard among the plurality of multimedia materials.

[0103] In some embodiments, the target color display standard is a PQ color display standard and the non-target color display standard includes an SDR color display standard and / or an HLG color display standard, or the target color display standard is an SDR color display standard and the non-target color display standard includes an HLG color display standard and / or a PQ color display standard, or the target color display standard is an HLG color display standard and the non-target color display standard includes an SDR color display standard and / or a PQ color display standard.

[0104] In some embodiments, the imaging device 400 may further include a clip processing module for processing the plurality of multimedia materials according to a clip manipulation scheme corresponding to each of one or more clip types.

[0105] During the process of clipping the multimedia materials, the rendering module 403 can perform image rendering in real time according to the processing result of the clip operation manner, and preview the clip effect on the display screen of the electronic device.

[0106] The image processing device according to this embodiment is used to implement any one of the method embodiments described above, and based on this, its realization principle and technical effect are similar, and reference can be made to the detailed description of the method embodiment described above, and for the sake of brevity, no further description will be given here.

[0107] Illustratively, the present disclosure further provides an electronic device.

[0108] 5 is a structural schematic diagram of an electronic device according to an embodiment of the present disclosure. Referring to FIG. 5, an electronic device 500 according to the present embodiment includes a memory 501 and a processor 502.

[0109] Here, the memory 501 may be an independent physical unit, or may be connected to the processor 502 via a bus 503. The memory 501 and the processor 502 may be integrated and realized by hardware or the like.

[0110] The memory 501 is used for storing program instructions, and the processor 502 calls the program instructions to execute the technical solutions of any one of the above method embodiments.

[0111] Alternatively, when some or all of the methods of the above embodiments are realized by software, the electronic device 500 may include only the processor 502. A memory 501 for storing a program is located outside the electronic device 500, and the processor 502 is connected to the memory via a circuit / wire to read and execute the program stored in the memory.

[0112] The processor 502 may be a central processing unit (CPU), a network processor (NP), or a combination of a CPU and a NP.

[0113] The processor 502 may further include a hardware chip. The hardware chip may be an application-specific integrated circuit (ASIC), a programmable logic device (PLD), or a combination thereof. The PLD may be a complex programmable logic device (CPLD), a field-programmable gate array (FPGA), a generic array logic (GAL), or any combination thereof.

[0114] The memory 501 may include volatile memory, such as random-access memory (RAM), the memory may also include non-volatile memory, such as flash memory, a hard disk drive (HDD) or a solid-state drive (SSD), the memory may also include a combination of the above types of memory.

[0115] The present disclosure further provides a readable storage medium, the readable storage medium comprising computer program instructions, The computer program instructions, when executed by at least one processor of an electronic device, implement the image processing method as set forth in any one of the method embodiments above.

[0116] The present disclosure further provides a computer program product, which, when executed by a computer, causes the computer to implement an image processing method as set forth in any one of the method embodiments above.

[0117] The present disclosure further provides a computer program comprising instructions, which when executed by a processor, cause the processor to implement an image processing method as set forth in any one of the method embodiments above.

[0118] It should be explained that in this specification, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply that any such actual relationship or sequence exists between these entities or operations. And the terms "comprise", "include", "includes" or any other variants thereof are intended to cover a non-exclusive "comprise", whereby a process, method, article or device that includes a set of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent in such process, method, article or device. In the absence of further limitations, an element limited by the text "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device that includes said element.

[0119] The above are merely specific embodiments of the present disclosure that enable those skilled in the art to understand or realize the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure is not limited to these embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. 1. An image processing method, comprising: determining, based on the target color display standard, multimedia materials having a non-target color display standard included in the plurality of multimedia materials; converting the non-target color display standard multimedia material into the target color display standard multimedia material; and image-rendering the plurality of multimedia materials based on the target color display standard, and presenting the plurality of multimedia materials on a display screen of an electronic device according to the image-rendering result, or exporting the plurality of multimedia materials as a video file of a specific format according to the image-rendering result.

2. Before determining, based on the target color display standard, multimedia materials of non-target color display standards included in the plurality of multimedia materials, the method further comprises: The method of claim 1 , further comprising determining the target color display standard.

3. determining the target color display standard comprises: The method of claim 2 , further comprising determining the target color display standard based on a color display standard having a widest color space among color display standards corresponding to each of the plurality of multimedia materials.

4. determining the target color display standard comprises: The method of claim 2 , further comprising determining the target color display standard based on a pre-specified color display standard.

5. said converting said non-target color display standard multimedia material into said target color display standard multimedia material, converting the non-target color display standard multimedia material into the target color display standard multimedia material if the non-target color display standard multimedia material was generated based on a video frame image at a freeze-frame position of another non-target color display standard multimedia material among the plurality of multimedia materials; or A method according to any one of claims 1 to 4, comprising not converting the multimedia material of the non-target color display standard if the multimedia material of the non-target color display standard was generated based on a video frame image at the freeze frame position of the multimedia material of the target color display standard among the plurality of multimedia materials.

6. said converting said non-target color display standard multimedia material into said target color display standard multimedia material, decoding the multimedia material in the non-target color display standard to obtain a first set of color values ​​in the non-target color display standard for each pixel point of the multimedia material; Converting each color value in the first color value set into an optical signal in the non-target color display standard according to an electrical-optical conversion function corresponding to the non-target color display standard to obtain a first optical signal set; converting each optical signal in the first set of optical signals based on an optical-to-optical conversion function to obtain a second set of optical signals in the target color display standard; 6. The method according to claim 1, further comprising: converting each optical signal in the second set of optical signals into a color value based on an opto-electrical conversion function corresponding to the target color display standard to obtain a second set of color values ​​in the target color display standard of the multimedia material.

7. 7. The method of claim 6, after converting each optical signal in the first set of optical signals based on the optical-optical conversion function to obtain a second set of optical signals in the target color display standard, the method further includes performing a color gamut mapping process to align color values ​​in different color display standards.

8. The target color display standard is a perceptually quantized (PQ) color display standard, and the non-target color display standard includes a standard dynamic range (SDR) color display standard and / or a hybrid log gamma curve (HLG) color display standard, or the target color display standard is an SDR color display standard, and the non-target color display standard includes an HLG color display standard and / or a PQ color display standard; or 8. The method of claim 1, wherein the target color display standard is the HLG color display standard and the non-target color display standards include the SDR color display standard and / or the PQ color display standard.

9. Prior to image rendering of the plurality of multimedia materials based on the target color display standard, the method further comprises:

9. The method of claim 1, further comprising processing the plurality of multimedia materials according to a clip manipulation scheme corresponding to each of one or more clip types.

10. An image processing device, an identification module for determining, based on the target color display standard, multimedia materials of a non-target color display standard included in the plurality of multimedia materials; a conversion module for converting the non-target color display standard multimedia material into the target color display standard multimedia material; a rendering module for image rendering of the plurality of multimedia materials; and a control module for controlling to present the plurality of multimedia materials on a display screen of an electronic device according to an image rendering result, or for controlling to export the plurality of multimedia materials as a video file of a specific format according to the image rendering result.

11. An electronic device, A memory and a processor are included, the memory is configured to store computer program instructions; 10. An electronic device, the processor being configured to execute the computer program instructions to cause the electronic device to implement the image processing method of any one of claims 1 to 9.

12. 1. A readable storage medium, comprising: Contains computer program instructions, A readable storage medium, the computer program instructions, when executed by at least one processor of an electronic device, causing the electronic device to implement the image processing method according to any one of claims 1 to 9.

13. A computer program product, which when executed by a computer, causes the computer to implement the image processing method according to any one of claims 1 to 9.

14. A computer program comprising instructions which, when executed by a processor, cause the processor to implement the image processing method according to any one of claims 1 to 9.

Images