Video signal conversion method and device, electronic equipment, storage medium and program product

Abstract

The invention provides a video signal conversion method and device, electronic equipment, a storage medium and a program product. The conversion method comprises the following steps: acquiring a first color signal; wherein the first color signal is obtained through a first video signal; determining a first brightness signal according to a preset brightness formula and the first color signal; determining a second brightness signal according to a preset inverse tone mapping operator and the first brightness signal; determining a brightness scaling coefficient according to the first brightness signal and the second brightness signal; determining a second color signal according to the first color signal and the brightness scaling coefficient; wherein the second color signal is used for generating a second video signal. According to the technical scheme, the brightness scaling coefficient is determined based on the first color signal, the preset brightness formula and the preset inverse tone mapping operator, so that the second color signal meeting the requirement of the second video signal is obtained, and the whole process has the advantages of low cost and high efficiency.

Description

Technical Field

[0001] The present disclosure relates to the technical field of video conversion, and in particular, to a method, an apparatus, an electronic device, a storage medium, and a program product for converting video signals. Background Art

[0002] With the continuous maturity of 4K / 8K ultra-high-definition video technology, television programs and video websites can provide users with a clearer and more realistic visual experience, and the demand for converting high-definition videos into ultra-high-definition videos is increasing continuously. Summary of the Invention

[0003] In view of this, an object of the present disclosure is to provide a method, an apparatus, an electronic device, a storage medium, and a program product for converting video signals.

[0004] Based on the above object, the present disclosure provides a method for converting video signals, and the conversion method includes:

[0005] Obtaining a first color signal; wherein, the first color signal is obtained from a first video signal;

[0006] Determining a first luminance signal according to a preset luminance formula and the first color signal;

[0007] Determining a second luminance signal according to a preset inverse tone mapping operator and the first luminance signal;

[0008] Determining a luminance scaling coefficient according to the first luminance signal and the second luminance signal;

[0009] Determining a second color signal according to the first color signal and the luminance scaling coefficient; wherein, the second color signal is used to generate a second video signal.

[0010] Based on the same inventive concept, an embodiment of the present disclosure further provides a video signal conversion apparatus, including:

[0011] An obtaining module, configured to obtain a first color signal; wherein, the first color signal is obtained from a first video signal;

[0012] A first luminance module, configured to determine a first luminance signal according to a preset luminance formula and the first color signal;

[0013] A second luminance module, configured to determine a second luminance signal according to a preset inverse tone mapping operator and the first luminance signal;

[0014] A scaling coefficient module, configured to determine a luminance scaling coefficient according to the first luminance signal and the second luminance signal;

[0015] A conversion module, configured to determine a second color signal according to the first color signal and the luminance scaling factor; wherein the second color signal is used to generate a second video signal.

[0016] Based on the same inventive concept, an embodiment of the present disclosure further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the program, it implements the conversion method as described in any one of the above.

[0017] Based on the same inventive concept, an embodiment of the present disclosure further provides a non-transitory computer-readable storage medium storing computer instructions for causing a computer to execute the conversion method described in any one of the above.

[0018] Based on the same inventive concept, an embodiment of the present disclosure further provides a computer program product including computer program instructions. When the computer program instructions run on a computer, the computer is caused to execute the conversion method described in any one of the above.

[0019] As can be seen from the above, a video signal conversion method, apparatus, electronic device, storage medium, and program product provided by the embodiments of the present disclosure obtain a first color signal from a first video signal; determine a first luminance signal according to a preset luminance formula and the first color signal; determine a second luminance signal according to a preset inverse tone mapping operator and the first luminance signal; determine a luminance scaling factor according to the first luminance signal and the second luminance signal; determine a second color signal according to the first color signal and the luminance scaling factor; wherein the second color signal is used to generate a second video signal. Such a technical solution can determine the luminance scaling factor based on the first color signal, the preset luminance formula, and the preset inverse tone mapping operator, so as to obtain a second color signal that meets the requirements of the second video signal. The whole process has the advantages of low cost and high efficiency. Description of the Drawings

[0020] In order to more clearly illustrate the technical solutions in the present disclosure or related technologies, the following will briefly introduce the drawings required for use in the description of the embodiments or related technologies. Obviously, the drawings in the following description are only embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0021] Figure 1 A schematic diagram of an application scenario showing a video signal conversion method provided by an embodiment of the present disclosure;

[0022] Figure 2Schematic diagram showing the overall process of a video signal conversion method provided by an embodiment of the present disclosure;

[0023] Figure 3 Show Figure 2 Expansion process schematic diagram of the inverse tone mapping in

[0024] Figure 4 Schematic diagram showing the process of another video signal conversion method provided by an embodiment of the present disclosure;

[0025] Figure 5 Schematic diagram showing the structure of a video signal conversion device provided by an embodiment of the present disclosure;

[0026] Figure 6 Schematic diagram showing the structure of an electronic device provided by an embodiment of the present disclosure. Detailed implementation manners

[0027] To make the objectives, technical solutions and advantages of the present disclosure more clear and understandable, the present disclosure will be further described in detail below with reference to specific embodiments and the accompanying drawings.

[0028] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of the present disclosure should have the ordinary meanings understood by those of ordinary skill in the art to which the present disclosure belongs. The "first", "second" and similar terms used in the embodiments of the present disclosure do not denote any order, quantity or importance, but are only used to distinguish different components. The terms such as "including" or "comprising" mean that the elements or objects appearing before this word cover the elements or objects listed after this word and their equivalents, without excluding other elements or objects. The terms such as "connected" or "coupled" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The terms such as "upper", "lower", "left" and "right" are only used to represent relative positional relationships, and when the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0029] To facilitate the understanding of the technical solutions of the present disclosure, some technical terms related to the present disclosure will be introduced below.

[0030] High-definition TV programs and high-definition videos refer to high-definition and standard dynamic range (Standard Dynamic Range, abbreviated as SDR) digital videos whose signal formats comply with GY / T 155—2000 or GB / T 32631—2016. Their non-linear conversion curves (optical-electric / electro-optical conversion characteristic functions, abbreviated as OETF / EOTF) are such that the OETF complies with BT.709 and the EOTF complies with BT.1886 (the EOTF Gamma value is 2.4), and their color gamuts comply with the BT.709 color gamut.

[0031] Ultra-high-definition TV programs and ultra-high-definition videos refer to ultra-high-definition and high dynamic range (High-Dynamic Range, abbreviated as HDR) digital videos whose signal formats comply with GB / T 41808—2022 and GB / T 41809—2022. The non-linear conversion curve (optical-electric / electro-optical conversion characteristic function, OETF / EOTF) is the HLG curve that complies with GB / T 41808—2022, and their color gamuts comply with the BT.2020 color gamut.

[0032] Inverse tone mapping, also known as anti-tone mapping and tone up-mapping (up-conversion), refers to expanding the SDR signal to the HDR signal range to simulate the visual experience of HDR content, so that the up-mapped SDR image displayed on the HDR monitor has a similar visual experience to the native HDR image.

[0033] As described in the background art section, the demand for converting high-definition videos to ultra-high-definition videos is increasing continuously. In related technologies, video conversion methods have problems such as high hardware requirements, high computational complexity, and poor conversion effects.

[0034] In view of this, the embodiments of the present disclosure provide a method, apparatus, electronic device, storage medium, and program product for converting video signals. A first color signal is obtained from a first video signal; a first luminance signal is determined according to a preset luminance formula and the first color signal; a second luminance signal is determined according to a preset inverse tone mapping operator and the first luminance signal; a luminance scaling factor is determined according to the first luminance signal and the second luminance signal; a second color signal is determined according to the first color signal and the luminance scaling factor; wherein, the second color signal is used to generate a second video signal. Such a technical solution can determine the luminance scaling factor based on the first color signal, the preset luminance formula, and the preset inverse tone mapping operator, so as to obtain the second color signal that meets the requirements of the second video signal, and the whole process has the advantages of low cost and high efficiency.

[0035] In order to make the technical solutions of the present disclosure clearer and easier to understand, the following introduces the scenario architecture of a method for converting video signals provided by the embodiments of the present disclosure with reference to the accompanying drawings.

[0036] A video signal conversion method provided by an embodiment of the present disclosure includes, but is not limited to, being applied to an application scenario 100 as Figure 1 shown. As Figure 1 shown, this application scenario includes a server 102, a data storage system 104, and terminal devices 106A, 106B, and 106C. Among them, the server 102 can be connected to the data storage system 104 and the terminal devices 106A, 106B, and 106C through a wired or wireless communication network; the data storage system 104 can be connected to the terminal devices 106A, 106B, and 106C through a wired or wireless communication network.

[0037] The server 102 is used to obtain a high-definition video signal and convert it into an ultra-high-definition video signal to provide the ultra-high-definition video signal to the users of the terminal devices 106A, 106B, and 106C. Of course, the ultra-high-definition video signal converted by the server 102 can also be stored in the data storage system 104, and the data storage system 104 provides the corresponding ultra-high-definition video signal to the terminal devices 106A, 106B, and 106C in response to the requests of the terminal devices 106A, 106B, and 106C. The data storage system 104 can also directly provide the stored ultra-high-definition video signal to an ultra-high-definition TV channel.

[0038] It should be noted that the high-definition video signal can be a video signal directly collected by a collection device, such as a camera, a video camera, a camera, a webcam, etc., or a video signal stored in the data storage system, or a high-definition video signal provided by a video signal source. It should be noted that the high-definition video signal here can be a high-definition video signal obtained by a single collection device, or a new video signal obtained by editing and producing the video signals collected by multiple collection devices. The present disclosure does not make any limitations in this regard.

[0039] In addition, the ultra-high-definition video signal converted by the server 102 can also be directly provided to an ultra-high-definition TV channel and provided to users through the ultra-high-definition TV channel. The present disclosure does not make any limitations in this regard.

[0040] The terminal devices 106A, 106B, and 106C include, but are not limited to, televisions, desktop computers, mobile phones, laptops, tablets, media players, smart wearable devices, personal digital assistants (PDAs), or other electronic devices capable of implementing the above functions. Both the server 102 and the data storage system 104 can be independent physical servers, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0041] It should be noted that the above application scenarios are only shown for the convenience of understanding the spirit and principle of the present disclosure, and the embodiments of the present disclosure are not limited in this regard. On the contrary, the embodiments of the present disclosure can be applied to any applicable scenario. For example, the terminal devices 106A, 106B, and 106C can replace the server 102 to convert high-definition video signals into ultra-high-definition video signals, and the present disclosure does not limit this.

[0042] Next, the video signal conversion method provided by the embodiments of the present disclosure will be described in detail from the perspective of the server 102 executing the video signal conversion method.

[0043] See Figure 2 As shown in the general flow schematic diagram of a video signal conversion method, the method includes:

[0044] S201: Convert the color difference signal of the acquired high-definition video signal to obtain non-linear red (R), blue (B), and green (G) signals. Here, the color difference signal of the high-definition video signal can be represented in the YCbCr format. Among them, Y represents the luminance component, indicating the grayscale information of the image; Cb represents the blue chrominance component, indicating the difference between blue and luminance; Cr: the red chrominance component, indicating the difference between red and luminance.

[0045] In some embodiments, based on the ITU-R BT.709 recommendation, from the normalized luminance and color difference signals E ′ Y 、E ′ CB 、E ′ CR to the normalized R ′ 、G ′ 、B ′ color signals E ′ R 、E ′ G 、E ′B The conversion can adopt the following conversion formula:

[0046]

[0047] It should be noted that ITU-R is the abbreviation of the International Telecommunication Union - Radiocommunication Sector.

[0048] S202: Use the preset electro-optical conversion function to perform electro-optical conversion on the non-linear RGB signals to obtain linear RGB signals.

[0049] Here, the electro-optical transfer function (Electro-Optical Transfer Function, abbreviated as EOTF) is a way to convert video signals into linear optical signals for output display. Display devices use it to convert recorded or received video signals into optical signals. For example, ITU-R BT.1886 EOTF, "ITU-R BT.1886 Reference electro-optical transfer function for flat panel displays used in HDTV studio production", is the reference electro-optical transfer characteristic (EOTF) of flat panel displays used in high-definition television studio production.

[0050] In some embodiments, using the ITU-R BT.1886 EOTF, the non-linearly represented normalized R ′ G ′ B ′ color signal E ′ R 、E ′ G 、E ′ B (Recommendation ITU-R BT.709) can be converted to the linearly represented, normalized RGB color signal E R E G E B (Recommendation ITU-R BT.709).

[0051] Optionally, the above conversion can be implemented using an approximation of the ITU-R BT.1886 EOTF. For example, E = (E ′ ) 2.40 , 0 ≤ E ′ ≤ 1.

[0052] It should be noted that the color gamut standard for high-definition video signals is the BT.709 color gamut, and the color gamut standard for ultra-high-definition video signals is the BT.2020 color gamut. To convert high-definition video signals into ultra-high-definition video signals, color gamut conversion is required.

[0053] S203: Perform color gamut conversion on the linear red, green, and blue signals to obtain a first color signal. Here, the first color signal is a linear, BT.2020 color gamut, normalized RGB color signal, and its color gamut meets the color gamut requirements of ultra-high-definition video signals.

[0054] Exemplarily, from the linearly represented, normalized RGB color signal E R E G E B (Recommendation BT.709) to the linearly represented, normalized RGB color signal E R E G E B (Recommendation BT.2020) color conversion:

[0055]

[0056] S204: Perform inverse tone mapping on the first color signal to obtain a normalized RGB color signal of HDR linear display light in the BT.2020 color gamut.

[0057] Figure 3 Show Figure 2 The expanded flowchart of the inverse tone mapping 204 in. As Figure 3 shown, S204 may specifically include:

[0058] S301: Determine a first luminance signal according to a preset luminance formula and the first color signal.

[0059] Exemplarily, the preset luminance formula may be Y = 0.2627R + 0.6780G + 00593B; where Y represents the luminance of the first color signal; R, G, and B respectively represent the red, green, and blue components in the first color signal.

[0060] S302: Determine a second luminance signal according to a preset inverse tone mapping operator and the first luminance signal.

[0061] In some embodiments, the inverse tone mapping operator includes a first operator and a second operator. S302 specifically includes:

[0062] Obtain a preset normalized inflection point coordinate; the normalized inflection point coordinate includes a first coordinate value; here, the normalized inflection point coordinate can be set according to experience, and the present disclosure does not limit this.

[0063] Exemplarily, the normalized inflection point coordinates may be (L kneeX , L kneeY ); where L kneeX is the first coordinate value of the normalized inflection point, and L kneeY is the second coordinate value of the normalized inflection point.

[0064] In response to determining that the first luminance signal is not greater than the first coordinate value L kneeX , the second luminance signal is determined based on the first operator;

[0065] Exemplarily, the first operator may be where Y HDR (x) is the second luminance signal, x is the first luminance signal; where t and c are preset constants;

[0066] Optionally, at least one of the preset constants is determined by machine learning. Additionally, the preset constants may also be determined based on experience, and the present disclosure does not limit this.

[0067] In response to determining that the first luminance signal is greater than the first coordinate value L kneeX , the second luminance signal is determined based on the second operator.

[0068] Exemplarily, the second operator is as follows:

[0069]

[0070] where γ is a preset constant.

[0071] With such a technical solution, the second luminance signal can be determined only through two operators, which has the advantages of low computational complexity, fast processing speed, and low hardware requirements.

[0072] S303: Determine a luminance scaling factor according to the first luminance signal and the second luminance signal.

[0073] Optionally, the luminance scaling factor may be obtained by dividing the second luminance signal (Y HDR ) by the first luminance signal (Y).

[0074] S304: Determine a second color signal according to the first color signal and the luminance scaling factor; where the second color signal is used to generate a second video signal. Here, the second color signal is a linear, normalized red - green - blue signal, and its dynamic range is high dynamic range (HDR).

[0075] In some embodiments, S304 specifically includes:

[0076] S3041: Determine the third color signal according to the first color signal and the luminance scaling factor.

[0077] Exemplarily, where RGB represents the first color signal; Y HDR / Y represents the luminance scaling factor; RGB HDR represents the third color signal.

[0078] S3042: Perform color adjustment on the third color signal to obtain the second color signal.

[0079] Exemplarily, a symmetric matrix can be used to adjust the third color signal.

[0080] For example where RGB HDR-adjust represents the second color signal; α is the adjustment parameter. It should be noted that α can be set according to experience, for example, α = 0.04.

[0081] It should be noted that the above technical solution of using a symmetric matrix to adjust the third color signal is only an example, and those skilled in the art can also adopt other color adjustment schemes to adjust the third color signal, and the present disclosure does not limit this.

[0082] S205: According to the inverse operation of the preset electro-optical conversion, convert the second color signal to obtain an ultra-high-definition video signal. Here, the inverse operation of electro-optical conversion is opposite to electro-optical conversion and is an operation that converts display linear light into an electrical signal.

[0083] The electro-optical / electro-optical non-linear conversion standard for high dynamic range (HDR) can be Hybrid LogGamma (HLG for short) or Perceptual Quantization (PQ for short). GB / T 41808—2022 and ITU-R BT.2100 specify these two HDR non-linear conversions of HLG and PQ.

[0084] Exemplarily, to perform the inverse operation of the electro-optical conversion function on the second color signal, Recommendation ITU-R BT.2100 can be adopted to implement the inverse EOTF of the HLG standard for the second color signal.

[0085] It should be understood that the preset inverse operation of electro-optical conversion can be adjusted according to the standard requirements of the video signal to be obtained, and the above inverse EOTF of the HLG standard is only an example.

[0086] Through the above technical solution, a high-definition video signal can be converted into an ultra-high-definition video signal. The entire process has a low computational load, a fast processing speed, low hardware requirements, and a low overall cost. The converted ultra-high-definition video signal retains the creative intention of the standard dynamic range before conversion, and has a similar visual experience to the ultra-high-definition video captured natively, ensuring good consistency in aspects such as brightness, color, and contrast of images from different camera positions and different scenes of the same program, no phenomenon of sudden brightening or darkening in the same scene, reasonable use of brightness and dynamic range, and full display of details in the bright and dark parts of the picture; it can effectively reduce problems such as contrast change, detail loss, color tone shift, and oversaturation of some color tones, and can be broadcast on ultra-high-definition TV channels and normally displayed on high-dynamic range (HDR) TVs. In addition, it can maintain temporal stability and does not introduce temporal errors.

[0087] It should be noted that the method of the embodiments of the present disclosure can be executed by a single device, such as a computer or a server. The method of this embodiment can also be applied to a distributed scenario, and completed by multiple devices cooperating with each other. In such a distributed scenario, one of the multiple devices can only execute one or more steps of the method of the embodiments of the present disclosure, and these multiple devices will interact with each other to complete the described method.

[0088] It should be noted that some embodiments of the present disclosure have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the above embodiments and still achieve the desired result. Additionally, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired result. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0089] Based on the same inventive concept, an embodiment of the present disclosure provides a method for converting a video signal. Figure 4 The flowchart showing another method for converting a video signal provided by an embodiment of the present disclosure is as follows Figure 4 As shown, the conversion method includes:

[0090] S401: Obtain a first color signal; wherein, the first color signal is obtained from a first video signal; here, the first video signal can be a high-definition video signal; the first color signal can be a linear, normalized red, green, and blue signal, and its dynamic range is the standard dynamic range;

[0091] S402: Determine a first luminance signal according to a preset luminance formula and the first color signal; here, S402 can refer to S301;

[0092] S403: Determine a second luminance signal according to a preset inverse tone mapping operator and the first luminance signal; here, S403 may refer to S302;

[0093] S404: Determine a luminance scaling factor according to the first luminance signal and the second luminance signal; here, S404 may refer to S303;

[0094] S405: Determine a second color signal according to the first color signal and the luminance scaling factor; wherein, the second color signal is used to generate a second video signal; here, the second video signal may be an ultra-high definition video signal; the second color signal is a linear, normalized red-green-blue signal, and its dynamic range is a high dynamic range; here, S405 may refer to S304.

[0095] For such a technical solution, the determination of the first luminance signal and the second luminance signal only requires a small amount of calculation, and the luminance scaling factor can be determined quickly, which helps to improve the overall efficiency of video signal conversion.

[0096] In some embodiments, the inverse tone mapping operator includes a first operator and a second operator; step S403 includes:

[0097] Referring to step S302: Obtain a preset normalized inflection point coordinate; the normalized inflection point coordinate includes a first coordinate value;

[0098] In response to determining that the first luminance signal is not greater than the first coordinate value, determine the second luminance signal based on the first operator;

[0099] In response to determining that the first luminance signal is greater than the first coordinate value, determine the second luminance signal based on the second operator.

[0100] In some embodiments, the first operator is as follows:

[0101]

[0102] And / or,

[0103] The second operator is as follows:

[0104]

[0105] Wherein, Y HDR (x) is the second luminance signal, and x is the first luminance signal;

[0106] Wherein, L kneeX is the first coordinate value of the normalized inflection point, L kneeY is the second coordinate value of the normalized inflection point, t, c, and γ are preset constants;

[0107] Here, the calculation of the second brightness signal can be realized by only using the first operator and the second operator, and the calculation method is simple; and the first operator and the second operator themselves are simple and clear, without complex calculations, which can greatly save computing resources.

[0108] In some embodiments, at least one of the preset constants is determined by machine learning.

[0109] In some embodiments, S405 specifically includes:

[0110] Referring to S304: determining a third color signal according to the first color signal and the brightness scaling coefficient;

[0111] Performing color adjustment on the third color signal to obtain the second color signal.

[0112] In some embodiments, the step of performing color adjustment on the third color signal includes:

[0113] Referring to S3042, the third color signal is adjusted using a symmetric matrix.

[0114] In some embodiments, the diagonal elements in the alignment matrix are 1+2α, and the non-diagonal elements are all -α; wherein α is an adjustment parameter.

[0115] In some embodiments, S401: specifically includes:

[0116] Referring to S201: converting the color difference signal of the first video signal to obtain nonlinear red, green and blue signals;

[0117] Referring to S202: using a preset electro-optical conversion function, performing electro-optical conversion on the nonlinear red, green and blue signal to obtain a linear red, green and blue signal;

[0118] Refer to S203: Perform color gamut conversion on the linear red, green and blue signal to obtain the first color signal.

[0119] In some embodiments, it also includes:

[0120] Referring to S205: according to the preset inverse operation of the electro-optical conversion, the second color signal is converted to obtain the second video signal. Here, based on S205, the second video signal can be obtained from the second color signal.

[0121] Based on the same inventive concept, corresponding to any of the above-mentioned embodiments and methods, the present disclosure further provides a video signal conversion device.

[0122] refer to Figure 5, the conversion device includes:

[0123] An acquisition module 501, configured to acquire a first color signal; wherein, the first color signal is obtained from a first video signal;

[0124] A first luminance module 502, configured to determine a first luminance signal according to a preset luminance formula and the first color signal;

[0125] A second luminance module 503, configured to determine a second luminance signal according to a preset inverse tone mapping operator and the first luminance signal;

[0126] A scaling factor module 504, configured to determine a luminance scaling factor according to the first luminance signal and the second luminance signal;

[0127] A conversion module 505, configured to determine a second color signal according to the first color signal and the luminance scaling factor; wherein, the second color signal is used to generate a second video signal.

[0128] For convenience of description, when describing the above device, it is divided into various modules according to functions and described separately. Of course, when implementing the present disclosure, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0129] The device of the above embodiment is used to implement the corresponding conversion method in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0130] Based on the same inventive concept, corresponding to the method of any of the above embodiments, the present disclosure further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, it implements the conversion method described in any one of the above embodiments.

[0131] Figure 6 FIG. shows a more specific schematic diagram of the hardware structure of the electronic device provided in this embodiment. The device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. Among them, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are communicatively connected to each other inside the device through the bus 1050.

[0132] The processor 1010 can be implemented in the form of a general-purpose CPU (Central Processing Unit), a microprocessor, an Application Specific Integrated Circuit (ASIC), or one or more integrated circuits, etc., and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0133] The memory 1020 can be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, etc. The memory 1020 can store an operating system and other application programs. When implementing the technical solutions provided in the embodiments of this specification through software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.

[0134] The input / output interface 1030 is used to connect to an input / output module to achieve information input and output. The input / output module can be configured as a component in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. Among them, the input device can include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device can include a display, a speaker, a vibrator, an indicator light, etc.

[0135] The communication interface 1040 is used to connect to a communication module (not shown in the figure) to achieve communication and interaction between this device and other devices. Among them, the communication module can achieve communication through a wired method (such as USB, network cable, etc.) or through a wireless method (such as a mobile network, WIFI, Bluetooth, etc.).

[0136] The bus 1050 includes a path for transmitting information between various components of the device (such as the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).

[0137] It should be noted that although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040, and the bus 1050, in the specific implementation process, this device may also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device may also only include the components necessary to implement the solutions of the embodiments of this specification, and do not necessarily include all the components shown in the figure.

[0138] The electronic device in the above embodiments is used to implement the corresponding conversion method in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0139] Based on the same inventive concept, corresponding to the method in any of the above embodiments, the present disclosure also provides a non-transitory computer-readable storage medium storing computer instructions for causing the computer to execute the conversion method described in any of the foregoing embodiments.

[0140] The computer-readable medium of this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible by a computing device.

[0141] The computer instructions stored in the storage medium of the above embodiments are used to cause the computer to execute the conversion method described in any of the foregoing embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0142] Based on the same inventive concept, corresponding to the conversion method described in any of the above embodiments, the present disclosure also provides a computer program product including computer program instructions. In some embodiments, the computer program instructions can be executed by one or more processors of the computer to cause the computer and / or the processor to execute the conversion method. Corresponding to the execution subject corresponding to each step in each embodiment of the conversion method, the processor executing the corresponding step can belong to the corresponding execution subject.

[0143] The computer program product of the above embodiments is used to cause the computer and / or the processor to execute the conversion method described in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0144] Those of ordinary skill in the art should understand that the discussion of any of the above embodiments is merely exemplary and is not intended to imply that the scope of the present disclosure (including the claims) is limited to these examples; under the concept of the present disclosure, the technical features in the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations in different aspects of the embodiments of the present disclosure as described above, and they are not provided in detail for the sake of brevity.

[0145] In addition, for simplicity of explanation and discussion, and in order not to make the embodiments of the present disclosure difficult to understand, the well-known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided drawings. Further, the devices may be shown in block diagram form in order to avoid making the embodiments of the present disclosure difficult to understand, and this also takes into account the fact that the details of the implementation of these block diagram devices are highly dependent on the platform on which the embodiments of the present disclosure are to be implemented (i.e., these details should be fully within the understanding of those skilled in the art). In cases where specific details (such as circuits) are set forth to describe exemplary embodiments of the present disclosure, it will be apparent to those skilled in the art that the embodiments of the present disclosure may be implemented without these specific details or with variations of these specific details. Accordingly, these descriptions should be considered illustrative rather than restrictive.

[0146] Although the present disclosure has been described in connection with specific embodiments of the present disclosure, many alternatives, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art based on the foregoing description. For example, other memory architectures (such as dynamic RAM (DRAM)) may be used with the embodiments discussed.

[0147] The embodiments of the present disclosure are intended to cover all such alternatives, modifications, and variations that fall within the broad scope of the appended claims. Therefore, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the embodiments of the present disclosure shall be included within the protection scope of the present disclosure.

Claims

1. A method for converting a video signal, characterized in that: The conversion method comprises: Acquire a first color signal; wherein the first color signal is obtained through a first video signal; Determine a first brightness signal according to a preset brightness formula and the first color signal; Determine a second brightness signal according to a preset inverse tone mapping operator and the first brightness signal; Determining a brightness scaling factor according to the first brightness signal and the second brightness signal; A second color signal is determined according to the first color signal and the brightness scaling factor; wherein the second color signal is used to generate a second video signal.

2. The conversion method according to claim 1, characterized in that: The first color signal is a linear, normalized red, green, and blue signal, and its dynamic range is a standard dynamic range; the second color signal is a linear, normalized red, green, and blue signal, and its dynamic range is a high dynamic range.

3. The conversion method according to claim 1 or 2, characterized in that: The inverse tone mapping operator includes a first operator and a second operator; The determining the second brightness signal according to the preset inverse tone mapping operator and the first brightness signal includes: Obtaining preset normalized inflection point coordinates; the normalized inflection point coordinates include a first coordinate value; In response to determining that the first brightness signal is not greater than the first coordinate value, determining the second brightness signal based on the first operator; In response to determining that the first brightness signal is greater than the first coordinate value, the second brightness signal is determined based on the second operator.

4. The conversion method according to claim 3, characterized in that: The first operator is as follows: and / or, The second operator is as follows: Among them, Y HDR (x) is the second brightness signal, and x is the first brightness signal; Among them, L kneeX is the first coordinate value of the normalized inflection point, L kneeY is the second coordinate value of the normalized inflection point, t, c, and γ are preset constants; 5. The conversion method according to claim 4, characterized in that: At least one of the preset constants is determined by machine learning.

6. The conversion method according to claim 1, characterized in that: The determining the second color signal according to the first color signal and the brightness scaling coefficient specifically includes: determining a third color signal according to the first color signal and the brightness scaling factor; Performing color adjustment on the third color signal to obtain the second color signal.

7. The conversion method according to claim 6, characterized in that: The step of performing color adjustment on the third color signal comprises: The third color signal is adjusted using a symmetric matrix.

8. The conversion method according to claim 7, characterized in that: The diagonal elements in the alignment matrix are 1+2α, and the non-diagonal elements are all -α; wherein α is an adjustment parameter.

9. The conversion method according to claim 1, characterized in that: The obtaining of the first color signal specifically includes: Converting the color difference signal of the first video signal to obtain nonlinear red, green and blue signals; Using a preset electro-optical conversion function, the nonlinear red, green and blue signal is electro-optically converted to obtain a linear red, green and blue signal; Performing color gamut conversion on the linear red, green and blue signal to obtain the first color signal.

10. The conversion method according to claim 1, characterized in that: Also includes: The second color signal is converted according to a preset inverse operation of the electro-optical conversion to obtain the second video signal.

11. A video signal conversion device, characterized in that: include: An acquisition module, configured to acquire a first color signal; wherein the first color signal is obtained through a first video signal; A first brightness module, configured to determine a first brightness signal according to a preset brightness formula and the first color signal; A second brightness module, configured to determine a second brightness signal according to a preset inverse tone mapping operator and the first brightness signal; a scaling factor module, configured to determine a brightness scaling factor according to the first brightness signal and the second brightness signal; The conversion module is configured to determine a second color signal according to the first color signal and the brightness scaling factor; wherein the second color signal is used to generate a second video signal.

12. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable by the processor, characterized in that: The processor implements the conversion method according to any one of claims 1 to 10 when executing the computer program.

13. A non-transitory computer-readable storage medium, characterized in that: The non-transitory computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the conversion method according to any one of claims 1 to 10.

14. A computer program product, characterized in that The invention comprises computer program instructions, which, when being executed on a computer, enable the computer to execute the conversion method according to any one of claims 1 to 10.

Images