Intelligent coding method and system, storage medium and electronic device

Abstract

The present disclosure provides an intelligent coding method and system, a storage medium and an electronic device. The intelligent coding method comprises: obtaining intelligent coding information, the intelligent coding information comprising a maximum target code rate, a minimum target code rate, a motion complexity, a texture complexity and a region of interest; and encoding an input source of a coder according to the intelligent coding information. The intelligent coding method has strong flexibility.

Description

TECHNICAL FIELD

[0001] The present disclosure belongs to the technical field of intelligent coding, and particularly relates to an intelligent coding method and system, a storage medium, and an electronic device. BACKGROUND

[0002] With the development of the Internet and video coding technology, network videos are developing towards the direction of super-clear and super-high definition. While people enjoy high-definition videos, they also face problems such as higher transmission bandwidth occupation and larger storage space requirements. To solve this problem, intelligent coding technology is applied. Existing intelligent coding schemes are usually cascaded with other mode bit rate control, such as constant bit rate (CBR) and variable bit rate (VBR), for simultaneous use. SUMMARY

[0003] The present disclosure provides an intelligent coding method and system, a storage medium, and an electronic device, to solve the problem that existing intelligent coding technology is not flexible enough.

[0004] In a first aspect, the present disclosure provides an intelligent coding method. The intelligent coding method comprises: obtaining intelligent coding information, the intelligent coding information comprising a maximum target bit rate, a minimum target bit rate, a motion complexity, a texture complexity, and a region of interest; and encoding an input source of an encoder according to the intelligent coding information.

[0005] In an implementation form of the first aspect, the encoding the input source of the encoder according to the intelligent coding information comprises: configuring at least one of a dynamic bit rate, a dynamic frame rate, a dynamic group of pictures, and an active region of protection for the input source of the encoder according to the intelligent coding information.

[0006] In an implementation form of the first aspect, the configuring the dynamic bit rate for the input source of the encoder according to the intelligent coding information comprises: obtaining an encoding coefficient according to the motion complexity, the texture complexity, and the region of interest, the encoding coefficient being positively correlated with the sizes of the motion complexity, the texture complexity, and the region of interest; and configuring a target bit rate of the encoder according to the encoding coefficient, the maximum target bit rate, and the minimum target bit rate.

[0007] In an implementation form of the first aspect, the configuring the target bit rate of the encoder according to the encoding coefficient, the maximum target bit rate, and the minimum target bit rate comprises: calculating and configuring the target bit rate of the encoder by the following formula:

[0008] target_bitrate = (max_bitrate - min_bitrate) x ratio + min_bitrate;

[0009] wherein target_bitrate is a target bit rate of the encoder, max_bitrate is the maximum target bit rate, min_bitrate is the minimum target bit rate, ratio is the encoding coefficient and has a value range between 0 and 1.

[0010] In an implementation form of the first aspect, obtaining the encoding coefficient according to the motion complexity, the texture complexity and the region of interest comprises: obtaining the encoding coefficient from an encoding coefficient table according to the motion complexity, the texture complexity and the region of interest.

[0011] In an implementation form of the first aspect, configuring an active protection region of an input source of the encoder according to the intelligent encoding information comprises: detecting a region of interest from the input source of the encoder; and configuring an encoding manner of the region of interest as a low quantization parameter encoding.

[0012] In an implementation form of the first aspect, configuring a dynamic frame rate and a dynamic group of pictures of an input source of the encoder according to the intelligent encoding information comprises: configuring the dynamic frame rate and the dynamic group of pictures according to the motion complexity and the texture complexity, wherein the lower the motion complexity, the lower the dynamic frame rate and the longer the dynamic group of pictures, and wherein the lower the texture complexity, the lower the dynamic frame rate and the longer the dynamic group of pictures.

[0013] In an implementation form of the first aspect, obtaining the intelligent encoding information comprises: obtaining the maximum target bit rate and the minimum target bit rate according to a bit rate configuration instruction input by a user.

[0014] The second aspect, the present disclosure provides an intelligent encoding system. The intelligent encoding system comprises: an encoding information obtaining device configured to obtain intelligent encoding information, the intelligent encoding information comprising a maximum target bit rate, a minimum target bit rate, a motion complexity, a texture complexity and a region of interest; and an encoding device configured to encode an input source according to the intelligent encoding information.

[0015] The third aspect, the present disclosure provides a computer readable storage medium. The computer readable storage medium stores a computer program, the computer program is executed by a processor to implement the intelligent encoding method according to any one of the first aspect of the present disclosure.

[0016] In a fourth aspect, the present disclosure provides an electronic device. The electronic device comprises a memory configured to store a computer program; and a processor configured to execute the computer program to perform the intelligent coding method according to any one of the first aspect of the present disclosure.

[0017] According to the intelligent coding method provided in the implementation manner of the present disclosure, the encoder input source can be intelligently coded according to different scenes, so that the coding scheme can adapt to different scenes and has strong flexibility. For example, the code rate is small in a simple scene, the code rate is moderate in a medium complex scene, and the code rate is close to the maximum target code rate in a complex scene. In addition, the intelligent coding method can achieve visual lossless compared with other code rate control. BRIEF DESCRIPTION OF DRAWINGS

[0018] Figure 1 A flowchart of the intelligent coding method in the embodiment of the present disclosure is shown.

[0019] Figure 2 A flowchart of configuring the target code rate of the encoder in the embodiment of the present disclosure is shown.

[0020] Figure 3 A flowchart of configuring the effective protection area of the input source of the encoder in the embodiment of the present disclosure is shown.

[0021] Figure 4 A structural schematic diagram of the intelligent coding system in the embodiment of the present disclosure is shown.

[0022] Figure 5 A structural schematic diagram of the electronic device in the embodiment of the present disclosure is shown. DETAILED DESCRIPTION

[0023] The implementation manners of the present disclosure are described below through specific and concrete examples, and other advantages and effects of the present disclosure can be easily understood by those skilled in the art from the disclosure. The present disclosure can also be implemented or applied through other different specific implementation manners, and various modifications or changes can be made to the details in the specification based on different views and applications without departing from the spirit of the present disclosure. It should be noted that the following embodiments and features in the embodiments can be combined with each other without conflict.

[0024] It should be noted that the diagrams provided in the following embodiments only illustrate the basic concept of the present disclosure in a schematic manner, and the diagrams only show the components related to the present disclosure, not the number, shape and size of the components when actually implemented. The actual implementation of each component can be randomly changed in shape, number and proportion, and the layout pattern of the components can be more complex.

[0025] The existing intelligent coding scheme is usually used in cascade with other mode of code rate control, such as constant code rate control and variable code rate control. Therefore, the prior art does not design a code rate control scheme for intelligent coding alone, which has poor flexibility and is difficult to dynamically test the code rate according to the actual scene complexity and cannot make flexible adjustment for subjective effect deficiency.

[0026] At least for the above problems, the present disclosure provides an intelligent coding method, which can intelligently code the input source of the encoder according to different scenes, so that the coding scheme of the input source of the encoder can adapt to different scenes and has strong flexibility. In addition, the intelligent coding method can realize visual lossless relative to other code rate control.

[0027] The technical solutions in the embodiments of the present disclosure will be described in detail below with reference to the drawings in the embodiments of the present disclosure.

[0028] Figure 1 is a flowchart illustrating an intelligent coding method according to an embodiment of the present disclosure. As shown in Figure 1 , the intelligent coding method provided by the embodiment of the present disclosure includes the following steps S11 and S12.

[0029] In step S11, intelligent coding information is obtained, and the intelligent coding information includes a maximum target code rate, a minimum target code rate, a motion complexity, a texture complexity, and a region of interest (ROI). The code rate refers to the number of data bits transmitted per unit time during data transmission, and the commonly used unit is kbps.

[0030] In step S12, the input source of the encoder is coded according to the intelligent coding information. In some embodiments, at least one of the dynamic code rate, the dynamic frame rate, the dynamic group of pictures, and the effective protection area of the input source of the encoder is configured according to the intelligent coding information.

[0031] According to the embodiment of the present disclosure, the input source of the encoder can be intelligently coded according to different scenes, the code rate is small in a simple scene, the code rate is moderate in a medium complex scene, and the code rate is close to the maximum target code rate in a complex scene. In this way, the coding scheme can adapt to different scenes and has strong flexibility.

[0032] Figure 2 is a method for configuring a dynamic code rate of an input source of an encoder according to intelligent coding information according to an embodiment of the present disclosure. As shown in Figure 2 , the method for configuring a dynamic code rate of an input source of an encoder according to intelligent coding information according to the embodiment of the present disclosure includes the following steps S21 and S22.

[0033] In step S21, the encoding coefficient is obtained according to the motion complexity, the texture complexity and the size of the region of interest. The encoding coefficient is positively correlated with the motion complexity, the texture complexity and the size of the region of interest. In some embodiments, the encoding coefficient is obtained from an encoding coefficient table according to the motion complexity, the texture complexity and the size of the region of interest. The encoding coefficient table can be obtained empirically or by actual measurement, and contains the corresponding relationship between the motion complexity, the texture complexity, the size of the region of interest and the encoding coefficient. The higher the motion complexity and the texture complexity, and the larger the size of the region of interest, the larger the corresponding encoding coefficient in the encoding coefficient table.

[0034] In step S22, the target bit rate of the encoder is configured according to the encoding coefficient, the maximum target bit rate and the minimum target bit rate. In some embodiments, the target bit rate of the encoder is calculated and configured by the following formula:

[0035] target_bitrate = (max_bitrate - min_bitrate) x ratio + min_bitrate;

[0036] wherein target_bitrate is the target bit rate of the encoder, max_bitrate is the maximum target bit rate, min_bitrate is the minimum target bit rate, and ratio is the encoding coefficient and takes a value in the range of 0 to 1.

[0037] It should be noted that the calculation of the bit rate of the input source of the encoder by the above formula is only one possible way of the embodiments of the present disclosure, but the present disclosure is not limited thereto.

[0038] Figure 3 is a flow chart showing the configuration of the effective protection region of the input source of the encoder according to the intelligent encoding information. As shown in Figure 3 , the configuration of the effective protection region of the input source of the encoder according to the intelligent encoding information in the embodiments of the present disclosure includes the following steps S31 and S32.

[0039] In step S31, the region of interest is detected from the input source of the encoder. In some embodiments, the region of interest can be detected by using the AI detection method of the input source of the encoder.

[0040] In step S32, the encoding mode of the region of interest is configured as low quantization parameter encoding. The low quantization parameter means that the quantization parameter used when the region of interest is encoded is smaller than that of the non-region of interest, and the specific value of the quantization parameter is not limited. In this way, the quality of the region of interest can be better preserved, so that the quality of the region of interest is clearer, thereby achieving the purpose of effectively protecting the region of interest.

[0041] It should be noted that the above steps S31 and S32 only exemplarily show a method for protecting the region of interest, but the present disclosure is not limited thereto. In specific applications, other technical means can be used to protect the region of interest.

[0042] In some embodiments, configuring the dynamic frame rate and the dynamic GOP of the input source of the encoder according to the intelligent encoding information comprises configuring the dynamic frame rate and the dynamic GOP of the input source of the encoder according to both the motion complexity and the texture complexity. The lower the motion complexity, the longer the dynamic GOP and the lower the dynamic frame rate. In addition, the lower the texture complexity, the longer the dynamic GOP and the lower the dynamic frame rate.

[0043] According to an embodiment of the present disclosure, acquiring the intelligent encoding information comprises acquiring the maximum target code rate and the minimum target code rate according to the code rate configuration instruction input by the user.

[0044] The protection scope of the intelligent encoding method provided by the embodiments of the present disclosure is not limited to the execution order of the steps listed in the embodiments. Any scheme realized by adding, replacing or modifying the steps of the prior art according to the principle of the present disclosure is included in the protection scope of the present disclosure.

[0045] The intelligent encoding method provided by the embodiments of the present disclosure can intelligently encode the input source of the encoder according to different scenes, so that the encoding scheme can adapt to different scenes and has strong flexibility. For example, the code rate is small in a simple scene, moderate in a moderately complex scene, and close to the maximum target code rate in a complex scene.

[0046] In addition, the intelligent encoding method provided by the embodiments of the present disclosure can better preserve the quality of the motion region by configuring the encoding mode of the region of interest as low-quantization-parameter encoding, so that the quality of the region is clearer, thereby achieving the purpose of effectively protecting the region of interest.

[0047] The embodiments of the present disclosure also provide an intelligent encoding system, which can implement the intelligent encoding method of the present disclosure. However, the implementation device of the intelligent encoding method of the present disclosure includes but is not limited to the structure of the intelligent encoding system listed in the embodiments. Any modification or replacement of the structure of the prior art according to the principle of the present disclosure is included in the protection scope of the present disclosure.

[0048] Figure 4 FIG. 1 is a structural schematic diagram of an intelligent encoding system 100 in an embodiment of the present disclosure. As shown in FIG. 1, the intelligent encoding system 100 comprises an intelligent encoding device 1000 and a video source 2000. Figure 4As shown, the intelligent encoding system 100 in the embodiments of the present disclosure includes an encoding information acquisition device 410 and an encoding device 420. The encoding information acquisition device 410 is configured to acquire intelligent encoding information, the intelligent encoding information including a maximum target bit rate, a minimum target bit rate, a motion complexity, a texture complexity, and a region of interest. The encoding device 420 is coupled to the encoding information acquisition device 410 and is configured to encode an input source according to the intelligent encoding information.

[0049] In some embodiments, the encoding device 420 is configured to configure at least one of a dynamic bit rate, a dynamic frame rate, a dynamic group of pictures, and an active region of interest for the input source of the encoder according to the intelligent encoding information.

[0050] In some embodiments, the encoding device 420 includes an encoding coefficient acquisition unit 421 and a bit rate configuration unit 422. The encoding coefficient acquisition unit 421 is configured to acquire an encoding coefficient according to the motion complexity, the texture complexity, and the region of interest, the encoding coefficient being positively correlated to the sizes of the motion complexity, the texture complexity, and the region of interest. The bit rate configuration unit 422 is configured to configure a target bit rate of the encoder according to the encoding coefficient, the maximum target bit rate, and the minimum target bit rate.

[0051] In some embodiments, the encoding coefficient acquisition unit 421 is configured to acquire the encoding coefficient from an encoding coefficient table according to the motion complexity, the texture complexity, and the region of interest.

[0052] In some embodiments, the bit rate configuration unit 422 is configured to calculate and configure the target bit rate of the encoder by the following formula:

[0053] target_bitrate = (max_bitrate - min_bitrate) x ratio + min_bitrate;

[0054] wherein target_bitrate is the target bit rate of the encoder, max_bitrate is the maximum target bit rate, min_bitrate is the minimum target bit rate, and ratio is the encoding coefficient and ranges from 0 to 1.

[0055] In some embodiments, the encoding device 420 is configured to detect the region of interest from the input source of the encoder and configure a coding manner of the region of interest as low quantization parameter coding.

[0056] In some embodiments, the encoding device 420 is configured to configure a dynamic frame rate and a dynamic group of pictures for the input source of the encoder according to both the motion complexity and the texture complexity. The lower the motion complexity, the longer the dynamic group of pictures and the lower the dynamic frame rate. In addition, the lower the texture complexity, the longer the dynamic group of pictures and the lower the dynamic frame rate.

[0057] In some embodiments, the encoding information acquisition device 410 is configured to acquire the maximum target code rate and the minimum target code rate according to a code rate configuration instruction input by a user.

[0058] In several embodiments provided by the present disclosure, it should be understood that the disclosed system or method can be implemented in other manners. For example, the embodiments of the system described above are merely schematic, and the division of the apparatus / units is merely logical function division, and there can be another division manner in actual implementation. For example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections between different units, or the among different units, can be indirect couplings or communication connections through some interfaces, devices or units, and can be in electrical, mechanical or other forms.

[0059] The apparatus / units described as separate components can or can not be physically separate, and the components shown as apparatus / units can or can not be physical apparatus, i.e., can be located in one place or distributed on a plurality of network units. Some or all of the apparatus / units can be selected according to actual needs to achieve the purpose of the embodiments of the present disclosure. For example, the functional apparatus / units in various embodiments of the present disclosure can be integrated in one processing apparatus, or each apparatus / unit can be physically present separately, or two or more apparatus / units can be integrated in one apparatus / unit.

[0060] It should also be further understood by those of ordinary skill in the art that the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein can be realized in electronic hardware, computer software or a combination of both. In order to clearly illustrate the interchangeability of hardware and software, the components and steps of the examples have been described in general terms in the above description. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present disclosure.

[0061] This disclosure also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, which is executed by a processor to implement the intelligent encoding method provided in this disclosure. Those skilled in the art will understand that all or part of the steps in the methods of the above embodiments can be implemented by a program instructing a processor. The program can be stored in a computer-readable storage medium, which is a non-transitory medium, such as random access memory, read-only memory, flash memory, hard disk, solid-state drive, magnetic tape, floppy disk, optical disk, and any combination thereof. The storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disc (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0062] The descriptions of the processes or structures corresponding to the above figures each have their own emphasis. For parts of a process or structure that are not described in detail, please refer to the relevant descriptions of other processes or structures.

[0063] This disclosure also provides an electronic device. Figure 5 The diagram shown is a structural schematic of the electronic device 500 in an embodiment of this disclosure. Figure 5 As shown, the electronic device 500 includes a memory 510 and a processor 520. The memory 510 is configured to store a computer program. The processor 520 is communicatively connected to the memory 510 and is configured to invoke the computer program to execute the intelligent coding method according to any one of the embodiments of this disclosure.

[0064] In some embodiments, the electronic device 500 may further include a display 530. The display 530 is communicatively connected to the memory 510 and the processor 520, and is used to display the relevant GUI interactive interface of the intelligent encoding method.

[0065] The above embodiments are merely illustrative of the principles and effects of this disclosure and are not intended to limit this disclosure. Any person skilled in the art can modify or alter the above embodiments without departing from the spirit and scope of this disclosure. Therefore, all equivalent modifications or alterations made by those skilled in the art without departing from the spirit and technical concept disclosed in this disclosure should still be covered by the claims of this disclosure.

Claims

1. A method of intelligent coding, characterized by, comprising: obtaining intelligent encoding information, the intelligent encoding information comprising a maximum target bit rate, a minimum target bit rate, a motion complexity, a texture complexity and a region of interest; and encoding an input source of an encoder according to the intelligent encoding information, wherein encoding the input source of the encoder according to the intelligent encoding information comprises obtaining an encoding coefficient according to the motion complexity, the texture complexity and the region of interest, the encoding coefficient being positively correlated with a size of the motion complexity, the texture complexity and the region of interest, and configuring a target bit rate of the encoder according to the encoding coefficient, the maximum target bit rate and the minimum target bit rate, wherein the target bit rate is: target_bitrate = (max_bitrate - min_bitrate) x ratio + min_bitrate, where target_bitrate is the target bit rate of the encoder, max_bitrate is the maximum target bit rate, min_bitrate is the minimum target bit rate, and ratio is the encoding coefficient and takes a value in a range of 0 to 1.

2. The intelligent coding method of claim 1, wherein, obtaining the encoding coefficient according to the motion complexity, the texture complexity and the region of interest comprises: obtaining the encoding coefficient from an encoding coefficient table according to the motion complexity, the texture complexity and the region of interest.

3. The intelligent coding method of claim 1, wherein, configuring an active guard region for the input source of the encoder according to the intelligent encoding information comprises: detecting a region of interest from the input source of the encoder; and configuring an encoding manner of the region of interest as a low quantization parameter encoding.

4. The intelligent coding method of claim 1, wherein, configuring a dynamic frame rate and a dynamic group of pictures for the input source of the encoder according to the intelligent encoding information comprises: configuring the dynamic frame rate and the dynamic group of pictures according to the motion complexity and the texture complexity, wherein the lower the motion complexity, the lower the dynamic frame rate and the longer the dynamic group of pictures, and wherein the lower the texture complexity, the lower the dynamic frame rate and the longer the dynamic group of pictures.

5. The intelligent coding method of claim 1, wherein, obtaining the intelligent encoding information comprises: obtaining the maximum target bit rate and the minimum target bit rate according to a bit rate configuration instruction input by a user.

6. An intelligent coding system characterized in that, comprising: an encoding information obtaining device configured to obtain intelligent encoding information, the intelligent encoding information comprising a maximum target bit rate, a minimum target bit rate, a motion complexity, a texture complexity and a region of interest; and an encoding device configured to encode an input source according to the intelligent encoding information, wherein the encoding device is configured to obtain an encoding coefficient according to the motion complexity, the texture complexity and the region of interest, the encoding coefficient being positively correlated with a size of the motion complexity, the texture complexity and the region of interest, and configure a target bit rate of an encoder according to the encoding coefficient, the maximum target bit rate and the minimum target bit rate, wherein the target bit rate is: target_bitrate = (max_bitrate - min_bitrate) x ratio + min_bitrate, where target_bitrate is the target bitrate of the encoder, max_bitrate is the maximum target bitrate, min_bitrate is the minimum target bitrate, ratio is the encoding coefficient and takes a value in the range of 0 to 1.

7. A computer-readable storage medium having stored thereon a computer program, characterized in that The computer program is executed to implement the intelligent encoding method according to any one of claims 1-5.

8. An electronic device, comprising: Comprise: a memory configured to store a computer program; and a processor configured to execute the computer program to perform the intelligent encoding method according to any one of claims 1-5.

Images