Video image enhancement method, device, equipment, chip and storage medium
By passing the viewing area parameters of the video image between the server and the terminal device, the video image is enhanced, and the problem of poor display effect of VR360-degree film source on low-configured terminal devices is solved, achieving more vivid brightness and colors Effect.
Patent Information
- Application Number
- CN201910895085.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-09-20
- Publication Date
- 2025-02-25
- Estimated Expiration
- 2039-09-20
AI Technical Summary
When playing VR 360-degree film sources, the configuration of the terminal device is low, resulting in the problem that the viewing angle area looks darker and the colors are not bright enough.
The server receives the request message from the terminal device, acquires the screen parameters of at least one viewing area in the video image, and sends these parameters to the terminal device. The terminal device enhances the video image based on these parameters, including adjusting brightness, saturation, contrast and sharpness.
It improves the display effect of video images, makes the brightness and colors of the viewing angle area more vivid, and improves the overall viewing experience.
Smart Images

Figure CN112541858B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of video image processing, and in particular to a method, device, equipment, chip and storage medium for enhancing a video image. Background Art
[0002] When a terminal device plays a 360-degree virtual reality (VR) source, if the configuration of the terminal device is low, in order to be able to play high-resolution sources, the terminal device can divide the source into several small blocks, and when the source is played, only some blocks in the viewing area are spliced and displayed. In addition, in order to avoid the problem that the data stream in the viewing area cannot be downloaded and displayed in time, the terminal device can overlay a background stream with lower resolution and lower bit rate on the background part. For example: the resolution of the background stream is 4K, and the resolution of the data stream in the viewing area is 8K (that is, high-definition stream), and the content of the background stream and the high-definition stream are exactly the same, and the two completely overlap after projection. Based on this, when the user's perspective switches to the above-mentioned viewing area, if the high-definition stream cannot be displayed in time, the user sees the content of the background stream. For example: Figure 1 The source provided by the prior art is divided into 72 blocks, as shown in FIG. Figure 1 As shown, viewing area 1 is the part that the user can actually see at the same time. When the terminal device plays the source, if the terminal device can download the high-definition stream in time, the viewing area 1 is played with the high-definition stream. If the terminal device cannot download the high-definition stream in time, the viewing area 1 is played with the low-definition stream (i.e., the background stream), while the other parts of the source are still played with the low-definition stream.
[0003] For video images such as VR360 film sources, their brightness, contrast, and color saturation values are for the entire video image during encoding. Therefore, if the terminal device uses the brightness, contrast, and color saturation values of the entire 360-degree picture when playing the content in the viewing area, this will cause the viewing area to appear darker, the colors to be not bright enough, and other poor display effects. Summary of the invention
[0004] The present application provides a video image enhancement method, device, equipment, chip and storage medium. The method can improve the video image display effect.
[0005] In a first aspect, the present application provides a method for enhancing a video image, comprising: a server receiving a request message sent by a terminal device, the request message including an identifier of a video image. The server obtains picture parameters of at least one viewing area in the video image according to the identifier of the video image. The server sends the picture parameters of at least one viewing area to the terminal device. The picture parameters of at least one viewing area include: enhancement parameters corresponding to at least one viewing area, respectively, and the enhancement parameters corresponding to any one viewing area in at least one viewing area are used by the terminal device to perform enhancement processing on the viewing area.
[0006] That is, the method can improve the video image display effect. Furthermore, the technical solution provided by the present application can refine the video image enhancement into each viewing area or the main viewing area, and each viewing area has a corresponding enhancement parameter, instead of enhancing the video image for the entire video image, thereby further improving the video image display effect.
[0007] Optionally, before the server receives the request message sent by the terminal device, the process further includes: the server determines a picture parameter of at least one viewing angle area.
[0008] Optionally, the server determines the picture parameters of at least one viewing angle area, including: if the average value of the brightness component of each pixel in the video image is less than the brightness threshold, and the number of first pixels is greater than a first preset number, then determine the brightness enhancement parameter corresponding to at least one viewing angle area, the first pixel is a pixel whose brightness component is less than the average value of the brightness component among all pixels. And / or, if the average value of the saturation component of each pixel in the video image is less than the saturation threshold, and the number of second pixels is greater than a second preset number, then determine the saturation enhancement parameter corresponding to at least one viewing angle area, the second pixel is a pixel whose saturation component is less than the average value of the saturation component among all pixels. And / or, if the average value of the contrast component of each pixel in the video image is less than the contrast threshold, and the number of third pixels is greater than the second preset number, then determine the contrast enhancement parameter corresponding to at least one viewing angle area, the third pixel is a pixel whose contrast component is less than the average value of the contrast component among all pixels. And / or, if the average value of the sharpness component of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to at least one viewing angle area are determined, and the fourth pixel is the pixel whose sharpness component among each pixel is less than the average value of the sharpness component.
[0009] That is, when each pixel in the video image meets the above conditions, the server determines the picture parameters of at least one viewing area. When each pixel in the video image does not meet the above conditions, the server does not determine the picture parameters of at least one viewing area. Accordingly, the terminal device does not perform video image enhancement processing, which can improve the flexibility of video image enhancement processing on the one hand and reduce the power consumption of the server and the terminal device on the other hand. Optionally, the above multiple viewing areas cover the video image.
[0010] Optionally, the encoder can encode and generate a video image, and the video image can be injected into the business / media management server, and the business / media management server generates a unique identifier for the video image. The encoder can also inject the video image into a streaming media server, that is, the streaming media server is used to store the video image. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the business / media management server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to the above-mentioned at least one viewing angle area. And the terminal device can obtain the video image from the streaming media server.
[0011] Alternatively, the above-mentioned business / media management server, streaming media server and image enhancement server are one server. Assume that the server is also called an image enhancement server. In this case, the encoder can encode and generate a video image, and the video image can be injected into the image enhancement server, and the image enhancement server generates a unique identifier for the video image. The encoder can also inject the video image into the image enhancement server, that is, the image enhancement server is used to store the video image. Among them, the terminal device can obtain the identifier of the video image from the image enhancement server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters and video image corresponding to the above-mentioned at least one viewing area.
[0012] Alternatively, the above-mentioned business / media management server and streaming media server are one server. Assuming that the server is called a media server, the encoder can encode and generate a video image, and the video image can be injected into the media server, and the media server generates a unique identifier for the video image. The encoder can also inject the video image into the media server, that is, the media server is used to store video images. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the media server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to the above-mentioned at least one viewing area. And the terminal device can obtain the video image from the media server.
[0013] Optionally, the picture parameters of the at least one viewing area further include: a timestamp and a spatial range respectively corresponding to the at least one viewing area.
[0014] The following will provide a video image enhancement method performed on the terminal device side, as well as a video image enhancement device, equipment, chip, storage medium and computer program product. The effects thereof can refer to the corresponding effects of the above-mentioned video image enhancement method, which will not be repeated below.
[0015] In a second aspect, the present application provides a method for enhancing a video image, comprising: a terminal device sends a request message to a server, the request message includes an identifier of a video image, and the identifier of the video image is used by the server to obtain picture parameters of at least one viewing area in the video image. The terminal device receives the picture parameters of at least one viewing area sent by the server. The terminal device performs enhancement processing on the video image according to the picture parameters of at least one viewing area. Among them, the picture parameters of at least one viewing area include: enhancement parameters corresponding to at least one viewing area respectively, and the enhancement parameters corresponding to any one viewing area of at least one viewing area are used by the terminal device to perform enhancement processing on the viewing area.
[0016] Optionally, the picture parameters of at least one viewing area also include: a timestamp and a spatial range respectively corresponding to at least one viewing area. Accordingly, the terminal device performs enhancement processing on the video image according to the picture parameters of at least one viewing area, including: the terminal device determines the enhancement parameters corresponding to the target viewing area according to the timestamp and the spatial range of the target viewing area, and the timestamp and the spatial range respectively corresponding to at least one viewing area. According to the enhancement parameters corresponding to the target viewing area, the target viewing area is enhanced. The target viewing area is part or all of the at least one viewing area.
[0017] Optionally, the enhancement parameter corresponding to any viewing angle area includes at least one of the following: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the viewing angle area.
[0018] In a third aspect, the present application provides a video image enhancement device, comprising:
[0019] The receiving module is used to receive a request message sent by a terminal device, where the request message includes an identifier of a video image.
[0020] The acquisition module is used to acquire the picture parameters of at least one viewing angle area in the video image according to the identification of the video image.
[0021] The sending module is used to send the picture parameters of at least one viewing area to the terminal device.
[0022] The picture parameters of at least one viewing area include: enhancement parameters corresponding to at least one viewing area respectively, and the enhancement parameters corresponding to any one viewing area of the at least one viewing area are used by the terminal device to perform enhancement processing on the viewing area.
[0023] In a fourth aspect, the present application provides a video image enhancement device, comprising:
[0024] The sending module is used to send a request message to the server, where the request message includes an identifier of the video image, and the identifier of the video image is used by the server to obtain picture parameters of at least one viewing angle area in the video image.
[0025] The receiving module is used to receive the picture parameters of at least one viewing area sent by the server.
[0026] The processing module is used to enhance the video image according to the picture parameters of at least one viewing angle area.
[0027] The picture parameters of at least one viewing area include: enhancement parameters corresponding to at least one viewing area respectively, and the enhancement parameters corresponding to any one viewing area of the at least one viewing area are used by the terminal device to perform enhancement processing on the viewing area.
[0028] In a fifth aspect, the present application provides a server, comprising: a memory and a processor. The memory is used to store computer instructions so that the processor executes the computer instructions to implement the video image enhancement method as in the first aspect or in an optional manner of the first aspect.
[0029] In a sixth aspect, the present application provides a terminal device, comprising: a memory and a processor. The memory is used to store computer instructions so that the processor executes the computer instructions to implement the video image enhancement method as in the second aspect or in an optional manner of the second aspect.
[0030] In a seventh aspect, the present application provides a chip, which is used to implement the video image enhancement method as in the first aspect or in an optional manner of the first aspect.
[0031] In an eighth aspect, the present application provides a chip, and the chip is used to implement the video image enhancement method as in the second aspect or the optional method of the second aspect.
[0032] In a tenth aspect, the present application provides a computer storage medium, comprising: computer executable instructions, wherein the computer executable instructions are used to implement a method for enhancing a video image as in the first aspect or in an optional manner of the first aspect.
[0033] In an eleventh aspect, the present application provides a computer storage medium, comprising: computer executable instructions, wherein the computer executable instructions are used to implement the method for enhancing a video image as in the second aspect or in an optional manner of the second aspect.
[0034] In a twelfth aspect, the present application provides a computer program product, comprising: computer executable instructions, wherein the computer executable instructions are used to implement a method for enhancing a video image as in the first aspect or in an optional manner of the first aspect.
[0035] In a thirteenth aspect, the present application provides a computer program product, comprising: computer executable instructions, wherein the computer executable instructions are used to implement a method for enhancing a video image as in the second aspect or in an optional manner of the second aspect.
[0036] The present application provides a method, device, equipment, chip and storage medium for enhancing a video image. The method includes: a server receives a request message sent by a terminal device, and the request message includes an identifier of a video image. The server obtains picture parameters of at least one viewing area in the video image according to the identifier of the video image. The server sends the picture parameters of at least one viewing area to the terminal device. Among them, the picture parameters of at least one viewing area include: enhancement parameters corresponding to at least one viewing area respectively, and the enhancement parameters corresponding to any one viewing area in at least one viewing area are used by the terminal device to enhance the viewing area. The method can improve the display effect of video images. BRIEF DESCRIPTION OF THE DRAWINGS
[0037] Figure 1 A schematic diagram showing that the film source provided by the prior art is divided into 72 blocks;
[0038] Figure 2 An application scenario diagram of the technical solution of the present application provided for an embodiment of the present application;
[0039] Figure 3 An interactive flow chart of a method for enhancing a video image provided by an embodiment of the present application;
[0040] Figure 4 A schematic diagram of a video image provided by an embodiment of the present application;
[0041] FIG. 5A to FIG. 5C A schematic diagram of a video image provided by another embodiment of the present application;
[0042] Figure 6 A schematic diagram of brightness enhancement provided by an embodiment of the present application;
[0043] Figure 7 A flowchart of a method for enhancing a video image provided by another embodiment of the present application;
[0044] Figure 8 An interactive flow chart of a method for enhancing a video image provided by yet another embodiment of the present application;
[0045] Fig. 9A flowchart of a method for enhancing a video image provided by another embodiment of the present application;
[0046] Fig.10 A schematic diagram of a video image enhancement device provided in one embodiment of the present application;
[0047] Fig.11 A schematic diagram of a video image enhancement device provided by another embodiment of the present application;
[0048] Fig.12 A schematic diagram of a server provided in one embodiment of the present application;
[0049] Fig.13 A schematic diagram of a terminal device provided in one embodiment of the present application. DETAILED DESCRIPTION
[0050] As mentioned above, for video images such as VR360 film sources, their brightness, contrast, and color saturation values are for the entire 360-degree picture when encoded. Therefore, if the terminal device uses the brightness, contrast, and color saturation values of the entire 360-degree picture when playing the content in the viewing area, this will cause the viewing area to look darker, the color is not bright enough, and other poor display effects. In order to solve this technical problem, the present application provides a method, device, equipment, chip, and storage medium for enhancing video images.
[0051] For example, Figure 2 The application scenario diagram of the technical solution of the present application provided in one embodiment of the present application is as follows: Figure 2 As shown, the network elements involved in the technical solution of the present application include: an encoder 21, a service / media management server 22, a terminal device 23, a streaming media server 24 and an image enhancement server 25. The encoder 21 is connected to the service / media management server 22, the streaming media server 24 and the image enhancement server 25 respectively, and the service / media management server 22, the streaming media server 24 and the image enhancement server 25 are connected to the terminal device 23 respectively. The encoder 21 is used to encode and generate a video image, and send the video image to the service / media management server 22, the streaming media server 24 and the image enhancement server 25 respectively. The service / media management server 22 generates an identifier of the video image. The service / media management server 22 sends the identifier of the video image to the terminal device 23. The image enhancement server 25 determines the picture parameter corresponding to at least one viewing angle area in the video image, and the terminal device 23 can obtain the picture parameter from the image enhancement server 25 and obtain the video image from the streaming media server 24, so as to enhance the video image through the picture parameter.
[0052] Among them, the terminal device involved in this application may refer to a device with a video or video image playback function, which may be a handheld device with a wireless connection function, or other processing equipment connected to a wireless modem. The terminal device can communicate with at least one core network via a radio access network (Radio Access Network, RAN). The terminal device may be a mobile terminal, such as a mobile phone (or "cellular" phone) and a computer, for example, a portable, pocket-sized, handheld, computer-built-in or vehicle-mounted mobile device, which exchanges data with a wireless access network. The terminal device may also be referred to as a subscriber unit (Subscriber Unit), a subscriber station (Subscriber Station), a mobile station (Mobile Station), a mobile station (Mobile Station), a remote station (Remote Station), an access point (Access Point), a remote terminal (Remote Terminal), an access terminal (Access Terminal), a user terminal (User Terminal), a user agent (User Agent) or a user equipment (User Equipment), which is not limited here. In summary, as long as the terminal device has a device with a video or video image playback function and can communicate with a server, this application does not limit the form of the terminal device.
[0053] Exemplarily, the at least one viewing angle area mentioned above may be a plurality of viewing angle areas or a main viewing angle area in a video image. The video image enhancement method is described in detail below for these two situations respectively:
[0054] Figure 3 An interactive flow chart of a method for enhancing video images provided in one embodiment of the present application, the network elements involved in the method include: part or all of a server, and part or all of a terminal device. Part of the server may be a processor in the server or a chip with processing functions, etc., and part of the terminal device may be a processor in the terminal device or a chip with processing functions, etc. In order to distinguish the server from other servers in the present application, the server may be referred to as an image enhancement server in the present application. The video image enhancement method is described below with the image enhancement server and the terminal device as the execution subjects. Figure 3 As shown, the method comprises the following steps:
[0055] Optional step S301: The image enhancement server determines picture parameters corresponding to multiple viewing angle areas in a video image.
[0056] Step S302: the terminal device sends a request message to the image enhancement server, where the request message includes: the identifier of the above video image.
[0057] Step S303: the image enhancement server sends picture parameters corresponding to the above-mentioned multiple viewing angle areas to the terminal device according to the identification of the video image.
[0058] Step S304: the terminal device performs enhancement processing on the video image according to the picture parameters corresponding to the above-mentioned multiple viewing angle areas.
[0059] Step S301 is described as follows:
[0060] The video image is divided into a plurality of viewing areas, for example, Figure 4 A schematic diagram of a video image provided in an embodiment of the present application, the video image may be a VR360 source, but is not limited to, such as Figure 4 As shown in FIG. 1 , the video image is divided into five viewing areas, namely, viewing area 1, viewing area 2, viewing area 3, viewing area 4 and viewing area 5. Each viewing area is a rectangular area. The intersection of these five viewing areas is more than 120 degrees, and these five viewing areas cover the video image. It should be noted that the video image is actually a ring source, that is, Figure 4 The first column of content is adjacent to the last column of content. The first column of content includes: data block 1, data block 13, data block 25, data block 37, data block 49, data block 61. The last column of content includes: data block 12, data block 24, data block 36, data block 48, data block 60, data block 72.
[0061] The image enhancement server can generate picture parameters corresponding to multiple viewing areas. For any of the multiple viewing areas, the picture parameters corresponding to the multiple viewing areas include: enhancement parameters corresponding to the viewing area, which are used by the terminal device to enhance the viewing area. Optionally, the enhancement parameters of the viewing area include at least one of the following: brightness enhancement parameters, saturation enhancement parameters, contrast enhancement parameters, and sharpness enhancement parameters of the viewing area.
[0062] Optionally, the picture parameters corresponding to the multiple viewing areas further include: a timestamp and a spatial range of any viewing area.
[0063] Among them, the image enhancement server can obtain the enhancement algorithm models corresponding to the brightness enhancement parameter, saturation enhancement parameter, contrast enhancement parameter, and sharpness enhancement parameter through training. For example, the enhancement algorithm model corresponding to the brightness enhancement parameter is as follows:
[0064] Y(new)=A*Y(original)+B(when Y(original)<200)
[0065] Y(new)=C*Y(original)+D(when Y(original)>=200)
[0066] Among them, for any pixel in any viewing angle area, Y(original) represents the brightness component before the pixel is enhanced, Y(new) represents the brightness component after the pixel is enhanced, and A, B, C and D are brightness enhancement parameters.
[0067] Furthermore, the image enhancement server may determine the enhancement parameters corresponding to each of the multiple viewing angles. It should be noted that this application does not limit how the image enhancement server trains the enhancement algorithm model and how to determine the enhancement parameters corresponding to each viewing angle.
[0068] Since there are multiple viewing angles in a video image, in order to enable the terminal device to determine the enhanced parameters of each viewing angle when playing the video image, as mentioned above, the parameters of each viewing angle also include the timestamp and spatial range of the viewing angle. The timestamp is the playback time of the viewing angle. The timestamp is generally in milliseconds (ms). When the video is played, it is actually displayed smoothly in a series of continuous frames at fixed time intervals. For example, a video with a frame rate of 25 frames means that 25 frames are played per second, and the interval between each frame is 40 milliseconds (1 second / 25 frames). The definition of the timestamp, for example, starts from 0, then the timestamp of the first frame is 0, the timestamp of the second frame is 40, and the timestamp of the third frame is 80, etc. The spatial range is defined according to longitude and latitude.
[0069] For example, the parameters of a certain viewing area are: 133|(0,90)-(72,-90)|1,1.15,5.5,1.05,3.5. Among them, 133 means that the timestamp of the viewing area is 133ms, the spatial range is (0,90)-(72,-90), and 1 means the over-dark enhancement scene, that is, 1 is the scene identifier, which is an optional parameter. 1.15,5.5,1.05,3.5 respectively represent A=1.15, B=5.5, C=1.05D=3.5.
[0070] It should be noted that the image enhancement server can also set conditions for determining whether to determine the picture parameters corresponding to multiple viewing areas: for example, if the average value of the brightness component of each pixel in the video image is less than the brightness threshold, such as 255*0.3, and the number of the first pixel is greater than the first preset number, then the brightness enhancement parameters corresponding to the above multiple viewing areas are determined, and the first pixel is the pixel whose brightness component is less than the average value of the brightness component in each pixel. And / or, if the average value of the saturation component of each pixel in the video image is less than the saturation threshold, and the number of the second pixel is greater than the second preset number, then the saturation enhancement parameters corresponding to the above multiple viewing areas are determined, and the second pixel is the pixel whose saturation component is less than the average value of the saturation component in each pixel. And / or, if the average value of the contrast component of each pixel in the video image is less than the contrast threshold, and the number of the third pixel is greater than the second preset number, then the contrast enhancement parameters corresponding to the above multiple viewing areas are determined, and the third pixel is the pixel whose contrast component is less than the average value of the contrast component in each pixel. And / or, if the average value of the sharpness component of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to the above-mentioned multiple viewing areas are determined, and the fourth pixel is the pixel whose sharpness component among each pixel is less than the average value of the sharpness component.
[0071] Step S302 is described below:
[0072] Exemplarily, the encoder can encode and generate a video image, which can be injected into a business / media management server, and the business / media management server generates a unique identifier for the video image, such as: A894093847378394, which is used to identify the video image. The encoder can also inject the video image into a streaming media server, that is, the streaming media server is used to store video images. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the business / media management server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to multiple viewing angles. And the terminal device can obtain the video image from the streaming media server.
[0073] or,
[0074] Exemplarily, the above-mentioned business / media management server, streaming media server and image enhancement server are one server. Assume that the server is also called an image enhancement server. In this case, the encoder can encode and generate a video image, and the video image can be injected into the image enhancement server. The image enhancement server generates a unique identifier for the video image, such as: A894093847378394, which is used to identify the video image. The encoder can also inject the video image into the image enhancement server, that is, the image enhancement server is used to store video images. Among them, the terminal device can obtain the identifier of the video image from the image enhancement server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters and video images corresponding to multiple viewing areas.
[0075] or,
[0076] Exemplarily, the above-mentioned business / media management server and streaming media server are one server. Assuming that the server is called a media server, the encoder can encode and generate a video image, and the video image can be injected into the media server. The media server generates a unique identifier for the video image, such as: A894093847378394, which is used to identify the video image. The encoder can also inject the video image into the media server, that is, the media server is used to store video images. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the media server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to multiple viewing areas. And the terminal device can obtain the video image from the media server.
[0077] The following is explained in combination with step S303 and step S304:
[0078] As described above, the video image includes multiple viewing areas. Therefore, when the image enhancement server obtains the identifier of the video image, it can obtain the picture parameters corresponding to the above multiple viewing areas. The picture parameters corresponding to the multiple viewing areas are sent to the terminal device. The terminal device determines the enhancement parameters corresponding to the target viewing area according to the timestamp and spatial range of the target viewing area, and the timestamps and spatial ranges corresponding to the above multiple viewing areas respectively; and enhances the target viewing area according to the enhancement parameters corresponding to the target viewing area; wherein the target viewing area is part or all of the above multiple viewing areas. For example: FIG. 5A to FIG. 5C A schematic diagram of a video image provided by another embodiment of the present application is shown in FIG. Figure 5AAs shown, since the target viewing area 51 belongs to the viewing area 1, the enhancement parameter corresponding to the target viewing area 51 is the enhancement parameter corresponding to the viewing area 1. Figure 5B As shown, since the target viewing area 52 belongs to viewing area 1 and viewing area 2, the enhancement parameter corresponding to the target viewing area 51 is the enhancement parameter corresponding to viewing area 1 or viewing area 2. Figure 5C As shown, since the target viewing area 53 belongs to the viewing area 3, the enhancement parameters corresponding to the target viewing area 53 are the enhancement parameters corresponding to the viewing area 3.
[0079] Assume that the brightness enhancement parameters obtained by the terminal device are A=1.15, B=5.5, C=1.05D=3.5. Then the terminal device can perform the following enhancement processing on each pixel:
[0080] Y(new)=1.15*Y(original)+5.5(when Y(original)<200)
[0081] Y(new)=1.05*Y(original)+3.5(when 200<=Y(original)<230)
[0082] Among them, for any pixel in any viewing angle area, Y(original) represents the brightness component before the pixel is enhanced, Y(new) represents the brightness component after the pixel is enhanced, and A, B, C and D are brightness enhancement parameters. Figure 6 A schematic diagram of brightness enhancement provided in an embodiment of the present application is shown in FIG. Figure 6 As shown, the horizontal axis represents the brightness component of each pixel before the enhancement process, and the vertical axis represents the brightness component of each pixel after the enhancement process.
[0083] Optionally, after performing enhancement processing on the video image, the terminal device may also render the video image.
[0084] In summary, the present application provides a method for video image enhancement, comprising: a terminal device sends a request message to an image enhancement server, the request message including: an identifier of the above-mentioned video image. The image enhancement server sends the picture parameters corresponding to the above-mentioned multiple viewing angles to the terminal device according to the identifier of the video image. The terminal device performs enhancement processing on the video image according to the picture parameters corresponding to the above-mentioned multiple viewing angles. That is, the method can improve the video image display effect. Furthermore, the technical solution provided by the present application can refine the video image enhancement into each viewing angle area, and each viewing angle area has a corresponding enhancement parameter, instead of performing video image enhancement on the entire video image, thereby further improving the video image display effect.
[0085] As described above, the encoder can encode and generate a video image, which can be injected into a business / media management server. The business / media management server generates a unique identifier for the video image, and the unique identifier is used to identify the video image. The encoder can also inject the video image into a streaming media server, that is, the streaming media server is used to store video images. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the business / media management server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to multiple viewing areas. And the terminal device can obtain the video image from the streaming media server. The following is a detailed description of this solution:
[0086] Figure 7 A flowchart of a method for enhancing a video image provided by another embodiment of the present application is shown in FIG. Figure 7 As shown, the method comprises the following steps:
[0087] Step S701: The encoder encodes to generate a video image.
[0088] Step S702: The encoder sends the video image to the service / media management server.
[0089] Step S703: The service / media management server generates an identifier for the video image.
[0090] Step S704: the service / media management server sends the identifier of the video image to the terminal device.
[0091] Step S705: The encoder sends the video image to the streaming media server.
[0092] Step S706: The encoder sends the video image to the image enhancement server.
[0093] Step S707: The image enhancement server determines the picture parameters corresponding to the above-mentioned multiple viewing angle areas.
[0094] Step S708: The terminal device sends a request message to the image enhancement server, where the request message includes: an identifier of the video image.
[0095] Step S709: the image enhancement server sends a response message to the terminal device, where the response message includes: a first storage address corresponding to the video image and a second storage address corresponding to the parameters corresponding to each viewing angle area.
[0096] The second storage address includes: the identifier of the video image, for example: the second storage address is: http: / / 10.135.13.12 / A894093847378394_enhance.dat, and A894093847378394 is the identifier of the video image.
[0097] Step S710: The terminal device obtains the video image from the streaming media server according to the first storage address.
[0098] Step S711: the terminal device obtains picture parameters corresponding to the above-mentioned multiple viewing angle areas from the image enhancement server according to the second storage address.
[0099] Step S712: The terminal device performs enhancement processing on the video image according to the picture parameters corresponding to the above-mentioned multiple viewing angle areas.
[0100] It should be noted that this embodiment is mainly used in situations where there are business / media management servers, streaming media servers, and image enhancement servers, which are respectively used to determine the identification of video images, store video images, and obtain parameters corresponding to each viewing area of the video images. The details of this embodiment can be referred to the previous embodiment and will not be repeated here.
[0101] Figure 8 An interactive flow chart of a method for enhancing video images provided as another embodiment of the present application, the network elements involved in the method include: part or all of a server, and part or all of a terminal device. Part of the server may be a processor in the server or a chip with processing functions, etc., and part of the terminal device may be a processor in the terminal device or a chip with processing functions, etc. In order to distinguish the server from other servers in the present application, the server may be referred to as an image enhancement server in the present application. The video image enhancement method is described below with the image enhancement server and the terminal device as the execution subjects. Figure 8 As shown, the method comprises the following steps:
[0102] Optional step S801: The image enhancement server determines picture parameters corresponding to the main viewing area in the video image.
[0103] Step S802: The terminal device sends a request message to the image enhancement server, where the request message includes: the identifier of the above video image.
[0104] Step S803: the image enhancement server sends picture parameters corresponding to the main viewing area to the terminal device according to the identification of the video image.
[0105] Step S804: The terminal device performs enhancement processing on the video image according to the picture parameters corresponding to the main viewing area.
[0106] Step S801 is described as follows:
[0107] Among them, for the above video image, the main viewing area is the part that the user can actually see at the same time.
[0108] The image enhancement server can generate picture parameters corresponding to the main viewing area, and the picture parameters corresponding to the main viewing area include: enhancement parameters of the main viewing area, and the enhancement parameters of the main viewing area are used by the terminal device to enhance the main viewing area. The enhancement parameters of the main viewing area include at least one of the following: brightness enhancement parameters, saturation enhancement parameters, contrast enhancement parameters, and sharpness enhancement parameters of the main viewing area.
[0109] Optionally, the picture parameters corresponding to the main viewing area also include: the timestamp and spatial range of the main viewing area, wherein the image enhancement server can obtain the enhancement algorithm models corresponding to the brightness enhancement parameter, the saturation enhancement parameter, the contrast enhancement parameter, and the sharpness enhancement parameter through training, for example: the enhancement algorithm model corresponding to the brightness enhancement parameter is as follows:
[0110] Y(new)=A*Y(original)+B(when Y(original)<200)
[0111] Y(new)=C*Y(original)+D(when Y(original)>=200)
[0112] Among them, for any pixel in the main viewing area, Y(original) represents the brightness component before the pixel is enhanced, Y(new) represents the brightness component after the pixel is enhanced, and A, B, C and D are brightness enhancement parameters.
[0113] Furthermore, the image enhancement server may determine the enhancement parameters corresponding to the main viewing area. It should be noted that the present application does not limit how the image enhancement server trains the enhancement algorithm model and how the enhancement parameters corresponding to the main viewing area are determined.
[0114] Since a video image has multiple viewing areas, in order to enable the terminal device to determine the enhancement parameters of the main viewing area when playing the video image, as mentioned above, the parameters of the main viewing area also include the timestamp and spatial range of the main viewing area.
[0115] It should be noted that the image enhancement server can also set conditions for determining whether to determine the picture parameters corresponding to the main viewing area: for example: if the average value of the brightness component of each pixel in the video image is less than the brightness threshold, such as 255*0.3, and the number of the first pixel is greater than the first preset number, then the brightness enhancement parameter corresponding to the main viewing area in the video image is determined, and the first pixel is a pixel whose brightness component is less than the average value of the brightness component among all pixels. And / or, if the average value of the saturation component of each pixel in the video image is less than the saturation threshold, and the number of the second pixel is greater than the second preset number, then the saturation enhancement parameter corresponding to the main viewing area in the video image is determined, and the second pixel is a pixel whose saturation component is less than the average value of the saturation component among all pixels. And / or, if the average value of the contrast component of each pixel in the video image is less than the contrast threshold, and the number of the third pixel is greater than the second preset number, then the contrast enhancement parameter corresponding to the main viewing area in the video image is determined, and the third pixel is a pixel whose contrast component is less than the average value of the contrast component among all pixels. And / or, if the average value of the sharpness component of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to the main viewing area in the video image or the sharpness enhancement parameters corresponding to multiple viewing areas are determined, and the fourth pixel is the pixel whose sharpness component is less than the average value of the sharpness component among all pixels.
[0116] Step S802 is described below:
[0117] Exemplarily, the encoder can encode and generate a video image, which can be injected into a business / media management server, and the business / media management server generates a unique identifier for the video image, such as: A894093847378394, which is used to identify the video image. The encoder can also inject the video image into a streaming media server, that is, the streaming media server is used to store video images. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the business / media management server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to the main viewing area. And the terminal device can obtain the video image from the streaming media server.
[0118] or,
[0119] Exemplarily, the above-mentioned business / media management server, streaming media server and image enhancement server are one server. Assume that the server is also called an image enhancement server. In this case, the encoder can encode and generate a video image, and the video image can be injected into the image enhancement server. The image enhancement server generates a unique identifier for the video image, such as: A894093847378394, which is used to identify the video image. The encoder can also inject the video image into the image enhancement server, that is, the image enhancement server is used to store video images. Among them, the terminal device can obtain the identifier of the video image from the image enhancement server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters and video image corresponding to the main viewing area.
[0120] or,
[0121] Exemplarily, the above-mentioned business / media management server and streaming media server are one server. Assuming that the server is called a media server, the encoder can encode and generate a video image, and the video image can be injected into the media server. The media server generates a unique identifier for the video image, such as: A894093847378394, which is used to identify the video image. The encoder can also inject the video image into the media server, that is, the media server is used to store video images. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the media server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to the main viewing area. And the terminal device can obtain the video image from the media server.
[0122] The following is explained in combination with step S803 and step S804:
[0123] As described above, the video image includes a main viewing area, so when the image enhancement server obtains the identifier of the video image, it can obtain the picture parameters corresponding to the main viewing area. The picture parameters corresponding to the main viewing area are sent to the terminal device, and the terminal device determines the enhancement parameters corresponding to the target viewing area according to the timestamp and spatial range of the target viewing area, and the timestamp and spatial range corresponding to the main viewing area; and enhances the target viewing area according to the enhancement parameters corresponding to the target viewing area; wherein the target viewing area is part or all of the main viewing area.
[0124] Assume that the brightness enhancement parameters obtained by the terminal device are A=1.15, B=5.5, C=1.05D=3.5. Then the terminal device can perform the following enhancement processing on each pixel:
[0125] Y(new)=1.15*Y(original)+5.5(when Y(original)<200)
[0126] Y(new)=1.05*Y(original)+3.5(when 200<=Y(original)<230)
[0127] For any pixel in the main viewing area, Y(original) represents the brightness component before the pixel is enhanced, Y(new) represents the brightness component after the pixel is enhanced, and A, B, C and D are brightness enhancement parameters. Optionally, after the terminal device enhances the video image, it can also render the video image.
[0128] In summary, the present application provides a video image enhancement method, comprising: a terminal device sends a request message to an image enhancement server, the request message including: an identifier of the above-mentioned video image. The image enhancement server sends the picture parameters corresponding to the above-mentioned main viewing area to the terminal device according to the identifier of the video image. The terminal device performs enhancement processing on the video image according to the picture parameters corresponding to the above-mentioned main viewing area. That is, the video image display effect can be improved by this method. Furthermore, the technical solution provided by the present application can refine the video image enhancement to the main viewing area, and the main viewing area has corresponding picture parameters, instead of performing video image enhancement on the entire video image, thereby further improving the video image display effect.
[0129] As described above, the encoder can encode and generate a video image, and the video image can be injected into the business / media management server, and the business / media management server generates a unique identifier for the video image, and the unique identifier is used to identify the video image. The encoder can also inject the video image into a streaming media server, that is, the streaming media server is used to store the video image. Among them, the terminal device and the image enhancement server can obtain the identifier of the video image from the business / media management server. When the terminal device needs to play the video image, the terminal device sends a request message carrying the identifier of the video image to the image enhancement server to request to obtain the picture parameters corresponding to the main viewing area. And the terminal device can obtain the video image from the streaming media server. The following is a detailed description of this solution:
[0130] Fig. 9 A flowchart of a method for enhancing a video image provided by another embodiment of the present application is shown in FIG. Fig. 9 As shown, the method comprises the following steps:
[0131] Step S901: The encoder encodes to generate a video image.
[0132] Step S902: The encoder sends the video image to the service / media management server.
[0133] Step S903: The service / media management server generates an identifier for the video image.
[0134] Step S904: the service / media management server sends the identifier of the video image to the terminal device.
[0135] Step S905: The encoder sends the video image to the streaming media server.
[0136] Step S906: The encoder sends the video image to the image enhancement server.
[0137] Step S907: The image enhancement server determines the picture parameters corresponding to the main viewing area in the video image.
[0138] Step S908: The terminal device sends a request message to the image enhancement server, where the request message includes: an identifier of the video image.
[0139] Step S909: the image enhancement server sends a response message to the terminal device, where the response message includes: a first storage address corresponding to the video image and a second storage address corresponding to the parameter corresponding to the main viewing area.
[0140] The second storage address includes: the identifier of the video image, for example: the second storage address is: http: / / 10.135.13.12 / A894093847378394_enhance.dat, and A894093847378394 is the identifier of the video image.
[0141] Step S910: the terminal device obtains the video image from the streaming media server according to the first storage address.
[0142] Step S911: the terminal device obtains picture parameters corresponding to the main viewing area from the image enhancement server according to the second storage address.
[0143] Step S912: The terminal device performs enhancement processing on the video image according to the picture parameters corresponding to the above main viewing angle areas.
[0144] It should be noted that this embodiment is mainly used in situations where there are business / media management servers, streaming media servers, and image enhancement servers, which are respectively used to determine the identification of video images, store video images, and obtain parameters corresponding to each viewing area of the video images. The details of this embodiment can be referred to the previous embodiment and will not be repeated here.
[0145] Fig.10A schematic diagram of a video image enhancement device provided in an embodiment of the present application, wherein the video image enhancement device may be part or all of a server, such as Fig.10 As shown, the device comprises:
[0146] The receiving module 1001 is used to receive a request message sent by a terminal device, where the request message includes an identifier of a video image.
[0147] The acquisition module 1002 is used to acquire picture parameters of at least one viewing angle area in the video image according to the identifier of the video image.
[0148] The sending module 1003 is used to send the picture parameters of at least one viewing area to the terminal device.
[0149] The picture parameters of at least one viewing area include: enhancement parameters corresponding to at least one viewing area respectively, and the enhancement parameters corresponding to any one viewing area of the at least one viewing area are used by the terminal device to perform enhancement processing on the viewing area.
[0150] Optionally, the apparatus further includes: a determination module 1004, configured to determine a picture parameter of at least one viewing angle area before the receiving module receives a request message sent by the terminal device.
[0151] Optionally, the determination module 1004 is specifically used to: if the mean value of the brightness component of each pixel in the video image is less than the brightness threshold, and the number of the first pixel is greater than the first preset number, then determine the brightness enhancement parameter corresponding to at least one viewing angle area, the first pixel is a pixel whose brightness component is less than the mean value of the brightness component among all pixels. And / or, if the mean value of the saturation component of each pixel in the video image is less than the saturation threshold, and the number of the second pixel is greater than the second preset number, then determine the saturation enhancement parameter corresponding to at least one viewing angle area, the second pixel is a pixel whose saturation component is less than the mean value of the saturation component among all pixels. And / or, if the mean value of the contrast component of each pixel in the video image is less than the contrast threshold, and the number of the third pixel is greater than the second preset number, then determine the contrast enhancement parameter corresponding to at least one viewing angle area, the third pixel is a pixel whose contrast component is less than the mean value of the contrast component among all pixels. And / or, if the average value of the sharpness component of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to at least one viewing angle area are determined, and the fourth pixel is the pixel whose sharpness component among each pixel is less than the average value of the sharpness component.
[0152] Optionally, the picture parameters of at least one viewing area further include: a timestamp and a spatial range respectively corresponding to at least one viewing area.
[0153] The video image enhancement device provided in the present application can be used to execute the video image enhancement method executed by the above-mentioned image enhancement server. Its content and effects can be referred to the method embodiment part, which will not be repeated here.
[0154] Fig.11 A schematic diagram of a video image enhancement device provided in another embodiment of the present application, wherein the video image enhancement device may be part or all of a server, such as Fig.11 As shown, the device comprises:
[0155] The sending module 1101 is used to send a request message to the server, where the request message includes an identifier of a video image, and the identifier of the video image is used by the server to obtain picture parameters of at least one viewing angle area in the video image.
[0156] The receiving module 1102 is used to receive picture parameters of at least one viewing area sent by the server.
[0157] The processing module 1103 is used to enhance the video image according to the picture parameters of at least one viewing angle area.
[0158] The picture parameters of at least one viewing area include: enhancement parameters corresponding to at least one viewing area respectively, and the enhancement parameters corresponding to any one viewing area of the at least one viewing area are used by the terminal device to perform enhancement processing on the viewing area.
[0159] Optionally, the picture parameters of at least one viewing area also include: a timestamp and a spatial range respectively corresponding to at least one viewing area. Accordingly, the processing module 1103 is specifically used to: determine the enhancement parameters corresponding to the target viewing area according to the timestamp and the spatial range of the target viewing area, and the timestamp and the spatial range respectively corresponding to at least one viewing area. According to the enhancement parameters corresponding to the target viewing area, the target viewing area is enhanced. The target viewing area is part or all of the at least one viewing area.
[0160] Optionally, the enhancement parameter corresponding to any viewing angle area includes at least one of the following: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the viewing angle area.
[0161] The video image enhancement device provided in the present application can be used to execute the video image enhancement method executed by the above-mentioned terminal device. Its content and effects can be referred to the method embodiment part, which will not be repeated here.
[0162] Fig.12 A schematic diagram of a server provided in an embodiment of the present application, such as Fig.12As shown, the server includes: a memory 1201 and a processor 1202. The memory is used to store computer instructions so that the processor executes the computer instructions to implement the video image enhancement method performed by the server. The content and effect can be referred to in the method embodiment part, which will not be repeated here. Optionally, the server also includes a transceiver 1203 for realizing data transmission with a terminal device or other device.
[0163] Fig.13 A schematic diagram of a terminal device provided in an embodiment of the present application is shown in FIG. Fig.13 As shown, the terminal device includes: a memory 1301 and a processor 1302. The memory is used to store computer instructions so that the processor executes the computer instructions to implement the video image enhancement method performed by the terminal device. The content and effect can be referred to in the method embodiment part, which will not be repeated here. Optionally, the terminal device also includes a transceiver 1303 for realizing data transmission with a server or other device.
[0164] The present application provides a chip, which is used to implement a video image enhancement method executed by a server. The content and effects thereof can be referred to in the method embodiment part, which will not be described in detail.
[0165] The present application provides a chip, which is used to implement a video image enhancement method executed by a terminal device. The content and effect thereof can be referred to the method embodiment part, which will not be described in detail.
[0166] The present application provides a computer storage medium, including: computer executable instructions, the computer executable instructions are used to implement a video image enhancement method executed by a server. The content and effect thereof can be referred to the method embodiment part, which will not be described in detail.
[0167] The present application provides a computer storage medium, including: computer executable instructions, the computer executable instructions are used to implement a video image enhancement method executed by a terminal device. The content and effect thereof can be referred to the method embodiment part, which will not be described in detail.
Claims
1. A method for enhancing a video image, characterized in that: include: The server receives a request message sent by the terminal device, wherein the request message includes an identifier of the video image; The server acquires, according to the identifier of the video image, a picture parameter of at least one viewing angle area in the video image; The server sends the picture parameters of the at least one viewing area to the terminal device; The picture parameters of the at least one viewing angle area include: enhancement parameters corresponding to the at least one viewing angle area respectively, and the enhancement parameters corresponding to any one of the at least one viewing angle area are used by the terminal device to perform enhancement processing on the viewing angle area; The server determines the picture parameters of the at least one viewing angle area, including: If the average value of the brightness component of each pixel in the video image is less than the brightness threshold, and the number of first pixels is greater than a first preset number, then determining the brightness enhancement parameters corresponding to the at least one viewing angle area, wherein the first pixel is a pixel whose brightness component is less than the average value of the brightness component among the pixels; and / or, If the mean value of the saturation component of each pixel in the video image is less than the saturation threshold value, and the number of second pixels is greater than a second preset number, then determining the saturation enhancement parameters corresponding to the at least one viewing angle area respectively, the second pixel being a pixel whose saturation component is less than the mean value of the saturation component among the pixels; and / or, If the mean value of the contrast component of each pixel in the video image is less than the contrast threshold value, and the number of the third pixels is greater than the second preset number, then determining the contrast enhancement parameters corresponding to the at least one viewing angle area, wherein the third pixel is a pixel whose contrast component is less than the mean value of the contrast component among the pixels; and / or, If the average value of the sharpness components of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to at least one viewing angle area are determined, and the fourth pixel is the pixel whose sharpness component among the pixels is less than the average value of the sharpness component.
2. The method according to claim 1, characterized in that: Before the server receives the request message sent by the terminal device, the method further includes: The server determines picture parameters of the at least one viewing area.
3. The method according to any one of claims 1 to 2, characterized in that: The picture parameters of the at least one viewing area further include: a timestamp and a spatial range respectively corresponding to the at least one viewing area.
4. A method for enhancing a video image, characterized in that: include: The terminal device sends a request message to the server, wherein the request message includes an identifier of a video image, and the identifier of the video image is used by the server to obtain picture parameters of at least one viewing angle area in the video image; The terminal device receives the picture parameters of the at least one viewing area sent by the server; The terminal device performs enhancement processing on the video image according to the picture parameters of the at least one viewing angle area; The picture parameters of the at least one viewing angle area include: enhancement parameters corresponding to the at least one viewing angle area respectively, and the enhancement parameters corresponding to any one of the at least one viewing angle area are used by the terminal device to perform enhancement processing on the viewing angle area; The image parameters of the at least one viewing area are determined by the server in the following manner: If the average value of the brightness component of each pixel in the video image is less than the brightness threshold, and the number of first pixels is greater than a first preset number, then determining the brightness enhancement parameters corresponding to the at least one viewing angle area, wherein the first pixel is a pixel whose brightness component is less than the average value of the brightness component among the pixels; and / or, If the mean value of the saturation component of each pixel in the video image is less than the saturation threshold value, and the number of second pixels is greater than a second preset number, then determining the saturation enhancement parameters corresponding to the at least one viewing angle area respectively, the second pixel being a pixel whose saturation component is less than the mean value of the saturation component among the pixels; and / or, If the mean value of the contrast component of each pixel in the video image is less than the contrast threshold value, and the number of the third pixels is greater than the second preset number, then determining the contrast enhancement parameters corresponding to the at least one viewing angle area, wherein the third pixel is a pixel whose contrast component is less than the mean value of the contrast component among the pixels; and / or, If the average value of the sharpness components of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to at least one viewing angle area are determined, and the fourth pixel is the pixel whose sharpness component among the pixels is less than the average value of the sharpness component.
5. The method according to claim 4, characterized in that The picture parameters of the at least one viewing area further include: a timestamp and a spatial range respectively corresponding to the at least one viewing area; Correspondingly, the terminal device performs enhancement processing on the video image according to the picture parameters of the at least one viewing angle area, including: The terminal device determines the enhancement parameter corresponding to the target viewing area according to the timestamp and spatial range of the target viewing area, and the timestamp and spatial range respectively corresponding to the at least one viewing area; Performing enhancement processing on the target viewing angle area according to the enhancement parameters corresponding to the target viewing angle area; The target viewing area is part or all of the at least one viewing area.
6. The method according to claim 4 or 5, characterized in that: The enhancement parameter corresponding to any one of the viewing angle regions includes at least one of the following: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the viewing angle region.
7. A video image enhancement device, characterized in that: include: A receiving module, used to receive a request message sent by a terminal device, wherein the request message includes an identifier of a video image; An acquisition module, configured to acquire picture parameters of at least one viewing angle area in the video image according to an identifier of the video image; A sending module, used for sending the picture parameters of the at least one viewing area to the terminal device; The picture parameters of the at least one viewing angle area include: enhancement parameters corresponding to the at least one viewing angle area respectively, and the enhancement parameters corresponding to any one of the at least one viewing angle area are used by the terminal device to perform enhancement processing on the viewing angle area; Determine the module used to: If the average value of the brightness component of each pixel in the video image is less than the brightness threshold, and the number of first pixels is greater than a first preset number, then determining the brightness enhancement parameters corresponding to the at least one viewing angle area, wherein the first pixel is a pixel whose brightness component is less than the average value of the brightness component among the pixels; and / or, If the mean value of the saturation component of each pixel in the video image is less than the saturation threshold value, and the number of second pixels is greater than a second preset number, then determining the saturation enhancement parameters corresponding to the at least one viewing angle area respectively, the second pixel being a pixel whose saturation component is less than the mean value of the saturation component among the pixels; and / or, If the mean value of the contrast component of each pixel in the video image is less than the contrast threshold value, and the number of the third pixels is greater than the second preset number, then determining the contrast enhancement parameters corresponding to the at least one viewing angle area, wherein the third pixel is a pixel whose contrast component is less than the mean value of the contrast component among the pixels; and / or, If the average value of the sharpness components of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to at least one viewing angle area are determined, and the fourth pixel is the pixel whose sharpness component among the pixels is less than the average value of the sharpness component.
8. The device according to claim 7, characterized in that Also includes: The determination module is used to determine the picture parameters of the at least one viewing angle area before the receiving module receives the request message sent by the terminal device.
9. The device according to any one of claims 7-8, characterized in that: The picture parameters of the at least one viewing area further include: a timestamp and a spatial range respectively corresponding to the at least one viewing area.
10. A video image enhancement device, characterized in that: include: A sending module, configured to send a request message to a server, wherein the request message includes an identifier of a video image, and the identifier of the video image is used by the server to obtain picture parameters of at least one viewing angle area in the video image; A receiving module, configured to receive picture parameters of the at least one viewing area sent by the server; A processing module, configured to perform enhancement processing on the video image according to picture parameters of the at least one viewing angle area; The picture parameters of the at least one viewing angle area include: enhancement parameters corresponding to the at least one viewing angle area respectively, and the enhancement parameters corresponding to any one of the at least one viewing angle area are used by the terminal device to perform enhancement processing on the viewing angle area; The image parameters of the at least one viewing area are determined by the server in the following manner: If the average value of the brightness component of each pixel in the video image is less than the brightness threshold, and the number of first pixels is greater than a first preset number, then determining the brightness enhancement parameters corresponding to the at least one viewing angle area, wherein the first pixel is a pixel whose brightness component is less than the average value of the brightness component among the pixels; and / or, If the mean value of the saturation component of each pixel in the video image is less than the saturation threshold value, and the number of second pixels is greater than a second preset number, then determining the saturation enhancement parameters corresponding to the at least one viewing angle area respectively, the second pixel being a pixel whose saturation component is less than the mean value of the saturation component among the pixels; and / or, If the mean value of the contrast component of each pixel in the video image is less than the contrast threshold value, and the number of the third pixels is greater than the second preset number, then determining the contrast enhancement parameters corresponding to the at least one viewing angle area, wherein the third pixel is a pixel whose contrast component is less than the mean value of the contrast component among the pixels; and / or, If the average value of the sharpness components of each pixel in the video image is less than the sharpness threshold, and the number of fourth pixels is greater than the second preset number, then the sharpness enhancement parameters corresponding to at least one viewing angle area are determined, and the fourth pixel is the pixel whose sharpness component among the pixels is less than the average value of the sharpness component.
11. The device according to claim 10, characterized in that The picture parameters of the at least one viewing area further include: a timestamp and a spatial range respectively corresponding to the at least one viewing area; Accordingly, the processing module is specifically used for: Determine an enhancement parameter corresponding to the target viewing area according to a timestamp and a spatial range of the target viewing area, and a timestamp and a spatial range respectively corresponding to the at least one viewing area; Performing enhancement processing on the target viewing angle area according to the enhancement parameters corresponding to the target viewing angle area; The target viewing area is part or all of the at least one viewing area.
12. The device according to claim 10 or 11, characterized in that The enhancement parameter corresponding to any one of the viewing angle regions includes at least one of the following: a brightness enhancement parameter, a saturation enhancement parameter, a contrast enhancement parameter, and a sharpness enhancement parameter of the viewing angle region.
13. A server, characterized in that: include: Memory and processor; The memory is used to store computer instructions so that the processor executes the computer instructions to implement the video image enhancement method according to any one of claims 1 to 3.
14. A terminal device, characterized in that: include: Memory and processor; The memory is used to store computer instructions so that the processor executes the computer instructions to implement the video image enhancement method as described in any one of claims 4-6.
Citation Information
Patent Citations
Panoramic video processing method, device and system
CN106454321A