Video processing method and system, video playing system, device, equipment and medium

Abstract

The invention discloses a video processing method and system, a video playing system, device, equipment and medium, and belongs to the technical field of video processing, and the method comprises the steps: obtaining an input video frame and a display parameter of the input video frame during display, the display parameter comprising at least one of a video format and a resolution; based on the display parameters, the input video frame is processed into a plurality of output video frames, and one output video frame corresponds to a partial region of the input video frame; and respectively displaying the plurality of output video frames on a plurality of display devices, so that the plurality of output video frames are displayed according to the display parameters.

Description

Video processing method and system, video playback system, device, equipment and medium

[0001] The present disclosure relates to the field of video processing technology, and in particular to a video processing method and system, a video playback system, a device, equipment and a medium.

[0002] With the rise of Internet technology and multimedia technology, various videos are often played on terminals, such as advertisements, movies and TV series, promotional information, and monitoring videos. In the media control scenario, a video will be split and displayed on multiple display devices, and different display devices will play different split images of the video.

[0003] Overview

[0004] The present disclosure provides a video processing method, the method comprising:

[0005] Acquire an input video frame and display parameters of the input video frame when it is displayed, wherein the display parameters include at least one of a video format and a resolution;

[0006] Based on the display parameters, the input video frame is processed into a plurality of output video frames, wherein one of the output video frames corresponds to a partial area of ​​the input video frame;

[0007] The plurality of output video frames are displayed on a plurality of display devices respectively, so that the plurality of output video frames are displayed according to the display parameters.

[0008] Exemplarily, the processing the input video frame into a plurality of output sub-video frames based on the display parameter includes:

[0009] Acquire input parameters of the input video frame, wherein the input parameters include at least one of a video format and a resolution;

[0010] Based on the input parameters and the display parameters, at least one image processing is performed on the input video frame in sequence; wherein the image processing includes segmentation processing, and the segmentation processing is used to segment the current video frame into a plurality of sub-video frames;

[0011] The multiple sub-video frames correspond to the multiple output video frames respectively, and the current video frame is the input video frame, or is a video frame obtained after the input video frame is subjected to image processing other than the segmentation processing.

[0012] Exemplarily, the input parameter includes the video format; and the performing at least one image processing on the video frame in sequence based on the input parameter and the display parameter includes:

[0013] When the video format is different from the video format of the input video frame, performing a format conversion process on the input video frame, wherein the format conversion process is used to convert the input video frame into a first video frame that conforms to the video format in the display parameter;

[0014] The segmentation process is performed on the first video frame to obtain a plurality of output video frames.

[0015] Exemplarily, the input video frame is in a two-dimensional video format, the video format of the output video frame is in a three-dimensional video format, and the format conversion process of the input video frame includes:

[0016] Obtaining a depth map corresponding to the input video frame;

[0017] Based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, sub-video frames corresponding to multiple viewpoints are generated, and the sub-video frames corresponding to the multiple viewpoints include pixels of the viewpoints at multiple positions.

[0018] Exemplarily, the first video frame includes a plurality of viewpoints and pixels of each viewpoint at a plurality of positions; performing the segmentation process on the first video frame to obtain a plurality of output video frames includes:

[0019] Dividing the multiple pixels included in each of the viewpoints according to the splicing method of the multiple display devices to obtain the pixels included in different area positions of each viewpoint;

[0020] Pixels belonging to the same regional position in the multiple viewpoints are spliced ​​to obtain output video frames corresponding to the multiple regional positions respectively.

[0021] Exemplarily, the display parameter includes the resolution, the at least one image processing further includes super-resolution processing, and the performing at least one image processing on the video frame in sequence based on the input parameter and the display parameter includes:

[0022] When the resolution of the output video frame is higher than the resolution of the input video frame, determining the execution order between the segmentation process and the super-resolution process based on the video format of the output video frame; wherein the super-resolution process is used to improve the resolution of the input video frame;

[0023] When the execution order of the super-resolution processing arrives, the input second video frame is subjected to the super-resolution processing according to the resolution of the output video frame;

[0024] The second video frame is the input video frame, or the sub-video frame.

[0025] Exemplarily, determining the execution order between the segmentation process and the super-resolution process based on the video format of the output video frame includes:

[0026] If the video format of the output video frame is a two-dimensional video format, determining that the execution order of the segmentation process takes precedence over the execution order of the super-resolution process;

[0027] If the video format of the output video frame is a three-dimensional video format, it is determined that the execution order of the segmentation process lags behind the execution order of the super-resolution process.

[0028] Exemplarily, the video format of the output video frame is a three-dimensional video format, the execution order of the segmentation process lags behind the execution order of the super-resolution process, and the super-resolution process of the input second video frame includes:

[0029] Extracting sub-video frames belonging to each viewpoint from the second video frame, respectively, wherein the sub-video frame of each viewpoint includes pixels at multiple positions;

[0030] Performing pixel expansion on pixels in the sub-video frames of each of the viewpoints;

[0031] The segmentation process is used to rearrange the pixels in the sub-video frames of the plurality of viewpoints after the pixel expansion according to the splicing mode of the plurality of display devices to obtain the output video frame.

[0032] Exemplarily, the execution order of the segmentation process takes precedence over the execution order of the super-resolution process, and the super-resolution process is performed on the input second video frame, including:

[0033] For each sub-video frame among the multiple sub-video frames, pixels included in the sub-video frame are expanded to obtain output video frames corresponding to each sub-video frame.

[0034] Exemplarily, the pixel expansion includes:

[0035] For each of the sub-video frames, insert at least one circle of first pixels outside the first edge of the sub-video frame to obtain an intermediate sub-video frame; wherein the pixel value of the first pixel is a preset value;

[0036] The pixel expansion is performed on the pixels included in each of the intermediate sub-video frames.

[0037] Exemplarily, the video format of the input video frame is a two-dimensional video format, and before performing pixel expansion, the method further includes:

[0038] Inserting at least one circle of second pixels outside the second edge of the input video frame to obtain a third video frame; wherein the pixel value of the second pixel is a preset value;

[0039] Performing the segmentation process on the third video frame to obtain a plurality of sub-video frames;

[0040] The first edge is an edge in the sub-video frame except the second edge.

[0041] Exemplarily, the input video frame includes a plurality of frames, and the method further includes:

[0042] Buffering a plurality of the input video frames and a plurality of output video frames respectively corresponding to the input video frames, so as to sequentially display the output video frames according to a frame sequence of the output video frames;

[0043] The method further comprises:

[0044] In response to the adjustment operation of the display parameter, based on the change of the display parameter before and after the adjustment, determining a target video frame to be adjusted; wherein the target video frame is a cached input video frame or a cached output video frame;

[0045] The target video frame is processed to obtain a video frame that meets the adjusted display parameters.

[0046] Exemplarily, determining a target video frame to be adjusted based on a change of the display parameter before and after the adjustment includes:

[0047] In the case where the change represents a change in the resolution, the cached output video frame is used as the target video frame; wherein the cached output video frame is the output video frame to be displayed at the current moment;

[0048] In the case where the change represents a change other than a resolution change, the buffered input video frame is used as the target video frame.

[0049] Exemplarily, the processing the target video frame to obtain a video frame that meets the adjusted display parameters includes:

[0050] If the target video frame is the output video frame, the resolution of the cached output video frame is processed according to the adjusted display parameters to obtain an output video frame with a changed resolution;

[0051] If the target video frame is the input video frame, performing format conversion processing on the cached input video frame, and performing the segmentation processing on the video frame obtained after the format conversion processing to obtain multiple new output video frames;

[0052] The format conversion process is used to convert the buffered input video frames into video frames that conform to the changed video format.

[0053] A second aspect of the present disclosure provides a video processing system, including: a scheduling unit, an image processing unit, and a display unit;

[0054] The scheduling unit is used to schedule the input video frame to the image processing unit;

[0055] The image processing unit is used to process the input video frame into a plurality of output video frames based on display parameters of the input video frame when displayed, wherein one of the output video frames corresponds to a partial area on the input video frame, and the display parameters include at least one of a video format and a resolution;

[0056] The display unit is used to display the multiple output video frames on multiple display devices respectively, so that the output video frames are displayed according to the display parameters.

[0057] Exemplarily, the image processing unit includes a plurality of image processing modules;

[0058] The scheduling unit is used to determine at least one target image processing module to be scheduled and an execution order between the target image processing modules among the multiple image processing modules based on the input parameters of the input video frame and the display parameters;

[0059] And, in the scheduling process, according to the execution order, the video frame processed by the previous target image processing module is scheduled to the next target image processing module; wherein the scheduled target image processing module includes a segmentation module, and the segmentation module is used to segment the video frame input to the segmentation module into multiple sub-video frames;

[0060] The multiple sub-video frames correspond to the multiple output video frames respectively.

[0061] Exemplarily, when the video format of the input video frame is different from the video format of the output video frame, the target image processing module includes a format conversion module and the segmentation module;

[0062] The format conversion module is scheduled before the segmentation module, and is used to convert the input video frame into a video frame that complies with the video format in the display parameter.

[0063] Exemplarily, when the resolution of the input video frame is lower than the resolution of the output video frame, the target image processing module further includes a super-resolution module; the super-resolution module is used to perform pixel expansion on the video frame input to the super-resolution module; wherein:

[0064] The scheduling unit is further used to determine the execution order between the super-resolution module and the segmentation module based on the video format of the input video frame;

[0065] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a three-dimensional video format, the execution order of the super-resolution module is superior to that of the segmentation module;

[0066] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a two-dimensional video format, the execution order of the super-resolution module lags behind that of the segmentation module.

[0067] Exemplarily, the segmentation module includes a first segmentation module and a second segmentation module;

[0068] The first segmentation module is used to segment the video frames of the input two-dimensional video according to the splicing mode of the plurality of display devices;

[0069] The second segmentation module is used to extract the sub-video frame belonging to each viewpoint from the video frame of the input three-dimensional video, and divide the multiple pixels in the sub-video frame of each viewpoint according to the splicing method of multiple display devices to obtain the pixels included in different area positions of each viewpoint; and splice the pixels belonging to the same area position in multiple viewpoints.

[0070] Exemplarily, when the output video frame is in a three-dimensional video format and the input video frame is in a two-dimensional video format, the format conversion module is used to generate sub-video frames of multiple different viewpoints of the input video frame based on the input video frame and a depth map corresponding to the input video frame, wherein each sub-video frame of the viewpoint includes pixels at multiple positions of the viewpoint.

[0071] Exemplarily, the super-resolution module includes a first super-resolution module and a second super-resolution module; wherein:

[0072] The first super-resolution module is used to insert at least one circle of preset pixels at the edge of the input sub-video frame, and the pixel values ​​of the preset pixels are preset values;

[0073] The second super-resolution module is used to perform the pixel expansion on the sub-video frame output by the first super-resolution module.

[0074] Exemplarily, the system includes a plurality of playback components, the playback components include a plurality of the display devices, and the plurality of the display devices are spliced ​​with each other;

[0075] Wherein, the display unit is used to send the multiple output video frames to at least one of the playback components respectively, so that the playback component displays the multiple output video frames on multiple display devices respectively.

[0076] Exemplarily, it includes a plurality of image processing units; wherein different image processing units correspond to playback components spliced ​​by different numbers of display devices, and / or correspond to playback components spliced ​​by display devices with different display performances;

[0077] The scheduling unit is specifically configured to send the input video frame to the image processing unit corresponding to at least one target playback component according to the at least one target playback component to be displayed by the input video frame.

[0078] The present disclosure provides a video playback system, including a video processing module and a display module connected to the video processing module, wherein the display module is obtained by splicing a plurality of display devices; wherein the video processing module is used to execute the video processing method.

[0079] A fourth aspect of the present disclosure provides a video processing device, including:

[0080] A parameter acquisition module, used to acquire an input video frame and display parameters of the input video frame when it is displayed, wherein the display parameters include at least one of a video format and a resolution;

[0081] A processing module, configured to process the input video frame into a plurality of output video frames based on the display parameter, wherein one of the output video frames corresponds to a partial area of ​​the input video frame;

[0082] The display module is used to display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters.

[0083] The present disclosure provides a video processing method, which can obtain an input video frame and display parameters of the input video frame when displayed, and based on the display parameters, process the input video frame into multiple output video frames, and display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters; wherein one output video frame corresponds to a partial area of ​​the input video frame.

[0084] Since the input video frame can be processed based on the display parameters of the input video when it is displayed to obtain multiple output video frames, the input video frame can be split and displayed on multiple display devices, thereby realizing the display of the split video. Wherein, the display parameters include at least one of the video format and the resolution. Then, when the video is split and displayed, the input video frame can be processed into a video frame that meets the expected video format, or a video frame that meets the expected resolution, or a video frame that meets both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters, thereby, multiple display devices can splice and display multiple videos, achieving the effect of universal playback of multiple videos.

[0085] The present disclosure also discloses an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the video processing method as described in the first aspect when executing the computer program.

[0086] The embodiment of the present disclosure further discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the video processing method as described in the first aspect of the present disclosure.

[0087] The above description is only an overview of the technical solution of the present disclosure. In order to more clearly understand the technical means of the present disclosure, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present disclosure more obvious and easy to understand, the specific implementation methods of the present disclosure are listed below.

[0088] BRIEF DESCRIPTION OF THE DRAWINGS

[0089] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the following is a brief introduction to the drawings required for use in the embodiments or related technical descriptions. Obviously, the drawings described below are some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. It should be noted that the proportions in the drawings are only for illustration and do not represent the actual proportions.

[0090] FIG1 is a schematic diagram showing a framework of a first implementation environment of a video processing method in an embodiment of the present disclosure;

[0091] FIG2 is a schematic diagram showing a step flow diagram of a video processing method in an embodiment of the present disclosure;

[0092] FIG3 is a schematic diagram showing a video processing flow when converting an input video frame from a 2D video format to a 3D video format for output in an embodiment of the present disclosure;

[0093] FIG4 is a schematic diagram showing segmentation of a first video frame in a two-dimensional video format according to an embodiment of the present disclosure;

[0094] FIG5 is a schematic diagram showing a process flow of super-resolution processing in video processing in an embodiment of the present disclosure;

[0095] FIG6 is a schematic diagram showing a flow chart of another super-resolution process in video processing in an embodiment of the present disclosure;

[0096] FIG7 is a schematic diagram showing pixel expansion of a sub-video frame in an embodiment of the present disclosure;

[0097] FIG8 is a schematic diagram showing a process of super-resolution based on edge filling in an embodiment of the present disclosure;

[0098] FIG9 is a schematic diagram showing a process of super-resolution and segmentation of a two-dimensional video in an embodiment of the present disclosure;

[0099] FIG10 is a schematic diagram showing a process of performing video processing on a three-dimensional video in an embodiment of the present disclosure;

[0100] FIG11 is a schematic diagram showing a process of performing video processing on a three-dimensional video in an embodiment of the present disclosure;

[0101] FIG12 is a schematic diagram showing a process of performing video processing on a two-dimensional video in an embodiment of the present disclosure;

[0102] FIG13 is a schematic diagram showing a process of performing video processing on a two-dimensional video in an embodiment of the present disclosure;

[0103] FIG14 shows a schematic diagram of a framework structure of a video processing system in an embodiment of the present disclosure;

[0104] FIG15 shows a schematic diagram of the framework structure of yet another video processing system in an embodiment of the present disclosure;

[0105] FIG16 shows a schematic diagram of the framework structure of yet another video processing system in an embodiment of the present disclosure;

[0106] FIG17 shows a schematic diagram of the framework structure of yet another video processing system in an embodiment of the present disclosure;

[0107] FIG. 18 shows a schematic diagram of the framework of a video processing device in an embodiment of the present disclosure.

[0108] Detailed Description

[0109] In order to make the purpose, technical solution and advantages of the embodiments of the present disclosure clearer, the technical solution in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0110] In the related art, a video needs to be split and displayed on multiple display devices, and different display devices play different split images of the video; wherein, a display device formed by splicing multiple display devices is called a spliced ​​large screen, and the spliced ​​large screen can include 8K, 16K and other large screens. In some practical scenarios, it is necessary to realize universal display of various types of videos on the spliced ​​large screen, and the input source video can be converted and displayed according to the performance parameters of the spliced ​​large screen.

[0111] In view of this, the present disclosure provides a video processing method, the core concept of which is to process an input video frame into multiple output video frames according to display parameters when the input video frame is displayed on a display device, so as to display the multiple output video frames on multiple display devices respectively. Since the input video frame is processed according to the display parameters when displayed, the input video frame can be processed into a video frame that meets the expected video format, or a video frame that meets the expected resolution, or a video frame that meets both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters, thereby enabling multiple display devices to adapt to multiple videos, achieving the effect of universal playback of multiple videos.

[0112] First, referring to FIG. 1, a schematic diagram of the implementation environment of the video processing method of the present disclosure is shown. As shown in FIG. 1, a spliced ​​large screen, a monitoring host connected to each display device in the spliced ​​large screen, and a media publishing terminal connected to the monitoring host are included; wherein the media publishing terminal needs to process the incoming video (input video frame 1) according to the display parameters, and then send the processed video frame to the monitoring host, such as obtaining video frames F11-F14 after processing, wherein video frame F11 is sent to monitoring host 1, video frame F12 is sent to monitoring host 2, video frame F13 is sent to monitoring host 3, and video frame F14 is sent to monitoring host 4. The monitoring host then displays it on the spliced ​​large screen, wherein the spliced ​​large screen may include display screens located in public places, such as shopping malls, subway stations, and railway stations, and may also include display screens located in large conference rooms.

[0113] Among them, the spliced ​​large screen can be an 8K screen, 16K screen or 4K screen, which can achieve high-definition display.

[0114] Among them, the display device of the spliced ​​large screen can display 2D video and 3D video, among which 2D video is also called two-dimensional video, and 3D video is also called three-dimensional video. Exemplarily, the display device is a naked-eye 3D display device, which has a cylindrical lens array and a slit grating, and has 3D display capability, and can be used to display 3D video, and the user can watch the 3D video with naked eyes without the aid of an auxiliary viewing device; another exemplary embodiment, the display device does not include a cylindrical lens array and a slit grating, and it can be used to display 2D video; another exemplary embodiment, although the display device does not have a 3D display capability, it can still display a 3D video, in which case the user can watch the 3D display effect with the aid of an auxiliary viewing device.

[0115] Accordingly, based on the implementation environment shown in Figure 1, the present disclosure provides a video processing system, which can process the input video and send it to the monitoring host for playback. Specifically, the video processing system is described in detail in the subsequent embodiments and will not be repeated here.

[0116] In conjunction with the implementation environment shown in FIG1 , the video processing method provided by the present disclosure is introduced. As shown in FIG2 , a schematic flow chart of the steps of a video processing method of the present disclosure is shown. As shown in FIG2 , the method may specifically include the following steps:

[0117] Step S101: obtaining input video frames and display parameters of the input video frames when displayed, wherein the display parameters include at least one of a video format and a resolution.

[0118] In this embodiment, the input video frame may refer to a video frame in the video stream to be played. When the video stream arrives, each incoming video frame is called an input video frame, and then each incoming input video frame needs to be processed. Among them, the display parameters of the input video frame when displayed may refer to the parameters of the picture when the video is played on the display device. If the video format is included, it refers to the video format in which the input video frame is displayed when displayed. As mentioned above, the video format includes a three-dimensional video format and a two-dimensional video format. When the video format is a three-dimensional video format, the input video frame can display a three-dimensional video on the display device. If the display device is a naked-eye 3D display device, the input video frame can achieve a stereoscopic display effect on the display device; if the video format is a two-dimensional video format, the input video frame displays a two-dimensional video on the display device.

[0119] The display parameters may further include a resolution, which may indicate the resolution at which the input video frame is displayed on the display device. The higher the resolution, the clearer the input video frame will be displayed on the display device.

[0120] In practice, the display parameters may include resolution or video format, or both. In the display scenario of a spliced ​​large screen, according to the display performance of the display device, the display parameters may include both resolution and video format to indicate that the video is played according to the display performance provided by the display device.

[0121] In this embodiment, for the same multiple display devices, the display parameters corresponding to the input video frames in different videos may be different. For example, the display parameters corresponding to the 3D video may be different from the display parameters corresponding to the 2D video.

[0122] Alternatively, for the same multiple display devices, the corresponding display parameters of the input video frames in different videos can be the same. In this way, no matter what video format the input video is in or what resolution the input video is, it can be displayed on multiple display devices with the same display parameters, achieving universal playback of multiple videos on a spliced ​​large screen.

[0123] Of course, for the same multiple display devices, that is, the same spliced ​​large screen and the same video, different display parameters can be used at different times. For example, if the display parameters of the video are manually adjusted during the video playback, the display parameters will change during the video playback. For another example, if the sensitive images in the video need to be blurred during the video playback, one display parameter can be used during the playback period of the sensitive images, and another display parameter can be used during the other periods except for the sensitive images.

[0124] Step S102: Based on the display parameters, the input video frame is processed into a plurality of output video frames, wherein one output video frame corresponds to a partial area of ​​the input video frame;

[0125] In order to enable different types of videos to be displayed on a display device, the input video frame can be processed into an output video frame that meets the display parameters. Since the display parameters include the video format and / or resolution, the processing of the input video frame includes the format processing and / or resolution processing of the input video frame.

[0126] Among them, since the input video frame needs to be displayed on multiple display devices, multiple display devices are spliced ​​to obtain a spliced ​​large screen, and each display device displays a partial area of ​​the input video frame, the display parameters can also include the number of display devices and the splicing method of the display devices. Based on the number of display devices and the splicing method, the input video frame can also be segmented, that is, the processing of the input video frame also includes segmentation processing. It should be noted that inconsistent numbers of display devices or inconsistent splicing methods will result in different ways of segmenting the input video.

[0127] Exemplarily, since the processing of the input video frame includes segmentation processing, format processing and / or resolution processing, wherein segmentation processing is a necessary processing, in practice, the input video frame can be segmented first, and then each sub-video frame obtained after the segmentation processing can be formatted and / or processed for resolution; or, the input video frame can be formatted and / or processed for resolution first, and then the obtained video frame can be segmented; or, in the case of including format processing and resolution processing, the format processing, resolution processing and segmentation processing can flexibly adjust their respective processing orders according to actual needs, and finally obtain multiple output video frames.

[0128] Among them, for format processing and resolution processing, when the video format of the input video frame does not conform to the video format in the display parameters, the video format of the input video frame needs to be converted, such as converting the input video frame from a two-dimensional video format to a three-dimensional video format, or converting the input video frame from a three-dimensional video format to a two-dimensional video format.

[0129] For example, when the resolution of the input video frame does not match the resolution in the display parameters, the resolution of the input video frame needs to be increased, such as converting the input video frame from a low resolution to a high resolution. For another example, if both the resolution and the video format of the input video frame are inconsistent with the resolution and the video format in the display parameters, the resolution of the input video frame needs to be increased and the video format of the input video frame needs to be converted.

[0130] Step S103: Display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters.

[0131] In this embodiment, since the plurality of output video frames are obtained by processing the input video frames according to the display parameters, the resolution and video format of the output video frames meet the display performance requirements of the display device, so that the output video frames can be displayed on the display device according to the display parameters. For example, if the video format of the output video frame is converted to a three-dimensional video format, the output video frame is displayed on the display device with a stereoscopic effect; for another example, if the resolution of the output video frame is increased to a high resolution, the output video frame is displayed on the display device with a high resolution; for another example, if the resolution and video format of the output video frame are both processed, the output video frame can be displayed in three dimensions with a high resolution on the display device.

[0132] The technical solution of this embodiment, because the input video is divided into multiple output video frames according to the display parameters, the input video frame can be split and displayed on multiple display devices, thereby realizing the display of the split video. Among them, because the display parameters include at least one of the video format and the resolution, when the video is split and displayed, the input video frame can be processed into a video frame that meets the expected video format, or a video frame that meets the expected resolution, or a video frame that meets both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters, thereby making multiple display devices adapt to multiple videos, achieving the effect of universal playback of multiple videos.

[0133] In an optional embodiment, in the process of processing the input video frame into multiple output video frames based on the display parameters, a universal display of multiple input video frames can be achieved. In this case, the corresponding video processing logic can be set for the input video frame based on the display parameters and the input parameters of the input video frame. The display parameters can reflect the video format and resolution of the output video frame, and the input parameters can reflect the video format and resolution of the input video frame. The difference between the input video frame and the desired output video frame can be determined through the input parameters and the display parameters, and the corresponding video processing logic is set for the input video frame according to the difference.

[0134] In this optional embodiment, the video processing logic for the input video frame can be determined based on the input parameters of the incoming input video frame and the display parameters of the input video frame when it is displayed. The video processing logic may include at least one image processing. When the input video frame is processed according to the video processing logic, at least one image processing may be performed in a certain execution order. It should be noted that since the input video frame needs to be divided into multiple output video frames for output, at least one image processing includes a segmentation process, and the segmentation process is used to segment the video frame according to the number of display devices and the splicing method.

[0135] In a specific implementation, input parameters of an input video frame may be obtained, and at least one image processing may be performed on the input video frame in sequence based on the input parameters and display parameters. The input parameters include at least one of a video format and a resolution, and the segmentation processing is used to segment the current video frame into a plurality of sub-video frames; wherein the plurality of sub-video frames correspond to a plurality of output video frames respectively, and the current video frame is the input video frame, or is a video frame obtained after the input video frame is subjected to image processing other than the segmentation processing.

[0136] In this embodiment, for two input video frames with the same input parameters, if the display parameters corresponding to the two input video frames are different, the video processing logics may be different; similarly, for two input video frames corresponding to the same display parameters, if the input parameters of the two input video frames are different, their video processing logics are also different.

[0137] Among them, the image processing that needs to be performed on the input video frame can be determined based on the input parameters and the display parameters. For example, if it is determined based on the input parameters and the display parameters that only segmentation processing needs to be performed on the input video frame (characterizing that the input parameters and the display parameters are consistent), then the image processing only includes segmentation processing; for another example, if it is determined based on the input parameters and the display parameters that format conversion needs to be performed on the input video frame, then the image processing includes segmentation processing and format conversion processing; for another example, if it is determined based on the input parameters and the display parameters that the resolution of the input video frame needs to be improved, then the image processing includes segmentation processing and resolution processing (super-resolution processing in subsequent embodiments); for another example, if it is determined based on the input parameters and the display parameters that the resolution of the input video frame needs to be improved and format conversion needs to be performed, then the image processing includes segmentation processing, format conversion processing and super-resolution processing.

[0138] Among them, in the case of only segmentation processing, only the input video frame can be segmented according to the number and splicing method of multiple display devices to obtain multiple output video frames. In this case, the current video frame processed by the segmentation processing is the input video frame, and the multiple sub-video frames output after the segmentation processing are the multiple output video frames.

[0139] In the case where at least one of the processes of super-resolution processing and format conversion processing is included in addition to the segmentation processing, the execution order of the multiple image processing can be determined first, and then, the image processing is performed on the input video frame in sequence according to the execution order; in this case, when the execution order of the segmentation processing arrives, the current video frame processed is either the input video frame or the video frame output after other image processing (image processing other than the segmentation processing). In other words, the execution order of the segmentation processing can be the first, the last, or between the first and the last.

[0140] By adopting the above scheme, the execution order of various image processing performed on the input video frames can be different for different input parameters and display parameters. In this way, more adaptive video processing of the input video frames can be achieved. For example, the quality of video processing can be guaranteed while ensuring the efficiency of video processing.

[0141] Next, how to combine input parameters and display parameters to perform image processing on input video frames is introduced and explained.

[0142] Example #1, the display parameter includes only the video format. When the display parameter includes only the video format, it means that the input video frame only needs to be displayed according to the preset video format, and the resolution of the input video frame does not need to be processed. The processing method of this example #1 is as follows:

[0143] When performing video processing, the input video frame can be processed according to the video format of the input video frame and the video format of the output video frame, and the image processing includes format conversion processing and segmentation processing. For example, if the video format of the input video frame is different from the video format of the output video frame, the video format of the input video frame can be format converted, for example, the input video frame is converted from a 3D video format to a 2D video format for output, or the input video frame is converted from a 2D video format to a 3D video format for output. In this case, after the input video frame is format converted, the video frame after the format conversion can be segmented.

[0144] In a specific implementation, when the video format of the output video frame is different from the video format of the input video frame, a format conversion process is performed on the input video frame. The format conversion process is used to convert the input video frame into a first video frame that conforms to the video format in the display parameters. Then, a segmentation process can be performed on the first video frame to obtain multiple output video frames.

[0145] In this example #1, if the video format of the output video frame is different from the video format of the input video frame, the video format of the input video frame needs to be converted to the preset video format. As mentioned above, the video format conversion includes the conversion from the 2D video format to the 3D video format, and the conversion from the 3D video format to the 2D video format. Among them, the format conversion process of converting the 2D video format to the 3D video format can be combined with the depth map of the input video frame. The depth map can provide the depth value of each pixel in the input video frame to distinguish the foreground and the background, thereby converting the input video frame in the two-dimensional video format into the first video frame in the three-dimensional video format.

[0146] Among them, in the format conversion process of converting the 3D video format into the 2D video format, the input video frame generally includes multiple viewpoints, that is, includes images from different perspectives. In practice, the image of one of the viewpoints can be extracted from the input video frame, thereby converting the input video frame in the three-dimensional video format into the first video frame in the two-dimensional video format.

[0147] In this example #1, the execution order of the format conversion processing can be set to take precedence over the execution order of the segmentation processing. In this way, the video frame targeted by the segmentation processing is the first video frame after the format conversion. In this way, the first video frame can be segmented according to the number of display devices and the splicing method to obtain multiple output video frames.

[0148] When using this example #1, since the segmentation process is performed after the format conversion process, the format conversion process can be performed on the entire input video frame, which can improve the conversion efficiency compared to the situation where the format conversion process is performed later and the format conversion needs to be performed on multiple segmented sub-video frames. In addition, when it is necessary to convert the input video frame from a 2D video format to a 3D video format, the input video frame is first converted into a 3D video format, which can avoid the loss of image information caused by segmentation first, thereby improving the quality of the output video frame.

[0149] Exemplarily, referring to FIG. 3 , a schematic diagram of a video processing flow when converting an input video frame from a 2D video format to a 3D video format for output is shown. As shown in FIG. 3 , the input video frame is in a two-dimensional video format, and the video format of the output video frame is in a three-dimensional video format. When the input video frame is format-converted, a depth map corresponding to the input video frame can be obtained. Based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, multiple sub-video frames of the input video frame are generated, and the multiple sub-video frames include multiple viewpoints and pixels at multiple positions for each viewpoint.

[0150] As described above, the depth map may include the depth value of each pixel in the input video frame, and the depth value may characterize whether the pixel belongs to the foreground or the background. In practice, the multiple viewpoints included and the pixels at multiple positions of each viewpoint may be restored by the pixel values ​​of each pixel in the input video frame and the depth values ​​of the pixels at the corresponding positions in the depth map; wherein the viewpoint may be understood as a viewing angle, and different viewpoints correspond to different viewing angles. An image may be formed under different viewing angles, and the images of multiple viewpoints may form a three-dimensional video frame for stereoscopic display. Among them, the image of each viewpoint may be called a sub-video frame. As shown in FIG3 , nine viewpoints are restored according to the input video frame and the depth map, and nine sub-video frames are obtained. Each sub-video frame includes pixels at multiple different positions, wherein for different sub-video frames, the pixel values ​​of pixels at the same position may be the same or different, thereby, the sub-video frames corresponding to each of the multiple viewpoints constitute the video data of the first video frame, and the stereoscopic display effect may be achieved based on these video data.

[0151] Next, segmentation processing can be performed on the first video frame, and multiple output video frames can be obtained after the segmentation processing. In this case, each of the multiple output video frames can include multiple viewpoints, and the multiple viewpoints correspond to pixels in the same position area; for example, each output video frame includes nine viewpoints, and the nine viewpoints correspond to pixels in the same position area. In this way, when the multiple output video frames are spliced ​​and displayed on multiple display devices, the output video frames displayed on each display device can achieve a stereoscopic display effect.

[0152] In this example #1, the segmentation process of the first video frame of different video formats is described as follows:

[0153] When the first video frame in the two-dimensional video format is segmented, the first video frame is obtained by converting the input video frame from the 3D video format to the 2D video format. The segmentation process can be shown in FIG4, which shows a schematic diagram of segmenting the first video frame in the two-dimensional video format. As shown in FIG4, the first video frame can be divided according to the splicing method and number of multiple display devices. For example, as shown in FIG1, the spliced ​​large screen is spliced ​​by 4 display devices, and the first video frame can be divided into 4 areas according to the splicing method of the 4 display devices, and the 4 areas correspond to 4 display devices respectively. For example, the picture of area 1 (pixels 1, 2, 5 and 6) is displayed on display device 1, the picture of area 2 (pixels 3, 4, 7 and 8) is displayed on display device 2, the picture of area 3 (pixels 9, 10, 13 and 14) is displayed on display device 3, and the picture of area 4 (pixels 11, 12, 15 and 16) is displayed on display device 4.

[0154] When segmenting a first video frame in a three-dimensional video format, the first video frame is obtained by converting an input video frame from a 2D video format to a 3D video format. The segmentation process can be shown in FIG3 . As shown in FIG3 , since the converted first video frame includes sub-video frames corresponding to a plurality of viewpoints, each sub-video frame includes pixels of the viewpoint at a plurality of positions. When segmenting the first video frame, pixels in the sub-video frames of the plurality of viewpoints can be rearranged. The pixel rearrangement can be used to integrate pixels of the plurality of viewpoints at different regional positions, so that pixels under the plurality of viewpoints at the same regional position are arranged together to form a three-dimensional video at the regional position.

[0155] In a specific implementation, the multiple pixels included in each viewpoint can be divided according to the splicing method and number of multiple display devices to obtain the pixels included in different regional positions of each viewpoint; then, the pixels belonging to the same regional position in multiple viewpoints can be spliced ​​to obtain output video frames corresponding to multiple regional positions.

[0156] Among them, for the sub-video frame of each viewpoint, in pixel 1_1, the first 1 represents the viewpoint, and the second 1 represents the first pixel of the first sub-video frame; in pixel 1_2, the first 1 represents the viewpoint, and the second 2 represents the second pixel of the first sub-video frame; in practice, the sub-video frame of the viewpoint can be divided according to the stitching method and number of multiple display devices, as shown in Figure 3. The sub-video frame of each viewpoint includes pixels from 4 different areas, the number of display devices is 4, and the stitching method is as shown in Figure 1. Then the division of the sub-video frame can be as shown in Figure 3, that is, pixel 1_1, pixel 1_2, pixel 1_3 and pixel 1_4 belong to different regional positions respectively.

[0157] Afterwards, the pixels of the divided sub-video frames are rearranged according to the divided regional positions. For example, for regional position 1, the pixels belonging to regional position 1 in multiple viewpoints need to be combined together. As shown in FIG3, for regional position 1, the first pixels belonging to regional position 1 in 9 viewpoints are arranged together, thereby obtaining a three-dimensional sub-video frame of regional position 1. The regional position 1 includes pixels of different viewpoints, thereby obtaining images of the regional position 1 at different viewing angles. When these images are displayed in a display device, they can be superimposed on each other to form a three-dimensional display effect. For example, as shown in FIG3, when rearranging, the pixels (_1) at the first position of the 9 viewpoints are taken to re-form an image matrix, and the pixels (_2) at the second position of the 9 viewpoints are taken to re-form an image matrix. By analogy, the _3 and _4 positions are respectively composed of new image matrices, and finally, the images after the rearrangement of 4 pixels can be obtained, and then the synchronization of the 4 image streams is controlled by the control module, and they are displayed and played on the 1st, 2nd, 3rd, and 4th display devices respectively.

[0158] Example #2, the display parameter only includes the resolution. When the display parameter only includes the resolution, it means that the input video frame only needs to be displayed according to the preset resolution, and the video format of the input video frame does not need to be processed. The processing method of this example #2 is as follows:

[0159] If the resolution of the output video frame is higher than the resolution of the input video frame, the input video frame needs to be super-resolution processed, and the super-resolution processing is used to increase the resolution of the input video frame so that the resolution of the output video frame is the resolution determined in the display parameters.

[0160] Specifically, super-resolution processing can be performed before or after image segmentation. Exemplarily, no matter what video format the input video frame is in, or no matter what video format the output video frame is in, super-resolution processing can be performed before image segmentation. For example, if the output video frame and the input video frame are both video frames in two-dimensional video format, the input video frame can be super-resolution processed first, and then the video frame after super-resolution processing can be segmented; wherein, the segmentation processing of the second video frame in two-dimensional video format can refer to the above-mentioned process of segmenting the first video frame in two-dimensional video format, which will not be repeated here. For another example, if the output video frame and the input video frame are both video frames in three-dimensional video format, the input video frame can be super-resolution processed first, and then the video frame after super-resolution processing can be segmented; wherein, the segmentation processing process can refer to the above-mentioned process of segmenting the first video frame in three-dimensional video format, which will not be repeated here.

[0161] For another example, regardless of the video format of the input video frame or the video format of the output video frame, the super-resolution processing can be performed after the image segmentation. For example, if the output video frame and the input video frame are both video frames in a two-dimensional video format, the input video frame can be segmented first, and then the multiple sub-video frames obtained after the segmentation processing can be super-resolution processed; for another example, if the output video frame and the input video frame are both video frames in a three-dimensional video format, the input video frame can be segmented first, and then the multiple sub-video frames obtained after the segmentation processing can be super-resolution processed.

[0162] In another exemplary embodiment, when super-resolution processing is performed on an input video frame, the execution order between super-resolution processing and segmentation processing can be determined based on the video format of the output video frame, thereby enabling the execution order of super-resolution processing and segmentation processing to be changed in a targeted manner in different video formats of the output video frame to improve the effect of video processing. Accordingly, when the execution order of super-resolution processing arrives, super-resolution processing can be performed on the input second video frame according to the resolution of the output video frame; wherein the second video frame is the input video frame, or a sub-video frame.

[0163] Specifically, if the super-resolution processing is performed before the segmentation processing, the super-resolution processing can be targeted at the input video frame, that is, the input video frame is first super-resolution processed to obtain a super-resolution video frame, and then the super-resolution frame is segmented. If the super-resolution processing is performed after the segmentation processing, the input video frame is first segmented to obtain multiple sub-video frames, and then each sub-video frame is super-resolution processed.

[0164] Exemplarily, if the video format of the output video frames is a two-dimensional video format, the execution order of the segmentation processing is determined to take precedence over the execution order of the super-resolution processing; if the video format of the output video frames is a three-dimensional video format, the execution order of the segmentation processing is determined to lag behind the execution order of the super-resolution processing.

[0165] Among them, when the video format of the output video frame is a three-dimensional video format, the output video frame includes multiple viewpoints, and each viewpoint includes pixels at multiple different positions. In this way, super-resolution processing can be performed first, so that the pixels of each viewpoint can be expanded first. Because one viewpoint corresponds to a sub-video frame of that viewpoint, in this case, the resolution of the sub-video frame of each viewpoint can be enhanced first, and then the sub-video frames of multiple viewpoints can be segmented. The pixels are rearranged as described above, so as to avoid the situation where the parallax inconsistency occurs when the resolution is increased after segmentation, which affects the stereoscopic display effect.

[0166] 5 , a flow chart of a super-resolution process in video processing is shown. As shown in FIG5 , the video format of the output video frame is a three-dimensional video format. In this case, regardless of whether the input video is in a two-dimensional video format or a three-dimensional video format, the second video frame targeted by the super-resolution process is a video frame in a three-dimensional video format. Specifically, the super-resolution process can be performed on each viewpoint in the second video frame, that is, on the sub-video frame of each viewpoint in the second video frame.

[0167] In a specific implementation, sub-video frames belonging to each viewpoint can be extracted from the second video frame, each sub-video frame including pixels at multiple positions; then, the pixels in the sub-video frames of each viewpoint are expanded; wherein the segmentation processing is used to rearrange the pixels in the sub-video frames of multiple viewpoints after pixel expansion according to the splicing method of multiple display devices to obtain an output video frame.

[0168] The second video frame may be an input video frame. Since the input video frame is in a three-dimensional video format, it includes sub-video frames corresponding to multiple viewpoints. For each viewpoint sub-video frame, it includes pixels at multiple different positions. When expanding the pixels in the sub-video frame of the viewpoint, nonlinear interpolation or other methods may be used to increase the number of pixels in the sub-video frame, thereby improving the resolution of the sub-video frame of each viewpoint. It should be noted that when expanding the pixels of the sub-video frames of multiple viewpoints, the pixel expansion scales of different sub-video frames are the same.

[0169] Next, when expanding the pixels of the sub-video frame of each viewpoint, the pixels in the multiple sub-video frames after pixel expansion can be rearranged in the manner of segmenting the first video frame in the 3D video format, thereby obtaining multiple output video frames.

[0170] Referring to Figure 6, a flow chart of another super-resolution processing in video processing is shown. As shown in Figure 6, in Example #2, the video format of the output video frame is a two-dimensional video format. In this case, regardless of whether the input video is in a two-dimensional video format or a three-dimensional video format, the second video frame targeted by the super-resolution processing is a plurality of sub-video frames obtained after the segmentation processing. Specifically, if the input video frame is in a two-dimensional video format, the second video frame may be a sub-video frame obtained by segmenting the input video frame. If the input video frame is in a three-dimensional video format, the input video frame may be first converted into a video frame in a two-dimensional video format, and then the converted video frame in the two-dimensional video format may be segmented to obtain sub-video frames to be super-resolution processed.

[0171] The sub-video frame is a video frame of two-dimensional data. In specific implementation, for each of the multiple sub-video frames, pixels included in the sub-video frame can be expanded to obtain output video frames corresponding to each sub-video frame.

[0172] As shown in FIG5 and FIG6, pixel expansion is involved in super-resolution processing, which can increase the number of pixels in the sub-video. When the number of pixels increases, the resolution can be improved. Exemplarily, whether it is a video frame in a three-dimensional video format or a video frame in a two-dimensional video format, the super-resolution processing is for the sub-video frame in the input video frame. Specifically, in the two-dimensional video format, the object of super-resolution processing is the sub-video frame obtained by segmenting the two-dimensional video frame, and in the three-dimensional video format, the object of super-resolution processing is the sub-video frame of each viewpoint in the three-dimensional video frame.

[0173] No matter the object of super-resolution processing is the sub-video frames obtained after segmenting the two-dimensional video frame, or the sub-video frames of each viewpoint in the three-dimensional video frame, the above two types of sub-video frames can be regarded as an image to be processed and super-resolution processing can be performed on the image to be processed.

[0174] Exemplarily, the pixel expansion may be to perform linear interpolation on the sub-video frame, specifically including: at least one of non-linear interpolation, bilinear interpolation and trilinear interpolation.

[0175] As another example, pixel expansion can be performed using a neural network model, such as inputting a sub-video frame into a restoration model, and improving the resolution of the sub-video frame through the restoration model. The training samples of the restoration model may include multiple image sample pairs, each image sample pair includes a high-resolution image and a low-resolution image of the same image. During the training process, the low-resolution image is input into the restoration model, and a loss function is constructed based on the predicted image and the high-resolution image output by the restoration model. The loss value is obtained based on the loss function, and the parameters of the restoration model are continuously updated based on the loss value, thereby training a restoration model that can perform super-resolution processing on the image.

[0176] As another example, during the pixel expansion process, each sub-video frame to be super-resolution processed can be edge-filled, and the edge-filling process can refer to: expanding the edge of the sub-video frame by n pixels, such as adding n pixels to the four edges of the sub-video frame, and then expanding the sub-video frame after the edge-filling process. In this way, it is possible to avoid jagged edges on the edges of the sub-video frame during pixel expansion, thereby improving the quality of the super-resolution image. In a specific implementation, for each sub-video frame, at least one circle of first pixels can be inserted outside the first edge of the sub-video frame to obtain an intermediate sub-video frame; and the pixels included in each intermediate sub-video frame can be pixel-expanded; wherein the pixel value of the first pixel is a preset value.

[0177] Referring to Figure 7, a schematic diagram of pixel expansion of a sub-video frame is shown. As shown in Figure 7, whether it is a sub-video in a two-dimensional video format or a sub-video for each viewpoint, at least one circle of first pixels can be expanded outside the first edge of the sub-video frame. Specifically, the first edge can refer to the edge of each side of the sub-video frame. As shown in Figure 7, it can refer to the edges of the upper, lower, left, and right edges of the sub-video frame; wherein, at least one circle of first pixels with pixel values ​​of preset values ​​can be supplemented at the edges of the upper, lower, left, and right edges of the sub-video frame. For example, n first pixels adjacent to the pixels at each edge of the sub-video frame are supplemented. When n is 1, one first pixel is supplemented at the edge, and the size of the sub-video frame is expanded outward by one pixel. When n is greater than 1, n first pixels are supplemented at the edge, and the size of the sub-video frame is expanded outward by n pixels.

[0178] The preset value may be 0, that is, a circle of pixels with a pixel value of 0 may be inserted outside the first edge of the sub-video frame. In this way, when pixel expansion is performed later, since the pixel values ​​of the pixels at the edge of the sub-video frame are 0, the jagged phenomenon of the edge may be improved, thereby improving the image quality at the edge.

[0179] In some embodiments, if the video format of the input video frame is a two-dimensional video format, and if the video format of the output video frame is also a two-dimensional video format, a padding operation may be performed before pixel expansion. Specifically, the original input video frame may be padded before segmentation. After the padding, the edges of the input video frame are padded first, and then the input video frame after the padding is segmented. In this way, for the segmented sub-video frames, only the remaining edges need to be padded. Thus, the padding operation can be completed in stages, thereby improving processing efficiency.

[0180] In a specific implementation, at least one circle of second pixels can be inserted outside the second edge of the input video frame to obtain a third video frame, and the third video frame can be segmented to obtain multiple sub-video frames; wherein the pixel value of the second pixel is a preset value, and the first edge is the edge of the sub-video frame except the second edge.

[0181] Referring to FIG8 , a schematic diagram of the process of super-resolution based on edge filling is shown. As shown in FIG8 , at least one circle of second pixels is inserted at the second edge of the input video frame. Specifically, the second edge can be the four edges of the upper, lower, left, and right sides of the input video frame. The number of inserted circles of the second pixel can be one circle or multiple circles. The pixel value of the second pixel can be 0. The edge filling process can refer to the process shown in FIG7 . After the input video frame is edge filled, the size of the input video frame is expanded outward by n pixels. For example, when the input video frame includes 1024 pixels in the length direction, after one circle of edge filling, two pixels are expanded in the length direction and two pixels are expanded in the height direction.

[0182] After the input video frame is padded, the padded input video frame can be segmented, and the segmentation is performed according to the number of display devices and the stitching method; the multiple sub-video frames obtained after the segmentation can be shown in Figure 8, so that for each sub-video frame, according to the segmentation method, part of the edges of some or all of the sub-video frames already have the second pixel for padded, then in order to make the sizes of each sub-video frame consistent, for each sub-video frame, the sub-video frame can be padded on the first edge except the second edge.

[0183] For example, as shown in Figure 8, a circle of second pixels is added outside the edge of the input video frame, and then the input video frame after the edge filling is divided in a grid manner, and the two adjacent second edges of each sub-video frame are supplemented with the second pixels. If the other two adjacent first edges are not supplemented with the second pixels, a circle of first pixels can be supplemented on the other adjacent first edges.

[0184] Among them, Figure 8 shows an example of dividing the input video frame in a grid-like manner. In some other examples, the input video frame may be divided in a nine-square grid or other manner. If the input video frame is divided in a nine-square grid manner, there is a sub-video frame whose four edges are not supplemented with the second pixel. In this case, the first pixel can be supplemented on all four edges of the sub-video frame, so that the sizes of the multiple sub-video frames after the supplementation can be the same.

[0185] The scale of the edge padding of the sub-video frame is consistent with the scale of the edge padding of the input video frame. For example, if n second pixels are added to the four edges of the input video frame, then n first pixels are also added outside the first edge of the sub-video frame. The pixel values ​​of the first pixel and the second pixel are both preset values, such as both 0.

[0186] With this implementation, the input video frame can be initially padded, then the padded input video frame is segmented, and then the multiple sub-video frames obtained after segmentation are padded again. Through the two padded operations, the edges of each sub-video frame are expanded outward by n pixels, thereby improving the image quality of the video frame at the edge.

[0187] Example #3, the display parameters include resolution and video format. When the display parameters include resolution and video format, it means that the input video frame needs to be displayed according to a preset resolution and a preset video format, and both the video format and the resolution of the input video frame need to be processed. The processing method of this example #3 is as follows:

[0188] According to the video format of the input video frame and the video format of the output video frame, it is determined whether the input video frame needs to be format converted, and according to the resolution of the input video frame and the resolution of the output video frame, it is determined whether the resolution of the input video frame needs to be super-resolution processed. Among them, the video processing logic of the input video frame can be set according to whether the input video frame needs to be format converted and whether the resolution of the input video frame needs to be super-resolution processed. Based on the above embodiments, there are several video processing logics as follows:

[0189] The first video processing logic: there is no need to convert the format of the input video frame, but the resolution of the input video frame needs to be super-resolution processed.

[0190] Among them, the video format of the input video frame is a two-dimensional video format, and the video format of the output video frame is also a two-dimensional video format, then the video processing logic can be a segmentation process first and then a super-resolution process, as shown in Figure 9. Figure 9 shows a schematic diagram of the processing process of super-resolution and segmentation of a two-dimensional video. As shown in Figure 9, the input video frame can be segmented in a four-grid manner to obtain four sub-video frames, and then, each sub-video frame is firstly supplemented with edges, such as supplementing a circle of pixels with a pixel value of 0 at the four edges of the sub-video, and then, each of the supplemented sub-video frames is sent to the repair model to obtain an output video frame with a higher resolution.

[0191] Among them, the video format of the input video frame is a three-dimensional video format, and the video format of the output video frame is also a three-dimensional video format, then the video processing logic can be viewpoint segmentation processing first, then super-resolution processing, and then segmentation processing, as shown in Figure 10, Figure 10 shows a schematic diagram of the video processing process for three-dimensional video, as shown in Figure 10, firstly, a sub-video frame of each viewpoint is extracted from the input video frame, then a circle of pixels with a pixel value of 0 is extended at the edge of the sub-video frame of each viewpoint, and then the sub-video frame after the edge filling processing is sent to the repair model to obtain a sub-video frame with higher resolution, then, the sub-video frames of multiple viewpoints output by the repair model are rearranged in pixels, such as the sub-video frames of each viewpoint are segmented according to the number of display devices and the splicing method to obtain pixels in different regional positions, and then, the pixels belonging to the same regional position in multiple viewpoints are combined to obtain an output video frame of a regional position.

[0192] The second video processing logic: the format of the input video frame needs to be converted, and the resolution of the input video frame does not need to be super-resolution processed.

[0193] Among them, the video format of the input video frame is a two-dimensional video format, the video format of the output video frame is a three-dimensional video format, and the resolution of the input video frame is the same as the resolution of the output video frame; then its video processing logic can be a format conversion process first and then a segmentation process, as shown in Figure 3, according to the input video frame and the depth map corresponding to the input video frame, multiple viewpoints and sub-video frames of each viewpoint are restored, so that the input video frame in the two-dimensional video format is converted into a video frame in the three-dimensional video format, and then the sub-video frame of each viewpoint is segmented according to the number of display devices and the splicing method to obtain pixels in different regional positions, and then, the pixels belonging to the same regional position in multiple viewpoints are combined to obtain an output video frame of a regional position.

[0194] Among them, the video format of the input video frame is a three-dimensional video format, and the video format of the output video frame is a two-dimensional video format, then the video processing logic can be viewpoint segmentation processing, format conversion processing and then segmentation processing, as shown in Figure 11, Figure 11 shows a schematic diagram of the processing process of video processing for three-dimensional video, as shown in Figure 11, sub-video frames corresponding to multiple viewpoints can be extracted from the input video frame, a sub-video frame can be understood as an image under a certain perspective, then a sub-video frame of a viewpoint can be extracted, and the extracted sub-video frame of the viewpoint is a video frame in a two-dimensional video format, then, the extracted sub-video frame of the viewpoint is segmented according to the number of display devices and the splicing method to obtain multiple output video frames.

[0195] The third video processing logic: the input video frame needs to be format converted and the resolution of the input video frame needs to be super-resolution processed.

[0196] Among them, the video format of the input video frame is a two-dimensional video format, and the video format of the output video frame is a three-dimensional video format. The video processing logic can be format conversion processing → super-resolution processing → segmentation processing, as shown in Figure 12. Figure 12 shows a schematic diagram of the processing process of performing video processing on a two-dimensional video. As shown in Figure 12, according to the input video frame and the depth map corresponding to the input video frame, multiple viewpoints and sub-video frames of each viewpoint are restored, so that the input video frame in the two-dimensional video format is converted into the first video frame in the three-dimensional video format, and then at least one circle of pixels with a pixel value of 0 is extended outside the edge of the sub-video frame of each viewpoint, and then the sub-video frame of each viewpoint after the edge filling is sent to the repair model to obtain a high-resolution sub-video frame, and then the high-resolution sub-video frame is pixel rearranged to obtain multiple output video frames.

[0197] Among them, the video format of the input video frame is a three-dimensional video format, and the video format of the output video frame is a two-dimensional video format, then the video processing logic can be format conversion processing → segmentation processing → super-resolution processing; as shown in Figure 13, Figure 13 shows a schematic diagram of the processing process of performing video processing on a two-dimensional video. As shown in Figure 13, sub-video frames corresponding to multiple viewpoints can be extracted from the input video frame. A sub-video frame can be understood as an image under a certain perspective, then a sub-video frame of a viewpoint can be extracted, and the extracted sub-video frame of the viewpoint is the first video frame in the two-dimensional video format. Then, the first video frame is segmented according to the number of display devices and the splicing method to obtain multiple sub-video frames; then, the multiple sub-video frames are sent to the restoration model to obtain multiple output video frames with high resolution.

[0198] In some embodiments, after displaying multiple output video frames on multiple display devices, the display parameters of the input video frames may also be adjusted, so that the video format and resolution of the video can be continuously adjusted as needed during the video playback process.

[0199] Among them, in order to adjust the display parameters of the output video frames efficiently, multiple input video frames and output video frames corresponding to the multiple input video frames can be cached, so that the output video frames can be displayed in sequence according to the frame sequence of the output video frames; then, when it is detected that the display parameters are adjusted, the object to be processed can be extracted from the cache first, thereby avoiding the problem of reduced efficiency caused by re-acquiring new input video frames.

[0200] When it is detected that the display parameters are adjusted, it can be determined whether the object of video processing is a cached input video frame or a cached output video frame; that is, it can be determined whether the cached input video frame or the cached output video frame is to be processed. If it is a cached input video frame, the representation will perform video processing on the video frame in the original video according to the process of the above embodiment; if it is a cached output video frame, video processing is performed on the basis of the cached output video frame. Since the cached output video frame has already processed the input video frame according to the display parameters, after the display parameters are adjusted, the video processing of the cached output video frame can be regarded as continuous video processing, and the step of processing the input video frame into the output video frame is omitted, thereby improving the adjustment efficiency.

[0201] In a specific implementation, in response to the adjustment of the display parameters, the adjusted display parameters can be obtained, and based on the changes of the display parameters before and after the adjustment, the target video frame to be adjusted is determined; and the target video frame is processed to obtain a video frame that meets the adjusted display parameters;

[0202] The target video frame is a cached input video frame or a cached output video frame.

[0203] In this embodiment, if the display parameters are adjusted, it can be determined whether there are input video frames and multiple output video frames corresponding to each input video frame cached at the moment the display parameters are detected to be adjusted. If there are cached, the target video frame can be determined from the cached video data. If there are no cached frames, the currently arriving input video frames need to be processed according to the adjusted display parameters.

[0204] When determining the target video frame from the cached video data, the input video frame or the output video frame can be directly taken from the cache as the object to be processed, thereby improving the retrieval efficiency; in the process of processing the cached target video frame, the newly arrived input video frame can be cached. If the target video frame is the output video frame, the newly arrived input video frame can be processed according to the original display parameters, and the video frame obtained after processing is cached as the target video frame, so that the target video frame can be reprocessed according to the new display parameters. In this way, after the display parameters change, the processing change transition of the input video frame can be made smoother, thereby reducing the screen frustration caused by the switching of the display parameters.

[0205] The following describes the changes in display parameters:

[0206] In the first case, the display parameter changes based on user operations, such as when the user sets the display parameter of the input video to change from one display parameter to another, the user can send a display parameter change instruction, which carries the changed display parameter.

[0207] The second case is the change of display parameters based on the change of display device. For example, the input video frame needs to be played on one spliced ​​large screen and switched to another spliced ​​large screen, such as from a 4K spliced ​​large screen to an 8K spliced ​​large screen. The display performance of the display device of the spliced ​​large screen changes, causing the display parameters to change. At this time, when it is detected that the spliced ​​large screen on which the input video frame is to be played changes, it indicates that the display parameters have changed, and the display parameters of the changed spliced ​​large screen can be obtained.

[0208] The third case is the change of the displayed picture of the input video frame based on the video stream. In this case, each input video frame can carry a picture identifier, and the picture identifier is used to indicate whether the picture of this input video frame needs to be blurred. If the picture identifier is 1, it indicates that the picture of the input video needs to be blurred. If the picture identifier is 0, it indicates that the picture of the input video does not need to be blurred. If blurring is required, it means that the resolution of the input video frame needs to change when it is displayed, and then the display parameters also change.

[0209] Based on the changes in display parameters, we can know that the display parameters may change in resolution, video format, or both resolution and video format. They may also represent changes in the number of display devices and the stitching method. Different changes may result in slightly different target video frames.

[0210] Exemplarily, if the change represents a change in resolution, the cached output video frame may be used as the target video frame; if the change represents a change in non-resolution, the cached input video frame may be used as the target video frame.

[0211] Specifically, when the resolution changes, only the resolution needs to be adjusted without adjusting the video format and segmentation processing. The resolution can be adjusted directly on the output video frame, and the target video frame can be the output video frame. In this way, the output video frame can be directly reprocessed to improve the output efficiency of the new output video frame after the display parameters change, thereby avoiding screen stuttering.

[0212] Specifically, if non-resolution changes occur, such as a change in video format or a change in segmentation method, the format needs to be changed starting from the original input video frame, so the target video frame can be a cached input video frame.

[0213] Exemplarily, if the target video frame is a cached output video frame, the resolution of the cached output video frame can be processed according to the adjusted display parameters to obtain an output video frame with changed resolution; if the target video frame is a cached input video frame, at least one image processing can be performed on the cached input video frame according to the display parameters; for example, format conversion processing is performed, and segmentation processing is performed on the video frame obtained after the format conversion processing to obtain multiple new output video frames; wherein the format conversion processing is used to convert the input video frame into a video frame that conforms to the changed video format.

[0214] In this example, if the resolution represented by the display parameter changes, the resolution of the cached output video frame that is not displayed is processed, and the processing may include super-resolution processing and low-resolution processing. The super-resolution processing is used to improve the resolution of the output video frame. For example, the video needs to be played from one spliced ​​large screen to another spliced ​​large screen. The resolution of the transferred spliced ​​large screen is higher. The number of display devices and the splicing method have not changed. Then, the output video frame to be played can be super-resolution processed. The super-resolution processing method can be seen in the process described in the above embodiment, so that a new output video frame is obtained after super-resolution processing, and the new output video frame can be sent to the new spliced ​​large screen for playback.

[0215] For another example, the input video frame to be played in the video carries a picture identifier of 1, and the input video frame to be played needs to be blurred. The target video frame is the output video frame with a picture identifier of 1. In this case, the resolution of the output video frame can be reduced to a preset resolution, and the output video frame can be blurred so that the clarity of the output video frame is reduced due to the lower resolution, thereby protecting the privacy of some pictures in the video. After blurring, a new output video frame is obtained, and the new output video frame is directly displayed on the display device until an output video frame with a picture identifier of 0 is reached, and then the original video processing logic is returned.

[0216] In this example, if the display parameters include a change in the video format, then regardless of whether the resolution changes, the target video frame can be a cached input video frame. For example, the video format of the output video frame changes from 2D to 3D, or from 3D to 2D. At this time, if image processing is performed on the output video frame, the format conversion process needs to be performed on multiple output video frames, and the processing is relatively complex and inefficient; therefore, the input video frame can be image processed according to the changed display parameters. Specifically, the process of performing image processing on the input video frame according to the changed display parameters can be to perform segmentation processing on the video frame obtained after the format conversion process to obtain multiple new output video frames. Specifically, it can be performed with reference to the process described in the above embodiment, which will not be repeated here.

[0217] For example, if a video needs to be played on a large splicing screen and then transferred to another large splicing screen, and the large splicing screen after the transfer is a 3D naked-eye display large screen, which can perform 3D display, while the previous large splicing screen cannot perform naked-eye 3D display, then the video format in the display parameters can be converted from a 2D video format to a 3D video format, and the number and splicing method of the display devices remain unchanged. In this case, the input video frames to be played in the cache can be converted in format according to the 3D video format first, and then segmented, according to the video processing logic shown in FIG11. Alternatively, as shown in FIG13, the input video frames to be played in the cache can be converted in format according to the 3D video format first, and then super-resolution processing is performed, and then segmentation processing is performed.

[0218] For another example, if a video needs to be played on a large splicing screen and then transferred to another large splicing screen, and the large splicing screen after the transfer is a 2D naked-eye display screen, while the previous large splicing screen can be used for naked-eye 3D display, then the video format in the display parameters can be converted from a 3D video format to a 2D video format, and the number and splicing method of the display devices remain unchanged. In this case, the input video frames to be played in the cache can be converted to a 2D video format first, and then segmented, according to the video processing logic shown in FIG12. Alternatively, as shown in FIG10, the input video frames to be played in the cache can be converted to a 2D video format first, and then segmented, and then super-resolution processed.

[0219] Exemplarily, if the display parameters include changes in the number of display devices or the splicing method, indicating that the spliced ​​large screen being played has changed and the segmentation processing of the input video frame needs to be changed accordingly, the cached input video frame to be played can be used as the target video frame, and then the target video frame is processed according to the process described in the above embodiment.

[0220] Based on the same inventive concept, the present disclosure also provides a video processing system, as shown in FIG14 , which shows a schematic diagram of the framework structure of the video processing system. As shown in FIG14 , the video processing system is used to execute the above-mentioned video processing method. Specifically, it may include a scheduling unit, an image processing unit, and a display unit:

[0221] Wherein, the scheduling unit is used to schedule the input video frame to the image processing unit;

[0222] An image processing unit, configured to process the input video frame into a plurality of output video frames based on display parameters of the input video frame when displayed, wherein one output video frame corresponds to a partial area on the input video frame, and the display parameters include at least one of a video format and a resolution;

[0223] The display unit is used to display the multiple output video frames on multiple display devices respectively, so that the output video frames are displayed according to the display parameters.

[0224] In this embodiment, the display unit can be a monitoring host connected to each display device. Each display device is connected to a monitoring host. The display unit can send multiple output video frames to multiple monitoring hosts respectively, and the monitoring host will display the received output video frames on the display device.

[0225] The description of the input video frame and the display parameters may refer to the description in the video processing method embodiment, which will not be repeated here.

[0226] By adopting the technical solution of this embodiment, since the image processing unit divides the input video into multiple output video frames according to the display parameters, the display unit can split the input video frame and display it on multiple display devices, thereby realizing the display of the split video. Among them, since the display parameters include at least one of the video format and the resolution, when the video is split and displayed, the input video frame can be processed into a video frame that meets the expected video format, or a video frame that meets the expected resolution, or a video frame that meets both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters, thereby making multiple display devices adapt to multiple videos, achieving the effect of universal playback of multiple videos.

[0227] Referring to Figure 15, there is shown a schematic diagram of the framework structure of another video processing system disclosed in the present invention. As shown in Figure 15, the video processing system may also include multiple playback components, the playback components include multiple display devices, and the multiple display devices are spliced ​​with each other; wherein the display unit is used to send multiple output video frames to at least one playback component respectively, so that the playback component displays the multiple output video frames on multiple display devices respectively.

[0228] Specifically, a plurality of display devices are spliced ​​together to obtain a spliced ​​large screen, wherein the playback component may also include the above-mentioned monitoring host, as shown in FIG1 , each playback component may include: a plurality of monitoring hosts, and a display device connected to each monitoring host; that is, a playback component is used to splice and display video frames.

[0229] Each playback component is connected to the image processing unit, and an input video frame can be spliced ​​and displayed on at least one playback component. For example, as shown in FIG15, after the input video frame is processed into multiple output video frames according to the display parameters, the multiple output video frames can be sent to at least one playback component at the same time, so that at least one playback component can obtain multiple output video frames at the same time, so that the video can be displayed on multiple spliced ​​large screens at the same time.

[0230] Exemplarily, the display performances of multiple playback components and the number of spliced ​​display devices may be different, and the display performance may include the physical resolution and display capability of the display devices in the playback components. The display capability may refer to 3D display capability and 2D display capability. As mentioned above, if a display device is a naked-eye 3D display device, it can display the video to be displayed in naked-eye 3D, and the user can watch the stereoscopic video without the help of auxiliary viewing tools; if a display device does not have naked-eye 3D display capability, it has 2D display capability. When the video to be displayed is a 3D video, the display device can only display it in 2D, and the user needs to use auxiliary viewing tools, such as 3D glasses, to watch the stereoscopic video.

[0231] Wherein, the number of spliced ​​display devices is different, and the number of output video frames that need to be segmented from the input video frame is different, and the segmentation method is also different.

[0232] Accordingly, the display parameters of the input video frame when being displayed can be determined based on the display performance of the display device in the playback component and the number of spliced ​​display devices. For example, if the physical resolution of the display device is high and has 3D display capability, the display parameters can be used to indicate that the input video frame is converted into a 3D video and the resolution of the input video frame is increased. For another example, if the physical resolution of the display device is high and does not have 3D display capability, the display parameters can be used to indicate that the resolution of the input video frame is increased. For another example, if the physical resolution of the display device is high and does not have 3D display capability, the display parameters can also be used to indicate that the resolution of the input video frame is increased and the input video frame is converted into a 3D video.

[0233] Among them, the display parameters corresponding to the playback components with different numbers of display devices are also different.

[0234] Thus, the display parameters corresponding to the multiple playback components may be different. As described in the above-mentioned embodiment of the video processing method, the video processing logic for performing video processing on the input video frame may be determined in combination with the input parameters and display parameters of the input video, including the first video processing logic, the second video processing logic, and the third video processing logic. When the display parameters corresponding to the multiple playback components are different, when the same input video frame needs to be displayed in multiple playback components, the video processing logic for the multiple playback components will be different.

[0235] In order to cope with the differences between playback components, a video processing system may include multiple image processing units, and different image processing units may correspond to playback components spliced ​​by different numbers of display devices, and / or to playback components spliced ​​by display devices with different display performances. Specifically, different image processing units may correspond to different numbers of display devices, or to playback components spliced ​​by display devices with different display performances; or, they may correspond to both different numbers of display devices and playback components spliced ​​by display devices with different display performances.

[0236] Correspondingly, when the same input video frame is input into the video processing system, at least one target playback component for displaying the input video frame can be determined, and the input video frame can be sent to an image processing unit corresponding to at least one of the target playback components, so that the input video frame is processed in the image processing unit.

[0237] For example, if different image processing units correspond to playback components composed of different numbers of display devices, then one image processing unit is for playback components composed of the same number of display devices; if different image processing units correspond to playback components composed of display devices with different display performances, then one image processing unit is for playback components composed of display devices with the same display performance. In this case, different image processing units may have different video processing logic for the input video frames.

[0238] For example, as shown in Figure 15, four groups of playback components are included, among which playback component A and playback component B each include four display devices, and the display performance of the eight display devices is the same, such as 8K spliced ​​large screens, then the playback component A and playback component B correspond to the same image processing unit 1; playback component C includes three display devices, and the three display devices can all realize naked-eye 3D display, then the playback component C corresponds to image processing unit 2; playback component D includes nine display devices, then the playback component D corresponds to image processing unit 3.

[0239] When a video needs to be played on playback component A, playback component B and playback component C, the scheduling unit will send the input video frames in the video to image processing unit 1 and image processing unit 2. Image processing unit 1 will process the input video frames according to the first video processing logic mentioned above, and send the output multiple output video frames to playback component A and playback component B at the same time; image processing unit 2 will process the input video frames according to the second video processing logic or the third video processing logic mentioned above, and send the output multiple output video frames to playback component C at the same time.

[0240] In some embodiments, the image processing unit may include multiple image processing modules, and different image processing modules are used to perform different image processing. The multiple image processing modules may include at least a segmentation module and a super-resolution module.

[0241] As described above, when the input video frame is processed based on the input parameters and display parameters, different combinations of input parameters and display parameters may have different video processing logics, and under different video processing logics, the image processing to be performed and the execution order between the image processing are different. In this case, the scheduling unit can be used to determine at least one target image processing module to be scheduled among multiple image processing modules, and the execution order between the target image processing modules based on the input parameters and display parameters of the input video frame; and to schedule the video frame processed by the previous target image processing module to the next target image processing module according to the execution order during the scheduling process; wherein the scheduled target image processing module includes a segmentation module, and the segmentation module is used to segment the video frame input to the segmentation module into multiple sub-video frames, and the multiple sub-video frames correspond to multiple output video frames respectively.

[0242] Referring to Figure 16, there is shown a schematic diagram of the framework structure of another video processing system disclosed in the present invention. As shown in Figure 16, an image processing unit includes multiple image processing modules, and different image processing modules are used to perform different image processing. When an input video frame arrives, the corresponding video processing logic can be determined according to the display parameters and the input parameters. According to the video processing logic, the target image processing module to be scheduled and the execution order between the target image processing modules are determined, wherein the execution order between the target image processing modules represents the execution order between the image processing.

[0243] Exemplarily, when the video format of the input video frame is different from the video format of the output video frame, the input video frame needs to be format converted. If super-resolution processing is not required, the target image processing module includes a format conversion module and a segmentation module; wherein the scheduling order of the format conversion module is before the segmentation module, and the format conversion module is used to convert the input video frame into a video frame that conforms to the video format in the display parameters.

[0244] For example, taking the second video processing logic mentioned above as an example, if the input video frame needs to be format converted and segmented, the format conversion can be performed online and then the segmentation can be performed. When scheduling, the scheduling unit can first schedule the input video frame to the format conversion module, and then schedule the output of the format conversion module to the segmentation module.

[0245] In another exemplary embodiment, the display parameters include video format and resolution. When the resolution of the input video frame is lower than the resolution of the output video frame, the target image processing module further includes a super-resolution module; the super-resolution module is used to perform pixel expansion on the video frame input to the super-resolution module; wherein:

[0246] The scheduling unit is further used to determine the execution order between the super-resolution module and the segmentation module based on the video format of the input video frame;

[0247] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a three-dimensional video format, the execution order of the super-resolution module is superior to that of the segmentation module;

[0248] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a two-dimensional video format, the execution order of the super-resolution module lags behind that of the segmentation module.

[0249] Taking the first video processing logic as an example, it is not necessary to convert the format of the input video frame, but it is necessary to perform super-resolution processing and segmentation processing on the input video frame. The execution order of the super-resolution processing and the segmentation processing can be determined according to the format of the input video frame. As shown in Figure 9, if the input video frame is in a 2D video format, it can be determined that the execution order of the segmentation module is higher than the execution order of the super-resolution module. When scheduling, the scheduling unit can first schedule the input video frame to the segmentation module, and then schedule the output of the segmentation module to the super-resolution module. As shown in Figure 10, if the input video frame is in a 3D video format, it can be determined that the execution order of the super-resolution module is higher than the execution order of the segmentation module. When scheduling, the scheduling unit can first schedule the input video frame to the super-resolution module, and then schedule the output of the segmentation module to the segmentation module.

[0250] In another exemplary embodiment, the segmentation module includes a first segmentation module and a second segmentation module; wherein the first segmentation module is used to perform image segmentation on the video frame of the input two-dimensional video according to the splicing mode of multiple display devices;

[0251] Among them, the second segmentation module is used to extract the sub-video frame belonging to each viewpoint from the video frame of the input three-dimensional video, and divide the multiple pixels in the sub-video frame of each viewpoint according to the splicing method of multiple display devices to obtain the pixels included in different area positions of each viewpoint; and splice the pixels belonging to the same area position in multiple viewpoints.

[0252] Among them, the segmentation module may include a first segmentation module corresponding to the video frame in the two-dimensional video format, and a second segmentation module corresponding to the video frame in the three-dimensional video format, wherein the processing method of the video frame by the first segmentation module can be shown in Figure 9, and the processing method of the video frame by the second segmentation module can be shown in Figure 10, that is, the scheduling unit can schedule the video frame in the two-dimensional video format to be processed to the first segmentation module, and schedule the video frame in the three-dimensional video format to the second segmentation module.

[0253] Exemplarily, when the output video frame is in a three-dimensional video format and the input video frame is in a two-dimensional video format, the format conversion module is used to generate sub-video frames of multiple different viewpoints of the input video frame based on the input video frame and a depth map corresponding to the input video frame, and the sub-video frame of each viewpoint includes pixels at multiple positions of the viewpoint.

[0254] Also exemplarily, the super-resolution module includes a first super-resolution module and a second super-resolution module; wherein: the first super-resolution module is used to insert at least one circle of preset pixels at the edge of the input video frame, and the pixel value of the preset pixels is a preset value; the second super-resolution module is used to perform the pixel expansion on the video frame output by the first super-resolution module.

[0255] As described in the above embodiment, when the input video frame is in a two-dimensional video format and the output video frame is also in a two-dimensional video format, if super-resolution processing is required, the input video frame can be padded first, and after the padded input video frame is segmented, the segmented sub-video frame can be padded again, that is, it includes two padded times. The padded input video frame can be performed by the first super-resolution module, and the padded sub-video frame can be performed by the second super-resolution module. The scheduling unit can first schedule the input video frame to the first super-resolution module, and then schedule the output of the first super-resolution module to the segmentation module, and then schedule the output of the segmentation module to the second super-resolution module, and the output of the second super-resolution module is scheduled to the display unit.

[0256] For example, as shown in FIG16, taking the input video frame that needs to be played on playback component A and playback component C as an example, playback component A and playback component C correspond to different display parameters, and thus correspond to different video processing logics. As shown by the solid arrow in FIG16, playback component A corresponds to the first video processing logic, and the scheduling unit schedules the input video frame to the first super-resolution module, and the input video frame is padded by the first super-resolution module. Then, the padded input video frame output by the first super-resolution module is scheduled to the segmentation module, and the segmentation module segments the input video frame in a four-grid manner to obtain four sub-video frames. Then, the scheduling unit schedules the four sub-video frames to the second super-resolution module, and the second super-resolution module increases the resolution of the sub-video frame and outputs it, and the output multiple output video frames are sent to playback component A.

[0257] As shown by the dotted arrow in Figure 16, the playback component C corresponds to the third video processing logic. As shown by the dotted arrow in the figure, the scheduling unit schedules the input video frame to the format conversion module, and the format conversion module restores multiple viewpoints and sub-video frames of each viewpoint according to the input video frame and the depth map corresponding to the input video frame; then, the scheduling unit schedules the sub-video frames of multiple viewpoints to the second super-resolution module, and the second super-resolution module extends the edge of the sub-video frame of each viewpoint by at least one circle of pixels with a pixel value of 0, and then sends the sub-video frames of each viewpoint after the edge filling to the restoration model to obtain high-resolution sub-video frames; thereafter, the scheduling unit schedules the sub-video frames of multiple viewpoints output by the second super-resolution module to the segmentation module, and the segmentation module rearranges the pixels of the high-resolution sub-video frames to obtain multiple output video frames, and the output multiple output video frames are sent to the playback component C.

[0258] Referring to Figure 17, a structural diagram of another video processing system is shown. As shown in Figure 17, in an optional example of this embodiment, a detection module may also be included. The detection module can be used to detect changes in the playback component to be displayed in the input video frame, changes in the screen identifier of the input video frame, and to monitor whether a parameter change instruction is received. If a change in the playback component is detected, the changed display parameters are generated according to the display performance, quantity and splicing method of the display device in the changed playback component; if a change in the screen identifier of the input video frame is detected, the changed display parameters are generated according to the current changed screen identifier. In this case, if the screen identifier changes from 0 to 1, the resolution in the display parameters changes from low resolution to high resolution, and if the screen identifier changes from 1 to 0, the resolution in the display parameters changes from high resolution to low resolution.

[0259] If a change instruction is detected and received, the display parameter carried in the change instruction is used as the changed display parameter.

[0260] In this case, the scheduling unit can compare the changes in display parameters before and after the change. If the resolution changes, the output video frame to be played can be extracted from the cache module, and the output video frame can be scheduled to the second super-resolution module to increase the resolution, or scheduled to the low-resolution processing module to reduce the resolution; if the video format changes, the input video frame to be played can be extracted from the cache module, and the input video frame can be scheduled to the format conversion module, and then subsequent video scheduling can be performed according to the corresponding video processing logic.

[0261] Based on the same inventive concept, the present disclosure also provides a video playback system, including a video processing module and a display module connected to the video processing module, wherein the display module is obtained by splicing multiple display devices, wherein multiple display modules may be included, and the video processing module can be used to execute the above-mentioned video processing method.

[0262] Based on the same inventive concept, the present disclosure further provides a video processing device, as shown in FIG. 18 , which shows a schematic diagram of the framework of the video processing device. As shown in FIG. 18 , the device can be located in the video processing module of the above-mentioned video playback system, and specifically includes the following modules:

[0263] A parameter acquisition module, used to acquire an input video frame and display parameters of the input video frame when it is displayed, wherein the display parameters include at least one of a video format and a resolution;

[0264] A processing module, configured to process the input video frame into a plurality of output video frames based on the display parameter, wherein one of the output video frames corresponds to a partial area of ​​the input video frame;

[0265] The display module is used to display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters.

[0266] Optionally, the processing module includes:

[0267] An input parameter acquisition unit, used to acquire input parameters of the input video frame, wherein the input parameters include at least one of a video format and a resolution;

[0268] An image processing unit, configured to perform at least one image processing on the input video frame in sequence based on the input parameter and the display parameter; wherein the image processing includes segmentation processing, and the segmentation processing is configured to segment the current video frame into a plurality of sub-video frames;

[0269] Optionally, the image processing unit specifically includes:

[0270] A first processing unit, configured to perform a format conversion process on the input video frame when the video format is different from the video format of the input video frame, wherein the format conversion process is used to convert the input video frame into a first video frame that conforms to the video format in the display parameter;

[0271] The second processing unit is used to perform the segmentation process on the first video frame to obtain a plurality of output video frames.

[0272] Optionally, the input video frame is in a two-dimensional video format, and the video format of the output video frame is in a three-dimensional video format. The first processing unit is specifically used to obtain a depth map corresponding to the input video frame; and, based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, generate sub-video frames corresponding to multiple viewpoints, respectively, and the sub-video frames corresponding to the multiple viewpoints include pixels of the viewpoints at multiple positions.

[0273] Optionally, the first video frame includes multiple viewpoints and pixels of each viewpoint at multiple positions; the second processing unit is specifically used to divide the multiple pixels included in each viewpoint according to the splicing method of the multiple display devices, so as to obtain the pixels included in different regional positions of each viewpoint; and, to splice the pixels belonging to the same regional position in the multiple viewpoints, so as to obtain output video frames corresponding to the multiple regional positions respectively.

[0274] Optionally, the display parameter includes the resolution, at least one of the image processing further includes super-resolution processing, and the image processing unit includes:

[0275] an order determination subunit, configured to determine, when the resolution of the output video frame is higher than the resolution of the input video frame, an execution order between the segmentation process and the super-resolution process based on a video format of the output video frame; wherein the super-resolution process is used to improve the resolution of the input video frame;

[0276] The third processing unit is used to perform the super-resolution processing on the input second video frame according to the resolution of the output video frame when the execution order of the super-resolution processing arrives; wherein the second video frame is the input video frame, or the sub-video frame.

[0277] Optionally, the order determination subunit is specifically used to determine that the execution order of the segmentation processing takes precedence over the execution order of the super-resolution processing if the video format of the output video frame is a two-dimensional video format; if the video format of the output video frame is a three-dimensional video format, then determine that the execution order of the segmentation processing lags behind the execution order of the super-resolution processing.

[0278] Optionally, the video format of the output video frame is a three-dimensional video format, the execution order of the segmentation processing lags behind the execution order of the super-resolution processing, and the third processing unit is used to extract sub-video frames belonging to each viewpoint from the second video frame, and the sub-video frame of each viewpoint includes pixels at multiple positions; and to perform pixel expansion on the pixels in the sub-video frames of each viewpoint; wherein the segmentation processing is used to rearrange the pixels in the sub-video frames of the multiple viewpoints after the pixel expansion according to the splicing method of the multiple display devices to obtain the output video frame.

[0279] Optionally, the execution order of the segmentation processing takes precedence over the execution order of the super-resolution processing, and the third processing unit is used to perform pixel expansion on the pixels included in each sub-video frame of the multiple sub-video frames to obtain output video frames corresponding to each sub-video frame.

[0280] Optionally, the step of performing pixel expansion includes: for each of the sub-video frames, inserting at least one circle of first pixels outside the first edge of the sub-video frame to obtain an intermediate sub-video frame; wherein the pixel value of the first pixel is a preset value; and performing pixel expansion on the pixels included in each of the intermediate sub-video frames.

[0281] Optionally, the video format of the input video frame is a two-dimensional video format, and the device further includes:

[0282] A first edge-filling module is used to insert at least one circle of second pixels outside the second edge of the input video frame to obtain a third video frame; wherein the pixel value of the second pixel is a preset value;

[0283] The second processing unit is specifically configured to perform the segmentation process on the third video frame to obtain a plurality of sub-video frames; wherein the first edge is an edge in the sub-video frame except the second edge.

[0284] Optionally, the input video frame includes a plurality of frames, and the device further includes:

[0285] A cache module, used for caching the plurality of input video frames and the output video frames respectively corresponding to the plurality of input video frames, so as to sequentially display the output video frames according to the frame sequence of the output video frames;

[0286] a change determination module, configured to determine, in response to an adjustment operation on the display parameter, a target video frame to be adjusted based on a change of the display parameter before and after the adjustment; wherein the target video frame is a cached input video frame or a cached output video frame;

[0287] The post-processing module is used to process the target video frame to obtain a video frame that meets the adjusted display parameters.

[0288] Optionally, the change determination module is used to use the cached output video frame as the target video frame when the change represents that the resolution has changed; wherein the cached output video frame is the output video frame to be displayed at the current moment;

[0289] And, in a case where the change represents a change other than a resolution change, the buffered input video frame is used as the target video frame.

[0290] Optionally, the post-processing module is specifically configured to, if the target video frame is the output video frame, process the resolution of the cached output video frame according to the adjusted display parameters to obtain an output video frame with a changed resolution; if the target video frame is the input video frame, perform format conversion processing on the cached input video frame, and perform the segmentation processing on the video frame obtained after the format conversion processing to obtain multiple new output video frames;

[0291] The format conversion process is used to convert the buffered input video frames into video frames that conform to the changed video format.

[0292] The embodiment of the video processing device of this embodiment is similar to the embodiment of the video processing method described above. The relevant parts may refer to the embodiment of the video processing method described above, which will not be described in detail here.

[0293] The embodiment of the present disclosure also provides an electronic device, the computer program stored in the electronic device enables a processor to execute the video processing method as described in the embodiment of the present disclosure.

[0294] The embodiment of the present disclosure further provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the video processing method as described in the embodiment of the present disclosure.

[0295] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0296] Finally, it should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, commodity or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, commodity or device including the elements.

[0297] The above is a detailed introduction to a video processing method and system, a video playback system, a device, equipment and a medium provided by the present disclosure. Specific examples are used in this article to illustrate the principles and implementation methods of the present disclosure. The description of the above embodiments is only used to help understand the method of the present disclosure and its core idea. At the same time, for a person skilled in the art, according to the idea of ​​the present disclosure, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present disclosure.

[0298] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. The present disclosure is intended to cover any variations, uses or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The description and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are indicated by the following claims.

[0299] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

[0300] References herein to "one embodiment," "embodiment," or "one or more embodiments" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment is included in at least one embodiment of the present disclosure. In addition, please note that examples of the term "in one embodiment" do not necessarily all refer to the same embodiment.

[0301] In the description provided herein, a large number of specific details are described. However, it is understood that the embodiments of the present disclosure can be practiced without these specific details. In some instances, well-known methods, structures and techniques are not shown in detail so as not to obscure the understanding of this description.

[0302] In the claims, any reference signs placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of elements or steps not listed in the claims. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present disclosure may be implemented by means of hardware comprising a number of different elements and by means of a suitably programmed computer. In a unit claim enumerating a number of means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third, etc. does not indicate any order. These words may be interpreted as names.

[0303] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present disclosure.

Claims

A video processing method, characterized in that: The method includes: obtaining an input video frame and display parameters of the input video frame when displayed, wherein the display parameters include at least one of a video format and a resolution; based on the display parameters, processing the input video frame into multiple output video frames, wherein one output video frame corresponds to a partial area of ​​the input video frame; and displaying the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters. The method according to claim 1, characterized in that The method of processing the input video frame into multiple output sub-video frames based on the display parameters includes: obtaining input parameters of the input video frame, wherein the input parameters include at least one of a video format and a resolution; performing at least one image processing on the input video frame in sequence based on the input parameters and the display parameters; wherein the image processing includes a segmentation processing, wherein the segmentation processing is used to segment the current video frame into multiple sub-video frames; wherein the multiple sub-video frames correspond to multiple output video frames respectively, and the current video frame is the input video frame, or is a video frame obtained after the input video frame is subjected to image processing other than the segmentation processing. The method according to claim 2, characterized in that The input parameters include the video format; based on the input parameters and the display parameters, at least one image processing is performed on the video frame in sequence, including: when the video format is different from the video format of the input video frame, format conversion processing is performed on the input video frame, and the format conversion processing is used to convert the input video frame into a first video frame that conforms to the video format in the display parameters; and the segmentation processing is performed on the first video frame to obtain a plurality of output video frames. The method according to claim 3, characterized in that The input video frame is in a two-dimensional video format, the output video frame is in a three-dimensional video format, and the format conversion processing of the input video frame includes: obtaining a depth map corresponding to the input video frame; based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, generating sub-video frames corresponding to multiple viewpoints respectively, wherein each sub-video frame corresponding to the viewpoint includes pixels of the viewpoint at multiple positions. The method according to claim 3, characterized in that The first video frame includes multiple viewpoints and pixels of each viewpoint at multiple positions; the segmentation process is performed on the first video frame to obtain multiple output video frames, including: dividing the multiple pixels included in each viewpoint according to the splicing method of the multiple display devices to obtain pixels included in different regional positions of each viewpoint; and splicing the pixels belonging to the same regional position in the multiple viewpoints to obtain output video frames corresponding to the multiple regional positions respectively. The method according to claim 2, characterized in that The display parameters include the resolution, at least one of the image processing also includes super-resolution processing, and based on the input parameters and the display parameters, at least one image processing is performed on the video frame in sequence, including: when the resolution of the output video frame is higher than the resolution of the input video frame, based on the video format of the output video frame, determining the execution order between the segmentation processing and the super-resolution processing; wherein the super-resolution processing is used to improve the resolution of the input video frame; when the execution order of the super-resolution processing arrives, the super-resolution processing is performed on the input second video frame according to the resolution of the output video frame; wherein the second video frame is the input video frame, or the sub-video frame. The method according to claim 6, characterized in that The step of determining the execution order between the segmentation processing and the super-resolution processing based on the video format of the output video frame includes: if the video format of the output video frame is a two-dimensional video format, determining that the execution order of the segmentation processing takes precedence over the execution order of the super-resolution processing; and if the video format of the output video frame is a three-dimensional video format, determining that the execution order of the segmentation processing lags behind the execution order of the super-resolution processing. The method according to claim 6, characterized in that The video format of the output video frame is a three-dimensional video format, the execution order of the segmentation processing lags behind the execution order of the super-resolution processing, and the super-resolution processing of the input second video frame includes: extracting sub-video frames belonging to each viewpoint from the second video frame, and the sub-video frame of each viewpoint includes pixels at multiple positions; pixel expansion is performed on the pixels in the sub-video frames of each viewpoint; wherein the segmentation processing is used to rearrange the pixels in the sub-video frames of the multiple viewpoints after the pixel expansion according to the splicing method of the multiple display devices to obtain the output video frame. The method according to claim 6, characterized in that The video format of the output video frame is a two-dimensional video format, the execution order of the segmentation processing takes precedence over the execution order of the super-resolution processing, and the super-resolution processing of the input second video frame includes: for each sub-video frame in the multiple sub-video frames, pixel expansion of the pixels included in the sub-video frame is performed to obtain output video frames corresponding to each sub-video frame. The method according to claim 8 or 9, characterized in that The pixel expansion includes: for each of the sub-video frames, inserting at least one circle of first pixels outside the first edge of the sub-video frame to obtain an intermediate sub-video frame; wherein the pixel value of the first pixel is a preset value; and performing the pixel expansion on the pixels included in each of the intermediate sub-video frames. The method according to claim 10, characterized in that The video format of the input video frame is a two-dimensional video format. Before the pixel expansion is performed, the method also includes: inserting at least one circle of second pixels outside the second edge of the input video frame to obtain a third video frame; wherein the pixel value of the second pixel is a preset value; performing the segmentation process on the third video frame to obtain a plurality of sub-video frames; wherein the first edge is an edge in the sub-video frame excluding the second edge. The method according to claim 1, characterized in that The input video frames include multiple frames, and the method further includes: caching the multiple input video frames and the output video frames corresponding to the multiple input video frames, so as to display the output video frames in sequence according to the frame sequence of the output video frames; the method further includes: in response to the adjustment operation of the display parameters, based on the changes of the display parameters before and after the adjustment, determining the target video frame to be adjusted; wherein the target video frame is the cached input video frame or the cached output video frame; the target video frame is processed to obtain a video frame that meets the adjusted display parameters. The method according to claim 12, characterized in that Based on the change of the display parameters before and after the adjustment, a target video frame to be adjusted is determined, including: when the change represents a change in the resolution, the cached output video frame is used as the target video frame; wherein the cached output video frame is the output video frame to be displayed at the current moment; when the change is other changes except the resolution change, the cached input video frame is used as the target video frame. The method according to claim 12, characterized in that The processing of the target video frame to obtain a video frame that meets the adjusted display parameters includes: if the target video frame is the output video frame, processing the resolution of the cached output video frame according to the adjusted display parameters to obtain an output video frame with a changed resolution; if the target video frame is the cached input video frame, processing the cached input video frame into multiple new output video frames based on the adjusted display parameters. A video processing system, characterized in that: include: Scheduling unit, image processing unit and display unit; The scheduling unit is used to schedule the input video frame to the image processing unit; the image processing unit is used to process the input video frame into multiple output video frames based on display parameters of the input video frame when displayed, wherein one output video frame corresponds to a partial area on the input video frame, and the display parameters include at least one of a video format and a resolution; the display unit is used to display the multiple output video frames on multiple display devices respectively, so that the output video frames are displayed according to the display parameters. The system according to claim 15, characterized in that The image processing unit includes a plurality of image processing modules; the scheduling unit is used to determine at least one target image processing module to be scheduled among the plurality of image processing modules, and an execution order between the target image processing modules based on the input parameters of the input video frame and the display parameters; And, it is used to schedule the video frame processed by the previous target image processing module to the next target image processing module according to the execution order during the scheduling process; wherein the scheduled target image processing module includes a segmentation module, and the segmentation module is used to segment the video frame input to the segmentation module into multiple sub-video frames; wherein the multiple sub-video frames respectively correspond to the multiple output video frames. The system according to claim 16, characterized in that When the video format of the input video frame is different from the video format of the output video frame, the target image processing module includes a format conversion module and the segmentation module; wherein the scheduling order of the format conversion module is located before the segmentation module, and the format conversion module is used to convert the input video frame into a video frame that conforms to the video format in the display parameters. The system according to claim 16, characterized in that In the case where the resolution of the input video frame is lower than the resolution of the output video frame, the target image processing module also includes a super-resolution module; the super-resolution module is used to perform pixel expansion on the video frame input to the super-resolution module; wherein: the scheduling unit is also used to determine the execution order between the super-resolution module and the segmentation module based on the video format of the output video frame; wherein, in the case where the video format of the output video frame is a three-dimensional video format, the execution order of the super-resolution module is superior to that of the segmentation module; in the case where the video format of the output video frame is a two-dimensional video format, the execution order of the super-resolution module lags behind that of the segmentation module. The system according to claim 18, characterized in that The segmentation module includes a first segmentation module and a second segmentation module; wherein the first segmentation module is used to perform image segmentation on the video frame of the input two-dimensional video according to the splicing method of multiple display devices; the second segmentation module is used to extract the sub-video frame belonging to each viewpoint from the video frame of the input three-dimensional video, and divide the multiple pixels in the sub-video frame of each viewpoint according to the splicing method of multiple display devices to obtain the pixels included in different regional positions of each viewpoint; and splice the pixels belonging to the same regional position in multiple viewpoints. The system according to claim 16, characterized in that When the output video frame is in a three-dimensional video format and the input video frame is in a two-dimensional video format, the format conversion module is used to generate sub-video frames of multiple different viewpoints of the input video frame based on the input video frame and a depth map corresponding to the input video frame, and each of the sub-video frames of the viewpoint includes pixels at multiple positions of the viewpoint. The system according to claim 17, characterized in that The super-resolution module includes a first super-resolution module and a second super-resolution module; wherein: the first super-resolution module is used to insert at least one circle of preset pixels at the edge of the input sub-video frame, and the pixel value of the preset pixels is a preset value; the second super-resolution module is used to perform the pixel expansion on the sub-video frame output by the first super-resolution module. The system according to any one of claims 15 to 21, characterized in that: The system includes multiple playback components, each of which includes multiple display devices, and the multiple display devices are spliced ​​together; wherein the display unit is used to send multiple output video frames to at least one playback component respectively, so that the playback component displays the multiple output video frames on multiple display devices respectively. The system according to claim 22, characterized in that It includes multiple image processing units; wherein different image processing units correspond to playback components spliced ​​by different numbers of display devices, and / or correspond to playback components spliced ​​by display devices with different display performances; the scheduling unit is specifically used to send the input video frame to the image processing units corresponding to at least one target playback component to be displayed by the input video frame. A video playback system, characterized in that: It comprises a video processing module and a display module connected to the video processing module, wherein the display module is obtained by splicing a plurality of display devices; wherein the video processing module is used to execute the video processing method described in any one of claims 1-14. A video processing device, characterized in that: include: A parameter acquisition module, used to acquire an input video frame and display parameters of the input video frame when it is displayed, wherein the display parameters include at least one of a video format and a resolution; a processing module, used to process the input video frame into a plurality of output video frames based on the display parameters, wherein one of the output video frames corresponds to a partial area of ​​the input video frame; The display module is used to display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes, the video processing method according to any one of claims 1 to 14 is implemented. A computer-readable storage medium, characterized in that The computer program stored therein enables the processor to execute the video processing method as described in any one of claims 1-14.

Images