Video processing method, system and apparatus, video playing system, device, and medium

Abstract

A video processing method, system and apparatus, a video playing system, a device, and a medium, which belong to the technical field of video processing. The method comprises: acquiring an input video frame and a display parameter of the input video frame when displayed, wherein the display parameter comprises at least one of a video format and resolution; processing the input video frame into a plurality of output video frames on the basis of the display parameter, wherein one output video frame corresponds to a partial region of the input video frame; and respectively displaying the plurality of output video frames on a plurality of display devices, such that the plurality of output video frames are displayed according to the display parameter.

Description

Video processing method and system, video playback system, device, equipment and medium Technical Field

[0001] The present disclosure relates to the field of video processing technology, and in particular to a video processing method and system, a video playback system, a device, equipment, and a medium. Background Art

[0002] With the rise of Internet and multimedia technologies, various videos are often played on terminals, such as advertisements, TV series, promotional information, and monitoring videos. In media management scenarios, a video is split and displayed on multiple display devices, with different display devices playing different split frames of the video.

[0003] Overview

[0004] The present disclosure provides a video processing method, the method comprising:

[0005] Acquire an input video frame and display parameters of the input video frame when displayed, wherein the display parameters include at least one of a video format and a resolution;

[0006] Based on the display parameters, processing the input video frame into a plurality of output video frames, wherein one of the output video frames corresponds to a partial area of ​​the input video frame;

[0007] The plurality of output video frames are displayed on a plurality of display devices respectively, so that the plurality of output video frames are displayed according to the display parameters.

[0008] Exemplarily, processing the input video frame into a plurality of output sub-video frames based on the display parameter includes:

[0009] Acquire input parameters of the input video frame, wherein the input parameters include at least one of a video format and a resolution;

[0010] Based on the input parameters and the display parameters, sequentially performing at least one image processing on the input video frame; wherein the image processing includes a segmentation process, and the segmentation process is used to segment the current video frame into a plurality of sub-video frames;

[0011] The plurality of sub-video frames correspond to the plurality of output video frames respectively, and the current video frame is the input video frame, or is a video frame obtained after the input video frame is subjected to image processing other than the segmentation processing.

[0012] Exemplarily, the input parameter includes the video format; and the performing at least one image processing on the video frame in sequence based on the input parameter and the display parameter includes:

[0013] When the video format is different from the video format of the input video frame, performing a format conversion process on the input video frame, wherein the format conversion process is used to convert the input video frame into a first video frame that conforms to the video format in the display parameters;

[0014] The segmentation process is performed on the first video frame to obtain a plurality of output video frames.

[0015] Exemplarily, the input video frame is in a two-dimensional video format, the output video frame is in a three-dimensional video format, and the format conversion process on the input video frame includes:

[0016] Obtaining a depth map corresponding to the input video frame;

[0017] Based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, sub-video frames corresponding to multiple viewpoints are generated, and the sub-video frames corresponding to the multiple viewpoints include pixels of the viewpoints at multiple positions.

[0018] Exemplarily, the first video frame includes multiple viewpoints and pixels of each viewpoint at multiple positions; performing the segmentation process on the first video frame to obtain the multiple output video frames includes:

[0019] Dividing the multiple pixels included in each viewpoint according to the splicing method of the multiple display devices to obtain pixels included in different area positions of each viewpoint;

[0020] Pixels belonging to the same regional position in the multiple viewpoints are spliced ​​to obtain output video frames corresponding to the multiple regional positions respectively.

[0021] Exemplarily, the display parameters include the resolution, the at least one image processing further includes super-resolution processing, and the performing at least one image processing on the video frames in sequence based on the input parameters and the display parameters includes:

[0022] When the resolution of the output video frame is higher than the resolution of the input video frame, determining the execution order of the segmentation process and the super-resolution process based on the video format of the output video frame; wherein the super-resolution process is used to improve the resolution of the input video frame;

[0023] When the execution order of the super-resolution processing arrives, performing the super-resolution processing on the input second video frame according to the resolution of the output video frame;

[0024] The second video frame is the input video frame, or the sub-video frame.

[0025] Exemplarily, determining the execution order of the segmentation processing and the super-resolution processing based on the video format of the output video frame includes:

[0026] If the video format of the output video frame is a two-dimensional video format, determining that the execution order of the segmentation processing takes precedence over the execution order of the super-resolution processing;

[0027] If the video format of the output video frame is a 3D video format, it is determined that the execution order of the segmentation process lags behind the execution order of the super-resolution process.

[0028] Exemplarily, the video format of the output video frame is a 3D video format, the execution order of the segmentation process lags behind the execution order of the super-resolution process, and the super-resolution process of the input second video frame includes:

[0029] Extracting sub-video frames belonging to each viewpoint from the second video frame, wherein the sub-video frame of each viewpoint includes pixels at multiple positions;

[0030] Performing pixel expansion on pixels in the sub-video frame of each viewpoint;

[0031] The segmentation process is used to rearrange the pixels in the sub-video frames of the plurality of viewpoints after the pixel expansion according to the splicing method of the plurality of display devices to obtain the output video frame.

[0032] Exemplarily, the execution order of the segmentation process takes precedence over the execution order of the super-resolution process, and the super-resolution process on the input second video frame includes:

[0033] For each of the plurality of sub-video frames, pixel expansion is performed on pixels included in the sub-video frame to obtain output video frames corresponding to each sub-video frame.

[0034] Exemplarily, the pixel expansion includes:

[0035] For each of the sub-video frames, insert at least one circle of first pixels outside the first edge of the sub-video frame to obtain an intermediate sub-video frame; wherein the pixel value of the first pixel is a preset value;

[0036] The pixel expansion is performed on the pixels included in each of the intermediate sub-video frames.

[0037] Exemplarily, the video format of the input video frame is a two-dimensional video format. Before performing pixel expansion, the method further includes:

[0038] Inserting at least one circle of second pixels outside the second edge of the input video frame to obtain a third video frame; wherein the pixel value of the second pixel is a preset value;

[0039] performing the segmentation process on the third video frame to obtain a plurality of sub-video frames;

[0040] The first edge is an edge in the sub-video frame except the second edge.

[0041] Exemplarily, the input video frame includes a plurality of frames, and the method further includes:

[0042] caching the plurality of input video frames and the plurality of output video frames respectively corresponding to the input video frames, so as to sequentially display the output video frames according to a frame sequence of the output video frames;

[0043] The method further comprises:

[0044] In response to the adjustment operation of the display parameter, based on the change of the display parameter before and after the adjustment, determining a target video frame to be adjusted; wherein the target video frame is a buffered input video frame or a buffered output video frame;

[0045] The target video frame is processed to obtain a video frame that meets the adjusted display parameters.

[0046] Exemplarily, determining a target video frame to be adjusted based on a change in the display parameter before and after the adjustment includes:

[0047] In a case where the change indicates that the resolution has changed, the cached output video frame is used as the target video frame; wherein the cached output video frame is the output video frame to be displayed at the current moment;

[0048] In a case where the change represents a change in a non-resolution aspect, the buffered input video frame is used as the target video frame.

[0049] Exemplarily, processing the target video frame to obtain a video frame that meets the adjusted display parameters includes:

[0050] If the target video frame is the output video frame, processing the resolution of the cached output video frame according to the adjusted display parameters to obtain an output video frame with a changed resolution;

[0051] If the target video frame is the input video frame, performing format conversion processing on the buffered input video frame, and performing the segmentation processing on the video frame obtained after the format conversion processing to obtain multiple new output video frames;

[0052] The format conversion process is used to convert the buffered input video frames into video frames that conform to the changed video format.

[0053] A second aspect of the present disclosure provides a video processing system, comprising: a scheduling unit, an image processing unit, and a display unit;

[0054] The scheduling unit is used to schedule the input video frame to the image processing unit;

[0055] The image processing unit is configured to process the input video frame into a plurality of output video frames based on display parameters of the input video frame when displayed, wherein one of the output video frames corresponds to a partial area on the input video frame, and the display parameters include at least one of a video format and a resolution;

[0056] The display unit is used to display the multiple output video frames on multiple display devices respectively, so that the output video frames are displayed according to the display parameters.

[0057] Exemplarily, the image processing unit includes a plurality of image processing modules;

[0058] The scheduling unit is configured to determine at least one target image processing module to be scheduled and an execution order between the target image processing modules based on the input parameters of the input video frame and the display parameters;

[0059] and, for, during the scheduling process, scheduling the video frame processed by the previous target image processing module to the next target image processing module according to the execution order; wherein the scheduled target image processing module includes a segmentation module, and the segmentation module is used to segment the video frame input to the segmentation module into multiple sub-video frames;

[0060] The plurality of sub-video frames correspond to a plurality of output video frames respectively.

[0061] Exemplarily, when the video format of the input video frame is different from the video format of the output video frame, the target image processing module includes a format conversion module and the segmentation module;

[0062] The format conversion module is scheduled before the segmentation module, and is used to convert the input video frame into a video frame that complies with the video format in the display parameters.

[0063] Exemplarily, when the resolution of the input video frame is lower than the resolution of the output video frame, the target image processing module further includes a super-resolution module; the super-resolution module is configured to perform pixel expansion on the video frame input to the super-resolution module; wherein:

[0064] The scheduling unit is further configured to determine an execution order between the super-resolution module and the segmentation module based on a video format of the input video frame;

[0065] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a three-dimensional video format, the execution order of the super-resolution module is superior to that of the segmentation module;

[0066] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a two-dimensional video format, the execution order of the super-resolution module lags behind that of the segmentation module.

[0067] Exemplarily, the segmentation module includes a first segmentation module and a second segmentation module;

[0068] The first segmentation module is configured to segment the input two-dimensional video frames according to a splicing method of the plurality of display devices;

[0069] The second segmentation module is used to extract the sub-video frame belonging to each viewpoint from the video frame of the input three-dimensional video, and divide the multiple pixels in the sub-video frame of each viewpoint according to the splicing method of the multiple display devices to obtain the pixels included in different regional positions of each viewpoint; and splice the pixels belonging to the same regional position in multiple viewpoints.

[0070] Exemplarily, when the output video frame is in a three-dimensional video format and the input video frame is in a two-dimensional video format, the format conversion module is used to generate sub-video frames of multiple different viewpoints of the input video frame based on the input video frame and a depth map corresponding to the input video frame, where the sub-video frame of each viewpoint includes pixels at multiple positions of the viewpoint.

[0071] Exemplarily, the super-resolution module includes a first super-resolution module and a second super-resolution module; wherein:

[0072] The first super-resolution module is configured to insert at least one circle of preset pixels at the edge of the input sub-video frame, where the pixel values ​​of the preset pixels are preset values;

[0073] The second super-resolution module is used to perform the pixel expansion on the sub-video frame output by the first super-resolution module.

[0074] Exemplarily, the system includes multiple playback components, each of which includes multiple display devices, and the multiple display devices are spliced ​​together;

[0075] The display unit is configured to send the plurality of output video frames to at least one of the playback components, so that the playback component displays the plurality of output video frames on a plurality of display devices.

[0076] Exemplarily, it includes multiple image processing units; wherein different image processing units correspond to playback components spliced ​​by different numbers of display devices, and / or correspond to playback components spliced ​​by display devices with different display performances;

[0077] The scheduling unit is specifically configured to send the input video frame to the image processing unit corresponding to at least one target playback component according to the at least one target playback component to be displayed by the input video frame.

[0078] The present disclosure provides a video playback system, comprising a video processing module and a display module connected to the video processing module, wherein the display module is obtained by splicing multiple display devices; wherein the video processing module is used to execute the video processing method.

[0079] A fourth aspect of the present disclosure provides a video processing device, comprising:

[0080] a parameter acquisition module, configured to acquire an input video frame and display parameters of the input video frame when displayed, wherein the display parameters include at least one of a video format and a resolution;

[0081] a processing module, configured to process the input video frame into a plurality of output video frames based on the display parameters, wherein one of the output video frames corresponds to a partial region of the input video frame;

[0082] The display module is used to display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters.

[0083] The present disclosure provides a video processing method, which can obtain an input video frame and display parameters of the input video frame when displayed, and based on the display parameters, process the input video frame into multiple output video frames, and display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters; wherein, one output video frame corresponds to a partial area of ​​the input video frame.

[0084] Since the input video frame can be processed based on the display parameters of the input video when it is displayed to obtain multiple output video frames, the input video frame can be split and displayed on multiple display devices, thereby realizing the display of the split video. Wherein, the display parameters include at least one of the video format and the resolution. Then, when the video is split and displayed, the input video frame can be processed into a video frame that meets the expected video format, or a video frame that meets the expected resolution, or a video frame that meets both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters. As a result, multiple display devices can splice and display multiple videos, achieving the effect of universal playback of multiple videos.

[0085] An embodiment of the present disclosure further discloses an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the video processing method as described in the first aspect when executing the computer program.

[0086] An embodiment of the present disclosure further discloses a computer-readable storage medium, which stores a computer program that enables a processor to execute the video processing method as described in the first aspect of the present disclosure.

[0087] The above description is only an overview of the technical solution of the present disclosure. In order to more clearly understand the technical means of the present disclosure, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present disclosure more obvious and easy to understand, the specific implementation methods of the present disclosure are listed below.

[0088] BRIEF DESCRIPTION OF THE DRAWINGS

[0089] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure or related technologies, the following is a brief introduction to the drawings required for the description of the embodiments or related technologies. Obviously, the drawings described below are some embodiments of the present disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without inventive efforts. It should be noted that the scales in the drawings are for illustration only and do not represent the actual scale.

[0090] FIG1 is a schematic diagram showing a framework of a first implementation environment of a video processing method according to an embodiment of the present disclosure;

[0091] FIG2 is a schematic diagram showing a flow chart of steps of a video processing method according to an embodiment of the present disclosure;

[0092] FIG3 shows a schematic diagram of a video processing flow when converting an input video frame from a 2D video format to a 3D video format for output in an embodiment of the present disclosure;

[0093] FIG4 is a schematic diagram showing segmentation of a first video frame in a two-dimensional video format according to an embodiment of the present disclosure;

[0094] FIG5 is a schematic diagram showing a process flow of super-resolution processing in video processing according to an embodiment of the present disclosure;

[0095] FIG6 shows a schematic diagram of a process flow of another super-resolution process in video processing according to an embodiment of the present disclosure;

[0096] FIG7 is a schematic diagram showing pixel expansion of a sub-video frame in an embodiment of the present disclosure;

[0097] FIG8 is a schematic diagram showing a process of super-resolution based on edge filling in an embodiment of the present disclosure;

[0098] FIG9 is a schematic diagram showing a process of super-resolution and segmentation of a two-dimensional video in an embodiment of the present disclosure;

[0099] FIG10 is a schematic diagram showing a process of performing video processing on a three-dimensional video according to an embodiment of the present disclosure;

[0100] FIG11 is a schematic diagram showing a process of performing video processing on a three-dimensional video according to an embodiment of the present disclosure;

[0101] FIG12 is a schematic diagram showing a process of performing video processing on a two-dimensional video according to an embodiment of the present disclosure;

[0102] FIG13 is a schematic diagram showing a process of performing video processing on a two-dimensional video according to an embodiment of the present disclosure;

[0103] FIG14 shows a schematic diagram of the framework structure of a video processing system according to an embodiment of the present disclosure;

[0104] FIG15 shows a schematic diagram of the framework structure of another video processing system according to an embodiment of the present disclosure;

[0105] FIG16 shows a schematic diagram of the framework structure of another video processing system according to an embodiment of the present disclosure;

[0106] FIG17 shows a schematic diagram of the framework structure of yet another video processing system according to an embodiment of the present disclosure;

[0107] FIG18 shows a schematic diagram of the framework of the video processing device in an embodiment of the present disclosure.

[0108] Detailed description

[0109] To make the objectives, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments of the present disclosure without making any creative efforts shall fall within the scope of protection of the present disclosure.

[0110] In related technologies, a video needs to be split and displayed on multiple display devices, with different display devices playing different views of the split video. A display device composed of multiple display devices is called a spliced ​​large screen, which can include 8K, 16K, and other large screens. In some practical scenarios, it is necessary to achieve universal display of various types of videos on the spliced ​​large screen, and to convert the input source video to display according to the performance parameters of the spliced ​​large screen.

[0111] In view of this, the present disclosure provides a video processing method, the core concept of which is to process an input video frame into multiple output video frames according to the display parameters when the input video frame is displayed on the display device, so that the multiple output video frames are displayed on multiple display devices respectively. Since the input video frame is processed according to the display parameters when displayed, the input video frame can be processed into a video frame that meets the expected video format, or a video frame that meets the expected resolution, or a video frame that meets both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters, thereby making it possible for multiple display devices to adapt to multiple videos, achieving the effect of universal playback of multiple videos.

[0112] First, referring to FIG1 , a schematic diagram of the implementation environment of the video processing method of the present disclosure is shown. As shown in FIG1 , the embodiment includes a spliced ​​large screen, a monitoring host connected to each display device in the spliced ​​large screen, and a media publishing terminal connected to the monitoring host. The media publishing terminal needs to process the incoming video (input video frame 1) according to the display parameters and then send the processed video frames to the monitoring host. For example, after the processing, video frames F11 to F14 are obtained, wherein video frame F11 is sent to monitoring host 1, video frame F12 is sent to monitoring host 2, video frame F13 is sent to monitoring host 3, and video frame F14 is sent to monitoring host 4. The monitoring host then displays the video on the spliced ​​large screen, wherein the spliced ​​large screen may include display screens located in public places, such as shopping malls, subway stations, and train stations, and may also include display screens located in large conference rooms.

[0113] Among them, the spliced ​​large screen can be an 8K screen, a 16K screen or a 4K screen, which can achieve high-definition display.

[0114] The display device of the spliced ​​large screen can display 2D video and 3D video, wherein 2D video is also called two-dimensional video, and 3D video is also called three-dimensional video. Exemplarily, the display device is a naked-eye 3D display device, which has a cylindrical lens array and a slit grating and has 3D display capabilities. It can be used to display 3D video, and the user can watch the 3D video with the naked eye without the aid of an auxiliary viewing device; another exemplary embodiment, the display device does not include a cylindrical lens array and a slit grating, and it can be used to display 2D video; another exemplary embodiment, although the display device does not have 3D display capabilities, it can still display 3D video. In this case, the user can use an auxiliary viewing device to view the 3D display effect.

[0115] Accordingly, based on the implementation environment shown in FIG1 , the present disclosure provides a video processing system that can process input videos and then send them to a monitoring host for playback. Specifically, the video processing system will be described in detail in subsequent embodiments and will not be repeated here.

[0116] In conjunction with the implementation environment shown in FIG1 , the video processing method provided by the present disclosure is introduced. FIG2 shows a schematic flow chart of the steps of a video processing method of the present disclosure. As shown in FIG2 , the method may specifically include the following steps:

[0117] Step S101: obtaining an input video frame and display parameters of the input video frame when displayed, where the display parameters include at least one of a video format and a resolution.

[0118] In this embodiment, the input video frame may refer to a video frame in a video stream to be played. When the video stream arrives, each incoming video frame is referred to as an input video frame, and then video processing is required for each incoming input video frame. The display parameters of the input video frame when displayed may refer to the parameters of the picture when the video is played on the display device. If a video format is included, it refers to the video format in which the input video frame is displayed. As mentioned above, the video format includes a three-dimensional video format and a two-dimensional video format. When the video format is a three-dimensional video format, the input video frame can display a three-dimensional video on the display device. If the display device is a naked-eye 3D display device, the input video frame can achieve a stereoscopic display effect on the display device. If the video format is a two-dimensional video format, the input video frame displays a two-dimensional video on the display device.

[0119] The display parameters may further include resolution, which may indicate the resolution at which the input video frame is displayed on the display device. The higher the resolution, the clearer the input video frame will be displayed on the display device.

[0120] In practice, the display parameters may include resolution or video format, or both. In a large-screen display scenario, depending on the display performance of the display device, the display parameters may include both resolution and video format, indicating that the video should be played according to the display performance provided by the display device.

[0121] In this embodiment, for the same multiple display devices, the display parameters corresponding to the input video frames in different videos may be different. For example, the display parameters corresponding to the 3D video may be different from the display parameters corresponding to the 2D video.

[0122] Alternatively, for the same multiple display devices, the corresponding display parameters of the input video frames in different videos can be the same. In this way, no matter what video format the input video is in or what resolution the input video is, it can be displayed on multiple display devices with the same display parameters, achieving universal playback of multiple videos on the spliced ​​large screen.

[0123] Of course, for the same multiple display devices, that is, the same spliced ​​large screen and the same video, different display parameters can be used at different times. For example, if the display parameters of a video are manually adjusted during playback, the display parameters will change during the video playback. For another example, if a sensitive image needs to be blurred during video playback, one display parameter can be used during the playback period of the sensitive image, and another display parameter can be used during the rest of the playback period.

[0124] Step S102: processing the input video frame into multiple output video frames based on the display parameters, wherein one output video frame corresponds to a partial area of ​​the input video frame;

[0125] In order to enable different types of videos to be displayed on a display device, the input video frame can be processed into an output video frame that meets the display parameters. Since the display parameters include the video format and / or resolution, the processing of the input video frame includes the format processing and / or resolution processing of the input video frame.

[0126] In particular, since the input video frame needs to be displayed on multiple display devices, and the multiple display devices are spliced ​​together to form a spliced ​​large screen, and each display device displays a portion of the input video frame, the display parameters may also include the number of display devices and the splicing method of the display devices. Based on the number of display devices and the splicing method, the input video frame may also be segmented, that is, the processing of the input video frame also includes segmentation. It should be noted that inconsistent numbers of display devices or inconsistent splicing methods will result in different ways of segmenting the input video.

[0127] Exemplarily, since the processing of the input video frame includes segmentation processing, format processing and / or resolution processing; among which segmentation processing is a necessary processing, in practice, the input video frame can be segmented first, and then each sub-video frame obtained after the segmentation processing can be formatted and / or resolution processed; or, the input video frame can be formatted and / or resolution processed first, and then the obtained video frame can be segmented; or, in the case of including format processing and resolution processing, the format processing, resolution processing and segmentation processing can flexibly adjust their respective processing orders according to actual needs, and finally obtain multiple output video frames.

[0128] Among them, for format processing and resolution processing, when the video format of the input video frame does not conform to the video format in the display parameters, the video format of the input video frame needs to be converted, such as converting the input video frame from a two-dimensional video format to a three-dimensional video format, or converting the input video frame from a three-dimensional video format to a two-dimensional video format.

[0129] For example, if the resolution of the input video frame does not match the resolution in the display parameters, the resolution of the input video frame needs to be increased, such as by converting the input video frame from a low resolution to a high resolution. For another example, if both the resolution and the video format of the input video frame are inconsistent with the resolution and the video format in the display parameters, the resolution of the input video frame needs to be increased and the video format of the input video frame needs to be converted.

[0130] Step S103: displaying the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters.

[0131] In this embodiment, because the multiple output video frames are obtained by processing the input video frames according to the display parameters, the resolution and video format of the output video frames meet the display performance requirements of the display device, and thus the output video frames can be displayed on the display device according to the display parameters. For example, if the video format of the output video frames is converted to a 3D video format, the output video frames are displayed on the display device with a stereoscopic effect; for another example, if the resolution of the output video frames is increased to a high resolution, the output video frames are displayed on the display device at a high resolution; for another example, if both the resolution and video format of the output video frames are processed, the output video frames can be displayed in 3D stereoscopic form at a high resolution on the display device.

[0132] The technical solution of this embodiment, since the input video is divided into multiple output video frames according to the display parameters, the input video frame can be split and displayed on multiple display devices, thereby realizing the display of the split video. Particularly, since the display parameters include at least one of the video format and the resolution, when the video is split and displayed, the input video frame can be processed into a video frame that meets the expected video format, or a video frame that meets the expected resolution, or a video frame that meets both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters. As a result, multiple display devices can adapt to multiple videos, achieving the effect of universal playback of multiple videos.

[0133] In an optional embodiment, when processing an input video frame into multiple output video frames based on display parameters, universal display of multiple input video frames can be achieved. In this case, corresponding video processing logic can be set for the input video frame based on the display parameters and input parameters of the input video frame. The display parameters can reflect the video format and resolution of the output video frame, and the input parameters can reflect the video format and resolution of the input video frame. The difference between the input video frame and the desired output video frame can be determined based on the input parameters and the display parameters, and the corresponding video processing logic can be set for the input video frame based on this difference.

[0134] In this optional embodiment, video processing logic for the incoming input video frame can be determined based on input parameters of the incoming input video frame and display parameters of the input video frame when displayed. The video processing logic can include at least one image processing. When processing the input video frame according to the video processing logic, the at least one image processing can be performed according to a certain execution order. It should be noted that since the input video frame needs to be segmented into multiple output video frames for output, the at least one image processing includes a segmentation process, which is used to segment the video frame according to the number of display devices and the splicing method.

[0135] In a specific implementation, input parameters of an input video frame may be obtained, and at least one image processing step may be sequentially performed on the input video frame based on the input parameters and display parameters. The input parameters may include at least one of a video format and a resolution, and the segmentation step may be used to segment the current video frame into a plurality of sub-video frames; wherein the plurality of sub-video frames correspond to a plurality of output video frames, respectively. The current video frame may be the input video frame, or may be a video frame obtained by performing image processing other than the segmentation step on the input video frame.

[0136] In this embodiment, for two input video frames with the same input parameters, if the display parameters corresponding to the two input video frames are different, the video processing logic may be different; similarly, for two input video frames corresponding to the same display parameters, if the input parameters of the two input video frames are different, their video processing logic is also different.

[0137] Among them, the image processing that needs to be performed on the input video frame can be determined based on the input parameters and display parameters. For example, if it is determined based on the input parameters and display parameters that only segmentation processing needs to be performed on the input video frame (characterizing that the input parameters and display parameters are consistent), then the image processing only includes segmentation processing; for another example, if it is determined based on the input parameters and display parameters that format conversion needs to be performed on the input video frame, then the image processing includes segmentation processing and format conversion processing; for another example, if it is determined based on the input parameters and display parameters that the resolution of the input video frame needs to be improved, then the image processing includes segmentation processing and resolution processing (super-resolution processing in subsequent embodiments); for another example, if it is determined based on the input parameters and display parameters that the resolution of the input video frame needs to be improved and format conversion needs to be performed, then the image processing includes segmentation processing, format conversion processing and super-resolution processing.

[0138] Among them, in the case of only segmentation processing, only the input video frame can be segmented according to the number and splicing method of multiple display devices to obtain multiple output video frames. In this case, the current video frame processed by the segmentation processing is the input video frame, and the multiple sub-video frames output after the segmentation processing are multiple output video frames.

[0139] In the case where the segmentation process includes at least one of super-resolution and format conversion, the execution order of the multiple image processing processes can be determined first, and then the image processing can be performed on the input video frame in sequence according to the execution order. In this case, when the segmentation process is executed, the current video frame being processed is either the input video frame or the video frame output after other image processing (image processing other than the segmentation process). In other words, the execution order of the segmentation process can be the first, the last, or somewhere between the first and the last.

[0140] By adopting the above scheme, the execution order of various image processing performed on the input video frames can be different for different input parameters and display parameters. In this way, more adaptive video processing of the input video frames can be achieved. For example, the quality of video processing can be guaranteed while ensuring the efficiency of video processing.

[0141] Next, how to combine input parameters and display parameters to perform image processing on input video frames is introduced and explained.

[0142] In Example #1, the display parameters only include the video format. In this case, it is only necessary to display the input video frame according to the preset video format, and the resolution of the input video frame does not need to be processed. The processing method of Example #1 is as follows:

[0143] When performing video processing, the input video frame can be processed according to the video format of the input video frame and the video format of the output video frame, and the image processing includes format conversion processing and segmentation processing. For example, if the video format of the input video frame and the video format of the output video frame are different, the video format of the input video frame can be format converted, for example, the input video frame is converted from a 3D video format to a 2D video format for output, or the input video frame is converted from a 2D video format to a 3D video format for output. In this case, after the input video frame is format converted, the video frame after the format conversion can be segmented.

[0144] In a specific implementation, when the video format of the output video frame is different from the video format of the input video frame, the input video frame is subjected to format conversion processing. The format conversion processing is used to convert the input video frame into a first video frame that conforms to the video format in the display parameters. Then, the first video frame can be segmented to obtain multiple output video frames.

[0145] In this example #1, if the video format of the output video frame is different from the video format of the input video frame, the video format of the input video frame needs to be converted to the preset video format. As described above, the video format conversion includes converting from a 2D video format to a 3D video format, and from a 3D video format to a 2D video format. The format conversion process of converting the 2D video format to a 3D video format can be performed in conjunction with a depth map of the input video frame. The depth map can provide the depth value of each pixel in the input video frame to distinguish between the foreground and the background, thereby converting the input video frame in a two-dimensional video format into a first video frame in a three-dimensional video format.

[0146] Among them, in the format conversion process of converting the 3D video format into the 2D video format, the input video frame generally includes multiple viewpoints, that is, images from different perspectives. In practice, the image of one of the viewpoints can be extracted from the input video frame, thereby converting the input video frame in the three-dimensional video format into the first video frame in the two-dimensional video format.

[0147] In this example #1, the execution order of the format conversion process can be set to take precedence over the execution order of the segmentation process. In this way, the video frame targeted by the segmentation process is the first video frame after the format conversion. In this way, the first video frame can be segmented according to the number of display devices and the splicing method to obtain multiple output video frames.

[0148] When using Example #1, since the segmentation process is performed after the format conversion process, the format conversion process can be performed on the entire input video frame. This improves conversion efficiency compared to the situation where the format conversion process is performed later and the format conversion of multiple segmented sub-video frames is required. Furthermore, when the input video frame needs to be converted from a 2D video format to a 3D video format, converting the input video frame to a 3D video format first can avoid the loss of image information caused by segmentation first, thereby improving the quality of the output video frame.

[0149] Exemplarily, referring to Figure 3, a schematic diagram of the video processing flow when converting the input video frame from a 2D video format to a 3D video format for output is shown. As shown in Figure 3, the input video frame is in a two-dimensional video format, and the video format of the output video frame is in a three-dimensional video format. When the input video frame is format-converted, a depth map corresponding to the input video frame can be obtained. Based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, multiple sub-video frames of the input video frame are generated, and the multiple sub-video frames include multiple viewpoints and pixels at multiple positions for each viewpoint.

[0150] As described above, a depth map can include a depth value for each pixel in the input video frame. The depth value can indicate whether a pixel belongs to the foreground or the background. In practice, the pixel values ​​of each pixel in the input video frame and the depth values ​​of the pixels at the corresponding positions in the depth map can be used to restore the multiple viewpoints included, as well as the pixels at multiple positions of each viewpoint. A viewpoint can be understood as a viewing angle. Different viewpoints correspond to different viewing angles, and different viewing angles can form an image. Images from multiple viewpoints can constitute a 3D video frame for stereoscopic display. The image of each viewpoint can be referred to as a sub-video frame. As shown in Figure 3, nine viewpoints are restored based on the input video frame and the depth map, resulting in nine sub-video frames. Each sub-video frame includes pixels at multiple different positions. For different sub-video frames, the pixel values ​​of pixels at the same position can be the same or different. Thus, the sub-video frames corresponding to each of the multiple viewpoints constitute the video data of the first video frame, and a stereoscopic display effect can be achieved based on this video data.

[0151] Next, segmentation processing can be performed on the first video frame, and multiple output video frames are obtained after the segmentation processing. In this case, each of the multiple output video frames can include multiple viewpoints, and the multiple viewpoints correspond to pixels in the same position area; for example, each output video frame includes nine viewpoints, and the nine viewpoints correspond to pixels in the same position area. In this way, when the multiple output video frames are spliced ​​and displayed on multiple display devices, the output video frames displayed on each display device can achieve a stereoscopic display effect.

[0152] In Example #1, the segmentation process of the first video frame of different video formats is described as follows:

[0153] When the first video frame in a two-dimensional video format is segmented, the first video frame is obtained by converting the input video frame from a 3D video format to a 2D video format. The segmentation process can be shown in FIG4 , which shows a schematic diagram of segmenting the first video frame in a two-dimensional video format. As shown in FIG4 , the first video frame can be divided according to the splicing method and number of multiple display devices. For example, as shown in FIG1 , the spliced ​​large screen is spliced ​​by 4 display devices. It can be divided into 4 areas according to the splicing method of the 4 display devices, and the 4 areas correspond to the 4 display devices respectively. For example, the picture of area 1 (pixels 1, 2, 5 and 6) is displayed on display device 1, the picture of area 2 (pixels 3, 4, 7 and 8) is displayed on display device 2, the picture of area 3 (pixels 9, 10, 13 and 14) is displayed on display device 3, and the picture of area 4 (pixels 11, 12, 15 and 16) is displayed on display device 4.

[0154] When segmenting a first video frame in a three-dimensional video format, the first video frame is obtained by converting an input video frame from a 2D video format to a 3D video format. The segmentation process can be shown in FIG3 . As shown in FIG3 , since the converted first video frame includes sub-video frames corresponding to multiple viewpoints, each sub-video frame includes pixels at multiple positions of the viewpoint. When segmenting the first video frame, the pixels in the sub-video frames of the multiple viewpoints can be rearranged. The pixel rearrangement can be used to integrate pixels at different regional positions of the multiple viewpoints, so that the pixels under multiple viewpoints at the same regional position are arranged together to form a three-dimensional video at the regional position.

[0155] In specific implementation, the multiple pixels included in each viewpoint can be divided according to the splicing method and number of multiple display devices to obtain the pixels included in different regional positions of each viewpoint; then, the pixels belonging to the same regional position in multiple viewpoints can be spliced ​​to obtain output video frames corresponding to multiple regional positions.

[0156] Among them, for the sub-video frame of each viewpoint, in pixel 1_1, the first 1 represents the viewpoint, and the second 1 represents the first pixel of the first sub-video frame; in pixel 1_2, the first 1 represents the viewpoint, and the second 2 represents the second pixel of the first sub-video frame; in practice, the sub-video frame of the viewpoint can be divided according to the splicing method and number of multiple display devices. As shown in Figure 3, the sub-video frame of each viewpoint includes pixels from 4 different areas, the number of display devices is 4, and the splicing method is as shown in Figure 1. Then the division of the sub-video frame can be as shown in Figure 3, that is, pixel 1_1, pixel 1_2, pixel 1_3 and pixel 1_4 belong to different regional positions respectively.

[0157] Afterwards, the pixels of the divided sub-video frames are rearranged. The rearrangement is performed according to the divided regional positions. For example, for regional position 1, the pixels belonging to regional position 1 in multiple viewpoints need to be combined together. As shown in Figure 3, for regional position 1, the first pixels belonging to regional position 1 in the nine viewpoints are arranged together, thereby obtaining a three-dimensional sub-video frame of regional position 1. Regional position 1 includes pixels from different viewpoints, thereby obtaining images of regional position 1 at different viewing angles. When these images are displayed on a display device, they can be superimposed on each other to form a three-dimensional display effect. For example, as shown in Figure 3, when rearranging, the pixels (_1) at the first position of the nine viewpoints are taken to re-form an image matrix, and the pixels (_2) at the second position of the nine viewpoints are taken to re-form an image matrix. Similarly, the _3 and _4 positions are each formed into a new image matrix. Finally, four images after pixel rearrangement can be obtained. Then, the control module controls the synchronization of the four image streams and displays them on the first, second, third, and fourth display devices respectively.

[0158] In Example #2, the display parameters only include resolution. In this case, it is only necessary to display the input video frame at the preset resolution, and the video format of the input video frame does not need to be processed. The processing method of Example #2 is as follows:

[0159] If the resolution of the output video frame is higher than that of the input video frame, the input video frame needs to be super-resolution processed. The super-resolution processing is used to increase the resolution of the input video frame so that the resolution of the output video frame is the resolution determined in the display parameters.

[0160] Specifically, super-resolution processing can be performed before or after image segmentation. For example, regardless of the video format of the input video frame or the video format of the output video frame, super-resolution processing can be performed before image segmentation. For example, if the output video frame and the input video frame are both video frames in two-dimensional video format, the input video frame can be super-resolution processed first, and then the super-resolution video frame can be segmented; wherein, the segmentation processing of the second video frame in two-dimensional video format can refer to the above-mentioned process of segmenting the first video frame in two-dimensional video format, which will not be repeated here. For another example, if the output video frame and the input video frame are both video frames in three-dimensional video format, the input video frame can be super-resolution processed first, and then the super-resolution video frame can be segmented; wherein, the segmentation processing process can refer to the above-mentioned process of segmenting the first video frame in three-dimensional video format, which will not be repeated here.

[0161] As another example, regardless of the video format of the input video frame or the video format of the output video frame, super-resolution processing can be performed after image segmentation. For example, if both the output video frame and the input video frame are in a two-dimensional video format, the input video frame can be segmented first, and then super-resolution processing can be performed on the multiple sub-video frames obtained after the segmentation processing. For another example, if both the output video frame and the input video frame are in a three-dimensional video format, the input video frame can be segmented first, and then super-resolution processing can be performed on the multiple sub-video frames obtained after the segmentation processing.

[0162] As another example, when super-resolution processing is performed on an input video frame, the execution order of the super-resolution processing and the segmentation processing can be determined based on the video format of the output video frame. As a result, the execution order of the super-resolution processing and the segmentation processing can be specifically changed for different video formats of the output video frames to improve the video processing effect. Accordingly, when the execution order of the super-resolution processing arrives, the input second video frame can be super-resolution processed according to the resolution of the output video frame; wherein the second video frame is the input video frame, or a sub-video frame.

[0163] Specifically, if the super-resolution processing is performed before the segmentation processing, the super-resolution processing can be targeted at the input video frame, that is, the input video frame is first super-resolution processed to obtain the super-resolution video frame, and then the super-resolution processed video frame is segmented. If the super-resolution processing is performed after the segmentation processing, the input video frame is first segmented to obtain multiple sub-video frames, and then each sub-video frame is super-resolution processed.

[0164] Exemplarily, if the video format of the output video frames is a two-dimensional video format, the execution order of the segmentation processing is determined to take precedence over the execution order of the super-resolution processing; if the video format of the output video frames is a three-dimensional video format, the execution order of the segmentation processing is determined to lag behind the execution order of the super-resolution processing.

[0165] Among them, when the video format of the output video frame is a three-dimensional video format, the output video frame includes multiple viewpoints, and each viewpoint includes pixels at multiple different positions. Super-resolution processing can be performed first, so that the pixels of each viewpoint can be expanded first. Because one viewpoint corresponds to the sub-video frame of the viewpoint, in this case, the resolution of the sub-video frame of each viewpoint can be enhanced first, and then the sub-video frames of multiple viewpoints can be segmented. The pixels are rearranged as described above, so as to avoid the situation where the parallax is inconsistent when the resolution is increased after segmentation, which affects the stereoscopic display effect.

[0166] 5 , a flow chart of a super-resolution process in video processing is shown. As shown in FIG5 , the video format of the output video frame is a three-dimensional video format. In this case, regardless of whether the input video is in a two-dimensional video format or a three-dimensional video format, the second video frame targeted by the super-resolution process is a video frame in a three-dimensional video format. Specifically, the super-resolution process can be performed on each viewpoint in the second video frame, that is, on the sub-video frame of each viewpoint in the second video frame.

[0167] In a specific implementation, a sub-video frame belonging to each viewpoint can be extracted from the second video frame, and the sub-video frame includes pixels at multiple positions; then, the pixels in the sub-video frame of each viewpoint are expanded; wherein the segmentation processing is used to rearrange the pixels in the sub-video frames of multiple viewpoints after pixel expansion according to the splicing method of multiple display devices to obtain the output video frame.

[0168] The second video frame may be an input video frame. Since the input video frame is in a 3D video format, it includes sub-video frames corresponding to multiple viewpoints. Each sub-video frame of each viewpoint includes pixels at multiple different positions. When pixel expansion is performed on the pixels in the sub-video frame of that viewpoint, nonlinear interpolation or other methods may be used to increase the number of pixels in the sub-video frame, thereby improving the resolution of the sub-video frame of each viewpoint. It should be noted that when pixel expansion is performed on the sub-video frames of multiple viewpoints, the pixel expansion scale of different sub-video frames is the same.

[0169] Next, when expanding the pixels of the sub-video frame of each viewpoint, the pixels in the multiple sub-video frames after pixel expansion can be rearranged according to the above-mentioned method of segmenting the first video frame in the 3D video format, thereby obtaining multiple output video frames.

[0170] Referring to Figure 6, a flow chart of another super-resolution processing in video processing is shown. As shown in Figure 6, in Example #2, the video format of the output video frame is a two-dimensional video format. In this case, regardless of whether the input video is in a two-dimensional video format or a three-dimensional video format, the second video frame targeted by the super-resolution processing is a plurality of sub-video frames obtained after the segmentation processing. Specifically, if the input video frame is in a two-dimensional video format, the second video frame can be a sub-video frame obtained by segmenting the input video frame. If the input video frame is in a three-dimensional video format, the input video frame can be first converted into a video frame in a two-dimensional video format, and then the converted video frame in the two-dimensional video format can be segmented to obtain sub-video frames to be super-resolution processed.

[0171] The sub-video frame is a video frame of two-dimensional data. In specific implementation, the pixels included in each of the multiple sub-video frames can be expanded to obtain an output video frame corresponding to each sub-video frame.

[0172] As shown in Figures 5 and 6, super-resolution processing involves pixel expansion, which increases the number of pixels in a sub-video. This increase in pixel count can improve resolution. For example, whether it's a 3D or 2D video frame, super-resolution processing is performed on sub-video frames within the input video frame. Specifically, in 2D video, super-resolution is performed on the sub-video frames obtained by segmenting the 2D video frame, while in 3D video, super-resolution is performed on the sub-video frames for each viewpoint within the 3D video frame.

[0173] Regardless of whether the object of super-resolution processing is the sub-video frame obtained after segmenting the two-dimensional video frame, or the sub-video frame of each viewpoint in the three-dimensional video frame, the above two sub-video frames can be regarded as an image to be processed, and super-resolution processing can be performed on the image to be processed.

[0174] Exemplarily, pixel expansion may be performed by linear interpolation on the sub-video frame, specifically including at least one of nonlinear interpolation, bilinear interpolation, and trilinear interpolation.

[0175] As another example, pixel augmentation can be performed using a neural network model, such as by inputting a sub-video frame into a restoration model to increase the resolution of the sub-video frame. The restoration model's training samples can include multiple image sample pairs, each of which includes a high-resolution image and a low-resolution image of the same image. During training, the low-resolution image is input into the restoration model. A loss function is constructed based on the predicted image and the high-resolution image output by the restoration model. A loss value is calculated based on the loss function, and the restoration model parameters are continuously updated based on the loss value, thereby training a restoration model capable of super-resolution processing of images.

[0176] As another example, during the pixel expansion process, each sub-video frame to be super-resolved can be padded. This padded process can include expanding the edge of the sub-video frame by an additional n pixels, such as adding n pixels to the top, bottom, left, and right edges of the sub-video frame. Pixel expansion of the padded sub-video frame can then be performed. This avoids jagged edges at the sub-video frame during pixel expansion and improves the quality of the super-resolved image. Specifically, for each sub-video frame, at least one circle of first pixels can be inserted outside the first edge of the sub-video frame to obtain an intermediate sub-video frame. Pixel expansion can then be performed on the pixels included in each intermediate sub-video frame. The pixel value of the first pixel is a preset value.

[0177] Referring to Figure 7, a schematic diagram of pixel expansion of a sub-video frame is shown. As shown in Figure 7, whether it is a sub-video in a two-dimensional video format or a sub-video for each viewpoint, at least one circle of first pixels can be extended outside the first edge of the sub-video frame. Specifically, the first edge can refer to the edge of each side of the sub-video frame. As shown in Figure 7, it can refer to the edges of the upper, lower, left and right four sides of the sub-video frame; wherein, at least one circle of first pixels with pixel values ​​of preset values ​​can be supplemented at the edges of the upper, lower, left and right four sides of the sub-video frame. For example, n first pixels adjacent to the pixels at each edge of the sub-video frame are supplemented. When n is 1, one first pixel is supplemented at the edge, and the size of the sub-video frame is expanded outward by one pixel. When n is greater than 1, n first pixels are supplemented at the edge, and the size of the sub-video frame is expanded outward by n pixels.

[0178] The preset value may be 0, that is, a circle of pixels with a pixel value of 0 may be inserted outside the first edge of the sub-video frame. In this way, when pixel expansion is subsequently performed, the pixel values ​​of the pixels at the edge of the sub-video frame are 0, thereby improving the jagged edge phenomenon and the image quality at the edge.

[0179] In some embodiments, if the video format of the input video frame is a two-dimensional video format, and if the video format of the output video frame is also a two-dimensional video format, an edge padding operation may be performed before pixel expansion. Specifically, the original input video frame may be edge-padded before segmentation. After edge padding, the edges of the input video frame are first padded. Then, the input video frame after edge padding is segmented. In this way, for the segmented sub-video frames, only the remaining edges need to be padded. Thus, the edge padding operation can be completed in stages, thereby improving processing efficiency.

[0180] In a specific implementation, at least one circle of second pixels can be inserted outside the second edge of the input video frame to obtain a third video frame, and the third video frame can be segmented to obtain multiple sub-video frames; wherein the pixel value of the second pixel is a preset value, and the first edge is the edge of the sub-video frame except the second edge.

[0181] Referring to FIG8 , a schematic diagram of the process of super-resolution processing based on edge padding is shown. As shown in FIG8 , at least one circle of second pixels is inserted at the second edge of the input video frame. Specifically, the second edge can be the upper, lower, left, and right edges of the input video frame. The number of inserted circles of second pixels can be one or more circles, and the pixel value of the second pixel can be 0. The edge padding process can refer to the process shown in FIG7 . After the input video frame is edge-padded, the size of the input video frame is expanded outward by n pixels. For example, if the input video frame includes 1024 pixels in the length direction, after one circle of edge padding, the length direction is expanded by two pixels and the height direction is expanded by two pixels.

[0182] After the input video frame is padded, the padded input video frame can be segmented, and the segmentation is performed according to the number of display devices and the splicing method; the multiple sub-video frames obtained after the segmentation process can be shown in Figure 8. In this way, for each sub-video frame, according to the segmentation method, part of the edges of some or all sub-video frames already have the second pixel of the padded edge. In order to make the sizes of each sub-video frame consistent, for each sub-video frame, the sub-video frame can be padded on the first edge except the second edge.

[0183] For example, as shown in Figure 8, a circle of second pixels is added outside the edge of the input video frame, and then the input video frame after the edge addition is divided in a grid manner. The two adjacent second edges of each sub-video frame are supplemented with second pixels. If the other two adjacent first edges are not supplemented with second pixels, a circle of first pixels can be supplemented on the other adjacent first edges.

[0184] Among them, Figure 8 shows an example of dividing the input video frame in a grid-like manner. In some other examples, the input video frame may be divided in a nine-square grid or other manner. If the input video frame is divided in a nine-square grid manner, there is a sub-video frame whose four edges are not supplemented with the second pixel. In this case, the first pixel can be supplemented on all four edges of the sub-video frame, so that the sizes of the multiple sub-video frames after supplementation can be the same.

[0185] The scale of the edge padding performed on the sub-video frame is consistent with the scale of the edge padding performed on the input video frame. For example, if n second pixels are padded on all four edges of the input video frame, then n first pixels are padded outside the first edge of the sub-video frame. The pixel values ​​of the first and second pixels are both preset values, such as 0.

[0186] With this implementation, the input video frame can be initially padded, the padded input video frame is then segmented, and then the multiple sub-video frames obtained after segmentation are padded again. By padding twice, the four edges of each sub-video frame are expanded outward by n pixels, thereby improving the image quality of the video frame at the edge.

[0187] In Example #3, the display parameters include resolution and video format. If the display parameters include resolution and video format, it means that the input video frame needs to be displayed according to a preset resolution and a preset video format. Both the video format and resolution of the input video frame need to be processed. The processing method of Example #3 is as follows:

[0188] According to the video format of the input video frame and the video format of the output video frame, it is determined whether the input video frame needs to be format converted, and according to the resolution of the input video frame and the resolution of the output video frame, it is determined whether the resolution of the input video frame needs to be super-resolution processed. Among them, the video processing logic of the input video frame can be set according to whether the input video frame needs to be format converted and whether the resolution of the input video frame needs to be super-resolution processed. Based on the above embodiment, there are several video processing logics as follows:

[0189] The first video processing logic: there is no need to convert the format of the input video frame, but the resolution of the input video frame needs to be super-resolved.

[0190] Among them, the video format of the input video frame is a two-dimensional video format, and the video format of the output video frame is also a two-dimensional video format, then its video processing logic can be segmentation processing first and then super-resolution processing, as shown in Figure 9, Figure 9 shows a schematic diagram of the processing process of super-resolution and segmentation of two-dimensional video. As shown in Figure 9, the input video frame can be segmented in a four-grid manner to obtain four sub-video frames, and then, each sub-video frame is first edge-filled, such as adding a circle of pixels with a pixel value of 0 to the four edges of the sub-video, and then, each sub-video frame after filling is sent to the repair model to obtain an output video frame with a higher resolution.

[0191] Among them, the video format of the input video frame is a three-dimensional video format, and the video format of the output video frame is also a three-dimensional video format, then its video processing logic can be viewpoint segmentation processing first, then super-resolution processing, and then segmentation processing, as shown in Figure 10. Figure 10 shows a schematic diagram of the video processing process for three-dimensional video. As shown in Figure 10, first, a sub-video frame of each viewpoint is extracted from the input video frame, then a circle of pixels with a pixel value of 0 is extended at the edge of the sub-video frame of each viewpoint, and then the sub-video frame after edge filling processing is sent to the repair model to obtain a sub-video frame with higher resolution, then, the sub-video frames of multiple viewpoints output by the repair model are pixel rearranged, such as the sub-video frame of each viewpoint is segmented according to the number of display devices and the splicing method to obtain pixels in different regional positions, and then the pixels belonging to the same regional position in multiple viewpoints are combined to obtain an output video frame of a regional position.

[0192] The second video processing logic: the format of the input video frame needs to be converted, and the resolution of the input video frame does not need to be super-resolution processed.

[0193] Among them, the video format of the input video frame is a two-dimensional video format, the video format of the output video frame is a three-dimensional video format, and the resolution of the input video frame is the same as the resolution of the output video frame; then its video processing logic can be a format conversion process first and then a segmentation process, as shown in Figure 3, according to the input video frame and the depth map corresponding to the input video frame, multiple viewpoints and sub-video frames of each viewpoint are restored, so that the input video frame in the two-dimensional video format is converted into a video frame in the three-dimensional video format, and then the sub-video frame of each viewpoint is segmented according to the number of display devices and the splicing method to obtain pixels in different regional positions, and then the pixels belonging to the same regional position in multiple viewpoints are combined to obtain an output video frame of a regional position.

[0194] Among them, the video format of the input video frame is a three-dimensional video format, and the video format of the output video frame is a two-dimensional video format, then its video processing logic can be viewpoint segmentation processing, format conversion processing and then segmentation processing, as shown in Figure 11. Figure 11 shows a schematic diagram of the processing process of video processing for three-dimensional video. As shown in Figure 11, sub-video frames corresponding to multiple viewpoints can be extracted from the input video frame. A sub-video frame can be understood as an image under a certain perspective, then a sub-video frame of a viewpoint can be extracted, and the extracted sub-video frame of the viewpoint is a video frame in a two-dimensional video format. Then, the extracted sub-video frame of the viewpoint is segmented according to the number of display devices and the splicing method to obtain multiple output video frames.

[0195] The third video processing logic: the input video frame needs to be format converted and the resolution of the input video frame needs to be super-resolution processed.

[0196] Among them, the video format of the input video frame is a two-dimensional video format, and the video format of the output video frame is a three-dimensional video format. The video processing logic can be format conversion processing → super-resolution processing → segmentation processing, as shown in Figure 12. Figure 12 shows a schematic diagram of the processing process of performing video processing on a two-dimensional video. As shown in Figure 12, based on the input video frame and the depth map corresponding to the input video frame, multiple viewpoints and sub-video frames of each viewpoint are restored, so that the input video frame in the two-dimensional video format is converted into the first video frame in the three-dimensional video format, and then at least one circle of pixels with a pixel value of 0 is extended outside the edge of the sub-video frame of each viewpoint, and then the sub-video frame of each viewpoint after the edge filling is sent to the repair model to obtain a high-resolution sub-video frame, and then the high-resolution sub-video frame is pixel rearranged to obtain multiple output video frames.

[0197] Among them, the video format of the input video frame is a three-dimensional video format, and the video format of the output video frame is a two-dimensional video format, then its video processing logic can be format conversion processing → segmentation processing → super-resolution processing; as shown in Figure 13, Figure 13 shows a schematic diagram of the processing process of performing video processing on a two-dimensional video. As shown in Figure 13, sub-video frames corresponding to multiple viewpoints can be extracted from the input video frame. A sub-video frame can be understood as an image under a certain perspective, then a sub-video frame of a viewpoint can be extracted, and the extracted sub-video frame of the viewpoint is the first video frame in the two-dimensional video format. Then, the first video frame is segmented according to the number of display devices and the splicing method to obtain multiple sub-video frames; thereafter, the multiple sub-video frames are sent to the restoration model to obtain multiple output video frames with high resolution.

[0198] In some embodiments, after displaying multiple output video frames on multiple display devices, the display parameters of the input video frames may also be adjusted, so that the video format and resolution of the video can be continuously adjusted as needed during playback.

[0199] Among them, in order to improve the efficiency of adjusting the display parameters of the output video frames, multiple input video frames and the output video frames corresponding to the multiple input video frames can be cached, so that the output video frames can be displayed in sequence according to the frame sequence of the output video frames; then, when it is detected that the display parameters are adjusted, the object to be processed can be extracted from the cache first, thereby avoiding the problem of reduced efficiency caused by re-acquiring new input video frames.

[0200] When it is detected that the display parameters have been adjusted, it can be determined whether the object of video processing is the cached input video frame or the cached output video frame; that is, it can be determined whether the cached input video frame or the cached output video frame is to be processed. If it is the cached input video frame, the representation will perform video processing on the video frame in the original video according to the process of the above embodiment; if it is the cached output video frame, the video processing is performed on the basis of the cached output video frame. Since the cached output video frame has already processed the input video frame according to the display parameters, after the display parameters are adjusted, the video processing of the cached output video frame can be regarded as continuous video processing, and the step of processing the input video frame into the output video frame is omitted, thereby improving the adjustment efficiency.

[0201] In a specific implementation, in response to the adjustment of the display parameters, the adjusted display parameters can be obtained, and based on the changes in the display parameters before and after the adjustment, the target video frame to be adjusted is determined; and the target video frame is processed to obtain a video frame that meets the adjusted display parameters;

[0202] The target video frame is a cached input video frame or a cached output video frame.

[0203] In this embodiment, if the display parameters are adjusted, it is possible to determine whether there are input video frames and multiple output video frames corresponding to each input video frame cached at the moment the display parameters are detected to be adjusted. If there are cached, the target video frame can be determined from the cached video data. If there are no cached frames, the currently arriving input video frame needs to be processed according to the adjusted display parameters.

[0204] When determining the target video frame from the cached video data, the input video frame or the output video frame can be directly taken from the cache as the object to be processed, thereby improving the retrieval efficiency; in the process of processing the cached target video frame, the newly arrived input video frame can be cached. If the target video frame is the output video frame, the newly arrived input video frame can be processed according to the original display parameters, and the video frame obtained after processing is cached as the target video frame, so that the target video frame can be reprocessed according to the new display parameters. In this way, after the display parameters change, the processing change transition of the input video frame can be made smoother, reducing the screen frustration caused by the switching of display parameters.

[0205] The following describes the changes in display parameters:

[0206] In the first case, the display parameter changes based on user operations, such as when the user sets the input video to change the display parameter from one display parameter to another, the user can send a display parameter change instruction, which carries the changed display parameter.

[0207] The second case is the change of display parameters based on the change of display device. For example, the input video frame needs to be played on one spliced ​​large screen and switched to another spliced ​​large screen, such as from a 4K spliced ​​large screen to an 8K spliced ​​large screen. The display parameters are changed due to the change in the display performance of the display device of the spliced ​​large screen. At this time, when it is detected that the spliced ​​large screen on which the input video frame is to be played has changed, it indicates that the display parameters have changed, and the display parameters of the changed spliced ​​large screen can be obtained.

[0208] The third case is the change of the display screen of the input video frame based on the video stream. In this case, each input video frame can carry a screen identifier, which is used to indicate whether the screen of this input video frame needs to be blurred. If the screen identifier is 1, it indicates that the screen of the input video frame needs to be blurred. If the screen identifier is 0, it indicates that the screen of the input video frame does not need to be blurred. If blurring is required, it means that the resolution of the input video frame needs to change when it is displayed, and then the display parameters also change.

[0209] Based on the changes in the display parameters, we can know that the display parameters may change in resolution, video format, or both resolution and video format. They may also represent changes in the number of display devices and the splicing method. Different changes may result in slightly different target video frames being processed.

[0210] For example, if the change represents a change in resolution, the cached output video frame may be used as the target video frame; if the change represents a change in non-resolution, the cached input video frame may be used as the target video frame.

[0211] Specifically, when the resolution changes, only the resolution needs to be adjusted without adjusting the video format and segmentation processing. The resolution can be adjusted directly on the output video frame, and the target video frame can be the output video frame. In this way, the output video frame can be directly reprocessed to improve the output efficiency of the new output video frame after the display parameters change, thereby avoiding screen stuttering.

[0212] Specifically, if non-resolution changes occur, such as a change in video format or a change in segmentation method, the format needs to be changed starting from the original input video frame. Therefore, the target video frame can be a cached input video frame.

[0213] Exemplarily, if the target video frame is a cached output video frame, the resolution of the cached output video frame can be processed according to the adjusted display parameters to obtain an output video frame with changed resolution; if the target video frame is a cached input video frame, at least one image processing can be performed on the cached input video frame according to the display parameters; for example, format conversion processing is performed, and segmentation processing is performed on the video frame obtained after the format conversion processing to obtain multiple new output video frames; wherein the format conversion processing is used to convert the input video frame into a video frame that conforms to the changed video format.

[0214] In this example, if the resolution represented by the display parameter changes, the resolution of the cached output video frames that have not been displayed and played will be processed. This processing may include super-resolution processing and low-resolution processing. Super-resolution processing is used to improve the resolution of the output video frames. For example, a video needs to be played from one spliced ​​large screen to another spliced ​​large screen. The resolution of the transferred spliced ​​large screen is higher. The number of display devices and the splicing method have not changed. In this case, the output video frames to be played can be super-resolution processed. The super-resolution processing method can be seen in the process described in the above embodiment, so that new output video frames can be obtained after super-resolution processing. The new output video frames can be sent to the new spliced ​​large screen for playback.

[0215] For another example, the input video frame to be played in the video carries a picture identifier of 1, and the input video frame to be played needs to be blurred. The target video frame is the output video frame with a picture identifier of 1. In this case, the resolution of the output video frame can be reduced to a preset resolution, and the output video frame can be blurred, so that the output video frame has lower clarity due to the lower resolution, thereby protecting the privacy of some pictures in the video. After blurring, a new output video frame is obtained, and the new output video frame is directly displayed on the display device until the output video frame with a picture identifier of 0 is reached, and then the original video processing logic is returned.

[0216] In this example, if the display parameters include a change in the video format, the target video frame can be a cached input video frame regardless of whether the resolution changes. For example, the video format of the output video frame changes from 2D to 3D, or from 3D to 2D. At this time, if image processing is performed on the output video frame, the format conversion process needs to be performed on multiple output video frames, which is relatively complex and inefficient. Therefore, the input video frame can be image processed according to the changed display parameters. Specifically, the process of performing image processing on the input video frame according to the changed display parameters can be to perform segmentation processing on the video frame obtained after the format conversion process to obtain multiple new output video frames. Specifically, it can be performed with reference to the process described in the above embodiment and will not be repeated here.

[0217] For example, a video needs to be played from one spliced ​​large screen to another spliced ​​large screen. The spliced ​​large screen after the transfer is a 3D naked-eye display large screen that can perform 3D display, while the previous spliced ​​large screen cannot perform naked-eye 3D display. In this case, the video format in the display parameters can be converted from a 2D video format to a 3D video format, and the number of display devices and the splicing method remain unchanged. In this case, the input video frames to be played in the cache can be format-converted according to the 3D video format first, and then segmented, according to the video processing logic shown in FIG11. Alternatively, as shown in FIG13, the input video frames to be played in the cache can be format-converted according to the 3D video format first, then super-resolution processed, and then segmented.

[0218] For another example, a video needs to be played from one spliced ​​large screen to another spliced ​​large screen. The spliced ​​large screen after the transfer is a 2D naked-eye display large screen, while the previous spliced ​​large screen can perform naked-eye 3D display. In this case, the video format in the display parameters can be converted from a 3D video format to a 2D video format, and the number of display devices and the splicing method remain unchanged. In this case, the input video frames to be played in the cache can be format-converted according to the 2D video format first, and then segmented, according to the video processing logic shown in FIG12. Alternatively, as shown in FIG10, the input video frames to be played in the cache can be format-converted according to the 2D video format first, and then segmented, and then super-resolution processed.

[0219] For example, if the display parameters include changes in the number of display devices or the splicing method, indicating that the spliced ​​large screen being played has changed and the segmentation processing of the input video frame needs to be changed accordingly, the cached input video frame to be played can be used as the target video frame, and then the target video frame can be processed according to the process described in the above embodiment.

[0220] Based on the same inventive concept, the present disclosure also provides a video processing system. FIG. 14 shows a schematic diagram of the framework structure of the video processing system. As shown in FIG. 14 , the video processing system is used to execute the above-mentioned video processing method. Specifically, the video processing system may include a scheduling unit, an image processing unit, and a display unit:

[0221] The scheduling unit is used to schedule the input video frame to the image processing unit;

[0222] an image processing unit, configured to process the input video frame into a plurality of output video frames based on display parameters of the input video frame when displayed, wherein each output video frame corresponds to a partial area of ​​the input video frame, the display parameters including at least one of a video format and a resolution;

[0223] The display unit is used to display the multiple output video frames on multiple display devices respectively, so that the output video frames are displayed according to the display parameters.

[0224] In this embodiment, the display unit can be a monitoring host connected to each display device. Each display device is connected to a monitoring host. The display unit can send multiple output video frames to multiple monitoring hosts respectively, and the monitoring host will display the received output video frames on the display device.

[0225] The description of the input video frame and display parameters may refer to the description in the embodiment of the video processing method, and will not be repeated here.

[0226] With the technical solution of this embodiment, since the image processing unit divides the input video into multiple output video frames according to the display parameters, the display unit can split the input video frames and display them on multiple display devices, thereby realizing the display of the split video. Particularly, since the display parameters include at least one of the video format and the resolution, when the video is split and displayed, the input video frames can be processed into video frames that meet the expected video format, or processed into video frames that meet the expected resolution, or processed into video frames that meet both the expected video format and the expected resolution, so that input video frames of different video formats and resolutions can be played according to the expected display parameters. As a result, multiple display devices can adapt to multiple videos, achieving the effect of universal playback of multiple videos.

[0227] Referring to Figure 15, a schematic diagram of the framework structure of another video processing system disclosed in the present invention is shown. As shown in Figure 15, the video processing system can also include multiple playback components, and the playback components include multiple display devices, and the multiple display devices are spliced ​​together; wherein the display unit is used to send multiple output video frames to at least one playback component respectively, so that the playback component displays the multiple output video frames on multiple display devices respectively.

[0228] Specifically, multiple display devices are spliced ​​together to obtain a spliced ​​large screen, wherein the playback component can also include the above-mentioned monitoring host. As shown in Figure 1, each playback component may include: multiple monitoring hosts, and display devices connected to each monitoring host; that is, one playback component is used to splice and display video frames.

[0229] Each playback component is connected to the image processing unit, and an input video frame can be spliced ​​and displayed on at least one playback component. For example, as shown in Figure 15, after the input video frame is processed into multiple output video frames according to display parameters, the multiple output video frames can be sent to at least one playback component at the same time. In this way, at least one playback component can simultaneously obtain multiple output video frames, thereby allowing the video to be displayed simultaneously on multiple spliced ​​large screens.

[0230] For example, the display performance of multiple playback components and the number of spliced ​​display devices may differ. The display performance may include the physical resolution and display capability of the display devices in the playback components. The display capability may refer to 3D display capability and 2D display capability. As mentioned above, if a display device is a naked-eye 3D display device, it can display the video to be displayed in naked-eye 3D, and the user can watch the stereoscopic video without the help of auxiliary viewing tools. If a display device does not have naked-eye 3D display capability, it has 2D display capability. If the video to be displayed is a 3D video, the display device can only display it in 2D, and the user needs to use auxiliary viewing tools, such as 3D glasses, to watch the stereoscopic video.

[0231] Wherein, the number of spliced ​​display devices is different, and the number of output video frames that need to be segmented from the input video frame is different, and the segmentation method is also different.

[0232] Accordingly, the display parameters of the input video frame when displayed can be determined based on the display performance of the display device in the playback component and the number of spliced ​​display devices. For example, if the physical resolution of the display device is high and it has 3D display capabilities, the display parameters can be used to indicate that the input video frame is converted into a 3D video and the resolution of the input video frame is increased. For another example, if the physical resolution of the display device is high but it does not have 3D display capabilities, the display parameters can be used to indicate that the resolution of the input video frame is increased. For another example, if the physical resolution of the display device is high but it does not have 3D display capabilities, the display parameters can also be used to indicate that the resolution of the input video frame is increased and the input video frame is converted into a 3D video.

[0233] The display parameters corresponding to the playback components with different numbers of display devices are also different.

[0234] Thus, the display parameters corresponding to the multiple playback components may differ. As described in the embodiment of the video processing method above, the video processing logic for performing video processing on the input video frame can be determined in combination with the input parameters and display parameters of the input video, including the first video processing logic, the second video processing logic, and the third video processing logic. When the display parameters corresponding to the multiple playback components differ, when the same input video frame needs to be displayed on multiple playback components, the video processing logic for the multiple playback components will differ.

[0235] To address the differences between playback components, the video processing system may include multiple image processing units. Different image processing units may correspond to playback components composed of different numbers of display devices and / or display components composed of display devices with different display capabilities. Specifically, different image processing units may correspond to different numbers of display devices, or playback components composed of display devices with different display capabilities; or, alternatively, different numbers of display devices and playback components composed of display devices with different display capabilities.

[0236] Correspondingly, when the same input video frame is input into the video processing system, at least one target playback component to be displayed for the input video frame can be determined, and the input video frame can be sent to the image processing unit corresponding to at least one of the target playback components, so that the input video frame is processed in the image processing unit.

[0237] For example, if different image processing units correspond to playback components spliced ​​together by different numbers of display devices, then one image processing unit is for playback components spliced ​​together by the same number of display devices; if different image processing units correspond to playback components spliced ​​together by display devices with different display performances, then one image processing unit is for playback components spliced ​​together by display devices with the same display performance. In this case, different image processing units may have different video processing logic for the input video frames.

[0238] For example, as shown in Figure 15, four groups of playback components are included, among which playback component A and playback component B each include four display devices, and the display performance of the eight display devices is the same, such as 8K spliced ​​large screens, then the playback component A and playback component B correspond to the same image processing unit 1; playback component C includes three display devices, and all three display devices can realize naked-eye 3D display, then the playback component C corresponds to image processing unit 2; playback component D includes nine display devices, then the playback component D corresponds to image processing unit 3.

[0239] When a video needs to be played on playback component A, playback component B and playback component C, the scheduling unit will send the input video frames in the video to image processing unit 1 and image processing unit 2. Image processing unit 1 will process the input video frames according to the first video processing logic mentioned above, and send the output multiple video frames to playback component A and playback component B at the same time; image processing unit 2 will process the input video frames according to the second video processing logic or the third video processing logic mentioned above, and send the output multiple output video frames to playback component C at the same time.

[0240] In some embodiments, the image processing unit may include multiple image processing modules, and different image processing modules are used to perform different image processing. The multiple image processing modules may include at least a segmentation module and a super-resolution module.

[0241] As described above, when processing the input video frame based on the input parameters and display parameters, different combinations of input parameters and display parameters may have different video processing logics. Under different video processing logics, the image processing to be performed and the execution order between the image processing are different. In this case, the scheduling unit can be used to determine at least one target image processing module to be scheduled and the execution order between the target image processing modules based on the input parameters and display parameters of the input video frame; and to schedule the video frame processed by the previous target image processing module to the next target image processing module according to the execution order during the scheduling process; wherein the scheduled target image processing module includes a segmentation module, which is used to segment the video frame input to the segmentation module into multiple sub-video frames, and the multiple sub-video frames respectively correspond to multiple output video frames.

[0242] Referring to Figure 16, there is shown a schematic diagram of the framework structure of another video processing system disclosed in the present invention. As shown in Figure 16, an image processing unit includes multiple image processing modules, and different image processing modules are used to perform different image processing. When the input video frame arrives, the corresponding video processing logic can be determined according to the display parameters and the input parameters. According to the video processing logic, the target image processing module to be scheduled and the execution order between the target image processing modules are determined, wherein the execution order between the target image processing modules represents the execution order between the image processing.

[0243] Exemplarily, when the video format of the input video frame is different from the video format of the output video frame, the input video frame needs to be format converted. If super-resolution processing is not required, the target image processing module includes a format conversion module and a segmentation module; wherein the scheduling order of the format conversion module is before the segmentation module, and the format conversion module is used to convert the input video frame into a video frame that conforms to the video format in the display parameters.

[0244] For example, taking the second video processing logic mentioned above as an example, if the input video frame needs to be format converted and segmented, the format conversion can be performed online and then the segmentation can be performed. When scheduling, the scheduling unit can first schedule the input video frame to the format conversion module, and then schedule the output of the format conversion module to the segmentation module.

[0245] In another exemplary embodiment, the display parameters include a video format and a resolution. When the resolution of the input video frame is lower than the resolution of the output video frame, the target image processing module further includes a super-resolution module; the super-resolution module is configured to perform pixel expansion on the video frame input to the super-resolution module; wherein:

[0246] The scheduling unit is further used to determine the execution order between the super-resolution module and the segmentation module based on the video format of the input video frame;

[0247] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a three-dimensional video format, the execution order of the super-resolution module is better than that of the segmentation module;

[0248] Wherein, when the video format of the input video frame is a two-dimensional video format and the video format of the output video frame is a two-dimensional video format, the execution order of the super-resolution module lags behind that of the segmentation module.

[0249] Taking the first video processing logic as an example, if the input video frame does not need to be format converted, but needs to be super-resolution processed and segmented, the execution order of the super-resolution and segmentation processes can be determined based on the format of the input video frame. As shown in Figure 9, if the input video frame is in a 2D video format, it can be determined that the execution order of the segmentation module is higher than the execution order of the super-resolution module. Then, when scheduling, the scheduling unit can first schedule the input video frame to the segmentation module, and then schedule the output of the segmentation module to the super-resolution module. As shown in Figure 10, if the input video frame is in a 3D video format, it can be determined that the execution order of the super-resolution module is higher than the execution order of the segmentation module. Then, when scheduling, the scheduling unit can first schedule the input video frame to the super-resolution module, and then schedule the output of the segmentation module to the segmentation module.

[0250] In another exemplary embodiment, the segmentation module includes a first segmentation module and a second segmentation module; wherein the first segmentation module is configured to perform image segmentation on the video frames of the input two-dimensional video according to a splicing method of multiple display devices;

[0251] Among them, the second segmentation module is used to extract the sub-video frame belonging to each viewpoint from the video frame of the input three-dimensional video, and divide the multiple pixels in the sub-video frame of each viewpoint according to the splicing method of multiple display devices to obtain the pixels included in different regional positions of each viewpoint; and splice the pixels belonging to the same regional position in multiple viewpoints.

[0252] Among them, the segmentation module may include a first segmentation module corresponding to the video frame in the two-dimensional video format, and a second segmentation module corresponding to the video frame in the three-dimensional video format. Among them, the processing method of the video frame by the first segmentation module can be shown in Figure 9, and the processing method of the video frame by the second segmentation module can be shown in Figure 10. That is, the scheduling unit can schedule the video frame in the two-dimensional video format to be processed to the first segmentation module, and schedule the video frame in the three-dimensional video format to the second segmentation module.

[0253] Exemplarily, when the output video frame is in a three-dimensional video format and the input video frame is in a two-dimensional video format, the format conversion module is used to generate sub-video frames of multiple different viewpoints of the input video frame based on the input video frame and a depth map corresponding to the input video frame, where the sub-video frame of each viewpoint includes pixels at multiple positions of the viewpoint.

[0254] Also exemplarily, the super-resolution module includes a first super-resolution module and a second super-resolution module; wherein: the first super-resolution module is used to insert at least a circle of preset pixels at the edge of the input video frame, and the pixel value of the preset pixels is a preset value; the second super-resolution module is used to perform the pixel expansion on the video frame output by the first super-resolution module.

[0255] As described in the above embodiment, when the input video frame is in a two-dimensional video format and the output video frame is also in a two-dimensional video format, if super-resolution processing is required, the input video frame can be padded first, and then the padded input video frame can be segmented, and then the segmented sub-video frame can be padded again, that is, it includes two padded times. The padded input video frame can be performed by the first super-resolution module, and the padded sub-video frame can be performed by the second super-resolution module. The scheduling unit can first schedule the input video frame to the first super-resolution module, and then schedule the output of the first super-resolution module to the segmentation module, and then schedule the output of the segmentation module to the second super-resolution module, and the output of the second super-resolution module can be scheduled to the display unit.

[0256] For example, as shown in FIG16 , taking the case where an input video frame needs to be played on playback component A and playback component C, playback component A and playback component C correspond to different display parameters and therefore correspond to different video processing logics. As shown by the solid arrow in FIG16 , playback component A corresponds to the first type of video processing logic, and the scheduling unit schedules the input video frame to the first super-resolution module, which performs edge padding on the input video frame. Next, the edge-padded input video frame output by the first super-resolution module is scheduled to the segmentation module. The segmentation module segments the input video frame in a four-grid manner to obtain four sub-video frames. Next, the scheduling unit schedules the four sub-video frames to the second super-resolution module. The second super-resolution module increases the resolution of the sub-video frame and outputs the sub-video frames. The output multiple video frames are then sent to playback component A.

[0257] As shown by the dotted arrow in Figure 16, the playback component C corresponds to the third video processing logic. As shown by the dotted arrow in the figure, the scheduling unit schedules the input video frame to the format conversion module. The format conversion module restores multiple viewpoints and sub-video frames of each viewpoint based on the input video frame and the depth map corresponding to the input video frame; then, the scheduling unit schedules the sub-video frames of multiple viewpoints to the second super-resolution module. The second super-resolution module extends the edge of the sub-video frame of each viewpoint by at least one circle of pixels with a pixel value of 0, and then sends the sub-video frames of each viewpoint after the edge filling to the restoration model to obtain high-resolution sub-video frames; thereafter, the scheduling unit schedules the sub-video frames of multiple viewpoints output by the second super-resolution module to the segmentation module. The segmentation module rearranges the pixels of the high-resolution sub-video frame to obtain multiple output video frames, and the output multiple output video frames are sent to the playback component C.

[0258] Referring to Figure 17, a structural diagram of another video processing system is shown. As shown in Figure 17, in an optional example of this embodiment, a detection module can also be included. The detection module can be used to detect changes in the playback component to be displayed of the input video frame, changes in the picture identification of the input video frame, and to monitor whether a parameter change instruction is received. If a change in the playback component is detected, the changed display parameters are generated according to the display performance, quantity and splicing method of the display device in the changed playback component; if a change in the picture identification of the input video frame is detected, the changed display parameters are generated according to the current changed picture identification. In this case, if the picture identification changes from 0 to 1, the resolution in the display parameters changes from low resolution to high resolution, and if the picture identification changes from 1 to 0, the resolution in the display parameters changes from high resolution to low resolution.

[0259] If a change instruction is detected and received, the display parameters carried in the change instruction are used as the changed display parameters.

[0260] In this case, the scheduling unit can compare the changes in display parameters before and after the change. If the resolution changes, the output video frame to be played can be extracted from the cache module, and the output video frame can be scheduled to the second super-resolution module to increase the resolution, or scheduled to the low-resolution processing module to reduce the resolution; if the video format changes, the input video frame to be played can be extracted from the cache module, and the input video frame can be scheduled to the format conversion module, and then subsequent video scheduling can be performed according to the corresponding video processing logic.

[0261] Based on the same inventive concept, the present disclosure also provides a video playback system, including a video processing module and a display module connected to the video processing module, wherein the display module is spliced ​​together from multiple display devices, wherein multiple display modules may be included, and the video processing module can be used to execute the above-mentioned video processing method.

[0262] Based on the same inventive concept, the present disclosure further provides a video processing device, as shown in FIG18 , which shows a schematic diagram of the framework of the video processing device. As shown in FIG18 , the device can be located in the video processing module of the above-mentioned video playback system, and specifically includes the following modules:

[0263] a parameter acquisition module, configured to acquire an input video frame and display parameters of the input video frame when displayed, wherein the display parameters include at least one of a video format and a resolution;

[0264] a processing module, configured to process the input video frame into a plurality of output video frames based on the display parameters, wherein one of the output video frames corresponds to a partial region of the input video frame;

[0265] The display module is used to display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters.

[0266] Optionally, the processing module includes:

[0267] An input parameter acquisition unit, configured to acquire input parameters of the input video frame, wherein the input parameters include at least one of a video format and a resolution;

[0268] an image processing unit, configured to sequentially perform at least one image processing on the input video frame based on the input parameters and the display parameters; wherein the image processing includes a segmentation process, wherein the segmentation process is configured to segment the current video frame into a plurality of sub-video frames;

[0269] Optionally, the image processing unit specifically includes:

[0270] a first processing unit configured to perform a format conversion process on the input video frame when the video format is different from the video format of the input video frame, wherein the format conversion process is configured to convert the input video frame into a first video frame conforming to the video format in the display parameters;

[0271] The second processing unit is configured to perform the segmentation process on the first video frame to obtain a plurality of output video frames.

[0272] Optionally, the input video frame is in a two-dimensional video format, the output video frame is in a three-dimensional video format, and the first processing unit is specifically used to obtain a depth map corresponding to the input video frame; and based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, generate sub-video frames corresponding to multiple viewpoints, wherein the sub-video frames corresponding to the multiple viewpoints include pixels of the viewpoint at multiple positions.

[0273] Optionally, the first video frame includes multiple viewpoints and pixels at multiple positions of each viewpoint; the second processing unit is specifically used to divide the multiple pixels included in each viewpoint according to the splicing method of the multiple display devices, to obtain the pixels included in different regional positions of each viewpoint; and, to splice the pixels belonging to the same regional position in the multiple viewpoints, to obtain output video frames corresponding to the multiple regional positions.

[0274] Optionally, the display parameter includes the resolution, at least one of the image processing further includes super-resolution processing, and the image processing unit includes:

[0275] an order determination subunit, configured to determine, when the resolution of the output video frame is higher than the resolution of the input video frame, an execution order between the segmentation process and the super-resolution process based on a video format of the output video frame; wherein the super-resolution process is used to increase the resolution of the input video frame;

[0276] The third processing unit is used to perform the super-resolution processing on the input second video frame according to the resolution of the output video frame when the execution order of the super-resolution processing arrives; wherein the second video frame is the input video frame, or the sub-video frame.

[0277] Optionally, the order determination subunit is specifically used to determine that the execution order of the segmentation processing takes precedence over the execution order of the super-resolution processing if the video format of the output video frame is a two-dimensional video format; if the video format of the output video frame is a three-dimensional video format, then determine that the execution order of the segmentation processing lags behind the execution order of the super-resolution processing.

[0278] Optionally, the video format of the output video frame is a three-dimensional video format, the execution order of the segmentation processing lags behind the execution order of the super-resolution processing, and the third processing unit is used to extract sub-video frames belonging to each viewpoint from the second video frame, and the sub-video frame of each viewpoint includes pixels at multiple positions; and pixel expansion is performed on the pixels in the sub-video frames of each viewpoint; wherein the segmentation processing is used to rearrange the pixels in the sub-video frames of the multiple viewpoints after the pixel expansion according to the splicing method of the multiple display devices to obtain the output video frame.

[0279] Optionally, the execution order of the segmentation processing takes precedence over the execution order of the super-resolution processing, and the third processing unit is used to perform pixel expansion on the pixels included in each sub-video frame of the multiple sub-video frames to obtain an output video frame corresponding to each sub-video frame.

[0280] Optionally, the step of performing pixel expansion includes: for each of the sub-video frames, inserting at least one circle of first pixels outside the first edge of the sub-video frame to obtain an intermediate sub-video frame; wherein the pixel value of the first pixel is a preset value; and performing pixel expansion on the pixels included in each of the intermediate sub-video frames.

[0281] Optionally, the video format of the input video frame is a two-dimensional video format, and the apparatus further includes:

[0282] A first edge-filling module is configured to insert at least one circle of second pixels outside the second edge of the input video frame to obtain a third video frame; wherein the pixel value of the second pixel is a preset value;

[0283] The second processing unit is specifically configured to perform the segmentation process on the third video frame to obtain a plurality of sub-video frames; wherein the first edge is an edge in the sub-video frame excluding the second edge.

[0284] Optionally, the input video frame includes a plurality of frames, and the apparatus further includes:

[0285] a cache module, configured to cache the plurality of input video frames and the output video frames respectively corresponding to the plurality of input video frames, so as to sequentially display the output video frames according to a frame sequence of the output video frames;

[0286] a change determination module, configured to, in response to an adjustment operation on the display parameter, determine a target video frame to be adjusted based on a change in the display parameter before and after the adjustment; wherein the target video frame is a buffered input video frame or a buffered output video frame;

[0287] The post-processing module is used to process the target video frame to obtain a video frame that meets the adjusted display parameters.

[0288] Optionally, the change determination module is configured to use the cached output video frame as the target video frame when the change indicates that the resolution has changed; wherein the cached output video frame is the output video frame to be displayed at the current moment;

[0289] And, in a case where the change represents a change in a non-resolution aspect, the buffered input video frame is used as the target video frame.

[0290] Optionally, the post-processing module is specifically configured to, if the target video frame is the output video frame, process the resolution of the cached output video frame according to the adjusted display parameters to obtain an output video frame with a changed resolution; if the target video frame is the input video frame, perform format conversion processing on the cached input video frame, and perform the segmentation processing on the video frame obtained after the format conversion processing to obtain multiple new output video frames;

[0291] The format conversion process is used to convert the buffered input video frames into video frames that conform to the changed video format.

[0292] The embodiment of the video processing device of this embodiment is similar to the embodiment of the video processing method described above. The relevant parts may refer to the embodiment of the video processing method described above and will not be described in detail here.

[0293] The embodiment of the present disclosure further provides an electronic device, wherein a computer program stored in the electronic device enables a processor to execute the video processing method as described in the embodiment of the present disclosure.

[0294] The embodiment of the present disclosure further provides a computer-readable storage medium, which stores a computer program that enables a processor to execute the video processing method as described in the embodiment of the present disclosure.

[0295] The various embodiments in this specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between the various embodiments can be referenced to each other.

[0296] Finally, it should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, commodity, or device that includes a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, commodity, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of additional identical elements in the process, method, commodity, or device that includes the element.

[0297] The above is a detailed introduction to a video processing method and system, video playback system, device, equipment and medium provided by the present disclosure. Specific examples are used herein to illustrate the principles and implementation methods of the present disclosure. The description of the above embodiments is only used to help understand the method and core ideas of the present disclosure. At the same time, for those skilled in the art, according to the ideas of the present disclosure, there may be changes in the specific implementation methods and application scopes. In summary, the contents of this specification should not be understood as limiting the present disclosure.

[0298] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0299] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

[0300] References herein to "one embodiment," "an embodiment," or "one or more embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Furthermore, please note that instances of the phrase "in one embodiment" do not necessarily all refer to the same embodiment.

[0301] In the description provided herein, numerous specific details are described. However, it is understood that embodiments of the present disclosure may be practiced without these specific details. In some instances, well-known methods, structures, and techniques are not shown in detail so as not to obscure the understanding of this description.

[0302] In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. The word "comprising" does not exclude the presence of elements or steps not listed in the claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The present disclosure may be implemented by means of hardware comprising several different elements and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names.

[0303] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present disclosure, rather than to limit them. Although the present disclosure has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present disclosure.

Claims

1. A video processing method, characterized in that: The method comprises: Acquire an input video frame and display parameters of the input video frame when it is displayed, wherein the display parameters include at least one of a video format and a resolution; Based on the display parameters, the input video frame is processed into a plurality of output video frames, wherein one of the output video frames corresponds to a partial area of ​​the input video frame; The plurality of output video frames are displayed on a plurality of display devices respectively, so that the plurality of output video frames are displayed according to the display parameters.

2. The method according to claim 1, characterized in that The step of processing the input video frame into a plurality of output sub-video frames based on the display parameter comprises: Acquire input parameters of the input video frame, wherein the input parameters include at least one of a video format and a resolution; Based on the input parameters and the display parameters, at least one image processing is performed on the input video frame in sequence; wherein the image processing includes segmentation processing, and the segmentation processing is used to segment the current video frame into a plurality of sub-video frames; The multiple sub-video frames correspond to the multiple output video frames respectively, and the current video frame is the input video frame, or is a video frame obtained after the input video frame is subjected to image processing other than the segmentation processing.

3. The method according to claim 2, characterized in that The input parameter includes the video format; and the performing at least one image processing on the video frame in sequence based on the input parameter and the display parameter includes: When the video format is different from the video format of the input video frame, performing a format conversion process on the input video frame, wherein the format conversion process is used to convert the input video frame into a first video frame that conforms to the video format in the display parameter; The segmentation process is performed on the first video frame to obtain a plurality of output video frames.

4. The method according to claim 3, characterized in that The input video frame is in a two-dimensional video format, the video format of the output video frame is in a three-dimensional video format, and the format conversion process of the input video frame includes: Obtaining a depth map corresponding to the input video frame; Based on the depth value corresponding to each pixel in the depth map and the pixel value corresponding to each pixel in the input video frame, sub-video frames corresponding to multiple viewpoints are generated, and the sub-video frame corresponding to each viewpoint includes pixels of the viewpoint at multiple positions.

5. The method according to claim 3, characterized in that: The first video frame includes a plurality of viewpoints and pixels of each viewpoint at a plurality of positions; the segmentation process is performed on the first video frame to obtain a plurality of output video frames, including: Dividing the multiple pixels included in each of the viewpoints according to the splicing method of the multiple display devices to obtain the pixels included in different area positions of each viewpoint; Pixels belonging to the same regional position in the multiple viewpoints are spliced ​​to obtain output video frames corresponding to the multiple regional positions respectively.

6. The method according to claim 2, characterized in that The display parameter includes the resolution, the at least one image processing further includes super-resolution processing, and the at least one image processing is sequentially performed on the video frame based on the input parameter and the display parameter, including: When the resolution of the output video frame is higher than the resolution of the input video frame, determining the execution order between the segmentation process and the super-resolution process based on the video format of the output video frame; wherein the super-resolution process is used to improve the resolution of the input video frame; When the execution order of the super-resolution processing arrives, the input second video frame is subjected to the super-resolution processing according to the resolution of the output video frame; The second video frame is the input video frame, or the sub-video frame.

7. The method according to claim 6, characterized in that The step of determining the execution order of the segmentation process and the super-resolution process based on the video format of the output video frame comprises: If the video format of the output video frame is a two-dimensional video format, determining that the execution order of the segmentation process takes precedence over the execution order of the super-resolution process; If the video format of the output video frame is a three-dimensional video format, it is determined that the execution order of the segmentation process lags behind the execution order of the super-resolution process.

8. The method according to claim 6, characterized in that The video format of the output video frame is a three-dimensional video format, the execution order of the segmentation process lags behind the execution order of the super-resolution process, and the super-resolution process of the input second video frame includes: Extracting sub-video frames belonging to each viewpoint from the second video frame, respectively, wherein the sub-video frame of each viewpoint includes pixels at multiple positions; Performing pixel expansion on pixels in the sub-video frames of each of the viewpoints; The segmentation process is used to rearrange the pixels in the sub-video frames of the plurality of viewpoints after the pixel expansion according to the splicing mode of the plurality of display devices to obtain the output video frame.

9. The method according to claim 6, characterized in that The video format of the output video frame is a two-dimensional video format, the execution order of the segmentation process takes precedence over the execution order of the super-resolution process, and the super-resolution process is performed on the input second video frame, including: For each sub-video frame among the multiple sub-video frames, pixels included in the sub-video frame are expanded to obtain output video frames corresponding to each sub-video frame.

10. The method according to claim 8 or 9, characterized in that: The pixel expansion comprises: For each of the sub-video frames, insert at least one circle of first pixels outside the first edge of the sub-video frame to obtain an intermediate sub-video frame; wherein the pixel value of the first pixel is a preset value; The pixel expansion is performed on the pixels included in each of the intermediate sub-video frames.

11. The method according to claim 10, characterized in that The video format of the input video frame is a two-dimensional video format. Before performing pixel expansion, the method further includes: Inserting at least one circle of second pixels outside the second edge of the input video frame to obtain a third video frame; wherein the pixel value of the second pixel is a preset value; Performing the segmentation process on the third video frame to obtain a plurality of sub-video frames; The first edge is an edge in the sub-video frame except the second edge.

12. The method according to claim 1, characterized in that The input video frame includes a plurality of frames, and the method further includes: The plurality of input video frames and the plurality of output video frames corresponding to the input video frames are respectively caching to sequentially display the output video frames according to the frame sequence of the output video frames; The method further comprises: In response to the adjustment operation of the display parameter, based on the change of the display parameter before and after the adjustment, determining a target video frame to be adjusted; wherein the target video frame is a cached input video frame or a cached output video frame; The target video frame is processed to obtain a video frame that meets the adjusted display parameters.

13. The method according to claim 12, characterized in that Determining a target video frame to be adjusted based on the change of the display parameter before and after the adjustment includes: In the case where the change represents a change in the resolution, the cached output video frame is used as the target video frame; wherein the cached output video frame is the output video frame to be displayed at the current moment; In the case where the change is other changes except the resolution change, the buffered input video frame is used as the target video frame.

14. The method according to claim 12, characterized in that The processing of the target video frame to obtain a video frame that meets the adjusted display parameters includes: If the target video frame is the output video frame, the resolution of the cached output video frame is processed according to the adjusted display parameters to obtain an output video frame with a changed resolution; If the target video frame is the buffered input video frame, the buffered input video frame is processed into a plurality of new output video frames based on the adjusted display parameters.

15. A video processing system, characterized in that: include: Scheduling unit, image processing unit and display unit; The scheduling unit is used to schedule the input video frame to the image processing unit; The image processing unit is used to process the input video frame into a plurality of output video frames based on display parameters of the input video frame when displayed, wherein one of the output video frames corresponds to a partial area on the input video frame, and the display parameters include at least one of a video format and a resolution; The display unit is used to display the multiple output video frames on multiple display devices respectively, so that the output video frames are displayed according to the display parameters.

16. The system according to claim 15, characterized in that The image processing unit includes a plurality of image processing modules; The scheduling unit is used to determine at least one target image processing module to be scheduled and an execution order between the target image processing modules among the multiple image processing modules based on the input parameters of the input video frame and the display parameters; And, in the scheduling process, according to the execution order, the video frame processed by the previous target image processing module is scheduled to the next target image processing module; wherein the scheduled target image processing module includes a segmentation module, and the segmentation module is used to segment the video frame input to the segmentation module into multiple sub-video frames; The multiple sub-video frames correspond to the multiple output video frames respectively.

17. The system according to claim 16, characterized in that When the video format of the input video frame is different from the video format of the output video frame, the target image processing module includes a format conversion module and the segmentation module; The format conversion module is scheduled before the segmentation module, and is used to convert the input video frame into a video frame that complies with the video format in the display parameter.

18. The system according to claim 16, characterized in that In the case where the resolution of the input video frame is lower than the resolution of the output video frame, the target image processing module further comprises a super-resolution module; the super-resolution module is used to perform pixel expansion on the video frame input to the super-resolution module; wherein: The scheduling unit is further used to determine the execution order between the super-resolution module and the segmentation module based on the video format of the output video frame; Among them, when the video format of the output video frame is a three-dimensional video format, the execution order of the super-resolution module is superior to that of the segmentation module; when the video format of the output video frame is a two-dimensional video format, the execution order of the super-resolution module lags behind that of the segmentation module.

19. The system according to claim 18, characterized in that The segmentation module includes a first segmentation module and a second segmentation module; The first segmentation module is used to segment the display devices in accordance with the splicing method of the plurality of display devices. Perform image segmentation on the video frames of the input two-dimensional video; The second segmentation module is used to extract the sub-video frame belonging to each viewpoint from the video frame of the input three-dimensional video, and divide the multiple pixels in the sub-video frame of each viewpoint according to the splicing method of multiple display devices to obtain the pixels included in different area positions of each viewpoint; and splice the pixels belonging to the same area position in multiple viewpoints.

20. The system according to claim 16, characterized in that When the output video frame is in a three-dimensional video format and the input video frame is in a two-dimensional video format, the format conversion module is used to generate sub-video frames of multiple different viewpoints of the input video frame based on the input video frame and a depth map corresponding to the input video frame, and each of the sub-video frames of the viewpoint includes pixels at multiple positions of the viewpoint.

21. The system according to claim 17, characterized in that The super-resolution module includes a first super-resolution module and a second super-resolution module; wherein: The first super-resolution module is used to insert at least one circle of preset pixels at the edge of the input sub-video frame, and the pixel values ​​of the preset pixels are preset values; The second super-resolution module is used to perform the pixel expansion on the sub-video frame output by the first super-resolution module.

22. The system according to any one of claims 15 to 21, characterized in that: The system includes a plurality of playback components, the playback components include a plurality of the display devices, and the plurality of the display devices are spliced ​​with each other; Wherein, the display unit is used to send the multiple output video frames to at least one of the playback components respectively, so that the playback component displays the multiple output video frames on multiple display devices respectively.

23. The system according to claim 22, characterized in that It includes a plurality of image processing units; wherein different image processing units correspond to playback components spliced ​​by different numbers of display devices, and / or correspond to playback components spliced ​​by display devices with different display performances; The scheduling unit is specifically configured to send the input video frame to the image processing unit corresponding to at least one target playback component according to the at least one target playback component to be displayed by the input video frame.

24. A video playback system, characterized in that: It comprises a video processing module and a display module connected to the video processing module, wherein the display module is obtained by splicing a plurality of display devices; wherein the video processing module is used to execute the video processing method described in any one of claims 1-14.

25. A video processing device, characterized in that: include: A parameter acquisition module, used to acquire an input video frame and display parameters of the input video frame when it is displayed, wherein the display parameters include at least one of a video format and a resolution; A processing module, configured to process the input video frame into a plurality of output video frames based on the display parameter, wherein one of the output video frames corresponds to a partial area of ​​the input video frame; The display module is used to display the multiple output video frames on multiple display devices respectively, so that the multiple output video frames are displayed according to the display parameters.

26. An electronic device, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes, the video processing method according to any one of claims 1 to 14 is implemented.

27. A computer-readable storage medium, characterized in that: The computer program stored therein enables the processor to execute the video processing method as described in any one of claims 1-14.

Images