Display control method, device, equipment, system and storage medium of video
By cropping and splicing the video before rendering, the problem of blurry images caused by hardware limitations in high-resolution video display is solved, and clear display of high-resolution video is achieved.
Patent Information
- Application Number
- CN202310612437.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-26
- Publication Date
- 2025-11-28
- Estimated Expiration
- 2043-05-26
AI Technical Summary
In existing technologies, the display of high-resolution videos is limited by the maximum display texture of hardware devices and GPUs, which requires compression and transcoding of the image during rendering, resulting in a blurry output image that cannot meet the display requirements of high-resolution videos.
By cropping the image before rendering, N target sub-images are determined, ensuring that the total size of the spliced image is the same as the original video. Each sub-image is rendered separately and then spliced together for output, avoiding compression and transcoding, and ensuring that the total size of the output image is consistent with the original video.
It effectively avoids the blurring problem caused by compression and transcoding during rendering, and meets the display requirements of high-resolution video.
Smart Images

Figure CN116489457B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The application belongs to the technical field of display screens, and particularly relates to a video display control method, device, equipment, system and storage medium. BACKGROUND
[0002] With the development of display screen technology and the increase of display screen application scenarios, in some scenarios, a user needs to play a high-resolution video through a display screen, for example, needs to play a 20000*200 resolution video through the display screen. Limited by the maximum display texture that can be supported by a hardware device and a graphics processing unit (GPU), in the related art, when a high-resolution video is rendered, the video is usually compressed to be within the resolution limit corresponding to the maximum display texture, and then is output to the display screen for display after being rendered. Compression and transcoding during rendering is prone to cause the output picture to be blurred, and it is difficult to meet the display requirement of the high-resolution video. SUMMARY
[0003] Embodiments of the application provide a video display control method, device, equipment, system and storage medium, which can solve the problem that the display requirement of a high-resolution video is difficult to be met in the related art.
[0004] An embodiment of the application provides a video display control method, which comprises the following steps: obtaining a video to be rendered, the video to be rendered being an original video of a first preset size or a video of a second preset size obtained by transcoding the original video, the second preset size being smaller than the first preset size; determining N target sub-pictures according to a video picture of the video to be rendered, N being a positive integer greater than 1, wherein the total size of the N target sub-pictures after splicing is the same as the first preset size; rendering each target sub-picture respectively to obtain N rendered sub-pictures; splicing the N rendered sub-pictures to obtain a rendered picture; and outputting the rendered picture to a display screen for display.
[0005] The second aspect of the embodiment of the present application provides a video display control device, comprising: an acquisition unit configured to acquire a video to be rendered, wherein the video to be rendered is an original video of a first preset size, or a video of a second preset size obtained by transcoding the original video, and the second preset size is smaller than the first preset size; a determination unit configured to determine N target sub-pictures according to a video picture of the video to be rendered, wherein N is a positive integer greater than 1, and a total size of the N target sub-pictures after splicing is the same as the first preset size; a rendering unit configured to render each of the target sub-pictures to obtain N rendered sub-pictures; a splicing unit configured to splice the N rendered sub-pictures to obtain a rendered picture; and a display unit configured to output the rendered picture to a display screen for display.
[0006] The third aspect of the embodiment of the present application provides a playing control device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, and the processor implements the steps of the video display control method when executing the computer program.
[0007] The fourth aspect of the embodiment of the present application provides a display control system, comprising a host computer, a display screen, and a playing control device connected with the host computer and the display screen respectively; the host computer is configured to acquire a video to be rendered, and transmit the video to be rendered to the playing control device, wherein the video to be rendered is an original video of a first preset size, or a video of a second preset size obtained by transcoding the original video when the first preset size is greater than a maximum decoding size of the playing control device, and the second preset size is smaller than or equal to the maximum decoding size; the playing control device is configured to acquire the video to be rendered transmitted by the host computer, and output a rendered picture to the display screen according to the video display control method of the first aspect; and the display screen is configured to display the rendered picture.
[0008] The fifth aspect of the embodiment of the present application provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the steps of the video display control method.
[0009] The sixth aspect of the embodiment of the present application provides a computer program product, which, when executed on a playing control device, causes the playing control device to execute the video display control method.
[0010] In the embodiments of the present application, by acquiring a video to be rendered, and determining N target sub-pictures according to the video pictures of the video to be rendered, so that the total size of the N target sub-pictures after splicing is the same as the size of the original video, then rendering each target sub-picture respectively to obtain N rendered sub-pictures, and splicing the N rendered sub-pictures to obtain a rendered picture, the rendered picture is output to the display screen for display, so that the total size of the rendered picture is the same as the size of the original video, avoiding the problem that the output picture is blurred due to compression and transcoding during rendering, and meeting the display requirement of high-resolution video. BRIEF DESCRIPTION OF DRAWINGS
[0011] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed to be used in the embodiments or prior art description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.
[0012] Figure 1 is a schematic diagram of an implementation process of a video display control method provided by an embodiment of the present application;
[0013] Figure 2 is a structural schematic diagram of a video display control device provided by an embodiment of the present application;
[0014] Figure 3 is a structural schematic diagram of a playing control device provided by an embodiment of the present application;
[0015] Figure 4 is a specific structural schematic diagram of a display control system provided by an embodiment of the present application. DETAILED DESCRIPTION
[0016] In order to make the purpose, technical solutions and advantages of the present application more clear, the present application will be further described in detail below with reference to the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without creative labor are within the scope of protection of the present application.
[0017] In the related art, when rendering a high-resolution video, the video is usually compressed and transcoded to a resolution limit corresponding to a maximum display texture supported by a hardware device and a graphics processing unit (GPU), and then rendered and output to a display screen for display. Specifically, some GPU chips currently support a maximum bandwidth of 16384. If the width of the original video exceeds 16384, the video pictures of the original video need to be compressed and encoded to a width of 16384, and then tiled to a canvas with a width of 16384 for rendering. Then, the rendered pictures are transmitted to the corresponding boxes, and the boxes are spliced and displayed when connected to the screen, achieving the effect of playing a high-resolution video with a width of 16384. Compressing and transcoding during rendering can easily cause the pictures output to the display screen to appear blurred. For example, for an original video with a width of 20000, the pictures output by this method have a width of 16384, which cannot meet the display requirements of high-resolution videos.
[0018] Therefore, the present application provides a display control method for a video, which can crop pictures before rendering, so that the rendered pictures are not easily limited by the resolution of the GPU, the total size of the rendered pictures is the same as that of the original video, and the problem of blurred pictures caused by compression and transcoding during rendering is avoided, meeting the display requirements of high-resolution videos.
[0019] To illustrate the technical solutions of the present application, specific embodiments are described below.
[0020] Figure 1 An implementation flowchart of a display control method for a video provided by an embodiment of the present application is shown, which can be applied to a playback control device and can be used in a situation where the display requirements of high-resolution videos need to be met.
[0021] It should be understood that the playback control device can be a computer, a mobile phone, or other intelligent devices with video processing capabilities, or a dedicated video processing device such as a playback box, and the present application does not limit the playback control device.
[0022] Specifically, the display control method for a video can include the following steps S101-S105.
[0023] In step S101, a video to be rendered is obtained.
[0024] The video to be rendered refers to a video that needs to be rendered by a GPU.
[0025] In the embodiments of the present application, the video to be rendered can be an original video with a first preset size, or a video with a second preset size obtained by transcoding the original video.
[0026] The original video is a video that has not been processed, and the first preset size can represent the resolution of the original video. The second preset size is smaller than the first preset size.
[0027] Specifically, the playback control device can be connected with a host computer. The host computer is a device for controlling the playback control device or transmitting data to the playback control device, and can be a computer, a mobile phone or other smart device. The user can select the original video to be displayed on the display screen on the host computer, or frame by frame capture the display screen of the host computer to generate the original video, and then transmit the original video to the playback control device through the host computer.
[0028] Considering that the playback control device usually needs to be decoded after receiving the original video, in the related art, due to cost constraints, the decoding device on the playback control device, such as an ARM (Advanced RISC Machine) board card, usually has limited decoding capability. In order to meet the decoding capability of the playback control device, in some embodiments of the present application, the playback control device can obtain the to-be-rendered video sent by the host computer. The host computer can be used to transcode the original video to obtain a to-be-rendered video of a second preset size when the first preset size of the original video is greater than the maximum decoding size of the playback control device, and then transmit the to-be-rendered video of the second preset size to the playback control device.
[0029] The second preset size is less than or equal to the maximum decoding size.
[0030] For example, the host computer can transcode the original video by using a transcoding tool such as MEncoder or FFmpeg. After comparison, the transcoding efficiency of FFmpeg is higher than that of MEncoder, and MEncoder supports more formats. Therefore, the user can select a transcoding tool according to the actual situation. It should be understood that the larger the second preset size after transcoding is, the less the resolution loss of the video picture is, and the better the display effect is. Therefore, preferably, the second preset size can be equal to the maximum decoding size. For example, when the maximum decoding size is 4K width (i.e. 3840), the width of the second preset size can also be 3840.
[0031] In step S102, N target sub-pictures are determined according to the video pictures of the to-be-rendered video.
[0032] In the embodiments of the present application, after receiving the video to be rendered, the playback control device can decode the video to be rendered to obtain a video picture of the video to be rendered. It should be understood that when the video to be rendered is the original video, the resolution of the video picture is equal to the first preset size, and when the video to be rendered is the second preset size video obtained by transcoding the original video, the resolution of the video picture is equal to the second preset size. In order to make the total size of the rendered picture the same as the size of the original video, the playback control device can determine N target sub-pictures according to the video picture of the video to be rendered.
[0033] The target sub-picture is a picture obtained by cropping the video picture. N is a positive integer greater than 1, and the specific value can be adjusted according to actual conditions. Moreover, the total size of the N target sub-pictures after splicing is the same as the first preset size. That is, the total size of the N sub-pictures after splicing is the same as the size of the original video.
[0034] Specifically, considering that the video picture needs to be displayed through a display screen, the display screen can usually be divided into multiple display regions, and each display region is carried by one network transmission interface, that is, the playback control device can transmit the rendered picture to the display screen through one network transmission interface, so that one network transmission interface can carry one display region of the display screen. However, the network transmission interface usually has an upper limit of carrying, therefore, the playback control device can obtain the actual size of the display screen and the reference size of the picture carried by the network transmission interface, and calculate the value of N according to the actual size and the reference size.
[0035] The actual size can refer to the total resolution, width or height of the display screen, and the reference size can refer to the maximum resolution, maximum width or maximum height that can be carried by the network transmission interface. The playback control device can divide the actual size by the reference size to obtain the value of N. For example, the actual width of the actual display screen is 20480, and the maximum width of the picture carried by a single network transmission interface is 4096, then N is equal to 5.
[0036] It should be understood that if the video to be rendered is the original video of the first preset size, the playback control device can crop the video picture to obtain N target sub-pictures. If the video to be rendered is the video of the second preset size, the playback control device can crop the video picture, and then respectively perform resolution enhancement on the N pictures to increase the size of each sub-picture to a specific size, so that the total size of the N target sub-pictures after splicing is the same as the first preset size.
[0037] It should be noted that the sizes of the N target sub-pictures can be the same or different. When the cropping method of the video picture is equal division, the N target sub-pictures can all be the third preset size.
[0038] Step S103, respectively rendering each target sub-picture to obtain N rendered sub-pictures.
[0039] In the embodiments of the present application, after obtaining the N target sub-pictures, the playback control device can render each target sub-picture respectively by the GPU to obtain N rendered sub-pictures. Specifically, the GPU can respectively tile each sub-picture to a texture of the same size as the sub-picture for rendering to obtain N rendered sub-pictures.
[0040] It should be understood that at this time the width of the sub-picture is less than the width of the video picture of the video to be rendered, so that the GPU renders the sub-picture, which is less likely to be limited by the maximum displayable texture supported by the GPU compared to directly rendering the video picture of the video to be rendered.
[0041] For example, if the width of the original video is 20480 and the maximum displayable texture of the GPU is 16384, the GPU is difficult to directly render the original video, and then the original video is rendered after compression. In the present application, the original video is cut into 5 parts, and the width of each sub-picture is 4096, which is not limited by the maximum displayable texture.
[0042] Step S104, splicing the N rendered sub-pictures to obtain a rendered picture.
[0043] It should be understood that the size of the N rendered sub-pictures is the same as the corresponding target sub-picture, so that the size of the rendered picture obtained by splicing the N rendered sub-pictures is the same as the size of the video picture to be rendered (or the first preset size of the original video).
[0044] The playback control device usually needs to transmit the rendered picture through the network transmission interface. Since the network transmission interface has a load upper limit (i.e. the reference size of the picture carried), the playback control device can splice the N rendered sub-pictures in the short side direction of the video picture to obtain the rendered picture. In this way, it can be avoided that the rendered picture exceeds the load capacity of the network transmission interface in the long side direction of the picture.
[0045] The short side direction of the picture can refer to the direction with shorter size in the picture width direction and the picture height direction, and the long side direction of the picture can refer to the direction with longer size in the picture width direction and the picture height direction. For example, when the video picture is a picture with a picture width of 20000 and a picture height of 200, the short side direction of the picture is the picture width direction, and the long side direction of the picture is the picture height direction.
[0046] For example, the maximum bandwidth supported by a single network port on a gigabit network card is about 65W dot pixels. Due to the limited processing capability of the FPGA (Field Programmable Gate Array) and ARM chip of the gigabit network card, the maximum width that can be supported is about 4096. If the original video has a picture width of 20000, it is obvious that the rendered picture width obtained by splicing along the picture width direction exceeds the maximum width that can be supported by the gigabit network card. At this time, splicing can be performed along the picture height direction. For example, the original video is cut into 5 parts, and the width of each part is 4096, which meets the maximum width that can be supported by the gigabit network card.
[0047] In step S105, the rendered picture is output to the display screen for display.
[0048] Specifically, the playback control device can transmit the rendered picture to the display screen through the network transmission interface, and the display screen displays the rendered picture.
[0049] In the embodiments of the present application, by obtaining a video to be rendered, and determining N target sub-pictures according to the video picture of the video to be rendered, so that the total size of the N target sub-pictures after splicing is the same as the size of the original video, then rendering each target sub-picture respectively to obtain N rendered sub-pictures, and splicing the N rendered sub-pictures to obtain a rendered picture, the rendered picture is output to the display screen for display, so that the total size of the rendered picture is the same as the size of the original video, avoiding the problem that the picture output to the display screen for display is blurred due to compression and transcoding during rendering, and meeting the display requirement of high-resolution video.
[0050] In step S102, if the video to be rendered is a second preset size video obtained by transcoding the original video, resolution enhancement is needed after picture cropping.
[0051] Specifically, the above step S102 can specifically include: cropping the video picture of the video to be rendered to obtain N initial sub-pictures, and performing interpolation processing on the N initial sub-pictures respectively to obtain N target sub-pictures.
[0052] That is, by cropping the video picture of the video to be rendered, N initial sub-pictures can be obtained. At this time, the total size of the N initial sub-pictures after splicing is the second preset size. In order to make the total size of the rendered sub-pictures after splicing be the first preset size, interpolation processing can be performed on the N initial sub-pictures respectively to fill the missing pixels, so that the total size of the N target sub-pictures after splicing is the first preset size.
[0053] The interpolation processing can adopt a nearest neighbor interpolation method, a bilinear interpolation method, a bicubic interpolation method, or the like.
[0054] Specifically, according to the first preset size and the second preset size, a scaling ratio of the initial sub-picture and the target sub-picture in a picture width direction and a picture height direction can be calculated. According to the scaling ratio, a corresponding pixel position of each pixel point in the target sub-picture in the initial sub-picture can be determined. According to pixel values of each pixel point around the corresponding pixel position in the initial sub-picture, a pixel value of the pixel point in the target sub-picture can be interpolated.
[0055] For example, according to the second preset size (picture width a, picture height b) and the first preset size (picture width m, picture height n), a scaling ratio in the picture width direction can be calculated as a scaling ratio in the picture height direction For example, for a pixel point at a pixel coordinate (i, j) in the target sub-picture, a corresponding pixel position in the initial sub-picture is According to the pixel position, a pixel point in the initial sub-picture that is closest to the pixel position in the picture width direction and the picture height direction can be searched. According to a pixel value of the searched pixel point, a pixel value of the pixel point at the pixel coordinate (i, j) in the target sub-picture can be calculated proportionally. By traversing each pixel point in the target sub-picture and determining a pixel value of each pixel point, a complete target sub-picture can be obtained, and the interpolation processing is completed. By performing the interpolation processing on N initial sub-pictures respectively, N target sub-pictures corresponding to the N initial sub-pictures respectively can be obtained.
[0056] Preferably, the playback control device can obtain a sample video, perform the steps S101 to S105 on the sample video in advance, and perform different interpolation algorithms on the sample video in the process of performing the step S102. Then, an image of the display screen when displaying the rendered picture obtained by using different interpolation algorithms is obtained. Based on the image, a display effect of the display screen when displaying each rendered picture is analyzed, for example, the outline sharpness, line sharpness, and noise point number of the image are analyzed. Then, the best display effect (for example, the highest outline sharpness, the highest line sharpness, and the least noise point number) is determined. The interpolation algorithm used in the rendered picture corresponding to the best display effect is used as the interpolation algorithm used in the subsequent step S102. Thus, the display screen can display the rendered picture with the best display effect.
[0057] In addition, in some embodiments, considering that the purpose of interpolation is to compensate for the resolution reduction caused by transcoding by the host computer, the playback control device can also obtain reference information before interpolation processing, and based on the reference information, the N initial sub-pictures are respectively interpolated to obtain N target sub-pictures during interpolation processing.
[0058] The reference information is information used to record the information loss in the original video when the original video is transcoded into the video to be rendered.
[0059] For example, when the original video is transcoded into the video to be rendered, every 2*2 pixel points are transcoded into 1 pixel point. At this time, the information loss in the middle when the 4 pixel points are transcoded into 1 pixel point can be recorded as reference information and carried in the video to be rendered and sent to the playback control device together with the host computer. Based on the reference information, the playback control device can restore the lost information for every 1 pixel point during interpolation to obtain 2*2 pixel points, and thus the total size of the N target sub-pictures after splicing is lower than the first preset size.
[0060] This way can adapt the interpolation process to the transcoding process of the host computer and improve the effect of interpolation to some extent.
[0061] It should be noted that, for the foregoing method embodiments, in order to simply describe, they are all expressed as a series of action combinations, but those skilled in the art should know that the present application is not limited by the action order described, because according to the present application, certain steps can be performed in other orders.
[0062] As shown in FIG. 1, a video display control device 200 provided by an embodiment of the present application is configured on a playback control device. Figure 2
[0063] Specifically, the video display control device 200 can include:
[0064] An obtaining unit 201 is configured to obtain a video to be rendered, the video to be rendered being an original video of a first preset size or a video of a second preset size obtained by transcoding the original video, the second preset size being smaller than the first preset size;
[0065] A determining unit 202 is configured to determine N target sub-pictures according to a video picture of the video to be rendered, N being a positive integer greater than 1, wherein the total size of the N target sub-pictures after splicing is the same as the first preset size;
[0066] A rendering unit 203 is configured to render each of the target sub-pictures to obtain N rendered sub-pictures;
[0067] The splicing unit 204 is configured to splice the N rendered sub-pictures to obtain a rendered picture.
[0068] The display unit 205 is configured to output the rendered picture to a display screen for display.
[0069] In some embodiments of the present application, the determination unit 202 can be further configured to: obtain an actual size of the display screen and a reference size of a picture borne by a network transmission interface, the network transmission interface being configured to transmit the rendered picture to the display screen; and calculate the value of N according to the actual size and the reference size.
[0070] In some embodiments of the present application, the playback control device is connected to a host computer, the video to be rendered is a second preset size video obtained by transcoding an original video, and the obtaining unit 201 can be specifically configured to: obtain the video to be rendered sent by the host computer, the host computer being configured to, when the first preset size of the original video is greater than a maximum decoding size of the playback control device, transcode the original video to obtain the video to be rendered of the second preset size, wherein the second preset size is less than or equal to the maximum decoding size.
[0071] In some embodiments of the present application, the splicing unit 204 can be specifically configured to splice the N rendered sub-pictures along a short side direction of a picture of the video to obtain the rendered picture.
[0072] In some embodiments of the present application, the determination unit 202 can be specifically configured to: crop a video picture of the video to be rendered to obtain N initial sub-pictures; and perform interpolation processing on the N initial sub-pictures respectively to obtain the N target sub-pictures.
[0073] In some embodiments of the present application, the determination unit 202 can be specifically configured to: obtain reference information, the reference information being used to record information lost in the original video when the original video is transcoded into the video to be rendered; and perform interpolation processing on the N initial sub-pictures respectively to obtain the N target sub-pictures based on the reference information.
[0074] It should be noted that, for the convenience and brevity of description, the specific working process of the video display control apparatus 200 can be referred to Figure 1 the corresponding process of the method, which will not be repeated here.
[0075] As Figure 3As shown in FIG. 3, a schematic diagram of a playing control device provided by an embodiment of the present application is shown. Specifically, the playing control device 3 can include a processor 30, a memory 31, and a computer program 32 stored in the memory 31 and executable on the processor 30, for example, a display control program of a video. The processor 30 implements the steps in each of the video display control method embodiments described above when executing the computer program 32, for example Figure 1 The processor 30 implements the functions of each module / unit in each of the apparatus embodiments described above when executing the computer program 32, for example Figure 2 The processor 30 implements the functions of each module / unit in each of the apparatus embodiments described above when executing the computer program 32, for example
[0076] The computer program can be divided into one or more modules / units, which are stored in the memory 31 and executed by the processor 30 to complete the present application. The one or more modules / units can be a series of computer program instruction segments capable of completing a specific function, which are used to describe the execution process of the computer program in the playing control device.
[0077] For example, the computer program can be divided into an obtaining unit, a determining unit, a rendering unit, a splicing unit, and a display unit.
[0078] The specific functions of each unit are as follows: the obtaining unit is configured to obtain a to-be-rendered video, the to-be-rendered video being a raw video of a first preset size or a video of a second preset size obtained by transcoding the raw video, the second preset size being smaller than the first preset size; the determining unit is configured to determine N target sub-pictures according to a video picture of the to-be-rendered video, N being a positive integer greater than 1, wherein the total size of the N target sub-pictures after splicing is the same as the first preset size; the rendering unit is configured to render each of the target sub-pictures to obtain N rendered sub-pictures; the splicing unit is configured to splice the N rendered sub-pictures to obtain a rendered picture; and the display unit is configured to output the rendered picture to a display screen for display.
[0079] The playing control device can include, but is not limited to, the processor 30 and the memory 31. Those skilled in the art can understand that, Figure 3 The playing control device is only an example and does not constitute a limitation on the playing control device, and can include more or fewer components than shown, or combine certain components, or different components, for example, the playing control device can also include an input / output device, a network access device, a bus, etc.
[0080] The processor 30 can be a central processing unit (CPU), and can also be other general-purpose processors, digital signal processors (DSP), application specific integrated circuits (ASIC), programmable logic devices (PLD), discrete gates or transistor logic, discrete hardware components, or the like. The general-purpose processor can be a microprocessor, or the processor can also be any conventional processor.
[0081] The memory 31 can be an internal storage unit of the playback control device, such as a hard disk or a memory of the playback control device. The memory 31 can also be an external storage device of the playback control device, such as a plug-in hard disk, a smart media card (SMC), a secure digital (SD) card, a flash card, or the like. Further, the memory 31 can include both the internal storage unit and the external storage device of the playback control device. The memory 31 is used to store the computer program and other programs and data required by the playback control device. The memory 31 can also be used to temporarily store data that has been output or is to be output.
[0082] It should be noted that, for the convenience and brevity of description, the structure of the playback control device described above can also refer to the specific description of the structure in the method embodiment, which will not be described here.
[0083] Please refer to Figure 4 , Figure 4 A display control system 40 provided by the present application is shown. The display control system 40 can include a host computer 1, a display screen 2, and a playback control device 3 connected with the host computer 1 and the display screen 2 respectively.
[0084] The host computer 1 can be used to obtain a video to be rendered, and transmit the video to be rendered to the playback control device 3. The video to be rendered can be an original video of a first preset size, or can be a video of a second preset size obtained by transcoding the original video when the first preset size is greater than a maximum decoding size of the playback control device 3. The second preset size is less than or equal to the maximum decoding size.
[0085] The playback control device 3 can be used to obtain the video to be rendered transmitted by the host computer 1, and according to the display control method of the video, output the rendered picture to the display screen 2. Figure 1 The display control method of the video, output the rendered picture to the display screen 2.
[0086] Correspondingly, the display screen 2 can be used to display the rendered picture.
[0087] It should be understood that the specific functions and structures of the host computer 1, the display screen 2, and the playback control device 3 described above can refer to the description of Figures 1 to 3 , which will not be repeated here.
[0088] Those skilled in the art can clearly understand that, for the convenience and brevity of description, only the above-mentioned division of each functional unit and module is exemplified, and in actual application, the above-mentioned functions can be completed by different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. Each functional unit and module in the embodiment can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The above-mentioned integrated unit can be realized in the form of hardware or software. In addition, the specific names of each functional unit and module are only for easy distinction, and do not limit the protection scope of the application. The specific working process of the units and modules in the above system can refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.
[0089] In the above embodiments, the description of each embodiment has its own emphasis, and the parts not described or recorded in detail in a certain embodiment can be referred to the related description of other embodiments.
[0090] Those of ordinary skill in the art can realize that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized in electronic hardware or a combination of computer software and electronic hardware. Whether the functions are executed in hardware or software depends on the specific application and design constraints of the technical solution. A person skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the application.
[0091] In the embodiments provided in the present application, it should be understood that the disclosed devices / playback control devices and methods can be implemented in other ways. For example, the device / playback control device embodiments described above are only schematic, for example, the division of the modules or units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units or components shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.
[0092] The units described as separate components may or may not be physically separate, and the components displayed as units may or may not be physical units, i.e. may be located in one place, or may be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.
[0093] In addition, the functional units in each embodiment of the present application can be integrated in one processing unit, or each unit can be physically present separately, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.
[0094] The integrated module / unit, if realized in the form of a software functional unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on this understanding, all or part of the processes in the above-mentioned embodiment methods can also be completed by a computer program instructing related hardware, and the computer program can be stored in a computer readable storage medium. The computer program can implement the steps of each method embodiment when executed by a processor. The computer program includes computer program code, which can be in the form of source code, object code, executable files or some intermediate forms, etc. The computer readable medium can include any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electrical carrier signal, telecommunication signal and software distribution medium, etc. It should be noted that the contents included in the computer readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction, for example, in some jurisdictions, according to legislation and patent practice, the computer readable medium does not include electrical carrier signals and telecommunication signals.
[0095] The above-described embodiments are only used to illustrate the technical solutions of the present application, rather than limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application.
Claims
1. A method for controlling the display of video, characterized in that, The display control method is applied to a playback control device, which is connected to a host computer; the video display control method includes: The host computer receives the video to be rendered sent by the host computer. The host computer transcodes the original video when the first preset size of the original video is greater than the maximum decoding size of the playback control device to obtain the video to be rendered with a second preset size. The second preset size is less than or equal to the maximum decoding size and the second preset size is less than the first preset size. The video frames of the video to be rendered are cropped to obtain N initial sub-frames, where N is a positive integer greater than 1; Obtain reference information, which is used to record information lost in the original video when transcoding the original video into the video to be rendered; Based on the reference information, interpolation processing will be performed on the N initial sub-images to obtain N target sub-images, wherein the total size of the N target sub-images after splicing is the same as the first preset size; Each of the target sub-images is rendered separately to obtain N rendered sub-images; The N rendered sub-images are stitched together to obtain the rendered image; The rendered image is then output to the display screen for display.
2. The video display control method as described in claim 1, characterized in that, The video display control method further includes: The actual size of the display screen and the reference size of the image carried by the network transmission interface are obtained. The network transmission interface is used to transmit the rendered image to the display screen. The value of N is calculated based on the actual size and the reference size.
3. The video display control method according to any one of claims 1 to 2, characterized in that, The step of stitching together the N rendered sub-images to obtain the rendered image includes: The rendered sub-pictures are stitched together along the short side of the video frame to obtain the rendered frame.
4. A video display control device, characterized in that, The display control device is configured on the playback control device, and the playback control device is connected to the host computer; the video display control device includes: The acquisition unit is used to acquire the video to be rendered sent by the host computer. The host computer is used to transcode the original video when the first preset size of the original video is greater than the maximum decoding size of the playback control device to obtain the video to be rendered with a second preset size, wherein the second preset size is less than or equal to the maximum decoding size and the second preset size is less than or equal to the maximum decoding size of the playback control device. The determining unit is used to crop the video frames of the video to be rendered to obtain N initial sub-frames; obtain reference information, which is used to record the information lost in the original video when transcoding the original video into the video to be rendered; based on the reference information, interpolation processing is performed on the N initial sub-frames to obtain N target sub-frames, where N is a positive integer greater than 1, and the total size of the N target sub-frames after splicing is the same as the first preset size; A rendering unit is used to render each of the target sub-pictures separately to obtain N rendered sub-pictures; A splicing unit is used to splice N rendered sub-images to obtain a rendered image; The display unit is used to output the rendered image to the display screen for display.
5. A playback control device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the computer program, it implements the steps of the video display control method as described in any one of claims 1 to 3.
6. A display control system, characterized in that, It includes a host computer, a display screen, and playback control devices connected to the host computer and the display screen respectively; The host computer is used to acquire the video to be rendered and transmit the video to be rendered to the playback control device. The video to be rendered is a video of a second preset size obtained by transcoding the original video when the first preset size of the original video is greater than the maximum decoding size of the playback control device. The second preset size is less than or equal to the maximum decoding size and is less than the first preset size. The playback control device is used to acquire the video to be rendered transmitted from the host computer, and output the rendered image to the display screen according to the video display control method according to any one of claims 1 to 3. The display screen is used to display the rendered image.
7. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the video display control method as described in any one of claims 1 to 3.
Citation Information
Patent Citations
Screenshot method and device, storage medium and electronic device
CN111562869A
Image rendering method and device, storage medium and electronic equipment
CN115393490A