Video playback method, device, equipment and storage medium for LED special-shaped screen
By converting the pixel coordinates of panoramic video to the pixel coordinates of the target irregularly shaped screen, and then stitching and encoding them, the customization problem of video playback on LED irregularly shaped screens is solved, enabling adaptive playback and distortion prevention for various irregularly shaped screens.
Patent Information
- Application Number
- CN202410926182.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-11
- Publication Date
- 2024-11-22
- Estimated Expiration
- 2044-07-11
AI Technical Summary
In existing technologies, video playback on irregularly shaped LED screens requires a custom-designed player and is prone to image distortion.
By converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target irregular screen, the video images of each sub-screen are obtained, stitched together and encoded to generate the target video, which is then projected onto the target irregular screen for playback.
It enables video playback to adapt to various irregularly shaped LED screens without requiring a customized player for each screen shape, thus preventing distortion during playback.
Smart Images

Figure CN118488151B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of video processing technology, and in particular to a video playback method, device, equipment and storage medium for an LED special-shaped screen. Background Art
[0002] At present, with the increasing number of application scenarios of LED display screens, the shapes of LED special-shaped screens are also increasing, such as spherical display, cylindrical display, cubic display, display of a combination of a cylinder and a surface, etc. However, in the prior art, for each type of LED special-shaped screen playback display, a corresponding player needs to be customized and adapted for video playback, and since the rendering process and playback process of each video are different, there may be picture distortion during video playback.
[0003] Therefore, how to provide a video playback solution that can adapt to various LED special-shaped screens has become a technical problem that needs to be solved urgently by those skilled in the art. Summary of the invention
[0004] In view of the above, the present application provides a video playback method, device, equipment and storage medium for an LED special-shaped screen, the purpose of which is to solve the above technical problems.
[0005] In a first aspect, the present application provides a video playback method for an LED special-shaped screen, the method comprising:
[0006] Get the panoramic video to be played;
[0007] Convert the image pixel coordinates of the panoramic video into pixel coordinates of a target special-shaped screen to obtain a video image of each sub-screen in the target special-shaped screen;
[0008] The video images of each sub-screen are spliced and encoded to obtain a target video corresponding to the panoramic video;
[0009] The target video is projected onto each sub-screen in the target special-shaped screen to play the target video.
[0010] In a second aspect, the present application provides a video playback device for an LED special-shaped screen, the device comprising:
[0011] Acquisition module: used to acquire the panoramic video to be played;
[0012] Conversion module: used for converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen, and obtaining the video image of each sub-screen in the target special-shaped screen;
[0013] Splicing module: used for splicing and encoding the video images of each sub-screen to obtain the target video corresponding to the panoramic video;
[0014] Playing module: used for projecting the target video onto each sub-screen in the target special-shaped screen to play the target video.
[0015] In a third aspect, the present application provides an electronic device, including a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;
[0016] Memory, used to store computer programs;
[0017] The processor is used to implement the video playback method of the LED special-shaped screen described in any embodiment of the first aspect when executing the program stored in the memory.
[0018] In a fourth aspect, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the video playback method of the LED special-shaped screen as described in any embodiment of the first aspect is implemented.
[0019] The above technical solution provided by the embodiment of the present application has the following advantages compared with the prior art:
[0020] This application obtains the panoramic video to be played, converts the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen, obtains the video image of each sub-screen in the target special-shaped screen, splices and encodes the video image of each sub-screen to obtain the target video corresponding to the panoramic video, and can synchronize the video frames of multiple video images to prevent distortion during subsequent playback. The target video is then projected to each sub-screen in the target special-shaped screen for playback. Since the panoramic video is converted into the video image of the sub-screen of the target special-shaped screen, it can adapt to the video playback of various target special-shaped screens spliced by multiple sub-screens, without the need to customize a special player for each LED special-shaped screen. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.
[0022] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0023] Figure 1 This is a flow chart of an embodiment of a video playback method for an LED special-shaped screen of the present application;
[0024] Figure 2 Schematic diagram of depression angle and elevation angle corresponding to the upper and lower edges of the cylinder in the embodiment of the present application;
[0025] Figure 3 This is a module schematic diagram of an embodiment of a video playback device for an LED special-shaped screen of the present application;
[0026] Figure 4 A schematic diagram of an electronic device embodiment of the present application;
[0027] The realization of the purpose, functional features and advantages of this application will be further explained in conjunction with embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION
[0028] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.
[0029] The disclosure below provides many different embodiments or examples to realize the different structures of the present application. In order to simplify the disclosure of the present application, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present application. In addition, the present application can repeat reference numbers and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed.
[0030] The present application provides a method for playing video on an LED special-shaped screen. Figure 1 The figure is a schematic diagram of a method flow of an embodiment of a method for playing video on a special-shaped LED screen of the present application. The method can be executed by an electronic device, and the electronic device can be implemented by software and / or hardware. The method for playing video on a special-shaped LED screen includes:
[0031] Step S10: Obtain the panoramic video to be played;
[0032] Step S20: converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen;
[0033] Step S30: splicing and encoding the video images of each sub-screen to obtain a target video corresponding to the panoramic video;
[0034] Step S40: Projecting the target video onto each sub-screen in the target special-shaped screen to play the target video.
[0035] In this embodiment, the LED special-shaped screen refers to an LED special-shaped screen that is modified into a special shape based on the LED display screen. The panoramic video to be played can be a panoramic video rendered and output by using an engine such as Unity3D or Unreal Engine 5 to render a scene animation, or it can be a panoramic video pre-stored in a preset path. According to the hardware resolution of the LED special-shaped screen, the resolution, frame rate, and bit rate of the panoramic video can be determined.
[0036] Since the panoramic video is a video played on a flat screen, if the panoramic video needs to be played on an LED special-shaped screen, the pixel coordinates of the panoramic video need to be converted into the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen, so as to project the converted video image onto the LED special-shaped screen for playback. The sub-screens of the target special-shaped screen may include an arc screen, a ceiling screen, and a ground screen. The cylindrical screen composed of these three sub-screens is used as the target special-shaped screen. Specifically, the image pixel coordinates of the panoramic video are converted into the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen, including:
[0037] Mapping the image pixel coordinates of the panoramic video to spherical polar coordinates;
[0038] Mapping the spherical polar coordinates to pixel coordinates of a target special-shaped screen;
[0039] The color components corresponding to the pixel coordinates of the target special-shaped screen are calculated to obtain the video image of each sub-screen in the target special-shaped screen.
[0040] When converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen, a virtual cylindrical three-dimensional model can be established according to the target special-shaped screen, and the three-dimensional model is circumscribed to the panoramic sphere. To ensure that the image is not distorted or stretched, the center position of the arc screen of the three-dimensional model needs to be close to the center position of the panoramic sphere. According to the relevant geometric projection formula, the image pixel coordinates of the panoramic video are mapped to the spherical polar coordinates of the panoramic sphere, and then the spherical polar coordinates are respectively mapped to the coordinates of the arc screen, ceiling screen, and ground screen of the target special-shaped screen, and then the color components corresponding to the pixel coordinates of the target special-shaped screen are calculated, thereby obtaining the video image of each sub-screen in the target special-shaped screen.
[0041] Furthermore, mapping the image pixel coordinates of the panoramic video to spherical polar coordinates includes:
[0042] Taking the center point coordinates of the panoramic video image as the origin coordinates;
[0043] Dividing the difference between the image pixel coordinates of the panoramic video and the origin coordinates by half the height of the image to obtain normalized proportional coordinates;
[0044] Using the abscissa value of the normalized scale coordinate as the azimuth of the spherical polar coordinate;
[0045] The ordinate value of the normalized scale coordinate is used as the polar angle of the spherical polar coordinate.
[0046] The center point of the panoramic video image ( cw , ch ) as the origin coordinates, and the image pixel coordinates of the panoramic video ( pw , ph )and( cw , ch ) is divided by the image height h / 2 (i.e., radius R) to obtain the normalized scale coordinates, i.e., the normalized scale coordinates are:
[0047] ( nx , new ) = [( pw , ph ) / R ,( ph , ch ) / R ]
[0048] Normalized scale coordinates ( nx , new )∈[-1,1]×[-1,1], multiply the horizontal coordinate value of the normalized scale coordinate by the coefficient π / 2 Azimuth as spherical polar coordinates α , multiply the ordinate value of the normalized scale coordinate by the coefficient π / 2 Polar angle as spherical polar coordinates i , spherical polar coordinates ( α , i )∈[ -π / 2 , π / 2 ]×[ -π / 2 , π / 2 ] is the hemispherical angle range, that is α= nx·π / 2 , θ=ny·π / 2 .
[0049] Furthermore, the sub-screens of the target special-shaped screen include an arc screen, a ceiling screen and a ground screen, and the mapping of the spherical polar coordinates to the pixel coordinates of the target special-shaped screen includes:
[0050] According to the sine and cosine values of the depression angle, and the sine and cosine values of the elevation angle, the cylindrical rectangular coordinates when the spherical polar coordinates are located at the arc screen, the ceiling screen and the ground screen are calculated respectively ( kx , ky ), wherein the cylindrical surface refers to the cylindrical surface of a cylinder composed of the arc screen, the ceiling screen and the floor screen;
[0051] According to the value range of the azimuth angle of the spherical polar coordinates, the cylindrical rectangular coordinates are converted into pixel coordinates of the target special-shaped screen.
[0052] Ginseng Figure 2 As shown in the figure, it is a schematic diagram of the depression angle and elevation angle corresponding to the upper and lower edges of the cylinder in the embodiment of the present application, and the depression angle and elevation angle corresponding to the upper and lower edges of the cylinder are set to be i up and i down ,in, i up < 0, i down > 0, i up =- i down The azimuth angle range is -π / 2≤α≤π / 2 , respectively calculate the cylindrical rectangular coordinates when the spherical polar coordinates are located on the arc screen, ceiling screen and ground screen. When the spherical polar coordinates are located on the ceiling screen, that is, when -π / 2≤θ≤θ up , the cylindrical rectangular coordinates are calculated using the following formula:
[0053]
[0054] Among them, L represents the intermediate variable, sin ( i up ) represents the sine of the elevation angle, cos ( i up ) represents the cosine value of the elevation angle, sin ( α ) represents the sine of the azimuth angle, cos ( α ) represents the cosine value of the azimuth, sin ( i ) represents the sine of the polar angle, cos ( i ) represents the cosine of the polar angle.
[0055] There are two cases when the spherical polar coordinates are located on the arc screen. The first case is when i up ≤θ≤0 When , the cylindrical rectangular coordinates are calculated by the following formula:
[0056]
[0057] The second situation is when 0≤θ≤θ down When , the cylindrical rectangular coordinates are calculated by the following formula:
[0058]
[0059] When the spherical polar coordinates are on the ground screen, that is, when i down ≤θ≤π / 2 , the cylindrical rectangular coordinates are calculated using the following formula:
[0060]
[0061] Then according to the range of the azimuth angle of the spherical polar coordinates -π / 2≤α≤π / 2 , converting the cylindrical rectangular coordinates into the pixel coordinates of the target special-shaped screen, specifically, according to the value range of the azimuth angle of the spherical polar coordinates, converting the cylindrical rectangular coordinates into the pixel coordinates of the target special-shaped screen, including:
[0062] The horizontal coordinate value of the cylindrical rectangular coordinate is divided by the maximum value of the value range to obtain the horizontal coordinate value of the pixel coordinate of the target special-shaped screen, that is, the horizontal coordinate value of the pixel coordinate of the target special-shaped screen lx = kx / π / 2 ;
[0063] The ordinate value of the cylindrical rectangular coordinate is divided by the maximum value of the value range to obtain the ordinate value of the pixel coordinate of the target special-shaped screen, that is, the ordinate value of the pixel coordinate of the target special-shaped screen ly = ky / π / 2 .
[0064] After obtaining the pixel coordinates of the target special-shaped screen, the color components corresponding to the pixel coordinates of the target special-shaped screen are calculated, thereby obtaining the video image of each sub-screen in the target special-shaped screen. In practical applications, since the image pixel coordinates of the panoramic video ( pw , ph ) is an integer value, so the pixel coordinates of the target shaped screen ( lx , ly ) also needs to be converted into integer value coordinates. Specifically, the color components corresponding to the pixel coordinates of the target special-shaped screen are calculated, including:
[0065] Performing an inverse transformation operation on the pixel coordinates of the target special-shaped screen to obtain floating-point coordinates of image pixels of the panoramic video corresponding to the pixel coordinates of the target special-shaped screen;
[0066] The average values of the blue, green and red color components of the floating point coordinates are calculated respectively as the blue, green and red color components corresponding to the pixel coordinates of the target special-shaped screen.
[0067] Since rounding may not cover all pixels of the target shaped screen continuously during transformation, it is necessary to perform patching. Suppose the missing pixel coordinates of the target shaped screen are ( lx d , ly d ), the floating point coordinates of the corresponding panoramic video image pixels can be obtained through inverse transformation ( px real , py real ), and then calculate the missing pixel coordinates by interpolating the 4 pixels above, below, left and right ( lx d , ly d ) corresponding to the blue, green, and red color components, with the blue color component blue ( lx d , ly d ) as an example:
[0068] blue ( lx d , ly d )=[ blue up ( px real , py real )+ blue down ( px real , py real )+ blue left ( px real , py real )+ blue right ( px real , py real )] / 4;
[0069] Calculate the green color component accordingly green ( lx d , ly d ) and the red color component red ( lx d , ly d), the display content of all pixels of each sub-screen in the target special-shaped screen can be obtained, thereby obtaining the video image of each sub-screen in the target special-shaped screen, wherein the calculation method of the green color component and the red color component is the same as the blue color component, which will not be repeated here.
[0070] The video images of each sub-screen are spliced and encoded to obtain a target video corresponding to the panoramic video. Splicing and synthesizing a target video can simplify the problem of synchronization of several video frames.
[0071] The player projects the target video onto the arc screen, the floor screen and the ceiling screen of the target special-shaped screen according to the splicing rules for display, thereby achieving the effect of playing the panoramic video corresponding to the shape of the target special-shaped screen. Specifically, projecting the target video onto each sub-screen of the target special-shaped screen to play the target video includes:
[0072] Crop the target video according to a pre-configured splicing rule to obtain a video to be played on each sub-screen;
[0073] The video to be played on each sub-screen is projected onto the sub-screen corresponding to the target special-shaped screen to play the target video.
[0074] For example, create three virtual camera objects in the game engine scene, and set each camera to output images to the corresponding three physical screens (arc screen, ceiling screen, and floor screen). Create three canvas interfaces in the game engine scene and set them to the camera front overlay mode. Assign the rendering cameras of the three canvases to the camera objects created above. Create a picture interface game object under each of the three created canvas interfaces to carry the decoded video frame images, and set the UV cropping variables in each picture interface component according to the splicing rules, so as to achieve video frame cropping by area, and dynamically assign the decoded video frames to the picture interface, so as to achieve cropping of the target video according to the splicing rules and output it to different physical screens.
[0075] Reference Figure 3 , which is a schematic diagram of the functional modules of the video playback device 100 of the LED special-shaped screen of the present application.
[0076] The video playback device 100 of the LED special-shaped screen described in the present application can be installed in an electronic device. According to the functions to be implemented, the video playback device 100 of the LED special-shaped screen may include an acquisition module 110, a conversion module 120, a splicing module 130 and a playback module 140. The module described in the present application may also be referred to as a unit, which refers to a series of computer program segments that can be executed by an electronic device processor and can complete fixed functions, which are stored in the memory of the electronic device.
[0077] In this embodiment, the functions of each module / unit are as follows:
[0078] Acquisition module 110: used to acquire the panoramic video to be played;
[0079] Conversion module 120: used to convert the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen, and obtain the video image of each sub-screen in the target special-shaped screen;
[0080] The splicing module 130 is used to splice and encode the video images of each sub-screen to obtain a target video corresponding to the panoramic video;
[0081] Playing module 140: used for projecting the target video onto each sub-screen in the target special-shaped screen to play the target video.
[0082] In one embodiment, converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen includes:
[0083] Mapping the image pixel coordinates of the panoramic video to spherical polar coordinates;
[0084] Mapping the spherical polar coordinates to pixel coordinates of a target special-shaped screen;
[0085] The color components corresponding to the pixel coordinates of the target special-shaped screen are calculated to obtain the video image of each sub-screen in the target special-shaped screen.
[0086] In one embodiment, mapping the image pixel coordinates of the panoramic video to spherical polar coordinates includes:
[0087] Taking the center point coordinates of the panoramic video image as the origin coordinates;
[0088] Dividing the difference between the image pixel coordinates of the panoramic video and the origin coordinates by half the height of the image to obtain normalized proportional coordinates;
[0089] Using the abscissa value of the normalized scale coordinate as the azimuth of the spherical polar coordinate;
[0090] The ordinate value of the normalized scale coordinate is used as the polar angle of the spherical polar coordinate.
[0091] In one embodiment, the sub-screens of the target special-shaped screen include an arc screen, a ceiling screen, and a floor screen, and the mapping of the spherical polar coordinates to the pixel coordinates of the target special-shaped screen includes:
[0092] According to the sine value and cosine value of the depression angle and the sine value and cosine value of the elevation angle, the cylindrical rectangular coordinates when the spherical polar coordinates are located at the arc screen, the ceiling screen and the floor screen are calculated respectively, wherein the cylinder refers to the cylindrical surface of the cylinder formed by the arc screen, the ceiling screen and the floor screen;
[0093] According to the value range of the azimuth angle of the spherical polar coordinates, the cylindrical rectangular coordinates are converted into pixel coordinates of the target special-shaped screen.
[0094] In one embodiment, the converting of the cylindrical rectangular coordinates into the pixel coordinates of the target special-shaped screen according to the value range of the azimuth angle of the spherical polar coordinates includes:
[0095] Dividing the horizontal coordinate value of the cylindrical rectangular coordinate by the maximum value of the value range to obtain the horizontal coordinate value of the pixel coordinate of the target special-shaped screen;
[0096] The ordinate value of the cylindrical rectangular coordinate is divided by the maximum value of the value range to obtain the ordinate value of the pixel coordinate of the target special-shaped screen.
[0097] In one embodiment, the step of calculating the color components corresponding to the pixel coordinates of the target special-shaped screen includes:
[0098] Performing an inverse transformation operation on the pixel coordinates of the target special-shaped screen to obtain floating-point coordinates of image pixels of the panoramic video corresponding to the pixel coordinates of the target special-shaped screen;
[0099] The average values of the blue, green and red color components of the floating point coordinates are calculated respectively as the blue, green and red color components corresponding to the pixel coordinates of the target special-shaped screen.
[0100] In one embodiment, projecting the target video onto each sub-screen in the target special-shaped screen to play the target video includes:
[0101] Crop the target video according to a pre-configured splicing rule to obtain a video to be played on each sub-screen;
[0102] The video to be played on each sub-screen is projected onto the sub-screen corresponding to the target special-shaped screen to play the target video.
[0103] Reference Figure 4 , which is a schematic diagram of a preferred embodiment of the electronic device of the present application.
[0104] The electronic device includes a processor 111, a communication interface 112, a memory 113 and a communication bus 114, wherein the processor 111, the communication interface 112, and the memory 113 communicate with each other via the communication bus 114;
[0105] The memory 113 is used to store computer programs, for example, a video playback program for LED special-shaped screens;
[0106] In some embodiments, the processor 111 may be a central processing unit (CPU), a controller, a microcontroller, a microprocessor, or other data processing chips. The processor 111 is generally used to control the overall operation of the electronic device, such as performing control and processing related to data interaction or communication. In this embodiment, the processor 111 is used to run the program code stored in the memory 113 or process data, such as running the program code of the video playback program of the LED special-shaped screen.
[0107] The communication interface 112 may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), and the communication interface 112 may also be used to establish a communication connection between the electronic device and other electronic devices.
[0108] The memory 113 includes at least one type of readable storage medium, and the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), random access memory (RAM), static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), programmable read-only memory (PROM), magnetic memory, disk, optical disk, etc. In some embodiments, the memory 113 can be an internal storage unit of the electronic device, such as a hard disk or memory of the electronic device. In other embodiments, the memory 113 can also be an external storage device of the electronic device, such as a plug-in hard disk, a smart memory card (Smart Media Card, SMC), a secure digital (Secure Digital, SD) card, a flash card (Flash Card), etc. equipped with the electronic device. Of course, the memory 113 can also include both the internal storage unit of the electronic device and its external storage device. In this embodiment, the memory 11 is generally used to store the operating system and various computer programs installed in the electronic device, such as the program code of the video playback program of the LED special-shaped screen, etc. In addition, the memory 113 can also be used to temporarily store various types of data that have been output or are to be output.
[0109] Figure 4 Only an electronic device having components 111 - 114 is shown, but it is understood that implementing all of the components shown is not a requirement, and more or fewer components may alternatively be implemented.
[0110] In one embodiment of the present application, the processor 111 is used to execute the program stored in the memory 113 to implement the video playback method of the LED special-shaped screen provided by any of the above method embodiments, including:
[0111] Get the panoramic video to be played;
[0112] Convert the image pixel coordinates of the panoramic video into pixel coordinates of a target special-shaped screen to obtain a video image of each sub-screen in the target special-shaped screen;
[0113] The video images of each sub-screen are stitched and encoded to obtain a target video corresponding to the panoramic video;
[0114] The target video is projected onto each sub-screen in the target special-shaped screen to play the target video.
[0115] For a detailed description of the above steps, please refer to the above Figure 1 Description of the flowchart of an embodiment of a video playback method for an LED special-shaped screen.
[0116] In addition, the embodiment of the present application also proposes a computer-readable storage medium, which can be non-volatile or volatile. The computer-readable storage medium includes a data storage area and a program storage area, and the program storage area stores a video playback program for the LED special-shaped screen. When the video playback program for the LED special-shaped screen is executed by the processor, the following operations are implemented:
[0117] Get the panoramic video to be played;
[0118] Convert the image pixel coordinates of the panoramic video into pixel coordinates of a target special-shaped screen to obtain a video image of each sub-screen in the target special-shaped screen;
[0119] The video images of each sub-screen are stitched and encoded to obtain a target video corresponding to the panoramic video;
[0120] The target video is projected onto each sub-screen in the target special-shaped screen to play the target video.
[0121] The specific implementation of the computer-readable storage medium of the present application is roughly the same as the specific implementation of the video playback method of the above-mentioned LED special-shaped screen, and will not be repeated here.
[0122] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0123] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution, in essence, or the part that contributes to the relevant technology, can be embodied in the form of a software product, which can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiment.
[0124] It should be noted that the descriptions involving "first", "second", etc. in this application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of technical features indicated. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the ability of ordinary technicians in this field to implement them. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.
[0125] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.
[0126] The above description is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to the embodiments shown herein, but will conform to the widest range consistent with the principles and novel features applied for herein.
Claims
1. A video playback method for LED special-shaped screen, characterized in that: The method comprises: Get the panoramic video to be played; Convert the image pixel coordinates of the panoramic video into pixel coordinates of a target special-shaped screen to obtain a video image of each sub-screen in the target special-shaped screen; The video images of each sub-screen are spliced and encoded to obtain a target video corresponding to the panoramic video; Projecting the target video onto each sub-screen in the target special-shaped screen to play the target video; The step of converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen includes: Mapping the image pixel coordinates of the panoramic video to spherical polar coordinates; Mapping the spherical polar coordinates to pixel coordinates of a target special-shaped screen; Calculate the color components corresponding to the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen; Mapping the image pixel coordinates of the panoramic video to spherical polar coordinates includes: Taking the center point coordinates of the panoramic video image as the origin coordinates; Dividing the difference between the image pixel coordinates of the panoramic video and the origin coordinates by half the height of the image to obtain normalized proportional coordinates; Using the abscissa value of the normalized scale coordinate as the azimuth of the spherical polar coordinate; The ordinate value of the normalized scale coordinate is used as the polar angle of the spherical polar coordinate.
2. The video playing method of the LED special-shaped screen according to claim 1, characterized in that: The sub-screens of the target special-shaped screen include an arc screen, a ceiling screen and a ground screen, and the mapping of the spherical polar coordinates to the pixel coordinates of the target special-shaped screen includes: According to the sine value and cosine value of the depression angle and the sine value and cosine value of the elevation angle, the cylindrical rectangular coordinates when the spherical polar coordinates are located at the arc screen, the ceiling screen and the floor screen are calculated respectively, wherein the cylinder refers to the cylindrical surface of the cylinder formed by the arc screen, the ceiling screen and the floor screen; According to the value range of the azimuth angle of the spherical polar coordinates, the cylindrical rectangular coordinates are converted into pixel coordinates of the target special-shaped screen.
3. The video playing method of the LED special-shaped screen according to claim 2, characterized in that: The step of converting the cylindrical rectangular coordinates into pixel coordinates of the target special-shaped screen according to the value range of the azimuth angle of the spherical polar coordinates includes: Dividing the horizontal coordinate value of the cylindrical rectangular coordinate by the maximum value of the value range to obtain the horizontal coordinate value of the pixel coordinate of the target special-shaped screen; The ordinate value of the cylindrical rectangular coordinate is divided by the maximum value of the value range to obtain the ordinate value of the pixel coordinate of the target special-shaped screen.
4. The video playing method of the LED special-shaped screen according to claim 1, characterized in that: The step of calculating the color components corresponding to the pixel coordinates of the target special-shaped screen includes: Performing an inverse transformation operation on the pixel coordinates of the target special-shaped screen to obtain floating-point coordinates of image pixels of the panoramic video corresponding to the pixel coordinates of the target special-shaped screen; The average values of the blue, green and red color components of the floating point coordinates are calculated respectively as the blue, green and red color components corresponding to the pixel coordinates of the target special-shaped screen.
5. The video playing method of the LED special-shaped screen according to any one of claims 1 to 4, characterized in that: The projecting the target video onto each sub-screen in the target special-shaped screen to play the target video includes: Crop the target video according to a pre-configured splicing rule to obtain a video to be played on each sub-screen; The video to be played on each sub-screen is projected onto the sub-screen corresponding to the target special-shaped screen to play the target video.
6. A video playback device for an LED special-shaped screen, characterized in that: The device comprises: Acquisition module: used to acquire the panoramic video to be played; Conversion module: used for converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen, and obtaining the video image of each sub-screen in the target special-shaped screen; Splicing module: used for splicing and encoding the video images of each sub-screen to obtain the target video corresponding to the panoramic video; Playing module: used for projecting the target video to each sub-screen in the target special-shaped screen to play the target video; The step of converting the image pixel coordinates of the panoramic video into the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen includes: Mapping the image pixel coordinates of the panoramic video to spherical polar coordinates; Mapping the spherical polar coordinates to pixel coordinates of a target special-shaped screen; Calculate the color components corresponding to the pixel coordinates of the target special-shaped screen to obtain the video image of each sub-screen in the target special-shaped screen; Mapping the image pixel coordinates of the panoramic video to spherical polar coordinates includes: Taking the center point coordinates of the panoramic video image as the origin coordinates; Dividing the difference between the image pixel coordinates of the panoramic video and the origin coordinates by half the height of the image to obtain normalized proportional coordinates; Using the abscissa value of the normalized scale coordinate as the azimuth of the spherical polar coordinate; The ordinate value of the normalized scale coordinate is used as the polar angle of the spherical polar coordinate.
7. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; Memory, used to store computer programs; The processor is used to implement the video playback method of the LED special-shaped screen according to any one of claims 1 to 5 when executing the program stored in the memory.
8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the video playback method for the LED special-shaped screen according to any one of claims 1 to 5 is implemented.
Citation Information
Patent Citations
Real scene video display method and system
CN107172413A
Spherical enclosed cockpit panoramic display method based on double-projection transformation
CN108876712A
Immersive system based on LED main body
CN111145660A
Panoramic video playing method and system, storage medium and playing equipment
CN112788317A
Video cutting method and device, electronic equipment and computer readable storage medium
CN113470038A
