A method, device and display device for obtaining cover of program switching
By obtaining and covering the target screen of the video renderer, the container screen of the program screen container is directly obtained, which solves the problem of long and poor quality of program switching of large-screen media delivery devices, and realizes millisecond-level cover acquisition and seamless switching Effect.
Patent Information
- Application Number
- CN202110632869.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-06-07
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2041-06-07
AI Technical Summary
When the large-screen media delivery device switches the program, the cover acquisition time is long and the quality is poor, resulting in poor playback consistency.
By obtaining all video renderers in the program screen container, obtaining the current target screen and covering it above the video renderer, and finally obtaining the container screen in the program screen container as the cover for program switching, avoiding system screenshots and image processing, directly Stored in memory.
It significantly shortens the cover acquisition time, and improves from seconds to milliseconds, avoids the reduction in cover quality, and ensures seamless switching and improved appearance of the display during dynamic layout.
Smart Images

Figure CN115515005B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of multimedia technology, and in particular to a method, device and display equipment for obtaining a cover of a program switch. Background Art
[0002] With the development of media communication, various large-screen media delivery devices have appeared in various places. Therefore, in order to better deliver information to large-screen media delivery devices, the traditional information delivery method has gradually been replaced by the information delivery system. By installing the information delivery system, the middle platform of the information delivery system will push the media files to the playback terminal for playback, which can realize the real-time update of program information and improve the overall configuration efficiency of media display information. When it is necessary to switch programs on large-screen media delivery devices, in order to solve the problem of flashing screen or black screen, the system screenshot method is often used. However, different large-screen media devices are often equipped with different boards, and the production standards of different boards are not unified, and the API (Application Programming Interface) is also different, and the screenshot methods they are equipped with are also different. Therefore, the current board screenshot response time is generally long and the quality is low, resulting in poor playback continuity.
[0003] Therefore, the problem existing in the prior art is that when a large-screen media delivery device switches programs, it takes a long time to obtain the cover and the quality is poor. Summary of the invention
[0004] In view of the above problems, the present invention proposes a cover acquisition method, device and display device for program switching, which greatly shortens the cover acquisition time when program switching, avoids the reduction of cover quality, and improves the viewing experience of seamless switching of display screen programs during dynamic layout.
[0005] In the first aspect, the present application provides the following technical solution through an embodiment:
[0006] A method for obtaining a cover of a program switching comprises:
[0007] Acquire all video renderers in the program screen container; for each of the video renderers, acquire the target screen in the current video renderer; overlay the target screen on top of the corresponding video renderer; acquire the container screen in the current program screen container to use the container screen as the cover of the program switching; the container screen includes the target screen.
[0008] Optionally, before overlaying the target picture on the corresponding video renderer, the method includes:
[0009] A picture renderer is preset above the video renderer, and the picture renderer is set to an invisible state; and covering the target picture above the corresponding video renderer includes: using the picture renderer to render and display the target picture to cover the video renderer.
[0010] Optionally, overlaying the target picture on a corresponding video renderer includes:
[0011] Based on the size of the video renderer, the image renderer is generated; the image renderer is inserted above the video renderer; and the target picture is rendered and displayed using the image renderer to cover the video renderer.
[0012] Optionally, the image renderer is the same size as the video renderer it covers.
[0013] Optionally, obtaining the target picture in the current video renderer includes:
[0014] The getBitmap() method is used to obtain the target image in the video stream of the video renderer.
[0015] Optionally, the obtaining of a container screen in the current program screen container includes:
[0016] The method of the program picture container is adopted to obtain the container picture in the current program picture container.
[0017] Optionally, after obtaining the container screen in the current program screen container, the method further includes:
[0018] The container screen is saved in the memory of the system; the container screen is read, and the container screen is rendered above the program screen container.
[0019] In the second aspect, based on the same inventive concept, the present application provides the following technical solution through an embodiment:
[0020] A message sending system, characterized in that the message sending system is connected to a preset display device, and the message sending system is used to publish program information to the display device. The message sending system includes a processor and a memory, the memory is coupled to the processor, and the memory stores instructions, and when the instructions are executed by the processor, the message sending system controls the display device to perform the steps of any one of the methods described in the first aspect above.
[0021] In the third aspect, based on the same inventive concept, the present application provides the following technical solution through an embodiment:
[0022] A display device comprises a processor and a memory, wherein the memory is coupled to the processor and stores instructions, and when the instructions are executed by the processor, the display device executes the steps of any one of the methods described in the first aspect.
[0023] In the fourth aspect, based on the same inventive concept, the present application provides the following technical solution through an embodiment:
[0024] A computer-readable storage medium stores a computer program, which, when executed by a processor, implements the steps of any one of the methods described in the first aspect above.
[0025] The present invention provides a method, device and display device for obtaining the cover of program switching, wherein the method obtains all video renderers in the program screen container; then, for each video renderer, obtains the target screen in the current video renderer; then covers the target screen on top of the corresponding video renderer; finally, obtains the container screen in the current program screen container, and the container screen includes the target screen, thereby ensuring that the current target screen of the video renderer can be effectively obtained from the program screen container, avoiding the appearance of black areas, ensuring the integrity of the container screen, and the obtained container screen is used as the cover of the program switching. In the present invention, the system screenshot of the board card is avoided in the entire process of obtaining the cover, and there is no need to process the image or form file storage, which effectively increases the cover acquisition speed from seconds to milliseconds; at the same time, it also avoids the reduction of the cover quality, ensures that the cover quality is consistent with the original picture quality of the display screen, and improves the viewing experience of seamless switching of display screen programs during dynamic layout.
[0026] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented according to the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the specific implementation methods of the present invention are listed below. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for describing the embodiments. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:
[0028] Figure 1 A flowchart of a method for obtaining a cover for program switching provided by an embodiment of the present invention is shown;
[0029] Figure 2 A schematic diagram of program layout of a display device provided by an embodiment of the present invention is shown;
[0030] Figure 3 The method of obtaining only the program picture container is shown. Figure 2 A schematic diagram of a container screen;
[0031] Figure 4 Shows Figure 2 A schematic diagram of a container screen when the image renderer in the video A area is larger than the video renderer;
[0032] Figure 5 Shows Figure 2 Schematic diagram of the container screen when the image renderer in area A of the middle video is smaller than the video renderer. DETAILED DESCRIPTION
[0033] The exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided to enable a more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.
[0034] According to the inventor's analysis, for large-screen media delivery devices in the application scenario of the information transmission system, when obtaining the transition cover through system screenshots, the following process will be performed: first, the entire display screen will be captured, and then the captured screenshot result will be stored in the form of a file and saved in the read-only memory of the board. In order to improve the storage efficiency and the rendering efficiency as a cover, and shorten the time for obtaining and processing the cover, the screenshots will generally be further processed during the storage process to obtain a smaller file. However, this processing process will cause the quality of the screenshots to decrease. For example, after processing, the brightness of the screenshots will decrease and the clarity of the picture will decrease. Not only that, the processing process will also consume a certain amount of time. The time consumed by the screenshot processing process and the time consumed by the storage and reading of the screenshots will cause the time to refresh the cover when the program is switched to be longer than 16ms, and the display screen cannot reach 60fps (Frames PerSecond, the number of frames transmitted per second) when refreshing the picture, so that the picture freezes. In addition, due to the limitations of the display device system, screenshots can only be taken in full screen. In this way, when only a small area on the display screen is used to display the program, a full screen screenshot is also required, and the computing overhead cannot be optimized.
[0035] Furthermore, due to the limitation of cost and application scenarios, the boards and cards used in large-screen media delivery devices often have low performance. If the response time of screenshot is shortened by simply improving the hardware performance, the hardware cost will be greatly increased, which is not conducive to cost control and resource utilization. In the context of this analysis, the inventor has designed a solution from another angle to solve or partially solve the problem of long cover acquisition time and poor quality when switching programs. For details, please refer to the following embodiments.
[0036] First embodiment
[0037] See also Figure 1 , shows a flow chart of a method for obtaining a cover of a program switching provided by a first embodiment of the present invention. The method for obtaining a cover of a program switching comprises:
[0038] Step S10: Obtain all video renderers in the program picture container.
[0039] In step S10, the program screen refers to the screen on the display screen of the large-screen media delivery device (hereinafter referred to as the media device). Multiple display areas can be arranged on the program screen, and each display area can display different program information, such as screen content, text content or video content. For example, there are three display areas on a display screen: area A, area B and area C; among which area A can display pictures, and areas B and C can play videos. Area A, area B, area C and the background part together constitute the program screen.
[0040] Program switching means removing the original layout and then dynamically adding a new layout. The relevant files of the new layout are sent from the information distribution system to the media device, which renders and displays them on its display screen. For example, before the switch, the program screen has 3 display areas, and after the rearrangement, the program screen can be changed to 4 display areas. The time taken to complete the entire switching process is between milliseconds and hundreds of milliseconds. During this process, the next layout screen has not been rendered yet, and flickering or black screen will appear. Therefore, in this process, the flickering or black screen is blocked by displaying the screen before the previous program is removed as the cover.
[0041] The video renderer is used to render the video and display it on the display screen. For example, the video renderer can be TextureView.
[0042] Step S20: For each of the video renderers, obtain the target picture currently in the video renderer.
[0043] In the program screen container, there may be a corresponding method to obtain the container screen of the program screen container. The container screen is the screen in the container that is being displayed on the display screen. The method of the program screen container may be public static BitmaploadBitmapFromView(), which can be referred to as follows:
[0044]
[0045] The above codes are merely exemplary expressions to make the implementation process of this embodiment more clearly presented, so the above exemplary codes should not be understood as limiting the scope of protection of the present invention. The parameter definitions and the implementation logic in the method can be adaptively transformed according to different application scenarios.
[0046] However, obtaining the entire container image through the program image container method will produce a black area. Due to the limitation of the system's rendering mechanism, when the program image container contains a video renderer, the program image container method will not be able to obtain the image where the video renderer is located. At this time, the image corresponding to the location of the video renderer in the program image obtained through the program image container will be displayed as black. Figure 2 In the display device shown, if the container image is directly obtained by using the program image container method, the video A and video B areas will become black areas, such as Figure 3 To avoid this situation, in this embodiment, the entire container image of the program image container is acquired by executing steps S20-S30.
[0047] In step S20, each video renderer can be processed by traversal to obtain the current picture, that is, the target picture, from the data stream of the video renderer. For example, if the video renderer is TextureView, the getBitmap() method can be used to obtain the target picture currently rendered on the interface from the video stream of the video renderer, and the obtained target picture can be stored in the system's memory. By using the getBitmap() method to obtain the picture of the video renderer, an image of a specified frame can be obtained, that is, a frame of image when the program is switched. The obtained image does not need to be stored as a file, which shortens the processing time.
[0048] Step S30: Overlay the target image on the corresponding video renderer.
[0049] In step S30, an example is used for explanation. For example, in step S20, the target screen 1 is obtained in the video renderer A. When step S30 is executed, the target screen 1 is covered on the top of the video renderer A. At this time, when the entire screen in the container is obtained through the program screen container, the container screen of the current video renderer can be obtained, and no black area will appear due to the video renderer. Specifically, at least two implementation methods of step S30 are provided in this embodiment:
[0050] 1. The first overlay method: Before step S30, a picture renderer is preset above the video renderer, and the picture renderer is set to an invisible state. Specifically, the picture renderer can be ImageView, etc. Since the preset picture renderer is invisible before the program screen container is obtained, the video renderer below the picture renderer will not be affected when performing video rendering and display.
[0051] When it is necessary to obtain the entire screen of the program screen container, the image renderer is used to render and display the target screen to cover the video renderer. At this time, the video renderer is blocked by the target screen, and the target screen is the real-time screen of the video renderer in the process of obtaining the cover. When the program screen container method is used to obtain the entire container screen, the screen rendered by the image renderer can be obtained, avoiding the problem of generating black areas. Not only that, since the image renderer is preset above the video renderer, when the target screen is obtained, it can be rendered and displayed to achieve occlusion. The entire process does not need to insert the image renderer, and the obtained target screen does not need to be stored in the form of an image file, which improves processing efficiency.
[0052] 2. The second overlay method: based on the size of the video renderer, generate the image renderer corresponding to the video renderer; insert the generated image renderer above the video renderer; then, use the image renderer to render and display the target screen to cover the video renderer. Similarly, this method can cover the video renderer when the program screen container method obtains the entire container screen. The obtained target screen does not need to be stored as an image file, and has high processing efficiency. In this implementation method, by dynamically generating an image renderer according to the size of the video renderer and inserting it above the video renderer, the flexibility of defining the image renderer can be facilitated, such as adjusting the size and coordinates of the rendering area, etc., thereby improving development efficiency.
[0053] In this embodiment, when the image renderer is used to render the target screen to cover the video renderer, if the size of the image renderer is larger than the video renderer, the content outside the video renderer may be covered after the target screen is rendered, or the obtained container screen may be misaligned. Figure 4, taking video A area as an example, if the size of the image renderer is larger than the video renderer, it will cause over-coverage, where the X part is the covered area outside video A area; if the size of the image renderer is smaller than the video renderer, the content in the video renderer may not be well covered after the target screen is rendered, resulting in a black area in the obtained container screen. Please refer to Figure 5 , taking video area A as an example, if the size of the image renderer is smaller than the video renderer, it will not be able to completely cover the video renderer, where part Y is the uncovered part of video area A, i.e., the part that generates the black area. Therefore, the size of the inserted or preset image renderer can be set to be the same as the size of the video renderer, so that the rendered target screen can just cover the video renderer, ensuring good container screen quality.
[0054] Step S40: obtaining a container screen in the current program screen container, so as to use the container screen as the cover of the program switching; the container screen includes the target screen.
[0055] In step S40, after the target picture is used to block the video renderer, there is no video renderer at the top layer of the program picture container, that is, in the program picture container, the target picture rendered by the picture renderer is above the video renderer. At this time, the entire program picture container is captured, and a complete container picture can be obtained without any black area. The container picture obtained by the program picture container method is stored in the memory of the board system, and no file is generated and stored in the readable memory. Therefore, there is no process of reading the container picture in the readable memory, which greatly shortens the time of the cover acquisition process.
[0056] When using the cover, the container screen will be read from the system's memory as the cover and rendered to cover the entire program screen container. When the new layout below the cover is generated and rendered, the cover can be removed to display the switched program on the display.
[0057] In summary, the present embodiment provides a method for obtaining a cover for program switching, which obtains all video renderers in a program screen container; then, for each video renderer, obtains a target screen in the current video renderer; and then overlays the target screen on top of the corresponding video renderer; finally, obtains a container screen in the current program screen container, which includes the target screen, thereby ensuring that the current target screen of the video renderer can be effectively obtained from the program screen container, avoiding the appearance of black areas, ensuring the integrity of the container screen, and the obtained container screen is used as the cover of the program switching; the present embodiment avoids the use of system screenshots of media devices in the entire process of obtaining the cover, and does not need to process the image or form file storage, effectively increasing the cover acquisition speed from seconds to milliseconds; at the same time, it also avoids the reduction of the cover quality, ensuring that the cover quality is consistent with the original picture quality of the display screen, and improving the viewing experience of seamless switching of display screen programs during dynamic layout.
[0058] Second embodiment
[0059] Based on the same inventive concept, the second embodiment of the present invention provides a signal sending system, which is connected to a preset display device, and is used to publish program information to the display device. The signal sending system includes a processor and a memory, and the memory is coupled to the processor. The memory stores instructions, and when the instructions are executed by the processor, the signal sending system controls the display device to perform the steps of any one of the methods described in the first embodiment above.
[0060] It should be noted that the corresponding understanding and explanation of relevant technical details in the message sending system provided in the embodiment of the present invention can refer to the contents in the aforementioned method embodiment, and its specific implementation and the technical effects produced are the same as those in the aforementioned method embodiment. For the sake of brief description, for matters not mentioned in the device embodiment, reference can be made to the corresponding contents in the aforementioned method embodiment.
[0061] Third embodiment
[0062] Based on the same inventive concept, a third embodiment of the present invention provides a display device, including a processor and a memory, wherein the memory is coupled to the processor, and the memory stores instructions, which, when executed by the processor, enable the display device to execute the steps of any one of the methods described in the first embodiment above.
[0063] It should be noted that, in the display device provided in the embodiment of the present invention, the specific implementation of each of the above steps and the technical effects produced are the same as those in the aforementioned method embodiment. For the sake of brief description, the parts not mentioned in this embodiment can be referred to the corresponding contents in the aforementioned method embodiment.
[0064] Fourth embodiment
[0065] Based on the same inventive concept, a fourth embodiment of the present invention provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of any one of the methods described in the first embodiment are implemented.
[0066] It should be noted that, in the computer-readable storage medium provided in the embodiment of the present invention, the specific implementation of each of the above steps and the technical effects produced are the same as those in the aforementioned method embodiment. For the sake of brief description, the parts not mentioned in this embodiment can be referred to the corresponding contents in the aforementioned method embodiment.
[0067] The term "and / or" that appears in this article is only a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article generally indicates that the objects associated before and after are in an "or" relationship; the word "comprising" does not exclude the existence of elements or steps that are not listed in the claims. The word "one" or "an" placed before an element does not exclude the existence of multiple such elements. The present invention can be implemented with the aid of hardware including several different elements and with the aid of appropriately programmed computers. In a unit claim that lists several devices, several of these devices may be embodied by the same hardware item. The use of the words first, second, and third, etc. does not indicate any order. These words can be interpreted as names.
[0068] Those skilled in the art will appreciate that embodiments of the present invention may be provided as methods, systems, or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
[0069] The present invention is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present invention. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.
[0070] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.
[0071] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process in the computer or other programmable device. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.
[0072] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.
[0073] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.
Claims
1. A method for obtaining a cover of a program switching, characterized in that: include: Obtain all video renderers in the program screen container; wherein the program screen refers to the screen on the display screen of the large-screen media delivery device; the video renderer is used to render the video and display it on the display screen; for each video renderer, obtain the target screen in the current video renderer; Overlaying the target image on the corresponding video renderer; Acquire a container screen in the current program screen container, so as to use the container screen as the cover of the program switching; the container screen includes the target screen; Before overlaying the target image on the corresponding video renderer, the method includes: presetting a picture renderer on the video renderer and setting the picture renderer to an invisible state; overlaying the target image on the corresponding video renderer, the method includes: rendering and displaying the target image using the picture renderer to cover the video renderer; Alternatively, overlaying the target image on the corresponding video renderer includes: generating a picture renderer based on the size of the video renderer; inserting the picture renderer on the video renderer; and rendering and displaying the target image using the picture renderer to cover the video renderer. After obtaining the container image in the current program image container, the method further includes: Saving the container image to the system's memory; The container screen is read and rendered above the program screen container.
2. The method according to claim 1, characterized in that The image renderer has the same size as the video renderer it covers.
3. The method according to claim 1, characterized in that The step of obtaining the target image in the current video renderer includes: The getBitmap() method is used to obtain the target image in the video stream of the video renderer.
4. The method according to claim 1, wherein The obtaining of the container screen in the current program screen container includes: The method of the program picture container is adopted to obtain the container picture in the current program picture container.
5. A message sending system, characterized in that: The signaling system is connected to a preset display device, and is used to publish program information to the display device. The signaling system includes a processor and a memory, and the memory is coupled to the processor. The memory stores instructions, and when the instructions are executed by the processor, the signaling system controls the display device to perform the steps of the method described in any one of claims 1-4.
6. A display device, characterized in that: The display device comprises a processor and a memory, wherein the memory is coupled to the processor and stores instructions, and when the instructions are executed by the processor, the display device executes the steps of the method according to any one of claims 1 to 4.
7. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 4 are implemented.
