Display method and device, equipment, storage medium and program product

Abstract

The invention discloses a display method and device, equipment, a storage medium and a program product, and relates to the technical field of televisions.The display method comprises the steps that primary picture display data and secondary picture display data matched with panel resolution are generated according to received to-be-displayed content; performing display frame synthesis on the main picture display data to obtain first display data matched with a system resolution which is lower than a panel resolution; zooming the first display data to obtain second display data matched with the panel resolution, and mixing and splicing the second display data and the secondary picture display data; and displaying a mixed picture obtained by mixing and splicing through a physical panel.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of television, and particularly relates to a display method, a display device, a display equipment, a storage medium and a program product. BACKGROUND

[0002] With the popularization of smart televisions, the demand of television stores for product display is increasingly diversified. Traditional television selling point display methods mostly rely on physical labels or television full-screen advertisements, and have problems such as inconvenient information updating, large visual interference, limited resolution and the like. Some televisions support superimposing labels on the screen through software, but are limited by system resolution and cannot realize super high definition display of local areas on high resolution physical panels (such as 4K panels), resulting in blurred label content and affecting user experience.

[0003] At present, the display content of an Android system is usually unified synthesized by SurfaceFlinger, and the output resolution is limited by the system resolution setting (such as 1080P). Even if the physical panel is of 4K resolution, the local label content cannot be displayed in 4K resolution, resulting in blurred label display. SUMMARY

[0004] The main purpose of the present application is to provide a display method, a display device, a display equipment, a storage medium and a program product, aiming at solving the technical problem that the local label display of the existing smart television is easy to blur.

[0005] To achieve the above-mentioned purpose, the present application provides a display method, which comprises the following steps. generating main picture display data and sub-picture display data matched with panel resolution according to received to-be-displayed content; performing display frame synthesis on the main picture display data to obtain first display data matched with system resolution, the system resolution being lower than the panel resolution; scaling the first display data to obtain second display data matched with the panel resolution, and mixing and splicing the second display data and the sub-picture display data; displaying the mixed picture obtained by mixing and splicing on a physical panel.

[0006] In addition, to achieve the above-mentioned purpose, the present application further provides a display device, which comprises a memory, a processor and a computer program stored in the memory and executable on the processor, and the computer program is configured to implement the steps of the display method as described above.

[0007] In addition, to achieve the above-mentioned purpose, the present application further provides a storage medium, which is a computer readable storage medium, and the storage medium stores a computer program, and the computer program is executed by a processor to implement the steps of the display method as described above.

[0008] In addition, to achieve the above object, the present application also provides a computer program product, which comprises a computer program, and the computer program is executed by a processor to realize the steps of the display method. BRIEF DESCRIPTION OF DRAWINGS

[0009] The drawings incorporated in the specification include an embodiment consistent with the present application and serve to explain the principles of the present application together with the specification.

[0010] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the drawings needed to be used in the embodiments or prior art description will be briefly introduced as follows. Obviously, for those of ordinary skill in the art, other drawings can also be obtained from these drawings without any creative effort.

[0011] Figure 1 The flowchart is provided for the display method embodiment one of the present application; Figure 2 The system architecture diagram is provided for the display method in an implementation manner of the embodiment of the present application; Figure 3 The flowchart is provided for the display method embodiment two of the present application; Figure 4 The flowchart is provided for the display method embodiment three of the present application; Figure 5 The module structure diagram is provided for the display device of the embodiment of the present application; Figure 6 The device structure diagram is provided for the hardware running environment involved in the display method in the embodiment of the present application.

[0012] The object implementation, functional features and advantages of the present application will be further explained with reference to the embodiments and the drawings. DETAILED DESCRIPTION

[0013] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application, and are not used to limit the present application.

[0014] In order to better understand the technical solutions of the present application, the following will be described in detail in combination with the drawings in the specification and specific implementation manners.

[0015] The main solution of the embodiment of the present application is: generating main picture display data and sub-picture display data matched with the panel resolution according to the received to-be-displayed content; performing display frame composition on the main picture display data to obtain first display data matched with the system resolution, the system resolution being lower than the panel resolution; performing scaling on the first display data to obtain second display data matched with the panel resolution, and performing mixed splicing on the second display data and the sub-picture display data; and displaying the mixed picture obtained by the mixed splicing through the physical panel.

[0016] In some embodiments of the embodiment of the present application, since the display content is usually uniformly composed by the display composer SurfaceFlinger, the resolution of the output display data is limited by the system resolution set by the Android system. Although some chip platforms support the Overlay channel, they lack flexible partition splicing and high-resolution area display capabilities, and it is difficult to meet the needs of the market for high-definition, flexible, and low-interference label content.

[0017] The present application proposes a display method that can still display sub-picture content at a physical 4K resolution in a specified small area of the screen when the system main picture display data resolution of the smart television is lower than the physical panel resolution (for example, the system resolution is 1080P and the panel resolution is 4K), which significantly improves the display clarity and visual effect of the sub-picture area.

[0018] It should be noted that the execution subject of the embodiment can be a computing service device with content display, data processing, network communication, and program running functions, such as a smart television, a display screen, or an electronic device, a virtual device, or the like that can implement the above functions. The display device is taken as an example to describe the embodiment and the following embodiments.

[0019] Based on this, the embodiment of the present application provides a display method, which refers to Figure 1 , Figure 1 The flowchart provided by the display method embodiment one of the present application is shown in the figure.

[0020] In the embodiment, the display method includes steps S10-S40: Step S10, generating main picture display data and sub-picture display data matched with the panel resolution according to the received to-be-displayed content.

[0021] It should be noted that the to-be-displayed content can include main picture display content that needs to be displayed through the main picture and sub-picture display content that needs to be displayed through the sub-picture. By displaying and splicing the main picture and the sub-picture, the main picture display content and the sub-picture display content can be displayed together on the physical panel.

[0022] It can be understood that the above main screen display content, that is, the main screen display content occupying the main display area of the screen on the physical panel of the display device, as the core carrier of user interaction or content viewing, such as the operating system graphical interface, application rendering content, dynamic wallpaper or screen saver, etc. The embodiments of the present application do not limit this. Among them, the main screen display content will be rendered at the system resolution (such as 1080P) set by the system when generating display data. Through the hardware scaler of the hardware layer, the rendered display data can be enlarged to the panel resolution.

[0023] It should be understood that the above secondary screen display content, that is, the secondary screen display content usually overlaid on the main screen display content on the physical panel of the display device, is usually graphical data of auxiliary, prompt or interactive content, such as system status and notification, television store label, picture-in-picture, interactive control, etc. The embodiments of the present application do not limit this.

[0024] It should be noted that the system resolution is the screen resolution set by the operating system or application of the display device, such as 720P, 1080P, 480P set by the user. The panel resolution is the actual pixel amount possessed by the display device, which determines the highest display precision of the display device, such as 4K, 8K, 1080P, etc. In actual application, if the system resolution is lower than the physical panel resolution, the display data will be scaled through the hardware scaler of the hardware layer when displaying, so that the display is adapted to the panel resolution of the physical panel. Since the scaling is directly performed through the hardware scaler of the hardware layer of the display, the computational load of the central processing unit and the graphics processing unit is reduced, and the smoothness of the system is improved. However, this scaling method is usually implemented by interpolation or other methods, which will affect the clarity of the display to some extent. When displaying the secondary screen data on a high-resolution panel, scaling may cause edge cracking, jaggies, blur, etc.

[0025] In some embodiments of the embodiments of the present application, for the convenience of description, the display device of the present application is divided into several functional modules according to the use function, such as the main content display module, the electronic tag generation module, the DDK splicing control module, the Layer name detection and control module, and the display output module. For details, please refer to the examples of Figure 2 Figure 2 is a system architecture diagram of the display method in an implementation manner of the embodiments of the present application.

[0026] ​In some embodiments of the present application, the main content display module is configured to render the main screen display. Specifically, the main screen display content (e.g., Android desktop, HDMI signal, WebView, etc.) in the content to be displayed can include the main screen display, and the system can generate main screen display data corresponding to the main screen display content, and perform display frame composition through the display compositor SurfaceFlinger at a system resolution (e.g., 1920x1080) to obtain first display data matching the system resolution. That is, in step S20, the main screen display data is subjected to display frame composition to obtain first display data matching the system resolution, and the system resolution is lower than the panel resolution.

[0027] It should be understood that the above specific manner of display frame composition through the display compositor SurfaceFlinger can be implemented according to the requirements in actual applications, and the present application is not limited in this regard. For example, the display compositor can obtain main screen display data corresponding to each system application program, synthesize the corresponding data, and output the synthesized frame buffer Framebuffer, which is the above-mentioned first display data, and the corresponding resolution is the system resolution.

[0028] It should be noted that for the secondary screen display content corresponding to the secondary screen, the secondary screen display data matching the panel resolution can be generated according to requirements, and display parameters such as display area (e.g., a 300x300 pixel area in the lower right corner of the screen), transparency, and level can be specified.

[0029] In some embodiments of the present application, the present application can add a secondary screen type corresponding to the secondary screen display data in the display compositor SurfaceFlinger, and support system-level services to directly deliver high-resolution secondary screen display data through a preset interface. During composition, the main screen display data and the secondary screen display data go through different channels, so that the main screen display data is synthesized by the display compositor SurfaceFlinger to obtain the corresponding frame buffer, and the secondary screen display data is output through the preset interface without being synthesized. In actual applications, the secondary screen type added in the display compositor SurfaceFlinger can be dynamically added, deleted, and parameter modified to meet the flexible management requirements.

[0030] It should be noted that the above-mentioned preset interface can be an interface such as Binder / Native interface that can realize high-resolution data buffer transmission, and the present application is not limited in this regard.

[0031] In step S30, the first display data is scaled to obtain second display data matching the panel resolution, and the second display data and the secondary picture display data are mixed and spliced. In step S40, the mixed picture obtained by the physical panel display is displayed.

[0032] In some embodiments of the present application, the DDK splicing control module of the present application can realize partition splicing and synthesis of the primary picture and the secondary picture based on a bottom display driver (Display Driver Kit, DDK), while supporting channel configuration of a hardware layer. Through the display output module, the synthesized content can be output to the physical panel, realizing seamless superposition of the primary picture and the high-resolution secondary picture.

[0033] In some embodiments of the present application, the present application can also include a Layer name detection and control module. The Layer name detection and control module can detect the current top layer in real time, and automatically control the display and hiding of the secondary picture according to the preset label whitelist.

[0034] It should be noted that the above-mentioned current top layer can be a graphical layer corresponding to the interface visible to the user at the top layer in the layer stack of the real system, and can be a hardware layer corresponding to the first display content.

[0035] It should be understood that the above-mentioned mixed splicing is a process of combining one or more independent image sources or layers into a single complete picture according to the spatial layout set in the hardware layer. Through mixed splicing, the final visual image can be presented on the physical panel after the one or more independently rendered hardware layers are synthesized and processed by a hardware composer (HWC). In the present application, the multi-hardware plane feature of the system on chip (SOC) is utilized to physically isolate the primary picture rendering channel and the secondary picture rendering channel, and to creatively realize the mixed display mode of coexistence of primary picture scaling and secondary picture non-scaling on the same physical panel, thereby guaranteeing the display performance of the secondary picture under high resolution.

[0036] The embodiment of the present application generates main picture display data and sub-picture display data matched with the panel resolution according to the received content to be displayed; performs display frame composition on the main picture display data to obtain first display data matched with the system resolution, the system resolution being lower than the panel resolution; scales the first display data to obtain second display data matched with the panel resolution, and mixes and splices the second display data and the sub-picture display data; and displays the mixed picture obtained by the mixing and splicing through the physical panel. Since the main picture display data and the sub-picture display data are generated by rendering in different resolutions, the low-resolution main picture display data is scaled to the physical resolution after display frame composition, and the high-resolution sub-picture display data is not scaled, thereby avoiding blurring and other problems caused by resolution scaling of the sub-picture display data; the first display data and the sub-picture display data are spliced, local high-definition display of the sub-picture in the physical panel is realized, and the constraint of the same resolution in the traditional display system is broken. Through software and hardware cooperation, high-definition display is provided for the sub-picture without significantly increasing system overhead, the application contradiction of the high-resolution panel on the low-performance device is solved, and a feasible technical path is provided for multi-resolution display, AR superposition and other applications.

[0037] Based on the first embodiment of the present application, in the second embodiment of the present application, the same or similar contents as the above-mentioned first embodiment can be referred to the above introduction, and will not be described in detail. On this basis, please refer to Figure 3 , Figure 3 for the flowchart provided by the second embodiment of the display method of the present application.

[0038] As Figure 3 shown, in the embodiment of the present application, the step of scaling the first display data to obtain second display data matched with the panel resolution, and mixing and splicing the second display data and the sub-picture display data, includes: Step S31, the first display data is allocated to the first hardware layer, and the first display data is processed by the first hardware layer to obtain second display data matched with the panel resolution, and the first processing at least includes scaling processing; Step S32, the sub-picture display data is allocated to the pre-configured second hardware layer for second processing to obtain processed sub-picture display data, and the second processing does not include scaling processing; Step S33, the second display data and the processed sub-picture display data are mixed and spliced.

[0039] It should be noted that the display controller of the system-on-chip (such as MTK, Realtek, Amlogic, etc. platform) of the intelligent television at present can usually include multiple hardware layers, such as the first hardware layer and the second hardware layer described above. The first hardware layer Layer0 (Primary Plane) can be used to display the main picture of the Android system, and specifically can be used to display the frame buffer synthesized by the display synthesizer SurfaceFlinger. Since the first display data synthesized by the display synthesizer SurfaceFlinger is of system resolution, it can be enlarged to the panel resolution corresponding to the physical panel by the hardware scaler of the hardware layer. The second hardware layer Layer1 (Overlay Plane) can be used as a dedicated layer of the secondary picture, and is used to display the secondary picture. The hardware layer can be configured to not pass through the hardware scaler, and directly read the secondary picture display data Buffer in the memory in a point-to-point manner.

[0040] It can be understood that the hardware scaler described above is a circuit module integrated in the hardware layer, which can be used to use an image scaling algorithm (such as an interpolation algorithm, a bilinear interpolation algorithm, etc.) to calculate and output a pixel array of a target resolution (i.e., the panel resolution in the present application) according to a configured scaling ratio of the pixel array of the input image in real time.

[0041] In some embodiments of the embodiments of the present application, the embodiments of the present application can configure the hardware layer to realize different processing modes of the data by different hardware layers. Specifically, the configured parameters can include: a file descriptor of the display data (which can be used to distinguish the second display data and the secondary picture display data), a display width of the display data corresponding to the hardware layer, a display height of the display data corresponding to the hardware layer, a physical panel display starting X coordinate, a physical panel display starting Y coordinate, a level of the hardware layer, a transparency of the display, a scaling flag of the display, etc., wherein the content corresponding to the parameters can be set according to the requirements in the actual application, and the embodiments of the present application do not limit this.

[0042] It should be noted that for the first hardware layer, the scaling flag bit therein can be configured as a normal scaling flag bit to realize scaling of the resolution of the second display data corresponding to the main picture to the panel resolution corresponding to the physical panel; for the second hardware layer, the scaling flag bit therein can be configured as a skip scaling to realize skip of the scaling processing of the secondary picture display data. That is, before the step of allocating the secondary picture display data to the pre-configured second hardware layer for the second processing to obtain the processed secondary picture display data, the method further includes: obtaining a configuration file of the second hardware layer; and configuring the scaling flag bit of the second hardware layer as a skip scaling flag bit based on the configuration file to obtain a pre-configured second hardware layer processing channel, and the skip scaling flag bit is used to configure the second hardware layer to not perform scaling processing.

[0043] It can be understood that the obtaining manner and the configuration manner of the configuration file can be selected according to the requirements in actual application, for example, a specific structure body is defined to configure the first hardware layer and the second hardware layer by communicating with the kernel display driver through an IOCTL interface.

[0044] In some embodiments of the embodiments of the present application, in order to realize the resolution contradiction of the main picture and the secondary picture, the embodiments of the present application can perform double-channel management on the main picture display data and the secondary picture display data. Specifically, since the screen resolution recognized by the system is a system resolution (such as 1080P), in order to map the second display data to the physical panel, the second display data can be stretched from the system resolution to the panel resolution by the hardware scaler of the first hardware layer. For the display content corresponding to the secondary picture, the panel resolution corresponding secondary picture display data GraphicBuffer can be directly generated, and in the second hardware layer, the secondary picture display data GraphicBuffer does not need to be coordinate-converted, and is directly projected to the physical pixel. Compared with the main picture display data, the secondary picture display data of the present application is drawn and processed through a separate channel, bypasses the display synthesizer SurfaceFlinger synthesis stage of the system, and is directly sent to the hardware synthesizer to be mixed and spliced with the second display data.

[0045] In some embodiments of the embodiments of the present application, in the processing of the hardware synthesizer, the secondary picture type corresponding to the second hardware layer can be ensured not to participate in the graphics processor synthesis, but to directly perform hardware superposition.

[0046] The embodiment of the present application allocates the first display data to the first hardware layer, performs first processing on the first display data through the first hardware layer to obtain second display data matched with the panel resolution, the first processing at least including scaling processing; allocates the secondary picture display data to the preconfigured second hardware layer to perform second processing to obtain processed secondary picture display data, the second processing not including scaling processing; and performs mixed splicing on the second display data and the processed secondary picture display data. Since the main picture display data (first display data) and the secondary picture display data are allocated to different hardware layers for processing, channel isolation in the physical layer is realized, the independent processing of the main content and the secondary content is realized, and problems such as secondary picture display blurring caused by unified display synthesis and content scaling are avoided.

[0047] Based on the first embodiment and / or the second embodiment of the present application, in the third embodiment of the present application, the same or similar content as the above-mentioned embodiment one and / or embodiment two can be referred to the above introduction, and the subsequent will not be described in detail. On this basis, please refer to Figure 4 , Figure 4 The flowchart provided by the third embodiment of the display method of the present application is shown in the figure.

[0048] As Figure 4 shown, in the embodiment of the present application, the step of performing mixed splicing on the second display data and the processed secondary picture display data includes: Step S41, obtaining a preset label whitelist corresponding to the foreground activity of the main picture display data and the secondary picture display data; Step S42, determining whether the foreground activity belongs to the preset label whitelist; Step S43, if it belongs, performing mixed splicing on the second display data and the processed secondary picture display data through the hardware compositor.

[0049] It should be noted that in order to realize the monitoring of the foreground hardware layer, the Layer name detection and control module of the embodiment of the present application can run a daemon process in the system service, and realize the content monitoring of the hardware layer through the registration of the listener. Specifically, the Layer name detection and control module of the embodiment of the present application can obtain the package name or the activity Activity name corresponding to the main picture display data (second display data) of the current first hardware layer in real time, and the package name or the activity name can determine the current foreground display content. In the embodiment of the present application, the way of obtaining the package name or the activity name can be realized through Window Manager, Activity Manager, SurfaceFlinger Layer stack and the like. The embodiment of the present application does not limit this.

[0050] It can be understood that for the secondary screen display data to be displayed, there can be a preset label whitelist corresponding to the foreground activity. The preset label whitelist can include the foreground activity name that needs to display the secondary screen display data, such as a store label that can be displayed on the application interface related to promotion. By comparing the foreground activity with the whitelist activity in the preset label whitelist, if it belongs, the secondary screen display data and the second display data can be mixed and spliced by the hardware compositor; if it does not belong, the secondary screen display data can be hidden or closed, and only the content corresponding to the main screen is displayed on the physical panel. That is, after the step of determining whether the foreground activity belongs to the preset label whitelist, it further includes: if it does not belong, the second display data is mixed and spliced by the hardware compositor.

[0051] In some embodiments of the present application, the step of determining whether the foreground activity belongs to the preset label whitelist includes: obtaining a label display activity in the preset label whitelist; comparing the label display activity and the foreground activity package name to obtain a display comparison result; and determining whether the foreground activity belongs to the preset label whitelist according to the display comparison result.

[0052] It should be noted that the above-mentioned preset label whitelist can be configured by the background or locally, such as by store background configuration, user local configuration, etc., which is not limited in the present application.

[0053] In some embodiments of the present application, when the foreground activity package name matches the activity name in the preset label whitelist, the DDK splicing control module can be automatically called to configure and display a high-resolution second hardware layer, otherwise the second hardware layer is closed or hidden.

[0054] In some embodiments of the present application, the above-mentioned Layer name detection and control module can support real-time detection and automatic response in application switching, foreground activity switching, signal source switching and other scenarios, which is not limited in the present application.

[0055] It can be understood that the above-mentioned display comparison result can include comparison pass and comparison fail, when the comparison pass, it can be determined that the current foreground activity belongs to the preset label whitelist; otherwise, it is determined that the current foreground activity does not belong to the preset label whitelist.

[0056] The present application embodiment obtains the preset label whitelist corresponding to the foreground activity of the main screen display data and the secondary screen display data; determines whether the foreground activity belongs to the preset label whitelist; if it belongs, the second display data and the processed secondary screen display data are mixed and spliced by the hardware compositor. Since the preset label whitelist is set to match the foreground activity, the display and hiding of the secondary screen are realized, so that the label can be switched according to different application scenarios.

[0057] It should be noted that the above examples are only used for understanding the present application and do not constitute a limitation on the display method of the present application, and more forms of simple changes based on this technical concept are within the protection scope of the present application.

[0058] The present application also provides a display device, please refer to Figure 5 , Figure 5 The module structure schematic diagram of the display device of the embodiment of the present application is shown in the figure, and the display device comprises: The generating module 10 is configured to generate main picture display data and sub-picture display data matched with the panel resolution according to the received content to be displayed; The synthesizing module 20 is configured to perform display frame synthesis on the main picture display data to obtain first display data matched with the system resolution, and the system resolution is lower than the panel resolution; The mixing module 30 is configured to perform scaling on the first display data to obtain second display data matched with the panel resolution, and perform mixing and splicing on the second display data and the sub-picture display data; The display module 40 is configured to display the mixed picture obtained by the mixing and splicing through the physical panel.

[0059] The display device provided by the present application adopts the display method in the above embodiment, which can solve the technical problem that the local label display of the existing smart television is easy to blur. Compared with the prior art, the beneficial effects of the display device provided by the present application are the same as those of the display method provided by the above embodiment, and the other technical features in the display device are the same as those disclosed in the above embodiment method, which will not be repeated here.

[0060] The present application provides a display device, comprising: at least one processor; and a memory connected with the at least one processor in communication; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the display method in the above embodiment one.

[0061] The following refers to Figure 6The diagram illustrates a structural schematic of a display device suitable for implementing embodiments of this application. The display device in the embodiments of this application may include, but is not limited to, mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), in-vehicle terminals (e.g., in-vehicle navigation terminals), and fixed terminals such as digital TVs and desktop computers. Figure 6 The display device shown is merely an example and should not impose any limitations on the functionality and scope of use of the embodiments of this application.

[0062] like Figure 6 As shown, the display device may include a processing unit 1001 (e.g., a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in read-only memory (ROM) 1002 or a program loaded from storage device 1003 into random access memory (RAM) 1004. The RAM 1004 also stores various programs and data required for the operation of the display device. The processing unit 1001, ROM 1002, and RAM 1004 are interconnected via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, touchscreens, touchpads, keyboards, mice, image sensors, microphones, accelerometers, gyroscopes, etc.; output devices 1008 including, for example, liquid crystal displays (LCDs), speakers, vibrators, etc.; storage devices 1003 including, for example, magnetic tapes, hard disks, etc.; and communication devices 1009. Communication device 1009 allows the display device to communicate wirelessly or wiredly with other devices to exchange data. Although the figures show display devices with various systems, it should be understood that implementation or possession of all the systems shown is not required. More or fewer systems may be implemented alternatively.

[0063] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product comprising a computer program carried on a computer readable medium, the computer program containing program codes for executing the method shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network through a communication device, or installed from the storage device 1003, or installed from the ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiments disclosed in the present application are executed.

[0064] The display device provided by the present application adopts the display method in the above-mentioned embodiments, and can solve the technical problem of easy blurring of local label display of the existing smart television. Compared with the prior art, the display device provided by the present application has the same beneficial effects as the display method provided by the above-mentioned embodiments, and other technical features in the display device are the same as the features disclosed in the previous embodiment method, which will not be repeated here.

[0065] It should be understood that various parts of the present application can be realized by hardware, software, firmware or a combination thereof. In the description of the above-mentioned embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0066] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto, and any person skilled in the art can easily think of changes or replacements within the technical scope disclosed in the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0067] The present application provides a computer readable storage medium having stored thereon computer readable program instructions (i.e. computer program) for executing the display method in the above-mentioned embodiments.

[0068] The computer readable storage medium provided in the application may be, for example, a U disk, but is not limited to an electric, magnetic, optical, electromagnetic, infrared, or semiconductor system, system, or device, or any combination of the above. More specific examples of the computer readable storage medium may include, but are not limited to, an electric connection with one or more conductive lines, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (EPROM) or a flash memory, an optical fiber, a portable compact disk read only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the embodiment, the computer readable storage medium may be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, system, or device. The program code contained on the computer readable storage medium can be transmitted by any suitable medium, including but not limited to an electric wire, an optical cable, an RF (Radio Frequency, RF), and the like, or any suitable combination of the above.

[0069] The above computer readable storage medium may be contained in a display device, or may exist separately without being assembled into the display device.

[0070] The above computer readable storage medium carries one or more programs, which, when executed by the display device, cause the display device to: generate main picture display data and sub-picture display data matching the panel resolution according to the received content to be displayed; perform display frame synthesis on the main picture display data to obtain first display data matching the system resolution, the system resolution being lower than the panel resolution; perform scaling on the first display data to obtain second display data matching the panel resolution, and perform mixing and splicing of the second display data and the sub-picture display data; display the mixed picture obtained by the physical panel.

[0071] Computer program code for carrying out operations of the present application can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0072] The flow diagrams and the block diagrams in the drawings are illustrations of architectures, functionalities, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present application. In this regard, each block in the flow diagrams or block diagrams can represent a module, a segment, or a portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that in some alternative implementations, the functions noted in the blocks can occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently or the blocks may

[0073] The modules involved in the embodiments of the present application can be implemented in the form of software or in the form of hardware. In some cases, the name of the module does not constitute a limitation on the module itself.

[0074] The readable storage medium provided by the present application is a computer readable storage medium, which stores computer readable program instructions (i.e. computer programs) for executing the display method described above, and can solve the technical problem that the local label display of the existing smart television is easy to blur. Compared with the prior art, the computer readable storage medium provided by the present application has the same beneficial effects as the display method provided by the above embodiments, and will not be described here.

[0075] The application further provides a computer program product comprising a computer program which, when executed by a processor, implements the steps of the display method as described above.

[0076] The computer program product provided by the application can solve the technical problem of easy blurring of the display of the local label of the existing smart television. Compared with the prior art, the computer program product provided by the application has the same beneficial effects as the display method provided by the above-described embodiments, and thus is not described herein.

[0077] The above is only some embodiments of the application, and does not limit the protection scope of the application. Any equivalent structure transformation made by using the content of the specification and drawings of the application, or direct / indirect application in other related technical fields under the technical concept of the application is included in the protection scope of the application.

Claims

1. A display method, characterized in that, The display method includes: Generate main screen display data and secondary screen display data that match the panel resolution based on the received content to be displayed; The main screen display data is processed to synthesize display frames to obtain first display data that matches the system resolution, wherein the system resolution is lower than the panel resolution; The first display data is scaled to obtain second display data that matches the panel resolution, and the second display data and the sub-screen display data are then mixed and spliced ​​together. The composite image obtained by splicing is displayed through the physical panel.

2. The display method as described in claim 1, characterized in that, The step of scaling the first display data to obtain second display data matching the panel resolution, and then mixing and splicing the second display data and the sub-screen display data, includes: The first display data is assigned to the first hardware layer, and the first display data is processed by the first hardware layer to obtain second display data that matches the panel resolution. The first processing includes at least scaling processing. The secondary display data is assigned to a pre-configured second hardware layer for second processing to obtain the processed secondary display data. The second processing does not include the scaling processing. The second display data and the processed secondary display data are mixed and spliced ​​together.

3. The display method as described in claim 2, characterized in that, Before the step of allocating the secondary display data to a pre-configured second hardware layer for second processing to obtain the processed secondary display data, the method further includes: Obtain the configuration file for the second hardware layer; Based on the configuration file, the scaling flag of the second hardware layer is configured to skip the scaling flag, thereby obtaining a pre-configured second hardware layer processing channel. The skip scaling flag is used to configure the second hardware layer to not perform scaling processing.

4. The display method as described in claim 2, characterized in that, The step of mixing and splicing the second display data and the processed secondary display data includes: Obtain the preset tag whitelist corresponding to the foreground activity and the secondary screen display data corresponding to the main screen display data; Determine whether the front-end activity belongs to the preset tag whitelist; If so, the second display data and the processed sub-screen display data are mixed and spliced ​​together using a hardware synthesizer.

5. The display method as described in claim 4, characterized in that, The step of determining whether the front-end activity belongs to the preset tag whitelist includes: Obtain the tag display activity from the preset tag whitelist; The comparison between the displayed activity based on the label and the front-end activity package name is used to obtain the display comparison result; Based on the displayed comparison results, determine whether the front-end activity belongs to the preset tag whitelist.

6. The display method as described in claim 4, characterized in that, After determining whether the foreground activity belongs to the preset tag whitelist, the method further includes: If it does not belong to the category, the second display data is mixed and spliced ​​through a hardware synthesizer.

7. A display device, characterized in that, The display device includes: The generation module is used to generate main screen display data and secondary screen display data that match the panel resolution based on the received content to be displayed. A compositing module is used to perform display frame compositing on the main screen display data to obtain first display data that matches the system resolution, wherein the system resolution is lower than the panel resolution; A mixing module is used to scale the first display data to obtain second display data that matches the panel resolution, and to mix and stitch the second display data and the sub-screen display data. The display module is used to display the composite image obtained by splicing through the physical panel.

8. A display device, characterized in that, The device includes: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the display method as described in any one of claims 1 to 6.

9. A storage medium, characterized in that, The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, it implements the steps of the display method as described in any one of claims 1 to 6.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the steps of the display method as described in any one of claims 1 to 6.

Images