Display method and device for TV gallery mode and storage medium

Abstract

The invention discloses a TV gallery mode display method and device and a storage medium. The TV gallery mode display method comprises the following steps: selecting a corresponding gallery mode from a plurality of gallery modes according to a user selection instruction; the selected gallery mode is matched with a corresponding interface interface; selecting an API (Application Program Interface) interface corresponding to the gallery mode by using an Interface interface; calling an image corresponding to the gallery mode by using an API (Application Program Interface), and selecting a decoding mode according to the residual condition of system resources; and decoding the image by using a built-in playing frame of the API interface according to the decoding mode, and displaying the decoded image.

Description

Technical Field

[0001] The present application relates to the field of electronic and electrical technology, and in particular to a display method, device and storage medium in a TV gallery mode. Background Art

[0002] With the rapid development of digital and intelligent technologies, the role of televisions is undergoing a fundamental change. Televisions are transforming from simple audio-visual devices to multifunctional smart centers. The TV Gallery mode is a clear reflection of this transformation of televisions. As a platform that uses advanced display technology and Internet resources to transform traditional TV screens into artworks, the TV Gallery mode can significantly enhance the interactivity and display effects of TVs and meet users' growing personalized needs.

[0003] Currently, TV gallery mode is mainly realized through the screen saver function, that is, automatically playing preset art albums in standby mode. These art albums are usually pre-stored in cloud galleries and contain a wealth of art works and picture links. Whenever the TV enters the screen saver state, the TV system will load the corresponding image based on the album ID and link call, thus presenting the display effect of an art gallery on the screen.

[0004] Although the existing TV gallery mode has certain display value, it has obvious limitations in display effect and resource utilization. On the one hand, the display method of the screen saver is relatively single, which is difficult to meet the user's pursuit of diversified visual experience. On the other hand, due to the lack of effective resource management and optimization strategies, the gallery mode may occupy too many system resources when running, affecting the overall performance of the TV, such as response speed and image processing capabilities. Therefore, the existing technology still has a lot of room for improvement in balancing resource utilization and improving display effects.

[0005] The above contents are only used to assist in understanding the technical solution of the present application and do not constitute an admission that the above contents are prior art. Summary of the invention

[0006] The main purpose of this application is to provide a TV gallery mode display method, device and readable storage medium, aiming to solve the technical problems of the existing technology that the display method is single, occupies too many system resources, and is difficult to balance resource utilization and improve display effects.

[0007] To achieve the above purpose, the present application proposes a TV gallery mode display method, including:

[0008] According to the user selection instruction, a corresponding gallery mode is selected from multiple gallery modes;

[0009] Match the selected gallery mode to the corresponding Interface;

[0010] Use the Interface interface to select the API interface corresponding to the gallery mode;

[0011] Use the API interface to call the image corresponding to the gallery mode and select the decoding method based on the remaining system resources;

[0012] According to the decoding method, use the built-in playback framework of the API interface to decode the image and display the decoded image.

[0013] To achieve the above objectives, the present application also provides a TV gallery mode display device, the device comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being configured to implement the steps of the TV gallery mode display method provided in any of the above technical solutions.

[0014] To achieve the above objectives, the present application also provides a storage medium, which is a computer-readable storage medium. A computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the TV gallery mode display method provided by any of the above technical solutions are implemented.

[0015] One or more technical solutions proposed in this application have at least the following technical effects:

[0016] This application requires multiple gallery modes in TV, each of which can bring different experience effects to users, and enhance the value and use effect of TV products. In addition, through the switching and effect coordination between different gallery modes, users can be given a variety of gallery mode experience effects. After presetting multiple gallery modes, select the corresponding gallery mode from multiple gallery modes according to the user selection instruction; then match the gallery mode to the corresponding Interface interface, and use the Interface interface to select the API interface corresponding to the gallery mode. The API interface here mainly includes the TV Soc API and the system native API interface. Different API interfaces can meet the requirements of high-definition playback and smoothness of playback, and realize flexible switching of images; then use the API interface to select different decoding methods to decode the image according to the remaining system resources, so that the system resources of the TV can be reasonably utilized and balanced. According to the decoding method, the built-in playback framework of the API interface is used to decode and display the corresponding image of the gallery mode, which can improve the display effect on the basis of reasonable use of system resources and meet people's audio-visual needs. In summary, the above method can solve the problem that the existing gallery mode has a single display effect, it is difficult to reasonably utilize and balance TV system resources, and thus it is difficult to meet people's audio-visual needs. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0018] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0019] Figure 1 A flowchart of a TV gallery mode display method provided in an embodiment of the present application;

[0020] Figure 2 A flowchart of a method for switching gallery modes according to system resources provided in an embodiment of the present application;

[0021] Figure 3 A flowchart of a method for matching a gallery mode to an Interface interface provided in an embodiment of the present application;

[0022] Figure 4 A flowchart of a method for selecting a first API interface provided in an embodiment of the present application;

[0023] Figure 5 A flowchart of a method for selecting a second API interface provided in an embodiment of the present application;

[0024] Figure 6 yes Figure 1 A schematic flow chart of a method for selecting a decoding mode provided in the illustrated embodiment;

[0025] Figure 7 yes Figure 1 A schematic flow chart of a method for decoding and displaying an image provided by the illustrated embodiment;

[0026] Figure 8 It is a flowchart of a method for setting multiple gallery modes provided in an embodiment of the present application;

[0027] Fig. 9 It is a structural schematic diagram of multiple playback modes in a gallery mode playback scene provided by an embodiment of the present application;

[0028] Fig.10 is a layered architecture diagram of a TV system provided in an embodiment of the present application;

[0029] Fig.11 It is a flowchart of a gallery mode playback method provided in an embodiment of the present application;

[0030] Fig.12 This is a schematic diagram of the structure of an Interface provided in an embodiment of the present application;

[0031] Fig.13 It is a flowchart of a method for mapping a gallery mode and an Interface interface using a flag tag provided in an embodiment of the present application;

[0032] Fig.14 This is a flowchart of a method for selecting an API interface provided in an embodiment of the present application;

[0033] Fig.15 It is a structural schematic diagram of a TV gallery mode display device provided in an embodiment of the present application.

[0034] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0035] It should be understood that the specific embodiments described herein are only used to explain the technical solutions of the present application and are not used to limit the present application.

[0036] In order to better understand the technical solution of the present application, a detailed description will be given below in conjunction with the accompanying drawings and specific implementation methods.

[0037] The existing technology has the following technical problems: Although the existing TV gallery mode has certain display value, it has obvious limitations in display effect and resource utilization. On the one hand, the display method of the screen saver is relatively single, which is difficult to meet the user's pursuit of diversified visual experience. On the other hand, due to the lack of effective resource management and optimization strategies, the gallery mode may occupy too many system resources during operation, affecting the overall performance of the TV, such as response speed and image processing capabilities. Therefore, the existing technology still has a lot of room for improvement in balancing resource utilization and improving display effects.

[0038] To solve the above technical problems, the present application provides a solution, by selecting a corresponding gallery mode from a plurality of preset gallery modes according to a user selection instruction; matching the selected gallery mode to the corresponding Interface interface; using the Interface interface to select an API interface corresponding to the gallery mode; using the API interface to select a decoding method according to the remaining system resources; according to the decoding method, using the built-in playback framework of the API interface to decode the image and display the decoded image.

[0039] In summary, the TV gallery mode display solution constructed in this application can reasonably utilize and balance system resources on the TV, allowing users to experience the operation experience of the process, increase the experience and playability of the mural TV, and at the same time support high-definition display effects of current pictures.

[0040] It should be noted that the execution subject of this embodiment can be a computing service device with data processing, network communication and program running functions, such as a tablet computer, a personal computer, a mobile phone, etc., or an electronic device that can realize the above functions, a computer-readable storage medium, etc.

[0041] In order to better understand the above technical solution, the exemplary embodiments of the present application will be described in more detail with reference to the accompanying drawings. Although the exemplary embodiments of the present application are shown in the accompanying drawings, it should be understood that the present application can be implemented in various forms and should not be limited by the embodiments shown here. On the contrary, these embodiments are provided to enable a more thorough understanding of the present application and to fully convey the scope of the present application to those skilled in the art.

[0042] To achieve the above technical objectives, see Figure 1 , Figure 1 A flowchart of a method for displaying a TV gallery mode is provided for an embodiment of the present application. To achieve the above-mentioned purpose, the method for displaying a TV gallery mode includes:

[0043] S110: According to the user selection instruction, a corresponding gallery mode is selected from a plurality of gallery modes. The user selection instruction is used to enter a gallery mode playback scene, and a corresponding gallery mode is selected from the gallery mode playback scene, wherein the gallery modes set in the embodiment of the present application include picture frames, electronic photo albums, photo walls, and slides. By setting a plurality of gallery modes, picture frames and customized elements can be added, thereby increasing the dynamic display effect during the image switching process.

[0044] S120: Match the selected gallery mode to the corresponding Interface. The Interface has a built-in flag tag corresponding to the gallery mode, and the gallery mode can be matched to the corresponding Interface through the flag tag. Interface is a series of interfaces, and its calling logic and definition method are as follows: Fig.12 As shown, it includes an interface definition layer IPhotoPlayer and an interface implementation layer PhotoPlayer, and multiple playback methods such as init() and Play() are listed in the interface implementation layer PhotoPlayer.

[0045] S130: Use the Interface interface to select the API interface corresponding to the gallery mode. Because the Interface interface has a built-in flag tag corresponding to the gallery mode, the flag tag can be used to select the API interface corresponding to the gallery mode, which can implement the parsing of the gallery mode and its corresponding images. Among them, the API interface in this application includes TV SOCAPI and system native API; TV SOC API can ensure the highest clarity of photos, but the parsing time is longer; and the system native API can ensure the parsing rate and interface smoothness, but it will reduce clarity. Both have their own advantages and disadvantages, and are suitable for different gallery modes.

[0046] S140: Use the API interface to select a decoding method based on the remaining system resources. The API interface can call the corresponding decoding method. In the embodiment of the present application, the decoding method is selected based on the remaining system resources. Hard decoding is mainly handled by the GPU of the mobile phone. The resource occupancy rate of the GPU is high, while the resource occupancy rate of the CPU is low. Although the image quality may be slightly inferior to soft decoding, the playback is smooth and the power consumption is low. However, it is limited by the video format and has certain requirements for the player settings. Soft decoding is the decoding work undertaken by the CPU, is not limited by the video format, and has relatively good picture quality. However, it has high requirements on CPU performance, and may cause freezes when playing high-definition videos. The embodiment of the present application selects the corresponding decoding method according to the remaining system resources, which can balance resource utilization and display effects, and solve the problem of occupying too many system resources.

[0047] S150: according to the decoding method, use the built-in playback framework of the API interface to decode and display the image corresponding to the gallery mode. The API interface usually has a built-in playback framework, which integrates an image decoder and an image player. In this way, the image decoder combined with the above decoding method can be used to decode the image corresponding to the gallery mode, and the image player can be used to play the image. By using the built-in playback framework of the API interface, the display effect of the image can be improved.

[0048] In summary, the embodiment of the present application first requires multiple gallery modes in TV, each of which can bring different experience effects to users, thereby improving the value and use effect of TV products. In addition, by switching and coordinating the effects between different gallery modes, users can have a variety of gallery mode experience effects. After presetting multiple gallery modes, the corresponding gallery mode is selected from the multiple gallery modes according to the user selection instruction; then the gallery mode is matched to the corresponding Interface interface, and the API interface corresponding to the gallery mode can be selected using the Interface interface. The API interface here mainly includes the TV Soc API and the system native API interface. Different API interfaces can meet the requirements of high-definition playback and smoothness of playback, and realize flexible switching of images; then the API interface is used to select different decoding methods to decode the image according to the remaining system resources, so that the system resources of the TV can be reasonably utilized and balanced. According to the decoding method, the playback framework built into the API interface is used to decode and display the corresponding image of the gallery mode, so that the display effect can be improved on the basis of reasonable utilization of system resources, and people's audio-visual needs can be met. In summary, the above method can solve the problem that the existing gallery mode has a single display effect, it is difficult to reasonably utilize and balance TV system resources, and thus it is difficult to meet people's audio-visual needs.

[0049] Specifically, as a preferred embodiment, Figure 2 As shown, the above method, after the step S110: selecting a corresponding gallery mode from a plurality of gallery modes according to a user selection instruction, the method further includes:

[0050] S210: Determine whether a user selection instruction is received within a predetermined time. The predetermined time here is calculated from the time when the user enters the gallery mode playback scene. First, the user sends an entry instruction for the gallery mode playback scene to the TV, and then the TV displays different gallery mode playback options in the playback scene, so that the corresponding gallery mode can be selected for playback according to the user selection instruction.

[0051] S220: If the user selection instruction is not received within the predetermined time, the system resources required for playing each of the multiple gallery modes are calculated respectively. For example, the embodiment of the present application includes four gallery modes: picture frame, slide, photo wall and electronic photo album. The above four modes occupy different system resources when playing images.

[0052] S230: for each gallery mode, determine whether the current remaining system resources meet the system resources required for gallery mode playback. In an exemplary scenario, if the TV does not receive a user selection instruction within a predetermined time, the TV can enter a sleep mode, at which time it can selectively switch one or more gallery modes according to the distribution of the current remaining system resources to integrate the TV screen with the mural, so that the TV has both viewing value and practical functions.

[0053] S240: If the current remaining system resources meet the system resources required for gallery mode playback, the current remaining system resources are allocated to the gallery mode, and the steps of matching the selected gallery mode to the corresponding Interface and subsequent steps are performed.

[0054] If the current remaining system resources do not meet the system resources required for gallery mode playback, continue to determine whether the current remaining system resources meet the system resources required for the next gallery mode playback; if the current remaining system resources do not meet the system resources required for all gallery mode playbacks, wait for a predetermined time to release the current system resources, and execute again for each gallery mode, the step of determining whether the current remaining system resources meet the system resources required for gallery mode playback.

[0055] In order to improve the display effect, Fig. 9 The four playback modes shown are: picture frame mode, electronic album mode, photo wall mode and slideshow mode. The embodiment of the present application can quickly switch between the four modes in a controllable manner. Select the photos to be played and select one of the playback modes for playback; wherein, the photos can be selected from the TV's built-in or external storage such as a USB flash drive, can also be pushed by the server, and can also be pushed to the TV by a mobile phone or mobile terminal. In addition, set to automatically switch to the next photo, or switch manually. If the next photo is switched automatically, the interval time for automatically switching to the next photo can be set in a variety of ways, including 5s, 10s, 30s and custom duration.

[0056] The technical solution provided by the embodiment of the present application, when no user selection instruction is received within the predetermined time, makes a judgment based on the current remaining system resources of the TV and the system resources required for each mode in the multiple gallery modes of the TV, thereby selecting a gallery mode that meets the system resources and matching it to the corresponding Interface interface for playback. In the above manner, the TV can combine the TV screen and the mural when the system is in sleep or task-free state, can reasonably utilize and balance the current remaining system resources, and select a gallery mode that meets the resource requirements for playback, so that users can experience a smooth picture playback mode and high-definition display effect, increasing the experience and playability of the mural TV.

[0057] In addition, in order to implement the functional operation of the Interface interface to the gallery mode, as a preferred embodiment, Figure 3 As shown above Figure 1 Step S120 of the TV gallery mode display method shown in the figure: a step of matching the selected gallery mode to the corresponding Interface interface, specifically comprising:

[0058] S121: In the interface definition layer of the Interface interface, define the playback methods of multiple gallery modes. Fig.12 As shown in the structure diagram of the Interface interface, the interface definition layer IphotoPlayer of the Interface interface contains multiple play methods, including Init(), Play(), Next(), Pre(), Pause(), Release() and setPlayLst(), etc. Through the above play methods, not only can the gallery mode be matched to the interface implementation layer of the Interface interface, but also the play function of the gallery mode can be executed.

[0059] S122: Use the playback method corresponding to the user selection instruction to match the gallery mode to the interface implementation layer of the corresponding Interface interface. The Interface interface includes an interface definition layer IphotoPlayer and an interface implementation layer PhotoPlayer. The gallery mode can be matched to the interface implementation layer through the above playback method, so that the playback method of the interface implementation layer can be used to play, pause, release, etc. the images in the gallery mode.

[0060] S123: calling the playback method in the interface implementation layer according to the user selection instruction and executing the corresponding functional operation.

[0061] The technical solution provided in the embodiments of the present application can, by...,...

[0062] Specifically, as a preferred embodiment, Figure 4 As shown, the above step S130: using the Interface interface to select the API interface corresponding to the gallery mode includes:

[0063] S131: A flag tag is built into the Interface interface, wherein the flag tag is used to mark the API interface corresponding to the gallery mode. Each flag tag corresponds to a gallery mode. Different Interfaces will be marked with different flag tags, and different flag tags can be used to access API interfaces, such as TV Soc API or system native API.

[0064] S132: Use the Interface interface to match the selected gallery mode to the corresponding flag tag. Fig.13 From the structure shown, it can be seen that the picture frame mode corresponds to flag1, the photo wall mode corresponds to flag2, the electronic photo album mode corresponds to flag3, and the slideshow mode corresponds to flag4.

[0065] S133: Use the Interface interface to connect the gallery mode to the corresponding API interface according to the flag tag.

[0066] In the technical solution provided by the embodiment of the present application, a flag tag is built into the Interface interface, and then the gallery mode is matched to the corresponding flag tag, so that the connection between the gallery mode and the API interface can be established according to the flag tag, so that the image in the gallery mode can be parsed through different API interfaces, thereby balancing the fluency and clarity of the image parsing in the gallery mode.

[0067] Specifically, as a preferred embodiment, Figure 5 As shown, in the above-mentioned TV gallery mode display method, step S130: using the Interface interface to select the API interface corresponding to the gallery mode includes:

[0068] S134: According to the flag tag corresponding to the gallery mode, determine the API interface that needs to be accessed; Fig.14 As shown, the API interface provided by the embodiment of the present application includes a TV Soc API interface and a native API interface. Among them, the SOC API can ensure the highest clarity of the photo, but the parsing time is longer; the system native API can ensure the parsing rate and interface fluency, but it will reduce the clarity.

[0069] S135: Get the TV chip type built into the Interface interface, and call the API interface corresponding to the gallery mode according to the API interface flow specified by the TV chip type. The API interface flow here refers to the path flow that the call request needs to go through as specified by the API interface protocol. Different gallery modes require different access methods, and call the underlying API interface through the corresponding flow. Fig.14From the Interface structure diagram, we can see that if the TV manufacturer is PhotoPlayerImpForRealTek, the corresponding TV chips include RealTek2851M, RealTek866N and RealTek2875P. If the TV chip is RealTek2851M, if the user selects the frame mode, it will go through the RealTek2851M process and finally call the underlying TV Soc API.

[0070] The technical solution provided in the embodiment of the present application is that different manufacturers will set up different types of TV chips. Therefore, the present application has a built-in TV chip type in the Interface interface. The TV chip type corresponds to the process direction of different API interfaces. Therefore, after determining the API interface to be accessed according to the flag tag corresponding to the frame mode, it is necessary to call the API interface according to the process direction of the API interface corresponding to the TV chip type, so as to parse the image in the gallery mode to balance the parsing rate and the clarity of the parsing.

[0071] In addition, as a preferred embodiment, Figure 6 As shown, the above step S140: using the API interface to select a decoding method according to the remaining system resources includes:

[0072] S141: Determine whether the API interface supports hard decoding. The API interface usually supports soft decoding, which is software decoding and uses the CPU to perform specific decoding work. The hard decoding is hardware decoding, which mainly uses the GPU to perform specific decoding work, and the CPU occupancy rate is low. Although the image quality may be slightly inferior to soft decoding, the playback is smooth and the power consumption is low. However, it is limited by the video format and has certain requirements for the player settings. The advantages are smooth playback and low power consumption, and the disadvantages are limited video formats and slightly poor image quality.

[0073] S142: If it is determined that the API interface does not support the hard decoding method, the soft decoding method is used to decode the image. Soft decoding: The CPU undertakes the decoding work, is not limited by the video format, and the image quality is relatively good. However, it has high requirements on CPU performance, and may cause freezes when playing high-definition videos. The advantages are a wide range of formats and good image quality, and the disadvantages are that it may occupy more resources and have higher hardware requirements.

[0074] S143: If it is determined that the API interface supports hard decoding, then determine whether the current remaining system resources meet the hard decoding resource amount of the image. The hard decoding method uses GPU decoding, which requires a large amount of system resources to be provided to the GPU. Therefore, it is necessary to determine whether the current remaining system resources can meet the resource amount required for hard decoding. If they cannot meet the requirements, select soft decoding, that is, decode through the CPU.

[0075] S144: If it is determined that the current remaining system resources meet the hard decoding resource amount, the hard decoding method is used. Or,

[0076] S145: If it is determined that the current remaining system resources do not meet the hard decoding resource amount, a soft decoding method is used.

[0077] The technical solution provided in the embodiment of the present application first uses a hard decoding method to improve the playback fluency of the image and reduce power consumption. However, the hard decoding method is limited by the video format. At this time, it is necessary to determine in advance whether the API interface supports the hard decoding method. If the API interface does not support the hard decoding method, the soft decoding method is used to decode the image. If the hard decoding method is supported, it is determined whether the current remaining system resources meet the amount of resources required for hard decoding, and then the corresponding decoding method is selected to decode the image according to the amount of resources required for hard decoding. In summary, the embodiment of the present application matches the best decoding method according to the amount of resources remaining in the current system, and selects hard decoding or soft decoding to parse the picture and render it to the interface, thereby improving the display effect while improving the utilization of system resources.

[0078] In addition, as a preferred embodiment, both the SOC API and the system native API need to be processed by a playback framework, such as a software playback framework OMX; the image can be decoded, rendered and played through the processing of the playback framework. Figure 7 As shown, in the above TV gallery display method, the original step S150: according to the decoding method, using the built-in playback framework of the API interface to decode the image, and displaying the decoded image, specifically includes:

[0079] S151: Integrate the playback framework in the TV Soc API or the system native API; wherein, the playback framework encapsulates an image decoder and an image player. The playback framework provided in the present application can select the OMX playback framework, and the OMX playback framework includes three levels of API standards: OMX AL layer, OMX IL layer and OMX DL layer; wherein, the AL layer is the application interface layer, which can provide a high-level multimedia operation interface for implementing the business logic of the application layer; the IL layer is the component integration layer, which can encapsulate component modules in its multimedia framework. The image decoder and image player of the present application are encapsulated components. The DL layer is the algorithm implementation layer, which defines the unified interface when the underlying algorithm implements the operation.

[0080] S152: Use the image decoder of the playback framework to decode the image according to the selected decoding method; the image decoder can decode the image according to the above decoding method after determining the decoding method. Specifically, in the software playback framework OMX, OMXCodec is the module responsible for decoding. This module complies with the open-max interface specification and can decode the image according to the decoding method selected by the API interface.

[0081] S153: Calling the playback method encapsulated by the Interface interface to render the decoded image; Fig.12 As shown in the structure diagram of the Interface interface, the Interface interface encapsulates multiple playback methods. After the user selects the corresponding playback method, the playback method can render the image in combination with its own function and pass the rendered image to the image player for playback.

[0082] S154: Use the image player encapsulated by the playback framework to display the image. The image player is a module encapsulated by the playback framework. The component module of the image player is encapsulated in the OMX IL layer of the OMX playback framework. After the image is input to the image player, the API interface calls the image player through the AL layer to display the above image.

[0083] Specifically, during the playback of the image, you can view the photo information at any time: shooting time, location, resolution and size, etc. This function can be implemented in the playback method encapsulated by the above Interface interface. In addition, background music can be played during the playback of the image. The background music can be selected from the TV's built-in or external storage such as a USB flash drive, or pushed through the server, or pushed to the TV by a mobile phone or mobile terminal.

[0084] The technical solution provided in the embodiment of the present application integrates a playback framework in the TV Soc API or the system native API, uses an image decoder encapsulated by the playback framework, decodes the image according to the above-selected decoding method, and finally uses an image player encapsulated by the playback framework to display the image, thereby realizing the switching and display of images in multiple gallery modes.

[0085] In addition, as a preferred embodiment, Figure 8 As shown, in the TV gallery mode display method, before step S110: selecting a corresponding gallery mode from a plurality of gallery modes according to a user selection instruction, the method further includes:

[0086] S310: Preset a picture frame mode, a slideshow mode, a photo wall mode and an electronic photo album mode in the TV; wherein,

[0087] S320: For the picture frame mode, multiple art frames are built into the display interface corresponding to the picture frame mode, and the API interface of the picture frame mode is set to TV Soc API;

[0088] S330: for the slide mode, setting the slide transition effect of the slide mode, and setting the API interface of the slide mode to the system native API;

[0089] S340: For the photo wall mode, set the photo layout and display effect in the display interface corresponding to the photo wall mode, and set the API interface of the photo wall mode to the system native API;

[0090] S350: For the electronic photo album mode, setting a display effect on a display interface corresponding to the electronic photo album mode, and setting the API interface of the electronic photo album mode to TV Soc API.

[0091] See Fig. 9 There are four play modes (picture frame, electronic photo album, photo wall and slide show) shown in the figure;

[0092] Picture frame mode: built-in multiple art frames, which can be displayed around the picture at any time to achieve the effect of artistic element decoration; this mode needs to ensure the high definition of picture playback and flexible switching of picture frames, so this mode has multiple art frames built-in in the real interface, and its API interface is set to TV Soc API. Specifically, the picture frame style can be built-in to the TV, customized and pushed by the server, or pushed to the TV after the mobile phone or mobile terminal selects the style.

[0093] Slideshow mode: a mode in which pictures are played in the form of slideshows. There will be a slideshow effect when switching between pictures. This mode needs to ensure smooth picture slideshow switching while ensuring the picture playback mode to the greatest extent. Therefore, the API interface of this slideshow mode is set to the system native API. The switching effect of the slideshow mode can be built-in by the TV, customized and pushed by the server, and can also be pushed to the TV after selecting the style on the mobile phone or mobile terminal.

[0094] Photo wall mode: displayed through a group of photo wall styles; it should be noted that: 1. This mode needs to ensure the display rate of this group of photos, and the high definition can be appropriately reduced, so the API interface of the photo wall mode is set to the system native API; 2. All photos in this photo wall mode need to be displayed synchronously on the TV interface; 3. Photos can be selected from TV built-in or external storage, or pushed by the server, or pushed to the TV after selection by the mobile phone or mobile terminal; 4. The layout style can be built-in to the TV, customized and pushed by the server, or pushed to the TV after the mobile phone or mobile terminal selects the style; 5. Click on one of the photos to enter a single photo wall. A single photo wall needs to ensure the high definition of the picture playback, so a single photo wall can be modulated to the TV Soc API interface.

[0095] The electronic photo album mode achieves a dynamic effect of an electronic photo album between the pictures played in a loop; this mode needs to ensure the realism and smoothness of the switching effects, so its API interface uses TV Soc API.

[0096] This application sets a corresponding display button on the TV, which corresponds to Fig.12 The playback method in the Interface interface shown above can realize controllable playback of the mode and fast switching between the four modes.

[0097] In addition, it should be noted that: if you select the photos you want to play and choose one of the playback modes to play; the photos can be selected from the TV's built-in or external storage such as a USB flash drive, can be pushed by the server, and can also be pushed to the TV through a mobile phone or mobile terminal.

[0098] In addition, the implementation architecture of the above-mentioned display method of this application can be found in Fig.10 . Fig.10 The layered architecture of the TV system includes:

[0099] Display layer: Application layer.

[0100] Interface layer: Interface layer.

[0101] API layer: TV SOC API, which is the chip manufacturer's software interface; using SOC API can ensure the highest definition of photos, but the parsing time is longer. Native API, which is the system's native software interface; using the system's native API can ensure the parsing speed and interface fluency, but it will reduce the definition.

[0102] OMX: native playback framework;

[0103] Decoding methods: hard decoding and soft decoding; among them, hard decoding is hardware decoding, which requires calling GPU decoding; soft decoding is software decoding, which uses CPU for decoding.

[0104] Also, see Fig.11 , as a playback method in TV gallery mode, includes the following steps:

[0105] First, enter TV gallery mode.

[0106] Select the playback mode (Frame, Slideshow, Photo Wall or Photo Album).

[0107] The system will automatically match the corresponding Interface according to the selected playback mode.

[0108] Different interfaces will be marked with different flag tags; the flag tag corresponds to the playback mode and API, so that the playback mode can be assigned to the corresponding API.

[0109] Interface uses different flag tags to choose to access TV Soc API or system native API;

[0110] The system native API will be processed by OMX (software playback framework);

[0111] Finally decode the picture: determine the current resources used and remaining resources of the system, and choose hard decoding or soft decoding.

[0112] In summary, the technical solution provided by the above embodiments of the present application includes four gallery modes (picture frame, slide, photo wall and electronic photo album) in the TV gallery scene: each gallery mode has a different experience effect, which comprehensively improves the TV product value and usage scenarios. The access mode of TV System and Application realizes the switching and effect coordination between modes, can reasonably utilize and balance system resources on TV, let users experience a smooth operation experience, increase the experience and playability of gallery TV, and at the same time have the highest definition effect supported by the current picture.

[0113] In addition, it should be noted that, first, with consumers' pursuit of home decoration and yearning for high-quality life, the market demand for mural (gallery) TVs continues to grow. Consumers have higher requirements for the appearance, picture quality, sound quality, etc. of TVs, and mural (gallery) TVs just meet these needs, so they have broad market prospects. Second, some well-known brands have a high degree of popularity and reputation in the field of mural (gallery) TVs, and their products are often favored by consumers, thus bringing more economic benefits. Third, mural (gallery) TVs not only have basic audio-visual functions, but also have decorative and artistic qualities, which can bring more added value to consumers. For example, some mural (gallery) TVs can be integrated with the home environment to enhance the beauty and comfort of the overall home, thereby bringing consumers a better living experience.

[0114] It should be noted that the above examples are only used to understand the present application and do not constitute a limitation on the display method of the TV gallery mode of the present application. More simple transformations based on this technical concept are all within the scope of protection of the present application.

[0115] In addition, the TV gallery mode display device provided in the present application includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the TV gallery mode display method of any of the above-mentioned embodiments.

[0116] Reference below Fig.15 , which shows a schematic diagram of the structure of a display device suitable for implementing the TV gallery mode of the embodiment of the present application. The display device of the TV gallery mode in the embodiment of the present application can include but is not limited to mobile terminals such as mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Portable Application Descriptions), PMPs (Portable Media Players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. Fig.15 The display device of the TV gallery mode shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0117] like Fig.15As shown, the display device in TV gallery mode can include a processing device 1001 (such as a central processing unit, a graphics processor, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM: Read Only Memory) 1002 or a program loaded from a storage device 1003 to a random access memory (RAM: Random Access Memory) 1004. In RAM1004, various programs and data required for the operation of the display device in TV gallery mode are also stored. The processing device 1001, ROM1002 and RAM1004 are connected to each other via a bus 1005. An input / output (I / O) interface 1006 is also connected to the bus. Typically, the following systems can be connected to the I / O interface 1006: input devices 1007 including, for example, a touch screen, a touchpad, a keyboard, a mouse, an image sensor, a microphone, an accelerometer, a gyroscope, etc.; output devices 1008 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 1003 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 1009. The communication device 1009 can enable the device to communicate with other devices wirelessly or by wire to exchange data. Although the figure shows a model building device with various systems, it should be understood that it is not required to implement or have all the systems shown. More or fewer systems can be implemented or have instead.

[0118] In particular, according to the embodiments disclosed in the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device 1003, or installed from a ROM 1002. When the computer program is executed by the processing device 1001, the above-mentioned functions defined in the method of the embodiment disclosed in the present application are executed.

[0119] The TV gallery mode display device provided in the present application adopts the TV gallery mode display method in the above-mentioned embodiment. Compared with the prior art, the beneficial effects of the device provided by the present application are the same as the beneficial effects of the method provided in the above-mentioned embodiment, and other technical features in the device are the same as the features disclosed in the method of the previous embodiment, which will not be repeated here.

[0120] It should be understood that the various parts disclosed in this application can be implemented by hardware, software, firmware or a combination thereof. In the description of the above embodiments, specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner.

[0121] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

[0122] The present application provides a computer-readable storage medium having computer-readable program instructions (ie, computer programs) stored thereon, the computer-readable program instructions being used to execute the display method of the TV gallery mode in the above-mentioned embodiment.

[0123] The computer-readable storage medium provided in the present application can be, for example, a USB flash drive, but is not limited to electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, systems or devices, or any combination of the above. More specific examples of computer-readable storage media can include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM: Random Access Memory), a read-only memory (ROM: Read Only Memory), an erasable programmable read-only memory (EPROM: Erasable Programmable Read Only Memory or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM: CD-Read Only Memory), an optical storage device, a magnetic storage device, or any suitable combination of the above. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, system or device. The program code contained on the computer-readable storage medium can be transmitted using any appropriate medium, including but not limited to: wires, optical cables, RF (Radio Frequency: Radio Frequency), etc., or any suitable combination of the above.

[0124] The computer-readable storage medium carries one or more programs. When the one or more programs are executed by the model building device, the TV gallery mode display device: selects a corresponding gallery mode from multiple gallery modes according to a user selection instruction; matches the selected gallery mode to the corresponding Interface interface; uses the Interface interface to select the API interface corresponding to the gallery mode; uses the API interface to call the image corresponding to the gallery mode, and selects a decoding method according to the remaining system resources; according to the decoding method, uses the built-in playback framework of the API interface to decode the image, and displays the decoded image.

[0125] Computer program code for performing the operations of the present application can be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code can be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0126] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present application. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes also be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented by a dedicated hardware-based system that performs a specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0127] The modules involved in the embodiments of the present application can be implemented by software or hardware, wherein the name of the module does not limit the unit itself in some cases.

[0128] The readable storage medium provided in the present application is a computer-readable storage medium, and the computer-readable storage medium stores computer-readable program instructions (i.e., computer programs) for executing the above-mentioned TV gallery mode display method. Compared with the prior art, the beneficial effects of the computer-readable storage medium provided in the present application are the same as the beneficial effects of the TV gallery mode display method provided in the above-mentioned embodiment, and will not be repeated here.

[0129] The present application also provides a computer program product, including a computer program, which implements the steps of the TV gallery mode display method as described above when executed by a processor.

[0130] The computer program product provided by the present application can solve the technical problem that the existing methods are difficult to balance the utilization of system resources and improve the display effect. Compared with the prior art, the beneficial effects of the computer program product provided by the present application are the same as the beneficial effects of the display method of the TV gallery mode provided by the above embodiment, which will not be repeated here.

[0131] The above descriptions are only some embodiments of the present application, and are not intended to limit the patent scope of the present application. All equivalent structural changes made using the contents of the present application specification and drawings under the technical concept of the present application, or direct / indirect applications in other related technical fields are included in the patent protection scope of the present application.

Claims

1. A TV gallery mode display method, characterized in that: include: According to the user selection instruction, a corresponding gallery mode is selected from multiple gallery modes; Match the selected gallery mode to the corresponding Interface; Use the Interface interface to select the API interface corresponding to the gallery mode; Use the API interface to select a decoding method based on the remaining system resources; According to the decoding method, the playback framework built into the API interface is used to decode and display the image corresponding to the gallery mode.

2. The method according to claim 1, characterized in that After the step of selecting a corresponding gallery mode from a plurality of gallery modes according to the user selection instruction, the method further comprises: Determining whether the user selection instruction is received within a predetermined time; If the user selection instruction is not received within the predetermined time, respectively calculating the system resources required for playing each of the multiple gallery modes; For each gallery mode, determining whether the current remaining system resources meet the system resources required for playing the gallery mode; If the current remaining system resources meet the system resources required for the gallery mode playback, the current remaining system resources are allocated to the gallery mode, and the steps of matching the selected gallery mode to the corresponding Interface and subsequent steps are performed.

3. The method according to claim 1, characterized in that The step of matching the selected gallery mode to the corresponding Interface interface includes: In the interface definition layer of the Interface interface, the playing methods of the multiple gallery modes are defined; Using the playback method corresponding to the user selection instruction, matching the gallery mode to the interface implementation layer of the corresponding Interface interface; The playing method in the interface implementation layer is called according to the user selection instruction to perform the corresponding functional operation.

4. The method according to claim 1, characterized in that The step of using the Interface interface to select the API interface corresponding to the gallery mode includes: A flag tag is built into the Interface interface, wherein the flag tag is used to mark the API interface corresponding to the gallery mode; Use the Interface interface to match the selected gallery mode to the corresponding flag tag; Use the Interface interface to connect the gallery mode to the corresponding API interface according to the flag tag.

5. The method according to claim 4, characterized in that The step of using the Interface interface to select the API interface corresponding to the gallery mode includes: According to the flag tag corresponding to the gallery mode, determine the API interface that needs to be accessed; The TV chip type built into the Interface interface is obtained, and the API interface corresponding to the gallery mode is called according to the process trend of the API interface specified by the TV chip type.

6. The method according to claim 1, characterized in that The step of using the API interface to select a decoding method according to the remaining system resources includes: Determine whether the API interface supports hard decoding; If it is determined that the API interface does not support hard decoding, then soft decoding is selected; If it is determined that the API interface supports hard decoding, then determining whether the current remaining system resources meet the hard decoding resource amount required by the gallery module; If it is determined that the current remaining system resources meet the hard decoding resource amount, the hard decoding mode is selected; or, If it is determined that the current remaining system resources do not meet the hard decoding resource amount, the soft decoding mode is selected.

7. The method according to claim 6, characterized in that The step of decoding and displaying the image corresponding to the gallery module using the built-in playback framework of the API interface according to the decoding method includes: Integrate the playback framework in the TV Soc API or the system native API; wherein the playback framework encapsulates an image decoder and an image player; Using the image decoder encapsulated by the playback framework, decoding the image according to the selected decoding method; Calling the playback method encapsulated by the Interface to render the decoded image; The image player encapsulated by the playback framework is used to display the image.

8. The method according to claim 1, characterized in that Before the step of selecting a corresponding gallery mode from a plurality of gallery modes according to a user selection instruction, the method further includes: The TV is pre-set with picture frame mode, slide show mode, photo wall mode and electronic photo album mode; For the picture frame mode, a variety of art frames are built into the display interface corresponding to the picture frame mode, and the API interface of the picture frame mode is set to TV Soc API; For the slide mode, setting the slide transition effect of the slide mode, and setting the API interface of the slide mode to the system native API; For the photo wall mode, the photo layout and display effect are set on the display interface corresponding to the photo wall mode, and the API interface of the photo wall mode is set to the system native API; For the electronic photo album mode, a display effect is set on a display interface corresponding to the electronic photo album mode, and an API interface of the electronic photo album mode is set to TV Soc API.

9. A display device in TV gallery mode, characterized in that: The device comprises: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the computer program is configured to implement the steps of the TV gallery mode display method according to any one of claims 1 to 8.

10. A storage medium, characterized in that: The storage medium is a computer-readable storage medium, and a computer program is stored on the storage medium. When the computer program is executed by a processor, the steps of the TV gallery mode display method according to any one of claims 1 to 8 are implemented.

Images