Display device and search method for media resources

Abstract

The application discloses a display device and a media resource search method. The display device runs at least two media applications. The display device can respond to a media search instruction, control each media application to perform a search operation, and obtain a search result image generated by each media application. First media information in the image is extracted based on image recognition technology and summarized as a media resource list, and the display device displays the media resource list. In response to a media selection instruction for the media resource list, the corresponding media application is controlled to jump to a play page of a target media resource and display a play interface. The application does not need to rely on the opening of a search interface of the media application, avoids copyright risks, can realize global cross-application media resource search, improves media resource search and play efficiency, and further improves user experience.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a method for searching display devices and media resources. Background Technology

[0002] Display devices are intelligent devices capable of presenting a user interface and supporting user interaction. Taking smart TVs as an example, smart TVs are television products based on Internet application technology, equipped with open operating systems and chips, possessing open application platforms, enabling two-way human-computer interaction, and integrating multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] The display device can play different types of media resources, including built-in live channels, time-shift playback functions, various pre-installed and third-party on-demand applications, LAN-shared media, and local storage media. To meet users' needs for finding media resources across applications, related technologies collaborate with film and television application manufacturers to call their open search interfaces, or use web crawler technology to capture film and television metadata and playback links from various platforms, thereby achieving aggregated search and unified display of cross-application content.

[0004] However, the aforementioned methods cannot achieve a legal, comprehensive, and timely unified search of cross-application media resources without relying on API authorization from film and television application manufacturers. This leads to a decrease in the search efficiency of media resources on display devices, affecting the user experience. For example, the implementation method relying on application open interfaces is limited by the manufacturer's interface openness policy, and cannot cover unauthorized applications, making it difficult to achieve a comprehensive search of all applications installed by the user. The implementation method using web crawler technology carries the risk of copyright infringement, and the updated resource information obtained lags behind the source platform, failing to guarantee the legality and timeliness of the content. Summary of the Invention

[0005] This application provides a method for searching display devices and media resources to solve the problem of low efficiency in searching media resources in display devices.

[0006] In a first aspect, this application provides a display device, comprising: The monitor is configured to display the user interface; The user input interface is configured to receive user input instructions; the instructions include media asset search instructions and media asset selection instructions, the media asset search instructions are used to query media resources, and the media asset selection instructions are used to play the corresponding target media resources; A controller, electrically connected to the display and the user input interface, running at least two media applications, and configured to: In response to the media asset search command, control the media application to perform a search operation for the media resource; Obtain the search result image generated by each of the media applications after performing the search operation; Based on image recognition technology, the first media asset information corresponding to the media resource is extracted from the search result image, and the first media asset information is summarized into a media resource list. Control the display to show the media resource list; In response to the media resource selection instruction for the media resource list, the corresponding media application is controlled to jump to the playback page of the target media resource, and the display is controlled to show the playback interface corresponding to the playback page.

[0007] The above technical solution has the following beneficial effects or advantages: Breaking the dependence of media resource search on open search interfaces of media applications, it extracts media asset information through non-intrusive image recognition technology, covering all installed media applications and achieving full-domain search. Furthermore, users only need to enter a search command once to obtain search results from all platforms and jump to the target content playback page with one click, which can improve the efficiency of media resource search and playback, thereby improving the user experience.

[0008] In some embodiments of this application, the controller performs a search operation on the media resource by controlling the media application, specifically configured as follows: Obtain the list of target media applications corresponding to the aforementioned media application; Launch each media application in the target media application list; After the media application is launched, it navigates to the search interface of the corresponding media application based on the pre-configured application navigation script; Enter the search keywords corresponding to the media asset search command in the search interface to trigger the media application to perform the search operation.

[0009] The above technical solution has the following beneficial effects or advantages: Enables automated search across multiple applications, eliminating the need for users to manually open each application, enter keywords, and execute a search; drives each application's search operation through pre-configured application navigation scripts, ensuring consistency and reliability in the search process; supports sequential or parallel search operations across multiple media applications, reducing the overall time required for cross-platform searches.

[0010] In some embodiments of this application, the controller executes a pre-configured application navigation script to navigate to the search interface of the corresponding media application, specifically configured as follows: Invoke the accessibility service to listen for UI elements of the media application; Based on the interface element identifiers or relative position information recorded in the application navigation script, control operations are generated, which are either button operations or touch operations. In response to the control operation, navigate to the search interface of the media application.

[0011] The above technical solution has the following beneficial effects or advantages: It uses operating system-level accessibility services to simulate user operations without requiring any modification or intrusion into the target media application. It is highly compatible and can be adapted to all installed media applications. Navigation is performed through interface element identifiers or relative position information, maintaining a high success rate even if the application interface changes.

[0012] In some embodiments of this application, the controller is specifically configured to acquire the search result image generated after each media application performs the search operation, as follows: When a loading completion notification is detected for the search results interface, the image information corresponding to the search results interface is captured. The image information is preprocessed, and the preprocessing includes at least one of image compression, irrelevant region cropping, and image sharpness enhancement; The preprocessed image information is stored as the search result image.

[0013] The above technical solution has the following beneficial effects or advantages: The screenshot operation is triggered by detecting the completion notification of the search results interface, ensuring that accurate search results images are captured and avoiding capturing blank pages or pages that are loading. The original image is compressed, cropped, and preprocessed to enhance clarity, which reduces the amount of data to be transmitted and recognized in the subsequent process, and improves the processing speed and the accuracy of image recognition.

[0014] In some embodiments of this application, the controller performs image recognition technology-based extraction of first media asset information corresponding to the media resource from the search result image, specifically configured as follows: The search result image and pre-configured recognition prompts are sent to an image recognition service, whereby the recognition prompts instruct the image recognition service to extract a specified type of media asset information. Receive the structured recognition result returned by the image recognition service based on the recognition prompt words; The first media asset information is parsed from the structured recognition results.

[0015] The above technical solution has the following beneficial effects or advantages: The image recognition service is guided by pre-configured recognition prompts to extract the required type of media asset information, avoiding the extraction of irrelevant content, thereby improving the targeting and accuracy of information extraction; the recognition results are returned in a structured data format, which facilitates subsequent processing.

[0016] In some embodiments of this application, a communication device is also included, the communication device being configured to establish a communication connection with a cloud server; the controller is further configured to: The search result image is sent to the cloud server via the communication device, so that the cloud server generates the corresponding media asset information recognition result based on the large language model service. The communication device receives the media asset information identification results returned by the cloud server. Based on the media asset information identification results, update the pre-configured application navigation script and identification prompts.

[0017] The above technical solution has the following beneficial effects or advantages: Leveraging the image understanding and information extraction capabilities of cloud-based large language model services can improve the accuracy of media asset information recognition in complex interfaces. By dynamically updating application navigation scripts and recognition prompts in the cloud, it can adapt to version updates and interface changes of media applications, ensuring the long-term stable operation of media resource search without requiring users to manually update local configurations.

[0018] In some embodiments of this application, the controller summarizes the first media asset information into a media resource list, specifically configured as follows: The first media asset information is deduplicated; The first media asset information after deduplication is sorted according to the preset sorting rules to obtain a list of media resources containing the first media asset information.

[0019] The above technical solution has the following beneficial effects or advantages: The system deduplicates media asset information extracted from different platforms to prevent the same media resource from being displayed repeatedly on multiple platforms. By sorting search results according to preset sorting rules, it can prioritize displaying the content that users are most likely to be interested in, further improving the efficiency of users finding target media resources.

[0020] In some embodiments of this application, the controller controls the media application corresponding to the target media resource to jump to the playback page of the target media resource, specifically configured as follows: Obtain the media application identifier and content identifier information corresponding to the target media resource; For target media resources that support deep linking, the corresponding media application is launched through the application launch interface carrying the content identification information, and then the user is redirected to the playback page of the target media resource. For target media resources that do not support deep link navigation, the system navigates to the playback page of the target media resource in the corresponding media application based on a pre-configured application navigation script.

[0021] The above technical solution has the following beneficial effects or advantages: By adopting a two-tiered redirection strategy that prioritizes deep links and simulates navigation, mainstream applications with publicly available deep links can achieve fast page navigation, while niche applications without publicly available deep links can achieve one-click playback, thereby expanding the application scope of media resource search.

[0022] In some embodiments of this application, when the controller performs the operation of controlling the media application to perform a search, it is further configured to: Obtain second media asset information that matches the media asset search command from the system's built-in resources and external shared resources; the system's built-in resources include live channels and time-shifted playback content, and the external shared resources include local area network shared media and local storage media; The second media asset information and the first media asset information are merged and summarized into the media resource list.

[0023] The above technical solution has the following beneficial effects or advantages: Expanding the search scope from third-party media applications to built-in system resources and external shared resources enables unified searching of media resources across all channels; users can view media resources from all sources in one interface without switching between different functional modules, thus achieving a one-stop media search experience.

[0024] Secondly, this application also provides a method for searching media resources, applied to a display device, the display device running at least two media applications and supporting the receipt of user input instructions; the instructions include media resource search instructions and media resource selection instructions, the media resource search instructions being used to query media resources, and the media resource selection instructions being used to play corresponding target media resources; the method includes: In response to the media asset search command, control the media application to perform a search operation for the media resource; Obtain the search result image generated by each of the media applications after performing the search operation; Based on image recognition technology, the first media asset information corresponding to the media resource is extracted from the search result image, and the first media asset information is summarized into a media resource list. Control the display to show the list of media resources; In response to the media resource selection instruction for the media resource list, the corresponding media application is controlled to jump to the playback page of the target media resource, and the display is controlled to show the playback interface corresponding to the playback page.

[0025] The above technical solution has the following beneficial effects or advantages: The method does not rely on open interfaces of media applications, can cover all installed media applications to achieve full-domain search, and does not involve copyright infringement risks associated with web crawling technology. The media asset information extracted by the method is always consistent with the search results of the source application, which can ensure the legality and timeliness of the search results, thereby improving the search efficiency of media resources on display devices and enhancing the user experience. Attached Figure Description

[0026] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is a schematic diagram illustrating the operation scenarios of a display device provided in some embodiments of this application; Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application; Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application; Figure 4 A flowchart illustrating a media resource search method provided in some embodiments of this application; Figure 5 A flowchart illustrating the search operation provided in some embodiments of this application; Figure 6 Screenshots and preprocessing flowcharts provided for some embodiments of this application; Figure 7 This is a schematic diagram of the process for extracting media asset information through image recognition provided in some embodiments of this application; Figure 8 This is a schematic diagram illustrating the effect of the media resource list provided in some embodiments of this application; Figure 9 A schematic diagram illustrating the one-click playback process provided in some embodiments of this application; Figure 10 A schematic diagram illustrating the aggregation of omnichannel media resources provided for some embodiments of this application; Figure 11 An interactive schematic diagram illustrating the media resource search method provided in some embodiments of this application; Figure 12 These are renderings of a unified search interface provided in some embodiments of this application. Detailed Implementation

[0028] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0029] In this embodiment, display device 200 generally refers to a device with screen display and data processing capabilities. For example, display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0030] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, users can operate the display device 200 via touch operation, mobile terminal 300, and control device 100. For example, control device 100 can be a remote control, stylus, gamepad, etc.

[0031] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0032] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0033] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0034] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0035] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface 280.

[0036] In some embodiments, detector 230 is used to collect signals from the external environment or signals interacting with the outside world. For example, detector 230 may include millimeter-wave radar, which can be used to detect whether a user is present within a preset range. Detector 230 may also include a voice acquisition unit to collect voice commands input by the user.

[0037] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0038] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0039] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0040] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0041] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0042] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0043] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0044] In some embodiments, the user input interface 280 can be used to receive instructions input by a user. The user input interface 280 may include at least one of a microphone, touchpad, sensor, remote control, etc. The display device 200 can then receive user-input instructions based on the user input interface 280 to perform interactive functions with the user.

[0045] In some embodiments, to enable user interaction, the display device 200 may run an operating system. An operating system is a computer program that manages and controls the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running applications. The operating system also allows users to interact with the display device 200.

[0046] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0047] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0048] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0049] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0050] like Figure 3 As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0051] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0052] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0053] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The kernel layer can contain at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0054] In some embodiments, the display device 200 may install and run multiple media applications, each providing media resources from different sources or of different types. For example, video-on-demand applications provide online playback services for movies, TV series, and variety shows; live streaming applications provide live viewing services for TV channels; and music applications provide playback services for songs and audio content. When searching for a target media resource, users need to switch between different media applications and perform search operations separately.

[0055] For example, if a user wants to find a platform where a certain movie can be played, they need to first open one video app and search for the movie. If no results are found, they need to exit and open a second video app to search again, and so on. This method of searching through each app is cumbersome, time-consuming, and requires users to repeatedly switch between the search interfaces of multiple apps to enter search keywords, which affects the user experience.

[0056] In related technologies, the display device 200 is equipped with an aggregated search function, which displays search results from multiple platforms on a single search interface. However, aggregated search relies on the application programming interfaces (APIs) or web crawling technology of various media applications to obtain media asset metadata. However, relying on the APIs of various media applications cannot cover media applications that have not authorized open APIs, thus limiting the coverage of aggregated search. On the other hand, using web crawling technology to retrieve metadata from the servers of various media applications has problems such as poor data timeliness, inconsistencies between the retrieved results and the actual display of the source application, and the risk of infringing on data copyright.

[0057] Furthermore, when a user selects a target media resource from the search results to play, the technology can only redirect to the homepage or search page of the corresponding media application. The user still needs to manually search for and play the target media resource in the target application, which cannot achieve the function of one-click redirection to the playback page. The operation process is too long and the user experience is poor.

[0058] To address the aforementioned issues, this application provides a method for searching display devices and media resources. The display device 200 serves as the central hub for aggregating and searching media resources across the entire platform. Without relying on open search interfaces of media applications, the method controls each media application to automatically perform search operations. Media asset information is extracted from the search results pages returned by each application using image recognition technology. After aggregation and deduplication, the information is presented in a unified list format, and users can jump to the playback page of the corresponding application with one click.

[0059] In this embodiment, media applications include, but are not limited to, third-party video-on-demand applications, live streaming applications, and local media playback applications. Media asset information is descriptive information associated with media resources, which may include, for example, media resource name, source platform name, membership requirements, resolution information, release year, rating, etc.

[0060] In some embodiments, the display device 200 includes at least a display 260, a user input interface 280, and a controller 250. The display 260 is used to display a user interface; the user input interface 280 is configured to receive user input instructions, including media asset search instructions and media asset selection instructions. The media asset search instructions are used to query media resources, and the media asset selection instructions are used to play the corresponding target media resource; the controller 250 is electrically connected to the display 260 and the user input interface 280, and the controller 250 runs at least two media applications.

[0061] In some embodiments, users can input media asset search commands in voice form via the voice button on the remote control or the voice search entry displayed on the display device 200. The controller 250 performs voice recognition on the voice input and converts the voice into search keywords in text form. Users can also input media asset search commands in text form via the text input function of the remote control or the control application on the mobile terminal 300. Media asset search commands can include search keywords such as the full name, partial name, actor name, director name, and genre of the media resource. For example, a user can enter "Media Asset A" as a search keyword to query cross-platform playability information for this film.

[0062] Figure 4 This is a flowchart illustrating a media resource search method provided in some embodiments of this application. Figure 4 As shown, controller 250 is configured to perform the following steps: S401, In response to a media asset search command, controls the media application to perform a search operation on the media asset.

[0063] After receiving a media asset search command from the user via the user input interface 280, the controller 250 parses the search keywords and controls at least two media applications running on the display device 200 to perform search operations targeting the search keywords. The search operation includes launching each media application sequentially or in parallel, navigating to the search interface within each media application, entering the search keywords, and triggering the search function.

[0064] In some embodiments, after receiving a media asset search command, the controller 250 may first display a "Searching" prompt on the display 260 to inform the user that various media applications are performing search operations in parallel. The controller 250 may also update the number of completed search applications in the prompt interface in real time, for example, displaying "3 / 5 application searches completed," so that the user has a clear understanding of the search progress.

[0065] S402. Obtain the search result image generated after each media application performs a search operation.

[0066] After the search results interfaces of various media applications have been loaded, the controller 250 captures the corresponding image information using the screen capture capability provided by the operating system, and preprocesses the captured image to obtain the search results image. Preprocessing includes at least one of image compression, irrelevant region cropping, and image sharpness enhancement. The purpose of preprocessing is to reduce the amount of data transmission and computational overhead in subsequent image recognition stages, while improving recognition accuracy.

[0067] In some embodiments, for media applications where the search results content exceeds one screen, the controller 250 can simulate a downward swipe operation after capturing the first screen image and continue to capture images of subsequent screens, stitching the multi-screen screenshots together or merging them after separate recognition, to ensure that complete search results are obtained.

[0068] S403. Based on image recognition technology, extract the first media asset information corresponding to the media resource from the search result image.

[0069] The controller 250 sends the preprocessed search result image to the image recognition service. The image recognition service analyzes the image content based on pre-configured recognition prompts, extracting media resource-related information (such as media resource name, source platform name, membership requirements, and resolution information) and returning the recognition results in a structured data format. The controller 250 then parses the first media asset information from the structured recognition results. This method of extracting media asset information using image recognition technology does not rely on the media application's open search interface or require access to the media application's backend database; therefore, it eliminates the risks of restricted interface opening policies and copyright infringement.

[0070] S404. Summarize the first media asset information into a media resource list and control the display to show the media resource list.

[0071] The controller 250 aggregates and processes the first media asset information extracted from various media applications, including deduplicating the first media asset information and sorting the deduplicated media asset information according to a preset sorting rule to generate a media resource list. The controller 250 controls the display 260 to display the media resource list in the form of a user interface. Each item clearly displays information such as the media resource name, platform, membership requirements, and resolution, making it easy for users to compare and select.

[0072] S405, In response to a media asset selection instruction for the media resource list, control the corresponding media application to jump to the playback page of the target media resource, and control the display to show the playback interface corresponding to the playback page.

[0073] After seeing the unified media resource list, users can select the target media resource to play via remote control, touch, or voice, triggering a media resource selection command. Upon receiving the media resource selection command, the controller 250 determines the corresponding source platform and content identification information based on the media resource's information, controls the corresponding media application to jump to the target media resource's playback page or details page, and controls the display 260 to show the corresponding playback interface.

[0074] This embodiment of the disclosure acquires search result images from various media applications and extracts media asset information from them based on image recognition technology. This eliminates the reliance on open search interfaces for each media application, freeing the search coverage from the limitations of vendor interface opening policies. It can cover all media applications installed by the user, achieving unified cross-application media resource search across the entire domain. Furthermore, since it does not use web crawler technology to extract metadata, it avoids copyright infringement risks. The extracted media asset information remains consistent with the search results actually displayed on the source platform, ensuring the accuracy and timeliness of the search results.

[0075] Figure 5 This is a flowchart illustrating the search operation provided in some embodiments of this application. In some embodiments, such as Figure 5 As shown, in step S401 above, the controller 250 executes a search operation by controlling the media application, specifically configured to perform the following steps: S501. Obtain the list of target media applications corresponding to the media applications.

[0076] The target media application list contains identification information (such as application package name) of the media applications to be searched and their corresponding application navigation scripts. In some embodiments, the target media application list may include all media applications installed on the display device 200; users can also customize the media applications participating in the search to reduce the total search time. For example, users can select the media applications to be searched in the settings interface; applications that are not selected will not appear in the target media application list.

[0077] S502. Launch each media application in the target media application list.

[0078] The controller 250 launches each media application in the target media application list through the application launch interface provided by the operating system (such as the Intent mechanism of the Android system).

[0079] S503. After the media application is launched, navigate to the search interface of the corresponding media application based on the pre-configured application navigation script.

[0080] After the media application starts up, the controller 250 loads the pre-configured application navigation script corresponding to the media application. The application navigation script contains the key operation steps and interface element identification information required to navigate to the search interface. According to the guidance in the script, the controller 250 simulates the user's navigation operations (such as remote control button operations or touch operations) within the media application, gradually navigating to the media application's search interface. For example, the script can record operation sequences such as "press the down arrow key twice from the home page to locate the search entry, and press the confirmation key to enter the search interface".

[0081] S504. Enter the search keywords corresponding to the media asset search command in the search interface to trigger the media application to perform a search operation.

[0082] After navigating to the search interface, the controller 250 simulates user operation by entering search keywords in the search input box and simulates click or confirmation operations to trigger the search function, enabling the media application to perform a media resource search based on the search keywords.

[0083] In some embodiments, when a search keyword is entered, the controller 250 locates the interface element of the search input box through the accessibility service, writes the search keyword into the text attribute of the input box, and then simulates the confirmation key operation to trigger the search.

[0084] In some embodiments, when a user inputs a media asset search command in voice form, the controller 250 first performs speech recognition on the voice data to obtain text keywords (i.e., the search keywords mentioned above), and then inputs the text keywords into the search interface of each media application. In this way, the user only needs to issue a voice command once to automatically complete the search in all selected media applications without having to repeat the operation multiple times.

[0085] In some embodiments, when the speech recognition result contains homophones, the controller 250 can display a list of candidate keywords on the display 260 for the user to confirm, thereby avoiding deviations in search results due to speech recognition errors.

[0086] In some embodiments, the controller 250 may perform the search operation sequentially according to the order of the applications recorded in the target media application list, or it may launch multiple media applications simultaneously to perform the search in a parallel manner, so as to shorten the total time of cross-platform search.

[0087] For the parallel search method, the controller 250 launches various media applications in the background in parallel, and uses a window stack management mechanism to switch between the foreground and background of each application. After each application completes the search, the controller 250 obtains the search result images in sequence.

[0088] In some embodiments, the controller 250 may also set a search timeout threshold (e.g., 15 seconds). When a media application fails to complete the search operation within the timeout threshold, the controller 250 skips the media application and aggregates and displays the search results of other media applications that have been obtained, so as to avoid affecting the presentation timeliness of the overall search results due to the slow response of a single application.

[0089] The above embodiments can realize automated search for multiple applications, and drive each application to perform search operations through pre-configured application navigation scripts, ensuring the consistency and reliability of the search process.

[0090] In some embodiments, when the controller 250 executes a pre-configured application navigation script to navigate to the search interface, it invokes an operating system-level accessibility service (such as the AccessibilityService in Android) to listen for the UI elements of the media application. The accessibility service can obtain the UI tree structure of the current application interface, including the identifiers (such as resource IDs, text content, class names, etc.) and hierarchical position information of each UI element. Based on the UI element identifiers or relative position information recorded in the application navigation script, the controller 250 automatically generates corresponding control operations (such as remote control button operations or touch operations), driving the interaction of UI elements and gradually navigating to the search interface of the media application. That is, the controller 250 navigates to the search interface of the media application in response to the control operations.

[0091] In some embodiments, the application navigation script includes a customized operation flow description for each media application. Taking navigation to the search interface as an example, the script can be described as: identifying the interface layout type of the current interface → locating the identifier of the search entry interface element → simulating remote control button operation to move the focus to the search entry → simulating confirmation button operation to enter the search interface. For different models or versions of media applications, the application navigation script can be configured with different navigation paths.

[0092] In some embodiments, when the UI element identifier recorded in the application navigation script is not matched in the current UI, the controller 250 may employ a fallback strategy: first, simulate a back button operation to exit the current UI level, and then retry navigation based on the alternative paths recorded in the script, in order to improve the navigation success rate. If the target UI element still cannot be located after multiple attempts, the controller 250 will skip this media application and record the exception information in the log, while continuing to perform search operations on other media applications in the target media application list, to avoid blocking the overall search process due to the failure of navigation for a single application.

[0093] The above embodiments use operating system-level accessibility services to simulate user operations without requiring any modification or intrusion into the target media application. They are highly compatible and can be adapted to all installed media applications. Navigation is performed through interface element identifiers or relative position information, and even if the application interface layout changes, a back-and-forth retry strategy can maintain a high success rate.

[0094] Figure 6 These are screenshots and flowcharts illustrating the preprocessing steps used in some embodiments of this application. Figure 6 As shown, in some embodiments, the controller 250 in step S402 above, which acquires the search result image generated after each media application performs a search operation, is specifically configured to perform the following steps: S601. When a loading completion notification is detected for the search results interface, capture the image information corresponding to the search results interface.

[0095] When a loading completion notification is detected for the search results interface, the controller 250 captures the complete image information of the search results interface through the screen capture interface provided by the operating system (such as the MediaProjection API of the Android system).

[0096] In some embodiments, the completion notification of the search results interface can be detected by the following methods: the accessibility service listens for changes in the interface elements of the search results page, or the pixel change rate of multiple consecutive frame screenshots is determined to be lower than a preset threshold by the image frame difference detection method.

[0097] S602. Preprocess the image information.

[0098] After capturing the original image information, the controller 250 preprocesses the image information. Preprocessing may include at least one of the following operations: image compression to reduce the image storage size and network transmission data volume; irrelevant region cropping to remove non-search result areas such as status bars, navigation bars, and advertising banners from the image, retaining only the search result content area; and image sharpness enhancement to improve the sharpness of text and image elements in the image through contrast enhancement or noise reduction algorithms.

[0099] In some embodiments, image compression employs lossy compression to reduce the image resolution to a preset size (e.g., 1080×1920 pixels), minimizing the amount of image data while ensuring that the text in the image can be accurately recognized.

[0100] In some embodiments, irrelevant region cropping can be based on a pre-configured cropping template. The template defines the cropping coordinate range of the effective content area for each media application's different interface layout. For example, for video-on-demand application A, the cropping template defines the cropping area as from 200 pixels to 1800 pixels vertically to remove the top status bar and bottom navigation bar; for video-on-demand application B, due to its different interface layout, the cropping template defines the cropping area as from 150 pixels to 1750 pixels vertically. The cropping template can be flexibly configured according to the actual layout of each application interface to ensure that the retained image area after cropping contains complete search result content.

[0101] S603. Store the preprocessed image information as the search result image.

[0102] After completing the preprocessing, the controller 250 stores the preprocessed image information as the search result image for subsequent processing.

[0103] In the above embodiment, the screenshot operation is triggered by detecting the completion notification of the search results interface, ensuring that an accurate search results image can be captured; the original image is compressed, cropped and sharpness enhanced preprocessing, which reduces the amount of data to be transmitted and recognized in the subsequent process, and improves the processing speed and the accuracy of image recognition.

[0104] Figure 7 This is a schematic diagram illustrating the process of extracting media asset information through image recognition, provided in some embodiments of this application. For example... Figure 7 As shown, in some embodiments, in step S403 above, the controller 250 performs image recognition technology to extract the first media asset information corresponding to the media resource from the search result image, specifically configured to perform the following steps: S701. Send the search result image and pre-configured recognition prompts to the image recognition service.

[0105] The controller 250 sends the preprocessed search result image and pre-configured recognition prompts to the image recognition service. The image recognition service can be a Large Language Model (LLM) service deployed on a cloud server, or a lightweight visual language model deployed locally on the display device 200. The recognition prompts instruct the image recognition service to extract specified types of media asset information; for example, they can be set to "Please identify the film and television content search results displayed in the image, extract the film and television name, platform name, membership requirements, and resolution information for each result, and return it in JSON format."

[0106] S702, Receive the structured recognition results returned by the image recognition service based on the recognition prompt words.

[0107] After receiving the search result image and recognition prompt, the image recognition service analyzes the image content, extracts the media asset information corresponding to the prompt requirements, and returns the structured recognition results in a structured data format (such as JSON format).

[0108] S703. Parse the first media asset information from the structured recognition results.

[0109] After receiving the structured recognition results, the controller 250 parses out the first media asset information corresponding to each media resource, which may include fields such as media resource name, platform name, membership requirements, and resolution.

[0110] In some embodiments, the structured recognition result is in JSON array format, where each element corresponds to a media asset information entry. Each element contains key-value pairs such as name, platform, VIP requirement, and resolution. The controller 250 can retrieve each media asset information entry in batches by parsing the JSON array.

[0111] In some embodiments, the controller 250 also performs validity checks on the structured recognition results, such as checking whether required fields are missing or whether the media resource name is an empty string, and filters out entries that fail the validation to ensure the data quality of subsequent summary processing.

[0112] In some embodiments, in addition to the large language model service, the image recognition service can also be combined with dedicated Optical Character Recognition (OCR) technology to assist in text extraction, improving the accuracy of recognizing plain text information in search results. For example, OCR technology is first used to extract the text content and text location information from the image, and then the large language model is used to perform semantic understanding and structured integration of the OCR extraction results. When the search result image contains a display format that combines poster images and text, OCR technology can accurately locate the text region and extract the text content, while the large language model can perform semantic analysis on the extracted text content and map it into structured media asset information fields. The complementary cooperation of the two can improve the recognition accuracy.

[0113] In some embodiments, the controller 250 can also perform post-processing on the text extracted by OCR, such as removing advertising text, completing truncated movie titles, etc., to further improve the integrity of media asset information.

[0114] The above embodiments guide the image recognition service to extract the required type of media asset information through pre-configured recognition prompts, avoiding the extraction of irrelevant content, thereby improving the targeting and accuracy of information extraction; the recognition results are returned in a structured data format, which facilitates subsequent processing.

[0115] In some embodiments, the display device 200 further includes a communication device 220 configured to establish a communication connection with a cloud server. The controller 250 can send the search result image to the cloud server (i.e., server 400) via the communication device 220, so that the cloud server analyzes the search result image based on a large language model service and generates corresponding media asset information recognition results. The cloud server analyzes the latest interface layout changes of each media application based on the large language model service, generates updated application navigation scripts and recognition prompts, and sends them to the controller 250. The controller 250 receives the updated content returned by the cloud server and updates its local configuration.

[0116] In some embodiments, the cloud server can leverage the image understanding capabilities of its large language model service to identify changes in the interface element identifiers and layouts of key interfaces such as the search interface and search results page in new versions of various media applications. It can then automatically generate corresponding updated application navigation script content and optimize the recognition of prompts to adapt to potentially changing search result display styles. This update process can be performed periodically by the cloud server or triggered when a media application version changes. For example, when the cloud server detects that a new version of a media application has been released, it automatically downloads screenshots of the new version's interface, analyzes the differences between the old and new interfaces using the large language model, and updates the interface element identifiers and navigation paths involved in the application navigation script.

[0117] In some embodiments, the controller 250 is configured to first check the locally cached application navigation script version when performing a search operation. If it finds that the application version number corresponding to the local application navigation script is inconsistent with the actual installed media application version number, it triggers a cloud update process, actively requesting the latest application navigation script and recognition prompt words from the cloud server to ensure compatibility with the current version of the media application.

[0118] In some embodiments, when the cloud server pushes the latest script, it can simultaneously push the corresponding script version compatibility range information. After receiving the updated script, the controller 250 first verifies whether the version number of the current media application is within the compatibility range. If it is not within the compatibility range, it temporarily suspends the use of the script and requests further adaptation from the cloud to ensure the reliability of the navigation script.

[0119] The above embodiments utilize the image understanding and information extraction capabilities of cloud-based large language model services to improve the accuracy of media asset information recognition under complex interfaces; by dynamically updating application navigation scripts and recognition prompts in the cloud, they can adapt to version updates and interface changes of media applications, ensuring the long-term stable operation of media resource search.

[0120] In some embodiments, when the controller 250 aggregates the first media asset information into a media resource list, it first performs deduplication on the first media asset information. Since the same media resource may be playable in multiple media applications, the controller 250, based on preset deduplication rules, such as using a combination of the media resource name and release year as the deduplication key, merges multiple first media asset information entries from different platforms that point to the same media resource into a single aggregated media asset information entry. Simultaneously, it records the platform name, membership requirements, and resolution information of the media resource on multiple platforms. For example, when a user searches for movie-related media resources, the film "Little Cow" can be played in both application A and application B. After deduplication, these entries will be merged into a single record, such as... Figure 8 As shown, the monitor 260 can simultaneously display two playback options: 4K / VIP for application A and 1080P / Free for application B, making it easy for users to directly compare and choose.

[0121] It should be noted that, Figure 8 The effect shown is merely an illustrative example and is not intended to limit the display method of media asset aggregation on the display device in this application. The display format can be adjusted according to actual needs in different embodiments.

[0122] In some embodiments, the deduplication key can be further combined with director's name or main actor information for combination matching to reduce the misjudgment rate of films with the same name.

[0123] After deduplication is completed, the controller 250 sorts the deduplicated first media asset information according to preset sorting rules to generate a media resource list. Sorting rules may include: sorting by the matching degree between the media resource name and the search keywords, sorting by the number of media resources from different platforms, and sorting by the rating of the media resources.

[0124] In some embodiments, users can select their preferred sorting method in the system settings.

[0125] In some embodiments, when aggregating the media resource list, the controller 250 also adds source platform tags (such as platform icons or platform name abbreviations) to each deduplicated media resource entry, so that users can intuitively identify which platforms each resource comes from in the media resource list.

[0126] The above embodiments deduplicate media asset information extracted from different platforms to avoid the same media resource being displayed repeatedly on multiple platforms; by sorting search results according to preset sorting rules, the content that users are most likely to be interested in can be displayed first, further improving the efficiency of users finding target media resources.

[0127] Figure 9 This is a schematic diagram illustrating the one-click playback process provided in some embodiments of this application. For example... Figure 9 As shown, in some embodiments, when the controller 250 executes the control to jump to the playback page of the target media resource in step S405 above, it is specifically configured to perform the following steps: S901. Obtain the media application identifier and content identifier information corresponding to the target media resource.

[0128] The controller 250 obtains the media application identifier (such as application package name) and content identifier information (such as deep link or content ID) corresponding to the target media resource selected by the user from the media resource list.

[0129] S902. For target media resources that support deep linking, launch the corresponding media application by carrying content identification information through the application launch interface, and jump to the playback page of the target media resource.

[0130] For target media resources that support deep link navigation, the corresponding media application is launched via the application launch interface provided by the operating system, carrying content identification information. This allows the media application to directly redirect to the playback page of the target media resource upon launch. For example, the deep link format can be app_scheme: / / play?content_id=12345. Controller 250 passes the deep link to the corresponding application via the Intent mechanism. After parsing the deep link, the application automatically enters the playback page of the corresponding content.

[0131] In some embodiments, when constructing a deep link, the controller 250 may also attach a playback progress parameter so that the user can start playback at the specified progress position after jumping.

[0132] S903. For target media resources that do not support deep linking, navigate to the playback page of the target media resource in the corresponding media application based on the pre-configured application navigation script.

[0133] For target media resources that do not support deep link navigation, the controller 250 simulates user navigation operations within the corresponding launched media application based on the pre-configured application navigation script, gradually navigating to the playback page of the target media resource. For example, the application navigation script can record the sequence of operations: entering the search interface → entering the movie name → searching → selecting the first result → entering the playback page.

[0134] In some embodiments, during simulated navigation, the controller 250 monitors changes in interface elements of the current interface in real time through accessibility services to determine whether each navigation operation is successfully executed. If a navigation operation does not produce the expected interface change within a preset timeout period, the controller 250 will retry the operation or switch to an alternative navigation path.

[0135] In some embodiments, when the user selects a target media resource, the controller 250 automatically closes or hides the currently displayed media resource list interface, enabling the playback interface to be displayed in full screen and enhancing the user's immersive viewing experience.

[0136] The above embodiments employ a two-tiered redirection strategy that prioritizes deep links and simulates navigation. This strategy ensures that mainstream media applications that support publicly available deep links can quickly redirect to new pages, while also enabling niche or non-standard media applications that do not support publicly available deep links to play content with a single click. This expands the scope of playback redirection after media resource search.

[0137] Figure 10 This is a schematic diagram illustrating the aggregation of omnichannel media resources provided in some embodiments of this application. For example... Figure 10 As shown, in some embodiments, when the controller 250 executes a search operation by controlling the media application, it is also configured to simultaneously acquire second media asset information that matches the media asset search instruction from both built-in system resources and external shared resources. Built-in system resources include live channels and time-shifted playback content, while external shared resources include media shared on the local area network and media files in local storage media.

[0138] In some embodiments, the controller 250 acquires the Electronic Program Guide (EPG) data corresponding to the live channel, retrieves programs matching the search keywords from the EPG data, and extracts the matching program names and their corresponding channel information and broadcast time as second media asset information. For time-shifted playback content, the controller 250 retrieves the cached playback program list and extracts the matching program information. For media files in local area network shared media and local storage media, the controller 250 obtains a file list through file system scanning and uses media files whose filenames contain the search keywords as matching items.

[0139] In some embodiments, the controller 250 uses fuzzy matching to retrieve local and LAN media files. For example, when the search keyword is "wandering", media files whose filenames contain "media asset A" can also be retrieved and used as matching results.

[0140] The controller 250 merges the second media asset information with the first media asset information into a media resource list, and labels each entry with its source type (such as live broadcast, replay, local, LAN sharing) so that users can distinguish media resources from different sources. In this way, users can view all search results from third-party media applications, built-in system resources, and externally shared resources in a unified search results list without having to switch repeatedly between different function entry points.

[0141] The above embodiments expand the search scope from third-party media applications to system-built-in resources and external shared resources, enabling unified search of media resources across all channels. Users can view media resources from all sources on a single interface without switching between different functional modules, thus achieving a one-stop media search experience.

[0142] Figure 11 This is an interactive schematic diagram illustrating the media resource search method provided in some embodiments of this application. For example... Figure 11 As shown, in some embodiments, the user inputs a media asset search command to the display device 200, the user input interface 280 receives the media asset search command and transmits it to the central control module of the controller 250; the central control module outputs a display command to the display 260, controlling the display 260 to switch to displaying the unified search interface, such as... Figure 12 As shown, the unified search interface displays search keywords and search progress information simultaneously.

[0143] The central control module sends search tasks and a list of target applications to the application automation control module. The application automation control module launches media applications sequentially or in parallel, and controls each media application in the background to navigate to the search interface, enter search keywords, and trigger the search operation. During the search, the application automation control module provides real-time feedback on the search progress to the central control module, and the central control module updates the number of completed applications and progress prompts in the unified search interface synchronously.

[0144] After the search results interface of each media application is loaded, the screenshot and recognition module receives the screenshot instruction from the central control module, captures the search results image corresponding to the search results interface of each media application, preprocesses the image, and extracts the first media asset information corresponding to each application based on the image recognition service; at the same time, the screenshot and recognition module synchronously obtains the second media asset information matching the system's built-in resources and external shared resources. The central control module summarizes, deduplicates, and sorts the two types of media asset information to generate a media resource list.

[0145] The central control module sends a list display command to the display 260, controlling the unified search interface to switch to display a complete list of media resources. Each media resource item in the list displays the media resource name, source platform identifier, member attributes, and resolution information.

[0146] When a user selects a target media resource from the media resource list, triggering a media resource selection command, the user input interface 280 transmits the command to the central control module. The central control module then schedules the playback control module to perform a jump operation. First, it controls the unified search interface to close and return to the background. Then, based on the content identification information of the target media resource, it launches the corresponding media application. Prioritizing direct jump to the playback page of the target media resource via deep links, if no valid deep links are available, it jumps to the playback page via simulated navigation. Finally, the central control module controls the display 260 to switch and display the playback interface of the media application, allowing the user to directly perform playback control operations on the target media resource.

[0147] Based on the aforementioned display device 200, some embodiments of this application also provide a media resource search method, applicable to the display device 200, which runs at least two media applications and supports receiving user-input commands. The commands include media asset search commands and media asset selection commands. Media asset search commands are used to query media resources, and media asset selection commands are used to play the corresponding target media resource. For example... Figure 4 As shown, the method includes the following steps: S401, In response to a media asset search command, controls the media application to perform a search operation on the media asset.

[0148] S402. Obtain the search result image generated after each media application performs a search operation.

[0149] S403. Based on image recognition technology, extract the first media asset information corresponding to the media resource from the search result image.

[0150] S404. Summarize the first media asset information into a media resource list and control the display to show the media resource list.

[0151] S405, In response to a media asset selection instruction for the media resource list, control the corresponding media application to jump to the playback page of the target media resource, and control the display to show the playback interface corresponding to the playback page.

[0152] Based on the above-mentioned media resource search method, it is possible to achieve unified search and one-click playback of cross-platform, full-domain media resources without relying on the open search interfaces of various media applications. This effectively solves the problems of limited search coverage and copyright infringement risks in existing technologies, improves the search efficiency of media resources on display devices, and enhances the user experience.

[0153] It should be noted that the media resource search method described in this application embodiment can adopt the same principle and implementation as the above-described display device 200 embodiment. For specific implementation details, please refer to the description of the above embodiments, which will not be repeated here.

[0154] In other embodiments, the image recognition service can be deployed via a cloud API call mode, invoking a large language model service that supports multimodal understanding. The cloud server then utilizes its image understanding and text extraction capabilities to recognize media asset information and return structured results. Alternatively, a terminal-side deployment mode can be adopted, running a quantized, lightweight visual language model on the display device 200 to achieve localized media asset information recognition, reducing network transmission latency and dependence on cloud services while ensuring the privacy and security of user search data. A hybrid deployment mode combining cloud and terminal collaboration can also be used, prioritizing the cloud API call mode for high-precision recognition results in scenarios with good network conditions, and automatically switching to the terminal-side deployment mode in scenarios with poor network conditions to ensure the availability of the search function.

[0155] In some embodiments, the controller 250 may also automatically select a suitable deployment mode based on the hardware capabilities of the display device 200 (such as NPU computing power and memory capacity), prioritizing the use of the terminal-side mode when hardware capabilities are sufficient and prioritizing the use of the cloud mode when hardware capabilities are limited.

[0156] In other embodiments, when performing search operations on each application in the target media application list, the controller 250 can dynamically adjust the search parallelism based on the historical search time data of each application. For example, for applications with long historical search times, the search is initiated and executed first; for applications with low search result quality or frequently returning empty results, their search priority is temporarily reduced or they are removed from the target list to optimize overall search efficiency.

[0157] In other embodiments, the display device 200 may also support caching historical search results. If a user repeatedly searches for the same keyword within a preset time interval (e.g., 30 minutes), the controller 250 directly reads and displays the cached list of media resources without restarting each media application to perform the search operation, thereby reducing system resource consumption and search response time. Simultaneously, the controller 250 can attach a cache timestamp to each media resource in the cache. When the cache time exceeds a preset validity period (e.g., 1 hour), the current entry is automatically marked as expired, and the search operation is re-executed only for the media application corresponding to the expired entry when the user searches for the same keyword again, achieving incremental updates.

[0158] Similar parts between the embodiments provided in this application can be referred to mutually. The specific implementation methods provided above are only a few examples under the overall concept of this application and do not constitute a limitation on the scope of protection of this application. For those skilled in the art, any other implementation methods extended from the solution of this application without creative effort shall fall within the scope of protection of this application.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the user interface; The user input interface is configured to receive user input instructions; the instructions include media asset search instructions and media asset selection instructions, the media asset search instructions are used to query media resources, and the media asset selection instructions are used to play the corresponding target media resources; A controller, electrically connected to the display and the user input interface, runs at least two media applications and is configured to: In response to the media asset search command, control the media application to perform a search operation for the media resource; Obtain the search result image generated by each of the media applications after performing the search operation; Based on image recognition technology, the first media asset information corresponding to the media resource is extracted from the search result image, and the first media asset information is summarized into a media resource list. Control the display to show the media resource list; In response to the media resource selection instruction for the media resource list, the corresponding media application is controlled to jump to the playback page of the target media resource, and the display is controlled to show the playback interface corresponding to the playback page.

2. The display device according to claim 1, characterized in that, The controller is configured to control the media application to perform a search operation for the media resources, specifically as follows: Obtain the list of target media applications corresponding to the aforementioned media application; Launch each media application in the target media application list; After the media application is launched, it navigates to the search interface of the corresponding media application based on a pre-configured application navigation script; Enter the search keywords corresponding to the media asset search command in the search interface to trigger the media application to perform the search operation.

3. The display device according to claim 2, characterized in that, The controller executes a pre-configured application navigation script to navigate to the search interface of the corresponding media application, specifically configured as follows: Invoke the accessibility service to listen for UI elements of the media application; Based on the interface element identifiers or relative position information recorded in the application navigation script, control operations are generated, which are either button operations or touch operations. In response to the control operation, navigate to the search interface of the media application.

4. The display device according to claim 1, characterized in that, The controller is configured to acquire the search result image generated by each media application after performing the search operation, specifically as follows: When a loading completion notification is detected for the search results interface, the image information corresponding to the search results interface is captured. The image information is preprocessed, and the preprocessing includes at least one of image compression, irrelevant region cropping, and image sharpness enhancement; The preprocessed image information is stored as the search result image.

5. The display device according to claim 1, characterized in that, The controller performs image recognition technology to extract the first media asset information corresponding to the media resource from the search result image, specifically configured as follows: The search result image and pre-configured recognition prompts are sent to an image recognition service, whereby the recognition prompts instruct the image recognition service to extract a specified type of media asset information. Receive the structured recognition result returned by the image recognition service based on the recognition prompt words; The first media asset information is parsed from the structured recognition results.

6. The display device according to claim 3 or 5, characterized in that, It also includes a communication device configured to establish a communication connection with a cloud server; the controller is further configured to: The search result image is sent to the cloud server via the communication device, so that the cloud server generates the corresponding media asset information recognition result based on the large language model service. The communication device receives the media asset information identification results returned by the cloud server. Based on the media asset information identification results, update the pre-configured application navigation script and identification prompts.

7. The display device according to claim 1, characterized in that, The controller aggregates the first media asset information into a media resource list, specifically configured as follows: The first media asset information is deduplicated; The first media asset information after deduplication is sorted according to the preset sorting rules to obtain a list of media resources containing the first media asset information.

8. The display device according to claim 1, characterized in that, The controller is configured to redirect the media application corresponding to the target media resource to the playback page of the target media resource. Obtain the media application identifier and content identifier information corresponding to the target media resource; For target media resources that support deep linking, the corresponding media application is launched through the application launch interface carrying the content identification information, and then the user is redirected to the playback page of the target media resource. For target media resources that do not support deep link navigation, the system navigates to the playback page of the target media resource in the corresponding media application based on a pre-configured application navigation script.

9. The display device according to claim 1, characterized in that, When the controller executes the command to control the media application to perform a search operation, it is also configured to: Obtain second media asset information that matches the media asset search command from the system's built-in resources and external shared resources; the system's built-in resources include live channels and time-shifted playback content, and the external shared resources include local area network shared media and local storage media; The second media asset information and the first media asset information are merged and summarized into the media resource list.

10. A method for searching media resources, characterized in that, The method is applied to a display device that runs at least two media applications and supports receiving user input commands; the commands include media asset search commands and media asset selection commands, wherein the media asset search commands are used to query media resources, and the media asset selection commands are used to play corresponding target media resources; the method includes: In response to the media asset search command, control the media application to perform a search operation for the media resource; Obtain the search result image generated by each of the media applications after performing the search operation; Based on image recognition technology, the first media asset information corresponding to the media resource is extracted from the search result image, and the first media asset information is summarized into a media resource list. Control the display to show the list of media resources; In response to the media resource selection instruction for the media resource list, the corresponding media application is controlled to jump to the playback page of the target media resource, and the display is controlled to show the playback interface corresponding to the playback page.

Images