Display device and content push method

Abstract

The present application discloses a display device and a content push method. When presenting target content, an external terminal device that supports target relay capability is searched through one or more of a local area network protocol channel, a wide area network protocol channel, and other protocol channels; in response to an instruction input by a user indicating that the target content is pushed to a target receiving end device, a target protocol channel is determined according to the protocol channel supported by the target receiving end device; a relay request is sent to the target receiving end device based on the target protocol channel to request the target receiving end device to continue presenting the target content. By selecting a suitable protocol channel to search for a device and calling the target receiving end device, it can be ensured that the searched device information is more comprehensive, providing users with more choices, and more reasonable use of the device's communication resources, improving the execution speed of the content relay process between devices, and improving the user experience.

Description

[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on September 18, 2021, with application number 202111097923.X and invention name “Display Device”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The present application relates to the technical field of display devices, and in particular to a display device and a content push method. Background Art

[0003] Display devices, such as smart TVs and smart screens, can provide users with playback images such as audio, video, and pictures, such as online video programs and live TV programs. In addition, they can also provide users with various applications and service content such as online games, AI fitness, and online education.

[0004] In some scenarios, such as homes, there are usually multiple terminal devices, such as smart TVs, refrigerator smart screens, smart speakers, etc. These terminal devices can communicate with each other and can also communicate with terminal devices outside the scenario based on a wide area network. Each terminal device can present content to the user, including but not limited to music, videos, calls, texts, pictures, etc. How to share and continue content between devices to improve user experience has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] The present application provides a display device and a content push method.

[0006] In a first aspect, the present application provides a display device, including:

[0007] A display for presenting content;

[0008] A speaker, used to present the content together with the display;

[0009] A communicator configured to communicate with an external terminal device via a local area network protocol channel, a wide area network protocol channel, and other protocol channels;

[0010] The controller is configured as:

[0011] When presenting the target content, searching for an external terminal device supporting a target relay capability through one or more of the local area network protocol channel, the wide area network protocol channel, and other protocol channels, wherein the target relay capability refers to a capability required for presenting the target content;

[0012] Presenting the device information of the searched external terminal device, so that the user can specify a target receiving end device from the external terminal devices supporting the target relay capability;

[0013] In response to an instruction input by a user indicating that the target content is pushed to a target receiving end device, a target protocol channel is determined according to a protocol channel supported by the target receiving end device, wherein the target protocol channel is one or more of the local area network protocol channel, the wide area network protocol channel and other protocol channels;

[0014] A relay request is sent to the target receiving end device based on the target protocol channel to request the target receiving end device to continue presenting the target content.

[0015] In a second aspect, the present application also provides a content push method, the method comprising:

[0016] When presenting the target content, searching for an external terminal device supporting a target relay capability through one or more of a local area network protocol channel, a wide area network protocol channel, and other protocol channels, wherein the target relay capability refers to a capability required for presenting the target content;

[0017] Presenting the device information of the searched external terminal device, so that the user can specify a target receiving end device from the external terminal devices supporting the target relay capability;

[0018] In response to an instruction input by a user indicating that the target content is pushed to a target receiving end device, a target protocol channel is determined according to a protocol channel supported by the target receiving end device, wherein the target protocol channel is one or more of the local area network protocol channel, the wide area network protocol channel and other protocol channels;

[0019] A relay request is sent to the target receiving end device based on the target protocol channel to request the target receiving end device to continue presenting the target content.

[0020] It can be seen from the above technical solutions that based on the display device and content push method provided by the embodiment of the present application, when presenting the target content, an external terminal device that supports the target relay capability is searched through one or more of the local area network protocol channel, the wide area network protocol channel and other protocol channels; in response to the user input indicating the instruction to push the target content to the target receiving end device, the target protocol channel is determined according to the protocol channel supported by the target receiving end device, and the target protocol channel is one or more of the local area network protocol channel, the wide area network protocol channel and other protocol channels; based on the target protocol channel, a relay request is sent to the target receiving end device to request the target receiving end device to continue presenting the target content. By selecting a suitable protocol channel to search for the device and calling the target receiving end device, it can be ensured that the searched device information is more comprehensive, so as to provide users with more choices, and the communication resources of the device can be used more reasonably, so as to improve the execution speed of the content relay process between devices and improve the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0021] Figure 1 This is a usage scenario of a display device shown in some embodiments of the present application;

[0022] Figure 2 is a hardware configuration block diagram of the control device 100 shown in some embodiments of the present application;

[0023] Figure 3 A hardware configuration block diagram of a display device 200 shown in some embodiments of the present application;

[0024] Figure 4 A software configuration diagram of a display device 200 shown in some embodiments of the present application;

[0025] Figure 5 A software configuration block diagram of a common relay component is shown according to an exemplary embodiment;

[0026] Figure 6 This is a schematic diagram of a relay process according to an exemplary embodiment of the present application;

[0027] Figure 7 A display device user interface is exemplarily shown;

[0028] Figure 8 A display device user interface is exemplarily shown;

[0029] Fig. 9 A display device user interface is exemplarily shown;

[0030] Fig.10 A display device user interface is exemplarily shown;

[0031] Fig.11A A display device user interface is exemplarily shown;

[0032] Fig. 11B A display device user interface is exemplarily shown;

[0033] Fig. 11C A display device user interface is exemplarily shown;

[0034] Fig.12 A display device user interface is exemplarily shown;

[0035] Fig.13 This is a schematic diagram of a push scenario according to an exemplary embodiment of the present application;

[0036] Fig.14 A display device user interface is exemplarily shown;

[0037] Fig.15This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0038] Fig.16 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0039] Fig.17 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0040] Fig.18 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0041] Fig.19 This is a schematic diagram of another relay scenario according to an exemplary embodiment of the present application;

[0042] Fig. 20 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0043] Fig.21 This is a schematic diagram of another relay scenario according to an exemplary embodiment of the present application;

[0044] Fig. 22 This is a schematic diagram of another relay scenario according to an exemplary embodiment of the present application;

[0045] Fig.23 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0046] Fig.24 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0047] Fig.25 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0048] Fig.26 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0049] Fig.27A and Fig.27B This is a schematic diagram of a user interface of a receiving device according to an exemplary embodiment of the present application;

[0050] Fig.28 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0051] Fig.29 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0052] Fig.30This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0053] Fig.31 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0054] Fig.32 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application;

[0055] Fig.33 An interactive flow chart according to an exemplary embodiment of the present application is shown;

[0056] Fig.34 The following is an interactive flowchart according to an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0057] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0058] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0059] The terms "first", "second", "third", etc. in the specification, claims and drawings of this application are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0060] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0061] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0062] Figure 1This is a schematic diagram of an application scenario according to some embodiments of the present application, which is intended to illustrate a type of scenario in which there are multiple terminal devices and a server that can communicate with the terminal devices. These terminal devices include but are not limited to devices with data receiving and processing functions, image display functions, and / or sound output functions. Figure 1 The scene shown includes a display device 200, a mobile terminal 300, a refrigerator smart screen 400, a smart box 500, a speaker device 600 and a server 700.

[0063] Based on the Internet of Everything technology, a communication connection can be established between multiple terminal devices in the above scenario. The communication protocols for realizing the above-mentioned Internet of Everything may include local area network protocols, wide area network protocols, and short-range wireless communication protocols that are not restricted by the network. Among them, the local area network protocol includes but is not limited to the HSP communication protocol, the wide area network protocol includes but is not limited to the AIOT protocol, and the short-range wireless communication protocol includes but is not limited to the Bluetooth transmission protocol and the infrared transmission protocol. Based on the different types of the aforementioned communication protocols, the communication protocol channels of the terminal device can be divided into a local area network-based local area network protocol channel, a wide area network-based wide area network protocol channel, and other protocol channels. Other protocol channels include Bluetooth protocol channels, infrared protocol channels, etc. Each protocol channel can support multiple communication protocols. The terminal devices in the above scenarios can support one or more of the aforementioned protocol channels.

[0064] The terminal device can establish a communication connection with the server to exchange information with the server, such as providing various content and interactive information to the terminal device. The terminal device can be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN) and other networks. The server 700 can be a cluster or multiple clusters, and can include one or more types of servers.

[0065] It should be noted that Figure 1 The same type of scene shown may also include other terminal devices, including but not limited to touch-screen integrated devices, projection devices, tablet computers, computers, laptop computers, smart cooking devices, and external devices of the various terminal devices mentioned above, such as keyboards, mice, game controllers, etc. The number of the same type of terminal devices may be one or more. For example, multiple display devices 200 may exist in the scene at the same time.

[0066] In some embodiments, different terminal devices can control each other, or a specified terminal device can be controlled by the control device 100. For example, a user can operate the display device 200 through the control device 100 or the mobile terminal 300. For another example, a user can operate the smart box 500 or the refrigerator smart screen 400 through the mobile terminal 300, and / or, by operating the display device 200 or the mobile terminal 300, operate the speaker device 600, etc.

[0067] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the terminal device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and interacts with the terminal device wirelessly or wired. The user may input user commands through buttons on the remote controller, voice input, control panel input, etc. to control the terminal device.

[0068] In some embodiments, other terminal devices are controlled by using applications running on the mobile terminal 300 .

[0069] In some embodiments, each terminal device can also be controlled in a manner other than the control device 100 or other terminal devices. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the device, or the user's voice command control can be received through a voice control device set outside the device.

[0070] Figure 2 Schematically shows a block diagram of a configuration of the control device 100 according to an exemplary embodiment. Figure 2 As shown, the control device 100 includes but is not limited to at least one of a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive input operation instructions from the user, and convert the operation instructions into instructions that can be recognized and responded to by the terminal device, playing the role of an interactive intermediary between the user and the terminal device.

[0071] In some embodiments, the terminal device includes a controller, a memory, a communicator, and a display. In some embodiments, the terminal device may also include at least one of a tuner, a detector, an external device interface, an audio output interface, a power supply, and a user interface. The controller includes a processor, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output.

[0072] Taking the display device 200 as an example, Figure 3 FIG. 2 shows a hardware configuration block diagram of a display device 200 according to an exemplary embodiment. Figure 3The display device 200 includes but is not limited to at least one of a tuner and demodulator 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0073] In some embodiments, the display may be a liquid crystal display, an OLED display, and a projection display, and may also be a projection device and a projection screen.

[0074] The communicator is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of a Wifi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near field communication protocol chips, and an infrared receiver. The terminal device can establish the transmission and reception of control signals and data signals with other terminal devices, control devices or servers through the communicator.

[0075] The user interface can be used to receive control signals from a control device (such as an infrared remote controller, etc.).

[0076] The detector is used to collect signals from the external environment or the external interaction. For example, the detector includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0077] In some embodiments, the image collector is a camera module, which includes a camera for collecting images and a depth-sensing camera for collecting depth information of the images, such as an RGBD camera. Through the camera module, images and depth information of the images can be collected.

[0078] The external device interface may include, but is not limited to, any one or more of the following: a high-definition multimedia interface (HDMI), an analog or digital high-definition component input interface (component), a composite video input interface (CVBS), a USB input interface (USB), an RGB port, etc. It may also be a composite input / output interface formed by the above multiple interfaces.

[0079] The controller controls the operation of the terminal device and responds to user operations through various software control programs stored in the memory. The controller controls the overall operation of the terminal device. For example, in response to receiving a user command for selecting a UI object to be displayed on the display, the controller can perform operations related to the object selected by the user command.

[0080] The object may be any one of the selectable objects, such as a hyperlink, an icon or other operable controls. The operations related to the selected object include: displaying a page, document, image, etc. connected to the hyperlink, or executing a program corresponding to the icon.

[0081] In some embodiments, the controller includes a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM Random Access Memory (RAM), ROM (Read-Only Memory, ROM), a first interface to an nth interface for input / output, a communication bus (Bus), etc.

[0082] In some embodiments, the system of the terminal device may include a kernel, a command parser (shell), a file system, and an application. The kernel, shell, and file system together constitute the basic operating system structure, which allows users to manage files, run programs, and use the system. After power-on, the kernel starts, activates the kernel space, abstracts the hardware, initializes hardware parameters, etc., runs and maintains virtual memory, schedulers, signals, and inter-process communication (IPC). After the kernel starts, the shell and user applications are loaded. After startup, the application is compiled into machine code to form a process.

[0083] See also Figure 4 In some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the Android runtime (Android runtime) and system library layer (referred to as "system runtime library layer"), and the kernel layer.

[0084] In some embodiments, at least one application is running in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. provided by the operating system, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0085] In some embodiments, a common relay component and at least one content application are configured in the operating system of the terminal device. Content applications refer to applications that can provide content or present content, such as camera applications, picture resource applications, picture viewing applications, video call applications, video playback applications, audio call applications, audio resource applications, map applications, reading applications, etc. Content includes pictures, audio (including call audio, audio files and live audio streams), videos (including call videos, video files, live video streams), text, geographic location information and navigation information, etc. Presenting content includes displaying pictures, geographic location information or navigation information and text, playing video files, video call screens and live broadcast room screens, playing audio files, call sounds and live broadcast room sounds, etc. The common relay component is used to push the content presented by any content application to an external terminal device for continued playback on the external terminal device; it is also used to receive content pushed by the common relay component on the external terminal device and its playback information, and continue to play the content through content that has the ability to play the content.

[0086] In some embodiments, any content application can push content to other terminal devices that can establish a communication connection through a public relay component, thereby eliminating the need to configure the function of pushing content on each content application. Any content application can receive pushes from other terminal devices for a certain content through a public relay component to connect its capabilities, thereby eliminating the need to configure the function of receiving content pushes on each content application. In the aforementioned process of content pushing, receiving, and replaying, the public relay component on the push-end device (receiving-end device) is responsible for communicating with the public relay component on the receiving-end device (push-end device) to complete the aforementioned process of content pushing, receiving, and replaying.

[0087] For ease of explanation, the above-mentioned content push, reception and capability succession process performed by the push-end device and the receiving-end device is called a relay process. The push-end device is the terminal device that initiates content push, and the receiving-end device is the content push target, or the terminal device that receives the content and relays the push-end device to continue playing the content. Based on the data flow, the relationship between the push-end device and the receiving-end device can be described as that the push-end device pushes a certain content to the receiving-end device, and the receiving-end device relays the content pushed by the push-end device. It should be understood that the terminal device involved in the present application can at least serve as a receiving-end device to relay the content pushed by other terminal devices, such as a smart speaker device relaying the songs pushed by a mobile phone. The terminal device involved in the present application can be used as a receiving-end device while also serving as a push-end device to push content outward, such as a mobile phone pushing the current song to a smart speaker for continued playback, and a mobile phone receiving a video program pushed by a smart TV and continuing to play it.

[0088] In some embodiments, capability continuation includes but is not limited to at least one of the following: resumption of media resources (such as video resumption, audio resumption, etc.), alarm setting, image quality and sound quality parameter setting, file sharing, etc.

[0089] Figure 5 According to an exemplary embodiment, a software configuration block diagram of a common relay component is shown. Figure 5 As shown, the public relay component includes an interactive hub module, a state management module, an interface display module, a protocol processing module and a logic control module.

[0090] Among them, the interactive hub module is used to interact with the content application on the local device. The interactive hub module has a built-in SDK for each application to call, and each application interacts with the interactive hub module by calling the SDK. For example, when a user triggers an operation in a content application to transfer the current content to a designated terminal device for continued playback, the content application calls the aforementioned SDK to notify the interactive hub module to send, so that the public relay component responds to the user's operation. For another example, the interactive hub module feeds back various status information during the content push process to the corresponding content application.

[0091] The status management module is used to manage various status information generated during the interaction with other terminal devices, such as status information indicating the success or failure of push, status information indicating abnormal conditions, and various notification messages. The so-called management includes but is not limited to classifying information, distinguishing information to make corresponding processing according to the judgment results, and forwarding information.

[0092] The interface display module is used to display interface elements related to the relay process in the user interface, such as window objects, tabs, status information prompt boxes, and various operable buttons.

[0093] The protocol processing module is used to select a protocol channel for interaction with other terminal devices according to preset rules, for example, selecting one from a local area network protocol channel and a wide area network protocol channel, so that the terminal device can interact with other terminal devices through the channel selected by the protocol processing module.

[0094] The logic processing module is used to execute various logic controls involved in the relay process, such as logic control in a certain working mode and logic control in the case of multi-device interaction.

[0095] In some embodiments, the functional modules of the public relay component are deployed in the application layer. In other embodiments, the functional modules of the public relay component can be deployed across layers, for example, the interaction hub module and the interface display module are deployed in the application layer, and other modules are deployed in other layers. This application is not limited to this. It should be noted that in order to realize the above-mentioned content relay function, the public relay component may include more or fewer modules, not limited to Figure 5 The software composition and architecture shown. Based on the functions of the common relay components involved in the embodiments of the present application, other components and architecture components designed belong to the protection scope of the present application.

[0096] See also Figure 4 The framework layer provides application programming interfaces (APIs) and programming frameworks for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access resources in the system and obtain system services during execution.

[0097] like Figure 4 As shown, in the embodiment of the present application, the application framework layer includes managers, content providers, etc., wherein the manager includes at least one of the following modules: an activity manager (ActivityManager) is used to interact with all activities running in the system; a location manager (Location Manager) is used to provide system services or applications with access to system location services; a package manager (Package Manager) is used to retrieve various information related to the application package currently installed on the device; a notification manager (NotificationManager) is used to control the display and clearing of notification messages; a window manager (Window Manager) is used to manage icons, windows, toolbars, wallpapers, and desktop components on the user interface.

[0098] In some embodiments, the activity manager is used to manage the life cycle of each application and the common navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes (for example, reducing the display window, shaking the display, distorting the display, etc.).

[0099] In some embodiments, the system runtime layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system will run the C / C++ library contained in the system runtime layer to implement the functions to be implemented by the framework layer.

[0100] In some embodiments, the kernel layer is a layer between hardware and software. Figure 4 As shown, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0101] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on a display, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface receives the user input command by recognizing the sound or gesture through a sensor. The user interface is an interface that can be used to receive control input (such as a physical button on the display device body, or other, etc.).

[0102] In some embodiments, the "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, control, etc. displayed on the display screen of an electronic device, where the control can include icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, and other visual interface elements.

[0103] In some embodiments, when presenting a certain content, the terminal device can respond to user control and push relevant information of the content to the terminal device specified by the user, so that the terminal device specified by the user continues to play the content according to the relevant information of the content. For ease of explanation, in the following embodiments, the terminal device that initiates content push is referred to as a push-end device, and the terminal device that receives content push and continues to play is referred to as a receiving-end device. It is worth noting that the push-end device and the receiving-end device can be display devices that have both image display and audio output functions, such as televisions, smart phones, tablet computers, refrigerator smart screens, etc., or they can be devices that only have audio output functions but not image display functions, such as speaker devices, radios, etc.

[0104] For example, when a user is watching a TV series on the living room TV, he / she needs to go to the kitchen to cook. If the refrigerator in the kitchen has a smart screen, the user can push the TV series to the smart screen in the refrigerator through a series of operations on the living room TV to continue playing. In this way, the user can continue watching the TV series on the smart screen in the refrigerator while cooking. For another example, when a user is listening to a song on the bedroom TV, he / she needs to go to the living room. If there is a speaker in the living room, the user can push the song to the speaker in the living room through a series of operations on the bedroom TV to continue playing.

[0105] The terminal device can realize the above functions through the built-in public relay component. The following will take display devices and multimedia content as examples to explain in detail various implementation methods of the technical solution of the present application.

[0106] In some embodiments, after the display device is turned on, the public relay component is started and can accept calls from any content application.

[0107] In some embodiments, after the public relay component is started, the relay capabilities of all content applications in the system are scanned according to the standard interface of the operating system. Relay capability, as the name implies, refers to the ability of an application to continue presenting content, such as the type of content that can be presented, the presentation method, etc. Taking a media application as an example, its content presentation capability may be its ability to play video files, including various parameters of playable video files, etc. For the receiving device, when it receives a request to push content from a push-end device, the content continues to be played through an application whose relay capability matches the content. Exemplarily, if the relay content is a video, the receiving device needs to continue playing the video through the video playback application on it; if the relay content is text, the receiving device needs to continue displaying the text through a text application (such as Notepad) on it.

[0108] In some embodiments, the relay capability may have different levels, such as first-level capability and second-level capability. Considering the actual functions of the content application, the real relay capability of the content application can be described by a level of relay capability or a combination of multiple levels of capabilities. It should be understood that the relay capability of each application can be customized according to its actual function. The data form and data content of the relay capability are not limited in the embodiment of the present application. However, it should be noted that the relay capability applied on the terminal device determines which content the terminal device can relay to play. In other words, the relay capability applied on the terminal device determines the ability of the terminal device to relay the content of other devices. For example, when a terminal device does not have an application for relaying the playback of a certain content, the terminal device cannot relay the playback of the content, and thus cannot become the target receiving device of the content.

[0109] In some embodiments, after the public relay component scans the relay capabilities of each application, the relay capability data can be registered in the local area network protocol component of the terminal device so that the local area network protocol component can understand the relay capabilities of each content application, wherein the local area network protocol component refers to a functional component used to respond to interactive information such as instructions and requests sent by an external device based on a local area network protocol channel. For example, when a first terminal device receives a capability inquiry message sent by a second terminal device in the same local area network based on a local area network protocol channel, the relay capabilities of each application pre-registered by the public relay component are fed back to the second terminal device, or a response is made to the capability inquiry message, such as a response to support a certain relay capability or not support a certain relay capability. In this way, the second terminal device can understand the relay capability of the first terminal device, and use this as a basis to determine whether the first terminal device can be used as a receiving device for a certain content.

[0110] In other embodiments, after the public relay component scans the relay capabilities of each application, the relay capability data can be uploaded to the cloud server so that the cloud server can query the relay capabilities of each application on the specified terminal device. For example, when the cloud server receives a query request sent by the first terminal device to query the relay capability of the second terminal device, it can respond to the query request and return the relay capability data pre-uploaded by the second terminal device to the first terminal device. In this way, the first terminal device can learn about the relay capability of the second terminal device through the cloud server, and use this as a basis to determine whether the second terminal device can be used as a receiving device for a certain content.

[0111] In other embodiments, after the public relay component scans the relay capabilities of each application, the relay capability data can be saved in a specified path of local storage so that the local area network protocol component, Bluetooth protocol component, etc. can obtain the relay capability data in the specified path.

[0112] In some embodiments, the public relay component can select one or more of the above methods to save the relay capability data of the local device according to the communication strategy with other terminal devices. The communication strategy here refers to the communication channel based on which other terminal devices communicate, such as a local area network protocol channel or a wide area network protocol channel. Exemplarily, if the terminal device is limited to communicating with other devices of the local area network content based on the local area network protocol channel, the public relay component can choose to register the relay capability data in the local area network protocol component; if the terminal device can also communicate with devices outside the local area network based on the wide area network protocol channel, the public relay component can choose to upload the relay capability data to the cloud server, so that other devices can understand the relay capability of the terminal device through the cloud server.

[0113] In some embodiments, when a terminal device presents a certain content presented by a certain content application, the public relay component can search for a terminal device that matches the relay capability based on the relay capability of the content application, and obtain a device information list, in which the device information of the optional receiving device is included. The user specifies the target push-end device based on the device information list, and the public relay component can communicate with the target push-end device based on a certain communication protocol channel, requesting the target push-end device to relay the content. In response to the request, the public relay component on the target push-end device starts the content application with the relay capability, and continues to play the content through the content application with the relay capability.

[0114] It is worth noting that in a more specific implementation of the above embodiment, the content application on the push-end device needs to interact with the public relay component in response to user operations. The public relay component will perform certain operations in response to the interactive information sent by the content application. In addition, since the public relay component has the function of presenting interface objects independent of the content application, the user can directly interact with the public relay component through the interface object provided by the public relay component to directly control the public relay component to perform certain operations. In other words, in a more specific implementation of the above embodiment, the public relay component on the push-end device can perform certain operations in response to user input.

[0115] For ease of explanation, in the following embodiments, the content that the user wants to push is referred to as the target content, the relay capability of the application that provides the target content on the push-end device is referred to as the target relay capability, and the application that supports the target relay capability on the target receiving-end device is referred to as the target application. In addition, the common relay component on the push-end device can be referred to as the push-end relay component, and the common relay component on the receiving-end device can be referred to as the receiving-end relay component. It should be understood that the aforementioned definitional names are for the convenience of explanation and distinction between concepts. Not limited to the aforementioned names, other names can also be used for explanation in some embodiments. Therefore, when clarifying the essence represented by a certain name, it is necessary to combine the context of the name.

[0116] Figure 6 FIG. 1 is a schematic diagram of a relay process according to an exemplary embodiment of the present application. Figure 6 As shown, the process specifically includes the following steps:

[0117] S601: A push-end device presents target content provided by a content application.

[0118] In fact, the target content can be any content presented by the content application. It should be understood that the types of target content provided by different content applications may be the same or different. The same content application can also provide different types of content. For example, for media applications, the content presented is mostly video content, picture content or audio content. For reading applications, the content presented is mostly text content.

[0119] Figure 7 A display device user interface is shown as an example. Figure 7 As shown, the media application interface is displayed in full screen on the display device, and there is a video playback window in the media application interface, in which a certain video content provided by the media application is being played.

[0120] S602: The content application on the push-end device sends a target relay capability to the public relay component.

[0121] The target relay capability is the relay capability of the content application that provides the target content in S601.

[0122] In an optional implementation, when the content application interface meets the preset conditions, the content application sends its own relay capability to the public relay component. For example, when the target content is played in full screen, the content application interface is considered to meet the preset conditions. In another implementation, the content application can also send its own relay capability to the public relay component when other conditions are met. For example, when the content application receives specific user input, the content application sends its own relay capability to the public relay component. This application is not limited to this.

[0123] S603: The public relay component on the push-end device searches for terminal devices that support the target relay capability and obtains a device information list.

[0124] In some embodiments, after receiving the target relay capability sent by the content application, the public relay component on the push-end device begins to search for terminal devices that support the target relay capability and obtains a device information list. The device information list is composed of device information of optional receiving-end devices. It should be understood that the search results of the public relay component can be divided into two situations, one is that at least one optional receiving-end device is searched, and the other is that no optional receiving-end device is searched. If an optional receiving-end device is searched, it means that the current scene meets the preset content push conditions. If no optional receiving-end device is searched, it means that the current scene does not meet the content push conditions.

[0125] In some embodiments, when the content application determines that the current scene meets the preset content push conditions, it sends a device search request to the public relay component. In response to the device search request sent by the content application, the public relay component searches for an external terminal device that supports the target relay capability according to the target relay capability in the device search request.

[0126] In other embodiments, the public relay component provides an interactive interface for the user to input a device search instruction, so that the public relay component can directly receive the device search instruction input by the user, and in response to the device search instruction, obtain the relay capability of the content application, obtain the target relay capability; and search for an external terminal device that supports the target relay capability according to the target relay capability. For example, when presenting the target content, the public relay component controls the display of an interface object for triggering the presentation of device information, and the user can input the device search instruction by operating the interface object.

[0127] In some optional implementations, the public relay component on the push-end device sends a device search request to the cloud based on the wide area network communication protocol channel, and the device search request includes the push-end information identifier and the target relay capability. Among them, the push-end information identifier can be an account identifier logged in on the push-end device, such as an account identifier for logging in to the content application. After receiving the device search request, the cloud searches for terminal devices associated with the push-end device according to the push-end information identifier, such as terminal devices logged in to the same account as the push-end device; after the cloud finds the terminal devices associated with the push-end device, it determines the terminal devices that match the target relay capability based on the relay capability data uploaded by these terminal devices. For example, when the relay capability of the application on a certain terminal device matches the target relay capability, the terminal device is determined as a terminal device that matches the target relay capability. If the cloud finds at least one terminal device that matches the target relay capability, a device information list containing the at least one terminal device is generated and fed back to the push-end device. If the cloud fails to find a terminal device that matches the target relay capability, it will feed back an empty device information list to the push-end device, or return a corresponding notification message to the push-end device.

[0128] In some embodiments, the public relay component on the push end sends a capability inquiry message to the terminal device in the local area network based on the local area network communication protocol channel; after receiving the capability inquiry message, the terminal device in the local area network feeds back the relay capability of each application registered in the local area network component to the push end device by returning a response message; the push end device determines the optional push end device based on the relay capability fed back by the terminal device in the local area network.

[0129] In some embodiments, the public relay component on the push end opens a short-range communication protocol channel, receives relay capability data sent by nearby terminal devices based on the short-range communication protocol channel, and thereby determines a terminal device that supports the target relay capability from the nearby terminal devices.

[0130] In some embodiments, the public relay component can select one or more from the local area network protocol channel, the wide area network protocol channel and the short-distance communication protocol channel, and search for terminal devices that support the target relay capability based on the selected communication protocol channel. By selecting the appropriate protocol channel to search for devices, it can ensure that the searched device information is more comprehensive, providing users with more choices, and more reasonably utilizing the communication resources of the device, thereby increasing the execution speed of the content relay process between devices and improving the user experience.

[0131] In other embodiments, the user may pre-set a protocol channel for communicating with the receiving device. The public relay component searches for terminal devices that support the target relay capability based on the communication protocol channel pre-set by the user. It should be understood that if the communication protocol channel set by the user is a local area network protocol channel, the terminal device searched by the public relay component is a device in the same local area network as the push-end device; if the communication protocol channel set by the user is a wide area network protocol channel, the terminal device searched by the public relay component may be a device outside the local area network; if the communication protocol channel set by the user is a short-range communication protocol channel, the terminal device searched by the public relay component is a terminal device near the push-end device.

[0132] In some embodiments, the push-end public relay component performs a search for an external terminal device that supports the target relay capability through a wide area network protocol channel, and is further configured to: send a device query request to the server through a local area network protocol channel, the device query request includes the push-end identifier and the target relay capability corresponding to the display device; receive a device information set returned by the server in response to the device query request, the device information set includes the device information of the terminal device associated with the push-end identifier and supporting the target relay capability queried by the server. In some embodiments, the above-mentioned device information includes the unique identifier of the device and the communication protocol information supported by the device. Among them, the communication protocols supported by some terminal devices can be attributed to one or more of the local area network protocol channel, the wide area network protocol channel and the short-range communication protocol channel. For example, for some terminal devices, it is possible to communicate with the push-end device through the local area network protocol channel, and it is also possible to communicate with the push-end device through the short-range communication protocol channel. For some terminal devices, it is only possible to communicate with the push-end device through the wide area network protocol channel.

[0133] In some embodiments, the public relay component can integrate the device information of the same terminal device scanned through different protocol channels according to the unique identifier in the device information, so as to present the integrated device information when the device information needs to be presented, thereby avoiding the presentation of duplicate device information.

[0134] An exemplary integration result is as follows:

[0135] Terminal device A: supports AIOT\LAN\Bluetooth;

[0136] Terminal device B: supports LAN\Bluetooth;

[0137] Terminal device C: supports Bluetooth.

[0138] In some embodiments, when the public relay component on the push-end device searches for a terminal device, the public relay component presents a prompt message on the current interface to prompt the user that the device is currently being searched. Figure 8 As shown, a prompt message "Searching for device" is displayed on the playback screen.

[0139] S604: The public relay component on the push-end device feeds back a search result to the content application, where the search result indicates that there are optional receiving-end devices.

[0140] S605: After receiving the input relay operation, the content application on the push-end device sends a device presentation request to the public relay component.

[0141] In some embodiments, when a content application presents a certain content, the user can control the control area to be called out through a certain operation or a combination of multiple operations. The control area centrally displays user-operable controls, and the user triggers the terminal device to perform a corresponding operation by operating a certain control.

[0142] In some implementations, if the public relay component on the push-end device searches for at least one optional receiving-end device, a first search result is fed back to the content application, and the first search result indicates that there is an optional receiving-end device. If the content application receives the first search result, when the user operates to call out the control area, an interface object for triggering the relay process is displayed in the control area, so that the user can input the relay operation by operating the interface object. If the content application does not receive the first search result, when the user operates to call out the control area, the interface object for triggering the relay process is not displayed in the control area.

[0143] In another implementation, the public relay component on the push-end device feeds back a search result to the content application, which indicates whether there is an optional receiving-end device. The content application decides whether to display an interface object for triggering the relay process when the user calls out the control area based on the meaning represented by the search result.

[0144] In some implementations, when the content application determines that there is an optional receiving device based on the search results, the interface object for triggering the relay process is directly displayed on the interface, without displaying the interface object in the control area when the user operates to call out the control area.

[0145] like Fig. 9 As shown, the control area includes but is not limited to at least one of a "Relay" control, a "Playlist" control, a "Clarity" control, and a "Recommended Function" control. Among them, the user can trigger the display device to perform a corresponding operation by operating a certain control. For example, when the user selects the "Playlist" control, the display device will display a list of selected episodes. It is worth noting that the user can input a content relay operation by operating the "Relay" control to trigger the display device to execute an operation of pushing the current program to other terminal devices for continued playback. When the media application receives the user's operation on the "Relay" control, the media application sends the relay operation to the public relay component.

[0146] Of course, the user can also input content relay operations in other ways, such as using the voice control function of the display device to input content relay operations through voice commands, or input content relay operations through designated buttons or button combinations on the control device.

[0147] S606: The public relay component on the push-end device presents a device information list, where the device information list includes at least one optional receiving-end device option.

[0148] In some embodiments, if at least one external terminal device supporting the target relay capability is searched, the public relay component controls the display of an interface object for triggering the presentation of device information. At this time, the user can instruct the presentation of the searched device information by operating the interface object; the public relay component responds to the input device presentation instruction and presents a device information list, the device information list includes multiple device options, and the device options correspond to the searched device information; when an input selection operation for the target device option is received, it is determined that a content push instruction is received, and the target device option corresponds to the device information of the target receiving device.

[0149] like Fig.10As shown, the device information list includes multiple selectable device options such as "Second floor living room TV", "First floor kitchen refrigerator", "Second bedroom speakers", "First floor living room TV", etc. At this time, the user can specify the target receiving end device by inputting a selection operation for an option in the list. For example, when the user selects "Second floor living room TV", the device named "Second floor living room TV" is specified by the user as the target receiving end device.

[0150] S607: After receiving the input of the selection operation on the target receiving device, the public relay component on the push-end device requests the content application for the playback information of the target content.

[0151] S608: The content application on the push-end device returns the playback information of the target content to the public relay component.

[0152] Among them, the playback information of the target content is used to enable the application on the receiving device to continue to present the target content according to the playback information. For example, when the target content is multimedia content, its playback information should at least include the playback source address, playback progress, etc. Based on the playback information, the application on the receiving device is sufficient to continue to play the multimedia content. For another example, when the target content is navigation information, its playback information should at least include user location information and planned path information. Based on the playback information, the map application on the receiving device is sufficient to continue to navigate for the user. It should be understood that depending on the content application, the parameters contained in the corresponding playback information may be the same or different. The playback information of a content application on the push-end device should be parsable and recognized by at least one content application on the receiving device to continue to present the target content.

[0153] In other embodiments, when the content application presents the target content, the user can use the voice control function to instruct the public relay component to search for a terminal device that supports the target relay capability. Fig.11A After the user wakes up the voice application, he says "check the relay device". The voice application determines the device search instruction input by the user by parsing the semantics of the voice data. The device search instruction is sent to the public relay component, and the user is replied on the interface "OK, start searching". The public relay component responds to the device search instruction sent by the voice application, searches for terminal devices that support the target relay capability, and obtains a list of device information.

[0154] Next, the public relay component sends the searched device information list to the voice application, and the specific content of the device information list is read aloud by the voice application, and the device information list is displayed in text on the interface, such as Fig. 11BAs shown. After obtaining the device information list, the user can specify the target receiving device through the voice control function and instruct the push-end device to execute the relay process. For example, the user says "Relay to the TV in the living room on the second floor". The voice application parses the semantics of the voice data and determines that the target receiving device specified by the user is the terminal device named "TV in the living room on the second floor". The voice application sends the device information of the target push-end device to the public relay component and replies to the user "OK, relaying". Fig. 11C After receiving the target receiving end information, the public relay component requests the content application for the playback information of the target content and executes the subsequent steps.

[0155] In addition, users can also trigger certain links in the above-mentioned relay process through touch gestures, air gestures and other operations, which will not be elaborated here.

[0156] S609: The public relay component on the push-end device sends a call request to the target receiving-end device. The call request includes the target relay capability and the playback information of the target content.

[0157] In some embodiments, the call request is also called a relay request.

[0158] In some embodiments, after receiving the user's selection operation on the target push-end device, the public relay component on the push-end device calls the target receiving-end device after waiting for a preset time. During the waiting period, the public relay component on the push-end device displays a prompt message on the interface. During the display period of the prompt message or the waiting period, the user can cancel the push through a certain operation, or can push immediately through a certain operation instruction. If the public relay component receives a cancellation instruction input by the user during the display period of the prompt message or the waiting period, the step of canceling the push is performed. That is, the push-end device responds to the instruction input to push the currently presented target content to the target receiving-end device, controls the presentation of prompt information, and prompts the user to input a cancel push instruction or a confirm push instruction within a predetermined time through the prompt information; in response to the confirmation push instruction input by the user within the predetermined time, sends a relay request to the target receiving-end device to request the target receiving-end device to continue presenting the target content; or, in response to the cancel push instruction input by the user within the predetermined time, cancels the sending of the relay request to the target receiving end. If the input confirmation push instruction or cancellation push instruction is not received within the predetermined time period, a relay request is sent to the target receiving end device at the end of the predetermined time period, and the display of the prompt information is canceled. In other embodiments, after the public relay component on the push end device receives the user's selection operation on the target push end device, it displays a prompt message on the current interface while executing the call to the target receiving end device. During the display period of the prompt message or within the preset time, the user can cancel the push through a certain operation. If the push end device receives a cancellation instruction input by the user during the display period of the prompt message or within the preset time, the step of canceling the push is executed. For example, if the target receiving end device has not been called when the input cancellation instruction is received, the call is blocked. If the target receiving end device has been called when the input cancellation instruction is received, a request to cancel the relay is sent to the target receiving end device so that the target receiving end device interrupts the relevant operation.

[0159] That is, the push-end device responds to the input instruction to push the currently presented target content to the target receiving-end device, sends a relay request to the target receiving-end device, so that the target receiving-end device continues to present the target content according to the relay request; responds to receiving the cancel push instruction input by the user within the preset time, sends a cancel relay request to the target receiving-end device, so that the target receiving-end device cancels the presentation of the target content. In this way, the user has a certain amount of time to confirm the push operation input previously, and consider whether to withdraw the push operation, so as to avoid pushing the target content to the target receiving-end device due to user error operation, thereby improving the user experience.

[0160] Exemplarily, the user can input the cancel push instruction by operating any key. The user can input the confirm push instruction by operating a designated key.

[0161] In some embodiments, after receiving the user's selection operation on the target push-end device, the public relay component on the push-end device performs a countdown while displaying a prompt message. The countdown duration can be the waiting time before the call or the display duration of the prompt message. In addition, an interface element for showing the countdown progress is displayed on the interface to show the user a visual prompt of the countdown progress.

[0162] Fig.12 For users Fig.10 After selecting "Second Floor Living Room TV" as the target receiving device, the application interface displayed on the push device. Fig.12 As shown, the interface displays a prompt message that reads "It will be pushed to the TV in the living room on the second floor for playback. Press any key to stop it, and press the confirmation key to continue immediately." A visual countdown prompt "3" is displayed on one side of the prompt message.

[0163] In some embodiments, after receiving the cancel push instruction input by the user, the public relay component on the push-end device displays corresponding prompt information on the interface and sends a cancel relay request to the target receiving-end device. After receiving the cancel relay request, the public relay component on the target receiving-end device displays corresponding prompt information on the interface of the receiving-end device.

[0164] Fig.13 The figure is a schematic diagram of a push scenario according to an exemplary embodiment of the present application. Fig.13 The interface of the push-end device is specifically the interface displayed after the push-end relay component receives the cancel push instruction input by the user, such as Fig.13 As shown, a prompt message "Push has been canceled" is displayed on the interface of the push-end device. Fig.13 The interface of the receiving device is specifically the interface displayed after the receiving relay component receives the cancel relay request sent by the push device, such as Fig.13 As shown, a prompt message "The bedroom TV has canceled the push" is displayed on the interface of the receiving device.

[0165] It should be noted that the public relay components on the push-end device and the receiving-end device can broadcast messages by calling voice applications, including but not limited to the above-mentioned prompt messages of "push has been canceled" and "push has been canceled on bedroom TV".

[0166] In some embodiments, after the push-end device sends a relay request to the target receiving-end device, the content application on the push-end device may continue to present the target content, or may stop presenting the target content.

[0167] In some optional implementations, the user can set the specified function of the content application. After the push-end device sends a relay request to the target receiving-end device, the content application decides whether to continue presenting the target content according to the user setting. Exemplarily, when the user turns on the "continue playing on the original device" function of the content application, the content application continues to present the target content after the push-end device sends a relay request to the target receiving-end device. When the user turns off the "continue playing on the original device" function of the content application, the content application continues to present the target content after the push-end device sends a relay request to the target receiving-end device. Based on this, after the push-end device sends the relay request to the target receiving-end device, the push-end device is further configured to: obtain a target setting parameter, the target setting parameter is a first value or a second value; if the target setting parameter is the first value, the content application is controlled to end playing the target content; if the target setting parameter is the second value, the content application is controlled to continue playing the target content.

[0168] In some embodiments, the page displaying the device information list may also display some additional user guidance options and guidance information. Fig.10 In the device information list page shown, the user can trigger the relay function introduction page by operating the "?" control. The relay function introduction page is used to display at least the introduction information of the relay function, such as the relay operation method. Fig.10 The device information list page shown has a guide message "Press the confirmation key to relay, press the menu key to adjust the order". As the name implies, the guide message is used to remind the user that when a device option is selected, the relay process can be triggered by pressing the confirmation key on the remote control, and the display order of the device options in the device information list can be adjusted by pressing the menu key on the remote control.

[0169] In addition, Fig.10 The device information list page shown also displays a switch button for "Continue playing on the original device". When the user turns on the switch button, the "Continue playing on the original device" function of the content application is turned on. Then, after the public relay component pushes the content to the receiving device, the content application will continue to play the content. When the user turns off the switch button, the "Continue playing on the original device" function of the content application is turned off. Then, after the public relay component pushes the content to the receiving device, the content application can exit to end playing the content.

[0170] In other embodiments, after the push-end device sends a relay request to the target receiving-end device, it is further configured to: receive playback status information sent by the target receiving-end device, and obtain a target setting parameter, where the target setting parameter is a first value or a second value; if the playback status information indicates that the target receiving-end device responds to the relay request successfully, and the target setting parameter is the first value, then control the content application to end playback of the target content; if the playback status information indicates that the target receiving-end device fails to respond to the relay request, or the target setting parameter is the second value, then control the content application to continue playback of the target content.

[0171] S610: The public relay component on the target receiving-end device starts a target application supporting the target relay capability in response to a call request sent by the push-end device.

[0172] In some embodiments, when the target receiving end device has only one target application that supports the target relay capability, the public relay component directly starts the application. When the target receiving end device has multiple target applications that support the target relay capability, the public relay component starts a preset default application, or starts the target application with the highest priority according to the preset priorities of each target application, or displays an application list consisting of the multiple target applications in the interface to prompt the user to specify a target application, thereby starting the target application specified by the user.

[0173] In some embodiments, after receiving the call request from the push-end device, the public relay component on the receiving-end device waits for a preset time and then starts supporting the target application. During the waiting period, the public relay component on the receiving-end device displays a prompt message. During the display period of the prompt message or the waiting period, the user can cancel the relay through a certain operation, or can instruct to immediately relay through a certain operation. If the receiving-end device receives a user inputted instruction to cancel the relay during the display period of the prompt message or the waiting time, the step of canceling the relay is executed. In other embodiments, the public relay component on the receiving-end device responds to the call request from the push-end device, and displays a prompt message on the interface while searching for the target application. During the display period of the prompt message or the preset time, the user can cancel the relay through a certain operation. If a cancellation instruction inputted by the user is received during the display period of the prompt message or the preset time, the step of canceling the relay is executed. For example, if the target application is not started to support the target application or the target application has not started to present the target content when the inputted instruction to cancel the relay is received, the start-up or playback is blocked, and a cancellation message is sent to the push-end device. If the target application has started playing the target content when the input cancel relay instruction is received, the playback is ended and a cancellation message is sent to the push-end device.

[0174] That is, in response to receiving the relay request sent by the push-end device, the public relay component on the receiving end device controls the presentation of a certain prompt information, so as to prompt the user through the prompt information that he can input a cancel relay instruction or a confirm relay instruction within a predetermined time period; in response to the confirm relay instruction input by the user within the predetermined time period, the relay request is executed to continue to present the target content; or, in response to the cancel relay instruction input by the user within the predetermined time period, the relay request is ignored to cancel the presentation of the target content, and the corresponding prompt information is presented, and a cancellation message is sent to the push-end device. If the input confirmation relay instruction or the cancel relay instruction is not received within the predetermined time period, the relay request is executed at the end time of the predetermined time period to continue to present the target content. In this way, the user can prevent the display device from relaying and presenting the specified content within the predetermined time period before the display device responds to receiving the relay request sent by the push-end device, or instruct the display device to immediately present the execution content, thereby fully improving the flexibility of user operation.

[0175] In some embodiments, after the public relay component on the receiving device receives the relay request from the push-end device, if it receives a cancel relay request sent by the push-end device, it ignores the relay request to cancel the presentation of the target content and presents the corresponding prompt information. In some embodiments, after the public relay component on the target receiving device receives the call request sent by the push-end device, it performs a countdown while displaying the prompt message. The countdown duration can be the waiting time before the call or the display duration of the prompt message. In addition, an interface element for showing the countdown progress is displayed on the interface to show the user a visual prompt of the countdown progress.

[0176] Fig.14 For users Fig.10 After selecting "Second Floor Living Room TV" as the target receiving device, the user interface displayed on the target receiving device. Fig.14 As shown, the user interface displays a prompt message with the content "The bedroom TV content playback is about to be taken over. Press any key to stop. Press the confirmation key to take over immediately." A visual prompt "5" of the countdown progress is displayed on one side of the prompt message.

[0177] In some embodiments, after the public relay component on the receiving device receives the cancellation instruction input by the user, the corresponding cancellation notification is displayed on the interface of the receiving device, and the relay status is synchronized to the push-end device. After the public relay component on the push-end device receives the relay status sent by the receiving device, the corresponding cancellation notification is displayed on the interface of the push-end device.

[0178] Fig.15 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application. Fig.15The interface of the receiving end device is specifically the interface displayed after the receiving end relay component receives the cancel instruction input by the user, such as Fig.15 As shown, a notification message "Relay has been canceled" is displayed on the interface of the receiving device. Fig.15 The interface of the push-end device is specifically the interface displayed after the push-end relay component receives the relay status sent by the receiving-end device, such as Fig.15 As shown, a notification message "The other end has stopped relaying" is displayed on the interface of the push-end device.

[0179] In some embodiments, the public relay component selects a target communication protocol channel according to the target receiving end information, and calls the target receiving end device based on the target communication protocol channel, wherein the target communication protocol channel can be one or more of a local area network protocol channel, a wide area network protocol channel, and a short distance communication protocol channel.

[0180] Specifically, if the target receiving device only supports one protocol channel, then the protocol channel is determined as the target protocol channel. For example, for the terminal device C in the above example that only supports the Bluetooth protocol, the Bluetooth protocol channel is determined as the target communication protocol channel. For terminal devices that support multiple communication protocols, the public relay component determines one of the communication protocols supported by the target receiving device according to the preset rules as the target communication protocol channel.

[0181] In some embodiments, rules for determining the target communication protocol channel can be designed according to the characteristics of various communication protocol channels. It is known that the LAN protocol channel and the WAN protocol channel have the characteristics of unlimited transmission distance, strong anti-interference ability, and fast transmission rate (the larger the bandwidth, the faster the transmission rate); while short-range communication transmission protocols, such as Bluetooth protocol and infrared protocol, have a shorter transmission distance, and for infrared protocol, directionality and accessibility are also required.

[0182] Based on this, in some exemplary embodiments, when the receiving device supports both the LAN protocol channel and the WAN protocol channel, since the response speed of the LAN is better than that of the WAN, the LAN protocol channel can be determined as the target communication protocol channel. When the receiving device supports both the LAN protocol channel, the WAN protocol channel and the Bluetooth protocol channel, if the transmission distance is known to be far, such as exceeding 10 meters, the LAN protocol channel or the WAN protocol channel is determined as the target communication protocol channel; if the transmission distance is known to be short, such as not exceeding 2 meters, and the Bluetooth signal is strong and the network signal is weak, the Bluetooth protocol channel is determined as the target communication protocol channel. When the receiving device supports both the Bluetooth protocol channel and the infrared protocol channel, since the infrared protocol is generally a directive transmission, and the supported data volume is small, and the anti-interference ability is weak, the Bluetooth protocol channel is preferentially determined as the target communication protocol channel.

[0183] In some embodiments, the push-end public relay component obtains the preset priority of each protocol channel; and determines the protocol channel with the highest priority supported by the target receiving-end device as the target protocol channel.

[0184] It is understandable that by selecting a suitable protocol channel to call the target receiving device, the communication resources of the device can be more reasonably utilized, the execution speed of the content relay process between devices can be increased, and the user experience can be improved.

[0185] In some embodiments, the public relay component on the push-end device calls the receiving-end device simultaneously according to each communication protocol channel supported by the receiving-end device. The receiving-end device will successively receive call requests sent by the push-end device based on different protocol channels. The receiving-end device processes the call request received for the first time, and subsequently interacts with the push-end device based on the communication protocol corresponding to the call request received for the first time. When the receiving-end device subsequently receives the same call request sent by the same push-end device based on other protocol channels, it can discard these call requests.

[0186] S611: The public relay component on the receiving end device sends the playback information of the target content to the target application.

[0187] S612: The target application on the receiving end device continues to play the target content according to the playback information of the target content.

[0188] S613: The target application on the receiving device feeds back the playback status information to the public relay component.

[0189] S614: The public relay component on the receiving device sends the playback status information to the pushing device.

[0190] In some embodiments, the playback status indicates a successful playback or a failed playback. If the target application on the receiving end device successfully continues to play the target content, the target application feeds back playback status information indicating a successful playback to the receiving end relay component. If the target application on the receiving end device fails to continue to play the target content, the target application feeds back playback status information indicating a successful playback to the receiving end relay component.

[0191] In some embodiments, the receiving-end relay component displays a corresponding prompt message on the interface of the receiving-end device according to the received playback status information.

[0192] In some embodiments, after receiving the call request sent by the push-end device, the public relay component on the receiving-end device returns a response message to the push-end device. The push-end device determines whether the relay is successful or failed based on whether the response message is received. If the response message is received, the relay is considered to be successful, and a corresponding prompt message is displayed, such as a prompt message with the content "has been pushed to xx device". If the response message is not received for a long time, the relay is considered to have failed, and a corresponding prompt message is displayed, such as a prompt message with the content "relay failed".

[0193] S615: The public relay component on the push-end device receives the playback status information and presents corresponding prompt information according to the playback status information.

[0194] In some embodiments, after receiving the playback status information sent by the push-end device, the public relay component instructs the content application to end the playback of the target content, or instructs the content application to continue to play the target content, based on the playback status information and the switch status of the "Original Device Continues Playing" button. For example, regardless of whether the playback status information reveals that the receiving end device successfully or failed to play the target content, as long as the "Original Device Continues Playing" button is turned on, the content application is instructed to continue playing the target content. If the playback status information reveals that the receiving end device failed to play the target content, then if the "Original Device Continues Playing" button is turned on, the content application is instructed to continue playing the target content, and if the "Original Device Continues Playing" button is turned off, the content application is instructed to end the playback of the target content.

[0195] Fig.16 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application. Fig.16 The receiving device interface and the push device interface are specifically the interfaces displayed after the target application successfully resumes playing the target content. Fig.16 In the example, a prompt message "Playback has been switched to the bedroom TV" is displayed on the interface of the receiving device, and a prompt message "Playback has been switched to the second floor living room TV" is displayed on the interface of the pushing device.

[0196] Fig.17 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application. Fig.17 The receiving device interface and the push device interface are specifically the interfaces displayed after the target application fails to continue playing the target content. Fig.17 In the example, a prompt message "Relay failed" is displayed on the interface of the receiving device, and a prompt message "Relay failed" is displayed on the interface of the pushing device.

[0197] It should be noted that the relay process involved in the embodiment of the present application is not limited to Figure 6The process shown, the UI interface style displayed during the relay process between the push-end device and the receiving-end device is not limited to the style shown in the above embodiment. Based on the core idea of ​​the technical solution of this application, those skilled in the art can obtain a variety of different implementation methods without creative work, and these implementation methods all belong to the protection scope of this application.

[0198] In some embodiments, the public relay component can work in two modes, one is an exclusive mode, and the other is a non-exclusive mode. Among them, when the public relay component is in the exclusive mode, when it interacts with a certain receiving end device, or when it interacts with a certain push end device, it does not interact with the receiving end device or the terminal device other than the push end device regarding content push and content relay processes. In other words, when the public relay component on the terminal device is in the exclusive mode, the public relay component cannot simultaneously perform information interaction operations related to content push and content relay processes with two or more terminal devices. Conversely, when the public relay component is in the non-exclusive mode, when it performs information interaction in the process of content push to a certain receiving end device, and / or performs information interaction in the process of content relay with a certain push end device, it can also interact with the terminal devices other than the receiving end device or the push end device regarding content push and content relay processes.

[0199] In some possible implementations, the above interactions related to the content push process at least include: Figure 6 In other words, if the push-end relay component is in exclusive mode, it will not interact with terminal devices other than the receiving device during the execution of S609 to the presentation of the playing state.

[0200] In some possible implementations, the above-mentioned interaction related to content relay at least includes: Figure 6 In other words, if the receiving-end relay component is in the exclusive mode, it will not interact with terminal devices other than the push-end device during the execution of S610 to S614.

[0201] In some embodiments, the above-mentioned interaction related to content push and content relay is referred to as relay interaction. Taking a display device as an example, during the process of relay interaction with a first terminal device, the display device obtains the current working mode in response to receiving a relay request sent by a second terminal device; if the current working mode is an exclusive mode, the relay request sent by the second terminal device is ignored, and an exclusive message is returned to the second terminal device. If the current working mode is a non-exclusive mode, the corresponding relay request prompt information is displayed according to the relay request sent by the second terminal device, so that the user triggers the execution of relay interaction with the second terminal device or triggers the abandonment of relay interaction with the second terminal device according to the relay request prompt information. Among them, the relay interaction with the first terminal device refers to the interactive process of executing the relay request sent by the first terminal device to continue presenting the content pushed by the first terminal device, and / or, the interactive process of executing the input content push instruction to push the currently presented content to the first terminal device for continued presentation. In this way, the relay request sent by the second terminal device can be prevented from interrupting the relay interaction process between the display device and the first terminal device, ensuring that the display device smoothly relays the content pushed by the first terminal device, or smoothly pushes the content to the first terminal device, thereby ensuring user experience.

[0202] In some embodiments, if the current working mode is not the exclusive mode, an interruption operation prompt information is displayed to enable the user to input an interruption operation according to the interruption operation prompt information, and the interruption operation is used to control the display device to interrupt the relay interaction process with the first terminal device. In response to the input interruption operation, the relay interaction process with the first terminal device is interrupted.

[0203] In some embodiments, the user can make settings related to the content relay function on the UI interface provided by the common relay component, including setting the working mode of the common relay component. For example, by interacting with the interface objects on the UI interface provided by the common relay component, the working mode of the common relay component can be set to an exclusive mode or a non-exclusive mode.

[0204] Based on this, in the above embodiment, the display device obtains the current working mode, which may specifically include obtaining the switch status of the device's exclusive function; if the device's exclusive function is in the on state, it is determined that the current working mode is the exclusive mode; if the device's exclusive function is in the off state, it is determined that the current working mode is the non-exclusive mode.

[0205] In other embodiments, the user can turn on or off the device exclusive function of the public relay component on the UI interface provided by the public relay component. When the device exclusive function of the public relay component is turned on, when the public relay component starts to perform interaction with a terminal device related to content push or content relay, the public relay component automatically enters the exclusive mode, and when it ends the aforementioned interaction with a terminal, it automatically exits the exclusive mode and enters the non-exclusive mode. When the device exclusive function of the public relay component is turned off, the public relay component is always in the non-exclusive mode. That is, even if the public relay component starts to perform interaction with a terminal device related to content push or content relay, it will not automatically enter the exclusive mode.

[0206] In some embodiments, when the public relay component on the terminal device receives a call request sent by another terminal device, it determines whether it is currently in exclusive mode; if it is not currently in exclusive mode, it processes the call request, for example, executing Figure 6 S610 to S614 shown in; if it is currently in exclusive mode, the call request will not be processed, and the corresponding relay request prompt information will be displayed on the interface, and the corresponding notification message will be fed back to the terminal device that sent the call request. For the sake of convenience, the notification message can be called an exclusive message. The terminal device that sent the call request can display the corresponding prompt information on its interface according to the exclusive message. Among them, the relay request prompt information includes the device information of other terminal devices and / or the key information of the target content, such as the device name of other terminal devices and the content name of the target content.

[0207] In some possible implementations, when the public relay component is in exclusive mode, it can determine whether the call request or other information data is sent by the current interactive terminal or by other terminal devices by determining the source of the call request or other information data. If the request or information data is sent by other terminal devices, the request or information data is blocked.

[0208] It is understandable that the terminal device in exclusive mode may be acting as a push-end device, performing interactions with a receiving-end device related to a content push process, or may be acting as a receiving-end device, performing interactions with a push-end device related to a content relay process.

[0209] It should also be understood that the public relay component can receive call requests sent by multiple terminal devices at the same time, and the aforementioned simultaneous means that the multiple call requests are received at the same time or the time difference between receiving the multiple call requests is sufficiently short. In some embodiments, when the public relay component on the terminal device is in non-exclusive mode, if multiple call requests sent by multiple terminal devices are received, the call request received first is processed, for example, executing Figure 6 S610 to S614 shown in the figure do not need to process the call request received later. And, when deciding not to process a certain call request, a corresponding notification message is fed back to the terminal device that sent the call request. For ease of explanation, the notification message can be called a busy message. The terminal device that sent the call request can then display corresponding prompt information on its interface according to the busy message.

[0210] In some embodiments, when the public relay component on the terminal device is in non-exclusive mode, if multiple call requests sent by multiple terminal devices are received, the relay information corresponding to each call request is displayed on the interface, and the relay information includes but is not limited to the device information sent to the request, such as the device name, and may also include the content information requested for relay, such as the name of the target content. The user can specify the target relay information based on the relay information displayed in the interface, and the public relay component can process the corresponding call request to relay the response content. For relay information not specified by the user, the public relay component can feedback a busy message to the terminal device that sent the corresponding call request.

[0211] Fig.18 This is a schematic diagram of a relay scenario shown in accordance with an exemplary embodiment of the present application. In this example, when device A interacts with device B to push content A to device B, device C sends a call request to device A, which is used to request that content C be pushed to device A to continue playing on device A. At this time, device C presents the C content screen; device A presents the A content screen, and displays a prompt message with the content "about to be pushed to device B for playback"; device B presents the B device interface, and the B device interface displays a prompt message with the content "about to relay content from device A". It is worth noting that since the public relay component on device A is in exclusive mode, after receiving the call request from device C, device A does not process the call request, but instead feeds back an exclusive message to device C. After device C receives the exclusive message fed back by device A, a prompt message with the content "device A is relaying" is presented on the interface.

[0212] Fig.19 FIG. 1 is another schematic diagram of a relay scenario according to an exemplary embodiment of the present application. Fig.18The difference from the example shown is that when device A interacts with device B to push content A to device B, devices C, D, and E all send call requests to device A, respectively requesting that content C, content D, and content E be pushed to device A to continue playing on device A. Fig.18 The same thing in the examples shown is that, because the public relay component on device A is in exclusive mode, after receiving the call requests from devices C, D and E, device A did not process the call requests, but instead fed back an exclusive message to devices C, D and E. After receiving the busy message fed back by device A, devices C, D and E present a prompt message "Device A is relaying" on their respective interfaces.

[0213] Fig. 20 This is a schematic diagram of a relay scenario shown in accordance with an exemplary embodiment of the present application. In this example, when device A interacts with device B to push content A to device B, device C sends a call request to device B, where the call request is used to request that content C be pushed to device B to continue playing on device B. At this time, device C presents the content C screen; device A presents the content A screen, and displays a prompt message that reads "about to be pushed to device B for playback"; device B presents the device B interface, and a prompt message that reads "about to relay content from device A" is displayed on the device B interface. It is worth noting that based on the Fig.18 The same processing logic as the example shown, because the public relay component on device B is in exclusive mode, after receiving the call request from device C, device B did not process the call request, but fed back an exclusive message to device C. After device C received the exclusive message fed back by device B, a prompt message "Device B is in relay state" was displayed on the interface.

[0214] Fig.21 FIG. 1 is another schematic diagram of a relay scenario according to an exemplary embodiment of the present application. Fig.18 The difference from the example shown is that when device A interacts with device B to push content A to device B, device C, device D, and device E all send call requests to device B, respectively requesting that content C, content D, and content E be pushed to device B to continue playing on device B. Since the public relay component on device B is in exclusive mode, after receiving the call requests from device C, device D, and device E, device B does not process the call requests, but instead feeds back an exclusive message to device C, device D, and device E respectively. After receiving the exclusive message fed back by device B, device C, device D, and device E present a prompt message with the content "Device B is relaying" on their respective interfaces.

[0215] Fig. 22This is another relay scenario schematic diagram shown in accordance with an exemplary embodiment of the present application. In this example, when device A interacts with device B to push content A to device B, device C and device D both send a call request to device A, respectively requesting that content C and content D be pushed to device A to continue playing on device A, and device E and device F both send a call request to device B, requesting that content E and content F be pushed to device B to continue playing on device B. Since both device A and device B are in exclusive mode, after device A receives the call request sent by device C and device D, it feeds back an exclusive message to device C and device D, respectively, and device C and device D display a prompt message with the content "device A is in relay state" on their respective interfaces; after device B receives the call request sent by device E and device F, it sends an exclusive message to device E and device F, respectively, and device E and device F display a prompt message with the content "device B is in relay state" on their respective interfaces.

[0216] In some embodiments, the working state of the public relay component is divided into two types, one is a busy state, and the other is an idle state. The busy state and the idle state are complementary, that is, if the public relay component is not in a busy state, it is in an idle state. It should be noted that the busy state and the idle state can be defined according to different standards. In other words, in different embodiments, the busy state of the public relay component can be a different working state, and the corresponding idle state can also be different.

[0217] In some embodiments, when a terminal device acts as a push-end device and interacts with another or more terminal devices to push a certain content to the one or more terminal devices, the public relay component on the terminal device is in a busy state. When a terminal device acts as a receiving-end device and interacts with another or more terminal devices to receive the content pushed by the one or more terminal devices and relays the playback of the content, the public relay component on the terminal device is in a busy state. In other words, the busy state refers to the state of a terminal device when it is in relay interaction with other terminal devices.

[0218] In some optional implementations, when the common relay component executes Figure 6 During S609 to S615, the public relay component is in a busy state, otherwise it is in an idle state. More specifically, when the public relay component executes Figure 6 During S609, the public relay component enters a busy state. When the public relay component completes S615, the public relay component switches from the busy state to the idle state.

[0219] In some other optional implementations, when the common relay component executes Figure 6During S607 to S615, the public relay component is in a busy state, otherwise it is in an idle state. More specifically, when the public relay component executes S607, the public relay component enters a busy state, and when the public relay component completes executing S615, the public relay component switches from the busy state to the idle state.

[0220] In some embodiments, when a terminal device is in an idle state, in response to receiving a relay request sent by another or more terminal devices, it executes the one or more relay requests and updates the current state from an idle state to a busy state.

[0221] In some embodiments, when a terminal device is in an idle state, in response to an instruction input by a user to push the currently presented target content to another or more terminal devices, a relay request is sent to the one or more terminal devices, and the current state is updated from an idle state to a busy state.

[0222] For ease of explanation, the following embodiments use terms such as "first", "second", and "third" to distinguish various terminal devices in the interaction scenario. These terms do not specifically refer to a terminal device, and it should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0223] In some embodiments, when the public relay component on the first terminal device is busy due to relay interaction with the second terminal device, if a call request sent by a third terminal device is received, a relay information option corresponding to the call request is displayed on the interface to let the user know the content of the call request. Optionally, the relay information option may display the device information of the third terminal device and key information of the specified content, such as the device name of the third terminal device and the content name of the specified content. At this time, the user can instruct the first terminal device to execute the call request by selecting the relay information option. The first terminal device executes the call request in response to the user operation to present the specified content corresponding to the call request. In this way, the user can avoid missing the content pushed by the third terminal device.

[0224] In some embodiments, when the public relay component on the first terminal device is busy due to relay interaction with the second terminal device, if a call request sent by a third terminal device is received, a relay information option corresponding to the call request is displayed on the interface to let the user know the content of the call request. At this time, the user can interrupt the interaction between the first terminal device and the second terminal device through a predetermined operation. If the public relay component on the first terminal device receives an interrupt operation input by the user, the relay interaction with the second terminal device is interrupted, and the call request sent by the third terminal device is processed. If the public relay component on the first terminal device does not receive an interrupt operation input by the user, the relay interaction with the second terminal device continues without processing the call request sent by the third terminal device. Fig.23 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application. In this example, when device A interacts with device B to push content A to device B, device C sends a call request to device A, and the call request is used to request that content C be pushed to device A to continue playing on device A. Since the public relay component on device A is in a busy state, after receiving the call request from device C, the public relay component on device A displays the content "Device C requests to push content C, do you want to interrupt the current relay? Press the confirmation key to interrupt" on the interface of device A while executing the interaction process with device B. At this time, the user can input an interrupt operation by pressing the confirmation key. If the public relay component on device A receives an input interrupt operation, it interrupts the interaction process with device B, processes the call request sent by device C, and finally continues to play content C on device A. If the public relay component on device A does not receive an input interrupt operation, it continues the interaction process with device B without processing the call request sent by device C, and feeds back a busy message to device C.

[0225] Fig.24This is a schematic diagram of a relay scenario shown in accordance with an exemplary embodiment of the present application. In this example, when device A interacts with device B to push content A to device B, device C sends a call request to device B, and the call request is used to request that content C be pushed to device B to continue playing on device B. Since the public relay component on device B is in a busy state, after device B receives the call request from device C, while executing the interaction process with device A, the content displayed on the interface of device B is "Device C requests to push content C, do you want to interrupt the current relay? Press the confirmation key to interrupt". At this time, the user can input an interrupt operation by pressing the confirmation key. If the public relay component on device B receives an input interrupt operation, the interaction process with device A is interrupted, and the call request sent by device C is processed, and finally content C continues to be played on device B. If the public relay component on device B does not receive an input interrupt operation, the interaction process with device A continues without processing the call request sent by device C, and a busy message is fed back to device C.

[0226] In some embodiments, if the public relay component on the terminal device receives a busy message returned by the target receiving device after sending a call request to the target receiving device, corresponding user prompt information is displayed on the interface.

[0227] It should be understood that if a terminal device receives a call request sent by another terminal device while it is busy, it can prompt the user in various appropriate ways, not limited to the content shown in the above example of "Device C requests to push content C, do you want to interrupt the current relay? Press the confirmation key to interrupt." For example, according to the received call request, the relay information corresponding to the call request can be displayed on the device interface, and the relay information includes but is not limited to the push end device information and push content information. For example, Fig.25 In the example shown, if the public relay component on the A device receives a call request sent by the C device, a relay information option is displayed on the A device interface, and the relay information option displays the C device information and the C content information.

[0228] In some embodiments, when the public relay component on the first terminal device is in a busy state due to relay interaction with the second terminal device, if multiple call requests sent by the third terminal devices are received, the relay information options corresponding to each call request are displayed on the interface to let the user know the content of each call request. At this time, the user can instruct the first terminal device to execute one or more call requests by selecting one or more relay information options. The first terminal device responds to the instruction input by the user to execute at least one target relay request by specifying at least one target relay information option, and executes at least one target relay request to present the specified content corresponding to each target relay request, thereby preventing the user from missing the content pushed by the third terminal device. For the relay request corresponding to the relay information option that the user has not specified or selected, a busy message is returned to the terminal device that sent the relay request.

[0229] In addition, the user can interrupt the interaction between the first terminal device and the second terminal device through a predetermined operation, and can select one or more relay information options to specify the content to be relayed. If the public relay component on the first terminal device receives the interruption operation input by the user, and the selection operation of one or more relay information options, the interaction with the second terminal device is interrupted, and the call request corresponding to the relay information option selected by the user is processed at the same time. If the public relay component on the first terminal device does not receive the interruption operation input by the user, the interaction with the second terminal device continues, and the call request sent by other terminal devices is not processed.

[0230] In some embodiments, if the user selects multiple relay information options to specify multiple contents to be relayed, the receiving end relay component respectively starts multiple target applications that support the corresponding target relay capabilities, and sends the playback information of each target content to the corresponding target application, so that each target application continues to play the corresponding content according to the received playback information. Specifically, control the display of multiple content presentation windows, each of which is used to present the specified content corresponding to each target relay request, and multiple content presentation windows are displayed in a tiled manner, or at least some of the multiple content presentation windows are displayed in an overlapping manner. Among them, the content presentation window can be the application interface of the target application. Fig.26This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application. In this example, when device A interacts with device B to push content A to device B, device C, device D and device E all send call requests to device A, requesting to push content C, content D and content E to device A respectively, so as to continue playing on device A. Since the public relay component on device A is in a busy state, after receiving these three call requests, it presents relay information options corresponding to each call request in the interface, which are "C device-C content", "D device-D content" and "E device-E content", and a prompt message with the content "Do you want to interrupt the current relay? Press the confirmation key to interrupt". At this time, the user can interrupt the interaction between device A and device B by pressing the confirmation key. You can also control the content corresponding to the relay of device A by selecting a relay information option. For example, when the user selects "C device-C content", the public relay component on device A will process the call request sent by device C to continue playing content C on device A. It is worth noting that the user can also select multiple relay information options at the same time to control device A to relay the content pushed by multiple devices at the same time. For example, when the user selects "C device-C content" and "D device-D content", the public relay component on device A will process the call requests sent by device C and device D at the same time to continue playing content C on device A while continuing to play content D. Fig.27A and Fig.27B This is a schematic diagram of a user interface of a receiving device according to an exemplary embodiment of the present application, which specifically shows Fig.26 The user interface displayed after the user selects "C device - C content", "D device - D content" and "E device - E content" on device A. Fig.27A In the example, content C, content D and content E are displayed in different windows, or in other words, content C, content D and content E are displayed in split screens on the interface of device A. Fig.27B In the example, content C is displayed in full screen, and content D and content E are displayed superimposed on content C. It should be understood that when the user selects multiple relay information options to control device A to relay content pushed by multiple devices at the same time, the receiving device presents the multiple contents in a manner not limited to the implementation manner shown in the above example. This application does not limit the manner in which the receiving device presents multiple contents.

[0231] Fig.28This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application. In this example, when device A interacts with device B to push content A to device B, device C, device D and device E all send call requests to device B, respectively requesting to push content C, content D and content E to device B to continue playing on device B. Since the public relay component on device B is in a busy state, after receiving these three call requests, it presents relay information options corresponding to each call request in the interface, which are "C device-C content", "D device-D content" and "E device-E content", respectively, and a prompt message with the content "Do you want to interrupt the current relay? Press the confirmation key to interrupt". At this time, the user can interrupt the relay process between device B and device A by pressing the confirmation key. It is also possible to control device B to receive the content pushed by the corresponding device by selecting a certain relay information option. In some embodiments, when the public relay component on a terminal device is in an idle state, if call requests sent by multiple other terminal devices are received, the relay information options corresponding to each call request are displayed on the interface to enable the user to understand the content of each call request. At this time, the user can select one or more relay information options to specify the terminal device to interact with. If the public relay component on the first terminal device receives a selection operation on one or more relay information options, it will simultaneously process the call request corresponding to the relay information option selected by the user.

[0232] Fig.29 FIG. 1 is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application. Fig.26 The difference from the example shown is that device A receives the call requests sent by devices C, D, and E when its public relay component is in an idle state. Since the public relay component on device A is in an idle state, after receiving these three call requests, it only needs to present the relay information options corresponding to each call request in the interface for the user to select, without displaying the prompt message "Do you want to interrupt the current relay? Press the confirmation key to interrupt".

[0233] In some embodiments, when the public relay component on the first terminal device is in a busy state due to the execution of the relay process between the second terminal device, it can respond to the user operation and send a call request to one or more other terminal devices specified by the user. In the implementation scenario of sending a call request to multiple other terminal devices at the same time, the first terminal device will receive feedback information from the multiple other terminal devices, and the feedback information is any one of an exclusive message, a busy message, and a play status information. The first terminal device displays corresponding prompt information on the device interface according to the feedback information of each terminal device. For example, when receiving the play status information sent by a terminal device, the corresponding prompt information is presented in the interface according to the play status revealed by the play status information, including a play success status and a play failure status. When receiving an exclusive message sent by a terminal device, a prompt message with the content "xx device is in a relay state" is presented in the user interface. When receiving a busy message sent by a terminal device, a prompt message with the content "xx device refuses to receive the relay" is presented in the interface.

[0234] Fig.30 This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application, which specifically shows the interface status of each device after device A interacts with device B to push content A to device B, and device B presents content B and a device information list consisting of optional receiving device information, and sends a call request for requesting to push content B to device C1, device C2, and device C3 respectively in response to user operation. Among them, since device C1 is in an exclusive state when receiving the call request, it returns an exclusive message to device B, and device B presents a prompt message on the interface that reads "device C1 is in relay state". Since device C2 is in a busy state when receiving the call request, and the user has not terminated the relay process between device C2 and other devices, device C2 feeds back a busy message to device B, and device B presents a prompt message on the interface that reads "device C2 refuses to relay". The C3 device responds to the call request and starts a content application that supports the call request, successfully resuming playback of the B content. Therefore, the C3 device returns playback status information indicating successful playback to the B device, and the B device presents a prompt message on the interface that reads "Successfully pushed to the C3 device".

[0235] In some embodiments, when the public relay component on the first terminal device is busy due to executing the relay process between the second terminal device, it can respond to user operations and send a call request to one or more receiving devices specified by the user, and can also receive call requests sent by multiple push devices.

[0236] Fig.31This is a schematic diagram of a relay scenario according to an exemplary embodiment of the present application, which specifically shows the interface states of each device after device A interacts with device B to push content A to device B, device B presents content B and a device information list consisting of optional receiving device information, and receives call requests sent by device D1, device D2, and device D3 at the same time. Among them, in addition to displaying a device information list consisting of "C1 device", "C2 device", and "C3 device", device B also displays relay information options corresponding to call requests sent by device D1, device D2, and device D3, respectively, which are "D1 device-D1 content", "D2 device-D2 content", and "D3 device-D3 content". At this time, the user can specify the target receiving device by selecting one or more receiving device information options in the device information list, so that device B sends a call request for pushing content B to the receiving device specified by the user. On the other hand, the user can interrupt the relay process between device B and device A through a predetermined operation, and select one or more relay information options to specify the target push device to relay the content pushed by the target push device.

[0237] See also Fig.32 , because the user Fig.31 In the scenario shown, "C1 device" and "C2 device" are selected, so the public relay component on device B sends a call request to device C1 and device C2; ​​because the user interrupts the relay process between device B and device A and selects "D1 device-D1 content", device B relays the playback of D1 content.

[0238] It should be noted that the various steps executed by the common relay component involved in the above embodiments can be respectively divided and coordinated by the functional modules inside the common relay component.

[0239] For example, Fig.33 FIG. 1 is an interactive flow chart according to an exemplary embodiment of the present application. Fig.33As shown, the common relay component includes an interactive hub module, a state management module, an interface display module, a protocol processing module and a logic control module. On the push-end device, after the content application presents the target content, it establishes a communication connection with the interactive hub module, and based on the communication connection, sends its own relay capability (i.e., the target relay capability) to the interactive hub module. The interactive hub module sends the target relay capability to the protocol processing module to instruct the protocol processing module to search for external terminal devices that support the target relay capability. After obtaining the target relay capability, the protocol processing module selects the target communication protocol channel, and based on the target protocol channel, searches for external terminal devices that support the target relay capability through the target communication protocol component corresponding to the target protocol channel to obtain a device information list. The protocol processing module sends the device information list to the interface display module, and at the same time feeds back the device search results to the interactive hub module. The interactive hub module sends the device search results to the content application. The content application displays the interface object used to trigger the relay operation on the interface according to the device search results, receives the relay operation input by the user through the interface object, and sends a relay instruction to the interactive hub module. After the interactive hub module receives the relay instruction, it notifies the interface display module to present a list of device information. The interface display module receives the user's selection operation on the target receiving device, and sends the target receiving device information to the protocol processing module to instruct the protocol processing module to call the target receiving device. After receiving the target receiving device information, the protocol processing module instructs the interactive hub module to request the content application for the playback information of the target content, and the interactive hub module returns the requested playback information of the target content to the protocol processing module. The protocol processing module selects the target communication protocol channel and instructs the logic control module to call the target receiving device based on the target protocol channel. The logic control module determines whether it is currently in exclusive mode. If it is in exclusive mode, it notifies the interface interactive module to present a first prompt message to prompt the user. If it is not in the exclusive module, the target receiving device is called based on the target protocol channel. After the call is completed, the playback status information returned by the target receiving device is received, and the playback status information is sent to the status management module. The status management module instructs the interface display module to present a second prompt message based on the playback status information to prompt the user.

[0240] For example, Fig.34 FIG. 1 is an interactive flow chart according to an exemplary embodiment of the present application. Fig.34As shown, the public relay component includes an interactive hub module, a state management module, an interface display module, a protocol processing module and a logic control module. On the receiving end device, the target communication protocol component receives the call request sent by the push end device and sends the call request to the logic control module. The logic control module determines whether it is currently in exclusive mode. If it is in an exclusive module, it returns an exclusive message to the push end device through the target protocol component. If it is not in exclusive mode, it continues to determine whether it is currently in an idle state. If it is currently in an idle state, the target application indicating the target relay capability is determined, and the interactive hub module is instructed to start the target application. The interactive hub module starts the target application and sends the playback information of the target content to the target application. The target application continues to present the target content according to the playback information of the target content, and returns the playback status information to the interactive hub module. The interactive hub module sends the playback status information to the state management module. The state management module instructs the logic control module to return the playback status information to the push end device, and at the same time instructs the interface display module to present a prompt message according to the playback status information. If it is currently in a busy state, the interface display module is instructed to display the corresponding relay information according to the call request, and to display the interruption operation reminder message. The interface display module displays the corresponding relay information and the interruption operation reminder message according to the call request. When an interruption operation is received, the logic control module is instructed to interrupt the current relay. When a selection operation for the relay information is received, the logic control module is instructed to process the corresponding call request.

[0241] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0242] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: A display for presenting content; A communicator configured to communicate with an external terminal device via a local area network protocol channel, a wide area network protocol channel or other protocol channels; a controller running a common relay component and at least one content application; The public relay component includes an interactive hub module, a state management module, an interface display module, a protocol processing module, and a logic control module, and the content application refers to an application that can provide content or present content; The controller is configured to: When the display device is used as a push-end device, the following first process is performed: in response to the display device being turned on, each module in the public relay component is controlled to start, and the interactive hub module is controlled to scan the relay capability of the content application according to the standard interface to obtain the relay capability parameter of the content application, where the relay capability is the capability of the content application to continuously present content; In response to the start of the first content application, taking the relay capability of the first content application as the target relay capability, where the target relay capability refers to the capability required to present target content, where the target content is content presented by the first content application and to be pushed to the external terminal device; and, controlling the protocol processing module to select a protocol channel through which to interact with other terminal devices, and searching for an external terminal device that supports the target relay capability; If an external terminal device supporting the target relay capability is searched, the interface display module is controlled to present the device information of the searched external terminal device on the upper layer of the target content, and the interface display module is controlled to display the interactive interface related to the relay process, so that the user can specify the target receiving end device from the searched external terminal devices; In response to an instruction input by a user indicating that the target content is pushed to the target receiving end device, the interactive hub module is controlled to receive an instruction notification sent by the logic control module, wherein the instruction notification is used to instruct the interactive hub module to notify the protocol processing module to determine a target protocol channel; Controlling the protocol processing module to determine a target protocol channel according to the protocol channel supported by the target receiving end device; Controlling the logic control module to send a relay request to the target receiving end device based on the target protocol channel to request the target receiving end device to continue presenting the target content; In response to a push cancellation instruction input by a user within a predetermined time period, cancel sending a relay request to the target receiving end device, or send a relay cancellation request to the target receiving end device so that the target receiving end device cancels presenting the target content; When receiving the playback status information sent by the target receiving end device, controlling the interface display module to present a prompt message according to the playback status information; and / or, When the display device is used as a receiving device, the following second process is performed: in response to the display device being turned on, each module in the public relay component is controlled to start, and the interactive hub module is controlled to scan the relay capability of the content application according to the standard interface to obtain relay capability data; wherein the relay capability data includes the relay capability parameters of the content application; Controlling the interactive hub module to register the relay capability data with a communication protocol; Upon receiving a search request from an external terminal device for a display device that supports a target relay capability based on a communication protocol, controlling the interaction hub module to return a response message to the external terminal device according to the registered relay capability data, wherein the response message is used to enable the external terminal device to determine whether the display device supports the target relay capability; In response to a relay request sent by an external terminal device, control the logic control module to start a second application supporting the target relay capability according to the target relay capability and the playback information of the target content included in the relay request, control the second application to play the target content according to the playback information of the target content, and control the state management module to instruct the logic control module to feed back the playback state information to the external terminal device that sent the relay request; When the display device serves as a push-end device and a receiving-end device at the same time, the first process and the second process are performed at the same time.

2. The display device according to claim 1, characterized in that The communicator includes a local area network protocol component, and the local area network protocol component is used to communicate with an external terminal device through a local area network protocol channel. The controller is further configured as follows: Controlling the interactive hub module to register the relay capability data into the local area network protocol component, so that when the local area network protocol component receives a capability inquiry message sent by an external terminal device, it returns the response message to the external terminal device according to the relay capability data; And / or, control the interactive central module to send each of the relay capability data and the identification information of the display device to the server, so that when the server receives a device query request sent by the terminal device, it queries the terminal device associated with the terminal device and supporting the specified relay capability based on the pre-stored device identification information and the corresponding relay capability parameters.

3. The display device according to claim 1, characterized in that The controller searches for an external terminal device that supports the target relay capability, and is further configured to: Controlling the protocol processing module to send a capability inquiry message to a terminal device in the same local area network as the display device through the local area network protocol channel; Controlling the protocol processing module to receive a response message to the capability inquiry message sent by the terminal device; The protocol processing module is controlled to determine whether the terminal device supports the target relay capability according to the response message.

4. The display device according to claim 1, characterized in that The controller searches for an external terminal device that supports the target relay capability, and is further configured to: Control the protocol processing module to send a device query request to the server through the local area network protocol channel, wherein the device query request includes a push terminal identifier corresponding to the display device and the target relay capability; The protocol processing module is controlled to receive a device information set returned by the server in response to the device query request, wherein the device information set includes device information of a terminal device associated with the push end identifier and supporting the target relay capability queried by the server.

5. The display device according to claim 1, characterized in that The controller determines the target protocol channel according to the protocol channel supported by the target receiving end device, and is further configured to: If the target receiving end device supports a protocol channel, controlling the protocol processing module to determine the protocol channel supported by the target receiving end device as the target protocol channel; If the target receiving end device supports multiple protocol channels, the protocol processing module is controlled to determine the target protocol channel according to a preset rule.

6. The display device according to claim 5, characterized in that The other protocol channels include a Bluetooth protocol channel and an infrared protocol channel. The controller controls the protocol processing module to determine the target protocol channel according to a preset rule, and is further configured as follows: If the target receiving end device supports both the local area network protocol channel and the wide area network protocol channel, controlling the protocol processing module to determine the local area network protocol channel as the target protocol channel; If the target receiving end device supports the local area network protocol channel, the wide area network protocol channel and the Bluetooth protocol channel at the same time, and the transmission distance exceeds the preset value, the protocol processing module is controlled to determine the local area network protocol channel or the wide area network protocol channel as the target protocol channel; If the target receiving end device supports both the Bluetooth protocol channel and the infrared protocol channel, the protocol processing module is controlled to determine the Bluetooth protocol channel as the target protocol channel.

7. The display device according to claim 5, characterized in that The controller controls the protocol processing module to determine the target protocol channel according to a preset rule, and is further configured to: Controlling the protocol processing module to obtain the preset priority of each protocol channel; The protocol processing module is controlled to determine the protocol channel with the highest priority supported by the target receiving end device as the target protocol channel.

8. The display device according to claim 1, characterized in that The device information includes a unique identifier, and the controller performs presenting the searched device information of the external terminal device on an upper layer of the target content, and is further configured to: Controlling the protocol processing module to integrate device information of the same terminal device searched through different protocol channels according to the unique identifier; The control interface display module presents the integrated device information on the upper layer of the target content.

9. A content push method, characterized in that: The method comprises: When the display device is used as a push-end device, the following first process is performed: in response to the display device being turned on, each module in the common relay component is controlled to start, and the common relay component includes an interactive hub module, a state management module, an interface display module, a protocol processing module, and a logic control module; Controlling the interactive hub module to scan the relay capabilities of all content applications in the display device according to the standard interface to obtain relay capability parameters of the content applications; the content application refers to an application that can provide content or present content, and the relay capability refers to the ability of the content application to continuously present content; In response to the start of the first content application, taking the relay capability of the first content application as the target relay capability, where the target relay capability refers to the capability required to present target content, where the target content is content presented by the first content application and to be pushed to the external terminal device; and, controlling the protocol processing module to select a protocol channel through which to interact with other terminal devices, and searching for an external terminal device that supports the target relay capability; If an external terminal device supporting the target relay capability is searched, the interface display module is controlled to present the device information of the searched external terminal device on the upper layer of the target content, and the interface display module is controlled to display the interactive interface related to the relay process, so that the user can specify the target receiving end device from the searched external terminal devices; In response to an instruction input by a user indicating that the target content is pushed to the target receiving end device, the interactive hub module is controlled to receive an instruction notification sent by the logic control module, wherein the instruction notification is used to instruct the interactive hub module to notify the protocol processing module to determine a target protocol channel; Controlling the protocol processing module to determine a target protocol channel according to the protocol channel supported by the target receiving end device; Controlling the logic control module to send a relay request to the target receiving end device based on the target protocol channel to request the target receiving end device to continue presenting the target content; In response to a push cancellation instruction input by a user within a predetermined time period, cancel sending a relay request to the target receiving end device, or send a relay cancellation request to the target receiving end device so that the target receiving end device cancels presenting the target content; When receiving the playback status information sent by the target receiving end device, controlling the interface display module to present a prompt message according to the playback status information; and / or, When the display device is used as a receiving device, the following second process is performed: in response to the display device being turned on, each module in the public relay component is controlled to start, and the interactive hub module is controlled to scan the relay capability of the content application according to the standard interface to obtain relay capability data; wherein the relay capability data includes the relay capability parameters of the content application; Controlling the interactive central module to register the relay capability data with a communication protocol; Upon receiving a search request from an external terminal device for a display device that supports a target relay capability based on a communication protocol, controlling the interaction hub module to return a response message to the external terminal device according to the registered relay capability data, wherein the response message is used to enable the external terminal device to determine whether the display device supports the target relay capability; In response to a relay request sent by an external terminal device, control the logic control module to start a second application supporting the target relay capability according to the target relay capability and the playback information of the target content included in the relay request, control the second application to play the target content according to the playback information of the target content, and control the state management module to instruct the logic control module to feed back the playback state information to the external terminal device that sent the relay request; When the display device serves as a push-end device and a receiving-end device at the same time, the first process and the second process are performed at the same time.

Images