Remote control method of intelligent television, terminal equipment and smart television

[0034] In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of the embodiments of the present invention, not all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

[0035] The terms "first", "second", etc. referred to herein are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present invention described herein can, for example, be implemented in a sequence other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations of them are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to the clearly listed Those steps or units may include other steps or units that are not clearly listed or are inherent to these processes, methods, products, or equipment.

[0036] The term "module" used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or a combination of hardware or/and software codes that can perform functions related to the element.

[0037] The term "remote control" used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can generally control the electronic device wirelessly within a short distance. Generally, infrared and/or radio frequency (RF) signals and/or Bluetooth are used to connect to electronic devices, and may also include functional modules such as WiFi, wireless USB, Bluetooth, and motion sensors. For example, a handheld touch remote control replaces most of the physical built-in hard keys in general remote control devices with the user interface in the touch screen.

[0038] The term "gesture" used in this application refers to a user's behavior through a change of hand shape or hand movement to express expected ideas, actions, goals, and/or results.

[0039] figure 1 Exemplarily shows a schematic diagram of an operation scene between the display device and the control device according to the embodiment. Such as figure 1 As shown in, the user can operate the smart TV 200 through the mobile terminal 300 and the control device 100.

[0040] Among them, the control device 100 can be a remote control, including infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, etc., to control the smart TV 200 through wireless or other wired methods. The user can control the smart TV 200 by inputting user instructions through keys on the remote control, voice input, and control panel input. For example, the user can control the Smart TV 200 by inputting corresponding control instructions through the volume plus and minus keys, channel control keys, up/down/left/right movement keys, voice input keys, menu keys, switch button, etc. on the remote control. Function.

[0041] In some embodiments, mobile terminals, tablet computers, computers, notebook computers, and other smart devices may also be used to control the smart TV 200. For example, an application running on a smart device is used to control the smart TV 200. The application can be configured to provide users with various controls in an intuitive user interface (UI) on the screen associated with the smart device.

[0042] For example, the mobile terminal 300 can install a software application with the smart TV 200, realize connection communication through a network communication protocol, and realize the purpose of one-to-one control operation and data communication. For example, the mobile terminal 300 can be used to establish a control command protocol with the smart TV 200, the remote control keyboard can be synchronized to the mobile terminal 300, and the function of controlling the smart TV 200 can be realized by controlling the user interface on the mobile terminal 300. It is also possible to transmit the audio and video content displayed on the mobile terminal 300 to the smart TV 200 to realize the synchronous display function.

[0043] Such as figure 1 It also shows that the smart TV 200 also communicates with the server 400 through multiple communication methods. The smart TV 200 may be allowed to communicate through a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various contents and interactions to the smart TV 200. For example, the smart TV 200 can receive software program updates by sending and receiving information and interacting with an electronic program guide (EPG), or accessing a remotely stored digital media library. The server 400 may be one group or multiple groups, and may be one or more types of servers. The server 400 provides other network service content such as video on demand and advertising services.

[0044] The smart TV 200, distinguished from the perspective of display type, may include a liquid crystal display, an OLED display, and a projection display device. The specific display device type, size, resolution, etc. are not limited, and those skilled in the art can understand that the smart TV 200 can make some changes in performance and configuration as required.

[0045] In addition to providing a broadcast receiving TV function, the smart TV 200 may additionally provide a smart network TV function that provides computer support functions.

[0046] figure 2 Exemplarily shows a hardware configuration block diagram of the smart TV 200 according to an exemplary embodiment. Such as figure 2 As shown in the smart TV 200, the smart TV 200 includes a controller 210, a tuner and demodulator 220, a communication interface 230, a detector 240, an input/output interface 250, a video processor 260-1, an audio processor 60-2, a display 280, Audio output 270, memory 290, power supply, infrared receiver.

[0047] The display 280 is used to receive the image signal input from the video processor 260-1, to display video content and images, and a component of the menu control interface. The display 280 includes a display screen component for presenting a picture, and a driving component for driving image display. Display video content can be from broadcast TV content, or it can be said that various broadcast signals that can be received through wired or wireless communication protocols. Or, it can display various image content received from the network server side from the network communication protocol.

[0048] At the same time, the display 280 simultaneously displays a user manipulation UI interface generated in the smart TV 200 and used to control the smart TV 200.

[0049] And, depending on the type of the display 280, it also includes a driving component for driving the display. Alternatively, if the display 280 is a projection display, it may also include a projection device and a projection screen. In some embodiments, the display may be a plasma display screen, a liquid crystal display screen, an OLED display screen, or a combination of an optical lens and an optical projection screen.

[0050] The communication interface 230 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communication interface 230 may be a Wifi chip 231, a Bluetooth communication protocol chip 232, a wired Ethernet communication protocol chip 233 or other network communication protocol chips or a near field communication protocol chip, and an infrared receiver (not shown in the figure).

[0051] The smart TV 200 can establish control signal and data signal transmission and reception with an external control device or content providing device through the communication interface 230. And, an infrared receiver can be used as an interface device for receiving infrared control signals of the control device 100 (such as an infrared remote control, etc.).

[0052] The detector 240 is used by the smart TV 200 to collect signals from the external environment or interact with the outside. The detector 240 includes a light receiver 242, a sensor used to collect the intensity of ambient light, and can adaptively display parameter changes by collecting ambient light.

[0053] And including image collectors 241, such as cameras, cameras, etc., can be used to collect external environment scenes, and to collect user attributes or interact with user gestures, can adaptively change display parameters, and can also recognize user gestures to achieve interaction The function of interaction between users.

[0054] In some other exemplary embodiments, the detector 240 may also be a temperature sensor. For example, by sensing the ambient temperature, the smart TV 200 may adaptively adjust the display color temperature of the image. For example, when the temperature is relatively high, the color temperature of the displayed image of the smart TV 200 can be adjusted to be relatively cool, or when the temperature is relatively low, the color temperature of the displayed image of the smart TV 200 can be adjusted to be relatively warm.

[0055] In some other exemplary embodiments, the detector 240 can also be a sound collector, such as a microphone, which can be used to receive the user's voice, including the voice signal of the user's control instruction for controlling the smart TV 200, or to collect environmental sounds, using In order to identify the environmental scene type, the smart TV 200 can adapt to the environmental noise adaptively.

[0056] The input/output interface 250 is used for data transmission between the smart TV 200 controlled by the controller 210 and other external devices. Such as receiving data such as video signals and audio signals from external devices, or commands and instructions.

[0057] The input/output interface 250 may include, but is not limited to, the following: a high-definition multimedia interface HDMI interface 251, analog or data high-definition component input interface 253, composite video input interface 252, USB input interface 254, RGB port (not shown in the figure) Out) Wait for any one or more interfaces.

[0058] In some other exemplary embodiments, the input/output interface 250 may also form a composite input/output interface with the aforementioned multiple interfaces.

[0059] The tuner and demodulator 220 receives broadcast television signals through wired or wireless reception, and can perform modulation and demodulation processing such as amplification, mixing and resonance, and demodulate the frequency of the television channel selected by the user from multiple wireless or cable broadcast television signals The TV audio and video signals and EPG data signals carried in the.

[0060] The tuner and demodulator 220 can be selected by the user and controlled by the controller 210 to respond to the TV signal frequency selected by the user and the TV signal carried by the frequency.

[0061] The tuner and demodulator 220 can receive signals according to different TV signal broadcasting formats, such as: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting signals; and according to different modulation types, it can be digitally modulated, or The modulation method can be simulated. According to different types of received TV signals, analog signals and digital signals can be used.

[0062] In some other exemplary embodiments, the tuner demodulator 220 may also be in an external device, such as an external set-top box. In this way, the set-top box outputs TV audio and video signals through modulation and demodulation, and inputs them into the smart TV 200 through the input/output interface 250.

[0063] The video processor 260-1 is used to receive external video signals and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, image synthesis, etc., according to the standard codec protocol of the input signal, A signal that can be directly displayed or played on the smart TV 200 can be obtained.

[0064] Illustratively, the video processor 260-1 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, and the like.

[0065] Among them, the demultiplexing module is used to demultiplex the input audio and video data stream. For example, if MPEG-2 is input, the demultiplexing module will demultiplex into a video signal and an audio signal.

[0066] The video decoding module is used to process the demultiplexed video signal, including decoding and scaling.

[0067] An image synthesis module, such as an image synthesizer, is used for superimposing and mixing the GUI signal generated by the graphics generator with the zoomed video image according to user input or by itself, to generate an image signal for display.

[0068] The frame rate conversion module is used to convert the frame rate of the input video, such as converting a 60Hz frame rate to a 120Hz frame rate or a 240Hz frame rate, and the usual format is realized by inserting a frame.

[0069] The display formatting module is used to convert the video output signal after receiving the frame rate conversion, and change the signal to conform to the signal of the display format, such as outputting RGB data signals.

[0070] The audio processor 260-2 is used to receive external audio signals, and perform decompression and decoding according to the standard codec protocol of the input signal, as well as processing such as noise reduction, digital-to-analog conversion, and amplification processing, so that it can be played in the speaker Sound signal.

[0071] In some other exemplary embodiments, the video processor 260-1 may include one or more chips. The audio processor 260-2 may also include one or more chips.

[0072] And, in some other exemplary embodiments, the video processor 260-1 and the audio processor 260-2 may be separate chips, or may be integrated with the controller 210 in one or more chips.

[0073] The audio output 272, under the control of the controller 210, receives the sound signal output by the audio processor 260-2, such as a speaker 272, and other than the speaker 272 carried by the smart TV 200 itself, which can be output to the generator of an external device External audio output terminal 274, such as: external audio interface or headphone jack, etc.

[0074] The power supply, under the control of the controller 210, provides power supply support for the smart TV 200 with power input from an external power supply. The power supply may include a built-in power supply circuit installed inside the smart TV 200, or may be an external power supply installed in the smart TV 200, and a power interface for an external power supply is provided in the smart TV 200.

[0075] The user input interface is used to receive user input signals, and then send the received user input signals to the controller 210. The user input signal may be a remote control signal received through an infrared receiver, and various user control signals may be received through a network communication module.

[0076] For example, the user inputs user commands through the remote control 100 or the mobile terminal 300, the user input interface is based on the user's input, and the smart TV 200 responds to the user's input through the controller 210.

[0077] In some embodiments, the user may input a user command on a graphical user interface (GUI) displayed on the display 280, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user may input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

[0078] The controller 210 controls the work of the smart TV 200 and responds to user operations through various software control programs stored in the memory 290.

[0079] Such as figure 2 As shown, the controller 210 includes RAM 213 and ROM 214, a graphics processor 216, a CPU processor 212, a communication interface 218, such as a first interface 218-1 to an nth interface 218-n, and a communication bus. Among them, RAM213 and ROM214, graphics processor 216, CPU processor 212, and communication interface 218 are connected by a bus.

[0080] ROM213, used to store various system startup instructions. For example, when a power-on signal is received, the power of the smart TV 200 starts to start, and the CPU processor 212 executes the system start-up instruction in the ROM, and copies the operating system stored in the memory 290 to the RAM 213 to start the operating system. After the operating system is started, the CPU processor 212 copies various application programs in the memory 290 to the RAM 213, and then starts to run and start various application programs.

[0081] The graphics processor 216 is used to generate various graphics objects, such as icons, operation menus, and user input instructions to display graphics. Including an arithmetic unit, which performs operations by receiving various interactive instructions input by the user, and displays various objects according to display attributes. As well as including a renderer, various objects obtained based on the arithmetic unit are generated, and the rendering result is displayed on the display 280.

[0082] The CPU processor 212 is configured to execute operating system and application program instructions stored in the memory 290. And according to receiving various interactive instructions input from the outside, to execute various applications, data and content, so as to finally display and play various audio and video content.

[0083] In some exemplary embodiments, the CPU processor 212 may include multiple processors. The multiple processors may include a main processor and multiple or one sub-processors. The main processor is used to perform some operations of the smart TV 200 in the pre-power-on mode, and/or to display images in the normal mode. Multiple or one sub-processor, used for one operation in standby mode and other states.

[0084] The controller 210 may control the overall operation of the display device 100. For example, in response to receiving a user command for selecting a UI object to be displayed on the display 280, the controller 210 may perform an operation related to the object selected by the user command.

[0085] Wherein, the object may be any one of the selectable objects, such as a hyperlink or an icon. Operations related to the selected object, for example: display operations connected to hyperlink pages, documents, images, etc., or perform operations corresponding to the icon. The user command for selecting the UI object may be a command input through various input devices (for example, a mouse, a keyboard, a touch pad, etc.) connected to the smart TV 200 or a voice command corresponding to the voice spoken by the user.

[0086] The memory 290 includes storing various software modules for driving the smart TV 200. For example, various software modules stored in the memory 290 include: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

[0087] Among them, the basic module is used for signal communication between various hardware in the postpartum care smart TV 200, and the underlying software module that sends processing and control signals to the upper module. The detection module is a management module used to collect various information from various sensors or user input interfaces, and perform digital-to-analog conversion and analysis management.

[0088] For example: the voice recognition module includes a voice analysis module and a voice command database module. The display control module is a module for controlling the display 280 to display image content, and can be used to play information such as multimedia image content and UI interfaces. Communication module, a module for control and data communication with external devices. The browser module is a module used to perform data communication between browsing servers. The service module is used to provide various services and modules including various applications.

[0089] At the same time, the memory 290 is also used to store and receive external data and user data, images of various items in various user interfaces, and visual effect diagrams of focus objects.

[0090] image 3 Exemplarily shows a configuration block diagram of the control device 100 according to an exemplary embodiment. Such as image 3 As shown, the control device 100 includes a controller 110, a communication interface 130, a user input/output interface 140, a memory 190, and a power supply 180.

[0091] The control device 100 is configured to control the smart TV 200, and can receive input operation instructions from the user, and convert the operation instructions into instructions that the smart TV 200 can recognize and respond to, so as to serve as an interactive mediator between the user and the smart TV 200. For example, by operating the channel addition and subtraction keys on the control device 100, the smart TV 200 responds to the channel addition and subtraction operation.

[0092] In some embodiments, the control device 100 may be a smart device. For example, the control device 100 can install various applications for controlling the smart TV 200 according to user requirements.

[0093] In some embodiments, such as figure 1 As shown, the mobile terminal 300 or other smart electronic devices can perform similar functions to control the device 100 after installing an application for controlling the smart TV 200. For example, the user can install various function keys or virtual buttons of the graphical user interface that can be provided on the mobile terminal 300 or other smart electronic devices by installing applications to realize the function of controlling the physical keys of the device 100.

[0094] The controller 110 includes a processor 112, RAM 113 and ROM 114, a communication interface 218, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as communication and cooperation between internal components, and external and internal data processing functions.

[0095] The communication interface 130 realizes the communication of control signals and data signals with the smart TV 200 under the control of the controller 110. For example, the received user input signal is sent to the smart TV 200. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip, a Bluetooth module, and an NFC module.

[0096] The user input/output interface 140, wherein the input interface includes at least one of other input interfaces such as a microphone 141, a touch panel 142, a sensor 143, and a button 144. For example, the user can implement the user instruction input function through voice, touch, gesture, pressing and other actions. The input interface converts the received analog signal into a digital signal and the digital signal into a corresponding instruction signal, and sends it to the smart TV 200.

[0097] The output interface includes an interface for sending the received user instruction to the smart TV 200. In some embodiments, it may be an infrared interface or a radio frequency interface. For example, in the case of an infrared signal interface, the user input instruction needs to be converted into an infrared control signal according to the infrared control protocol, and sent to the smart TV 200 via the infrared sending module. For another example: in the case of a radio frequency signal interface, a user input instruction needs to be converted into a digital signal, and then modulated according to the radio frequency control signal modulation protocol, and then sent to the smart TV 200 by the radio frequency transmitting terminal.

[0098] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an output interface. The control device 100 is configured with a communication interface 130, such as: WiFi, Bluetooth, NFC and other modules, which can encode user input commands through WiFi protocol, or Bluetooth protocol, or NFC protocol, and send to smart TV 200.

[0099] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 200 under the control of the controller 110. The memory 190 can store various control signal instructions input by the user.

[0100] The power supply 180 is used to provide operating power support for each element of the control device 100 under the control of the controller 110. Can battery and related control circuit.

[0101] Figure 4 Exemplarily shows a functional configuration diagram of the smart TV 200 according to an exemplary embodiment. Such as Figure 4 As shown, the memory 290 is used to store an operating system, application programs, content, user data, etc., under the control of the controller 210, execute the system operation of driving the smart TV 200 and respond to various operations of the user. The memory 290 may include volatile and/or non-volatile memory.

[0102] The memory 290 is specifically used to store operating programs that drive the controller 210 in the smart TV 200, and store various applications built in the smart TV 200, various applications downloaded by users from external devices, and various graphical users related to the applications Interface, and various objects related to the graphical user interface, user data information, and various internal data supporting applications. The memory 290 is used to store system software such as OS kernel, middleware, and applications, as well as to store input video data and audio data, and other user data.

[0103] The memory 290 is specifically used to store driver programs and related data such as the audio and video processors 260-1 and 260-2, the display 280, the communication interface 230, the tuner and demodulator 220, and the input/output interface of the detector 240.

[0104] In some embodiments, the memory 290 may store software and/or programs. The software programs used to represent an operating system (OS) include, for example, a kernel, middleware, application programming interface (API), and/or application programs. Exemplarily, the kernel may control or manage system resources, or functions implemented by other programs (such as the middleware, API, or application program), and the kernel may provide interfaces to allow middleware and APIs, or applications to access the controller , In order to achieve control or management of system resources.

[0105] For example, the memory 290 includes a broadcast receiving module 2901, a channel control module 2902, a volume control module 2903, an image control module 2904, a display control module 2905, an audio control module 2906, an external command recognition module 2907, a communication control module 2908, and an optical receiver Module 2909, power control module 2910, operating system 2911, and other application programs 2912, browser module, etc. The controller 210 executes various software programs in the memory 290 such as: broadcast and television signal reception and demodulation function, TV channel selection control function, volume selection control function, image control function, display control function, audio control function, external command Recognition function, communication control function, optical signal receiving function, power control function, software control platform supporting various functions, browser function and other applications.

[0106] Figure 5a Exemplarily shows a configuration block diagram of the software system in the smart TV 200 according to an exemplary embodiment.

[0107] Such as Figure 5a As shown in the figure, the operating system 2911 includes operating software for processing various basic system services and performing hardware-related tasks, and serves as a medium for data processing completed between application programs and hardware components. In some embodiments, part of the operating system kernel may include a series of software to manage the hardware resources of the display device and provide services for other programs or software codes.

[0108] In some other embodiments, part of the operating system kernel may include one or more device drivers, and the device drivers may be a set of software codes in the operating system to help operate or control devices or hardware associated with the display device. The drive may contain code to manipulate video, audio, and/or other multimedia components. Examples include displays, cameras, Flash, WiFi, and audio drivers.

[0109] Among them, the accessibility module 2911-1 is used to modify or access the application program, so as to realize the accessibility of the application program and the operability of its display content.

[0110] The communication module 2911-2 is used to connect with other peripherals via related communication interfaces and communication networks.

[0111] The user interface module 2911-3 is used to provide objects for displaying the user interface, which can be accessed by various applications and can realize user operability.

[0112] The control application 2911-4 is used for controllable process management, including runtime applications.

[0113] The event transmission system 2914 can be implemented in the operating system 2911 or in the application 2912. In some embodiments, it is implemented in the operating system 2911 on the one hand and implemented in the application 2912 at the same time to monitor various user input events. , According to the identification results of various events or sub-events, it will implement one or more sets of predefined operation processing procedures.

[0114] Among them, the event monitoring module 2914-1 is used to monitor input events or sub-events of the user input interface.

[0115] Event recognition module 2914-1, used to input the definition of various events to various user input interfaces, recognize various events or sub-events, and transmit them to the processing to execute the corresponding one or more groups of processing programs .

[0116] Among them, the event or sub-event refers to the input detected by one or more sensors in the smart TV 200 and the input of an external control device (such as the control device 100). Such as: various sub-events of voice input, gesture input of gesture recognition, and sub-events of remote control button command input of control equipment, etc. For example, one or more sub-events in the remote control include various forms, including but not limited to one or a combination of pressing up/down/left/right/, confirming keys, and pressing keys. And the operation of non-physical buttons, such as move, hold, release, etc.

[0117] The interface layout manager 2913 directly or indirectly receives the user input events or sub-events monitored by the event transmission system 2914, and is used to update the layout of the user interface, including but not limited to the position of the controls or sub-controls in the interface, and the container The size or position, level, etc. of the interface layout are related to various execution operations.

[0118] Such as Figure 5b As shown in, the application layer 2912 contains various applications that can also be executed on the smart TV 200. The application program may include but is not limited to one or more application programs, such as: live TV application, video on demand application, media center application, application center, game application, etc.

[0119] Live TV applications can provide live TV through different sources. For example, a live TV application can provide a TV signal using input from cable TV, wireless broadcasting, satellite services, or other types of live TV services. And, the live TV application can display the video of the live TV signal on the smart TV 200.

[0120] Video-on-demand applications can provide videos from different storage sources. Unlike live TV applications, VOD provides video display from certain storage sources. For example, video on demand can come from the server side of cloud storage, and from the local hard disk storage that contains stored video programs.

[0121] Media center applications can provide various multimedia content playback applications. For example, the media center can provide services that are different from live TV or video on demand, and users can access various images or audio through the media center application.

[0122] Application center, can provide storage of various applications. The application program may be a game, an application program, or some other application program that is related to a computer system or other equipment but can be run on a smart TV. The application center can obtain these applications from different sources, store them in the local storage, and then run on the smart TV 200.

[0123] As mentioned above, the TV (for example, the smart TV 200) has powerful functions and many interface interactions. There is a certain degree of complexity in controlling the smart TV through the remote control. For the elderly or children, the smart TV cannot be controlled quickly and accurately. , The control efficiency of smart TV is low.

[0124] In order to solve the above technical problems, embodiments of the present invention provide a remote control method for a smart TV, which allows a remote user to intuitively obtain the current state of the smart TV that needs to be controlled, and remotely control the smart TV. Improve the control efficiency of smart TVs. For example, the remote user may be a parent or young person who has certain operating experience. The remote user may control the smart TV at home to provide help for the elderly or children at home.

[0125] To figure 1 The scenario shown is taken as an example for description. The terminal device (for example, the mobile terminal 300) can realize the remote control of the smart TV 200 through the remote control method of the smart TV in the embodiment of the present invention, improve the control efficiency of the smart TV, and enhance the user's use Experience. The following embodiments illustrate specific scenarios with examples.

[0126] Wherein, the terminal equipment may be a personal computer (Personal Computer, abbreviated as: PC) or a mobile terminal, etc. The mobile terminal may also be called a user equipment (User Equipment, abbreviated as: UE), an access terminal, a user unit, a user station, Mobile station, mobile station, user terminal, terminal, wireless communication device, user agent or user device. The mobile terminal can be a smart phone, a cellular phone, a cordless phone, a tablet computer, a personal digital assistant (PDA) device, a handheld device with wireless communication function or other processing devices connected to a wireless modem, a vehicle-mounted device, Wearable equipment, etc. In the embodiment of the present invention, the terminal device has an interface for communicating with a cellular network and/or a wireless local area network (Wireless Local Area Networks, WLAN for short).

[0127] For the specific implementation, refer to the explanation of the following embodiments.

[0128] Figure 6A This is an interactive flowchart of a remote control method for a smart TV in an embodiment of the present invention. The terminal device involved in this embodiment may be any of the above-mentioned terminal devices, such as Figure 6A As shown, the method of this embodiment may include:

[0129] Step 101: In response to the user's operation, the terminal device sends first screenshot request information, where the first screenshot request information carries first identification information, and the first identification information is configured to enable the smart TV to identify the first screenshot request information according to the first identification information The corresponding screenshot.

[0130] In an achievable manner, the terminal device can receive a user's trigger and generate a first signal for requesting to start the remote control.

[0131] Wherein, when the terminal device displays a user interface, it can receive a user's trigger and generate a first signal for requesting to turn on remote control. The user's trigger can be a click operation on a certain control on the terminal device's user interface. A signal may be a signal for clicking on the control corresponding to the remote control request. The click can be generated by the user's finger, stylus, or other control objects that can be detected by the touch screen.

[0132] As an example, please refer to Figure 6B , After the user opens the preset application, the terminal device first displays Figure 6B The first user interface 61 shown on the left, the first user interface 61 includes a status bar 612, a navigation bar 613, and a content view 611, where the status bar 612 is used to present the signal, time, power and other information of the terminal device itself , Located at the top of the entire first user interface, the navigation bar 613 can also be called a title bar, which is used to display the title (for example, "my"). Below the status bar, the content view 611 is used to display various information. The embodiment takes a content view in the form of a list as an example for illustration. The content view may include one or more column items. Each item in the content view may be in the form of a single picture or text, or a combination of pictures and text. For example, such as Figure 6B As shown, each item is in text form, for example, "My Shopping", "Remote Monitoring" and so on. Each column will be distinguished by a dividing line, and it is possible to display only the column without setting a dividing line. Each column in the list is set as a selection control. For example, when the user clicks on the corresponding position of the "Play History" text, the control is triggered and enters the interface corresponding to the control. The interface corresponding to the "Play History" control is It is configured to display the user's viewing history; when the user's finger clicks on the selection control corresponding to the "remote monitoring" text, the terminal device is triggered to generate the first signal.

[0133] The terminal device responds to the first signal, and the terminal device sends first screen capture request information to the smart TV corresponding to the first signal. The first screen capture request information carries first identification information, and the first identification information may be time. Any one or a combination of stamp, random number, or other identification information, the first identification information is used to uniquely identify the file (for example, a screenshot), for example, the first identification information may be a timestamp and a random number, The random number can be a 5-digit random number. The terminal device may send the first screen capture request information directly to the smart TV through the local area network, or send the first screen capture request information to the smart TV through a server. For example, the server may be a single server or include an interconnection server and a message forwarding server. Wherein, the interconnection server is connected to the message forwarding server, and the message forwarding server is connected to the smart TV. The terminal device may first send the first screenshot request information to the interconnection server, and the interconnection server sends the first screenshot request information to the message forwarding server, The message forwarding server forwards the first screen capture request information to the smart TV.

[0134] In another implementation manner, the terminal device can directly send the first screen capture request information in response to the user's operation. After receiving the user's operation, the terminal device directly obtains the current system time of the terminal device, and according to the current system time of the terminal device And a random number, or the current system time of the terminal device and a unique identifier that characterizes the terminal device, to generate the first screen capture request message. The first screen capture request information includes the time and random number of the current system of the terminal device, or the time of the current system of the terminal device and a unique identifier that characterizes the terminal device. This can simplify the software process and improve system efficiency.

[0135] In some embodiments, the user operation corresponding to the first screenshot request information is the user's first operation.

[0136] Step 102: The smart TV intercepts the current display interface of the smart TV in response to the first screenshot request information, generates a first screenshot, and uploads the first screenshot to the image server.

[0137] The smart TV receives the first screen capture request information, and in response to the first screen capture request information, the smart TV captures the current display interface of the smart TV, names the screenshot of the current display interface with the first identification information, and The first screenshot generated is uploaded to the image server. The image server may generate a Uniform Resource Locator (URL|) corresponding to the first identification information, and store the first screenshot. The image server of the embodiment of the present application can be used to store screenshots of the smart TV display interface at each moment.

[0138] Step 103: The terminal device obtains a first screenshot from the image server according to the first identification information, and displays the first screenshot.

[0139] The terminal device may obtain the URL corresponding to the first identification information from the image server according to the first identification information, and obtain the first screenshot according to the URL. The first screenshot is used to display the current state of the smart TV so that the user Based on the current status, the smart TV is remotely operated and controlled. The terminal device can display the first screenshot on the display screen. In some embodiments, the terminal device may send polling information containing the first identification information to the image server. The server feeds back to the terminal device according to the polling information, and the terminal device may also send the first screenshot request information to the image server at the same time. The first instruction containing the first identification information, the image server continuously matches the screenshots corresponding to the first identification information in the first instruction in the uploaded images (for example, the screenshot with the name of the first identification information), and the screenshot or The URL corresponding to the screenshot is sent to the terminal device.

[0140] In an achievable manner, the terminal device may send the first identification information to the image server, and the image server obtains the URL corresponding to the first identification information according to the first identification information, obtains a screenshot based on the URL, and returns the screenshot to the terminal device.

[0141] Take the above example for further illustration, please refer to Figure 6B , The terminal device responds to the first signal, the terminal device switches the currently displayed user interface, and displays such as Figure 6B The second user interface 62 shown on the right, where the second user interface 62 may include a status bar 621, a navigation bar 622, a content view 623, and a button 624, the content view 623 may be in the form of a collection view, and the information is tiled Display in the form of pictures, with pictures as the theme and text as auxiliary information, such as Figure 6B The content view 623 shown on the right can display the first screenshot. When the first screenshot is not obtained, the window corresponding to the content view can display the prompt information that the screenshot of the current display interface has not been obtained or the smart TV display at the previous point in time. Screenshot of the interface. In some embodiments, the window corresponding to the content view will also display the first identifier corresponding to the screenshot while displaying the screenshot. When the first identifier includes a timestamp, the user can determine the window corresponding to the content view through the displayed first identifier. What moment is the screenshot shown. At the same time, different remote control operations can also be presented in the form of text in the second user interface, for example, "return to home page", "turn off the TV", "volume down 5" and so on. These text-presented controls correspond to different commonly used control instructions. For example, if the user selects the control of'return to homepage', the terminal device can send the first control instruction to the smart TV, and the smart TV will follow the received first control Instruction to return to the home page; the user selects the control of'volume reduction by 5', the terminal device can send a second control instruction to the smart TV, and the smart TV will perform the operation of reducing the volume by 5 according to the received second control instruction. These commonly used control commands can be adjusted according to the user's historical operations. The interactive interface also includes an input control 624. The user operates the input control 624, and the terminal device receives the voice/text input by the user. For example, the input control 624 includes a "press and hold" button 6242 and a switch button 6241. The user presses Hold this button 6242, the terminal device receives the voice input by the user through the microphone, the user clicks the switch button 6241, and the terminal device displays a text input box on the second user interface to receive the text input by the user in the text input box. Through the second user interface 62, after the remote monitoring is turned on, the terminal device can send the first screen capture request information to the smart TV. After entering the user interaction interface for displaying screenshots, the terminal device can receive the user's refresh of the user interaction interface. Control 625 to resend the screenshot request message. The user interaction interface shows the screenshot of the current display interface of the smart TV to the user, so that the user can clearly know the current state of the smart TV and perform remote control operations on the smart TV. The remote control operation can be realized by inputting the corresponding voice/text in the user interface , It can also be realized by the way that the user selects common command controls.

[0142] In this embodiment, the terminal device responds to the user's operation by sending first screenshot request information, the first screenshot request information carries first identification information, and the first identification information is configured to enable the smart TV to identify the first screenshot according to the first identification information A screenshot corresponding to the request information. The smart TV intercepts the current display interface of the smart TV in response to the first screenshot request information, generates a first screenshot, and uploads the first screenshot to the image server. The terminal device obtains the first screenshot from the image server according to the first identification information. Take a screenshot and display the first screenshot. The first screenshot is used to show the current state of the smart TV, so that the user can remotely control the smart TV based on the current state, and improve the control accuracy and efficiency of the smart TV.

[0143] In the foregoing embodiment, the terminal device may establish a one-to-one binding relationship with the smart TV, or log in the same account with a smart TV, so as to realize remote control of the smart TV through the above method. In some embodiments, the terminal device may also establish a binding relationship with multiple smart TVs, or log in to the same account with multiple smart TVs, so that remote control of multiple smart TVs can be realized by the above method. One achievable way, the smart TV that the terminal device turns on for remote control this time is the smart TV that was remotely controlled last time, and another achievable way is to respond to the terminal device and correspond to multiple smart devices at the same time (smart TV, smart gateway, etc.) , Switch to Figure 6B Before the second user interface 62 on the right, the terminal device displays as Figure 6C As shown in the third user interface 64, the third user interface 64 may include multiple selection buttons 641 of the smart TV, so that when the user clicks the corresponding button 641, switch to the second user interface of the smart TV corresponding to the button 641 62.

[0144] Figure 7A Is an interactive flowchart of another remote control method for a smart TV in an embodiment of the present invention, such as Figure 7A Shown in the above Figure 6A On the basis of the illustrated embodiment, the method of this embodiment may further include:

[0145] Step 201: The terminal device generates a remote control operation instruction in response to the user's operation.

[0146] In an achievable manner, the terminal device can receive a user's trigger and generate a second signal for sending a remote control operation instruction.

[0147] As an example, the terminal device is displaying Figure 6B The second user interface 62 on the right side can receive user input and generate a second signal for sending a remote control operation instruction. The second signal may be generated by the user clicking a control corresponding to the remote control operation instruction. The click can be generated by the user's finger, stylus, or other control objects that can be detected by the touch screen. The second signal may also be generated based on the voice/text input by the user by operating the input control 624.

[0148] For example, the user can input "return to homepage" through the input control 624, and the terminal device generates the second signal according to the user input, and sends a corresponding control instruction according to the second signal. The control instruction is used for the smart TV to perform corresponding operations. For example, the control instruction corresponding to the "return to homepage" is the first control instruction, and the smart TV performs the operation of returning to the homepage according to the first control instruction.

[0149] As an example, in response to the second signal, the terminal device may display the remote control operation instruction input by the user on the currently displayed user interface, for example, Figure 6B A display box is added to the second user interface 62 shown on the right, and the text of the remote control operation instruction input by the user is displayed in the display box. The display effect can be as follows Figure 7B Shown as Figure 7B The second user interface shown further includes a display box 1 in which the text of the remote control operation instruction is displayed, for example, "return to home page".

[0150] In other embodiments, the terminal device directly generates a remote control operation instruction in response to the user's operation, and the user's operation corresponding to the remote control operation instruction is the user's second operation. Exemplarily, the terminal device directly generates a remote control operation instruction corresponding to the "return to home page" instruction after receiving the "return to home page" instruction input by the user. This can simplify the software process and improve system efficiency.

[0151] Step 202: Identify the type of remote control operation instruction.

[0152] One achievable way is that the terminal device recognizes the type of remote control operation instruction, and the other achievable way is that the terminal device sends the remote control operation instruction to the semantic recognition server, and the semantic recognition server responds to the type of remote control operation instruction Identify it.

[0153] As an example, refer to Figure 8 The system architecture shown, such as Figure 8 As shown, the interconnection server 31 is connected to the terminal device 1, the application server 32, the semantic recognition server 33, and the message forwarding server 34. The message forwarding server 34 is also connected to the smart TV 2. The smart TV 2 can also be connected to the terminal device 1 through a local area network. . In response to the second signal, the terminal device sends the remote control operation instruction to the interconnection server 31, and the interconnection server 31 forwards the remote control operation instruction to the semantic recognition server 33. The semantic recognition server 33 recognizes the remote control operation instruction and determines the The type of remote control operation instruction is TV playback control or application function control. Among them, the TV playback control instruction refers to the instruction for the smart TV to operate and control the smart TV itself, and the application function instruction refers to the instruction that the application server can respond to and generate media content for pushing to the TV. Instructions, for example: TV playback control specifically refers to operating instructions used to control the state of the smart TV itself, such as instructions for controlling volume, instructions for switching channels, etc., application function control specifically refers to The smart TV provides operating instructions for corresponding functions, such as pushing media resources of the application server to the smart TV.

[0154] Step 203: If the type of the remote control operation instruction is a TV playback control type, send the remote control operation instruction to the smart TV, so that the smart TV performs corresponding control operations according to the remote control operation instruction.

[0155] When the type of the remote control operation instruction is a TV playback control type, the remote control operation instruction is sent to the smart TV, and the smart TV performs corresponding control operations according to the remote control operation instruction. For example, the remote control operation instruction can be sent to the smart TV through the interconnection server 31 and the message forwarding server 34. For example, the remote control operation command is to decrease the volume of the TV by 5.

[0156] Step 204: If the type of the remote control operation instruction is an application function control type, send the remote control operation instruction to the corresponding application server, so that the application server pushes the corresponding media content to the smart TV according to the remote control operation instruction.

[0157] When the type of the remote control operation instruction is the application function control type, the terminal device sends a remote control operation instruction to the corresponding application server, or the TV sends a remote control operation instruction to the server in response to the remote control operation instruction of the terminal device, and the application server The remote control operation instruction pushes the corresponding media content to the smart TV, and the smart TV plays the media content. For example, the remote control operation instruction can be sent to the application server 32 through the interconnection server 31.

[0158] In this embodiment, the terminal device receives a user's trigger and generates a first signal for requesting to start remote control. In response to the first signal, the terminal device sends first screen capture request information, and the first screen capture request information carries the first identifier Information, the smart TV intercepts the current display interface of the smart TV according to the first screenshot request information, and generates a first screenshot according to the first identification information and uploads it to the image server, the terminal device obtains the first screenshot from the image server according to the first identification information, and Display the first screenshot, the first screenshot is used to show the current state of the smart TV, so that the user can remotely control the smart TV based on the current state, the terminal device receives the user's trigger and generates a second for sending remote control operation instructions Signal to identify the type of remote control operation instruction. If the type of the remote control operation instruction is a TV playback control type, the remote control operation instruction is sent to the smart TV so that the smart TV performs corresponding control operations according to the remote control operation instruction, If the type of the remote control operation instruction is the application function control type, the remote control operation instruction is sent to the corresponding application server, so that the application server pushes the corresponding media content to the smart TV according to the remote control operation instruction, thereby realizing the remote control of the smart TV Control, improve the control efficiency of smart TV.

[0159] Figure 9A This is an interaction flowchart of another remote control method for a smart TV in an embodiment of the present invention. This embodiment relates to the second screen capture request information, which is different from the first screen capture request information. The second screen capture request information is used for smart TV acquisition The second screenshot, the second screenshot is the result of remote control of the smart TV based on the above first screenshot to know whether the remote operation is successful, such as Figure 9A Shown in the above Figure 7A On the basis of the illustrated embodiment, the method of this embodiment may further include:

[0160] Step 301: The terminal device sends second screenshot request information. The second screenshot request information is used to enable the smart TV to obtain a second screenshot after responding to the remote operation instruction, and the second screenshot request information carries second identification information.

[0161] The terminal device can send the second screenshot request message after sending the remote control operation instruction, or while sending the remote control instruction, so that the terminal device can obtain a new screenshot image to show the screenshot of the smart TV after responding to the remote operation instruction Or a screenshot of the new moment. The user can use the new screenshot image displayed on the terminal device to determine the next step.

[0162] In some embodiments, the second screen capture request may be triggered by the terminal device after receiving a refresh operation from the user. In other embodiments, the user sends the second screen capture request while sending the remote operation control instruction. After the smart TV responds to the TV playback control instruction or receives the content issued by the server in response to the application function instruction, it responds to the second screen capture request to take a screenshot and upload it.

[0163] The terminal device may send the second screen capture request information to the smart TV through the local area network; or, the terminal device may send the second screen capture request information to the smart TV through the interconnection server 31 and the message forwarding server 34. The second screenshot request information is used to request the smart TV to re-take a screenshot of the current display interface of the smart TV, and generate a second screenshot according to the second identification information and upload it to the image server;

[0164] Step 302: The smart TV re-intercepts the current display interface of the smart TV according to the second screen capture request information, and generates a second screenshot according to the second identification information and uploads it to the image server. The second screenshot is used to display the remote control operation instruction. Operation result.

[0165] The smart TV receives the second screenshot request information, and in response to the second screenshot request information, the smart TV re-takes the current display interface of the smart TV to generate a second screenshot, and names the second screenshot with the second identification information , Upload to the image server. The image server may generate a URL| corresponding to the second identification information, and store the second screenshot, which is used to display the operation result of the above-mentioned remote control operation instruction.

[0166] Step 303: The terminal device obtains a second screenshot from the image server according to the second identification information, and displays the second screenshot, which is used to display the operation result of the remote control operation instruction.

[0167] The terminal device may obtain a URL corresponding to the second identification information from the image server according to the second identification information, and obtain the second screenshot according to the URL, and the second screenshot is used to display the result of the remote control instruction of the smart TV. The terminal device can display the second screenshot on the display screen, so that the user can determine whether the remote operation is successful.

[0168] Take the above example for further illustration, please refer to Figure 9B , The terminal device responds to the remote control operation instruction, the terminal device Figure 6B A display box is added to the second user interface 62 shown on the right, and the command sending status is displayed in the display box. For the display effect, see Figure 9B In the second user interface shown on the left, a display box 2 is displayed on the second user interface, and the text of the command sending status is displayed in the display box 2, for example, the text "is sending the command to the TV." After the image server obtains the screenshot corresponding to the second identification information, it displays on the touch screen such as Figure 9B In the second user interface 62 shown on the right, a screenshot corresponding to the second identification information is displayed in the content view of the second user interface 62, namely Figure 9B The screenshot displayed in the window corresponding to the content view shown on the left is updated to the screenshot corresponding to the second identification information. In some embodiments, you can also Figure 9B The screenshot shown in the window corresponding to the content view shown on the left is updated to the smart TV screen capture status, such as Figure 9B Shown in the middle, and then Figure 9B The screenshot status of the smart TV screen displayed in the window corresponding to the content view shown in the middle is updated to the screenshot corresponding to the second identification information.

[0169] In this embodiment, the second screen capture request information is sent through the terminal device. The second screen capture request information is used to make the smart TV obtain a second screenshot after responding to the remote operation instruction. The second screen capture request information carries the second identification information, and the smart TV is based on The second screenshot request information re-takes the current display interface of the smart TV, and generates a second screenshot according to the second identification information and uploads it to the image server. The second screenshot is used to display the operation result of the remote control operation instruction. The second identification information obtains a second screenshot from the image server, and displays the second screenshot, which is used to display the operation result of the remote control operation instruction and improve the control efficiency of the smart TV.

[0170] Picture 10 Is an interactive flowchart of another remote control method for a smart TV in an embodiment of the present invention, such as Picture 10 Shown in the above Figure 6A or Figure 7A or Figure 9A On the basis of the illustrated embodiment, the method of this embodiment may further include:

[0171] Step 401: The terminal device sends device query request information in response to the user's operation, and the device query request information is used to obtain the name of the currently available device.

[0172] In an achievable manner, the terminal device receives the user's operation and generates a third signal, and in response to the third signal, the terminal device sends the device query request information.

[0173] The method steps of this embodiment can be before any of the above embodiments. When the terminal device displays a user interface, it can receive a user trigger and generate a third signal for opening the remote monitoring interface. The third signal can be click and Remotely monitor the corresponding controls. The click can be generated by the user's finger, stylus, or other control objects that can be detected by the touch screen. The terminal device may send a device query request to the interconnection server to obtain the names of currently available devices, for example, the names of devices such as a smart TV in a bedroom at home and a smart TV in a living room.

[0174] In some embodiments, the terminal device directly sends the device query request information in response to the received user operation, and at the same time triggers a signal to open the remote monitoring interface. This can simplify the software process and improve system efficiency.

[0175] Step 402: The currently available device name sent by the interconnection server to the terminal device, and the available device name is displayed in a list form on the remote monitoring interface displayed on the terminal device.

[0176] The currently available device name is used to request remote control of the corresponding smart TV.

[0177] The terminal device can select a device from the currently available device names to perform the remote control described in the foregoing embodiments. For example, the terminal device can display Figure 6C In the third user interface 64 shown, the selection buttons 641 of each available device are displayed on the third user interface 64 to provide the user with a selection of available devices.

[0178] In this embodiment, the terminal device can respond to the user's operation by sending device query request information to the interconnection server. The device query request information is used to obtain the currently available device name. The currently available device name sent by the interconnection server to the terminal device is The available device name is used to request remote control of the corresponding smart TV, so as to realize the flexible selection of the smart TV for remote control and effective remote control of the smart TV.

[0179] Exemplary, refer to Picture 11 The terminal device can also receive a user’s trigger on the second user interface 62 and generate a second signal for sending a remote control operation instruction, for example, input a voice through the button 624 of the second user interface 62, and the voice is "Turn off the TV ", the terminal device can send the remote control operation instruction to turn off the TV to the TV through the method of the above-mentioned embodiment of the application, so that the TV performs the operation of turning off the TV, and the terminal device displays the display frame 3 on the second user interface 62. The text of the remote control operation instruction is displayed in box 3, for example, "turn off the TV". Such as Picture 11 As shown in the second user interface in the middle, the second user interface 62 may also display a display box 4, and the display box 4 displays the text of the instruction sending status, for example, "Sending instruction to TV". In some embodiments, you can also Picture 11 The screenshot shown in the window corresponding to the content view shown on the left is updated to the TV screen capture state, as Picture 11 As shown in the middle, after the smart TV responds to the remote operation instruction to turn off the TV, the terminal device can Picture 11 The content view shown in the middle shows a display box 5, which can display the text of the current status of the TV, for example, "Your TV is turned off...". Of course, the terminal device can also Picture 11 The screenshot status of the TV screen displayed in the window corresponding to the content view shown in the middle is updated to display the text "No TV screenshot information obtained".

[0180] Picture 12 Is a schematic structural diagram of a terminal device according to an embodiment of the present invention, such as Picture 12 As shown, the terminal device of this embodiment may include: a receiving module 11, a processing module 12, and a sending module 13. The processing module 12 is configured to respond to the user operation received by the receiving module 11 and send the first Screen capture request information, the first screen capture request information carries first identification information, and the first identification information is used to enable the smart TV to identify the screenshot corresponding to the first screen capture request information according to the first identification information. A screenshot request information is used to make the smart TV capture the current display interface of the smart TV, and upload the first screenshot generated to the image server according to the first identification information; the processing module 12 is also used to Polling the image server according to the first identification information, and receiving and displaying the first screenshot of the image server in response to the polling feedback.

[0181] Optionally, the processing module 12 is further configured to receive user operations through the receiving module 11 and generate remote control operation instructions of the TV playback control type, where the remote control operation instructions of the TV playback control type are responsive to the smart TV, Instructions for operating and controlling the smart TV itself; the processing module 12 is also used to send a second screenshot request through the sending module 13, and the second screenshot request information is used to make the smart TV respond to the remote control of the TV playback control After the operation instruction, a second screenshot is obtained. The second screenshot request information carries second identification information, and the second identification information is used to enable the smart TV to identify the second screenshot; the processing module 12 is also used to poll according to the second identification information The image server receives and displays the second screenshot of the image server in response to the polling feedback through the receiving module 11.

[0182] Optionally, the processing module 12 is further configured to receive user operations through the receiving module 11 and generate remote control operation instructions for application function instructions. The remote control operation instructions for the application function instructions refer to the application server can respond. And generate instructions for pushing media content to the TV; the processing module 12 is also used to send a second screenshot request through the sending module 13, and the second screenshot request information is used to make the smart TV respond to the push of the application server After the media content, a second screenshot is obtained. The second screenshot request information carries second identification information, and the second identification information is used to enable the smart TV to identify the second screenshot; the processing module 12 is also used to poll according to the second identification information The image server receives and displays the second screenshot of the image server in response to the polling feedback through the receiving module 11.

[0183] Optionally, the processing module 12 may control the sending module 13 to send the first screenshot request information or the second screenshot request information to the smart TV via a local area network; or, the processing module 12 may control the sending module 13 to forward the message via an interconnect server The server sends the first screen capture request information or the second screen capture request information to the smart TV, and a long connection is established between the message forwarding server and the smart TV.

[0184] Optionally, the processing module 12 is further configured to send device query request information through the sending module 13 in response to a user's operation before sending the first screen capture request information, where the device query request information is used to obtain the name of the currently available device; The module 11 is also used to receive the currently available device name, and the currently available device name is used to request remote control of the corresponding smart TV.

[0185] Optionally, the first identification information includes a current timestamp.

[0186] The terminal device of this embodiment may be used to execute the technical solution executed by the terminal device in the foregoing method embodiment, and its implementation principles and technical effects are similar, and will not be repeated here.

[0187] Figure 13 Is a schematic structural diagram of another terminal device according to an embodiment of the present invention, such as Figure 13 As shown, the apparatus of this embodiment may include: a memory 21 and a processor 22, where the memory 21 is used to store a computer program, and the processor 22 is used to execute the computer program, so as to implement the methods described in each of the foregoing embodiments.

[0188] The device in this embodiment can be used to execute the technical solution of the terminal device in the foregoing method embodiment, and its implementation principles and technical effects are similar, and will not be repeated here.

[0189] Figure 14 Is a schematic structural diagram of a smart TV according to an embodiment of the present invention, such as Figure 14 As shown, the smart TV of this embodiment may include: a receiving module 31, a processing module 32, and a sending module 33. The receiving module 31 is configured to receive first screenshot request information, and the first screenshot request information carries a first identifier. Information, the first identification information is used for the smart TV to identify the screenshot corresponding to the first screenshot request information according to the first identification information; the processing module 32 is used to intercept the smart TV according to the first screenshot request information And generate a first screenshot according to the first identification information; the processing module 32 is also configured to upload the first screenshot to the image server through the sending module 33.

[0190] Optionally, the receiving module 31 is also used to receive remote control operation instructions of the TV playback control type, and perform corresponding control operations according to the remote control operation instructions; or, the processing module 32 is also used to receive and play applications through the receiving module 31 The media content pushed by the server is pushed by the application server to the smart TV according to the remote control operation instruction of the application function control class.

[0191] Optionally, the receiving module 31 is further configured to receive second screenshot request information, where the second screenshot request information is used to enable the smart TV to obtain a second screenshot after responding to a remote control operation instruction, and the second screenshot request information carries Second identification information; the processing module 32 is configured to, according to the second screenshot request information, after responding to a remote control operation instruction, re-intercept the current display interface of the smart TV, and generate a second screenshot according to the second identification information , Upload the second screenshot to the image server through the sending module 33, and the second screenshot is used to display the operation result of the remote control operation instruction.

[0192] The smart TV of this embodiment can be used to implement the technical solution of the smart TV in the foregoing method embodiment, and its implementation principles and technical effects are similar, and will not be repeated here.

[0193] An embodiment of the present invention also provides a computer storage medium, where the computer storage medium is used to store a computer program, and the computer program is used to implement the method described in any of the foregoing embodiments when the computer program is executed. Its realization principle and technique and technical effect are similar, so I won't repeat it here.

[0194] In addition, the terms "including" and "having" and any variations of them are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or device that includes a series of steps or units is not necessarily limited to the clearly listed Those steps or units may include other steps or units that are not clearly listed or are inherent to these processes, methods, products, or equipment.

[0195] A person of ordinary skill in the art can understand that all or part of the steps in the foregoing method embodiments can be implemented by a program instructing relevant hardware. The aforementioned program can be stored in a computer readable storage medium. When the program is executed, it executes the steps including the foregoing method embodiments; and the foregoing storage medium includes: ROM, RAM, magnetic disk, or optical disk and other media that can store program codes.

[0196] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, but not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand: It is still possible to modify the technical solutions described in the foregoing embodiments, or equivalently replace some or all of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the technical solutions of the embodiments of the present invention. range.