A method and apparatus for controlling display of a slave device

Abstract

The application relates to the technical field of display, and provides a method and device for controlling display of a slave device, wherein a control application on a master device is authenticated by a server device, a unique control ID is allocated to the control application after the authentication is passed, the control ID is sent to the master device, the control ID has a validity period, and if the control ID is invalid, the control application is re-authenticated, so that the validity of the control ID is ensured. After the master device obtains the control ID allocated to the control application by the server device, a corresponding control relationship is generated according to a registration ID of at least one slave device stored in a device table, and a control instruction is sent to the at least one slave device according to the control relationship, so that the at least one slave device synchronously displays content displayed by the control application, thereby realizing reasonable control of the slave device and combining the advantages of the master device and the slave device.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a method and apparatus for controlling the display of a slave device. Background Technology

[0002] When displaying videos or images in a traditional way, there is a lack of perception and imagination for some abstract content. With the development of Virtual Reality (VR) and Augmented Reality (AR) technologies, immersive experiences are gradually spreading to various industries in modern life, such as clothing, live streaming, and gaming.

[0003] For some special industries (such as education), a one-to-many control method is often used. This requires a controllable demonstration device to control multiple VR / AR devices to display demonstration content, thereby achieving immersive demonstration teaching.

[0004] However, there is currently no reasonable control method for controlling the display of VR / AR devices. Summary of the Invention

[0005] This application provides a method and apparatus for controlling the display of a slave device, so as to accurately control the display of the slave device.

[0006] In a first aspect, embodiments of this application provide a master control device, which is equipped with a target control application and includes an input / output interface, a memory, and a controller.

[0007] The memory stores a software control program, and the controller performs the following operations according to the software control program:

[0008] The input / output interface is used to obtain a valid control ID for the target control application. The control ID is assigned by the server device after the target control application has been authenticated.

[0009] Based on the control ID and the registration ID of at least one slave device associated with the target control application, a control relationship corresponding to the target control application is generated;

[0010] According to the control relationship, a control command is sent to the at least one slave device so that the at least one slave device synchronously displays the content displayed by the target control application according to the control command.

[0011] Secondly, embodiments of this application provide a server-side device, including a memory and a processor. The memory stores computer program instructions, and the processor performs the following operations according to the computer program instructions stored in the memory:

[0012] The system receives an authentication request sent by the main control device, which has a target control application installed on it. The authentication request carries the attribute information of the target control application and is sent by the main control device when it detects that the target control application needs to be authenticated.

[0013] Based on the attribute information, the target control application is authenticated, and a control ID is assigned to the target control application after successful authentication.

[0014] The master control device sends authentication information carrying the control ID assigned to the target application, so that the master control device generates a control relationship corresponding to the target control application based on the control ID and the registration ID of at least one slave control device associated with the target control application, and sends control instructions to the at least one slave control device according to the control relationship. The control instructions are used to control the at least one slave control device to synchronously display the content displayed by the target control application.

[0015] Thirdly, embodiments of this application provide a method for controlling the display of a slave device, including:

[0016] Obtain a valid control ID for the target control application, wherein the control ID is assigned by the server device after the target control application has been authenticated;

[0017] Based on the control ID and the registration ID of at least one slave device associated with the target control application, a control relationship corresponding to the target control application is generated;

[0018] According to the control relationship, a control command is sent to the at least one slave device so that the at least one slave device synchronously displays the content displayed by the target control application according to the control command.

[0019] Fourthly, embodiments of this application provide a method for controlling the display of a slave device, comprising:

[0020] The system receives an authentication request sent by the main control device, which has a target control application installed on it. The authentication request carries the attribute information of the target control application and is sent by the main control device when it detects that the target control application needs to be authenticated.

[0021] Based on the attribute information, the target control application is authenticated, and a control ID is assigned to the target control application after successful authentication.

[0022] The master control device sends authentication information carrying the control ID assigned to the target application, so that the master control device generates a control relationship corresponding to the target control application based on the control ID and the registration ID of at least one slave control device associated with the target control application, and sends control instructions to at least one slave control device according to the control relationship. The control instructions are used to control the at least one slave control device to synchronously display the content displayed by the target control application.

[0023] In the above embodiments of this application, the master control device is equipped with a target control application. By obtaining the valid control ID assigned to the target control application after the server device has authenticated it, and combining it with the registration ID of at least one slave control device associated with the target control application, a control relationship is generated. Based on the generated control relationship, control commands can be accurately sent to at least one associated slave control device so that at least one slave control device can synchronously display the content displayed by the target control application, thereby achieving reasonable control over the content displayed by the slave control device. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 An exemplary diagram illustrating an application scenario provided in an embodiment of this application is shown;

[0026] Figure 2 An exemplary structural diagram of a master control device provided in an embodiment of this application is shown;

[0027] Figure 3 An exemplary diagram illustrating the control ID allocation provided in an embodiment of this application is shown;

[0028] Figure 4 An exemplary flowchart of the control ID allocation method provided in an embodiment of this application is shown;

[0029] Figure 5 An exemplary flowchart of a method for controlling the display provided in an embodiment of this application is shown;

[0030] Figure 6 An exemplary diagram illustrates a one-to-one control method provided in an embodiment of this application;

[0031] Figure 7 An exemplary diagram illustrates a one-to-many control method provided in an embodiment of this application;

[0032] Figure 8 An exemplary diagram illustrates a many-to-one control method provided in an embodiment of this application;

[0033] Figure 9 An exemplary diagram illustrates a many-to-many control method provided in an embodiment of this application;

[0034] Figure 10 An exemplary diagram of a one-to-many control display interface provided in an embodiment of this application is shown;

[0035] Figure 11 An exemplary diagram illustrates a local area network control and display process provided in an embodiment of this application;

[0036] Figure 12A An exemplary diagram illustrates a wide area network control and display process provided in an embodiment of this application;

[0037] Figure 12B An exemplary diagram illustrates another wide area network control and display process provided in an embodiment of this application;

[0038] Figure 13 An exemplary flowchart illustrates a complete method for controlling the display of a slave device provided in an embodiment of this application;

[0039] Figure 14 An exemplary structural diagram of the main control device provided in an embodiment of this application is shown;

[0040] Figure 15 An exemplary structural diagram of the server device provided in an embodiment of this application is shown. Detailed Implementation

[0041] Interactive whiteboards and smart TVs, as the most common large-screen display devices in the smart ecosystem, are an indispensable part of the smart ecosystem chain. The larger the screen, the larger the area for displaying content, the richer the information displayed, and the clearer the details. VR / AR devices can provide people with an immersive experience, enhancing perception and imagination. In the education sector, combining the large-screen display of traditional display devices with the immersive display of VR / AR devices can help students understand abstract content and improve learning efficiency.

[0042] In view of this, embodiments of this application provide a method and apparatus for controlling the display of slave devices, wherein a large-screen display device such as an electronic whiteboard or smart TV serves as the master control device, and a VR / AR device serves as the slave control device. The master control device is equipped with a control application for controlling the slave devices. By authenticating the control application, the ID assigned to the control application after successful authentication is combined with the ID of the relevant slave device to form a unique control relationship. According to the control relationship, one or more slave devices are simultaneously controlled to display the same content, such as playing or pausing the same video, or entering the same virtual scene.

[0043] The embodiments of this application are described in detail below with reference to the accompanying drawings.

[0044] Figure 1 This is a schematic diagram illustrating an application scenario provided in the embodiments of this application; such as Figure 1 As shown, the master control device 100 and the slave control device 300 communicate through the server 200. The master control device 100 is equipped with a control application 101. The server 200 authenticates the control application 101 and assigns it a unique control ID after successful authentication. The server 200 generates a corresponding control relationship by combining the IDs of at least one slave control device 300 (including but not limited to VR devices 301-303) associated with the control application 101, so as to control the synchronous display of at least one slave control device.

[0045] Among them, server 200 can be a cloud server, server cluster or other device, used to authenticate the main control device and forward messages.

[0046] Taking a smart TV as the main control device as an example, Figure 2 An exemplary hardware structure diagram of the main control device provided in an embodiment of this application is shown.

[0047] In some embodiments, the smart TV includes at least one of the following: controller 250, tuner / demodulator 210, communicator 220, detector 230, input / output interface 255, display 275, audio output interface 285, memory 260, power supply 290, user interface 265, and external device interface 240.

[0048] In some embodiments, the display 275 is a component for receiving image signals output from a first processor and for displaying video content and images as well as a menu control interface.

[0049] In some embodiments, the display 275 includes a display screen assembly for presenting an image and a driving assembly for driving the image display.

[0050] In some embodiments, the displayed video content may originate from broadcast television content, or from various broadcast signals received via wired or wireless communication protocols. Alternatively, it may display various image content received from a network server via network communication protocols.

[0051] In some embodiments, the display 275 is used to present a user interface (UI) generated in a smart TV and used to control the smart TV.

[0052] In some embodiments, depending on the type of display 275, a driving component for driving the display may also be included.

[0053] In some embodiments, the display 275 is a projection display, and may also include a projection device and a projection screen.

[0054] In some embodiments, the communicator 220 is a component for communicating with external devices or external servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi chip, a Bluetooth communication protocol chip, a wired Ethernet communication protocol chip, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver.

[0055] In some embodiments, the smart TV can establish a communication between the communicator 220 and the slave device 300 to send and receive control signals and data signals.

[0056] In some embodiments, the user interface 265 can be used to receive control signals such as infrared signals.

[0057] In some embodiments, detector 230 is used by a smart TV to collect signals from the external environment or to interact with the outside world.

[0058] In some embodiments, the detector 230 includes a light receiver and a sensor for collecting ambient light intensity, which can adaptively display parameter changes by collecting ambient light.

[0059] In some embodiments, the detector 230 may also include an image acquisition device, such as a camera or webcam, which can be used to acquire external environmental scenes and to acquire user attributes or user interaction gestures. It can adaptively change display parameters and recognize user gestures to achieve the function of interaction with the user.

[0060] In some embodiments, the detector 230 may also include a temperature sensor, such as by sensing ambient temperature.

[0061] In some embodiments, the smart TV can adaptively adjust the color temperature of the displayed image. For example, in a high-temperature environment, the color temperature of the smart TV image can be adjusted to a cooler tone, or in a low-temperature environment, the color temperature of the smart TV image can be adjusted to a warmer tone.

[0062] In some embodiments, the detector 230 may also be a sound collector, such as a microphone, for receiving the user's voice. Exemplarily, this may include voice signals of control commands from the user to control the smart TV, or the collection of ambient sounds to identify environmental scene types, enabling the smart TV to adapt to ambient noise.

[0063] In some embodiments, such as Figure 2 As shown, the input / output interface 255 is configured to enable data transmission between the controller 250 and other external devices (slave devices). This includes receiving video and audio signal data, or command and instruction data, from external devices.

[0064] In some embodiments, the external device interface 240 may include, but is not limited to, one or more interfaces such as an HDMI interface, an analog or high-definition component input interface, a composite video input interface, a USB input interface, and an RGB port. Alternatively, multiple interfaces may be combined to form a composite input / output interface.

[0065] In some embodiments, such as Figure 2 As shown, the tuner / demodulator 210 is configured to receive broadcast television signals via wired or wireless means, and can perform modulation and demodulation processes such as amplification, mixing, and resonance to demodulate audio and video signals from multiple wireless or wired broadcast television signals. The audio and video signals may include television audio and video signals carried in the frequency of the television channel selected by the user, as well as EPG data signals.

[0066] In some embodiments, the frequency point demodulated by the tuner 210 is controlled by the controller 250, which can issue control signals according to user selection to make the modem respond to the television signal frequency selected by the user and modulate the television signal carried at that frequency.

[0067] In some embodiments, broadcast television signals can be categorized according to different broadcasting standards, such as terrestrial broadcast signals, cable broadcast signals, satellite broadcast signals, or internet broadcast signals. Alternatively, they can be categorized according to different modulation types, such as digital modulation signals or analog modulation signals. Or, they can be categorized according to different signal types, such as digital signals or analog signals.

[0068] In some embodiments, the controller 250 and the tuner / demodulator 210 can be located in different separate devices; that is, the tuner / demodulator 210 can also be located in an external device of the main device where the controller 250 is located, such as an external set-top box. In this way, the set-top box outputs the modulated and demodulated television audio and video signal from the received broadcast television signal to the main device, and the main device receives the audio and video signal through the first input / output interface.

[0069] In some embodiments, the controller 250 controls the operation of the smart TV and responds to user operations through various software control programs stored in memory. The controller 250 can control the overall operation of the smart TV.

[0070] like Figure 2 As shown, the controller 250 includes at least one of the following: Random Access Memory 251 (RAM), Read-Only Memory 252 (ROM), Video Processor 270, Audio Processor 280, Other Processors 253 (e.g., Graphics Processing Unit (GPU), Central Processing Unit (CPU) 254), Communication Interface, and Communication Bus 256. The Communication Bus connects the various components.

[0071] In some embodiments, RAM 251 is used to store temporary data of the operating system or other running programs.

[0072] In some embodiments, ROM 252 is used to store various system startup instructions.

[0073] In some embodiments, ROM 252 is used to store a basic input / output system, referred to as the Basic Input / Output System (BIOS). It is used to perform power-on self-test (POST), initialization of various functional modules within the system, drivers for the system's basic inputs / outputs, and to boot the operating system.

[0074] In some embodiments, upon receiving a power-on signal, the smart device power-on begins, the CPU executes the system startup instructions in ROM 252, and copies temporary data of the operating system stored in memory to RAM 251 to facilitate the startup or operation of the operating system. After the operating system has started, the CPU copies temporary data of various applications from memory to RAM 251, and then facilitates the startup or operation of various applications.

[0075] In some embodiments, the CPU processor 254 is configured to execute operating system and application instructions stored in memory, and to execute various applications, data, and content based on various interactive instructions received from external input, so as to ultimately display and play various audio and video content.

[0076] In some exemplary embodiments, the CPU processor 254 may include multiple processors. The multiple processors may include a main processor and one or more sub-processors. The main processor is used to perform some operations of the smart TV in a pre-power-on mode and / or to display a screen in normal mode. The one or more sub-processors are used for one operation in a standby mode or other state.

[0077] In some embodiments, the graphics processor 253 is used to generate various graphical objects, such as icons, operation menus, and graphics displayed based on user input commands. It includes a calculation unit that performs calculations based on various user input interaction commands and displays various objects according to display attributes. It also includes a renderer that renders the various objects obtained from the calculation unit, and the rendered objects are used to display on a monitor.

[0078] In some embodiments, the video processor 270 is configured to receive external video signals and perform video processing such as decompression, decoding, scaling, noise reduction, frame rate conversion, resolution conversion, and image synthesis according to the standard codec protocol of the input signal, so as to obtain a signal that can be directly displayed or played on a smart TV.

[0079] In some embodiments, the video processor 270 includes a demultiplexing module, a video decoding module, an image synthesis module, a frame rate conversion module, a display formatting module, etc.

[0080] In some embodiments, the graphics processor 253 can be integrated with the video processor or configured separately. When integrated, it can perform the processing of graphics signals output to the display. When configured separately, they can perform different functions, such as a GPU+FRC (Frame Rate Conversion) architecture.

[0081] In some embodiments, the audio processor 280 is configured to receive external audio signals, perform decompression and decoding according to the standard codec protocol of the input signals, and perform noise reduction, digital-to-analog conversion, and amplification processing to obtain a sound signal that can be played in a speaker.

[0082] In some embodiments, the video processor 270 may comprise one or more chips. The audio processor may also comprise one or more chips.

[0083] In some embodiments, the video processor 270 and the audio processor 280 may be separate chips or integrated into one or more chips together with the controller.

[0084] In some embodiments, the audio output receives sound signals output by the audio processor 280 under the control of the controller 250, such as the speaker 286, and external audio output terminals of the generating device of an external device, such as an external audio interface or headphone interface, in addition to the speaker built into the smart TV itself. It may also include a short-range communication module in the communication interface, such as a Bluetooth module for Bluetooth speaker sound output.

[0085] The power supply 290, under the control of the controller 250, provides power to the smart TV by accepting external power input. The power supply 290 can be a built-in power circuit installed inside the smart TV, or it can be an external power source installed in the smart TV, providing an external power interface.

[0086] User interface 265 is used to receive user input signals and then send the received user input signals to controller 250. The user input signals can be remote control signals received via an infrared receiver, or various user control signals received via a network communication module.

[0087] In some embodiments, the user can input user commands through a graphical user interface (GUI) displayed on the display 275, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by inputting specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0088] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user. It converts information between its internal form and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0089] The memory 260 includes various software modules for driving the smart TV. For example, the various software modules stored in the first memory include at least one of the following: a basic module, a detection module, a communication module, a display control module, a browser module, and various service modules.

[0090] In the embodiments of this application, each master control device is equipped with a control application. When the server device receives an authentication request sent by the master control device carrying the attribute information of the control application, it authenticates the control application and assigns a unique control ID to the authenticated control application.

[0091] Taking a smart TV as the main control device as an example, the following is a diagram illustrating the allocation of control IDs for the control applications installed on the main control device: Figure 3 As shown, the ID resource pool of the server device is used to store control IDs. After the server device authenticates the control application 1 installed on TV1, it sends CCID_01 to TV1. After the server device authenticates the control application 2 installed on TV2, it sends CCID_02 to TV2. After the server device authenticates the control application 3 installed on TV3, it sends CCID_03 to TV3.

[0092] It should be noted that the server-side device assigns a unique control ID to each control application, and each ID has an expiration date. If the expiration date is exceeded, the application cannot continue to be used and needs to be placed in the ID pool to wait for the next allocation or be destroyed directly.

[0093] Throughout the authentication process, the server-side device and the authentication device need to communicate over the network. Therefore, it is necessary to ensure that each master control device is connected to the network for authentication.

[0094] based on Figure 3 Allocation diagram, Figure 4 A flowchart illustrating the method for assigning fast control IDs to control applications installed on the main control device, as provided in the embodiments of this application, is shown below. Figure 4 As shown, it mainly includes the following steps:

[0095] S401: In response to the startup operation of the target control application, the master control device checks whether authentication of the target control application is required. If so, it executes S402; otherwise, no authentication is required.

[0096] In the embodiments of this application, only authenticated control applications can operate normally and control one or more slave devices. Therefore, when executing S401, the user enters the target control application through a remote control device or by clicking on the display screen, and the master control device immediately determines whether authentication of the target control application is required. For authenticated control applications, the master control device's local system stores the corresponding control ID, and the control ID has an expiration date. For unauthenticated or expired control applications, the corresponding control ID in the master control device's local system is empty.

[0097] When executing S401, the master control device checks whether the control ID corresponding to the target control application is stored locally. If it is not stored, it means that the target control application is not authenticated and needs to be authenticated. If it is stored, it checks whether the control ID corresponding to the target control application is within the validity period. If it is not, the target control application needs to be authenticated. If it exists, no authentication is required.

[0098] S402: The master control device sends an authentication request to the server device, and the authentication request carries the attribute information of the target control application.

[0099] In S402, when it is determined that the target control application needs to be authenticated, an authentication request is sent to the server device. The authentication request carries attribute information such as the package name, version number, and login account of the target control application.

[0100] S403: The server device receives the authentication request and authenticates the target control application based on the aforementioned attribute information.

[0101] In S403, based on the attribute information carried in the authentication request, it is verified whether the target control application has control permissions. If it has control permissions, the authentication of the target control application is passed.

[0102] S404: After successful authentication, the server device assigns a control ID to the target control application.

[0103] In one optional implementation, the control ID is stored in the server device as an ID pool. When executing S404, after the server authenticates the target control application, it checks whether there is a free control ID in the ID resource pool. If it does, a control ID is selected and assigned to the target control application; if it does not exist, a new control ID is generated and assigned to the target control application.

[0104] S405: The server device sends authentication information to the master device, and the authentication information carries the control ID assigned to the target control application.

[0105] In S405, after the server device assigns a control ID to the target control application, it sends the control ID along with the authentication information to the master control device.

[0106] In the embodiments of this application, after the target control application is authenticated, the server device assigns it a control ID. The master control device stores the control ID corresponding to the target control application and the validity period information of the control ID locally in the system. After detecting that the validity period of the control ID corresponding to the target control application has expired, it re-requests authentication for the target control application to ensure the validity of the control ID.

[0107] In other embodiments, if the server device determines that the target control application does not have control permissions based on the attribute information of the target control application, it will not pass the authentication of the target control application. In this case, the server device sends a response message to the master control device. The response message carries a prompt message indicating that the target application's authentication has failed. Based on this prompt message, the configuration of the target control application is changed, and after the change, the server device re-initiates an authentication request to authenticate the target control application.

[0108] The master control device controls the synchronous display of at least one slave control device associated with the target control application based on the control ID assigned after the target control application is authenticated.

[0109] Figure 5 An exemplary flowchart illustrates a method for controlling the display of a slave device provided in an embodiment of this application; as shown below. Figure 5 As shown, this process is executed by the main control device and mainly includes the following steps:

[0110] S501: Obtain a valid control ID for the target control application.

[0111] As described in the foregoing embodiments, after the target control application installed on the main control device is started, the server device assigns it a unique control ID, and this control ID is valid. Therefore, when executing S501, the main control device obtains the control ID corresponding to the target control application from the local system.

[0112] S502: Generate the control relationship corresponding to the target control application based on the control ID and the registration ID of at least one slave device associated with the target control application.

[0113] In the embodiments of this application, the slave devices need to pre-register their respective IDs into the device table of the corresponding master device in order to associate with the target control application. When executing S502, the master device generates a control relationship based on the registration ID of at least one slave device associated with the target control application and the control ID assigned to the target control application by the server device.

[0114] In one alternative implementation, the control relationship is formatted as follows:

[0115] Control relationship: / CCID_xx / DevID_xx

[0116] Where CCID_xx represents the control ID assigned by the target control application, and DevID_xx represents the ID of the slave device associated with the target control application.

[0117] In embodiments of this application, a master control device can control one or more slave control devices.

[0118] For example, taking the master control device TV1 with control ID CCID_01 and associated with one slave control device as an example, the control relationship is represented as / CCID_01 / DevID_01, indicating that TV1 controls only one slave control device. See [link to relevant documentation]. Figure 6 .

[0119] For example, taking the master control device TV1 with control ID CCID_01 and associated with 5 slave control devices, the control relationship is represented as / CCID_01 / DevID_01~ / DevID_05, indicating that TV1 controls all slave control devices. See [link / details]. Figure 7 .

[0120] When a master device controls multiple slave devices simultaneously, the embodiments of this application do not impose restrictive requirements on the representation of the control relationship. For example, Figure 7 The control relationship in the code can also be represented as [ / CCID_01 / DevID_01; / CCID_01 / DevID_02; / CCID_01 / DevID_03; / CCID_01 / DevID_04; / CCID_01 / DevID_05].

[0121] In the embodiments of this application, when no specific control target is specified, that is, when the control relationship is represented as / CCID_01 / , it means that the master control device controls all slave control devices at the same time.

[0122] In the embodiments of this application, when there are multiple master control devices, the same slave control device can be controlled by different master control devices at different times.

[0123] For example, the control ID of master control device TV1 is CCID_01, and the control ID of master control device TV2 is CCID_02. Master control device TV1 is associated with 5 slave control devices, with control relationship 1 being / CCID_01 / DevID_01~ / DevID_05. All slave control devices with registered IDs DevID_01 to DevID_05 are controlled by TV1 at time t1. Master control device TV2 is associated with 1 slave control device, with control relationship 2 being / CCID_02 / DevID_01. The slave control device with registered ID DevID_01 is controlled by TV2 at time t2. (See [link to relevant documentation]). Figure 8 .

[0124] For example, the control ID of master control device TV1 is CCID_01, and the control ID of master control device TV2 is CCID_02. Master control device TV1 is associated with 5 slave control devices, with control relationship 1 being / CCID_01 / DevID_01~ / DevID_05. All slave control devices with registered IDs DevID_01 to DevID_05 are controlled by TV1 at time t1. Master control device TV2 is associated with 5 slave control devices, with control relationship 2 being / CCID_02 / DevID_01~ / DevID_05. All slave control devices with registered IDs DevID_01 to DevID_05 are controlled by TV2 at time t2. See [link to relevant documentation]. Figure 9 .

[0125] It should be noted that each slave device can only be controlled after it registers its own ID with the authenticated control application. Therefore, the method of generating control relationships in this application embodiment is applicable to both local area networks and wide area networks.

[0126] S503: Based on the control relationship, send a control command to at least one slave device so that at least one slave device can synchronously display the content displayed by the target control application according to the control command.

[0127] In the embodiments of this application, the control commands can be sent via a local area network (LAN) or a wide area network (WAN).

[0128] In one optional implementation, when the master control device and at least one slave control device are on a local area network, during the execution of S503, the master control device directly sends control commands to at least one slave control device according to the generated control relationship, such as... Figure 11 As shown.

[0129] In another optional implementation, when the master control device and at least one slave control device are on a wide area network, during the execution of S503, the master control device sends a control command to the background cloud according to the generated control relationship. The cloud then forwards the control command to at least one slave control device according to the control relationship. Figure 12A and Figure 12B As shown.

[0130] It should be noted that this application does not impose restrictive requirements on the specific content of the control instructions. For example, it can be an instruction to play the target video or an instruction to pause the playback of the target video.

[0131] In the embodiments of this application, regardless of whether it is in a local area network or a wide area network, the scope of the control commands issued by each control application is limited to the slave devices within the control relationship corresponding to that control application.

[0132] For example, with Figure 6For example, the control relationship is / CCID_01 / DevID_01, which means that TV1 controls only one slave device. In other words, only the slave device with the registered ID DevID_01 can receive control commands sent by TV1.

[0133] For example, with Figure 7 For example, the control relationship is / CCID_01 / DevID_01~ / DevID_05, which means that TV1 controls all slave devices. In other words, all slave devices with registered IDs from DevID_01 to DevID_05 can receive control commands sent by TV1.

[0134] In the embodiments of this application, when there are multiple master control devices, the same slave control device receives control commands sent by different master control devices at different times.

[0135] For example, with Figure 8 For example, when control relationship 1 is / CCID_01 / DevID_01~ / DevID_05, all slave devices with registered IDs DevID_01 to DevID_05 can receive control command 1 sent by TV1 at time t1; when control relationship 2 is / CCID_02 / DevID_01, the slave device with registered ID DevID_01 can receive control command sent by TV2 at time t2. That is to say, the slave device with registered ID DevID_01 is controlled by two master devices at different times.

[0136] For example, with Figure 9 For example, when control relationship 1 is / CCID_01 / DevID_01~ / DevID_05, all slave devices with registered IDs from DevID_01 to DevID_05 can receive the control command sent by TV1 at time t1; when control relationship 2 is / CCID_02 / DevID_01~ / DevID_05, all slave devices with registered IDs from DevID_01 to DevID_05 can receive the control command sent by TV2 at time t2. In other words, the slave devices with registered IDs from DevID_01 to DevID_05 are controlled by the two master devices at different times.

[0137] In the embodiments of this application, in S503, after at least one slave device receives the control command sent by the master device, it synchronously displays the content displayed by the target control application according to the control command.

[0138] Taking a master control device controlling multiple slave control devices simultaneously as an example, Figure 10 A synchronous display control interface is provided for embodiments of this application, such as... Figure 10As shown, the control application can be used for both regular 2D and immersive teaching. When the demonstration content of the control application is displayed on the main control device, it has the advantage of a large screen display, with rich details. When multiple VR devices display the same demonstration content synchronously according to control commands, it improves students' perception and imagination. Furthermore, through the operation interface, the teaching modes of regular 2D and immersive teaching can be switched freely.

[0139] Within a local area network, the overall control scheme of this application embodiment is described in [reference needed]. Figure 11 ,like Figure 11 As shown, the master control device has a control application installed. The master control device sends an authentication request ① to the cloud server. The authentication request carries the attribute information of the control application. The cloud server authenticates the control application based on the attribute information. After successful authentication, it returns authentication information ②, which carries the control ID assigned to the control application. The slave control device registers its own ID ③ in the device table of the control application, completing the authentication of the slave control device. The master control device generates a control relationship ④ based on the control ID of the control application and the registration ID of the slave control device. Through the operation interface, it sends a control command ⑤ to the message forwarding center. The message forwarding center sends the control command ⑤ to the slave control device corresponding to the control relationship. The slave control device executes the control command to synchronously display the content of the control application, thereby realizing the master control device's control and display of the slave control device.

[0140] Within a wide area network, in one optional implementation, the overall control scheme of this application embodiment is described below. Figure 12A ,like Figure 12A As shown, the master control device has a control application installed. The master control device sends an authentication request ① to the cloud server. The authentication request carries the attribute information of the control application. The cloud server authenticates the control application based on the attribute information. After successful authentication, it returns authentication information ②, which carries the control ID assigned to the control application. The slave control device registers its own ID ③ in the device table of the control application, completing the authentication of the slave control device. The master control device generates a control relationship ④ based on the control ID of the control application and the registration ID of the slave control device. Through the operation interface, it sends a control command ⑤ to the message center of the master control device. The message forwarding center of the master control device sends the control command ⑤ to the message forwarding center of the cloud server. The message forwarding center of the cloud server sends the control command ⑤ to the slave control device corresponding to the control relationship. The slave control device executes the control command to synchronously display the content of the control application, thereby realizing the master control device's control and display of the slave control device.

[0141] In a wide area network, another optional implementation method is described in the overall control scheme of this application embodiment. Figure 12B ,like Figure 12BAs shown, the control relationship ④ is directly sent to the message forwarding center of the cloud server through the operation interface of the master control device. The message forwarding center of the cloud server then sends the control command ⑤ to the slave control device corresponding to the control relationship. The slave control device executes the control command to synchronously display the content of the control application, thereby realizing the control and display of the slave control device by the master control device.

[0142] based on Figure 11 The overall control scheme shown in Figure 12, Figure 13 An exemplary flowchart illustrates a complete method for controlling the display of a slave device provided in an embodiment of this application, such as... Figure 13 As shown, it mainly includes the following steps:

[0143] S1301: In response to the startup operation of the target control application, the master control device detects whether the control ID corresponding to the target control application exists locally in the system. If it exists, execute S1302; otherwise, execute S1303.

[0144] S1302: The main control device checks whether the control ID corresponding to the target control application is within the validity period. If not, execute S1303; otherwise, execute S1311.

[0145] S1303: The master control device sends an authentication request to the server device, and the authentication request carries the attribute information of the target control application.

[0146] S1304~1305: The server device authenticates the target control application based on the aforementioned attribute information. If the authentication is successful, proceed to S1306; if the authentication fails, proceed to S1315.

[0147] S1306: The server device checks whether there is a free control ID in the ID resource pool. If it exists, execute S1307; otherwise, execute S1308.

[0148] S1307: The server device selects a control ID and assigns it to the target control application.

[0149] S1308: The server device regenerates a control ID and assigns it to the target control application.

[0150] S1309: The server device sends authentication information to the master control device, and the authentication information carries the control ID assigned to the target control application.

[0151] S1310: The master control device stores the control ID corresponding to the target control application locally in the system.

[0152] S1311: The master device obtains the registration ID of at least one slave device from the device table.

[0153] S1312: The master control device generates the control relationship corresponding to the target control application based on the control ID and the registration ID of at least one slave control device.

[0154] S1313: The master control device sends control commands to at least one slave control device according to the control relationship.

[0155] S1314: At least one slave device synchronously displays the content displayed by the target control application according to the control command.

[0156] S1315: The server device sends a response message to the master device, which carries a message indicating that the target application authentication failed.

[0157] In the above embodiments of this application, the server-side device authenticates the control application and assigns a unique control ID to each control application after successful authentication. This control ID is then sent to the corresponding master control device. Each control ID has an expiration date; if the control ID expires, the control application is re-authenticated, thus ensuring the validity of the control ID. After receiving the control ID assigned to the control application by the server-side device, the master control device generates a corresponding control relationship based on the registration IDs of at least one slave control device stored in the device table. Based on the control relationship, it sends control commands to at least one slave control device, enabling the at least one slave control device to synchronously display the content displayed by the control application. This achieves reasonable control over the slave control devices, combining the advantages of both the master and slave control devices.

[0158] Based on the same technical concept, this application provides a master control device that can execute the method flow for controlling the display of slave control devices provided in this application and achieve the same technical effect, which will not be repeated here.

[0159] See Figure 14 The main control device includes a controller 1401, a memory 1402, a display 1403, and an input / output interface 1404. The input / output interface 1404, the display 1403, and the memory 1402 are connected to the controller 1401 via a bus 1405. The input / output interface 1404 is used for communication and data transmission with the server device. The display 1403 is used to display the demonstration content. The memory 1402 stores computer program instructions, and the controller 1401 implements the method of controlling the display of the slave device by executing the computer program instructions.

[0160] Based on the same technical concept, this application provides a server device that can execute the method flow for controlling the display of the slave device provided in this application and achieve the same technical effect, which will not be repeated here.

[0161] See Figure 15The server device includes a processor 1501, a memory 1502, and an input / output interface 1503. The input / output interface 1503 and the memory 1502 are connected to the processor 1501 via a bus 1504. The input / output interface 1503 is used for communication and data transmission with the master control device. The memory 1502 stores computer program instructions, and the processor 1501 implements the method of controlling the display of the slave device by executing the computer program instructions.

[0162] This application also provides a computer-readable storage medium for storing instructions that, when executed, can perform the methods of the foregoing embodiments.

[0163] This application also provides a computer program product for storing a computer program that performs the methods described in the foregoing embodiments.

[0164] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0165] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A master control device, characterized in that, The main control device is equipped with a target control application, and includes input / output interfaces, a memory, and a controller. The memory stores a software control program, and the controller performs the following operations according to the software control program: The input / output interface is used to obtain a valid control ID for the target control application. The control ID is assigned by the server device after the target control application is authenticated. The control ID is selected from the ID resource pool by the server device when it detects that there are free IDs in the ID resource pool, or it is regenerated when there are no free IDs in the ID resource pool. Based on the control ID and the registration ID of at least one slave device associated with the target control application, a control relationship corresponding to the target control application is generated according to a preset format. The control relationship is used to uniquely identify the control authority of the master device to at least one slave device. The control authority is authenticated through the attribute information of the target control application. When the master control device and the at least one slave control device are in a local area network, control commands are sent directly to the at least one slave control device according to the control relationship. Alternatively, when the master control device and the at least one slave control device are in a wide area network, control commands are sent to the background cloud so that the cloud forwards the control commands to the at least one slave control device according to the control relationship. The control commands are used to instruct the at least one slave control device to synchronously display the content displayed by the target control application according to the control commands. The control relationship is represented in the following format: / CCID_xx / DevID_xx, where CCID_xx represents the control ID, and DevID_xx represents the registration ID of one of the at least one slave control devices. The registration IDs of the at least one slave control device are registered in the device table of the authenticated target control application. When the registration ID of a slave control device has a control relationship with different control IDs, the slave control device is controlled by only the master control device corresponding to one control ID at any given time.

2. The main control device as described in claim 1, characterized in that, Before the controller obtains a valid control ID for the target control application, it also performs the following operations: In response to the launch operation of the target control application, it is determined whether authentication of the target control application is required; When it is determined that the target control application needs to be authenticated, an authentication request is sent to the server device, the authentication request carrying the attribute information of the target control application; The authentication information corresponding to the authentication request is received. The authentication information carries a control ID assigned to the target control application. The authentication information is sent by the server device after authenticating the target control application based on the attribute information.

3. The main control device as described in claim 2, characterized in that, The authentication information is sent by the server device after authenticating the target control application based on the attribute information. The specific operation is as follows: After the target control application is authenticated, the server device checks whether there is a free control ID in the ID resource pool. If there is, a control ID is selected and assigned to the target control application; otherwise, a new control ID is generated and assigned to the target control application, and an authentication message carrying the control ID assigned to the target application is sent.

4. The main control device as described in claim 2, characterized in that, The controller detects whether authentication of the target control application is required, specifically by: The system detects whether the main control device has stored the control ID corresponding to the target control application locally. If it does not store the control ID, it determines that the target control application needs to be authenticated. If stored, check whether the control ID corresponding to the target control application is within the validity period. If not, determine that the target control application needs to be authenticated.

5. The main control device as described in claim 2, characterized in that, If the server device fails to authenticate the target control application based on the attribute information, after sending an authentication request to the server device, it also performs the following operations: The system receives a response message corresponding to the authentication request. The response message carries a prompt message indicating that the target application authentication has failed. The prompt message is used to instruct the target control application to re-authenticate.

6. The main control device as described in any one of claims 1-5, characterized in that, The target control application is assigned a unique control ID, and the control ID has an expiration period.

7. A server-side device, characterized in that, It includes a memory and a processor, the memory storing computer program instructions, and the processor performing the following operations according to the computer program instructions stored in the memory: The system receives an authentication request sent by a master control device, which has a target control application installed on it. The authentication request carries attribute information of the target control application and is sent by the master control device when it detects that the target control application needs to be authenticated. Based on the attribute information, the system detects whether the target control application has control permissions for authentication. After successful authentication, a control ID is assigned to the target control application. The control ID is selected from the ID resource pool by the server device when there are free IDs in the ID resource pool, or it is regenerated when there are no free IDs in the ID resource pool. The master control device sends authentication information carrying the control ID assigned to the target application to the master control device, so that the master control device generates the control relationship corresponding to the target control application according to the control ID and the registration ID of at least one slave control device associated with the target control application in a preset format, generates the control relationship corresponding to the target control application, and sends control instructions to the at least one slave control device according to the control relationship. The control instructions are used to instruct the at least one slave control device to synchronously display the content displayed by the target control application. Sending control commands to the at least one slave device according to the control relationship includes: When the master control device and the at least one slave control device are in a local area network, control commands are sent directly to the at least one slave control device according to the control relationship; or, when the master control device and the at least one slave control device are in a wide area network, control commands are sent to the background cloud so that the cloud forwards the control commands to the at least one slave control device according to the control relationship. The control relationship is used to uniquely identify the master control device's control authority over at least one slave control device. The control authority is authenticated through the attribute information of the target control application. The control relationship is represented in the following format: / CCID_xx / DevID_xx, where CCID_xx represents the control ID and DevID_xx represents the registration ID of one of the at least one slave control devices. The registration IDs of the at least one slave control device are registered in the device table of the authenticated target control application. When the registration ID of a slave control device has a control relationship with different control IDs, the slave control device is controlled by the master control device corresponding to only one control ID at any given time.

8. A method for controlling the display of a slave device, characterized in that, include: Obtain a valid control ID for the target control application. The control ID is assigned by the server device after the target control application is authenticated. The control ID is selected from the ID resource pool by the server device when it detects that there are free IDs in the ID resource pool, or it is regenerated when there are no free IDs in the ID resource pool. Based on the control ID and the registration ID of at least one slave device associated with the target control application, a control relationship corresponding to the target control application is generated according to a preset format. The control relationship is used to uniquely identify the control authority of the master device to at least one slave device. The control authority is authenticated through the attribute information of the target control application. When the master control device and the at least one slave control device are in a local area network, control commands are sent directly to the at least one slave control device according to the control relationship. Alternatively, when the master control device and the at least one slave control device are in a wide area network, control commands are sent to the background cloud so that the cloud forwards the control commands to the at least one slave control device according to the control relationship. The control commands are used to instruct the at least one slave control device to synchronously display the content displayed by the target control application according to the control commands. The control relationship is represented in the following format: / CCID_xx / DevID_xx, where CCID_xx represents the control ID, and DevID_xx represents the registration ID of one of the at least one slave control devices. The registration IDs of the at least one slave control device are registered in the device table of the authenticated target control application. When the registration ID of a slave control device has a control relationship with different control IDs, the slave control device is controlled by only the master control device corresponding to one control ID at any given time.

9. The method as described in claim 8, characterized in that, Before obtaining a valid control ID for the target control application, the process also includes: In response to the launch operation of the target control application, it is determined whether the target control application needs to be authenticated; When it is determined that the target control application needs to be authenticated, an authentication request is sent to the server device, the authentication request carrying the attribute information of the target control application; The authentication information corresponding to the authentication request is received. The authentication information carries a control ID assigned to the target control application. The authentication information is sent by the server device after authenticating the target control application based on the attribute information.

10. A method for controlling the display of a slave device, characterized in that, include: The system receives an authentication request sent by a master control device, which has a target control application installed on it. The authentication request carries attribute information of the target control application and is sent by the master control device when it detects that the target control application needs to be authenticated. Based on the attribute information, the system detects whether the target control application has control permissions for authentication. After successful authentication, a control ID is assigned to the target control application. The control ID is selected from the ID resource pool when the server device detects that there are free IDs in the ID resource pool, or it is regenerated when there are no free IDs in the ID resource pool. The master control device sends authentication information carrying the control ID assigned to the target application to the master control device, so that the master control device generates the control relationship corresponding to the target control application according to the control ID and the registration ID of at least one slave control device associated with the target control application in a preset format, generates the control relationship corresponding to the target control application, and sends control instructions to at least one slave control device according to the control relationship. The control instructions are used to instruct the at least one slave control device to synchronously display the content displayed by the target control application. Sending control commands to the at least one slave device according to the control relationship includes: When the master control device and the at least one slave control device are in a local area network, control commands are sent directly to the at least one slave control device according to the control relationship; or, when the master control device and the at least one slave control device are in a wide area network, control commands are sent to the background cloud so that the cloud forwards the control commands to the at least one slave control device according to the control relationship. The control relationship is used to uniquely identify the master control device's control authority over at least one slave control device. The control authority is authenticated through the attribute information of the target control application. The control relationship is represented in the following format: / CCID_xx / DevID_xx, where CCID_xx represents the control ID and DevID_xx represents the registration ID of one of the at least one slave control devices. The registration IDs of the at least one slave control device are registered in the device table of the authenticated target control application. When the registration ID of a slave control device has a control relationship with different control IDs, the slave control device is controlled by the master control device corresponding to only one control ID at any given time.

Images