Display equipment control system and method, storage medium and electronic equipment

Abstract

The invention relates to a display device control system and method, a storage medium and an electronic device, and relates to the technical field of device management, the control system comprises a master display device, a slave display device and a cloud server, and the master display device is in communication connection with the slave display device and the cloud server; wherein the master display device is used for acquiring first device information of the slave display device and sending the first device information to the cloud server; the cloud server is used for determining a device triggering condition of the slave display device according to the first device information and feeding back the device triggering condition to the main control device; the master control device is further used for determining a to-be-controlled display device from the slave display devices according to the device triggering condition and determining a device control scheme of the to-be-controlled display device; and the main control equipment is also used for controlling the equipment state and the equipment playing content of the to-be-controlled display equipment based on the equipment control scheme. The equipment control efficiency is improved.

Description

Technical Field

[0001] Embodiments of the present disclosure relate to the technical field of device management. Specifically, the present disclosure relates to a control system for a display device, a control method for a display device, a computer-readable storage medium, and an electronic device. Background Art

[0002] In the existing control methods for display devices, it is necessary to manually determine the display device to be controlled from the display device and manually control the display device to perform corresponding displays. However, this method has the problem of low control efficiency.

[0003] It should be noted that the information disclosed in the above background art is only used to enhance the understanding of the background of the present disclosure. Therefore, it may include information that does not constitute the prior art known to those of ordinary skill in the art. Summary of the Invention

[0004] The purpose of the present disclosure is to provide a control system for a display device, a control method for a display device, a computer-readable storage medium, and an electronic device, so as to at least overcome to a certain extent the problem of low control efficiency of the display device caused by the limitations and defects of the related art.

[0005] According to one aspect of the present disclosure, there is provided a control system for a display device, including a main display device, a slave display device, and a cloud server. The main display device is communicatively connected to the slave display device and the cloud server respectively. Wherein:

[0006] The main display device is configured to obtain first device information of the slave display device and send the first device information to the cloud server;

[0007] The cloud server is configured to determine a device trigger condition of the slave display device according to the first device information and feedback the device trigger condition to the main control device;

[0008] The main control device is further configured to determine a display device to be controlled from the slave display devices according to the device trigger condition and determine a device control scheme for the display device to be controlled;

[0009] The main control device is further configured to control the device state and device playback content of the display device to be controlled based on the device control scheme.

[0010] In an exemplary embodiment of the present disclosure, the first device information includes at least one of first device attribute information, first OTA version information, first application program list information, and first current device state information of the slave display device;

[0011] The first current device status information includes at least one of parameter information of the first device itself of the slave display device, parameter information of the first device environment where the slave display device is currently located, and first program playback status information that the slave display device is currently playing;

[0012] Wherein, the cloud server is further configured to: call a preset trigger condition prediction model, and input the first device attribute information, the first OTA version information, the first application program list information, and the first current device status information into the preset trigger condition prediction model to obtain a device trigger condition of the slave display device.

[0013] In an exemplary embodiment of the present disclosure, the control system of the display device further includes a main control device, and the main control device is communicatively connected to the main display device. The main control device is configured to: construct a device attribute information list corresponding to the main display device and / or the slave display device, and import the first device attribute information in the device attribute information list into the main display device based on a preset import method;

[0014] The main display device is further configured to: send the first device attribute information to the slave display device corresponding to the main display device.

[0015] In an exemplary embodiment of the present disclosure, the slave display device includes a slave display device with a first priority level and / or a slave display device with a second priority level; the first priority level is higher than the second priority level;

[0016] Wherein, the main display device is further configured to: send the first device attribute information to the slave display device with the first priority level corresponding to the main display device;

[0017] The slave display device with the first priority level is configured to: send the first device attribute information to the slave display device with the second priority level corresponding to the slave display device with the first priority level.

[0018] In an exemplary embodiment of the present disclosure, the main display device is further configured to:

[0019] Match the current device status information and the device trigger condition of the slave display device;

[0020] If the current device status information and the device trigger condition are consistent, determine the slave display device corresponding to the current device status information as the display device to be controlled;

[0021] If the current device status information and the device trigger condition are inconsistent, determine that the slave display device corresponding to the current device status information is not the display device to be controlled.

[0022] In an exemplary embodiment of the present disclosure, the main display device is further configured to: obtain second device information of the display device to be controlled, and send the second device information to the cloud server;

[0023] The cloud server is further configured to: determine a device control scheme for the display device to be controlled according to the second device information, and send the device control scheme to the main display device.

[0024] In an exemplary embodiment of the present disclosure, the cloud server is further configured to: call a preset control scheme prediction model, and input the second device information into the preset control scheme prediction model to obtain a device control scheme for the display device to be controlled; wherein, the preset control scheme prediction model includes a first input layer, an embedding mapping layer, an encoding layer, a mixture of experts model layer, and a first output layer.

[0025] In an exemplary embodiment of the present disclosure, the device control scheme for the display device to be controlled is predicted in the following manner:

[0026] Generate basic information to be predicted according to the second device attribute information, the second OTA version information, and the second current device state information of the display device to be controlled, and generate context information to be predicted according to the second application program list information of the display device to be controlled and preset model prompt parameters;

[0027] Perform word embedding processing on the basic information to be predicted based on the embedding mapping layer to obtain device features, and perform embedding mapping processing on the context information to be predicted based on the embedding mapping layer to obtain a context flag sequence;

[0028] Perform encoding processing on the device features and the context flag sequence based on the encoding layer to obtain an overall context representation, and perform prediction on the context flag sequence and the overall context representation based on the mixture of experts model layer to obtain a device control scheme for the display device to be controlled.

[0029] In an exemplary embodiment of the present disclosure, the mixture of experts model layer includes a first gated network model, a second gated network model, a third gated network model, and an expert neural network model;

[0030] Wherein, performing prediction on the context flag sequence and the overall context representation based on the mixture of experts model layer to obtain a device control scheme for the display device to be controlled includes:

[0031] Based on the first gating network model, the second gating network model, and the third gating network model, determine a first target neural network model, a second target neural network model, and a third target neural network model required for performing the prediction task of the device control scheme from the expert neural network model;

[0032] According to the first target neural network model, the second target neural network model, and the third target neural network model, predict the context flag sequence and the overall context representation to obtain a device control scheme for the display device to be controlled.

[0033] In an exemplary embodiment of the present disclosure, based on the first gating network model, the second gating network model, and the third gating network model, determining a first target neural network model, a second target neural network model, and a third target neural network model required for performing the prediction task of the device control scheme from the expert neural network model includes:

[0034] Based on the first gating network model and according to the context flag sequence, determine a first model weight of the expert neural network model in a first control scheme dimension corresponding to the current state information of the device itself, and according to the first model weight, determine a first target neural network model required for performing the prediction task of the device control scheme in the first control scheme dimension from the expert neural network;

[0035] Based on the second gating network model and according to the context flag sequence, determine a second model weight of the expert neural network model in a second control scheme dimension corresponding to the current environmental information where the device is located, and according to the second model weight, determine a second target neural network model required for performing the prediction task of the device control scheme in the second control scheme dimension from the expert neural network;

[0036] Based on the third gating network model and according to the context flag sequence, determine a third model weight of the expert neural network model in a third control scheme dimension corresponding to the current program information played by the device, and according to the third model weight, determine a third target neural network model required for performing the prediction task of the device control scheme in the third control scheme dimension from the expert neural network.

[0037] In an exemplary embodiment of the present disclosure, according to the first target neural network model, the second target neural network model, and the third target neural network model, predicting the context flag sequence and the overall context representation to obtain a device control scheme for the display device to be controlled includes:

[0038] Input the context flag sequence and the overall context representation into a first target neural network model to obtain a first prediction result in a first control scheme dimension corresponding to the current state information of the device itself;

[0039] Input the context flag sequence and the overall context representation into a second target neural network model to obtain a second prediction result in a second control scheme dimension corresponding to the current environmental information of the device;

[0040] Input the context flag sequence and the overall context representation into a third target neural network model to obtain a third prediction result in a third control scheme dimension corresponding to the current program information played by the device;

[0041] Generate a device control scheme for the display device to be controlled according to the first prediction result, the second prediction result, and the third prediction result.

[0042] In an exemplary embodiment of the present disclosure, the main display device is further configured to:

[0043] Control the device state information of the display device to be controlled according to the first prediction result and the second prediction result in the device control scheme, and control the device playback content of the display device to be controlled according to the third prediction result in the device control scheme.

[0044] In an exemplary embodiment of the present disclosure, the device state information of the display device to be controlled includes at least one of the following:

[0045] Power-on state / power-off state, open application / close application, connect signal source / disconnect signal source, turn on screensaver / turn off screensaver, connect network / disconnect network, turn on camera / turn off camera, issue alarm / turn off alarm, start security model / turn off security mode, upload file / download file, turn on remote control lock and file lock / turn off remote control lock and file lock, lock hardware interface / turn on hardware interface, hide files and applications / open files and applications.

[0046] According to one aspect of the present disclosure, a control method for a display device is provided, configured in a main display device. The control method for the display device includes:

[0047] Obtain first device information of a slave display device and send the first device information of the slave display device to a cloud server;

[0048] Receive a device trigger condition of the slave display device determined according to the first device information fed back by the cloud server, and determine a display device to be controlled from the slave display devices according to the device trigger condition;

[0049] Send the second device information of the display device to be controlled to the cloud server, and receive the device control scheme determined by the cloud server based on the second device information;

[0050] Control the device status and the device playback content of the display device to be controlled based on the device control scheme.

[0051] According to one aspect of the present disclosure, there is provided a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the control method of the display device described in any one of the above is implemented.

[0052] According to one aspect of the present disclosure, there is provided an electronic device, including:

[0053] A processor; and a memory for storing executable instructions of the processor;

[0054] Wherein, the processor is configured to execute the control method of the display device described in any one of the above by executing the executable instructions.

[0055] A control system of a display device provided by an embodiment of the present disclosure. On the one hand, the main display device obtains the first device information of the slave display device and sends the first device information to the cloud server; then the cloud server determines the device trigger condition of the slave display device according to the first device information and feeds back the device trigger condition to the main control device; further, the main control device determines the display device to be controlled from the above-mentioned slave display devices according to the device trigger condition and determines the device control scheme of the display device to be controlled; finally, the main control device controls the device status and the device playback content of the display device to be controlled based on the device control scheme, realizing the automatic control of the display device and improving the control efficiency of the display device; on the other hand, since a corresponding device control scheme can be configured for the display device to be controlled, the personalized control of the display device is realized.

[0056] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] The drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and those of ordinary skill in the art can obtain other drawings without creative efforts based on these drawings.

[0058] Figure 1Schematically shows a structural block diagram of a control system of a display device according to an exemplary embodiment of the present disclosure.

[0059] Figure 2 Schematically shows a structural block diagram of another control system of a display device according to an exemplary embodiment of the present disclosure.

[0060] Figure 3 Schematically shows an example diagram of a display interface of an import / export content selection scenario according to an exemplary embodiment of the present disclosure.

[0061] Figure 4 Schematically shows an example diagram of a display interface in a successful export scenario according to an exemplary embodiment of the present disclosure.

[0062] Figure 5 Schematically shows an example diagram of a display interface in a successful import scenario according to an exemplary embodiment of the present disclosure.

[0063] Figure 6 Schematically shows an example diagram of an import process of Device A in an information export scenario according to an exemplary embodiment of the present disclosure.

[0064] Figure 7 Schematically shows an example diagram of an import process of Device B in an information import scenario according to an exemplary embodiment of the present disclosure.

[0065] Figure 8 Schematically shows an example diagram of an export process of Device C in an information import scenario according to an exemplary embodiment of the present disclosure.

[0066] Figure 9 Schematically shows an example diagram of a device distribution scenario in a device hierarchical management scenario according to an exemplary embodiment of the present disclosure.

[0067] Figure 10 Schematically shows an example diagram of a structure of a preset control scheme prediction model according to an exemplary embodiment of the present disclosure.

[0068] Figure 11 Schematically shows an example diagram of an environmental scenario where a display device is located according to an exemplary embodiment of the present disclosure.

[0069] Figure 12 Schematically shows a flowchart of a control method of a display device according to an exemplary embodiment of the present disclosure.

[0070] Figure 13 Schematically shows a structural block diagram of a control device of a display device according to an exemplary embodiment of the present disclosure.

[0071] Figure 14An electronic device for implementing a control method of a display device according to an exemplary embodiment of the present disclosure is schematically shown. Detailed implementation manners

[0072] Exemplary embodiments will now be described more fully with reference to the accompanying drawings. However, the exemplary embodiments can be implemented in various forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of the exemplary embodiments to those skilled in the art. The features, structures, or characteristics described may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of the embodiments of the present disclosure. However, those skilled in the art will realize that the technical solutions of the present disclosure can be practiced without one or more of the specific details, or other methods, components, devices, steps, etc. may be used. In other cases, well-known technical solutions are not shown or described in detail so as not to obscure the various aspects of the present disclosure.

[0073] In addition, the accompanying drawings are only schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repeated description will be omitted. Some of the block diagrams shown in the drawings are functional entities and do not necessarily correspond to physically or logically independent entities. These functional entities may be implemented in software, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0074] The exemplary embodiments of the present disclosure first provide a control system for a display device. Specifically, referring to Figure 1 As shown, the control system of the display device may include a main display device 110, a slave display device 120, and a cloud server 130; wherein, the main display device may be communicatively connected to the slave display device through a local area network; at the same time, the main display device may also be communicatively connected to the server side remotely through a wired network or a wireless network. In the actual application process, the main display device may be used to obtain the first device information of the slave display device and send the first device information to the cloud server; at the same time, the cloud server may be used to determine the device trigger condition of the slave display device according to the first device information and feedback the device trigger condition to the main control device; further, the main control device is also used to determine the display device to be controlled from the slave display devices according to the device trigger condition and determine the device control scheme of the display device to be controlled; finally, the main control device is also used to control the device state and the device playback content of the display device to be controlled based on the device control scheme.

[0075] In the control system of the display device described above, on the one hand, the main display device obtains the first device information of the slave display device and sends the first device information to the cloud server; then, the cloud server determines the device trigger condition of the slave display device according to the first device information and feeds back the device trigger condition to the main control device; furthermore, the main control device determines the display device to be controlled from the above-mentioned slave display devices according to the device trigger condition and determines the device control scheme of the display device to be controlled; finally, the main control device controls the device state and the device playback content of the display device to be controlled based on the device control scheme, realizing the automatic control of the display device and improving the control efficiency of the display device; on the other hand, since a corresponding device control scheme can be configured for the display device to be controlled, the personalized control of the display device is realized.

[0076] Hereinafter, the control system of the display device described in the exemplary embodiments of the present disclosure will be explained and described in detail with reference to the accompanying drawings.

[0077] First, the application scenario of the exemplary embodiments of the present disclosure will be explained and described. Specifically, the control system of the display device described in the exemplary embodiments of the present disclosure can be used to control the display device in a large-size multi-display device scenario. Among them, the large-size (for example, it can be more than 50 inches) display device described here can be applied to intelligent meeting scenarios, intelligent teaching scenarios, commercial scenarios, smart city scenarios, and smart medical scenarios, etc. This example does not make special restrictions on this.

[0078] Secondly, the import process of the device attribute information described in the exemplary embodiments of the present disclosure will be explained and described. Specifically, the specific import of the device attribute information needs to be realized through the main control device. Specifically, as shown in Figure 2 The control system of the display device may further include a main control device 210. The main control device can communicate with the main display device through near-field communication, USB connection, or Bluetooth; in the actual application process, the main control device can be used to construct a device attribute information list corresponding to the main display device and / or the slave display device, and based on a preset import method, import the first device attribute information in the device attribute information list into the main display device; then, the main display device issues the first device attribute information to the slave display device corresponding to the main display device. Among them, the main control device described here can be a mobile terminal (such as a mobile phone, a tablet computer, or a personal computer, etc.), or a fixed terminal, such as a desktop computer, etc. This example does not make special restrictions on this.

[0079] In an exemplary embodiment, taking the case where the master control device and the master display device communicate via NFC (Near Field Communication) as an example, the specific import process of device attribute information is explained and described. Specifically, in the import process, first, an NFC batch setting function is added to the system settings of the large screen terminal (i.e., the master display device). When the NFC function is turned on, settings can be directly made via NFC; second, install a batch control APP (Application) in the master-slave device (such as a mobile phone); during the import process, the large screen can be directly controlled via NFC without opening the APP. Further, in the actual import process, take the mobile phone as the master control device, and devices A and B as the display devices for explanation and description. Specifically, bring the NFC area of the mobile phone close to device A, and a prompt content as shown in Figure 3 will pop up on the mobile phone, and import / export can be selected; second, click export and wait for device A to transfer the setting content to the mobile phone; then, when the export is completed, the mobile phone will display information indicating that the setting export is completed as shown in Figure 4 ; further, if the NFC area of the mobile phone is brought close to device B, a prompt will pop up on the mobile phone. Click import and wait for the setting content to be transferred to device B to complete the batch setting; when the import is completed, the mobile phone will display information indicating that the setting import is completed as shown in Figure 5 ; among them, for specific example diagrams of the import and export scenarios, reference can be made to Figure 6 , Figure 7 and Figure 8 shown.

[0080] In an exemplary embodiment, during the import or export process, the format of the imported content or exported content also needs to be set; specifically, during the process of importing content or exporting content, in order to improve the transmission speed, the setting content and adjustment values are not displayed in text but replaced by numbers. Specifically, during the import process, the setting content supported by the display device can be pre-entered in the master control device, and each content item corresponds to a number; the adjustment value corresponds to a specific value under the setting item, and each value corresponds to a number. Of course, for special content setting items, additional note information such as device name, wifi information, etc. can be added and displayed through actual text. In the actual application process, assume that a certain device has a total of 10 setting items, and the numbers 0-9 respectively represent these setting items. Then the specific setting information list can be as shown in Table 1 below.

[0081] Table 1

[0082] Setting item Code Adjustment value Code Brightness 0 0-100 0-100 Contrast 1 0-100 0-100 Saturation 2 0-100 0-100 Sharpness 3 0-100 0-100 Color temperature 4 Cool / Warm / Standard 0 / 1 / 2 System language 5 Chinese / English 0 / 1 Source wake-up 6 Off / On 0 / 1 Noise reduction 7 Off / Auto / Low / Medium / High 0 / 1 / 2 / 3 / 4 Digital audio output 8 Off / Auto / PCM / Transcoding 0 / 1 / 2 / 3 Screen saver time 9 5 / 10 / 15 / 20 / 30 minutes 0 / 1 / 2 / 3 / 4

[0083] Further, during the export process, the set content and adjustment values can be converted into numbers and punctuation marks and exported as a string of text in text form. For example, the exported content " / 0-80 / 1-70 / 2-90 / 3-90 / 4-1 / 5-0 / 6-0 / 7-3 / 8-1 / 9-4 / " can be converted into the content recorded in Table 2 below:

[0084] Table 2

[0085]

[0086]

[0087] It should also be supplemented here that during the import process, the adjustment values can also be modified according to the corresponding set items; further, for the case where the set items are inconsistent due to different devices, only the set items with the same number and the corresponding adjustment items can be copied.

[0088] In a possible exemplary embodiment, the slave display devices described above may include slave display devices with a first priority level and / or slave display devices with a second priority level; the first priority level is higher than the second priority level; for example, the slave display device with the first priority level may be the group leader slave display device, and the slave display device with the second priority level may be the group member slave display device; on this premise, the specific setting process of the device attribute information may further include: sending the first device attribute information to the slave display device with the first priority level corresponding to the master display device through the master display device; sending the first device attribute information to the slave display device with the second priority level corresponding to the slave display device with the first priority level through the slave display device with the first priority level. Specifically, during the actual application process, when the number of slave display devices is too large, the master display device obtaining the information of multiple slave display devices at the same time will occupy memory and time; therefore, to solve this problem, a device hierarchical management method can be adopted to implement. Specifically, during the device hierarchical management process, the master display device can be used as the overall control, connected to the "group leader device", and the "group leader device" controls the devices within its own group; further, importance levels can also be set for different tasks. For medium and low-level tasks, the group leader slave display device can handle them by itself; for high-level tasks, they need to be fed back to the master display device, and the master display device can distribute them to other group leader devices and notify all slave display devices. Furthermore, when the master display device receives a task, it can also select to send it to all group leaders or a certain group leader according to the task content and type; among them, the medium and low-level tasks described here may include, but are not limited to, asynchronous device playback; the high-level tasks described here may include, but are not limited to, the device being stolen, etc.; at the same time, for the specific scenario example diagram of the device hierarchical management described here, reference can be made toFigure 9 as shown

[0089] In one exemplary embodiment, the first device information described above may include, but is not limited to, the first device attribute information of the display device, the first OTA version information, the first application list information, and the first current device status information, etc.; the first current device status information may include, but is not limited to, the parameter information of the first device itself of the display device, the parameter information of the first device environment where the display device is currently located, and the first program playback status information of the program currently being played by the display device, etc.; at the same time, the first device attribute information described here may include, but is not limited to, brightness, contrast, saturation, clarity, color temperature, system language, source wake-up, noise reduction, digital audio output, and screensaver time, etc.; the first OTA (Over-The-Air) version information described here refers to the version information that requires remote device software update; the first application list information described here refers to the list information formed by the applications installed in the display device.

[0090] In one exemplary embodiment, before obtaining the first device information of the display device, it is also necessary to determine the main display device; specifically, the determination of the main display device can be achieved through the main control device; for example, the main control device can send an instruction to the display device via near-field communication. When the display device receives this instruction, it can determine whether it is the main display device according to the device type included in the instruction; for example, if the device type included in the instruction is 1, it is determined to be the main display device; if the device type included in the instruction is 0, it is determined to be the slave display device; at the same time, the main display device and the slave display device can be communicatively connected via a local area network; after the main display device is determined, the main display device can send a first information acquisition request to the slave display device associated with it. When the slave display device receives this first information acquisition request, it can then feedback the first device information to the main display device. It should also be added here that in the actual application process, the main control device can send the first information acquisition request to the slave display device at specific time intervals (such as 5 minutes or 10 minutes) to obtain the first device information.

[0091] In an exemplary embodiment, after the main display device receives the first device information, it can send the first device information to the cloud server. After the cloud server receives the first device information, it can call a preset trigger condition prediction model and input the first device attribute information, the first OTA version information, the first application list information, and the first current device state information into the preset trigger condition prediction model to obtain the device trigger condition of the slave display device. Specifically, the trigger condition prediction model described here can include, but is not limited to, a convolutional neural network, a recurrent neural network model, or a long short-term memory network model, etc. This example does not make special restrictions on this; at the same time, the trigger condition prediction model set in the server can save the setting information and trigger information of different scenarios, and continuously iterate and optimize the accuracy through the improvement of model data; further, after obtaining the device trigger condition, the device trigger condition can be sent to the main display device so that the main display device can match the display device to be controlled from all slave display devices.

[0092] In an exemplary embodiment, the device trigger condition described here can include, but is not limited to, at least one of the following: on the one hand, state switching types; that is, if it is detected that another device has performed a specified state switching behavior, it is determined that the trigger condition is met: ① detecting a power-on / power-off behavior; ② detecting the opening of a certain application; ③ detecting entering a certain signal source; ④ detecting entering the screensaver; ⑤ detecting that the device is connected to the network; ⑥ detecting that a certain setting item has changed or is set to a certain value; ⑦ other state changes, which can be added manually; on the other hand, environmental change types: ① detecting that there are people around; ② face recognition of the administrator / stranger / a person with a specified identity; ③ detecting that the brightness / volume reaches a certain range. On this premise, after the cloud server receives the first device information, it can intelligently analyze the scenario through the current environment and device parameters in the first device information; then, according to the scenario obtained by the intelligent analysis, it automatically matches the trigger method; for example: if it is detected that the current scenario of the slave display device is an exhibition hall scenario, the corresponding trigger method (trigger condition) is whether there are people around + opening a certain application.

[0093] In an exemplary embodiment, during the process of the main display device matching the display device to be controlled from all slave display devices, it can be implemented in the following manner: match the current device status information and device trigger conditions of the slave display devices; if the current device status information and device trigger conditions are consistent, determine the slave display device corresponding to the current device status information as the display device to be controlled; if the current device status information and device trigger conditions are inconsistent, determine that the slave display device corresponding to the current device status information is not the display device to be controlled. That is, after the main display device receives the device trigger conditions, it can detect whether other slave display devices meet the trigger conditions; if they meet the trigger conditions, determine that the slave display device is the display device to be controlled; otherwise, it is not the display device to be controlled.

[0094] In an exemplary embodiment, after the display device to be controlled is determined, the main control device can obtain the second device information of the display device to be controlled and send the second device information to the cloud server; wherein, the second device information recorded here can also include the device attribute information, OTA version information, application list information, and current device status information of the device to be controlled; at the same time, the device attribute information, OTA version information, application list information, and current device status information recorded here can be the same as the first device information or can be re-obtained, and this example does not make special restrictions on this; further, after the cloud server receives the second device information, it can determine the device control scheme of the display device to be controlled according to the second device information and send the device control scheme to the main display device.

[0095] In an exemplary embodiment of the present disclosure, in the specific prediction process of the device control scheme, it can be implemented in the following manner: call a preset control scheme prediction model and input the second device information into the preset control scheme prediction model to obtain the device control scheme of the display device to be controlled; specifically, as shown in Figure 10 shown, the preset control scheme prediction model recorded here can include a first input layer 1001, an embedding mapping layer 1002, an encoding layer 1003, a mixture of experts model layer 1004, and a first output layer 1005.

[0096] In an exemplary embodiment, the device control scheme for the display device to be controlled is predicted in the following manner: Generate the basic information to be predicted based on the second device attribute information, the second OTA version information, and the second current device state information of the display device to be controlled, and generate the context information to be predicted based on the second application program list information of the display device to be controlled and the preset model hint parameters; perform word embedding processing on the basic information to be predicted based on the embedding mapping layer to obtain device features, and perform embedding mapping processing on the context information to be predicted based on the embedding mapping layer to obtain a context flag sequence; perform encoding processing on the device features and the context flag sequence based on the encoding layer to obtain an overall context representation, and perform prediction on the context flag sequence and the overall context representation based on the mixture of experts model layer to obtain the device control scheme for the display device to be controlled. Specifically, the embedding mapping layer described here may include an Embedding embedding mapping layer and a Bert embedding mapping layer, and the encoding layer described here may be a bidirectional multi-layer Transformer; further, in the specific embedding mapping process, embedding mapping processing may be performed on the basic information to be predicted based on the Embedding embedding mapping layer, and embedding mapping processing may be performed on the context information to be predicted based on the Bert embedding mapping layer; meanwhile, the preset model hint parameters described here can be set according to actual needs. For example, it can be: Your purpose is to generate different control schemes for display devices in different scenarios; of course, it can also be other information, and this example does not make special restrictions on this.

[0097] In an exemplary embodiment, the mixture of experts model layer includes a first gating network model, a second gating network model, a third gating network model, and an expert neural network model; among them, performing prediction on the context flag sequence and the overall context representation based on the mixture of experts model layer to obtain the device control scheme for the display device to be controlled includes: determining the first target neural network model, the second target neural network model, and the third target neural network model required for the prediction task of the device control scheme from the expert neural network model based on the first gating network model, the second gating network model, and the third gating network model; performing prediction on the context flag sequence and the overall context representation according to the first target neural network model, the second target neural network model, and the third target neural network model to obtain the device control scheme for the display device to be controlled. Specifically, the reason for setting multiple gating network models here is that multiple predictions in different dimensions are required; based on this, the accuracy of the obtained prediction results can be further improved.

[0098] In an exemplary embodiment, based on a first gating network model, a second gating network model, and a third gating network model, a first target neural network model, a second target neural network model, and a third target neural network model required for the prediction task of the execution device control scheme are determined from an expert neural network model, including: based on the first gating network model and according to the context flag sequence, determining a first model weight of the expert neural network model in a first control scheme dimension corresponding to the current state information of the device itself, and determining, according to the first model weight, a first target neural network model required for the prediction task of the device control scheme in the first control scheme dimension from the expert neural network; based on the second gating network model and according to the context flag sequence, determining a second model weight of the expert neural network model in a second control scheme dimension corresponding to the current environment information where the device is located, and determining, according to the second model weight, a second target neural network model required for the prediction task of the device control scheme in the second control scheme dimension from the expert neural network; based on the third gating network model and according to the context flag sequence, determining a third model weight of the expert neural network model in a third control scheme dimension corresponding to the current program information played by the device, and determining, according to the third model weight, a third target neural network model required for the prediction task of the device control scheme in the third control scheme dimension from the expert neural network.

[0099] In an exemplary embodiment, according to the first target neural network model, the second target neural network model, and the third target neural network model, the context flag sequence and the context overall representation are predicted to obtain a device control scheme for the display device to be controlled, including: inputting the context flag sequence and the context overall representation into the first target neural network model to obtain a first prediction result in a first control scheme dimension corresponding to the current state information of the device itself; inputting the context flag sequence and the context overall representation into the second target neural network model to obtain a second prediction result in a second control scheme dimension corresponding to the current environment information where the device is located; inputting the context flag sequence and the context overall representation into the third target neural network model to obtain a third prediction result in a third control scheme dimension corresponding to the current program information played by the device; and generating a device control scheme for the display device to be controlled according to the first prediction result, the second prediction result, and the third prediction result. Specifically, in the actual application process, after obtaining the first prediction result, the second prediction result, and the third prediction result, the first prediction result, the second prediction result, and the third prediction result can be directly combined to obtain the final device control scheme, or the corresponding device control scheme can be determined by means of weighted summation. This example does not make special restrictions on this.

[0100] In an exemplary embodiment, when the main control device receives a device control scheme, it can control the device state and the device playback content of the display device to be controlled according to the device control scheme. Specifically, in the process of controlling the device state and the device playback content of the display device to be controlled, it can be achieved in the following manner: controlling the device state information of the display device to be controlled according to the first prediction result and the second prediction result in the device control scheme, and controlling the device playback content of the display device to be controlled according to the third prediction result in the device control scheme. Among them, the device state information of the display device to be controlled recorded here includes but is not limited to the power-on state / power-off state, opening an application program / closing an application program, connecting a signal source / disconnecting a signal source, turning on the screen saver / turning off the screen saver, connecting to the network / disconnecting from the network, turning on the camera / turning off the camera, sounding an alarm / turning off the alarm, starting the security model / turning off the security mode, uploading a file / downloading a file, turning on the remote control lock and file lock / turning off the remote control lock and file lock, locking the hardware interface / opening the hardware interface, hiding files and applications / opening files and applications, and so on.

[0101] Hereinafter, the specific control process in the multi-device playback scenario will be explained and described. Specifically, in order to prevent playback accidents, when it is detected that a playback abnormality occurs in a certain slave display device, the specific control scheme is: sharing files / screens from other slave display devices to the device with the playback abnormality to enable the device to resume normal operation. Among them, the triggering condition for other slave display devices in this scenario is that the corresponding played program content is inconsistent; at the same time, the specific determination process for the display device to be controlled in this scenario is: after the main display device receives the triggering condition, it obtains the playback state information of other slave display devices (including in the first device information); among them, when obtaining the playback state information, the slave display device can send the program name and playback time to the master device; the main display device can verify the program name and playback time; further, if it is found that the program content corresponding to this time is incorrect, it is determined as the display device to be controlled; at the same time, the device control scheme for the display device to be controlled in this scenario is: the main display device obtains the correct program from the cloud and sends it to other slave display devices for playback; further, in the actual application process, the main display device can share the correct playback progress with other slave display devices every five minutes. The playback progress can include the current playback time and the playback progress. Other slave display devices can adjust the current playback progress according to the sharing result.

[0102] The following will explain and illustrate the specific control process in the scenario of preventing device loss. Specifically, to prevent device loss, after the anti-loss mode is enabled on the display device, the trigger condition for other slave display devices in this scenario is that the device status is inconsistent; during the actual application process, after the master display device receives the trigger condition, it obtains the device status of other slave display devices; if the device status is 1, it is determined that the slave display device is in a normal state; if the device status is 2, it is determined that the slave display device is in a stolen state; specifically, the specific determination process of the device status is as follows: if the slave display device to be controlled identifies a stranger in the current screen, it is determined to be in a stolen state; at the same time, if the slave display device to be controlled detects a change in the distance ABCD from the surrounding walls shown in Figure 11 indicating that the device is moving, it is determined that the device is in a stolen state; at the same time, if the device to be controlled is in a state of being disconnected from the network, powered off, switching networks, shutting down, or accessing other USB drives, it is also determined to be in a stolen state. Further, in the stolen state, the specific device control scheme is as follows: if the master display device discovers that a device to be controlled has been stolen, it sends this information to all other devices and sends a message to the administrator; at the same time, other devices enter an emergency state, emit an alarm sound, start camera recording, upload it to the cloud, and capture photos of the thief; further, all display devices start the security mode, upload device files to the cloud, the screen enters the black screen mode, lock the USB interface, hide files and applications, turn on the remote control lock and file lock to protect the security of device information, and the thief cannot obtain internal information; finally, if the slave display device in the stolen state can receive the loss message, it also starts the security mode; if it can take pictures, obtain the location, and connect to the network, it automatically turns on the camera and sends the camera content and location to the cloud.

[0103] It should also be noted here that during the process of controlling the device status and device playback content of the display device to be controlled, in order to prevent information errors, password-based security verification is also required between the master display device and the display device to be controlled; when the display device to be controlled receives the password, it verifies whether it is the master display device, and after the verification is completed, it receives the device control scheme. Based on this method, there is no need to set up each device one by one, nor to remotely control manually, and it can also be completed within the local area network, and the set content can be triggered according to specific situations; at the same time, as the AI device administrator, the master device can intelligently assist the staff in managing other devices.

[0104] In this exemplary embodiment, a control method for a display device is first provided, and this method can run on a large-screen display terminal, etc.; of course, those skilled in the art can also run the method disclosed in this application on other platforms according to requirements, and no special limitation is made in this exemplary embodiment. Specifically, referring to Figure 12 shown, the control method for the display device may include the following steps:

[0105] Step S1210: Obtain the first device information of the slave display device, and send the first device information of the slave display device to the cloud server;

[0106] Step S1220: Receive the device trigger condition of the slave display device determined according to the first device information fed back by the cloud server, and determine the display device to be controlled from the slave display device according to the device trigger condition;

[0107] Step S1230: Send the second device information of the display device to be controlled to the cloud server, and receive the device control scheme determined according to the second device information fed back by the cloud server;

[0108] Step S1240: Control the device state and the device playing content of the display device to be controlled based on the device control scheme.

[0109] In the above control scheme of the display device, on the one hand, by obtaining the first device information of the slave display device and sending the first device information to the cloud server; then receiving the device trigger condition of the slave display device determined according to the first device information fed back by the cloud server, and determining the display device to be controlled from the slave display device according to the device trigger condition; further sending the second device information of the display device to be controlled to the cloud server, and receiving the device control scheme determined according to the second device information fed back by the cloud server; finally, controlling the device state and the device playing content of the display device to be controlled based on the device control scheme, the automatic control of the display device is realized, and the control efficiency of the display device is improved; on the other hand, since a corresponding device control scheme can be configured for the display device to be controlled, the personalized control of the display device is realized.

[0110] The following is an embodiment of the device of the present disclosure, which can be used to execute the embodiment of the method of the present disclosure. For the details not disclosed in the embodiment of the device of the present disclosure, please refer to the embodiment of the method of the present disclosure.

[0111] The exemplary embodiment of the present disclosure also provides a control device for a display device. Specifically, as shown in Figure 13 The control device for the display device may include a first device information acquisition module 1310, a display device to be controlled determination module 1320, a device control scheme determination module 1330, and a display device control module 1340. Among them:

[0112] The first device information acquisition module 1310 can be used to obtain the first device information of the slave display device and send the first device information of the slave display device to the cloud server;

[0113] The to-be-controlled display device determination module 1320 can be used to receive the device trigger condition of the slave display device determined according to the first device information fed back by the cloud server, and determine the to-be-controlled display device from the slave display devices according to the device trigger condition;

[0114] The device control scheme determination module 1330 can be used to send the second device information of the to-be-controlled display device to the cloud server, and receive the device control scheme determined according to the second device information fed back by the cloud server;

[0115] The display device control module 1340 can be used to control the device state and the device playback content of the to-be-controlled display device based on the device control scheme.

[0116] The specific details of each module in the above control device of the display device have been described in detail in the corresponding control method of the display device, so they will not be elaborated here.

[0117] It should be noted that although several modules or units of the devices for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of the two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0118] In addition, although the steps of the methods in the present disclosure are described in a specific order in the drawings, this does not require or imply that these steps must be executed in this specific order, or that all the steps shown must be executed to achieve the desired result. Additionally or alternatively, some steps can be omitted, multiple steps can be combined into one step for execution, and / or one step can be decomposed into multiple steps for execution, etc.

[0119] In the exemplary embodiments of the present disclosure, an electronic device capable of implementing the above method is also provided. Those skilled in the art can understand that various aspects of the present disclosure can be implemented as a system, a method, or a program product. Therefore, various aspects of the present disclosure can be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or an implementation combining hardware and software aspects, which can be collectively referred to as a circuit, a module, or a system here.

[0120] Next, refer to Figure 14 to describe the electronic device 1400 according to this embodiment of the present disclosure. Figure 14 The illustrated electronic device 1400 is merely an example and should not impose any limitation on the functions and usage scope of the embodiments of the present disclosure.

[0121] As shown Figure 14 in the figure, the electronic device 1400 is presented in the form of a general computing device. The components of the electronic device 1400 may include, but are not limited to: at least one of the above-mentioned processing units 1410, at least one of the above-mentioned storage units 1420, a bus 1430 connecting different system components (including the storage unit 1420 and the processing unit 1410), and a display unit 1440.

[0122] Among them, the storage unit stores program code, and the program code can be executed by the processing unit 1410, so that the processing unit 1410 executes the steps according to various exemplary embodiments of the present disclosure described in the "Exemplary Method" section of the present specification above. For example, the processing unit 1410 may execute steps S1210 as shown Figure 12 in the figure: obtain the first device information of the slave display device, and send the first device information of the slave display device to the cloud server; step S1220: receive the device trigger condition of the slave display device determined according to the first device information fed back by the cloud server, and determine the to-be-controlled display device from the slave display device according to the device trigger condition; step S1230: send the second device information of the to-be-controlled display device to the cloud server, and receive the device control scheme determined according to the second device information fed back by the cloud server; step S1240: control the device state and device playback content of the to-be-controlled display device based on the device control scheme.

[0123] The storage unit 1420 may include a readable medium in the form of a volatile storage unit, such as a random access storage unit (RAM) 14201 and / or a cache storage unit 14202, and may further include a read-only storage unit (ROM) 14203.

[0124] The storage unit 1420 may further include a program / utilities 14204 having a set (at least one) of program modules 14205. Such program modules 14205 include, but are not limited to: an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include the implementation of a network environment.

[0125] The bus 1430 may represent one or more of several types of bus structures, including a storage unit bus or a storage unit controller, a peripheral bus, a graphics acceleration port, a processing unit, or a local bus using any bus structure in a variety of bus structures.

[0126] The electronic device 1400 can also communicate with one or more external devices 1500 (such as a keyboard, a pointing device, a Bluetooth device, etc.), and can also communicate with one or more devices that enable a user to interact with the electronic device 1400, and / or communicate with any device that enables the electronic device 1400 to communicate with one or more other computing devices (such as a router, a modem, etc.). Such communication can be carried out through the input / output (I / O) interface 1450. Moreover, the electronic device 1400 can also communicate with one or more networks (such as a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) through the network adapter 14140. As shown in the figure, the network adapter 14140 communicates with other modules of the electronic device 1400 through the bus 1430. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in combination with the electronic device 1400, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0127] Through the description of the above embodiments, those skilled in the art can easily understand that the exemplary embodiments described herein can be implemented by software, or can be implemented by a combination of software and necessary hardware. Therefore, the technical solutions according to the embodiments of the present disclosure can be embodied in the form of a software product, and the software product can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the embodiments of the present disclosure.

[0128] In an exemplary embodiment of the present disclosure, there is also provided a computer-readable storage medium, on which a program product capable of implementing the above method of this specification is stored. In some possible implementation manners, various aspects of the present disclosure can also be implemented in the form of a program product, which includes program code. When the program product runs on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present disclosure described in the above "Exemplary Method" section of this specification.

[0129] The program product for implementing the above method according to the embodiments of the present disclosure is described. It can be a portable compact disc read-only memory (CD-ROM) and includes program code, and can run on a terminal device, such as a personal computer. However, the program product of the present disclosure is not limited thereto. In this document, the readable storage medium can be any tangible medium that contains or stores a program, and the program can be used by or in combination with an instruction execution system, device, or device.

[0130] The program product may employ any combination of one or more readable media. The readable media may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the readable storage medium (a non-exhaustive list) include: an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0131] A computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, in which the readable program code is carried. Such a propagated data signal may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the foregoing. The readable signal medium may also be any readable medium other than the readable storage medium, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the readable medium may be transmitted with any appropriate medium, including but not limited to wireless, wired, optical fiber cable, RF, etc., or any suitable combination of the foregoing.

[0132] The program code for performing the operations of the present disclosure may be written in any combination of one or more programming languages, including object-oriented programming languages such as Java, C++, etc., and also including conventional procedural programming languages such as the "C" language or similar programming languages. The program code may execute entirely on the user's computing device, partially on the user's device, as a stand-alone software package, partially on the user's computing device and partially on a remote computing device, or entirely on the remote computing device or server. In the case of a remote computing device, the remote computing device may be connected to the user's computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0133] In addition, the above drawings are only schematic illustrations of the processes included in the method according to the exemplary embodiments of the present disclosure, and are not for limiting purposes. It is easy to understand that the processes shown in the above drawings do not indicate or limit the chronological order of these processes. Additionally, it is also easy to understand that these processes may be executed, for example, synchronously or asynchronously in multiple modules.

[0134] Other embodiments of the present disclosure will be readily apparent to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known or customary technical means in the art that are not invented by the present disclosure. The specification and examples are only to be considered as exemplary, and the true scope and spirit of the present disclosure are pointed out by the claims.

Claims

1. A control system for a display device, characterized in that: It includes a main display device, a slave display device and a cloud server, wherein the main display device is communicatively connected with the slave display device and the cloud server respectively; wherein: The master display device is used to obtain the first device information of the slave display device, and send the first device information to the cloud server; The cloud server is used to determine the device triggering condition of the slave display device according to the first device information, and feed back the device triggering condition to the master control device; The master control device is further used to determine a display device to be controlled from the slave display devices according to the device triggering condition, and determine a device control scheme for the display device to be controlled; The main control device is further used to control the device state and device playback content of the display device to be controlled based on the device control scheme.

2. The control system of the display device according to claim 1, characterized in that: The first device information includes at least one of first device attribute information, first OTA version information, first application list information, and first current device state information of the slave display device; The first current device state information includes at least one of parameter information of the first device itself of the slave display device, parameter information of the first device environment in which the slave display device is currently located, and playback state information of the first program currently being played by the slave display device; Among them, the cloud server is also used to: call a preset trigger condition prediction model, and input the first device attribute information, the first OTA version information, the first application list information and the first current device status information into the preset trigger condition prediction model to obtain the device trigger condition from the display device.

3. The control system of the display device according to claim 2, characterized in that: The control system of the display device further comprises a main control device, the main control device being communicatively connected with the main display device, the main control device being used to: construct a device attribute information list corresponding to the main display device and / or the slave display device, and import the first device attribute information in the device attribute information list into the main display device based on a preset import method; The master display device is further used to send the first device attribute information to a slave display device corresponding to the master display device.

4. The control system of the display device according to claim 3, characterized in that: The slave display device includes a slave display device with a first priority level and / or a slave display device with a second priority level; the first priority level is higher than the second priority level; The master display device is further used to: send the first device attribute information to a slave display device with a first priority level corresponding to the master display device; The slave display device with the first priority level is used for sending the first device attribute information to the slave display device with the second priority level corresponding to the slave display device with the first priority level.

5. The control system of the display device according to claim 1, characterized in that: The main display device is also used for: Matching the current device status information and the device triggering condition of the slave display device; If the current device status information and the device trigger condition are consistent, determining that the slave display device corresponding to the current device status information is the display device to be controlled; If the current device status information and the device trigger condition are inconsistent, it is determined that the slave display device corresponding to the current device status information is not the display device to be controlled.

6. The control system of the display device according to claim 1, characterized in that: The main display device is further used to: obtain second device information of the display device to be controlled, and send the second device information to the cloud server; The cloud server is further used to determine a device control scheme for the display device to be controlled according to the second device information, and send the device control scheme to the main display device.

7. The control system of the display device according to claim 6, characterized in that: The cloud server is also used to: call a preset control scheme prediction model, and input the second device information into the preset control scheme prediction model to obtain the device control scheme of the display device to be controlled; wherein the preset control scheme prediction model includes a first input layer, an embedded mapping layer, a coding layer, a hybrid expert model layer and a first output layer.

8. The control system of the display device according to claim 7, characterized in that: The device control scheme of the display device to be controlled is predicted by the following method: Generate the basic information to be predicted according to the second device attribute information, the second OTA version information and the second current device state information of the display device to be controlled, and generate the context information to be predicted according to the second application list information of the display device to be controlled and the preset model prompt parameters; Performing word embedding processing on the basic information to be predicted based on the embedding mapping layer to obtain device features, and performing embedding mapping processing on the context information to be predicted based on the embedding mapping layer to obtain a context marker sequence; The device features and the context flag sequence are encoded based on the encoding layer to obtain the overall context representation, and the context flag sequence and the overall context representation are predicted based on the hybrid expert model layer to obtain a device control scheme for the display device to be controlled.

9. The control system of the display device according to claim 8, characterized in that: The hybrid expert model layer includes a first gated network model, a second gated network model, a third gated network model and an expert neural network model; The process of predicting the context marker sequence and the overall context representation based on the hybrid expert model layer to obtain a device control scheme for the display device to be controlled includes: Based on the first gated network model, the second gated network model and the third gated network model, determining from the expert neural network model a first target neural network model, a second target neural network model and a third target neural network model required for executing the prediction task of the device control scheme; The context flag sequence and the overall context representation are predicted according to the first target neural network model, the second target neural network model and the third target neural network model to obtain a device control scheme for the display device to be controlled.

10. The control system of the display device according to claim 9, characterized in that: Based on the first gated network model, the second gated network model and the third gated network model, determining the first target neural network model, the second target neural network model and the third target neural network model required for executing the prediction task of the device control scheme from the expert neural network model, including: Determine, based on the first gating network model and according to the context flag sequence, a first model weight of the expert neural network model on a first control scheme dimension corresponding to the current state information of the device itself, and determine, from the expert neural network, a first target neural network model required for performing a prediction task of the device control scheme on the first control scheme dimension according to the first model weight; Determine, based on the second gating network model and according to the context flag sequence, a second model weight of the expert neural network model on a second control scheme dimension corresponding to the current environment information of the device, and determine, from the expert neural network, a second target neural network model required for performing a prediction task of the device control scheme on the second control scheme dimension according to the second model weight; Based on the third gating network model, according to the context flag sequence, the third model weight of the expert neural network model on the third control scheme dimension corresponding to the current program information played by the device is determined, and according to the third model weight, the third target neural network model required for performing the prediction task of the device control scheme on the third control scheme dimension is determined from the expert neural network.

11. The control system of the display device according to claim 9, characterized in that: The context flag sequence and the overall context representation are predicted according to the first target neural network model, the second target neural network model and the third target neural network model to obtain a device control scheme for the display device to be controlled, including: Inputting the context flag sequence and the overall context representation into a first target neural network model to obtain a first prediction result on a first control scheme dimension corresponding to current state information of the device itself; Inputting the context marker sequence and the overall context representation into a second target neural network model to obtain a second prediction result on a second control scheme dimension corresponding to the current environment information of the device; Inputting the context marker sequence and the overall context representation into a third target neural network model to obtain a third prediction result on a third control scheme dimension corresponding to current program information played by the device; A device control scheme for the display device to be controlled is generated according to the first prediction result, the second prediction result and the third prediction result.

12. The control system of the display device according to claim 1, characterized in that: The main display device is also used for: The device status information of the display device to be controlled is controlled according to the first prediction result and the second prediction result in the device control scheme, and the device playback content of the display device to be controlled is controlled according to the third prediction result in the device control scheme.

13. The control system of the display device according to claim 12, characterized in that: The device status information of the display device to be controlled includes at least one of the following: Power on / off status, open application / close application, connect signal source / disconnect signal source, open screen saver / close screen saver, connect network / disconnect network, turn on camera / turn off camera, sound alarm / turn off alarm, start security model / turn off security mode, upload file / download file, turn on remote control lock and file lock / turn off remote control lock and file lock, lock hardware interface / open hardware interface, hide files and applications / open files and applications.

14. A method for controlling a display device, characterized in that: Configured in a main display device, the control method of the display device includes: Acquire first device information of a slave display device, and send the first device information of the slave display device to a cloud server; receiving a device triggering condition of a slave display device determined according to the first device information and fed back by the cloud server, and determining a display device to be controlled from the slave display device according to the device triggering condition; Sending the second device information of the display device to be controlled to the cloud server, and receiving the device control solution determined according to the second device information fed back by the cloud server; The device state of the display device to be controlled and the device playback content are controlled based on the device control scheme.

15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method for controlling the display device according to claim 14 is implemented.

16. An electronic device, characterized in that: include: processor; and a memory for storing executable instructions for the processor; The processor is configured to execute the control method of the display device of claim 14 by executing the executable instructions.

Images