Multimedia centralized control method based on digital twin

Abstract

The present invention discloses a multimedia centralized control method based on digital twins, which relates to the field of multimedia control technology, including: using a multimedia twin model to simulate the operation of multimedia; obtaining the control path of each device in the multimedia for a projector, and obtaining the multi-path startup time of the projector; analyzing historical operation data, and setting the pre-startup time of the projector based on the analysis results; the present invention is used to solve the problem in the prior art that when a device in the multimedia is started, some devices will have a situation where it takes a long time from issuing a startup instruction to fully starting the device. Even if the startup instruction can be sent to the device in the multimedia in time based on the existing improved method, it still takes a long time to wait, thereby reducing the startup efficiency of the multimedia in actual applications.

Description

Technical Field

[0001] The present invention relates to the field of multimedia control technology, and in particular to a multimedia centralized control method based on digital twins. Background Art

[0002] Multimedia is a combination of multiple media, generally including multiple media forms such as text, sound and image; in computer systems, multimedia refers to a human-computer interactive information exchange and communication medium that combines two or more media; the media used include text, pictures, photos, sound, animation and video, as well as interactive functions provided by the program; and the various media forms in multimedia are usually realized through multiple devices; digital twin is a technology that uses physical models, sensor data and simulation processes to create digital mapping of physical objects in virtual space.

[0003] Existing improvements in multimedia control usually optimize the convenience and intelligence of multimedia, such as analyzing the running trajectory of multimedia controls on the terminal screen and controlling the release of multimedia information based on the analysis results. Although this improvement method can improve the intelligence of multimedia, when controlling the startup of devices in multimedia, some devices may take a long time from issuing a startup instruction to fully starting the device. Even if the startup instruction is sent to the device in the multimedia in time based on the running trajectory of the multimedia control, it still takes a long time to wait, thereby reducing the startup efficiency of multimedia in practical applications. For example, in a patent application with publication number CN103713850A, a multimedia control method, device and terminal are disclosed. This solution is to realize multimedia control based on the motion trajectory of multimedia controls, thereby improving the convenience and intelligence of multimedia control. Other improvements in multimedia control are usually based on sound signals to make multimedia more efficient when executing control, but this improvement method still cannot shorten the time between issuing a startup instruction and fully starting the device in the multimedia when starting, resulting in unnecessary time waste when using multimedia. In view of this, it is necessary to improve the existing multimedia control method. Summary of the invention

[0004] The present invention aims to solve at least one of the technical problems in the prior art to a certain extent. By proposing a multimedia centralized control method based on digital twins, it is used to solve the problem in the prior art that when the devices in the multimedia are started, some devices will take a long time from issuing a startup command to fully starting the device. Even if the startup command is sent to the device in the multimedia in time based on the running trajectory of the multimedia control, it still takes a long time to wait, thereby reducing the startup efficiency of the multimedia in actual applications.

[0005] To achieve the above objectives, the present application provides a multimedia centralized control method based on digital twins, comprising the following steps:

[0006] Establish a multimedia twin model based on digital twins and multimedia, and use the multimedia twin model to simulate the operation of multimedia;

[0007] During multimedia operation, the control path of each device in the multimedia for the projector is obtained based on the multimedia twin model, and the path startup time of the projector is obtained based on the control path and the startup time of the projector;

[0008] The historical operation data of the operator in the multimedia is analyzed, and based on the analysis result, the pre-start time of the projector is set when the operator performs each operation on the multimedia.

[0009] Furthermore, a multimedia twin model is established based on digital twins and multimedia, and the multimedia twin model is used to simulate the operation of multimedia, including:

[0010] Obtain multiple devices in the multimedia and the connection methods between the multiple devices; establish a multimedia twin model through digital twins based on all devices and all connection methods in the multimedia;

[0011] When multimedia is actually used, equivalent operations are performed in the multimedia twin model based on the devices and interactive operations initiated by the operator in the media.

[0012] Furthermore, during the multimedia operation, obtaining the control path of each device in the multimedia for the projector based on the multimedia twin model, and obtaining the path startup duration of the projector based on the control path and the startup duration of the projector include:

[0013] For any device α in the multimedia, record the devices in the multimedia other than α that can be controlled by device α as controllable devices; obtain the controllable devices corresponding to all devices in the multimedia; establish a table of T rows × T columns, recorded as a control analysis table, wherein the top row of the control analysis table is filled with multiple devices in the multimedia from left to right except the first cell, and the leftmost column of the control analysis table is filled with multiple devices in the multimedia from top to bottom except the first cell; for any device β in the leftmost column of the control analysis table, obtain the controllable devices of device β, and record the cells where the columns where the controllable devices of device β are located and the rows where device β is located in the 2nd column to the Tth column from left to right in the control analysis table as the controllable cells of device β, and obtain the controllable cells corresponding to all devices in the leftmost column of the control analysis table.

[0014] Furthermore, during the multimedia operation, obtaining the control path of each device in the multimedia for the projector based on the multimedia twin model, and obtaining the path startup duration of the projector based on the control path and the startup duration of the projector also includes:

[0015] For all devices in the multimedia except the projector, the path acquisition method is used to obtain the control path of some devices on the projector;

[0016] The path startup duration corresponding to each control path is obtained based on the startup duration of the projector.

[0017] Furthermore, the path acquisition method includes:

[0018] For any device other than a projector in the multimedia, when there is a projector among the controllable devices of the device, the device is recorded as a first-level master control device; when there is a first-level master control device among the controllable devices of a device that is not recorded as a first-level master control device, the device is recorded as a second-level inter-control device; when there is a second-level inter-control device among the controllable devices of a device that is not recorded as a second-level inter-control device and a first-level master control device, the device is recorded as a third-level inter-control device; and so on, until a K-level inter-control device is obtained, wherein a K-level inter-control device is a device that has a K-1-level inter-control device or a first-level master control device among the control devices;

[0019] Delete the rows containing the devices in the leftmost column of the control analysis table that are not recorded as first-level main control devices except the projector, or the devices that are not recorded as any of the second-level to K-level intermediate control devices.

[0020] Furthermore, the path acquisition method also includes:

[0021] For any first-level master control device, the control path of the first-level master control device is set to: first-level master control device → projector; for any K1-level inter-control device from the second-level inter-control device to the K-level inter-control device, the control path of the K1-level inter-control device is set to: K1-level inter-control device → (K1-1)-level inter-control device among the controllable devices of the K1-level inter-control device →... → first-level master control device → projector, where K1 is a positive integer less than or equal to K and greater than or equal to 1.

[0022] Further, obtaining the path startup duration corresponding to each control path based on the startup duration of the projector also includes:

[0023] The time from when the projector receives the start-up command to when it can project is recorded as the start-up time; for any device in the leftmost column of any control analysis table, for any two devices separated by "→" in the control path of the device, the device pointed by the arrow is recorded as the lower-level device, the device that sends the arrow is recorded as the upper-level device, and the time from when the upper-level device sends the command to when the lower-level device receives the command and performs the operation is recorded as the single-level control time, and the sum of all single-level control times corresponding to the control path of the device is obtained, which is recorded as the total control time;

[0024] The sum of the total control time and the startup time is recorded as the path startup duration; the path startup duration corresponding to the control paths of all devices in the leftmost column of the control analysis table is obtained.

[0025] Further, analyzing the historical operation data of the operator in the multimedia, and setting the pre-start time of the projector when the operator performs each operation on the multimedia based on the analysis result includes:

[0026] Acquire all operation data of the multimedia after each startup, and record the operation data after each startup as historical operation data LC1 to historical operation data LC n ; For any control path with only one primary master control device and a projector, the total control time of the control path is recorded as the reference control time, and the primary master control device in the control path is recorded as the analysis device; obtain the historical operation data of starting the analysis device and the projector in all historical operation data LC, and record them as the analysis operation data FC; record the time from starting the analysis device to the time when the projector can project in all analysis operation data FC as the analysis operation time; record the difference between the maximum value of all analysis operation times and the reference control time as the adjustment limit time of the control path; record the difference between the minimum value of all analysis operation times and the reference control time as the shortest adjustment time of the control path.

[0027] Furthermore, analyzing the historical operation data of the operator in the multimedia, and setting the pre-start time of the projector when the operator performs each operation on the multimedia based on the analysis result also includes:

[0028] For any control path containing an intermediate control device, for any group of upper-level devices and lower-level devices in the control path, obtain the historical operation data of starting the upper-level device and the lower-level device in all historical operation data LC, and record them as upper-lower-level operation data SC; record the time from starting the upper-level device to starting the lower-level device in all upper-lower-level operation data SC as the upper-lower-level operation time, and record the value obtained by subtracting the single-level control time corresponding to the upper-level device and the lower-level device from the maximum value of all upper-lower-level operation times as the single-level limit time; record the value obtained by subtracting the single-level control time corresponding to the upper-level device and the lower-level device from the minimum value of all upper-lower-level operation times as the single-level shortest time; record the sum of the single-level shortest times of all upper-level devices and their corresponding lower-level devices in the control path as the shortest adjustment time of the control path; record the sum of the single-level limit times of all upper-level devices and their corresponding lower-level devices in the control path as the adjustment limit time of the control path;

[0029] When the multimedia is started, the device that the operator has recently started in the multimedia is recorded as the latest device. When the latest device is in only one control path, the single-path algorithm is used to obtain the pre-startup time of the projector. The single-path algorithm includes: Among them, G is the pre-startup duration, G1 is the start-up time, G2 is the shortest adjustment time of the control path, and g1 is the difference between the shortest adjustment time of the control path and the start-up duration; when the latest device is started, after the adjustment limit time of the control path where the latest device is located has passed, the pre-startup duration of the projector obtained by the latest device will be deleted;

[0030] When the latest device is in multiple control paths, the pre-start time corresponding to each control path corresponding to the latest device is obtained based on the single-path algorithm, and the minimum value of all pre-start time is recorded as the pre-start time of the projector; the maximum value of the adjustment limit time corresponding to all control paths where the latest device is located is obtained, and recorded as the retention limit time of the latest device. When the latest device is started and the retention limit time has passed, the pre-start time of the projector obtained by the latest device will be deleted.

[0031] Furthermore, analyzing the historical operation data of the operator in the multimedia, and setting the pre-start time of the projector when the operator performs each operation on the multimedia based on the analysis result also includes:

[0032] The latest pre-start duration of the projector is obtained in real time. When the pre-start duration is 0, the projector is pre-started; when the pre-start duration is not 0, the projector is pre-started after the pre-start duration, wherein the pre-start is to start the projector in the background of the multimedia device.

[0033] Beneficial effects of the present invention: the present invention first establishes a multimedia twin model based on digital twins and multimedia, and uses the multimedia twin model to simulate the operation of the multimedia; then, during the operation of the multimedia, the control path of the projector by each device in the multimedia is obtained based on the multimedia twin model, and the path start-up time of the projector is obtained based on the control path and the start-up time of the projector. The advantage of this is that by establishing a multimedia digital twin model based on digital twins, it is helpful to obtain a variety of data required by the present invention through digital mapping without starting the actual device in subsequent analysis, thereby improving the efficiency of data analysis while ensuring the authenticity and validity of the data; by obtaining the path start-up time of each control path, it is possible to obtain the time required from starting to the projector being able to project when the projector is started by each device in the multimedia during the actual operation of the multimedia by the operator, thereby helping to obtain the pre-start-up time, thereby reducing the waiting time of the operator when the projector is actually started, and improving the start-up efficiency of multimedia in practical applications;

[0034] The present invention also analyzes the operator's historical operation data in the multimedia, and based on the analysis results sets the pre-start time of the projector when the operator performs each operation on the multimedia. The advantage of this is that by obtaining the pre-start time based on each operation of the operator, the time when the projector needs to be pre-started can be obtained through the pre-start time, thereby ensuring that when the operator sends a start command to the projector, the projector can directly project, thereby shortening the start-up time of the projector, thereby shortening the waiting time of the operator when using the projector, and improving the startup efficiency of the multimedia in practical applications. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 is a functional block diagram of the system of the present invention;

[0036] Figure 2 A schematic diagram of obtaining the regulatory pathway of the present invention;

[0037] Figure 3 It is a principle block diagram of the electronic device of the present invention. DETAILED DESCRIPTION

[0038] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0039] Example 1, first aspect, please refer to Figure 1 As shown, the present application provides a multimedia centralized control method based on digital twins, comprising the following steps: Step S1, establishing a multimedia twin model based on digital twins and multimedia, and using the multimedia twin model to simulate the operation of the multimedia;

[0040] Step S1 includes: step S101, obtaining multiple devices in the multimedia and connection methods between the multiple devices; based on all devices and all connection methods in the multimedia, establishing a multimedia twin model through digital twins;

[0041] In a specific implementation process, for example, a device corresponding to a multimedia includes a projector and a terminal controller, and the connection mode between the terminal controller and the projector can be a network connection or a Bluetooth connection;

[0042] Step S102, when multimedia is actually used, based on the devices started by the operator in the media and the interactive operations, the same operations are performed in the multimedia twin model; in the specific implementation process, by using the multimedia twin model to simulate the same operations on the multimedia, it is helpful to obtain the various data required by the present invention through digital mapping without starting the actual device in the subsequent analysis, thereby improving the efficiency of data analysis while ensuring the authenticity and validity of the data.

[0043] Step S2: during the multimedia operation, obtaining the control path of each device in the multimedia for the projector based on the multimedia twin model, and obtaining the path startup duration of the projector based on the control path and the startup duration of the projector;

[0044] Step S2 includes: step S201, for any device α in the multimedia, record the devices other than α in the multimedia that can be controlled by device α as controllable devices; obtain the controllable devices corresponding to all devices in the multimedia; establish a table of T rows × T columns, recorded as a control analysis table, wherein the top row of the control analysis table is filled with multiple devices in the multimedia from left to right except the first cell, and the leftmost column of the control analysis table is filled with multiple devices in the multimedia from top to bottom except the first cell; for any device β in the leftmost column of the control analysis table, obtain the controllable devices of device β, and record the cells where the columns where the controllable devices of device β are located and the rows where device β is located in the 2nd column to the Tth column from left to right in the control analysis table as the controllable cells of device β, and obtain the controllable cells corresponding to all devices in the leftmost column of the control analysis table;

[0045] In the specific implementation process, when the adjustment analysis table is actually established, the value of T is the number of all devices in the multimedia plus 1. For example, if the number of devices in the multimedia is 10, the value of T is 11. For example, in an actual analysis, the devices in the multimedia include device A, device B, and device C, and devices A, device B, and device C can control each other. The established control analysis table is shown in Table 1: Control analysis table:

[0046] Table 1: Regulation analysis table

[0047] Device A Device B Device C Device A Controllable Grid Controllable Grid Device B Controllable Grid Controllable Grid Device C Controllable Grid Controllable Grid

[0048] Step S202: For all devices in the multimedia except the projector, a path acquisition method is used to acquire the control path of some devices on the projector.

[0049] The path acquisition method includes: step S2021, for any device in the multimedia except the projector, when there is a projector in the controllable devices of the device, the device is recorded as a first-level master control device; when there is a first-level master control device in the controllable devices of the device that is not recorded as the first-level master control device, the device is recorded as a second-level inter-control device; when there is a second-level inter-control device in the controllable devices of the device that is not recorded as the second-level inter-control device and the first-level master control device, the device is recorded as a third-level inter-control device; and so on, until a K-level inter-control device is obtained, wherein the K-level inter-control device is a device that has a K-1-level inter-control device or a first-level master control device in the control device;

[0050] For example, in the specific implementation, for example, the control analysis table obtained in an analysis can be found in Figure 2 As shown, Figure 2 The table in the figure is a control analysis table. A1 to A4 are four devices in the multimedia, and the device corresponding to A2 is a projector. The cell where ○ is located is a controllable cell. Through the Q1 box, it can be seen that the device corresponding to A1 can control the projector. Therefore, the device corresponding to A1 is the first-level main control device of the projector. Similarly, through the Q2 and Q3 boxes, it can be seen that the devices corresponding to A3 and A4 are second-level and third-level control devices, respectively. Therefore, a control path can be obtained: A4→A3→A1→A2;

[0051] Some of the devices in the multimedia are the terminal controller, the external controller, the display controller and the projector. Through the control analysis table, it is found that the display controller has a projector among the controllable devices, the external controller has a display controller but no projector among the controllable devices, and the terminal controller has an external controller but no display controller and projector among the controllable devices. Through analysis, it can be obtained that the terminal controller is a third-level inter-control device, the external controller is a second-level inter-control device, and the display controller is a first-level main control device.

[0052] Step S2022, in the leftmost column of the control analysis table, the row where the equipment other than the projector is not recorded as the first-level main control equipment, or the equipment not recorded as any of the second-level room control equipment to the K-level room control equipment is located is deleted from the control analysis table. In the specific implementation process, for example, in actual application, the row number of the equipment "audio" in the control analysis table is the 10th row, and the audio is not recorded as the first-level main control equipment or any of the second-level room control equipment to the K-level room control equipment, then the 10th row where the audio is located is deleted from the control analysis table. In the subsequent analysis, only the equipment recorded as the first-level main control equipment or any of the second-level room control equipment to the K-level room control equipment is analyzed, so it is necessary to delete the equipment that is not analyzed to reduce space occupation;

[0053] Step S2023, for any first-level master control device, the control path of the first-level master control device is set to: first-level master control device → projector; for any K1-level inter-control device from the second-level inter-control device to the K-level inter-control device, the control path of the K1-level inter-control device is set to: K1-level inter-control device → (K1-1)-level inter-control device among the controllable devices of the K1-level inter-control device → ... → first-level master control device → projector, where K1 is a positive integer less than or equal to K and greater than or equal to 1;

[0054] In the specific implementation process, for example, in a data processing process, a third-level intermediate control device is obtained as a terminal controller, and the second-level intermediate control device and the first-level main control device corresponding to the terminal controller are the external controller and the display controller respectively. The control path corresponding to the terminal controller is: terminal controller → external controller → display controller → projector.

[0055] Step S203, based on the startup duration of the projector, the path startup duration corresponding to each control path is obtained; step S203 also includes: recording the time from when the projector receives the startup instruction to when it can project as the startup time; for any device in the leftmost column of any control analysis table, for any two devices separated by “→” in the control path of the device, the device pointed by the arrow is recorded as the subordinate device, the device that issues the arrow is recorded as the superior device, the time from when the superior device issues the instruction to when the subordinate device receives the instruction and performs the operation is recorded as the single-level control time, and the sum of all single-level control times corresponding to the control path of the device is obtained, which is recorded as the total control time;

[0056] In a specific implementation, for example, the startup time of the projector in the multimedia to be analyzed is 30s, and a control analysis table is: terminal controller→external controller→display controller→projector; then for "external controller→display controller" in the control analysis table, "external controller" is the upper-level device, and "display controller" is the lower-level device. The time from the external controller issuing a command to the display controller executing the operation is 1s, and the single-level control time is 1s; taking the above control analysis table as an example, by obtaining the single-level control time and obtaining the total control time based on the single-level control time, it is possible to obtain the shortest time that the projector in the multimedia can project after the operator issues a command to the terminal controller to start the projector, that is, the total control time obtained, so as to help obtain the time that the projector needs to be pre-started in the background in actual application, so that after the operator issues a command to the terminal controller, when the display controller receives the execution and starts the projector, the projector can directly project without consuming the startup time, thereby shortening the waiting time of the operator when using the projector and improving the startup efficiency of the multimedia in actual application;

[0057] The sum of the total control time and the startup time is recorded as the path startup duration; the path startup duration corresponding to the control paths of all devices in the leftmost column of the control analysis table is obtained.

[0058] Step S3, analyzing the operator's historical operation data in the multimedia, and setting the pre-start time of the projector based on the analysis result when the operator performs each step of the multimedia operation; Step S3 includes: Step S301, obtaining all operation data of the multimedia after each startup, and recording the operation data after each startup as historical operation data LC1 to historical operation data LC n ; For any control path with only one primary master control device and a projector, the total control time of the control path is recorded as the reference control time, and the primary master control device in the control path is recorded as the analysis device; the historical operation data of starting the analysis device and the projector in all historical operation data LC is obtained and recorded as the analysis operation data FC; the time from starting the analysis device to the projector being able to project in all analysis operation data FC is recorded as the analysis operation time; the difference between the maximum value of all analysis operation times and the reference control time is recorded as the adjustment limit time of the control path; the difference between the minimum value of all analysis operation times and the reference control time is recorded as the adjustment shortest time of the control path;

[0059] In the specific implementation process, for example, in an actual analysis, the reference control time of the control path terminal controller→external controller→display controller→projector is 2 minutes, which means that after the operator starts the terminal controller, at least 2 minutes are needed for the projector to start projecting. In actual use, the time from the operator starting the terminal controller to starting the projector is represented by the analysis operation time obtained in this embodiment. For example, in this analysis, the maximum value of the analysis operation time is 10 minutes and the minimum value is 5 minutes. This means that under the operator's usage habits, the command to start the projector will be issued at least 3 minutes after the terminal controller is started, that is, the shortest adjustment time. And the command to start the projector will not be issued 8 minutes after the operator starts the terminal controller, that is, the adjustment limit time. By obtaining the adjustment limit time and the shortest adjustment time, the time interval in which the projector may be started after the terminal controller is started can be effectively obtained, thereby providing data support for the subsequent acquisition of the pre-start duration.

[0060] Step S302, for any control path containing an intermediate control device, for any group of upper-level devices and lower-level devices in the control path, obtain the historical operation data of starting the upper-level device and the lower-level device in all historical operation data LC, and record them as upper-lower-level operation data SC; record the time from starting the upper-level device to starting the lower-level device in all upper-lower-level operation data SC as the upper-lower-level operation time, and record the value obtained by subtracting the single-level control time corresponding to the upper-level device and the lower-level device from the maximum value of all upper-lower-level operation times as the single-level limit time; record the value obtained by subtracting the single-level control time corresponding to the upper-level device and the lower-level device from the minimum value of all upper-lower-level operation times as the single-level shortest time; record the sum of the single-level shortest times of all upper-level devices and their corresponding lower-level devices in the control path as the shortest adjustment time of the control path; record the sum of the single-level limit times of all upper-level devices and their corresponding lower-level devices in the control path as the adjustment limit time of the control path;

[0061] In the specific implementation process, by obtaining the single-stage shortest time in the control path, the obtained shortest adjustment time can be the shortest time for the operator to move the projector through the control path for projection in actual application;

[0062] Step S303: after the multimedia is started, the device most recently started by the operator in the multimedia is recorded as the latest device. When the latest device is in only one control path, a single path algorithm is used to obtain the pre-startup time of the projector. The single path algorithm includes: Among them, G is the pre-startup duration, G1 is the start-up time, G2 is the shortest adjustment time of the control path, and g1 is the difference between the shortest adjustment time of the control path and the start-up duration; when the latest device is started, after the adjustment limit time of the control path where the latest device is located has passed, the pre-startup duration of the projector obtained by the latest device will be deleted;

[0063] For example, in a data processing process, the latest started device is the terminal controller, and the control path corresponding to the terminal controller is controller→external controller→display controller→projector; the startup time obtained at the same time is 1 minute, and the shortest adjustment time is 0.5 minutes, which means that after the operator starts the terminal controller, the terminal controller will issue a command to start the projector at the shortest time after 0.5 minutes, but the startup time of the projector is 1 minute, so it is necessary to pre-start the projector directly in the background to ensure that if the operator issues a command to start the projector from the terminal controller after 0.5 minutes, the projector can directly project. Even if it cannot project directly, it can shorten the time from issuing the command to start the projector to the projector being able to project without the improvement of this embodiment; for example, During a data processing process, the latest started device is the terminal controller, and the control path corresponding to the terminal controller is controller→external controller→display controller→projector; the startup time obtained at the same time is 1min, and the shortest adjustment time is 1.5min. Then, by subtracting 1min from 1.5min, 0.5min is obtained, that is, g1. It can be obtained that if the operator issues an instruction to start the projector from the terminal controller after 1.5min, the projector will be pre-started at least 0.5min later. That is, when the operator issues an instruction to start the projector from the terminal controller after 1.5min, the projector is already in a startup state capable of projection, thereby satisfying the projection needs of the operator and shortening the waiting time of the operator when using the projector, thereby improving the startup efficiency of multimedia in practical applications;

[0064] Step S304, when the latest device is in multiple control paths, the pre-start duration corresponding to each control path corresponding to the latest device is obtained based on the single-path algorithm, and the minimum value of all pre-start durations is recorded as the pre-start duration of the projector; the maximum value of the adjustment limit time corresponding to all control paths where the latest device is located is obtained, and recorded as the retention limit time of the latest device. When the latest device is started and the retention limit time has passed, the pre-start duration of the projector obtained by the latest device is deleted. In the specific implementation process, when the latest device is started and the retention limit time has passed, by analyzing the operator's usage habits, it can be obtained that the operator has no habit of starting the projector after the retention limit time has passed. Therefore, there is no need to pre-start the projector after the retention limit time has passed, so as to reduce resource consumption;

[0065] Step S305, obtaining the latest pre-start duration of the projector in real time, when the pre-start duration is 0, pre-starting the projector; when the pre-start duration is not 0, pre-starting the projector after the pre-start duration, wherein the pre-start is to start the projector in the background of the multimedia device.

[0066] Example 2, please refer to Figure 3 As shown, Figure 3 The structural schematic diagram of an electronic device is illustrated, and the electronic device may include: a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus. The memory stores computer-readable instructions, and the processor can call the instructions in the memory. When the computer-readable instructions are executed by the processor, the steps in the multimedia centralized control method based on digital twins are executed to achieve the following functions: first, a multimedia twin model is established based on digital twins and multimedia, and the multimedia twin model is used to simulate the operation of the multimedia; then, during the operation of the multimedia, the control path of each device in the multimedia to the projector is obtained based on the multimedia twin model, and the path startup time of the projector is obtained based on the control path and the startup time of the projector; finally, the historical operation data of the operator in the multimedia is analyzed, and based on the analysis results, the pre-startup time of the projector is set when the operator performs each step of the multimedia operation.

[0067] In addition, the logic instructions in the above-mentioned memory can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product. Based on this understanding, the technical solution of the present application can be essentially or partly embodied in the form of a software product that contributes to the prior art, and the computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a disk or an optical disk.

[0068] Example 3. The present application also provides a computer program product, which includes a computer program stored on a computer-readable storage medium, and the computer program includes program instructions. When the program instructions are executed by the computer, the computer can execute the multimedia centralized control method based on digital twins provided by the above methods. The method includes: first, establishing a multimedia twin model based on digital twins and multimedia, and using the multimedia twin model to simulate the operation of the multimedia; then, during the operation of the multimedia, obtaining the control path of the projector by each device in the multimedia based on the multimedia twin model, and obtaining the path startup time of the projector based on the control path and the startup time of the projector; finally, analyzing the operator's historical operation data in the multimedia, and setting the pre-startup time of the projector based on the analysis results when the operator performs each step of the multimedia operation.

[0069] Example 4. The present application also provides a computer-readable storage medium. The present application provides a storage medium on which a computer program is stored. When the computer program is executed by the processor, the steps in the multimedia centralized control method based on digital twins are executed to achieve the following functions: first, a multimedia twin model is established based on digital twins and multimedia, and the multimedia twin model is used to simulate the operation of the multimedia; then, during the operation of the multimedia, the control path of the projector of each device in the multimedia is obtained based on the multimedia twin model, and the path startup time of the projector is obtained based on the control path and the startup time of the projector; finally, the operator's historical operation data in the multimedia is analyzed, and based on the analysis results, the pre-start time of the projector is set when the operator performs each step of the multimedia operation.

[0070] Through the description of the above implementation methods, the embodiments of the present invention can be provided as methods, systems or computer program products. Based on such an understanding, the above technical solutions can be essentially or partly contributed to the prior art in the form of software products, which can be stored in a computer-readable storage medium, such as ROM / RAM, a magnetic disk, an optical disk, etc., and include several instructions for enabling a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0071] In the embodiments provided in the present application, it should be understood that the disclosed system or method can be implemented in other ways. The embodiments described above are merely schematic. For example, the division of modules or units is only a logical function division. There may be other division methods in actual implementation. For example, multiple modules or units can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of systems, modules and units can be electrical, mechanical or other forms.

[0072] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A multimedia centralized control method based on digital twins, characterized in that: The steps include: Establish a multimedia twin model based on digital twins and multimedia, and use the multimedia twin model to simulate the operation of multimedia; During multimedia operation, the control path of each device in the multimedia for the projector is obtained based on the multimedia twin model, and the path startup time of the projector is obtained based on the control path and the startup time of the projector; Analyze the operator's historical operation data in the multimedia, and set the pre-start time of the projector when the operator performs each step of the multimedia operation based on the analysis result; During multimedia operation, the control path of each device in the multimedia for the projector is obtained based on the multimedia twin model. The path startup time of the projector is obtained based on the control path and the startup time of the projector, and the following steps are also included: For all devices in the multimedia except the projector, the path acquisition method is used to obtain the control path of some devices on the projector; Obtaining the path startup time corresponding to each control path based on the startup time of the projector; The path acquisition methods include: For any device other than the projector in the multimedia, when there is a projector among the controllable devices of the device, the device is recorded as a first-level master control device; when there is a first-level master control device among the controllable devices of the device that is not recorded as the first-level master control device, the device is recorded as a second-level inter-control device; when there is a second-level inter-control device among the controllable devices of the device that is not recorded as the second-level inter-control device and the first-level master control device, the device is recorded as a third-level inter-control device; and so on, until a K-level inter-control device is obtained, wherein a K-level inter-control device is a device that has a K-1-level inter-control device among the control devices; The path startup duration corresponding to each control path is obtained based on the startup duration of the projector and also includes: The time from when the projector receives the start command to when it can start projection is recorded as the start time; The time from when the upper-level device issues a command to when the lower-level device receives the command and executes the operation is recorded as the single-level control time, and the sum of all single-level control times corresponding to the control path of the device is obtained and recorded as the total control time; The sum of the total control time and the start time is recorded as the path start time; Analyze the operator's historical operation data in the multimedia, and set the pre-start time of the projector when the operator performs each step of the multimedia operation based on the analysis result, including: Acquire all operation data of the multimedia after each startup, and record the operation data after each startup as historical operation data LC1 to historical operation data LC n ; For any control path with only one primary master control device and a projector, the total control time of the control path is recorded as the reference control time, and the primary master control device in the control path is recorded as the analysis device; the historical operation data of starting the analysis device and the projector in all historical operation data LC is obtained and recorded as the analysis operation data FC; the time from starting the analysis device to the projector being able to project in all analysis operation data FC is recorded as the analysis operation time; the difference between the maximum value of all analysis operation times and the reference control time is recorded as the adjustment limit time of the control path; the difference between the minimum value of all analysis operation times and the reference control time is recorded as the adjustment shortest time of the control path; Analyzing the historical operation data of the operator in the multimedia, and setting the pre-start time of the projector when the operator performs each step of the multimedia operation based on the analysis result also includes: For any control path containing an intermediate control device, for any group of upper-level devices and lower-level devices in the control path, obtain the historical operation data of starting the upper-level device and the lower-level device in all historical operation data LC, and record them as upper-lower-level operation data SC; record the time from starting the upper-level device to starting the lower-level device in all upper-lower-level operation data SC as the upper-lower-level operation time, and record the value obtained by subtracting the single-level control time corresponding to the upper-level device and the lower-level device from the maximum value of all upper-lower-level operation times as the single-level limit time; record the value obtained by subtracting the single-level control time corresponding to the upper-level device and the lower-level device from the minimum value of all upper-lower-level operation times as the single-level shortest time; record the sum of the single-level shortest times of all upper-level devices and their corresponding lower-level devices in the control path as the shortest adjustment time of the control path; record the sum of the single-level limit times of all upper-level devices and their corresponding lower-level devices in the control path as the adjustment limit time of the control path; When the multimedia is started, the device that the operator has recently started in the multimedia is recorded as the latest device. When the latest device is in only one control path, the single-path algorithm is used to obtain the pre-startup time of the projector. The single-path algorithm includes: , where G is the pre-startup duration, G1 is the start-up time, G2 is the shortest adjustment time of the control path, and g1 is the difference between the shortest adjustment time of the control path and the start-up duration; when the latest device is started, after the adjustment limit time of the control path where the latest device is located has passed, the pre-startup duration of the projector obtained by the latest device will be deleted; When the latest device is in multiple control paths, the pre-startup time corresponding to each control path corresponding to the latest device is obtained based on the single-path algorithm, and the minimum value of all pre-startup time is recorded as the pre-startup time of the projector; the maximum value of the adjustment limit time corresponding to all control paths where the latest device is located is obtained, and recorded as the retention limit time of the latest device. When the latest device is started and the retention limit time has passed, the pre-startup time of the projector obtained by the latest device is deleted; Analyzing the historical operation data of the operator in the multimedia, and setting the pre-start time of the projector when the operator performs each step of the multimedia operation based on the analysis result also includes: The latest pre-start duration of the projector is obtained in real time. When the pre-start duration is 0, the projector is pre-started; when the pre-start duration is not 0, the projector is pre-started after the pre-start duration, wherein the pre-start is to start the projector in the background of the multimedia device.

2. The multimedia centralized control method based on digital twin according to claim 1 is characterized in that: A multimedia twin model is established based on digital twins and multimedia. The multimedia twin model is used to simulate the operation of multimedia, including: Obtain multiple devices in the multimedia and the connection methods between the multiple devices; establish a multimedia twin model through digital twins based on all devices and all connection methods in the multimedia; When multimedia is actually used, equivalent operations are performed in the multimedia twin model based on the devices and interactive operations initiated by the operator in the media.

3. The multimedia centralized control method based on digital twin according to claim 2 is characterized in that: During multimedia operation, the control path of each device in the multimedia for the projector is obtained based on the multimedia twin model, and the path startup time of the projector is obtained based on the control path and the startup time of the projector, including: For any device α in the multimedia, record the devices in the multimedia other than α that can be controlled by device α as controllable devices; obtain the controllable devices corresponding to all devices in the multimedia; establish a table of T rows × T columns, recorded as a control analysis table, wherein the top row of the control analysis table is filled with multiple devices in the multimedia from left to right except the first cell, and the leftmost column of the control analysis table is filled with multiple devices in the multimedia from top to bottom except the first cell; for any device β in the leftmost column of the control analysis table, obtain the controllable devices of device β, and record the cells where the columns where the controllable devices of device β are located and the rows where device β is located in the 2nd column to the Tth column from left to right in the control analysis table as the controllable cells of device β, and obtain the controllable cells corresponding to all devices in the leftmost column of the control analysis table.

4. The multimedia centralized control method based on digital twin according to claim 3 is characterized in that: The path acquisition method also includes: Delete the rows containing the devices in the leftmost column of the control analysis table that are not recorded as first-level main control devices except the projector, or the devices that are not recorded as any of the second-level to K-level intermediate control devices.

5. The multimedia centralized control method based on digital twin according to claim 4 is characterized in that: The path acquisition method also includes: For any first-level master control device, the control path of the first-level master control device is set to: first-level master control device → projector; for any K1-level inter-control device from the second-level inter-control device to the K-level inter-control device, the control path of the K1-level inter-control device is set to: K1-level inter-control device → (K1-1)-level inter-control devices among the controllable devices of the K1-level inter-control device → ··· → first-level master control device → projector, where K1 is a positive integer less than or equal to K and greater than or equal to 1.

6. The multimedia centralized control method based on digital twin according to claim 5 is characterized in that: The path startup duration corresponding to each control path is obtained based on the startup duration of the projector and also includes: For any device in the leftmost column of any control analysis table, for any two devices separated by "→" in the control path of the device, the device pointed by the arrow is recorded as the subordinate device, and the device emitting the arrow is recorded as the superior device, and the path startup duration corresponding to the control path of all devices in the leftmost column of the control analysis table is obtained.

Images