Multi-dimensional program management system, multi-screen heterogeneous playing scheduling method and device thereof and medium

Abstract

The embodiment of the application provides a multi-dimensional program management system and a multi-screen heterogeneous playing scheduling method, equipment and medium thereof, and belongs to the field of multimedia display. The system comprises: a multi-dimensional program list management module, which is used for constructing and managing a multi-dimensional program list structure; a multi-level index module, which is used for respectively assigning identifiers to program units, layer units, media cells and time axes, and establishing a hierarchical mapping relationship; and a playing scheduling engine, which is used for executing scheduling and control of media cell playing on multiple output terminals according to the time axis. The multi-dimensional program list structure is adopted to realize unified management of programs, layers, media units and time axes in space and time dimensions, simultaneously support multi-screen heterogeneous playing and material differentiation scheduling, and improve flexibility and expansibility of the playing system. Relying on the multi-level index, any playing object can be accurately positioned, timing triggering, segmented circulation and multi-thread playing scheduling are supported, and the conflict problem of global synchronization and local asynchronous control is solved.

Description

Technical Field

[0001] This invention relates to the field of multimedia display technology, specifically to a multi-dimensional program management system and its multi-screen heterogeneous playback scheduling method, device, and medium. Background Technology

[0002] With the continuous development and popularization of multimedia display technology, application scenarios such as stage performances, advertising media, conferences, exhibitions, and immersive interactive experiences have placed higher demands on multi-screen and multi-terminal content display. In reality, it is often necessary to control multiple display terminals simultaneously, such as LED large screens, video walls, and mobile devices, and to perform comprehensive playback and real-time scheduling of various media materials such as videos, images, subtitles, and special effects on these terminals.

[0003] Currently, the most common program schedule structure is a two-dimensional design:

[0004] (1) The first dimension is the program list, which is different program units arranged in order. The system achieves overall content scheduling by playing them in order.

[0005] (2) The second dimension is the layer structure, that is, within a single program, it is divided into different layers according to the material level. By overlaying multiple layers, a certain degree of composite display effect can be achieved on the same terminal or multiple screen terminals.

[0006] This two-dimensional program schedule structure can meet basic multi-screen playback needs, such as adding explanatory text to the subtitle layer and overlaying animation effects in the effects layer while playing video on the stage screen. However, with the increasing demand for multi-screen heterogeneous playback and cross-terminal synchronous control, the two-dimensional structure has gradually revealed the following prominent problems:

[0007] (1) Differences in the quantity and duration of materials: The quantity and duration of materials required for display often vary across different output terminals. For example, in the same program, a large screen may play a complete ten-minute video, while a small screen or mobile device may only play a segment or loop a shorter piece of material. Two-dimensional structures lack the ability to uniformly manage such differentiated needs.

[0008] (2) The contradiction between multi-screen synchronization and asynchrony: When multiple terminals play simultaneously, some screens need to maintain strict time synchronization, while other screens need to play independently in a loop or triggered according to their own logic. The two-dimensional structure cannot accurately distinguish between the control requirements of global synchronization and local asynchrony.

[0009] (3) Insufficient expression of time dimension: The existing two-dimensional structure only divides programs and layers at the spatial level, while the expression in the time dimension is relatively simple, mainly relying on sequential playback or simple loop mechanism, lacking support for complex time axis scheduling (such as timed triggering, segmented loop, superimposed playback, etc.). Summary of the Invention

[0010] The purpose of this invention is to provide a multi-dimensional program management system and its multi-screen heterogeneous playback scheduling method, device and medium to solve at least some or all of the technical problems existing in the prior art.

[0011] To achieve the above objectives, embodiments of the present invention provide a multi-dimensional program management system, comprising:

[0012] A multi-dimensional program schedule management module is used to build and manage a multi-dimensional program schedule structure, wherein the multi-dimensional program schedule structure includes at least: program units, layer units, media cells, and timelines;

[0013] The multi-level index module is used to assign identifiers to program units, layer units, media cells, and timelines, and to establish hierarchical mapping relationships, so that the identifiers of the timeline belong to the identifiers of the media cells, the identifiers of the media cells belong to the identifiers of the layer units, and the identifiers of the layer units belong to the identifiers of the program units.

[0014] The playback scheduling engine is used to schedule and control the playback of media cells on multiple output terminals according to the timeline.

[0015] Optionally, each program unit contains Layer Each layer contains Media Unit Each cell has a timeline Each program unit Defined as:

[0016] ;

[0017] Each layer unit Defined as:

[0018] ;

[0019] In the formula, Indicates belonging to a layer unit The k-th media cell;

[0020] Each media cell Includes timeline attributes :

[0021] ；

[0022] Timeline Includes the following dimensions of information:

[0023] ;

[0024] In the formula, Indicates the start time of media playback. Indicates the end time of media playback. Indicates the number of times the music will loop. This indicates the triggering condition for program playback.

[0025] Optionally, the multi-dimensional program management system further includes:

[0026] The hierarchical tree-structured data organization module is used to organize program content in a tree structure. The top-level node is the global program list, which includes sequence nodes, program nodes, layer nodes, and media unit nodes in descending order.

[0027] Optionally, the multi-dimensional program management system further includes:

[0028] The bidirectional reference module is used to establish bidirectional reference relationships between upper and lower level nodes in the tree structure, so that the upper level node stores the reference of its lower level node, and the lower level node stores the reverse reference of its upper level node.

[0029] Secondly, the present invention also provides a multi-screen heterogeneous playback scheduling method applied to a multi-dimensional program management system, comprising:

[0030] Construct a multi-dimensional program schedule data structure, wherein the multi-dimensional program schedule data structure includes at least program units, layer units, media cells and their timelines;

[0031] Assign identifiers to each program unit, layer unit, media cell, and timeline, and establish hierarchical mapping relationships between identifiers;

[0032] Based on the timeline and hierarchical mapping, the playback scheduling of each media cell is controlled on the corresponding output terminal.

[0033] Optionally, based on the timeline and hierarchical mapping relationship, the playback scheduling of each media cell on the corresponding output terminal is controlled, including:

[0034] Based on the hierarchical mapping relationship, an upward reference from the media cell to its own layer unit and program unit is established, and / or a downward reference from the program unit and layer unit to its subordinate unit is established, forming a bidirectional reference relationship.

[0035] When the playback status of any media cell or the timeline changes, the playback scheduling status of its parent cell is updated synchronously based on the bidirectional reference relationship.

[0036] Optionally, the timeline includes at least one of start time, end time, number of cycles, and triggering conditions.

[0037] Thirdly, the present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of the multi-screen heterogeneous playback scheduling method described above.

[0038] Fourthly, the present invention also provides a storage medium storing a computer program thereon, wherein the computer program, when executed by a processor, implements the steps of the multi-screen heterogeneous playback scheduling method described above.

[0039] Through the above technical solution, employing a multi-dimensional program guide structure, the system achieves unified management of programs, layers, media units, and timelines in both spatial and temporal dimensions. It can simultaneously support multi-screen heterogeneous playback and differentiated material scheduling, improving the flexibility and scalability of the playback system. Relying on multi-level indexes, the system can accurately locate any playback object, supporting timed triggering, segmented looping, and multi-threaded playback scheduling, thus resolving the conflict between global synchronous and local asynchronous control.

[0040] Other features and advantages of the embodiments of the present invention will be described in detail in the following detailed description section. Attached Figure Description

[0041] The accompanying drawings are provided to further illustrate embodiments of the present invention and form part of the specification. They are used together with the following detailed description to explain the embodiments of the present invention, but do not constitute a limitation thereof. In the drawings:

[0042] Figure 1 This is a schematic diagram of the structure of a multi-dimensional program management system provided in an embodiment of the present invention;

[0043] Figure 2 This is a flowchart of a multi-screen heterogeneous playback scheduling method provided in an embodiment of the present invention;

[0044] Figure 3 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present invention. Detailed Implementation

[0045] Various embodiments of this disclosure will be described more fully in the following detailed description. This disclosure may have various embodiments, and adjustments and changes may be made therein. However, it should be understood that there is no intention to limit the various embodiments of this disclosure to the specific embodiments disclosed herein, but rather this disclosure should be understood to cover all adjustments, equivalents, and / or alternatives falling within the spirit and scope of the various embodiments of this disclosure.

[0046] In the following, the terms “comprising” or “may include”, which may be used in various embodiments of this disclosure, indicate the presence of the disclosed functions or operations and do not limit the addition of one or more functions or operations. Furthermore, as used in various embodiments of this disclosure, the terms “comprising,” “having,” and their cognates are intended only to indicate a specific feature, number, step, operation, or combination of the foregoing and should not be construed as primarily excluding the presence of one or more other features, numbers, steps, operations, or combinations of the foregoing, or the possibility of adding one or more features, numbers, steps, operations, or combinations of the foregoing.

[0047] In various embodiments of this disclosure, the expression "or" or "at least one of A and / or B" includes any combination or all combinations of the words listed simultaneously. For example, the expression "A or B" or "at least one of A and / or B" may include A, may include B, or may include both A and B.

[0048] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0049] See Figure 1 The diagram shown is a structural schematic of a multi-dimensional program management system provided in an embodiment of the present invention, comprising:

[0050] A multi-dimensional program schedule management module is used to build and manage a multi-dimensional program schedule structure, wherein the multi-dimensional program schedule structure includes at least: program units, layer units, media cells, and timelines;

[0051] The multi-level index module is used to assign identifiers to program units, layer units, media cells, and timelines, and to establish hierarchical mapping relationships, so that the identifiers of the timeline belong to the identifiers of the media cells, the identifiers of the media cells belong to the identifiers of the layer units, and the identifiers of the layer units belong to the identifiers of the program units.

[0052] The playback scheduling engine is used to schedule and control the playback of media cells on multiple output terminals according to the timeline.

[0053] In one specific implementation, the multi-dimensional program schedule structure is a four-dimensional program schedule, represented as follows:

[0054] ;

[0055] In the formula, This represents each program unit. This represents the total number of program segments.

[0056] Furthermore, each program unit contains Layer Each layer contains Media Unit Each cell has a timeline Each program unit Defined as:

[0057] ;

[0058] Each layer unit Defined as:

[0059] ;

[0060] In the formula, Indicates belonging to a layer unit The k-th media cell;

[0061] Each media cell Includes timeline attributes :

[0062] ；

[0063] Timeline Includes the following dimensions of information:

[0064] ;

[0065] In the formula, Indicates the start time of media playback. Indicates the end time of media playback. Indicates the number of times the music will loop. This indicates the triggering condition for program playback.

[0066] In one specific implementation, this module introduces a four-dimensional program guide structure to achieve unified management and flexible scheduling of programs, layers, media cells, and timelines in both spatial and temporal dimensions. The entire system treats program guides, layers, and media cells as independent units and assigns timeline attributes to each unit, thereby achieving unified scheduling and flexible playback in multi-screen heterogeneous playback scenarios.

[0067] This module divides program schedule management into four levels: one-dimensional program units, two-dimensional layer units, three-dimensional media units, and a four-dimensional timeline. Each level has independent identifiers and playback attributes, enabling fine-grained content scheduling. The system can define multiple program units, each corresponding to different playback tasks or scenarios, and can dynamically add or delete programs according to user needs. Each program unit contains multiple layers, each capable of independently controlling playback video, subtitles, effects, or backgrounds, and supports combined overlay display on different output terminals, achieving multi-screen, multi-layered heterogeneous playback effects. Each layer is further subdivided into multiple media units, each corresponding to independent media materials, which can be independently triggered for playback, looping, or delayed playback, thus enabling differentiated control of the quantity and duration of materials across terminals. Each media cell includes timeline attributes, including start time, end time, loop count, and trigger conditions. The system simultaneously maintains a global timeline and local timelines, ensuring flexible asynchronous playback at the local level while maintaining unified global control.

[0068] In one specific embodiment, the multi-dimensional program management system further includes: a hierarchical tree-structured data organization module, used to organize program content in a tree structure, wherein the top-level node is the global program list, and the nodes below it include sequence nodes, program nodes, layer nodes, and media unit nodes in sequence.

[0069] In one specific implementation, based on the four-dimensional program schedule structure, a multi-level index and hierarchical data mechanism is further constructed to achieve accurate positioning and flexible scheduling of multi-level content.

[0070] First, a unique identifier (ID) is created for each object in the four-dimensional program guide, forming a multi-level indexing system: program-level index. Layer-level index Media cell index and timeline index A strict hierarchical mapping relationship is formed among the four:

[0071]

[0072] In this system, the timeline attribute is always attached to a specific media cell, which in turn belongs to a specific layer and ultimately maps to a unique program unit. Through this progressive indexing structure, the system can accurately locate the playback object and its context at any given time, and on this basis, implement complex playback logic such as timeline-based synchronous control, segmented looping, and timed triggering. This enables real-time tracking and management of the global playback status, and the design enhances the system's expressive power in the time dimension and the global controllability of multi-screen content.

[0073] At the data organization level, the system employs a hierarchical tree structure to manage and store program content. The top-level node represents the global program guide, progressively descending to include sequence nodes, program nodes, layer nodes, and media unit nodes, forming a hierarchical system from macro to micro. This structural design allows for clear logical division and structured organization of program content, providing a unified data foundation for playback scheduling, editing operations, and multi-terminal distribution. In multi-screen heterogeneous scenarios, different output terminals can selectively load certain layers or media units, achieving differentiated presentation of content and resource sharing. This mechanism effectively solves the technical bottlenecks of existing two-dimensional structures in heterogeneous environments, hindering unified management and scalability, thus enhancing the system's flexibility and scalability.

[0074] In one specific embodiment, the multi-dimensional program management system further includes: a bidirectional reference module, used to establish a bidirectional reference relationship between upper and lower level nodes in the tree structure, so that the upper level node saves the reference of its lower level node, and the lower level node saves the reverse reference of its upper level node.

[0075] In one specific implementation, to further improve the system's access efficiency and flexibility in multi-level data management, this embodiment introduces a bidirectional referencing and dynamic consistency mechanism based on the hierarchical tree structure. While maintaining a clear hierarchical structure, the system enables data flow to move beyond unidirectional chained access, achieving real-time linkage and feedback between upper and lower level nodes.

[0076] Specifically, upper-level nodes store a set of references to their lower-level nodes to support sequential traversal, batch operations, and centralized control. Simultaneously, each lower-level node also retains a reverse reference to its parent node, allowing any child node to quickly trace its program, sequence, and global attributes during playback scheduling, status updates, or editing operations. This bidirectional reference structure breaks the access limitations of traditional unidirectional data chains, enabling the system to achieve real-time interaction and status awareness between multi-level nodes, thereby significantly improving response speed and data consistency in scenarios such as synchronous control, partial updates, and real-time playback feedback.

[0077] For example, the node data structure and reference relationships are as follows: Each node (whether it's a program unit Pi, a layer unit Lij, or a media cell Mijk) is instantiated in the system as a data object containing the following key fields: Self-attributes: including a unique ID, type identifier, and its inherent business attributes (such as program name, layer position, media material path, timeline attribute Tijk, etc.). Downward references: a list or pointer to its direct child nodes. For example, program node Pi holds a list of references to all its layer child nodes Li1, Li2, ..., LiMi. Layer node Lij holds a list of references to all its media cell child nodes Mij1, Mij2, ..., MijKij. Upward references: a reference or pointer to its direct parent node. For example, layer node Lij explicitly knows that its parent node is program Pi. Media cell node Mijk explicitly knows that its parent node is layer Lij.

[0078] Scenario 1: Top-Down Parameter Modification and Synchronization: Trigger Action: The user modifies the playback speed ratio of a program unit Pi through the interface. The system receives the modification instruction for the program node Pi's attributes. Using Pi's downlink reference, it immediately traverses all its child layer nodes Lij and sends the change instruction "playback speed ratio = 1.5". After receiving the instruction, each layer node Lij uses its own downlink reference to continue passing the instruction to all its subordinate media cell nodes Mijk. After receiving the instruction, each media cell node Mijk dynamically adjusts the relevant parameters in its timeline attribute Tijk. After the update is complete, a confirmation signal can be returned from bottom to top (using uplink references) to ensure that the entire subtree has been modified.

[0079] Scenario 2: Bottom-up Status Feedback and Strategy Adjustment: During playback, a media cell Mijk on an output terminal fails to play on time due to resource loading failure. The playback engine detects the playback failure event of Mijk. The system immediately uses Mijk's uplink reference to quickly locate its parent node—layer Lij—and reports the "cell playback failure" event and context. Layer node Lij (or its upper-level program node Pi, according to a predefined strategy) makes a decision based on this event. For example, the decision might be to skip this failed cell and continue playing the next one. The decision instruction is then sent down the downlink reference path from layer Lij to all related media cells it manages, notifying subsequent cells to adjust their early start or trigger condition changes. The status dashboard of program node Pi summarizes the status of its child nodes through its downlink references and updates in real time.

[0080] Through this mechanism, the system establishes an efficient two-way data linkage relationship between the "global" and "local" levels. When a user adjusts the parameters of a sequence or layer in the global program guide (such as playback duration, synchronization strategy, loop mode), the system can automatically push the changed content down to all related media cells. Conversely, when an anomaly, replacement, or delay occurs in a media cell during playback, its associated program and upper-level sequence can also instantly detect the status change and automatically adjust the playback strategy or recalculate the timeline scheduling accordingly.

[0081] This bidirectional synchronous design between upper and lower levels effectively resolves the conflict between global synchronization and local asynchronous control in traditional playback systems, ensuring that multi-screen heterogeneous playback still maintains stability and real-time performance in complex scheduling scenarios.

[0082] The technical effects achieved by this application are as follows:

[0083] Through the four-dimensional program schedule structure, the system achieves unified management of programs, layers, media units, and timelines in both spatial and temporal dimensions. It can simultaneously support multi-screen heterogeneous playback and differentiated material scheduling, significantly improving the flexibility and scalability of the playback system.

[0084] Relying on a multi-level index and bidirectional reference mechanism, the system can accurately locate any playback object and achieve global-local bidirectional linkage. It supports timed triggering, segmented looping, and multi-threaded playback scheduling, effectively solving the problem of conflict between global synchronous and local asynchronous control.

[0085] The modular tree structure and dynamic consistency mechanism ensure that node addition, deletion, copying, and merging operations can be completed locally. The system remains stable even when the number of programs, layers, or media increases, making it suitable for large-scale multi-terminal and multi-screen playback environments.

[0086] See Figure 2 The diagram shows a flowchart of a multi-screen heterogeneous playback scheduling method in a specific embodiment, including the following execution steps:

[0087] Step 200: Construct a multi-dimensional program schedule data structure.

[0088] The multidimensional program schedule data structure includes at least program units, layer units, media cells, and their timelines.

[0089] Preferably, the timeline includes at least one of start time, end time, number of cycles, and triggering conditions.

[0090] In one specific implementation, program schedule management is divided into four levels: one-dimensional program units, two-dimensional layer units, three-dimensional media units, and a four-dimensional timeline. Each level has independent identifiers and playback attributes, enabling fine-grained content scheduling. The system can define multiple program units, each corresponding to different playback tasks or scenarios, and can dynamically add or delete programs according to user needs. Each program unit contains multiple layers, each capable of independently controlling the playback of video, subtitles, effects, or backgrounds, and supports combined overlay display on different output terminals, achieving multi-screen, multi-layered heterogeneous playback effects. Each layer is further subdivided into multiple media units, each corresponding to independent media materials, which can be independently triggered for playback, looping, or delayed playback, thereby achieving differentiated control over the quantity and duration of materials across terminals. Each media cell includes timeline attributes, including start time, end time, loop count, and trigger conditions. The system simultaneously maintains a global timeline and a local timeline, ensuring flexible asynchronous playback at the local level while maintaining unified global control.

[0091] For example, suppose the system has a total of Each program unit contains [number] program segments, and each program segment contains [number] program segments. Layer Each layer contains Media Unit Each cell has a timeline Each program unit Defined as:

[0092] ;

[0093] Each layer unit Defined as:

[0094] ;

[0095] In the formula, Indicates belonging to a layer unit The k-th media cell;

[0096] Each media cell Includes timeline attributes :

[0097] ；

[0098] Timeline Includes the following dimensions:

[0099] ;

[0100] In the formula, Indicates the start time of media playback. Indicates the end time of media playback. Indicates the number of times the music will loop. This indicates the triggering condition for program playback.

[0101] By organically combining program units, layers, media cells, and timelines, the system achieves unified management of both spatial and temporal dimensions. Through this structure, the system can schedule each program unit as an independent playback unit, and multimedia cells within layers can support differentiated playback and loop triggering, thus meeting the playback needs of different terminals in a multi-screen heterogeneous environment. Simultaneously, hierarchical management ensures that program content is clearly divided logically and structurally, providing a foundation for subsequent indexing, scheduling, and dynamic updates. Step 201: Assign identifiers to each program unit, layer unit, media cell, and timeline, and establish hierarchical mapping relationships between these identifiers.

[0102] For example, a unique identifier (ID) is created for each object in the four-dimensional program guide, forming a multi-level indexing system: program-level index. Layer-level index Media cell index and timeline index A strict hierarchical mapping relationship is formed among the four:

[0103]

[0104] In this system, the timeline attribute is always attached to a specific media cell, which in turn belongs to a specific layer and ultimately maps to a unique program unit. Through this progressive indexing structure, the system can accurately locate the playback object and its context at any given time, and on this basis, implement complex playback logic such as timeline-based synchronous control, segmented looping, and timed triggering, thereby achieving real-time tracking and management of the global playback state. This enhances the system's expressive capabilities in the time dimension and the global controllability of multi-screen content.

[0105] Step 202: Based on the timeline and hierarchical mapping relationship, control the playback scheduling of each media cell on the corresponding output terminal.

[0106] Specifically, when executing step 202, the following steps can be performed:

[0107] S2020: Based on the hierarchical mapping relationship, establish upward references from media cells to their respective layer units and program units, and / or downward references from program units and layer units to their subordinate units, forming a bidirectional reference relationship.

[0108] S2021: When the playback status of any media cell or the timeline changes, the playback scheduling status of its parent cell is updated synchronously based on the bidirectional reference relationship.

[0109] In one specific implementation, upper-level nodes store a set of references to their lower-level nodes to support sequential traversal, batch operations, and centralized control. Simultaneously, each lower-level node also retains a reverse reference to its parent node, enabling any child node to quickly trace its program, sequence, and global attributes during playback scheduling, status updates, or editing operations. This bidirectional reference structure breaks the access limitations of traditional unidirectional data chains, allowing the system to achieve real-time interaction and status awareness between multi-level nodes, thereby significantly improving response speed and data consistency in scenarios such as synchronous control, partial updates, and real-time playback feedback.

[0110] In this embodiment, this mechanism establishes an efficient two-way data linkage between the global and local levels. When a user adjusts the parameters of a sequence or layer (such as playback duration, synchronization strategy, or loop mode) in the global program guide, the system can automatically push the changed content down to all associated media cells. Conversely, when a media cell experiences an anomaly, replacement, or delayed triggering during playback, its associated program and upper-level sequence can instantly detect the status change and automatically adjust the playback strategy or recalculate the timeline scheduling accordingly. This two-way synchronization design between upper and lower levels resolves the conflict between global synchronization and local asynchronous control in traditional playback systems, ensuring that multi-screen heterogeneous playback still maintains stability and real-time performance in complex scheduling scenarios.

[0111] It should be understood that the sequence number of each step in the above embodiments does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention.

[0112] Figure 3 This is a schematic diagram of the hardware structure of an electronic device that implements various embodiments of the present invention.

[0113] The multi-screen heterogeneous playback scheduling method provided in this application can be applied to electronic devices. Those skilled in the art will understand that the electronic device structure involved in the embodiments of this invention does not constitute a limitation on the electronic device. An electronic device may include more or fewer components than illustrated, or combine certain components, or have different component arrangements. In the embodiments of this invention, the electronic device includes, but is not limited to, laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device may also represent various forms of mobile devices, such as personal digital processors, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the embodiments of this application described and / or claimed herein.

[0114] Electronic devices may include processors, external memory interfaces, internal memory, universal serial bus (USB) interfaces, charging management modules, power management modules, batteries, wireless communication modules, audio modules, speakers, microphones, sensor modules, buttons, cameras, displays, and SIM card interfaces, etc.

[0115] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on the electronic device. In other embodiments of this application, the electronic device may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0116] A processor may include one or more processing units, such as: a central processing unit (CPU), an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, memory, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0117] The processor can serve as the nerve center and command center of an electronic device. The controller can generate operation control signals based on the instruction opcode and timing signals to control the fetching and execution of instructions.

[0118] The processor may also include memory for storing instructions and data. In some embodiments, the memory in the processor is a cache memory. This memory can store instructions or data that the processor has just used or that are used repeatedly. If the processor needs to use the instruction or data again, it can retrieve it directly from this memory. This avoids repeated accesses, reduces processor latency, and thus improves system efficiency.

[0119] An external storage interface (ESI) can be used to connect external memory cards, such as microSD cards, to expand the storage capacity of electronic devices. The external memory card communicates with the processor through the ESI to perform data storage functions, such as saving music and video files on the external memory card.

[0120] Internal memory can be used to store computer executable program code, which includes instructions. The processor executes various functional applications and data processing of electronic devices by running the instructions stored in internal memory. Internal memory can include a program storage area and a data storage area. Internal memory can include high-speed random access memory, and can also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

[0121] Wireless communication functionality in electronic devices can be achieved through antennas, wireless communication modules, modem processors, and baseband processors.

[0122] Wireless communication modules can provide solutions for wireless communication applications in electronic devices, including wireless local area networks (WLANs) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), and infrared (IR) technologies.

[0123] Electronic devices can implement audio functions through audio modules, speakers, receivers, microphones, headphone jacks, and application processors.

[0124] Electronic devices can achieve shooting functions through ISPs, cameras, video codecs, GPUs, displays, and application processors.

[0125] Electronic devices can achieve display functions through GPUs, displays, and application processors.

[0126] A GPU is a microprocessor for image processing, connected to the display screen and application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. A processor may include one or more GPUs, which execute program instructions to generate or modify display information.

[0127] A display screen is used to display images, videos, etc. A display screen includes a display panel.

[0128] The storage medium provided in this application stores a program product capable of implementing a multi-screen heterogeneous playback scheduling method.

[0129] The multi-screen heterogeneous playback scheduling method includes: constructing a multi-dimensional program list data structure, wherein the multi-dimensional program list data structure includes at least program units, layer units, media cells and their timelines;

[0130] Identifiers are assigned to each program unit, layer unit, media cell, and timeline, and a hierarchical mapping relationship is established between the identifiers; based on the timeline and hierarchical mapping relationship, the playback scheduling of each media cell on the corresponding output terminal is controlled.

[0131] In some possible implementations, the subject matter of this disclosure, Multi-screen Heterogeneous Playback Scheduling Method and System, can be implemented as a program product comprising program code. When the program product is run on a terminal device, the program code is used to cause the terminal device to perform the steps described in the "Exemplary Methods" section of this specification according to various exemplary embodiments of this disclosure.

[0132] The storage medium disclosed herein may be any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples (a non-exhaustive list) of readable storage media include: an electrical connection having one or more wires, a portable disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof.

[0133] The above description of the disclosed embodiments enables those skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the invention is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A multi-dimensional program management system, characterized in that, include: A multi-dimensional program schedule management module is used to build and manage a multi-dimensional program schedule structure, wherein the multi-dimensional program schedule structure includes at least: program units, layer units, media cells, and timelines; The multi-level index module is used to assign identifiers to program units, layer units, media cells, and timelines, and to establish hierarchical mapping relationships, so that the identifiers of the timeline belong to the identifiers of the media cells, the identifiers of the media cells belong to the identifiers of the layer units, and the identifiers of the layer units belong to the identifiers of the program units. A playback scheduling engine is used to schedule and control the playback of media cells on multiple output terminals according to the timeline; The system defines multiple program units, each corresponding to different playback tasks or scenarios, and dynamically adds or deletes programs based on user needs. Each program unit contains multiple layers, each independently controlling the playback of video, subtitles, effects, or backgrounds, and supports combined and overlaid display on different output terminals to achieve multi-screen, multi-layered heterogeneous playback effects. Each layer is further divided into multiple media units, each corresponding to independent media materials, and independently triggering playback, looping, or delayed playback, thereby achieving differentiated control over the quantity and duration of materials across terminals. Each media cell has timeline attributes, including start time, end time, loop count, and trigger conditions. The system maintains both a global timeline and a local timeline to ensure flexible asynchronous playback on a globally unified control basis.

2. The multi-dimensional program management system according to claim 1, characterized in that, The multi-dimensional program schedule structure is a four-dimensional program schedule, represented as follows: ； In the formula, This represents each program unit. This represents the total number of program segments.

3. The multi-dimensional program management system according to claim 2, characterized in that, Each program unit contains Layer Each layer contains Media Unit Each cell has a timeline Each program unit Defined as: ； Each layer unit Defined as: ； In the formula, Indicates belonging to a layer unit k media cells; Each media cell Includes timeline attributes : ； Timeline Includes the following dimensions of information: ； In the formula, Indicates the start time of media playback. Indicates the end time of media playback. Indicates the number of times the music will loop. This indicates the trigger condition for program playback. Indicates media information.

4. The multi-dimensional program management system according to claim 1, characterized in that, The multi-dimensional program management system also includes: The hierarchical tree-structured data organization module is used to organize program content in a tree structure. The top-level node is the global program list, which includes sequence nodes, program nodes, layer nodes, and media unit nodes in descending order.

5. The multi-dimensional program management system according to claim 4, characterized in that, The multi-dimensional program management system also includes: The bidirectional reference module is used to establish bidirectional reference relationships between upper and lower level nodes in the tree structure, so that the upper level node stores the reference of its lower level node, and the lower level node stores the reverse reference of its upper level node.

6. A multi-screen heterogeneous playback scheduling method applied to the multi-dimensional program management system according to any one of claims 1-5, characterized in that, include: Construct a multi-dimensional program schedule data structure, wherein the multi-dimensional program schedule data structure includes at least program units, layer units, media cells and their timelines; Assign identifiers to each program unit, layer unit, media cell, and timeline, and establish hierarchical mapping relationships between identifiers; Based on the timeline and hierarchical mapping, the playback scheduling of each media cell is controlled on the corresponding output terminal.

7. The multi-screen heterogeneous playback scheduling method according to claim 6, characterized in that, Based on the timeline and hierarchical mapping, the playback scheduling of each media cell on the corresponding output terminal is controlled, including: Based on the hierarchical mapping relationship, an upward reference from the media cell to its own layer unit and program unit is established, and / or a downward reference from the program unit and layer unit to its subordinate unit is established, forming a bidirectional reference relationship. When the playback status of any media cell or the timeline changes, the playback scheduling status of its parent cell is updated synchronously based on the bidirectional reference relationship.

8. The multi-screen heterogeneous playback scheduling method according to claim 6, characterized in that, The timeline includes at least one of the following: start time, end time, number of cycles, and triggering conditions.

9. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the multi-screen heterogeneous playback scheduling method as described in any one of claims 6-8.

10. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the multi-screen heterogeneous playback scheduling method as described in any one of claims 6-8.

Images