An edge-computing-based virtual scene experience system for cultural and creative products

Abstract

The application discloses a kind of based on edge computing's virtual scene experience system of cultural and creative product, it is related to edge computing technical field, including, acquisition multi-modal experience interaction data flow is preprocessed, and combined in the conversation control surface in double plane conversation operation diagram, input is queued and sorted, obtains state increment item, simultaneously drive picture data surface and carry out state increment and take update, generate conversation operation state set;According to conversation operation state set, combined with consistent stamp carries out stamp boundary freezing, solidifies control surface snapshot section and data surface snapshot section, and writes into consistent stamp boundary marker, generates conversation snapshot package;Based on conversation snapshot package, conversation control surface and picture data surface are seamlessly relayed and restored, and switch continuous frame stream output channel, carry out relay closed packaging, generate scene experience output set.The application realizes state decoupling and timing synchronization, guarantees multi-modal interaction consistency, improves edge side response real-time performance.

Description

Technical Field

[0001] This invention relates to the field of edge computing technology, and in particular to a virtual scene-based experience system for cultural and creative products based on edge computing. Background Technology

[0002] Against the backdrop of the integrated development of culture and technology, virtual experience systems based on edge computing have made progress in recent years. With the evolution of 5G communication, the Internet of Things, and distributed computing architectures, edge computing is gradually becoming a key technological path to support low-latency, high-concurrency virtual scene services. Especially in the field of digital display of cultural and creative products, immersive interactive systems deployed on edge nodes can effectively achieve localized content rendering and real-time response, enhance user presence and participation, and promote the intelligent upgrading of scenarios such as cultural heritage and art exhibitions.

[0003] Existing edge computing-driven virtual experience systems still have limitations: First, the session state management mechanism is crude and lacks fine separation between control logic and screen data, making it difficult to guarantee state consistency under multimodal interaction; Second, the recovery process after session interruption relies on central cloud collaboration and cannot achieve snapshot-level seamless handover at the edge, which seriously affects the continuity of experience and system reliability. Summary of the Invention

[0004] In view of the aforementioned existing problems, the present invention is proposed.

[0005] Therefore, this invention provides a virtual scene-based experience system for cultural and creative products based on edge computing to solve the problems of inconsistent session states on the edge side and the inability to seamlessly recover after interruption.

[0006] To solve the above-mentioned technical problems, the present invention provides the following technical solution: This invention provides a virtual scene-based experience system for cultural and creative products based on edge computing. It includes: a session orchestration module, used to receive virtual scene-based experience requests for cultural and creative products, perform session access orchestration on edge computing nodes, issue session tickets to solidify the effective time window and snapshot index entry, and generate a session access list; a dual-plane construction module, used to create a session control plane and a screen data plane based on the session access list, and bind the session entry set and screen channel set respectively, while establishing a consistency stamp alignment index to generate a dual-plane session operation graph; and a state update module, used to collect multimodal experience interaction data streams for preprocessing. The system performs input queuing and sorting based on the session control plane in the dual-plane session runtime graph, obtains state increment entries, and simultaneously drives the screen data plane to update state increments, generating a session runtime state set. The snapshot solidification module is used to freeze the snapshot boundaries based on the session runtime state set and the consistency stamp, solidify the control plane snapshot segment and the data plane snapshot segment, and write the consistency stamp boundary marker to generate a session snapshot package. The relay recovery module is used to seamlessly relay recover the session control plane and the screen data plane based on the session snapshot package, and switch the continuous frame stream output channel to perform relay closure encapsulation, generating a scenario-based experience output set.

[0007] As a preferred embodiment of the virtual scene-based experience system for cultural and creative products based on edge computing described in this invention, the steps for performing session access orchestration on the edge computing node are as follows: Receive requests for virtual scene-based experiences of cultural and creative products, perform access fingerprint expansion and orchestration on edge computing nodes, and generate session access request parsing packets; Perform snapshot index entry reservation mapping on the session access request parsing packet, and simultaneously lock the session entry set and session calculation quota to generate a session access orchestration entry set.

[0008] As a preferred embodiment of the edge computing-based virtual scene-based experience system for cultural and creative products described in this invention, the steps for generating the session access list are as follows: The session access orchestration entry set is fixed with double boundaries for the session validity time window and encapsulated as a session ticket payload. At the same time, integrity verification is performed and a session ticket receipt is generated. Based on the session ticket receipt, the session ticket, session validity time window, and snapshot index entry are aggregated to generate a session access list.

[0009] As a preferred embodiment of the edge computing-based virtual scene-based experience system for cultural and creative products described in this invention, the steps for generating the dual-plane session operation graph are as follows: Based on the session access list, combined with the unified clock source, the session ticket is expanded, the session consistency stamp benchmark is obtained, and the session entry set and screen channel set are locked to generate a dual-plane creation preparation package. The dual-plane creation preparation package performs dual-plane session runtime entity splitting and orchestration, creates session control plane and screen data plane, establishes cross-plane event transmission channels and cross-plane state buffers, and generates dual-plane runtime entities; Based on the dual-plane running entity, a consistent stamp alignment index is constructed, and a replayable mapping relationship is established with the snapshot index entry to generate a dual-plane session running graph.

[0010] As a preferred embodiment of the virtual scene-based experience system for cultural and creative products based on edge computing described in this invention, the steps for input queuing and sorting are as follows: Collect multimodal experience interaction data streams, preprocess them, and generate a batch encapsulation set of session control inputs; Based on the session control input batch encapsulation set, consistent stamp-driven input enqueue sorting is performed in the session control plane of the biplane session run graph, and the input queue index is written to generate an ordered input queue.

[0011] As a preferred embodiment of the virtual scene-based experience system for cultural and creative products based on edge computing described in this invention, the steps for generating the session running state set are as follows: Perform segmented submission and replayability of state increment entries on the ordered input queue, and bind them to the input queue index to generate a state increment entry queue. Based on the state increment entry queue, perform state increment fetching and updating in the screen data plane, and synchronously aggregate the scene graph version pointer and consistency stamp boundary sequence number to generate a session running state set.

[0012] As a preferred embodiment of the edge computing-based virtual scene-based experience system for cultural and creative products described in this invention, the steps for generating the session snapshot package are as follows: Based on the session running state set, solidify the consistency stamp boundary freeze slice, and perform input enqueue closure and state increment entry queue segment tail sealing to generate a one-time stamp boundary freeze preparation package; Based on the one-time stamp boundary freeze preparation package, perform co-stamp convergence on the control plane snapshot segment and the data plane snapshot segment, and solidify the session state machine snapshot and the sequence of events to be committed, generating the solidified sequence of the control plane snapshot segment; Based on the control plane snapshot segment solidification sequence, the scene graph version pointer and queue cursor closed segment are extracted from the screen data plane and written into the snapshot segment alignment index to generate the data plane snapshot segment solidification sequence; Perform atomic encapsulation of snapshot index entry on the data plane snapshot segment solidified sequence, and perform same-stamp alignment between the consistency stamp boundary and the snapshot segment alignment index to generate a session snapshot package.

[0013] As a preferred embodiment of the virtual scene-based experience system for cultural and creative products based on edge computing described in this invention, the steps for seamlessly restoring the session control plane and the screen data plane are as follows: Loading and quota allocation of snapshot segment alignment index based on session snapshot package, creating relay recovery session context, initializing session consistency stamp baseline, and generating relay recovery preparation sequence; The control plane performs a first relay recovery orchestration for the relay recovery preparation sequence, opens the session entry set access endpoints, receives multimodal experience interaction data streams, and generates a control plane relay ready set.

[0014] As a preferred embodiment of the virtual scene-based experience system for cultural and creative products based on edge computing described in this invention, the system performs snapshot index entry differential multiplexing, image data plane loading and channel occupancy according to the control plane relay ready set, and enters the continuous frame stream output preparatory state to generate the data plane relay ready set. Perform consistency stamp boundary relay switching closure on the data plane relay ready set, and encapsulate continuous frame stream output channel switching and relay closure to generate a scenario-based experience output set.

[0015] As a preferred embodiment of the virtual scene-based experience system for cultural and creative products based on edge computing described in this invention, the preprocessing includes time scale normalization, arrival disorder rollback, and duplicate segment elimination.

[0016] The beneficial effects of this invention are as follows: by constructing a dual plane of control plane and data plane on the edge computing node and establishing a consistent stamp alignment index, state decoupling and timing synchronization are achieved, ensuring the consistency of multimodal interaction and improving the real-time response of the edge side; through the edge computing side snapshot solidification and relay recovery mechanism, seamless local reconstruction after session interruption is achieved, avoiding cloud dependence and enhancing the continuity of experience and system reliability. Attached Figure Description

[0017] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the following description of the embodiments will be briefly introduced. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0018] Figure 1 This is a flowchart of a virtual scene-based experience system for cultural and creative products based on edge computing.

[0019] Figure 2 This is a time series of frame intervals and a magnified comparison of local areas.

[0020] Figure 3 A comparison chart showing the ratio of disordered items to alignment errors.

[0021] Figure 4 The diagram shows the percentage of recovery time in the relay process. Detailed Implementation

[0022] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, the specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0023] Many specific details are set forth in the following description in order to provide a full understanding of the invention. However, the invention may also be practiced in other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the invention. Therefore, the invention is not limited to the specific embodiments disclosed below.

[0024] Secondly, the term "one embodiment" or "embodiment" as used herein refers to a specific feature, structure, or characteristic that may be included in at least one implementation of the present invention. The phrase "in one embodiment" appearing in different places in this specification does not necessarily refer to the same embodiment, nor is it a single or selective embodiment that is mutually exclusive with other embodiments.

[0025] Reference Figures 1-4 This is one embodiment of the present invention, which provides a virtual scene-based experience system for cultural and creative products based on edge computing, including the following steps: The session orchestration module is used to receive requests for virtual scene-based experiences of cultural and creative products, orchestrate session access at edge computing nodes, issue session tickets to solidify the effective time window and snapshot index entry of the session, and generate a session access list. Receive requests for virtual scene-based experiences of cultural and creative products, perform access fingerprint expansion and orchestration on edge computing nodes, and generate session access request parsing packets; Furthermore, upon receiving a request for a virtual scene-based experience of cultural and creative products, the edge computing node performs access fingerprint expansion and orchestration on the request, extracts the terminal access identifier, session entry set application information, and snapshot index entry application information, and performs field normalization and conflict resolution. The terminal access identifier is validated, and the request time is mapped to the unified clock source scale of the edge computing node. The session entry set application information is merged into entry type and concurrent occupancy intention expansion. The snapshot index entry application information is expanded with index position requirements and replayability granularity constraints. The terminal access identifier validation result, unified clock source scale mapping result, session entry set application information expansion result, and snapshot index entry application information expansion result are encapsulated and associated to generate a session access request parsing package.

[0026] It should be noted that the access fingerprint is composed of the terminal access identifier verification result, the entry type of the session entry set application information merged with the concurrent occupancy intention expansion result, the index position requirement expansion and replayability granularity constraint sorting result of the snapshot index entry application information, and the time stamp mapped to the unified clock source scale of the edge computing node.

[0027] Playback granularity constraints are used to limit the minimum time segment or consistency stamp boundary number span that a snapshot index entry is allowed to be located during playback positioning, so that the snapshot segment alignment index and the consistency stamp alignment index can be closed and attached at the same granularity.

[0028] Perform snapshot index entry reservation mapping on the session access request parsing packet, and simultaneously lock the session entry set and session calculation quota to generate a session access orchestration entry set; Furthermore, the snapshot index entry application information in the session access request parsing packet is used to define the snapshot index entry reserved segment and bind the reserved mapping handle. The reserved segment is allocated according to the storage location constraint and replayability granularity constraint of the snapshot index entry, and the start and end offsets and access paths of the reserved segment are solidified and encapsulated into the reserved mapping handle. The session entry set application information in the session access request parsing packet is used to perform access endpoint reachability verification, concurrency occupancy verification and entry type merging to complete the session entry set occupancy lock. The session calculation quota associated with the session access request parsing packet is used to perform quota occupancy and over-quota rollback processing. The reserved mapping handle, session entry set occupancy lock result and session calculation quota occupancy result are encapsulated and aggregated to generate the session access orchestration entry set.

[0029] It should be noted that the storage location constraint is as follows: the reserved segment used to limit the snapshot index entry can only fall within the storage level and physical location allowed by the edge computing node, and must meet the access path and read / write latency requirements.

[0030] Reserved mapping handle: A reference carrier used to uniquely point to and access the reserved section of the snapshot index entry. It contains the location information of the reserved section and the access path information, so as to establish the atomic attachment encapsulation and replayable mapping relationship of the snapshot index entry in the future.

[0031] The session access orchestration entry set is fixed with double boundaries for the session validity time window and encapsulated as a session ticket payload. At the same time, integrity verification is performed and a session ticket receipt is generated. Furthermore, the session access orchestration entry set is subjected to dual-boundary solidification of the session effective time window. Based on the unified clock source scale of the edge computing node, the start boundary and end boundary of the session effective time window are determined and the boundary legality is checked. For boundary out-of-bounds or boundary reversal, boundary rollback is registered and boundary recalculation is completed. The session entry set occupancy locking result, session calculation quota occupancy result, snapshot index entry reserved mapping handle and the start boundary and end boundary of the session effective time window are encapsulated into a session ticket payload. The session ticket payload is subjected to integrity check and occupancy consistency check and a session ticket is generated. The session ticket and session ticket payload are aggregated, encapsulated and sent back to generate a session ticket receipt.

[0032] It should be noted that the session ticket receipt refers to the return carrier used to send back the issued session ticket and the corresponding session ticket payload to the experience terminal. It is used to prove that the session entry set occupancy lock result, the session calculation quota occupancy result, the snapshot index entry reserved mapping handle and the session effective time window boundary have been bound and can be used by the subsequent dual-plane creation preparation package.

[0033] Based on the session ticket receipt, the session ticket, session validity time window, and snapshot index entry are aggregated to generate a session access list.

[0034] Furthermore, based on the session ticket receipt, the integrity and consistency of the receipt are checked, and the session ticket, the start boundary of the session valid time window, the end boundary of the session valid time window, and the reserved mapping handle of the snapshot index entry are extracted. The boundary legality is checked for the start boundary and end boundary of the session valid time window, and boundary rollback is performed for out-of-bounds time windows. The session ticket, the start boundary of the session valid time window, the end boundary of the session valid time window, and the reserved mapping handle of the snapshot index entry are encapsulated into session access list entries and merged according to the session ticket to generate a session access list.

[0035] The dual-plane construction module is used to create a session control plane and a screen data plane based on the session access list, and bind the session entry set and screen channel set respectively. At the same time, it establishes a consistency stamp alignment index and generates a dual-plane session operation graph. Based on the session access list, combined with the unified clock source, the session ticket is expanded, the session consistency stamp benchmark is obtained, and the session entry set and screen channel set are locked to generate a dual-plane creation preparation package. Furthermore, based on the session access list, the session ticket and the boundary of the session valid time window are located. The unified clock source is invoked to deseal and verify the session ticket and convert the time caliber. The starting boundary of the session valid time window is aligned with the scale of the unified clock source and the stamp start point is set. The ending boundary of the session valid time window is set as the stamp end point, generating a session consistency stamp benchmark. Based on the session consistency stamp benchmark, endpoint reachability detection and concurrent occupancy locking are performed on the session entry set. Channel quota application and encoding capability matching are performed on the screen channel set, and bandwidth queue occupancy locking is completed. The session consistency stamp benchmark, session entry set locking results and screen channel set locking results are aggregated and encapsulated to generate a dual-plane creation preparation package.

[0036] The dual-plane creation preparation package performs dual-plane session runtime entity splitting and orchestration, creates session control plane and screen data plane, establishes cross-plane event transmission channels and cross-plane state buffers, and generates dual-plane runtime entities; Furthermore, the dual-plane creation preparation package performs dual-plane session runtime entity splitting and orchestration. Based on the session consistency stamp benchmark, it generates session control plane execution context and screen data plane execution context. It binds the session entry set locking result to the session control plane and opens the input access endpoint and state advancement entry. It binds the screen channel set locking result to the screen data plane and opens the rendering task queue, encoding queue and continuous frame stream output endpoint. Based on the session consistency stamp benchmark, it establishes a cross-plane event delivery channel, configures the delivery order and rollback queue of the event delivery channel, establishes a cross-plane state buffer based on the cross-plane event delivery channel, and configures the cursor advancement and occupancy limit rollback handling of the buffer. It encapsulates and aggregates the session control plane description, screen data plane description, cross-plane event delivery channel description, and cross-plane state buffer description to generate a dual-plane runtime entity.

[0037] It should be noted that the cross-plane event delivery channel is a cross-plane delivery path that delivers events generated by the session control plane to the screen data plane in the delivery order based on the session consistency stamp benchmark, and performs reordering and rollback processing through the rollback queue when out of order or when capacity is tight.

[0038] Cross-plane state buffer: Based on the cross-plane event transmission channel, the delivered events and corresponding state increment entries are temporarily stored and made available to the screen data plane in a cursor-advance manner. At the same time, when the occupancy reaches the upper limit, a rollback is triggered to maintain session consistency and closure of retrieval under the boundary.

[0039] Based on the dual-plane running entity, a consistent stamp alignment index is constructed, and a replayable mapping relationship is established with the snapshot index entry to generate a dual-plane session running graph.

[0040] Furthermore, based on the dual-plane operation entity positioning of the session control plane, screen data plane, cross-plane event transmission channel, and cross-plane state buffer, a consistency stamp is assigned to each input enqueuing action of the session entry set access endpoint according to the session consistency stamp benchmark, and an input consistency stamp sequence is generated. The state increment entries output by the session control plane are associated with the state increment consistency stamp sequence according to the input consistency stamp sequence. In the screen data plane, a one-to-one correspondence is established between the state increment consistency stamp sequence taken by the rendering task queue and the continuous frame stream segments output by the encoding queue to generate a consistency stamp alignment index. Gap filling and conflict rollback are performed on the consistency stamp alignment index. A replayable mapping relationship is established between the consistency stamp alignment index and the reserved mapping handle of the snapshot index entry, and the mapping anchor point is fixed. The session control plane description, screen data plane description, consistency stamp alignment index and replayable mapping relationship are aggregated to generate a dual-plane session operation graph.

[0041] It should be noted that the consistency stamp alignment index is used to establish a one-to-one retrieval relationship between the state increment consistency stamp sequence generated by the session control plane and the continuous frame stream segments output by the screen data plane based on the session consistency stamp benchmark, and is attached to the reserved mapping handle of the snapshot index entry to support stamp-based playback positioning.

[0042] The dual-plane session operation diagram is a session operation relationship diagram that converges the session control plane description, screen data plane description, consistency stamp alignment index and snapshot index entry replayable mapping relationship. It is used to establish a searchable one-to-one correspondence link between input queuing actions, state increment entries and continuous frame stream segments under the session consistency stamp benchmark.

[0043] Figure 2 The horizontal axis represents the frame sequence within a second, the vertical axis represents seconds, and the color bars represent alignment errors (milliseconds). Each pixel corresponds to the stamp alignment deviation between the session control plane and the screen data plane at a certain frame sequence position within the same second. The lighter the color, the smaller the deviation. The experimental group established a consistency stamp alignment index through a dual-plane session run graph and established a one-to-one correspondence between the input consistency stamp sequence, the state increment consistency stamp sequence, and continuous frame stream segments. This resulted in the heat map showing a stable low-error band at most frame sequence positions within a second, while high-error blocks exhibited localized and short-term characteristics. In the control group, when there was a lack of consistency stamp alignment index or the replayable mapping relationship was incomplete, the heat map was more likely to show scattered high-error blocks and cross-second drift bands.

[0044] Experimental group: Using the complete link of the dual-plane session operation graph, the input consistency stamp sequence and the state increment consistency stamp sequence are generated on the session control plane side. On the screen data plane side, the state increment consistency stamp sequence and the continuous frame stream segments output by the encoding queue are established to form a consistency stamp alignment index, and a replayable mapping relationship is established with the snapshot index entry.

[0045] Control group: The baseline link does not include consistent stamp alignment index and replayable mapping relationship. It only relies on arrival order or regular timestamp alignment to concatenate input enqueue, state increment generation and continuous frame stream output. It does not perform unified index closure of the stamp boundaries of the session control plane and the screen data plane, or only retains incomplete correspondence.

[0046] Figure 3 The analysis focuses on the changes in alignment error under varying arrival out-of-order ratios. The horizontal axis represents the levels of arrival out-of-order severity of the multimodal experience interaction data stream at the session entry set access endpoint, from low to high. The vertical axis represents the statistical value of the stamp alignment deviation between the state increment consistency stamp sequence output by the session control plane and the continuous frame stream segments output by the encoding queue in the consistency stamp alignment index. In the control group, when there is a lack of consistency stamp alignment index or incomplete handling of gaps in the consistency stamp alignment index, gaps and conflicts are more likely to occur between the input consistency stamp sequence and the state increment consistency stamp sequence. The stamp alignment deviation increases with the arrival out-of-order ratio and exhibits a tail-lifting effect. In the experimental group, after establishing a consistency stamp alignment index on the image data plane and performing gap filling and conflict rollback handling, the state increment entries used by the rendering task queue maintain a one-to-one correspondence with the continuous frame stream segments. The increase in stamp alignment deviation with the arrival out-of-order ratio is smaller, thus demonstrating the improvement in multimodal interaction consistency and edge-side timing synchronization capabilities.

[0047] The state update module is used to collect multimodal experience interaction data streams for preprocessing, and combine them with the session control plane in the dual-plane session run graph to sort the inputs into queues, obtain state increment entries, and drive the screen data plane to update the state increments to generate a session run state set. Collect multimodal experience interaction data streams, and perform time scale normalization, arrival out-of-order callback and duplicate segment elimination to generate a batch encapsulation set of session control inputs; Furthermore, the system collects multimodal experience interaction data streams and registers arrival and sampling times according to data source channels. Based on a unified clock source, the time scale of the multimodal experience interaction data streams is normalized to a unified time grid, and time alignment clipping is performed on leading and lagging segments. The multimodal experience interaction data streams are sorted by arrival time, and out-of-order segments are rolled back to their corresponding time scales. Priority retention decisions are made for conflicting rollback segments. Duplicate segments are eliminated from the multimodal experience interaction data streams by comparing segment fingerprints and verifying time scale overlap. Duplicate segments are also eliminated by splicing overlapping segments. The time scale normalization results, out-of-order rollback results, and duplicate segment elimination results are bucketed according to time scales and batched with batch numbers to generate a session control input batch set.

[0048] Based on the session control input batch encapsulation set, a consistent stamp-driven input enqueue sorting is performed in the session control plane of the dual-plane session run graph, and the input queue index is written to generate an ordered input queue. Furthermore, based on the session control input batch encapsulation set, the input batches after time-scale binning are extracted batch by batch. The session control plane of the dual-plane session operation graph is called to locate the session consistency stamp benchmark. A consistency stamp is assigned to each input segment according to the session consistency stamp benchmark, and an input consistency stamp sequence is generated. The consistency stamp monotonicity check is performed on the input consistency stamp sequence, and the out-of-order consistency stamps are reordered. The priority adjudication is performed on the input segments with conflicting stamps, and a stamp retention list is generated. The reordering result and the stamp retention list are sorted by consistency stamp from smallest to largest, and the inputs are enqueued and sorted to form the head and tail cursors of the queue. Based on the head and tail cursors of the queue, a continuous queue position is assigned to each enqueued input segment, and an input queue index is generated. The input enqueuing sorting result and the input queue index are encapsulated and merged into an ordered input queue, generating an ordered input queue.

[0049] Perform segmented submission and replayability of state increment entries on the ordered input queue, and bind them to the input queue index to generate a state increment entry queue. Furthermore, the system retrieves enqueued input segments from the ordered input queue according to their indices, calls the session control plane of the dual-plane session run graph to perform session state advancement, and organizes the session state changes triggered by each enqueued input segment into state increment entries. It then performs segmented commits on the state increment entries based on consistency stamp continuity, merging state increment entries within adjacent consistency stamp ranges into segmented commit segments and generating segment boundary cursors. Finally, it performs replayable attachments on the segmented commit segments, associating the segmented commit segments with the replayable mapping relationship of the snapshot index entry and generating a replay positioning pointer. Each state increment entry is bound to its corresponding input queue index, maintaining a one-to-one correspondence. The binding results of the segmented commit segments, replay positioning pointers, and input queue indices are encapsulated into a state increment entry queue, generating the state increment entry queue.

[0050] It should be noted that segmented commit merges state increment entries into segmented commit fragments based on consistency stamp continuity. The replayable hook is a replayable mapping relationship that hooks the segmented commit fragments to the snapshot index entry through the replay positioning pointer and binds them one by one to the input queue index.

[0051] Based on the state increment entry queue, perform state increment fetching and updating in the screen data plane, and synchronously aggregate the scene graph version pointer and consistency stamp boundary sequence number to generate a session running state set.

[0052] Furthermore, the screen data plane is scheduled according to the segmented submission order of the state increment entry queue. A state increment entry matching the current rendering task queue cursor is retrieved from the state increment entry queue, and a state increment retrieval update is performed. The state increment entry is applied to the scene graph of the screen data plane, and a rendering task entry corresponding to the updated scene graph state is generated and enqueued into the rendering task queue. For each scene graph state after a state increment retrieval update, a scene graph version pointer is generated and attached to the scene graph version pointer link in the generation order, and the link tail pointer is updated. This ensures that the scene graph version pointer retrieved by the rendering task queue can establish a correspondence with the frame stream segments received by the encoding queue, aligned with the same link tail pointer. Under the session consistency stamp benchmark, consistency stamp boundary numbers are extracted from the beginning and end consistency stamps of the state increment entries and aligned with the scene graph version pointer. The state increment retrieval update result, the scene graph version pointer, and the consistency stamp boundary numbers are encapsulated and aggregated to generate a session running state set.

[0053] It should be noted that the scene graph version pointer is used to uniquely point to the scene graph state version after the screen data plane has been updated by a state increment, and establishes a searchable correspondence with the corresponding consistency stamp boundary number and the frame stream segment received by the encoding queue.

[0054] The snapshot solidification module is used to freeze the stamp boundaries based on the session running state set and the consistency stamp, solidify the control plane snapshot segment and the data plane snapshot segment, write the consistency stamp boundary marker, and generate a session snapshot package; Based on the session running state set, solidify the consistency stamp boundary freeze slice, and perform input enqueue closure and state increment entry queue segment tail sealing to generate a one-time stamp boundary freeze preparation package; Furthermore, based on the session running state set location scenario graph version pointer and consistency stamp boundary sequence number, the boundary corresponding to the consistency stamp boundary sequence number is selected as the frozen boundary and the consistency stamp boundary frozen slice is solidified. The range of input consistency stamp sequence and the range of state increment consistency stamp sequence corresponding to the frozen boundary are determined as the coverage area of ​​the frozen slice. Input enqueue closure is performed on the session control plane, suspending the enqueue acceptance of the session entry set access endpoint, and queueing and condensing the enqueued but not sorted input segments to form an input enqueue closure list. Segment tail sealing is performed on the state increment entry queue, positioning the last state increment entry within the coverage area of ​​the frozen slice as the segment tail and closing the append channel for segmented submission segments. State increment entries after the segment tail are registered as segments to be continued. The consistency stamp boundary frozen slice, the input enqueue closure list and the state increment entry queue segment tail sealing results are encapsulated and converged to generate a one-time stamp boundary freezing preparation package.

[0055] It should be noted that performing queued closure involves regrouping the enqueued but not sorted input segments into a continuous queue segment based on the input consistency stamp sequence and the input queue index, and fixing the tail of the queue segment, so that the input enqueuing closure list only retains the set of ordered segments that can be directly closed.

[0056] Based on the one-time stamp boundary freeze preparation package, perform co-stamp convergence on the control plane snapshot segment and the data plane snapshot segment, and solidify the session state machine snapshot and the sequence of events to be committed, generating the solidified sequence of the control plane snapshot segment; Furthermore, based on the one-time stamp boundary freeze preparation package, the freeze boundary and coverage of the consistency stamp boundary freeze slice are determined. The session control plane is invoked to align the input enqueue closure list and the state increment entry queue segment tail sealing results within the coverage to the same freeze boundary to perform same-stamp convergence. The session state advancement results completed before the freeze boundary are summarized and a session state machine snapshot is generated. The cross-plane event transmission channel delivery records and cross-plane state buffer occupancy records that have not been committed within the coverage of the freeze boundary are collected and organized to form a sequence of events to be committed, and the sequence of events to be committed is associated with the session state machine snapshot. The session state machine snapshot and the sequence of events to be committed are checked for integrity and consistency stamp boundary sequence number. Entries that do not meet the check are rolled back and removed. The session state machine snapshot and the sequence of events to be committed are encapsulated and aggregated to generate a control plane snapshot segment solidification sequence.

[0057] Based on the control plane snapshot segment solidification sequence, the scene graph version pointer and queue cursor closed segment are extracted from the screen data plane and written into the snapshot segment alignment index to generate the data plane snapshot segment solidification sequence; Furthermore, based on the control plane snapshot segment solidification sequence, the session state machine snapshot, the sequence of events to be committed, and the consistency stamp boundary number are extracted. The scene graph version pointer corresponding to the frozen boundary of the screen data plane is locked and the advancement of the rendering task queue and the encoding queue cursors is paused. The current positions of the rendering task queue cursor and the encoding queue cursor are closed. The closed segment is extracted in the scene graph version pointer link according to the consistency stamp boundary number, and the closed segment of the rendering task queue and the closed segment of the encoding queue are extracted simultaneously. The snapshot segment alignment index from the consistency stamp boundary number to the scene graph version pointer and the queue cursor is established and encapsulated and converged to generate the data plane snapshot segment solidification sequence.

[0058] It should be noted that the queue cursor closed segment refers to the continuous task interval that is intercepted and closed forward from the current position of the rendering task queue cursor and the encoding queue cursor at the frozen boundary corresponding to the consistency stamp boundary number. It is used to accurately reset the accessed position to the same consistency stamp boundary number during playback or relay recovery.

[0059] Perform atomic encapsulation of snapshot index entry on the data plane snapshot segment solidified sequence, and perform same-stamp alignment between the consistency stamp boundary and the snapshot segment alignment index to generate a session snapshot package.

[0060] Furthermore, the scene graph version pointer closed segment, rendering task queue closed segment, encoding queue closed segment and snapshot segment alignment index are extracted from the data plane snapshot segment solidification sequence. The reserved mapping handle of the snapshot index entry is called to initiate a hanging slot occupation request. An unoccupied hanging slot is selected in the reserved segment and an exclusive occupation lock is completed. The hanging slot number and exclusive occupation token are returned and a temporary hanging certificate is established. The temporary hanging certificate is formed by combining the hanging slot number, exclusive occupation token and the snapshot segment alignment index position pointer to be hung. It is used to temporarily store the positioning relationship of the encapsulated object after the same stamp alignment before atomic hanging. The data plane snapshot segment solidified sequence and the control plane snapshot segment solidified sequence are aligned using the consistency stamp boundary number. The consistency stamp boundary number is verified to be consistent with the coverage of the snapshot segment alignment index. For inconsistent entries, alignment rollback and truncation range shrinkage are performed. Atomic attachment is performed on temporary attachment credentials. The control plane snapshot segment solidified sequence and the data plane snapshot segment solidified sequence after consistency stamp alignment are encapsulated into the snapshot index entry attachment slot at once, and the replayable mapping anchor point is confirmed. The snapshot index entry attachment result, the control plane snapshot segment solidified sequence and the data plane snapshot segment solidified sequence are encapsulated and aggregated to generate a session snapshot package.

[0061] It should be noted that the replayable mapping anchor point is a positioning point in the snapshot index entry used to stably bind the consistency stamp boundary sequence number with the corresponding control plane snapshot segment solidification sequence, data plane snapshot segment solidification sequence and snapshot segment alignment index, so that the corresponding snapshot content can be directly located and restored according to the same boundary in the future.

[0062] The relay recovery module is used to seamlessly relay and recover the session control plane and the screen data plane based on the session snapshot package, and switch the continuous frame stream output channel to perform relay closure encapsulation and generate a scenario-based experience output set.

[0063] Loading and quota allocation of snapshot segment alignment index based on session snapshot package, creating relay recovery session context, initializing session consistency stamp baseline, and generating relay recovery preparation sequence; Furthermore, the snapshot index entry location and loading verification are performed on the session snapshot package. The control plane snapshot segment solidified sequence, data plane snapshot segment solidified sequence and snapshot segment alignment index are extracted and the continuity of the consistency stamp boundary sequence number is verified. Based on the snapshot segment alignment index, the session entry set occupation item, screen channel set occupation item and session computing quota occupation item are parsed. Quota occupation is initiated to the edge computing node resource management end and an occupation receipt is obtained. Downgrade occupation and retry queuing are performed for the failed occupation items. Based on the control plane snapshot segment solidified sequence and data plane snapshot segment solidified sequence obtained by snapshot index entry location and loading verification, and the occupation receipt obtained by parsing and completing quota occupation based on the snapshot segment alignment index, a relay recovery session context is established. The session state machine snapshot of the control plane snapshot segment solidified sequence, the event sequence to be submitted and the scene graph version pointer closed segment, the rendering task queue closed segment and the encoding queue closed segment of the data plane snapshot segment solidified sequence are attached to the same session context handle. The session consistency stamp benchmark is initialized according to the consistency stamp boundary sequence number and the starting consistency stamp cursor is generated. The quota occupation receipt, relay recovery session context and session consistency stamp benchmark are encapsulated and aggregated to generate the relay recovery preparation sequence.

[0064] It should be noted that the failed occupancy item refers to the resource application item that did not receive an occupancy confirmation when the resource management terminal of the edge computing node initiated the application for the occupancy of the session entry set, the screen channel set, or the session computing quota.

[0065] The control plane performs a first-stage relay recovery orchestration for the relay recovery preparation sequence, opens the session entry set access endpoints, receives multimodal experience interaction data streams, and generates a control plane relay ready set; Furthermore, the relay recovery session context, session consistency stamp benchmark, and session entry set occupancy receipt are extracted from the relay recovery preparation sequence. A session state machine snapshot is loaded, and the sequence of events to be submitted is placed into the delivery buffer of the cross-plane event transmission channel. The cursor is reset for the input queue index corresponding to the input enqueue closure list, and the input enqueue sorting reception state is enabled. The session entry set access endpoints are opened one by one according to the session entry set occupancy receipt, and the endpoint handshake verification is completed. The reception of multimodal experience interaction data stream is enabled, and the received segments are uniformly associated with the session consistency stamp benchmark to generate an input consistency stamp sequence. Out-of-order callback and duplicate segment elimination are performed on the received segments to form a session control input batch encapsulation set. The session state machine snapshot loading result, session entry set access endpoint opening result, session control input batch encapsulation set, and session consistency stamp benchmark are encapsulated and converged to generate the control plane relay ready set.

[0066] It should be noted that out-of-order rollback and duplicate fragment elimination are performed as follows: The arrival order of received fragments is compared with the expected cursor of the input consistency stamp sequence. When a received fragment with an input consistency stamp sequence earlier than the expected cursor is encountered, the expected cursor is rolled back to the corresponding consistency stamp, and the received fragment is re-inserted into the enqueue sorting waiting area to complete the reordering. When a received fragment with the same input consistency stamp sequence and received fragment content digest is encountered, it is determined to be a duplicate fragment and the later-arriving fragment is discarded. When a received fragment with the same input consistency stamp sequence but inconsistent content is encountered, the fragment consistent with the session state machine snapshot is retained, and the conflicting fragment is transferred to the rollback queue.

[0067] Based on the control plane relay ready set, perform snapshot index entry differential multiplexing, image data plane loading and channel occupation, and enter the continuous frame stream output preparation state to generate the data plane relay ready set; Based on the control plane relay ready set, extract the session consistency stamp benchmark, session entry set access endpoint opening result, and relay recovery session context handle. Call the snapshot index entry to perform differential multiplexing, locate the snapshot segment alignment index corresponding to the session snapshot packet, and calculate the differential range. Retain the scene graph version pointer closed segment and queue closed segment reference outside the differential range, and load the incremental segment within the differential range. Load the rendering task queue closed segment, encoding queue closed segment, and scene graph version pointer closed segment onto the screen data plane. Reset the rendering task queue cursor and encoding queue cursor and bind the session consistency stamp benchmark. According to the screen channel set occupancy receipt, occupy the frame stream output endpoint, encoding capability, and bandwidth queue one by one. Attach the screen channel set occupancy result to the encoding queue and frame stream output endpoint, enter the continuous frame stream output preparatory state, and generate a preparatory state heartbeat confirmation. Encapsulate and converge the snapshot index entry differential multiplexing result, screen data plane loading result, screen channel set occupancy result, and continuous frame stream output preparatory state heartbeat confirmation to generate the data plane relay ready set.

[0068] It should be noted that the ready-state heartbeat confirmation refers to the process by which the image data plane sends a lightweight keep-alive probe to the frame stream output endpoint at fixed intervals and receives a receipt to verify the endpoint reachability, bandwidth queue occupancy, and encoding queue availability when it has completed the acquisition of the image channel set and entered the ready-state of continuous frame stream output. The ready-state indicates that the rendering task queue, encoding queue, and frame stream output endpoint have all been loaded and bound, but have not yet been switched to the formal push state of continuous frame stream output channel.

[0069] The formula for calculating the difference range is: ; in, Indicates the range of differences. Indicates the first Boundary numbers Indicates the first One difference indicator quantity, Indicates the number of boundary numbers. Indicates the first One difference indicator quantity, This represents the multiplication symbol.

[0070] Perform consistency stamp boundary relay switching closure on the data plane relay ready set, and encapsulate continuous frame stream output channel switching and relay closure to generate a scenario-based experience output set.

[0071] Furthermore, the session consistency stamp baseline, continuous frame stream output pre-state heartbeat confirmation, screen channel set occupancy result, and snapshot segment alignment index differential multiplexing result are extracted from the data plane relay ready set. The consistency stamp boundary sequence number is located and a relay switching closure list is established. The current cursor of the session control plane input consistency stamp sequence is aligned and verified with the rendering task queue cursor and encoding queue cursor of the screen data plane according to the same consistency stamp boundary sequence number. Boundary freeze trigger is executed on the consistency stamp boundary relay switching closure list, the input enqueue sorting reception state corresponding to the old boundary sequence number is closed, and the pending submission event sequence is sealed. The delivery window is opened simultaneously, and the state incremental retrieval update retrieval window corresponding to the new boundary number is opened and the rendering task queue retrieval is unsealed; dual-channel parallel warm-up is performed for the continuous frame stream output channel switching, the old frame stream output endpoint continues to output, and a synchronization keyframe start point is established at the new frame stream output endpoint. The frame stream segments output by the encoding queue are switched and mapped to the new frame stream output endpoint according to the snapshot segment alignment index, and the old frame stream output endpoint is closed; the relay closure encapsulation convergence consistency stamp boundary relay switching closure record, continuous frame stream output channel switching record and screen channel set occupancy result are encapsulated to generate a scene-based experience output set.

[0072] Figure 4 The diagram illustrates the latency breakdown of the relay recovery process, with each sector representing the time occupancy of snapshot loading, control plane relay readiness, data plane relay readiness, and output channel switching within a single session interruption recovery. The snapshot loading phase relies on the snapshot segment alignment index and atomic hooking result of the session snapshot packet to load the solidified content and allocate quotas. The control plane relay readiness phase loads the session state machine snapshot and restores the input queuing and sorting receiving state, receiving multimodal experience interaction data streams and forming a session control input batch encapsulation set. The data plane relay readiness phase executes differential multiplexing of the snapshot index entry and loads the screen data plane, entering a continuous frame stream output preparation state. The output channel switching phase completes the continuous frame stream output channel switching and relay closure encapsulation. This breakdown structure illustrates how the snapshot solidification and relay recovery mechanisms converge recovery time to a controllable stage on the edge computing side, thereby supporting seamless reconstruction and improved experience continuity after a session interruption.

[0073] In summary, this invention achieves state decoupling and timing synchronization by constructing a dual-plane control plane and data plane at the edge computing node and establishing a consistent stamp alignment index, ensuring consistency of multimodal interactions and improving the real-time response of the edge side; and achieves seamless local reconstruction after session interruption by using the edge computing side snapshot solidification and relay recovery mechanism, avoiding cloud dependence and enhancing experience continuity and system reliability.

[0074] It should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and are not intended to limit it. Although the present invention has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of the present invention without departing from the spirit and scope of the technical solutions of the present invention, and all such modifications or substitutions should be covered within the scope of the claims of the present invention.

Claims

1. A virtual scene-based experience system for cultural and creative products based on edge computing, characterized in that: include, The session orchestration module is used to receive requests for virtual scene-based experiences of cultural and creative products, orchestrate session access at edge computing nodes, issue session tickets to solidify the effective time window and snapshot index entry of the session, and generate a session access list. The dual-plane construction module is used to create a session control plane and a screen data plane based on the session access list, and bind the session entry set and screen channel set respectively. At the same time, it establishes a consistency stamp alignment index and generates a dual-plane session operation graph. The state update module is used to collect multimodal experience interaction data streams for preprocessing, and combine them with the session control plane in the dual-plane session run graph to sort the inputs into queues, obtain state increment entries, and drive the screen data plane to update the state increments to generate a session run state set. The snapshot solidification module is used to freeze the stamp boundaries based on the session running state set and the consistency stamp, solidify the control plane snapshot segment and the data plane snapshot segment, write the consistency stamp boundary marker, and generate a session snapshot package; The relay recovery module is used to seamlessly relay and recover the session control plane and the screen data plane based on the session snapshot package, and switch the continuous frame stream output channel to perform relay closure encapsulation and generate a scenario-based experience output set.

2. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 1, characterized in that: The steps for performing session access orchestration at edge computing nodes are as follows: Receive requests for virtual scene-based experiences of cultural and creative products, perform access fingerprint expansion and orchestration on edge computing nodes, and generate session access request parsing packets; Perform snapshot index entry reservation mapping on the session access request parsing packet, and simultaneously lock the session entry set and session calculation quota to generate a session access orchestration entry set.

3. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 2, characterized in that: The steps for generating the session access list are as follows: The session access orchestration entry set is fixed with double boundaries for the session validity time window and encapsulated as a session ticket payload. At the same time, integrity verification is performed and a session ticket receipt is generated. Based on the session ticket receipt, the session ticket, session validity time window, and snapshot index entry are aggregated to generate a session access list.

4. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 3, characterized in that: The steps for generating the dual-plane session execution graph are as follows: Based on the session access list, combined with the unified clock source, the session ticket is expanded, the session consistency stamp benchmark is obtained, and the session entry set and screen channel set are locked to generate a dual-plane creation preparation package. The dual-plane creation preparation package performs dual-plane session runtime entity splitting and orchestration, creates session control plane and screen data plane, establishes cross-plane event transmission channels and cross-plane state buffers, and generates dual-plane runtime entities; Based on the dual-plane running entity, a consistent stamp alignment index is constructed, and a replayable mapping relationship is established with the snapshot index entry to generate a dual-plane session running graph.

5. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 4, characterized in that: The steps for sorting the inputs before queuing are as follows: Collect multimodal experience interaction data streams, preprocess them, and generate a batch encapsulation set of session control inputs; Based on the session control input batch encapsulation set, consistent stamp-driven input enqueue sorting is performed in the session control plane of the biplane session run graph, and the input queue index is written to generate an ordered input queue.

6. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 5, characterized in that: The steps for generating the session runtime state set are as follows: Perform segmented submission and replayability of state increment entries on the ordered input queue, and bind them to the input queue index to generate a state increment entry queue. Based on the state increment entry queue, perform state increment fetching and updating in the screen data plane, and synchronously aggregate the scene graph version pointer and consistency stamp boundary sequence number to generate a session running state set.

7. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 6, characterized in that: The steps for generating the session snapshot package are as follows: Based on the session running state set, solidify the consistency stamp boundary freeze slice, and perform input enqueue closure and state increment entry queue segment tail sealing to generate a one-time stamp boundary freeze preparation package; Based on the one-time stamp boundary freeze preparation package, perform co-stamp convergence on the control plane snapshot segment and the data plane snapshot segment, and solidify the session state machine snapshot and the sequence of events to be committed, generating the solidified sequence of the control plane snapshot segment; Based on the control plane snapshot segment solidification sequence, the scene graph version pointer and queue cursor closed segment are extracted from the screen data plane and written into the snapshot segment alignment index to generate the data plane snapshot segment solidification sequence; Perform atomic encapsulation of snapshot index entry on the data plane snapshot segment solidified sequence, and perform same-stamp alignment between the consistency stamp boundary and the snapshot segment alignment index to generate a session snapshot package.

8. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 7, characterized in that: The steps for seamlessly restoring the session control plane and the screen data plane are as follows. Loading and quota allocation of snapshot segment alignment index based on session snapshot package, creating relay recovery session context, initializing session consistency stamp baseline, and generating relay recovery preparation sequence; The control plane performs a first relay recovery orchestration for the relay recovery preparation sequence, opens the session entry set access endpoints, receives multimodal experience interaction data streams, and generates a control plane relay ready set.

9. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 8, characterized in that: The steps for generating the contextualized experience output set are as follows: Based on the control plane relay ready set, perform snapshot index entry differential multiplexing, image data plane loading and channel occupation, and enter the continuous frame stream output preparation state to generate the data plane relay ready set; Perform consistency stamp boundary relay switching closure on the data plane relay ready set, and encapsulate continuous frame stream output channel switching and relay closure to generate a scenario-based experience output set.

10. The virtual scene-based experience system for cultural and creative products based on edge computing as described in claim 5, characterized in that: The preprocessing includes time scale normalization, arrival out-of-order rollback, and duplicate segment elimination.

Images