Large-space immersive experience system

Abstract

According to the large-space immersive experience system provided by the invention, an integrated efficient solution is provided for a content producer, a content issuer and a content operator. By means of the system, the development period can be remarkably shortened, and the tedious workload is effectively reduced. Along with continuous expansion of a deployment environment, the system will continuously create more values, and long-term benefits are brought to a content producer. For the issuer and the operator, the system provides an efficient and simple tool, the copyright of the digital content can be comprehensively protected, the rapid distribution of the content and the efficient development of the personalized operation can be ensured, a solid guarantee is provided for the issuing and operation process, and the smooth promotion of the business is facilitated.

Description

Technical Field

[0001] The present application relates to the field of immersive large-space technology, and in particular to a large-space immersive experience system. Background Art

[0002] In recent years, with the rise of large-space systems, LBE digital cinemas, and immersive entertainment experiences, as well as the rapid development of related technologies, the immersive entertainment industry is experiencing unprecedented growth opportunities. For example, the significant improvement in the computing power of 6DoF MR devices has given them the powerful computing power to render stunning visual effects and quickly respond to interactive experiences. At the same time, inside-out positioning and tracking technology for large spaces has matured. This technology uses SLAM algorithms to calculate the spatial position of cameras installed on head-mounted displays (HMDs), thereby achieving precise positioning and tracking of the headset or controller. Furthermore, the rapid development of Wi-Fi 6 and Wi-Fi 7 provides high-throughput, low-latency, strong interference resistance, and wide coverage network support, laying a solid foundation for the smooth transmission of immersive experiences.

[0003] Although the above-mentioned technological advances have promoted the rapid development of the immersive entertainment industry, the industry still faces the problem of technical fragmentation in the entire chain from content development to operation. Specifically, current technical solutions mostly focus on the optimization of a single link, and lack an integrated auxiliary technical solution covering content creation, device adaptation, scene deployment, user interaction and data management. For example, in the content production stage, developers need to independently adapt to different hardware platforms (such as VR headsets, interactive handles, and dynamic environment devices), resulting in a lengthy development cycle and high costs; in the distribution link, the feedback mechanism for content distribution and end-user interaction data has not yet formed a closed loop, resulting in inefficient content distribution. In the operation stage, there is a lack of standardized tools for multi-device collaborative management and real-time data feedback. Therefore, the consistency and scalability of the development of immersive experience are limited. Summary of the Invention

[0004] In view of the above-mentioned shortcomings of the existing technology, the present invention provides a large-space immersive experience system to solve the problems in the existing technology, such as the lack of an integrated auxiliary technology solution in various stages from content production to distribution and operation.

[0005] To achieve the above-mentioned and other related purposes, the first aspect of the present application provides a large-space immersive experience system, comprising: a user server for obtaining user's ticket purchase information and verifying the ticket purchase information; a device server for obtaining the operating status information of the user's device in real time, and binding or unbinding the user's device with the corresponding user; a film scheduling server for obtaining the ticket purchase information of one or more users, determining the entry timestamp of each user and the selected target digital content according to the ticket purchase information of one or more users, and performing film scheduling management; a central control server connected to the user server, the device server and the film scheduling server respectively, for comprehensively managing the large-space immersive experience system according to the user's ticket purchase information, the operating status information of the user's device and multiple groups of digital content; a communication coordination server, Connected to the central control server, it is used to manage and coordinate the communication and interaction between user devices and each server based on a preset transmission protocol; the map server is connected to the central control server and the communication coordination server respectively, and is used to obtain the real-time location information of each user device, determine the area of ​​interest of each user based on the real-time location information of each user device, and send the map data information of the area of ​​interest to other user devices; the dynamic path planning server is connected to the communication coordination server, and is used to make dynamic path planning adjustments based on real-time crowd density data and combined with the map data of the actual operating venues of the large-space immersive experience system; the external expansion server is connected to the central control server, and is used to access or replace functional plug-ins to expand the service functions of the large-space immersive experience system.

[0006] In some embodiments of the first aspect of the present application, the system further includes a team server; the team server is connected to the communication coordination server and is used to handle operations and interactions between user devices within the user team.

[0007] In some embodiments of the first aspect of the present application, the system also includes a digital certificate server; the digital certificate server is connected to the central control server; the digital certificate server is used to receive the digital certificate corresponding to the digital content to be connected to the large-space immersive experience system and verify and monitor it.

[0008] In some embodiments of the first aspect of the present application, the device server is a plurality of device servers; each device server corresponds to a user device.

[0009] In some embodiments of the first aspect of the present application, the map server is also used to store map data of the actual operating venues of the large-space immersive experience system, and accurately match the digital content to be accessed with the map data of the actual operating venues of the large-space immersive experience system.

[0010] In some embodiments of the first aspect of the present application, the user server is further used to obtain the user's personalized information and / or team information based on the user's ticket purchase information.

[0011] In some embodiments of the first aspect of the present application, the preset transmission protocol is the KCP protocol.

[0012] In some embodiments of the first aspect of the present application, the user server is also connected to a code scanning terminal; the user's ticket purchase information is obtained by scanning the code through the code scanning terminal, and the user's ticket purchase information is sent to the user server.

[0013] In some embodiments of the first aspect of the present application, the device server is further connected to a code scanning terminal; the device information of the user device is obtained by scanning the code through the code scanning terminal, and the device information of the user device is sent to the device server.

[0014] In some embodiments of the first aspect of the present application, the scheduling server is also connected to a ticket-issuing terminal; the user's ticket purchase information is obtained through the ticket-issuing terminal, and scheduling management of the target digital content selected by the user is performed based on the user's ticket purchase information.

[0015] As described above, the large-space immersive experience system provided by this application has the following beneficial effects:

[0016] This application provides an integrated and efficient solution for content producers, distributors, and operators. With the help of this system, content producers can significantly shorten the development cycle and effectively reduce tedious workload. As the deployment environment continues to expand, the system will continue to create more value and bring long-term benefits to content producers. For distributors and operators, this system provides efficient and concise tools that can not only fully protect the copyright of digital content, but also ensure the rapid distribution of content and the efficient implementation of personalized operations, providing solid guarantees for the distribution and operation processes, and helping the business to proceed smoothly. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 Shown is a structural schematic diagram of a large-space immersive experience system in one embodiment of the present application.

[0018] Figure 2 Shown is another structural schematic diagram of a large-space immersive experience system in one embodiment of the present application.

[0019] Figure 3 Shown is a specific embodiment diagram of a large-space immersive experience system in one embodiment of the present application.

[0020] Figure 4Shown is another specific embodiment diagram of a large-space immersive experience system in one embodiment of the present application. DETAILED DESCRIPTION

[0021] The following describes the embodiments of the present application through specific examples. Those skilled in the art can easily understand the other advantages and effects of the present application from the content disclosed in this specification. The present application can also be implemented or applied through other different specific embodiments. The details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present application. It should be noted that the following embodiments and features in the embodiments can be combined with each other unless they conflict.

[0022] Before further explaining the present invention in detail, the nouns and terms involved in the embodiments of the present invention are explained. The nouns and terms involved in the embodiments of the present invention are subject to the following interpretations:

[0023] <1> Virtual Reality (VR) technology: a computer simulation system that can create and experience a virtual world. It uses computers to generate a simulated environment. It is a multi-source information fusion, interactive three-dimensional dynamic vision and entity behavior system simulation, allowing users to immerse themselves in the environment.

[0024] <2> Augmented reality technology (AR) is a technology that seamlessly integrates real-world information and virtual-world information. It simulates and superimposes physical information that is difficult to experience within a certain time and space range in the real world through computers and other scientific technologies, and applies virtual information to the real world, which is perceived by human senses, thereby achieving a sensory experience beyond reality.

[0025] <3> Mixed reality (MR), encompassing both virtual reality and augmented reality, refers to a new visual environment created by merging the real and virtual worlds. Within this new visual environment, physical and digital objects coexist and interact in real time. It is a further development of virtual reality. By introducing real-world scene information into the virtual environment, this technology establishes an interactive feedback loop between the virtual and real worlds and the user, enhancing the realism of the user experience.

[0026] <4> Extended Reality (XR) refers to the use of modern high-tech means with computers as the core to create a digital environment that combines real and virtual environments, as well as new human-computer interaction methods, to provide users with an immersive experience of seamless transition between the virtual and real worlds. It is a general term for multiple technologies such as AR, VR, and MR.

[0027] <5> AOI (Area of ​​Interest): A geographical area of ​​interest to a user, primarily used to represent regional entities in map data. Examples include a residential community, a university, an industrial park, a shopping mall, a scenic spot, or a stadium. The location data for an AOI in map data consists of a set of latitude and longitude coordinates. This set of latitude and longitude coordinates includes the latitude and longitude of multiple AOI boundary locations, arranged in sequence. These longitude and latitude coordinates, when connected in sequence, represent the extent of the area identified by the AOI in the map data.

[0028] <6> KCP: KCP (A Fast and Reliable ARQ Protocol) is a fast and reliable transmission protocol based on UDP (User Datagram Protocol) and designed to provide low-latency, high-reliability data transmission services. KCP relies primarily on improvements to UDP-based protocols, using multiple mechanisms to improve the efficiency and reliability of network data transmission. It achieves more efficient network communication than traditional TCP by rationally utilizing bandwidth, optimizing packet loss retransmission strategies, and applying flow control and congestion avoidance techniques. It is commonly used in applications requiring high network efficiency and stability, such as streaming media, online gaming, and the Internet of Things (IoT).

[0029] <7> Location-Based Entertainment (LBE): A form of entertainment that combines virtual reality technology with physical locations. Unlike traditional VR experiences, LBE typically takes place within a specific physical space, allowing users to move freely and interact with the virtual environment. LBE allows users to not only enjoy the immersive experience of virtual reality but also interact with friends and other players in real space, enhancing both social interaction and entertainment.

[0030] To facilitate understanding of the embodiments of this application, first Figure 1 Detailed description. Figure 1 The following is a schematic diagram of the structure of a large-space immersive experience system according to an embodiment of the present invention. The system includes: a user server 100, a device server 200, a film scheduling server 300, a central control server 400, a communication coordination server 500, a map server 600, and a dynamic path planning server 700. The central control server 400 is connected to the user server 100, the device server 200, the film scheduling server 300, the map server 600, and the communication coordination server 500, respectively. The communication coordination server 500 is connected to the map server 600 and the dynamic path planning server 700, respectively.

[0031] This application's large-scale immersive experience system utilizes virtual scene XR technology, combined with LBE space digital cinema, to continuously expand digital content application scenarios, including theme parks, tourism scenes, science fiction adventures, and other diverse digital content. The system can simultaneously immerse different users in the same venue at the same time, allowing audiences to experience multiple sets of digital content simultaneously, as if they were in different time and space and scenes, and enjoy a truly immersive experience.

[0032] like Figure 1 As shown, the user server 100 is used to obtain the user's ticket purchase information and verify the ticket purchase information. The user server 100 obtains the user's ticket purchase information, which includes: the user's identity information (such as name, ID number, contact information, etc.), ticket information (such as ticket purchase date, ticket type, ticket price, etc.), etc.

[0033] After obtaining the ticket purchase information, the user server 100 will verify it based on the ticket purchase information. The purpose of the verification is to ensure the authenticity and validity of the ticket purchase information in order to determine whether the user can enter. The process of verifying the ticket purchase information includes checking whether the ticket is expired, whether it has been reused, etc., verifying whether the identity of the ticket purchaser is consistent with the information on the ticket through information such as the ID number and mobile phone number, and confirming whether the ticket was purchased through a formal channel. If the verification is successful, it means that the user's ticket purchase information is valid, and subsequent ticket processing can be carried out, such as allowing the user to enter, wear user equipment, provide related services, etc.; if the verification fails, the user information is prompted to be incorrect, such as timeout and inability to enter, the entry time has not yet arrived, etc., and the user is reminded to re-purchase the ticket or wait until the entry time to verify the ticket and enter.

[0034] In one embodiment, the user server 100 is further configured to obtain the user's team information based on the user's personalized information and / or ticket purchase information. Personalized information refers to information such as the user's gender and height, which can affect performance within virtual reality. Team information refers to information related to the user's team or group with other users. Examples include team member information (such as team member names, contact information, ticket purchase information, etc.) and team activity information (such as team activities and itinerary).

[0035] It should be noted that the user server 100 includes two team formation methods: user-initiated team formation and system-automated team formation. User-initiated team formation means that users can choose to form a team when purchasing tickets, add team information to their ticket purchase information, and independently manage team members, such as adding the ticket purchase information of friends, family, or colleagues. System-automated team formation means that the user server 100 can automatically identify users watching the same digital content based on ticket purchase information, automatically team these users, and generate team information. This team formation method is suitable for scenarios where users may not have prior contact with each other, but the user wants to be a teammate, or the target digital content selected by the user requires team formation.

[0036] In one embodiment, combining Figure 2 It is noted that the user server 100 is also connected to a code scanning terminal; the code scanning terminal is used to scan a code to obtain the user's ticket purchase information, and the user's ticket purchase information is sent to the user server 100.

[0037] It should be noted that, in this embodiment, the user server 100 is connected to the code scanning terminal, which can be a barcode scanner, a QR code scanning device, etc., which obtains the ticket purchase information by scanning the paper ticket, electronic ticket or other certificate with ticket purchase information provided by the user, and then sends this information to the user server 100. The code scanning terminal provides a convenient way to input information, avoiding the errors and tedious operations that may occur when manually entering information.

[0038] The user server 100 is also connected to a ticket printing terminal, which can be used to print the user's ticket purchase receipt. Through the ticket printing terminal, the user server 100 can also synchronously obtain the user's ticket purchase information, such as the digital content selected by the user, the entry time, etc. The ticket printing terminal serves as the interaction point between the user and the system, simplifying the user's ticketing operation process and improving the system's usability and user experience.

[0039] like Figure 1 As shown, the device server 200 is used to obtain the operating status information of the user device in real time and bind or unbind the user device to the corresponding user. User devices include VR head-mounted display devices, AR head-mounted display devices, MR head-mounted display devices, XR head-mounted display devices, etc. The device server 200 can monitor the operating status information of the user device in real time. The operating status information includes the device's power, temperature, network connection status, etc. Through the operating status information, it can promptly detect user device anomalies (such as low power or network connection problems) and notify the user or administrator.

[0040] In one embodiment, the device server 200 comprises multiple device servers; each device server corresponds to a user device. The device server serves as the device management center for the entire system, responsible for processing the addition, modification, and deletion of user devices. The system of this embodiment includes multiple device servers, each corresponding to a user device. The device servers can monitor the real-time operating status of the corresponding user device.

[0041] In one embodiment, combining Figure 2 It is noted that the device server 200 is also connected to a code scanning terminal; the device information of the user device is obtained by scanning the code through the code scanning terminal, and the device information of the user device is sent to the device server 200.

[0042] The device server 200 is connected to the code scanning terminal, which obtains device information (such as device ID, model, serial number, etc.) by scanning the QR code or barcode on the user device. The code scanning terminal sends the device information of the user device to the device server 200. After the device server 200 verifies the validity of the device information, it can associate the user device with the corresponding user. Each user device is bound to one user. The binding operation ensures that the user device is associated with the corresponding user for easy management and security control. The unbinding operation allows the user to safely unbind the user device from the user when the user device is changed or no longer used. The unbound user device can be used for the next user binding operation. Through the device server, the administrator can fully control the operating status of all user devices in the system to ensure the normal operation of the user device and a good user experience.

[0043] like Figure 1 As shown, the film scheduling server 300 is used to obtain ticket purchase information of one or more users, determine the entry timestamp of each user and the selected target digital content according to the ticket purchase information of one or more users, and perform film scheduling management.

[0044] It should be noted that the large-space immersive experience system of the present invention can accommodate multiple users to experience different digital content simultaneously, and multiple sets of digital content can be screened simultaneously in the same venue and time period. In other words, different users can immersively watch different digital content in the same venue and time period. This differs from the scheduling logic of traditional cinemas, which only allow one movie to be screened in the same venue and time period.

[0045] Therefore, in this embodiment, the scheduling server 300 determines the needs of different users based on their ticket purchase information, namely, each user's entry timestamp and selected target digital content. This allows for a reasonable arrangement of the screening order and user entry times for different digital content within the same venue, ensuring that the immersive experiences of different users do not interfere with each other, resulting in a smoother and more comfortable user experience. The scheduling server ensures that the arrangement of digital content to be screened on user devices is consistent with ticket information, and coordinates resource allocation within the large-space immersive experience system to ensure the smooth progress of screening activities.

[0046] In one embodiment, combining Figure 2 The scheduling server 300 is also connected to the ticketing terminal; it obtains the user's ticket purchase information through the ticketing terminal and manages the scheduling of the target digital content selected by the user based on the user's ticket purchase information. The scheduling server 300 is connected to the ticketing terminal and obtains the user's ticket purchase information through the ticketing terminal. Based on the user's ticket purchase information, it can determine the target digital content selected by different users and the entry timestamps of different users. In other words, based on the user's ticket purchase information, the scheduling server can understand the user's ticket purchase status in real time, providing a data basis for subsequent scheduling management.

[0047] like Figure 1 As shown, the central control server 400 is connected to the user server 100, the device server 200 and the film scheduling server 300 respectively, and is used to comprehensively manage the large-space immersive experience system based on the user's ticket purchase information, the operating status information of the user's device and multiple sets of digital content.

[0048] Central control server 400 is used to provide comprehensive management of the large-space immersive experience system, including user management, device management, logging, configuration management, etc. Specifically, central control server 400 comprehensively manages the large-space immersive experience system based on user ticket purchase information, user device operating status information, and multiple sets of digital content.

[0049] Among them, user management includes managing user registration information, ticket purchase records, and automatically forming teams for users based on their ticket purchase information; controlling the administrator's operating permissions to the system, such as allowing the administrator to modify the user's team information (add or delete teammates), configure user devices, etc.; and monitoring and analyzing user behavior, such as counting users' ticket purchase frequency, viewing preferences, etc., to provide users with more personalized services.

[0050] Device management involves monitoring the user devices managed by the device server 200 to obtain real-time operating status information for each user device, such as its temperature, battery level, and network connection status. Various devices in the venue are monitored. If a device malfunctions, such as an XR device, the central control server can promptly issue an alarm and record the fault information, allowing maintenance personnel to quickly locate the problem. User devices can also be remotely controlled, for example, by binding or unbinding user devices and users, and adding or deleting user devices.

[0051] Logging refers to the recording of various log information during system operation. These include user operation logs, such as the time and content of operations such as login, ticket purchase, and ticket refund; device operation logs, which record events such as the start, stop, and exceptions of user devices; and scheduling logs, which record the screening history of multiple sets of digital content connected to the system and the number of viewers. Logs can be used for system maintenance and troubleshooting. By analyzing log records, the cause of the problem can be identified. For example, if a digital content playback error is detected, the logs can be reviewed to determine whether there is a problem with the digital certificate verification process, a playback failure on the user device, or other reasons.

[0052] Configuration management allows administrators to modify various system configurations. For example, they can configure the screening parameters for digital content, such as the order and duration of the content. Furthermore, when new digital content is added, the central control server can update the configuration to ensure the system can properly screen the newly added content.

[0053] Specifically, the central control server 400 obtains and stores the user's ticket purchase information from the user server 100. It can also determine the user's needs based on the purchase information, such as the user's selected digital content, entry timestamp, and team formation requirements. The central control server can also provide users with corresponding services, such as automatic team formation. The central control server 400 obtains and stores the operating status information of the user's device through the device server 200, and uses this information for device management functions, such as monitoring device operation and remote device control.

[0054] At the same time, the central control server 400 also sends the user device's configuration information to the device server 200, allowing the device server 200 to configure the user device accordingly, ensuring that the user device can operate normally according to the system's requirements. Based on the scheduling information provided by the scheduling server 300, the central control server 400 manages the multiple sets of digital content accessed by the system. The central control server 400 also provides a real-time radar map of the venue, giving administrators a clear overview of the venue. The central control server 400 connects to other servers to perform service forwarding.

[0055] like Figure 1 As shown, the communication coordination server 500 is connected to the central control server 400 and is used to manage and coordinate the communication and interaction between the user equipment and each server based on a preset transmission protocol. Preferably, the preset transmission protocol is the KCP protocol.

[0056] It should be noted that when users have an immersive experience in a large-space immersive experience system, multiple user devices can be started at the same time, and each user wears a user device. When each user device is running, the communication coordination server 500 is connected to the central control server 400, and the communication coordination server 500 receives control instructions from the central control server 400 and forwards them to the corresponding user device. Control instructions include starting the experience, ending the experience, pausing the experience, adjusting the experience parameters, etc. For example, when the administrator issues a "start experience" control instruction on the central control server 400, the communication coordination server 500 will accurately pass the control instruction to the corresponding user device, so that the user device can respond in time and lead the user into the immersive experience mode.

[0057] In addition to transmitting control instructions, the communication coordination server 500 is also responsible for coordinating the interaction process between the user device and each server (such as the central control server 400, the user server 100, the device server 200, the film scheduling server 300, etc.) to ensure orderly communication between different servers and different user devices. Specifically, the user device may be a different type of device (such as an XR device and a VR device), and there are also model differences between devices of the same type. Therefore, different user devices and servers use different communication protocols for data transmission. Due to the differences in communication protocols, the signals or data received by the server will be different.

[0058] For example, when using TCP (Transmission Control Protocol) and UDP (User Datagram Protocol) to transmit data, TCP is connection-oriented, ensuring reliable data packet transmission and potentially implementing retransmission mechanisms. UDP, on the other hand, is connectionless, offering relatively fast data packet transmission, but with the potential for packet loss. This can result in variations in the integrity and order of data received by the server. Due to differences in devices and communication protocols, data transmission can also experience delays.

[0059] Therefore, in this embodiment, the communication and interaction between user devices and various servers is managed and coordinated based on a preset transmission protocol. To minimize device latency, the preset transmission protocol is the KCP protocol. KCP reduces data transmission latency. KCP is a fast and reliable protocol that reduces average latency by 30%-40% and triples maximum latency, at the expense of 10%-20% less bandwidth than TCP.

[0060] Furthermore, patch management of user devices can be performed through the communication coordination server 500. In order to coordinate the control of different digital contents and the playback of patch advertisements by each user device, the communication coordination server 500 can be used as a transfer station for content packages. Content packages refer to patch advertisements (such as videos, audios, pictures, etc.) that need to be displayed or played on the user device. The user device receives the content package sent by the communication coordination server 500 for playback. The communication coordination server 500 is also used to receive control instructions issued by each server. Specifically, after receiving the control instruction from the server to insert patch advertisements, the user device can accurately insert advertisements at the appropriate position of the digital content playback (such as the beginning, middle or end of the video), which can well coordinate the playback order of advertisements and digital content to avoid conflicts between advertisements and digital content.

[0061] like Figure 1 As shown, the map server 600 is connected to the central control server 400 and the communication coordination server 500, respectively, and is used to obtain the real-time location information of each user device, determine the area of ​​interest (AOI) of each user based on the real-time location information of each user device, and send the map data information of the area of ​​interest to other user devices.

[0062] It should be noted that the map server 600 is connected to the central control server 400 and the communication coordination server 500, respectively, so that the map server can receive data from other devices or servers and transmit the information it has processed to other devices or servers. Specifically, the map server obtains the real-time location information of each user device. Based on the real-time location information of the user device, the map server can determine the area of ​​interest (AOI) of each user. The AOI refers to the geographical area that the user is currently interested in, usually a map area within a certain range around the user device.

[0063] Send the map data information of the area of ​​interest to other user devices, that is, synchronize the map data information of the current user's area of ​​interest to other user devices that are near the user or belong to the same team as the user. When multiple users are in a similar geographical location, the map server synchronizes the field of view within the AOI to the user devices of nearby users, allowing these users to quickly obtain the latest map information of the surrounding environment. In a team collaboration scenario, team members need to share map information of a specific area. For example, in an immersive experience, members of a team need to understand each other's location and the map situation of the area they are exploring together. The map server synchronizes the field of view within the AOI to the user devices of the same team, allowing team members to share map information in real time and better collaborate and communicate.

[0064] The map server updates and stores user device location information in real time and synchronizes information based on that location. This ensures that all relevant users have instant access to accurate location information. Team members can see each other's locations and surroundings in real time, enabling better coordination, improving work efficiency and safety, and enhancing the interactivity and fun of the immersive experience.

[0065] In one embodiment, the map server 600 is also used to store map data of actual operating venues of the large-space immersive experience system, and accurately match the digital content to be accessed with the map data of the actual operating venues of the large-space immersive experience system.

[0066] The map server 600 is responsible for storing map data for the actual operating venues of the large-space immersive experience system. This map data includes detailed layout information for the venue, such as the location of fixed features like walls, columns, stairs, entrances, exits, and corridors; and the division of virtual designated areas such as rest areas, activity areas, display areas, and interactive areas. The map server 600 adaptively and precisely matches different digital content within the same actual operating venue to the venue's physical environment. This allows each set of digital content to be integrated with the actual operating venue. For example, when the venue's size and area are adjusted, the digital content is also adjusted based on the actual size and area of ​​the venue, ensuring that the digital content is always placed in the corresponding position in the map data. This prevents issues such as incomplete digital content presentation and users encountering obstacles while walking. In complex venue layouts, precise matching ensures the correct display of digital content, providing users with a smoother and more immersive experience. Furthermore, the map server's adaptive and precise matching allows digital content creators to significantly shorten development cycles and effectively reduce tedious workloads.

[0067] like Figure 1 As shown, the dynamic path planning server 700 is connected to the communication coordination server 500 and is used to make dynamic path planning adjustments based on real-time crowd density data and map data of actual operating venues of the large-space immersive experience system.

[0068] Real-time crowd density data is calculated based on the user's ticket purchase information, film scheduling management, real-time location information of the user's device, and crowd density information obtained by monitoring equipment in the system. The map data of the actual operating venue of the large-space immersive experience system includes physical obstacles in the venue, virtual set areas, etc. The virtual set areas are areas designated to meet specific operational needs or event arrangements. For example, certain areas may be set as temporary rest areas, activity areas or restricted areas during specific periods of time. When performing dynamic path planning, the system will regard physical obstacles and virtual set areas in the venue as inaccessible areas. For example, if there is an area in the venue that is set as a virtual restricted area, the system will avoid this area when planning the path and guide users to detour from other accessible paths.

[0069] When a new user device is connected or the flow of people in a certain area of ​​the venue is too dense, the dynamic path planning server will quickly calculate a new path based on the real-time crowd density data and the map data of the actual operating venue of the large-space immersive experience system, and return the result to the communication coordination server 500, which will then provide it to the corresponding user device to guide some users to change their paths, that is, to make timely dynamic path planning adjustments, so as to achieve a reasonable distribution of people flow.

[0070] By properly distributing traffic, every area within the venue can be fully utilized, avoiding overcrowding in some areas while leaving others unused. This improves the venue's unit area utilization efficiency and maximizes the floor space efficiency ratio. Properly planning routes can also reduce crowding and collisions between people, making movement smoother and enhancing their experience within the venue.

[0071] In one embodiment, if Figure 1 As shown, the system also includes a team server 800; the team server 800 is connected to the communication coordination server 500, and is used to handle operations and interactions between various user devices within the user team. The team server 800 enables the various user devices within the team to interact through the communication coordination server 500, which is specifically manifested in that team members can share information, divide work and cooperate, and communicate through voice, text, etc. The team server 800 plays a key role in team collaboration, task allocation and intra-team communication. It enables the team to operate efficiently as a whole, improves the team's collaboration efficiency and task completion quality. In a large-space immersive experience system, this team collaboration function can enhance the user's sense of participation and experience, allowing users to better enjoy the immersive experience.

[0072] It should be understood that the communication coordination server 500 is connected to the central control server 400, the map server 600, the dynamic path planning server 700, and the team server 800. When a user arrives at the venue entrance, the user server 100 verifies the user's ticket purchase information and determines the user's personalized information and / or team information, and then provides a team experience based on the user's personalized information and / or team information. The user device and the user are bound through the device server 200, and the user device can then be started.

[0073] When a user device starts running, the communication coordination server 500 connects to the central control server 400. The communication coordination server 500 receives control commands and, based on these commands, starts or ends the immersive experience for the user device. During the immersive experience, the communication coordination server 500 connects to the map server 600, and the user device sends its real-time location information to the map server 600 via the communication coordination server 500. The communication coordination server 500 also connects to the dynamic path planning server 700, which calculates a new path based on the current real-time crowd density data and returns it to the communication coordination server 500 and sends it to the user device. The communication coordination server 500 connects to the teaming server 800, and teaming server 800 forwards interaction information within the team. The dynamic path planning server 70 and teaming server 800, through the communication coordination server 500, can adjust path planning based on team collaboration requirements. For example, during a team task, the teaming server 800 can rationally arrange the order of action and task allocation of team members based on the path information provided by the dynamic path planning server 70, ensuring that the team can complete the task efficiently.

[0074] In one embodiment, the system further includes a digital certificate server 900, which is connected to the central control server 400. The digital certificate server 900 is configured to receive, verify, and monitor digital certificates corresponding to digital content to be accessed by the large-space immersive experience system. The digital certificate server 900 ensures the security and reliability of the system.

[0075] Specifically, when the large-space immersive experience system accesses new digital content, it needs to verify the digital certificate corresponding to the digital content. The verification process includes checking whether the certificate is expired, revoked, whether it is the digital content to be accessed, and whether it is authorized. The digital certificate server 900 also monitors the digital certificates that have been connected to the system in real time. The monitoring content includes: continuously monitoring the validity of the certificate to promptly detect certificate expiration or revocation; ensuring that the information corresponding to the digital content matches the domain name in the certificate to prevent the domain name from being misused; and by monitoring the use of digital certificates, promptly detecting potential security threats.

[0076] Through the verification and monitoring functions of digital certificate server 900, central control server 400 can ensure that digital content accessing the large-space immersive experience system is authentic, helping to prevent access to malicious digital content and protecting system security and user privacy. In other words, digital certificate server 900 can comprehensively protect the copyright of digital content while ensuring rapid content distribution and efficient personalized operations.

[0077] Further, combined with Figure 2Note that the central control server 400 and the digital certificate server 900 are also connected to the central control terminal. The central control terminal is the core operating platform of the entire system, used for centralized management and control of various devices and servers in the entire system, achieving unified operation of the system. The central control terminal can be equipped with an intuitive graphical user interface to facilitate operators to perform various operations and monitoring. For example, the central control terminal can directly remotely control user devices, including turning devices on and off and adjusting device parameters. Through centralized management and control, the central control terminal improves the system's operating efficiency and management level, while also enhancing the system's security and reliability.

[0078] In one embodiment, if Figure 1 As shown, the system further includes an external expansion server 1000, which is connected to the central control server 400; the external expansion server 1000 is used to access or replace functional plug-ins to expand the service functions of the large-space immersive experience system.

[0079] It should be understood that external extension servers extend functionality by introducing external plug-ins into the system's existing server architecture, or by replacing plug-ins. External extension servers can add or replace plug-ins as needed without requiring large-scale modifications to the system's existing server architecture. Plug-ins can be independently developed and maintained, facilitating team division of labor and feature iteration. They can also quickly adapt to changing business needs, such as adding new services or features.

[0080] In a specific embodiment, the functional plug-in includes an account service functional plug-in, a payment service functional plug-in, an AI service functional plug-in, a Web3 functional plug-in, etc.

[0081] The account service plug-in is used to manage user accounts. For example, it provides a user registration and login interface, allows new users to join, and supports multiple login methods (such as username and password, mobile phone number verification code, and third-party account login). It also provides account management functions such as changing passwords, updating personal information, and account binding. It also provides permission management functions, assigning different permissions based on user roles, such as ordinary users and administrators.

[0082] The payment service plug-in handles payment-related functions. It can expand multiple payment channels and support various payment methods, such as credit card payments and third-party platform payments. It can also be used for payment data analysis, such as recording payment transaction data for financial statistics and risk analysis. It can also strengthen payment security management, such as using encrypted transmission and anti-tampering technologies to ensure the security of the payment process.

[0083] AI service plug-ins provide AI-related functionality, including plug-ins for multimodal processing such as text, speech, and vision. Text processing includes text generation, text classification, sentiment analysis, and machine translation. Speech processing includes speech recognition, speech synthesis, and voice command recognition. Vision processing includes image recognition (such as object detection and face recognition), image generation (such as AI painting), and video analysis. Combining multiple modalities such as text, speech, and vision provides richer interaction methods, such as generating images through voice commands or generating text descriptions from image content.

[0084] The Web3 plug-in provides blockchain-based functional services, including Web3 account management, authorization management, and payment management. Web3 refers to the next generation of the internet, based on blockchain technology and emphasizing decentralization and user data ownership.

[0085] It should be emphasized that by accessing or replacing functional plug-ins through the external extension server 1000 to expand the service functions of the large-space immersive experience system, the system becomes more flexible, scalable and easy to maintain, and can quickly adapt to the needs of different business scenarios.

[0086] Figure 3 Shown is a specific embodiment diagram of the large-space immersive experience system of this application. Among them, each user wears a corresponding XR device, and forms a team based on the user's ticket purchase information. Each user forms Team 1, Team 2 to Team N respectively. The digital content of each team's immersive experience can be the same or different. Each XR device is connected to the physical server of the system through the network, and the central control terminal, code scanning terminal, and ticket printing terminal are also connected to the physical server of the system. Local deployment is carried out in the physical server, and the central control server, user server, device server, film scheduling server, map server, team server, etc. are deployed. The immersive experience process is managed and controlled by each server, and multiple groups of digital content can be immersively experienced simultaneously in the same venue at the same time.

[0087] Figure 4Shown is another specific embodiment diagram of the large-space immersive experience system of the present application. Among them, each user wears a corresponding XR device, and forms a team based on the user's ticket purchase information. Each user forms Team 1, Team 2 to Team N respectively. The digital content of each team's immersive experience can be the same or different. Each XR device is connected to the gateway through the network, and the central control terminal, code scanning terminal, and ticket printing terminal are also connected to the gateway respectively. The content is uploaded to the cloud through the gateway interface, and the central control server, user server, device server, film scheduling server, map server, team server, etc. are deployed in the cloud. By deploying the server in the cloud, operation and maintenance personnel can remotely manage and maintain the server without having to go to the site for operation, thereby improving operation and maintenance efficiency. At the same time, it can monitor the server's operating status, performance indicators, etc. in real time, discover and solve problems in a timely manner, and ensure the continuation of the immersive experience. Through cloud deployment management, if it is necessary to deploy the immersive experience system in multiple venues or different regions in the future, cloud deployment can easily realize cross-regional resource allocation and data synchronization, quickly expand the business scope, and improve the scalability of the system.

[0088] To facilitate the demonstration of a large-space immersive experience system of this application, the path from the specific digital content production to operation and distribution of the system is explained:

[0089] Digital content producers: first connect to the server of this system to register. During the development / debugging phase, conduct a simulated development preview of the actual operating venue in the environment provided by the server. After the development is completed, use the content key to encrypt and package the digital content to generate a DMP (digital media package).

[0090] Distributor: Creates a Key Delivery Message (KDM). The KDM creation process involves the distributor asymmetrically encrypting the content key using the public key of the Central Control Board (CCB). The KDM also contains metadata, such as the content identifier and playback time window.

[0091] Operator: After receiving the KDM and DMP, the system first uses the private key to decrypt the KDM and obtain the content key. This content key is then used to decrypt the actual digital content in the DMP. The system then checks whether all parameters in the KDM (such as media ID, device ID, time, etc.) match. Only when all parameters match will the current digital content be decrypted and played. The system then schedules the film based on the authorized digital content and can also process the title clip based on the actual operating venue.

[0092] It should be emphasized that the large-space immersive experience system provided by the present invention significantly accelerates and improves the efficiency of content development and operation by optimizing processing procedures, standardizing development procedures, and providing modular optional solutions.

[0093] Specifically, for content producers, the system enables them to decouple the production of digital content from the information of the actual operating venues, allowing them to focus on content development itself. The system can set the boundaries and obstacles of the venues and carry out specific dynamic path planning based on the characteristics of different venues to ensure the adaptability of the content. For distributors, this system provides a digital copyright protection mechanism similar to that of the film industry. The released content can only be decrypted and played on the specified devices within the specified time period, thereby effectively guaranteeing the legal use of copyright. For operators, this system provides a series of powerful tools, including quick setting of user personalized information, device management, content playback control, management of opening and ending credits, and query of real-time and historical data of operational information, which greatly improves the convenience and efficiency of operations.

[0094] In the embodiments of the present application, words such as "first" and "second" are used to distinguish between identical or similar items with substantially the same functions and effects, and do not limit their order. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity or execution order, and words such as "first" and "second" do not necessarily mean different.

[0095] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" represent examples, illustrations, or descriptions. Any embodiment or design described in this application as "exemplary" or "for example" should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0096] In the embodiments of the present application, "at least one" refers to one or more, and "more" refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can represent: a, b, c, ab, ac, bc or abc, where a, b, c can be single or multiple.

[0097] It should also be understood that the division of modules in the embodiments of the present application is illustrative and is merely a logical functional division. In actual implementation, other division methods may be used. Furthermore, the functional modules in the various embodiments of the present application may be integrated into a single processor, or may exist physically separately, or two or more modules may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or software functional modules.

[0098] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

[0099] In summary, this application provides a large-space immersive experience system. For content producers, this system can significantly shorten the development cycle and easily save more than two months of tedious work. Moreover, as the deployment environment continues to expand, the system will continue to create more value and bring long-term benefits to content producers. For distributors and operators, this system provides efficient and concise tools that can not only fully protect the copyright of digital content, but also ensure the rapid distribution of content and the efficient implementation of personalized operations, providing solid guarantees for the distribution and operation processes, and helping the business to proceed smoothly. Therefore, this application effectively overcomes the various shortcomings in the existing technology and has a high industrial utilization value.

[0100] The above embodiments are merely illustrative of the principles and effects of this application and are not intended to limit this application. Anyone skilled in the art may modify or alter the above embodiments without departing from the spirit and scope of this application. Therefore, all equivalent modifications or alterations made by one of ordinary skill in the art without departing from the spirit and technical concepts disclosed in this application shall be covered by the claims of this application.

Claims

1. A large space immersive experience system, characterized by: include: The user server is used to obtain the user's ticket purchase information and verify the ticket purchase information; The device server is used to obtain the operating status information of the user device in real time and bind or unbind the user device to the corresponding user; The film scheduling server is used to obtain the ticket purchase information of one or more users, determine the entry timestamp of each user and the selected target digital content based on the ticket purchase information of one or more users, and perform film scheduling management; A central control server is connected to the user server, device server, and scheduling server respectively, and is used to comprehensively manage the large-space immersive experience system based on user ticket purchase information, user device operating status information, and multiple sets of digital content; A communication coordination server, connected to the central control server, for managing and coordinating the communication and interaction between the user equipment and each server based on a preset transmission protocol; a map server, connected to the central control server and the communication coordination server, for obtaining real-time location information of each user device, determining an area of ​​interest for each user based on the real-time location information of each user device, and sending map data information of the area of ​​interest to other user devices; A dynamic path planning server, connected to the communication coordination server, is used to make dynamic path planning adjustments based on real-time crowd density data and map data of actual operating venues of the large-space immersive experience system; An external expansion server is connected to the central control server and is used to access or replace functional plug-ins to expand the service functions of the large-space immersive experience system.

2. The large space immersive experience system according to claim 1, characterized in that: The system further includes a team server; the team server is connected to the communication coordination server and is used to process operations and interactions between various user devices within the user team.

3. The large space immersive experience system according to claim 1, characterized in that: The system also includes a digital certificate server; the digital certificate server is connected to the central control server; the digital certificate server is used to receive the digital certificate corresponding to the digital content to be accessed into the large-space immersive experience system and to verify and monitor it.

4. The large space immersive experience system according to claim 1, characterized in that: The device server includes multiple device servers; each device server corresponds to a user device.

5. The large space immersive experience system according to claim 1, characterized in that: The map server is also used to store map data of the actual operating venues of the large-space immersive experience system, and accurately match the digital content to be accessed with the map data of the actual operating venues of the large-space immersive experience system.

6. The large space immersive experience system according to claim 1, characterized in that: The user server is further configured to obtain the user's personalized information and / or team formation information based on the user's ticket purchase information.

7. The large space immersive experience system according to claim 1, characterized in that: The preset transmission protocol is the KCP protocol.

8. The large space immersive experience system according to claim 1, characterized in that: The user server is also connected to a code scanning terminal; the user's ticket purchase information is obtained by scanning the code at the code scanning terminal, and the user's ticket purchase information is sent to the user server.

9. The large space immersive experience system according to claim 1, characterized in that: The device server is also connected to a code scanning terminal; the device information of the user device is obtained by scanning the code by the code scanning terminal, and the device information of the user device is sent to the device server.

10. The large space immersive experience system according to claim 1, characterized in that: The film scheduling server is also connected to the ticket printing terminal; the user's ticket purchasing information is obtained through the ticket printing terminal, and the film scheduling of the target digital content selected by the user is managed according to the user's ticket purchasing information.

Images