Method, device, electronic equipment, computer readable storage medium, computer program product for immersive live experience system

Abstract

The present disclosure relates to a method, apparatus, electronic device, computer readable storage medium, computer program product for an immersive live experience system. The method for the immersive live experience system comprises: receiving a request from a third-party application outside the immersive live experience system, the request invoking at least one media processing capability in one or more media processing capabilities of the immersive live experience system; verifying the request; in response to successful verification, sending the request to the immersive live experience system to cause the invoked at least one media processing capability to process the request; and sending a processing result of the request to the third-party application.

Description

Technical Field

[0001] This disclosure relates to a method, apparatus, electronic device, computer-readable storage medium, and computer program product for an immersive live experience system. Background Technology

[0002] Immersive Live Experience (ILE) systems utilize digital technology, spatial design, and real-time interactive methods to provide audiences with a highly immersive and engaging experience within a physical venue. These systems typically rely on the coordinated scheduling of heterogeneous computing resources and require the processing of multiple ultra-high bitrate audio and video streams, spatial positioning data, and real-time interactive commands, resulting in high overall processing power requirements.

[0003] Currently, the core technologies for building such systems are mainly controlled by a few large technology companies or professional service providers. Due to considerations such as business competition and data security, these service providers typically design their immersive live experience systems as closed or semi-closed vertical platforms, supporting only internal pre-order functions or customized project delivery, and their functions are not open to third-party developers. This closed nature leads to two problems: firstly, for most small and medium-sized content providers, industry solution integrators, and independent developers, the high R&D costs and complex distributed system debugging barriers make it difficult for them to independently build an immersive live experience system with equivalent real-time processing capabilities from scratch; secondly, even if third parties attempt to use existing immersive live experience systems, they must upgrade their own programs to adapt to various rules and restrictions such as system access requirements and data processing requirements, meaning that third parties cannot easily access the current immersive live experience system.

[0004] Currently, no technical solutions have been found for third parties to address access to immersive live experience systems. Therefore, it is beneficial to develop a technical method that can open up the basic processing capabilities of immersive live experience systems to third parties in a controllable and easy-to-use manner, in order to break through the current closed nature of the system and promote the large-scale application and cross-domain integration and innovation of immersive experience technology. Summary of the Invention

[0005] This disclosure aims to provide a method, apparatus, electronic device, computer-readable storage medium, and computer program product for an immersive live experience system, addressing the issue that the existing ITU-T (International Telecommunication Union-Telecommunication Standardization Sector) ILE standard framework does not support open media processing capabilities.

[0006] According to a first aspect of some embodiments of the present disclosure, a method for an immersive live experience system is provided, comprising: receiving a request from a third-party application outside the immersive live experience system, requesting to invoke at least one of one or more media processing capabilities of the immersive live experience system; verifying the request; in response to successful verification, sending the request to the immersive live experience system so that the invoked at least one media processing capability processes the request; and sending the processing result of the request to the third-party application.

[0007] In some embodiments, the request is further format-converted according to pre-configured semantic mapping rules before being sent, so as to map the original data of the request into equivalent elements corresponding to the target format of the immersive live experience system.

[0008] In some embodiments, when mapping the original data, at least the field names, enumeration values, and data structure organization methods in the original data are extracted, and the extracted field names, enumeration values, and data structure organization methods in the original data are mapped to equivalent elements corresponding to the target format.

[0009] In some embodiments, the method further includes performing a reverse format conversion on the processing result before sending the processing result to a third-party application. The reverse format conversion includes converting the processing result into a format corresponding to the request according to a pre-configured semantic mapping rule.

[0010] In some embodiments, the original data includes spatial coordinate information, and the mapping further includes identifying the original coordinate reference system and units and performing a standardization transformation on the original coordinate reference system and units, wherein the standardization transformation includes at least unit conversion and coordinate system transformation.

[0011] In some embodiments, the original data includes timestamps or time-series dependencies, and the mapping further includes extracting the original timestamp values ​​or time-series dependency data and retaining the original timestamp values ​​or time-series dependency data to ensure that the time order after mapping is consistent with the generation order of the original data.

[0012] In some embodiments, the method further includes recording invocation information representing the request invocation before sending the processing result to a third-party application.

[0013] In some embodiments, the system may also include one or more media processing capabilities that dynamically update the immersive live experience system.

[0014] In some embodiments, the method further includes receiving a query request from a third-party application for one or more media processing capabilities; and returning a response to the query request to the third-party application.

[0015] In some embodiments, one or more media processing capabilities include one or more of the following: spatial location perception capability, sound field direction recognition capability, media transmission capability, three-dimensional projection rendering capability, and multimedia synchronization capability.

[0016] According to a second aspect of some embodiments of the present disclosure, an apparatus for an immersive live experience system is provided. The apparatus includes: a management unit for managing requests from third-party applications outside the immersive live experience system; the management unit includes a call control module and an application management module; the call control module receives a request requesting to invoke at least one of one or more media processing capabilities of the immersive live experience system; the application management module verifies the request according to the requirements of the call control module; and an adaptation unit, in response to successful verification by the application management module, sending the request forwarded from the call control module to the immersive live experience system so that the invoked at least one media processing capability processes the request; the adaptation unit also sends the processing result of the request to the third-party application.

[0017] In some embodiments, the adapter unit further includes a format conversion module. Before sending the request, the format conversion module performs format conversion on the request according to pre-configured semantic mapping rules, so as to map the original data of the request into equivalent elements corresponding to the target format of the immersive live experience system.

[0018] In some embodiments, the adaptation unit further includes a format conversion module. Before sending the processing result to a third-party application, the format conversion module performs a reverse format conversion on the processing result. The reverse format conversion includes converting the processing result into a format corresponding to the request according to a pre-configured semantic mapping rule.

[0019] According to a third aspect of some embodiments of the present disclosure, an electronic device is provided, comprising: at least one processor; and at least one storage device storing instructions that, when executed by the at least one processor, cause the at least one processor to perform the method described in any of the preceding claims.

[0020] According to a fourth aspect of some embodiments of the present disclosure, a computer-readable storage medium is provided having computer-readable program instructions stored thereon, which, when executed by one or more processors, cause one or more processors to perform the method described in any of the preceding claims.

[0021] According to a fifth aspect of some embodiments of the present disclosure, a computer program product is provided, including computer-readable program instructions that, when executed by one or more processors, cause the one or more processors to perform the method described in any of the preceding claims.

[0022] According to this disclosure, third-party applications can access and invoke the immersive live experience system without requiring specific upgrades. The embodiments of this disclosure, when third-party applications invoke the internal media processing capabilities of the immersive live experience system, can handle capability adaptation, management, invocation mechanisms, and collaboration, thereby supporting easy compatibility with media data from different sources and enabling the internal media processing capabilities of the immersive live experience system to be opened up in an efficient, secure, and operable manner. Attached Figure Description

[0023] Figure 1 A schematic diagram of the open architecture of the immersive live experience system in this disclosure is shown.

[0024] Figure 2 This is a schematic diagram showing the functional module structure corresponding to the capability open layer.

[0025] Figure 3 This is a sequence diagram illustrating the process of a third-party application calling its capabilities.

[0026] Figure 4 This is a flowchart illustrating an open method for media processing capabilities for immersive live experience systems disclosed herein.

[0027] Figure 5 A block diagram of an exemplary computer system / server suitable for implementing embodiments of the present disclosure is shown. Detailed Implementation

[0028] Preferred embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While preferred embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be thorough and complete, and will fully convey the scope of the present disclosure to those skilled in the art.

[0029] The blocks within each of the block diagrams shown below can be implemented using hardware, software, firmware, or any combination thereof to achieve the principles of this disclosure. Those skilled in the art will understand that the blocks described in each block diagram can be combined or divided into sub-blocks to achieve the principles of this disclosure.

[0030] The steps of the method presented in this disclosure are intended to be illustrative. In some embodiments, the method may be performed with one or more additional steps not described and / or without the one or more steps discussed. Furthermore, the order in which the steps of the method are illustrated and described is not intended to be limiting.

[0031] Figure 1 This diagram illustrates the open architecture of the immersive live experience system disclosed herein. Figure 1In this context, third-party applications are independent of the immersive live experience system, whether they are from individuals or companies. These third-party applications do not have direct access to the immersive live experience system but share its media processing capabilities. The capability open layer processes requests from third-party applications, enabling them to access the immersive live experience (ILE) media capability pool of the immersive live experience system. This allows third-party applications to utilize the corresponding media processing capabilities within the ILE media capability pool to handle their requests. The ILE media capability pool primarily includes the internal media processing capabilities of the immersive live experience system, including but not limited to spatial location awareness, sound field direction recognition, media transmission, 3D projection rendering, and multimedia synchronization. Through the various capabilities in the ILE media capability pool, the processing of various multimodal data required by the immersive live experience system can be achieved.

[0032] Figure 2 This is a schematic diagram illustrating the functional module structure corresponding to the capability open layer. Figure 2 In the capability open layer, there can be a management unit 1 and an adaptation unit 5. The management unit 1 is used to manage requests from the aforementioned third-party applications and to manage capabilities from the immersive live experience system. The adaptation unit 5 is used to adapt to the requirements of the immersive live experience system and to perform adaptation operations on requests from the aforementioned third-party applications, so that the requests from the third-party applications can be passed to the immersive live experience system, and the media capabilities in the ILE media capability pool within the immersive live experience system can be used to respond to the requests.

[0033] The management unit 1 includes an application management module 2, a call control module 3, and a capability management module 4. The application management module 2 is used to register, authenticate, and authorize third-party applications. Third-party applications register before or during their first request to the immersive live experience system, generating a unique developer ID. The owner of a third-party application can be a regular user or an enterprise-level user. That is, registration can be differentiated based on developer identity. When the third-party application is enterprise-level, a unique developer ID with more access functions and permissions than that of a regular individual user is generated by submitting enterprise qualifications. A key is assigned during registration, or a user-defined key is provided. In OAuth authorization scenarios, a callback whitelist needs to be filled in during registration. The system will only send the authorization code to the address specified during registration to prevent authorization hijacking. After registration, when a third-party application sends a request, it can use the key and ID assigned during registration for authentication. Furthermore, to prevent tampering and ensure a higher level of security, the system can require the requester to concatenate request parameters, a timestamp, and a random number, and generate a signature using a pre-assigned key and a hash algorithm, which is then sent with the request. On the receiving side, the same algorithm is used to recalculate the signature. If the signature matches, authentication is successful. After authentication, corresponding permissions are granted based on the authenticated user's identity and request content. In other words, authorization determines whether the third-party application is qualified to call specific media processing capabilities in the ILE media capability pool. Authorization can also determine the usage of media processing capabilities. For example, a normal application can only establish a maximum of 10 ILE sessions per day, but a high-priority application can establish 1000 ILE sessions. Furthermore, authorization can be combined with capability management module 4. For example, a third-party application may normally have permission to call 8K rendering, but if capability management module 4 detects that the immersive live experience system is currently overloaded, it can dynamically generate a temporary policy to temporarily revoke the application's 8K permission, allowing only 4K rendering. All of the above registration, authentication, and authorization are performed by modules outside the immersive live experience system, such as application management module 2. Therefore, the immersive live experience system itself does not need to worry about complex third-party business logic and security protection, which can significantly improve the service throughput of the immersive live experience system and the security of third-party access, achieving seamless compatibility with heterogeneous systems.

[0034] The call control module 3 is used to process call requests and record call data. The call control module 3 sends call requests from third-party applications to the application management module 2 for authentication. If authentication is successful, the call control module 3 forwards the request to the adaptation department 5.

[0035] The capability management module 4 is used to dynamically manage the media processing capabilities within the immersive live experience system and provide a query interface for third-party applications. Dynamic management of the media processing capabilities within the immersive live experience system refers to the entire process of "exposing, negotiating, invoking, and monitoring" these capabilities. For example, when the media processing capabilities within the immersive live experience system are updated, the capability management module 4 will dynamically reflect this update. Alternatively, it can monitor capabilities published within the immersive live experience system in real time. For instance, if a new "8K virtual viewpoint compositing algorithm" is deployed within the immersive live experience system, or if the computing power of an edge node fails, the capability management module 4 will be immediately notified by the immersive live experience system and this will be reflected in the capability open layer. This ensures that at least when a third-party application wants to access the ILE media capability pool of the immersive live experience system through this capability open layer, the third-party application is aware of the aforementioned changes in the internal processing capabilities of the immersive live experience system. In other words, the capability management module 4 is updated in real time with its "capability list" and "capability status." When subsequent requests come from third-party applications, the capability management module 4 can first determine whether the requirements of the third-party application can be met before proceeding with the request processing, thus avoiding wasting system resources. When the immersive live experience system undergoes internal upgrades, there may be changes in interface fields or number format mappings. Upon receiving such changes, the capability management module 4 forwards them to the adaptation unit 5 (described later), enabling it to adapt according to the new mapping rules, thereby ensuring that upper-layer applications are unaware of underlying changes and can smoothly implement upgrades. Furthermore, the capability management module 4 serves as a query interface for third-party applications, allowing them to query the immersive live experience system's "capability list" and "capability status." It can also query capability performance indicators and determine the level of experience it provides to end users, among other things.

[0036] The adaptation unit 5 includes a format conversion module 6 and an encapsulation module 7. The format conversion module 6 is a media data format conversion module used to convert the raw data requested by third-party applications according to the data format requirements of the immersive live experience system, or to convert the binary data used internally by the immersive live experience system according to the requirements of third-party applications. The format conversion criteria and mapping rules of the format conversion module 6 can be directly obtained from within the immersive live experience system, or, as described above, can be dynamically updated by the capability management module 4. The encapsulation module 7 is a capability encapsulation module used to encapsulate the media processing capability interface internal to the immersive live experience system into a standardized interface usable by third-party applications.

[0037] The following describes the process by which a third-party application invokes the media processing capabilities within the immersive live experience system. Figure 3 This diagram illustrates the timing of a third-party application accessing the media processing capabilities within the immersive live experience system.

[0038] First, the third-party application initiates a call request to the call management module 3 of Management Department 1, requesting to utilize the media processing capabilities in the ILE media processing pool within the immersive live experience system. Upon receiving the call request, the call management module 3 requests the application management module 2 of Management Department 1 to authenticate the third-party application. Then, the application management module 2, after authentication, returns the authentication result to the call management module 3. The specific authentication process and method are detailed above, but not limited to these; any method can be used as long as it can identify the authorized third-party application. If authentication is successful, the call management module 3 forwards the request to the format conversion module 6. If authentication fails, the call management module 3 returns the failure result to the third-party application. Upon receiving the request, the format conversion module 6 converts the request data and forwards the converted request to the immersive live experience system, utilizing its internal media processing capabilities to process the request data. The ILE media capability pool that receives the converted request calls the corresponding requested capability to process the request data. After processing, the processing result is returned to the format conversion module 6. In the format conversion module 6, the processing result undergoes reverse format conversion. Specifically, the format conversion module 6 receives and identifies the processing result as belonging to ILE media processing capabilities, recognizing the internal encapsulation format. Based on pre-configured semantic mapping rules, it restores the data in the processing result to the format corresponding to the request. If spatial coordinate information is included, it is restored according to the rules; if the original data contains timestamps or temporal dependencies (such as video frame numbers or object occurrence times), it is restored according to the rules. The format conversion module 6 sends the converted result to the call management module 3, which records the call information. The converted data is then encapsulated and returned to the third-party application. The third-party application directly receives the data, which has been processed by the media capabilities and conforms to its own format requirements.

[0039] Figure 4 A flowchart illustrating the open method for media processing capabilities of the present disclosure for immersive live experience systems is shown.

[0040] In the open method for media processing capabilities of an immersive live experience system disclosed herein, in step S1, the invocation control module 3 in the management unit 1 receives a request from a third-party application outside the immersive live experience system. The request is for invoking at least one of one or more media processing capabilities of the immersive live experience system. For example, the third-party application sends a request to invoke a 3D projection rendering capability. Of course, the invoked capability is not limited to the 3D projection rendering capability; various other capabilities can also be invoked, such as spatial position perception capabilities, sound field direction recognition capabilities, etc.

[0041] In step S2, the call control module 3, which receives the request from the third-party application, sends a request to the application management module 2 in the management unit 1, requesting the application management module 2 to authenticate the application, that is, to verify the request. If the verification is successful, proceed to step S3; if the verification fails, return to step S1 and continue waiting for requests from the third-party application.

[0042] After successful verification, in step S3, the success result is fed back to the call control module 3. In response to the successful verification, the call control module 3 sends the request to the immersive live experience system so that at least one media processing capability being called can process the request. Before sending the request, the format conversion module 6 in the adaptation unit 5 can also perform format conversion on the request according to pre-configured semantic mapping rules, mapping the original data of the request to equivalent elements corresponding to the target format of the immersive live experience system, while preserving the business meaning of the data. For example, when mapping the original data, at least the field names, enumeration values, and data structure organization methods in the original data are extracted, and these extracted field names, enumeration values, and data structure organization methods are mapped to equivalent elements corresponding to the target format. This pre-configured semantic mapping rule can be obtained in advance from the immersive live experience system or dynamically obtained from the capability management module 4. The capability management module 4 can update the semantic mapping rule at any time according to changes in the media processing capabilities and capability status in the immersive live experience system.

[0043] In step S4, the processing result of the request is sent to the third-party application, and then the processing ends. That is, the format conversion module 6 receives the processing result of the request from the ILT media capability pool in the immersive live experience system, sends this processing result as a return result to the call control module 3, and the call control module 3 sends the processing result of the request to the third-party application. Before sending the processing result to the third-party application, a reverse format conversion can be performed on the processing result. This reverse format conversion can convert the processing result into a format corresponding to the request according to pre-configured semantic mapping rules.

[0044] Specifically, the format conversion performed by the aforementioned format conversion module 6 can be categorized and executed according to the format of the original data in the specific request. For example, if the original data contains spatial coordinate information, the mapping needs to identify the original coordinate reference system and unit, and perform a standardization conversion on the original coordinate reference system and unit. The standardization conversion includes at least unit conversion and coordinate system transformation. The unit conversion is, for example, centimeters to meters, millimeters to latitude and longitude degrees, while the coordinate system transformation is, for example, relative coordinates to global geodetic coordinates.

[0045] Furthermore, if the original data contains timestamps or temporal dependencies (e.g., video frame numbers, object occurrence times, etc.), the mapping needs to extract the original timestamp values ​​or temporal dependency data and retain the original timestamp values ​​or temporal dependency data to ensure that the temporal order of each element in the converted data is consistent with the generation order of the original data.

[0046] Through the implementation methods disclosed herein, third-party applications can access and invoke the system without requiring specific upgrades, supporting easy compatibility with media data from different sources. This allows the internal media processing capabilities of the immersive live experience system to be opened up in an efficient, secure, and operable manner. Furthermore, since the capability management module can determine whether a request meets the requirements of a third-party application before proceeding with subsequent request processing, system overhead can be avoided. The capability management module can also receive changes to interface fields and data format mappings within the immersive live experience system due to upgrades, forwarding these changes to the adaptation department so that it can adapt to the new mapping rules, ensuring that upper-layer applications are unaware of underlying changes and can smoothly implement upgrades. Moreover, since authentication is handled by the application management module of this disclosure, the immersive live experience system itself does not need to concern itself with complex third-party business logic and security protections. This significantly improves the service throughput and security of third-party access for the immersive live experience system, achieving seamless compatibility with heterogeneous systems.

[0047] Figure 5 A block diagram of an exemplary computer system / server suitable for implementing embodiments of the present disclosure is shown. Figure 5 The computer system / server 12 shown is merely an example and should not impose any limitation on the functionality and scope of use of the embodiments disclosed herein.

[0048] like Figure 5As shown, the computer system / server 12 is represented in the form of a general-purpose computing device. The components of the computer system / server 12 may include, but are not limited to: one or more processors or processing units 16, system memory 28, and a bus 18 connecting different system components (including system memory 28 and processing units 16).

[0049] System memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. Computer system / server 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 34 may be used to read and write non-removable, non-volatile magnetic media. Although... Figure 5 Not shown, a disk drive and an optical disk drive may also be provided. In these cases, each drive may be connected to bus 18 via one or more data media interfaces. Memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the embodiments of this disclosure.

[0050] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 42 typically perform the functions and / or methods described in the embodiments of this disclosure, such as... Figure 2The production event management method illustrated herein. The computer program instructions used to perform the operations of this disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-dependent instructions, microcode, firmware instructions, status setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Smalltalk, C++, etc., and conventional procedural programming languages ​​such as the "C" language or similar programming languages. The computer-readable program instructions may execute entirely on the user's computer, partially on the user's computer, as a standalone software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving remote computers, the remote computer may be connected to the user's computer via any type of network—including a local area network (LAN) or a wide area network (WAN)—or may be connected to an external computer (e.g., via the Internet using an Internet service provider). In some embodiments, electronic circuits, such as programmable logic circuits, field-programmable gate arrays (FPGAs), or programmable logic arrays (PLAs), are personalized by utilizing state information from computer-readable program instructions. These electronic circuits can execute computer-readable program instructions to implement various aspects of the present invention.

[0051] The computer system / server 12 can also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable users to interact with the computer system / server 12, and / or any device that enables the computer system / server 12 to communicate with one or more other computing devices (e.g., network interface card, modem, etc.). This communication can be performed via input / output (I / O) interface 22. Furthermore, the computer system / server 12 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 20. Networks may include copper cables, fiber optic cables, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. Each computing / processing device's network adapter card or network interface receives computer-readable program instructions from the network and forwards these instructions to computer-readable storage media stored in the respective computing / processing device. As shown, network adapter 20 communicates with other modules of the computer system / server 12 via bus 18. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the computer system / server 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0052] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of an instruction, which contains one or more executable instructions for implementing a specified logical function. In some alternative implementations, the functions marked in the blocks may occur in a different order than those shown in the drawings. For example, two consecutive blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented using a dedicated hardware-based system that performs the specified function or action, or using a combination of dedicated hardware and computer instructions.

[0053] The various embodiments of the present invention have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or improvement of the technology in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A method for an immersive live experience system, comprising: Receive a request from a third-party application outside the immersive live experience system, the request invoking at least one of one or more media processing capabilities of the immersive live experience system; Verify the request; In response to successful verification, the request is sent to the immersive live experience system so that at least one media processing capability is invoked to process the request; as well as The processing result of the request is sent to the third-party application.

2. The method according to claim 1, further comprising: Before sending the request, the request is format-converted according to pre-configured semantic mapping rules to map the original data of the request into equivalent elements corresponding to the target format of the immersive live experience system.

3. The method according to claim 2, wherein, When mapping the original data, at least the field names, enumeration values, and data structure organization methods in the original data are extracted, and the extracted field names, enumeration values, and data structure organization methods in the original data are mapped to equivalent elements corresponding to the target format.

4. The method according to claim 1, further comprising: Before sending the processing result to the third-party application, the processing result is subjected to reverse format conversion, which includes converting the processing result into a format corresponding to the request according to pre-configured semantic mapping rules.

5. The method according to claim 2 or 3, wherein, The original data contains spatial coordinate information, and the mapping further includes identifying the original coordinate reference system and units, as well as performing a standardization transformation on the original coordinate reference system and units. The standardization transformation includes at least unit conversion and coordinate system transformation.

6. The method according to claim 2 or 3, wherein, The original data contains timestamps or time-series dependencies. The mapping further includes extracting the original timestamp values ​​or time-series dependency data and retaining the original timestamp values ​​or time-series dependency data to ensure that the time order after mapping is consistent with the generation order of the original data.

7. The method according to claim 1, further comprising: Before sending the processing result to the third-party application, the call information representing the request is recorded.

8. The method according to claim 1, further comprising: Dynamically update one or more media processing capabilities of the immersive live experience system.

9. The method according to claim 1, further comprising: Receive query requests from the third-party application regarding the one or more media processing capabilities; as well as Return a response to the query request to the third-party application.

10. The method according to claim 1, wherein, The one or more media processing capabilities include one or more of the following: spatial location perception capability, sound field direction recognition capability, media transmission capability, three-dimensional projection presentation capability, and multimedia synchronization capability.

11. An apparatus for an immersive live experience system, the apparatus comprising: The management department manages requests from third-party applications outside the immersive live experience system. The management department includes a call control module and an application management module. The call control module receives the requests, which invoke at least one of one or more media processing capabilities of the immersive live experience system. The application management module verifies the requests according to the requirements of the call control module. In response to the successful verification by the application management module, the adaptation unit sends the request forwarded from the call control module to the immersive live experience system so that at least one media processing capability being called can process the request. The adaptation unit also sends the processing result of the request to the third-party application.

12. The apparatus according to claim 11, wherein, The adaptation unit also includes a format conversion module. Before sending the request, the format conversion module performs format conversion on the request according to a pre-configured semantic mapping rule, so as to map the original data of the request into equivalent elements corresponding to the target format of the immersive live experience system.

13. The apparatus according to claim 11, wherein, The adaptation unit also includes a format conversion module. Before sending the processing result to the third-party application, the format conversion module performs a reverse format conversion on the processing result. The reverse format conversion includes converting the processing result into a format corresponding to the request according to a pre-configured semantic mapping rule.

14. An electronic device comprising: At least one processor; as well as At least one storage device storing instructions that, when executed by the at least one processor, cause the at least one processor to perform the method of any one of claims 1-10.

15. A computer-readable storage medium having computer-readable program instructions stored thereon, which, when executed by one or more processors, cause the one or more processors to perform the method of any one of claims 1-10.

16. A computer program product comprising computer-readable program instructions that, when executed by one or more processors, cause the one or more processors to perform the method of any one of claims 1-10.

Images