An extended reality practical training content processing method, a client and a server

Abstract

The application provides an extended reality training content processing method, a client and a server. The method comprises the following steps: obtaining at least one training content; the training content is obtained based on an original data model; processing the training content by using at least one preset function in an application interface instance to obtain process training content; compressing the process training content based on a preset data model to obtain a training content package in a preset standard data structure; the training content package in the preset standard data structure comprises at least one of a list file and a physical file; and sending the training content package to a server. The scheme of the application unifies the data collection standard of the training content, so that different business platforms can obtain the same training content.

Description

Technical Field

[0001] This invention relates to the field of extended reality technology, and in particular to an extended reality training content processing method, client, and server. Background Technology

[0002] With the continuous development of XR (Extended Reality) virtual training technology, its application in vocational skills training in colleges and universities and on-the-job skills training in enterprises is becoming more and more widespread, and the demand for XR training content is growing rapidly.

[0003] However, the existing XR training content lacks unified standards and specifications in terms of both physical file structure and integration methods with the proprietary platforms of various XR content developers. This makes it difficult to quickly migrate and reuse across business platforms, which is very detrimental to the promotion of XR technology. Summary of the Invention

[0004] The technical problem to be solved by the present invention is to provide a method, client and server for processing training content in extended reality, which solves the problem that training content in extended reality cannot be quickly migrated and reused across business platforms.

[0005] To solve the above-mentioned technical problems, the technical solution of the present invention is as follows:

[0006] An extended reality training content processing method, applied to a first client, includes:

[0007] Obtain at least one training topic; the training topic is obtained based on the original data model.

[0008] The training content is processed by at least one preset function in the application interface instance to obtain the process training content;

[0009] Based on a preset data model, the process training content is compressed to obtain a training content package with a preset standard data structure; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file.

[0010] Send the training content package to the server.

[0011] Optionally, the manifest file is stored in the root directory of the training content package.

[0012] Optionally, the manifest file includes at least one of the following:

[0013] Metadata; the metadata is used to describe the training content;

[0014] Content organization method; the content organization method includes at least one content component;

[0015] Parameter information; the parameter information is used to describe the content component.

[0016] Optionally, the content component locates the physical file of the training content by referencing the parameter description information and parameter values ​​in the parameter information.

[0017] Optionally, the physical file includes at least one of the following:

[0018] At least one practical training content; the practical training content includes at least one of a content guidance file and auxiliary files;

[0019] Metadata description file; the metadata description file is a configuration file used to describe the structure and parameters of the training content.

[0020] Optionally, the preset function includes at least one of the following:

[0021] An initialization function; this initialization function is used to establish a communication connection between the client and the server.

[0022] Interaction point operation mode submission function; the interaction point operation mode submission function is used to submit training interaction process data for extended real-world applications;

[0023] A submission function; the submission function is used to submit learning result data for extended real-world applications;

[0024] Latest error code retrieval function; the latest error code retrieval function is used to retrieve the error code when the function called in the training content returns error information;

[0025] An error code string retrieval function; the error code string retrieval function is used to retrieve the string description corresponding to the error code when the training content uses an error code as a calling parameter;

[0026] Termination function; the termination function is used to terminate the communication connection between the client and the server.

[0027] This invention also provides a method for processing extended reality training content, applied to a server, comprising:

[0028] Receive a training content package with a preset standard data structure sent by a first client; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file;

[0029] The training content package with the preset standard data structure is sent to the second client, so that the second client can parse the training content package with the preset standard data structure to obtain at least one training content.

[0030] The present invention also provides a first client, comprising:

[0031] The acquisition module is used to acquire at least one training content;

[0032] The processing module is used to process the training content through at least one preset function in the application interface instance to obtain process training content; and to compress the process training content based on a preset data model to obtain a training content package; the training content package includes at least one of a manifest file and a physical file.

[0033] The first transceiver module is used to send the training content package to the server.

[0034] The present invention also provides a server, comprising:

[0035] The second transceiver module is used to receive a training content package sent by the first client; the training content package includes at least one of a manifest file and a physical file; and to send the training content package to the second client so that the second client can parse the training content package to obtain at least one training content.

[0036] The present invention also provides a computer-readable storage medium, characterized in that it stores instructions that, when executed on a computer, cause the computer to perform the method described above.

[0037] The above-described solution of the present invention has at least the following beneficial effects:

[0038] The above-described solution of the present invention obtains at least one training content; the training content is obtained based on an original data model; the training content is processed through at least one preset function in an application interface instance to obtain process training content; based on the preset data model, the process training content is compressed to obtain a training content package with a preset standard data structure; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file; the training content package is sent to a server; this solves the problem that extended reality training content cannot be quickly migrated and reused across business platforms, and unifies the data collection standard for training content so that different business platforms can obtain the same training content. Attached Figure Description

[0039] Figure 1 This is a flowchart illustrating the extended reality training content processing method applied to the first client according to an embodiment of the present invention.

[0040] Figure 2 This is a schematic diagram of the processing environment for the training content in a specific embodiment provided by the present invention;

[0041] Figure 3 This is a schematic diagram of the structure of the training content package according to an embodiment of the present invention;

[0042] Figure 4 This is a schematic diagram illustrating the reference relationships of content components in an embodiment of the present invention;

[0043] Figure 5 This is a schematic diagram of the structure of the physical files in the training content package of this invention embodiment;

[0044] Figure 6 This is a structural diagram of an application interface instance in a specific embodiment provided by the present invention;

[0045] Figure 7 This is a flowchart illustrating the training content processing method for extended reality applied to a server according to an embodiment of the present invention.

[0046] Figure 8 This is a schematic diagram of the structure of the first client in an embodiment of the present invention. Detailed Implementation

[0047] Exemplary embodiments of the present disclosure will now be described in more detail with reference to the accompanying drawings. While exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be implemented in various forms and should not be limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of the disclosure to those skilled in the art.

[0048] like Figure 1 As shown, an embodiment of the present invention proposes a method for processing extended reality training content, applied to a first client, including:

[0049] Step 11: Obtain at least one training content; the training content is obtained based on the original data model;

[0050] Step 12: Process the training content through at least one preset function in the application interface instance to obtain the process training content;

[0051] Step 13: Based on the preset data model, compress the process training content to obtain a training content package with a preset standard data structure; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file;

[0052] Step 14: Send the training content package to the server.

[0053] In this embodiment, a user can run an extended reality application through a first client. During the operation of this extended reality application, at least one training content is generated or uploaded. The training content of the first client is obtained based on the original data model, and the data structure corresponding to the original data model of different clients is different. The training content is processed through at least one preset function in the application interface instance to obtain process training content. The preset data model compresses the process training content to obtain a training content package with a preset standard data structure. The training content package includes at least one of a manifest file and a physical file. Then, the training content package is sent to the server. The training content package obtained in this way can be quickly imported into the extended reality application of other clients through the XR PMS (XRPractical Training Management System) on the server. This solves the problem that extended reality training content cannot be quickly migrated and reused across business platforms, and unifies the data collection standard of training content so that different business platforms can obtain the same training content.

[0054] The following describes the processing environment for the practical training content:

[0055] like Figure 2 As shown in a specific embodiment, the extended reality training management system is deployed on the server side, and the client is equipped with a browser or terminal application. The browser is preferably a browser that runs an extended reality application, and the terminal application is preferably an extended reality application.

[0056] When the extended reality application is running, the training content is published through the definition of the environment model, and a communication mechanism is established between the extended reality training management system, the client and the training content. The training content is managed according to the communication information between the extended reality training management system, the client and the training content.

[0057] The processing environment for this training content has at least three functions:

[0058] 1) Transfer the training content to the client, such as uploading the training content or synchronizing the physical files of the training content;

[0059] 2) Communication between the training content and the browser or terminal application;

[0060] 3) Information that needs to be reported in the management training content and related information managed through the extended reality training management system;

[0061] To enable the reuse and interactivity of training content, this processing environment provides a general way to launch training content and a way for training content to interact with the extended reality training management system. This processing environment includes at least one of the following:

[0062] Launch, API, and Data Model.

[0063] Among them, the startup and operation are used to enable browsers or terminal applications to call the training content through a preset communication mechanism, and bidirectional communication can be achieved through standardized API interfaces;

[0064] The application interface is a communication mechanism for transmitting information between the training content and the browser or terminal application. Through the API, related actions such as starting, stopping, getting and submitting data can be performed.

[0065] The data model describes the data model requirements transmitted between the training content and the browser or terminal application. The data model describes the data structure, data operations, and data constraints; for example, the startup and running information of the training content, the operation content and results of a training interaction, and the ending status of the content. The extended reality training management system is used to maintain the status information of the data model from the browser or terminal application. The training content is processed through the data model, thereby enabling reuse on different extended reality training management systems.

[0066] In an optional embodiment of the present invention, the manifest file is stored in the root directory of the training content package.

[0067] like Figure 3 As shown in the embodiments of the present invention, the training content package with a preset standard data structure mainly consists of a metadata description file, a content guidance file, and related auxiliary files required for the operation of the training content. It is compressed and packaged using a preset format (preferably zip format). The training content package includes multiple training contents, each stored in a relatively independent folder within the package, ensuring that each training content can be independently distributed and referenced. A training content includes a learning unit, which can be a part of the training content, a complete training content, or a group of training contents. Training contents can be distributed independently. The training content package can be arbitrarily decomposed or combined, and it must contain all the necessary information describing the package itself.

[0068] The training content package includes at least one of a manifest file and a physical file. The manifest file is preferably a YAML document (a data serialization format document that is intuitive and can be recognized by computers). The manifest file contains structural description information about the training content package. The manifest file must be stored in the root directory of the training content package.

[0069] In addition, the manifest file must use the UTF-8 (Universal Character Set / Unicode Transformation Format, 8-bit) character set;

[0070] In a preferred embodiment, the manifest file must also be a file named pmsmanifest.yml.

[0071] In an optional embodiment of the present invention, the manifest file includes at least one of the following:

[0072] Metadata; the metadata is used to describe the training content;

[0073] Content organization method; the content organization method includes at least one content component;

[0074] Parameter information; the parameter information is used to describe the content component.

[0075] like Figure 3 As shown, in embodiments of the present invention, the manifest file includes at least one of metadata, practicals, and parameters. The metadata provides a general method and / or naming description of the training content, enabling systematic searching of the training content and return of resources within it for reuse. The practicals describe the organization of the training content package and may include at least one content component. The parameters describe the content components and are used for startup and bootstrapping. They can also be used to locate physical files. These parameters may be the location information of the bootstrap files within the running physical files, or other optional parameter descriptions and values ​​used when running bootstrap files within the running physical files.

[0076] In an optional embodiment of the present invention, the content component locates the physical file of the training content by referencing the parameter description information and parameter values ​​in the parameter information.

[0077] like Figure 4 As shown in the embodiments of the present invention, the manifest file includes metadata, content organization method and parameter information. The content organization method includes at least one content component (such as a first content component and a second content component), and the parameter information includes at least one parameter (such as a first parameter and a second parameter). When locating a physical file through the parameter information, the content component can run the location information of the content guide file in the physical file by referencing the parameter description information and parameter value in the parameter information, that is, locate the physical file of the training content.

[0078] In an optional embodiment of the present invention, the physical file includes at least one of the following:

[0079] At least one practical training content; the practical training content includes at least one of a content guidance file and auxiliary files;

[0080] Metadata description file; the metadata description file is a configuration file used to describe the structure and parameters of the training content.

[0081] like Figure 5 As shown in the embodiments of the present invention, the physical file includes at least one training content and a metadata description file, wherein the training content includes at least one of a content guidance file and an auxiliary file; the auxiliary file is an auxiliary class and a material class file required for the training content to run.

[0082] Content guide files are used to start running or training programs. Specifically, when a user selects to experience a specific extended reality training program, the browser or terminal application will run or load the corresponding training guide file. It is worth noting that multiple training programs and their corresponding content guide files can be placed in the same training content package, and the training content package must contain at least one training program's content guide file.

[0083] The auxiliary files are the relevant library files, model files and other material files required for the training content to run. The training content can call them automatically through the content guidance files.

[0084] Metadata description files are configuration files used to describe the structure and parameters of training content. These metadata description files must exist in the root directory of the training content package. The description content includes the identifier and name of the training content provider, a list of training content, and related descriptive information.

[0085] Additionally, it should be noted that, in order to ensure that the physical files of the training content can be stored and used across platforms, the filenames of the training content package, as well as the folder names and file names within the training content package, should preferably use half-width characters.

[0086] In an optional embodiment of the present invention, the preset function includes at least one of the following:

[0087] An initialization function; this initialization function is used to establish a communication connection between the client and the server.

[0088] Interaction point operation mode submission function; the interaction point operation mode submission function is used to submit training interaction process data for extended real-world applications;

[0089] A submission function; the submission function is used to submit learning result data for extended real-world applications;

[0090] Latest error code retrieval function; the latest error code retrieval function is used to retrieve the error code when the function called in the training content returns error information;

[0091] An error code string retrieval function; the error code string retrieval function is used to retrieve the string description corresponding to the error code when the training content uses an error code as a calling parameter;

[0092] Termination function; the termination function is used to terminate the communication connection between the client and the server.

[0093] In embodiments of the present invention, the developers of the training content decide how to execute the API data communication, and the extended reality training management system on the server side decides the implementation method of the API;

[0094] In a preferred implementation, when calling a function via an API, the input parameter names should be case-sensitive.

[0095] The functions are explained below:

[0096] The initialization function (Initialize) is used to establish a communication connection between the training content and the extended reality training management system, and to obtain the training record information related to the current user from the extended reality training management system. The content object will obtain the initial runtime data through this initialization function when it starts up and runs.

[0097] The SetKeyPoint function is used to submit the process data of the training interaction to the browser or terminal application of the Extended Reality Training Management System when users interact with knowledge points and assessment points in the training content.

[0098] The commit function can be used to submit the user's learning results data (including scores, training status data, etc.) to the extended reality training management system's browser or terminal application;

[0099] The GetLastError function is used to retrieve the last error code. When the training content calls the API and returns an error message, this function can be called to obtain the specific error code.

[0100] The error code string retrieval function (GetErrorString) is used to retrieve the string description corresponding to the error code when the error code is used as a call parameter in the training content;

[0101] In one specific embodiment, the API provides predefined error codes, which are used to indicate the name and message of errors generated during data interaction, as shown in the table below:

[0102] Table 1

[0103]

[0104] As shown in the table above, when the training content uses error codes as calling parameters, different errors will provide different error codes. Each error code corresponds to a different error name and description, and the cause of the error can be quickly located based on the error code.

[0105] The Finish function is used to terminate the communication connection between a training task and the extended reality training management system. The training task calls this function before exiting and obtains the execution result.

[0106] The practical training content categorizes function call states into three types: running state, terminated state, and uninitialized state;

[0107] In the uninitialized state, at least one of the following functions can be called:

[0108] Initialization function, latest error code retrieval function, and error code string retrieval function;

[0109] At least one of the following functions can be called during runtime:

[0110] Functions for submitting interactive operations; function for submitting an error; function for retrieving the latest error code; function for retrieving the error code string.

[0111] At least one of the following functions may be called when the state is terminated:

[0112] Latest error code retrieval function; Error code string retrieval function; End function;

[0113] At least one of the above functions can implement the environment initialization of training content during normal startup, submission of key or recordable interaction point operation data, submission of stage or overall participation status / score, and related interfaces for obtaining error information during data interaction. This enables the same process and result evaluation data to be obtained when different business platforms run the same extended real-world application.

[0114] like Figure 2 and 6 As shown, in a specific embodiment, the extended reality application runs on the first client, and the extended reality application interacts with the extended reality training management system during operation;

[0115] The extended reality application, during its operation, includes training content 1 to 3, which interact with the extended reality training management system through an application interface instance set on the first client. This application interface instance contains multiple functions, including: an initialization function; a function to submit interaction point operation methods; a submission function; a function to retrieve the latest error code; a function to retrieve the error code string; and a termination function. These functions can process the training content and, based on a preset data model, perform actions such as... Figure 2 The training content is compressed in the environment shown to obtain a training content package with a preset standard data structure; the preset standard data structure includes physical file structure standard specifications, data structure description standard specifications, data collection standard specifications, etc.

[0116] The training content package with a pre-defined standard data structure has the following structural features:

[0117] The basic structural requirements for training content packages are specified. Each training content package should contain its own data structure description metadata file, which should be located in the root directory of the training content package. It should also contain at least one training content boot file. By standardizing the physical file structure of extended reality content packages and the parsing method of extended reality training content packages on business platforms, the cross-platform reuse of extended reality training content can be achieved.

[0118] The requirements for the metadata file structure of extended reality training content packages are specified. The metadata file structure is mainly divided into basic description information of extended reality training content, sub-content information and basic description information of extended reality training content, and guidance parameter information that each sub-content can contain. By standardizing the metadata structure of extended reality training content data structure, different business platforms can obtain the same structural description data when parsing the same extended reality training content.

[0119] By pre-setting a standard data structure to unify the training content, the problem of rapid cross-platform migration and reuse of extended reality training content is solved. At the same time, the unified data collection standard enables the extended reality application to fairly evaluate the training effectiveness of users.

[0120] The embodiments of the present invention obtain at least one training content; the training content is obtained based on an original data model; the training content is processed through at least one preset function in an application interface instance to obtain process training content; based on the preset data model, the process training content is compressed to obtain a training content package with a preset standard data structure; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file; the training content package is sent to a server, thereby solving the problem that extended reality training content cannot be quickly migrated and reused across business platforms, unifying the data collection standard of training content, so that different business platforms can obtain the same training content.

[0121] like Figure 7 As shown, an embodiment of the present invention proposes a method for processing extended reality training content, applied to a server, including:

[0122] Step 71: Receive a training content package with a preset standard data structure sent by the first client; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file;

[0123] Step 72: Send the training content package with the preset standard data structure to the second client so that the second client can parse the training content package with the preset standard data structure to obtain at least one training content.

[0124] It should be noted that the method applied to the server is the same as the method applied to the first client described above. All implementation methods in the embodiments of the method applied to the first client described above are applicable to the embodiments of the method applied to the server, and can achieve the same technical effect.

[0125] like Figure 8 As shown, embodiments of the present invention also provide a first client 80, comprising:

[0126] Module 81 is used to acquire at least one training content.

[0127] Processing module 82 is used to process the training content through at least one preset function in the application interface instance to obtain process training content; and to compress the process training content based on a preset data model to obtain a training content package; the training content package includes at least one of a manifest file and a physical file;

[0128] The first transceiver module 83 is used to send the training content package to the server.

[0129] Optionally, the manifest file is stored in the root directory of the training content package.

[0130] Optionally, the manifest file includes at least one of the following:

[0131] Metadata; the metadata is used to describe the training content;

[0132] Content organization method; the content organization method includes at least one content component;

[0133] Parameter information; the parameter information is used to describe the content component.

[0134] Optionally, the content component locates the physical file of the training content by referencing the parameter description information and parameter values ​​in the parameter information.

[0135] Optionally, the physical file includes at least one of the following:

[0136] At least one practical training content; the practical training content includes at least one of the content guidance file and auxiliary files;

[0137] Metadata description file; the metadata description file is a configuration file used to describe the structure and parameters of the training content.

[0138] Optionally, the preset function includes at least one of the following:

[0139] An initialization function; this initialization function is used to establish a communication connection between the client and the server.

[0140] Interaction point operation mode submission function; the interaction point operation mode submission function is used to submit training interaction process data for extended real-world applications;

[0141] A submission function; the submission function is used to submit learning result data for extended real-world applications;

[0142] Latest error code retrieval function; the latest error code retrieval function is used to retrieve the error code when the function called in the training content returns error information;

[0143] An error code string retrieval function; the error code string retrieval function is used to retrieve the string description corresponding to the error code when the training content uses an error code as a calling parameter;

[0144] Termination function; the termination function is used to terminate the communication connection between the client and the server.

[0145] It should be noted that the first client is the first client corresponding to the method applied to the first client described above. All implementation methods in the method embodiments applied to the first client described above are applicable to the embodiments of the first client and can achieve the same technical effect.

[0146] Embodiments of the present invention also provide a server, comprising:

[0147] The second transceiver module is used to receive a training content package sent by the first client; the training content package includes at least one of a manifest file and a physical file; and to send the training content package to the second client so that the second client can parse the training content package to obtain at least one training content.

[0148] It should be noted that this server is the server corresponding to the method applied to the server described above. All implementation methods in the above-described method embodiments applied to the server are applicable to the embodiments of this server and can achieve the same technical effect.

[0149] Embodiments of the present invention also provide a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the method as described above. All implementations in the above method embodiments are applicable to this embodiment and can achieve the same technical effects.

[0150] Those skilled in the art will recognize that the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementations should not be considered beyond the scope of this invention.

[0151] Those skilled in the art will understand that, for the sake of convenience and brevity, the specific working processes of the systems, devices, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here.

[0152] In the embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0153] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0154] In addition, the functional units in the various embodiments of the present invention can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit.

[0155] If the aforementioned functions are implemented as software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, essentially, or the part that contributes to the prior art, or a portion of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, ROM, RAM, magnetic disks, or optical disks.

[0156] Furthermore, it should be noted that in the apparatus and method of the present invention, it is obvious that the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered equivalent solutions of the present invention. Moreover, the steps performing the above series of processes can naturally be executed in the order described, but are not necessarily required to be executed in chronological order; some steps can be executed in parallel or independently of each other. Those skilled in the art will understand that all or any step or component of the method and apparatus of the present invention can be implemented in any computing device (including processors, storage media, etc.) or network of computing devices, in hardware, firmware, software, or a combination thereof. This is something that those skilled in the art can achieve by using their basic programming skills after reading the description of the present invention.

[0157] Therefore, the object of the present invention can also be achieved by running a program or a set of programs on any computing device. The computing device can be a known general-purpose device. Therefore, the object of the present invention can also be achieved simply by providing a program product containing program code implementing the method or apparatus. That is, such a program product also constitutes the present invention, and the storage medium storing such a program product also constitutes the present invention. Obviously, the storage medium can be any known storage medium or any storage medium developed in the future. It should also be noted that in the apparatus and method of the present invention, it is obvious that the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered equivalent to the present invention. Furthermore, the steps performing the above series of processes can naturally be performed in the order described, but are not necessarily required to be performed in chronological order. Some steps can be performed in parallel or independently of each other.

[0158] The above description represents the preferred embodiments of the present invention. It should be noted that those skilled in the art can make various improvements and modifications without departing from the principles of the present invention, and these improvements and modifications should also be considered within the scope of protection of the present invention.

Claims

1. A method for processing extended reality training content, characterized in that, Applied to the first client, including: Obtain at least one training topic; the training topic is obtained based on the original data model. The training content is processed by at least one preset function in the application interface instance to obtain the process training content; Based on a preset data model, the process training content is compressed to obtain a training content package with a preset standard data structure; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file. Send the training content package to the server; Specifically, during the extended reality application runtime, training content is published through an environment model definition, a communication mechanism is established between the extended reality training management system, the client, and the training content, and the training content is managed based on the communication information between the extended reality training management system, the client, and the training content. The processing environment includes at least one of startup and operation, application interface and data model; The startup and operation are used to enable the browser or terminal application to call the training content through a preset communication mechanism and conduct bidirectional communication through a standardized API interface; the application interface is the communication mechanism for transmitting information between the training content and the browser or terminal application, and performs startup, stop, data acquisition and submission through the API; the data model is used to describe the data model requirements transmitted between the training content and the browser or terminal application, and the data model describes the data structure, data operation and data constraints. The preset function includes at least one of the following: An initialization function; this initialization function is used to establish a communication connection between the client and the server. Interaction point operation mode submission function; the interaction point operation mode submission function is used to submit training interaction process data for extended real-world applications; A submission function; the submission function is used to submit learning result data for extended real-world applications; Latest error code retrieval function; the latest error code retrieval function is used to retrieve the error code when the function called in the training content returns error information; An error code string retrieval function; the error code string retrieval function is used to retrieve the string description corresponding to the error code when the training content uses an error code as a calling parameter; The termination function is used to terminate the communication connection between the client and the server. The training content categorizes function call states into three types: running state, terminated state, and uninitialized state. Call at least one of the following functions when the state is uninitialized: Initialization function, latest error code retrieval function, and error code string retrieval function; Call at least one of the following functions while the application is running: The interaction point operation includes functions for submitting the data, retrieving the latest error code, and retrieving the error code string. Call at least one of the following functions when the state is terminated: Functions for retrieving the latest error code, retrieving the error code string, and ending the process; The manifest file is stored in the root directory of the training content package; The manifest file includes at least one of the following: Metadata; the metadata is used to describe the training content; Content organization method; the content organization method includes at least one content component; Parameter information; the parameter information is used to describe the content component; The content component locates the physical file of the training content by referencing the parameter description information and parameter values ​​in the parameter information; The physical file includes at least one of the following: At least one training content; the training content includes at least one of a content boot file and auxiliary files; the content boot file is used for startup or training boot file; Metadata description file; the metadata description file is a configuration file used to describe the structure and parameters of the training content; the metadata description file must exist in the root directory of the training content package, and includes: the identifier and name of the training content provider, a list of training content and related descriptive information.

2. A method for processing extended reality training content, characterized in that, Applied to servers, including: Receive a training content package with a preset standard data structure sent by a first client; the training content package with the preset standard data structure includes at least one of a manifest file and a physical file; The training content package with the preset standard data structure is sent to the second client so that the second client can parse the training content package with the preset standard data structure to obtain at least one training content. The training content package is obtained through the following process: The first client obtains at least one training content; the training content is obtained based on the original data model. The first client processes the training content through at least one preset function in the application interface instance to obtain the process training content; The first client compresses the process training content based on a preset data model to obtain a training content package with a preset standard data structure. Specifically, during the extended reality application runtime, training content is published through an environment model definition, a communication mechanism is established between the extended reality training management system, the client, and the training content, and the training content is managed based on the communication information between the extended reality training management system, the client, and the training content. The processing environment includes at least one of startup and operation, application interface and data model; The startup and operation are used to enable the browser or terminal application to call the training content through a preset communication mechanism and conduct bidirectional communication through a standardized API interface; the application interface is the communication mechanism for transmitting information between the training content and the browser or terminal application, and performs startup, stop, data acquisition and submission through the API; the data model is used to describe the data model requirements transmitted between the training content and the browser or terminal application, and the data model describes the data structure, data operation and data constraints. The preset function includes at least one of the following: An initialization function; this initialization function is used to establish a communication connection between the client and the server. Interaction point operation mode submission function; the interaction point operation mode submission function is used to submit training interaction process data for extended real-world applications; A submission function; the submission function is used to submit learning result data for extended real-world applications; Latest error code retrieval function; the latest error code retrieval function is used to retrieve the error code when the function called in the training content returns error information; An error code string retrieval function; the error code string retrieval function is used to retrieve the string description corresponding to the error code when the training content uses an error code as a calling parameter; The termination function is used to terminate the communication connection between the client and the server. The training content categorizes function call states into three types: running state, terminated state, and uninitialized state. Call at least one of the following functions when the state is uninitialized: Initialization function, latest error code retrieval function, and error code string retrieval function; Call at least one of the following functions while the application is running: The interaction point operation includes functions for submitting the data, retrieving the latest error code, and retrieving the error code string. Call at least one of the following functions when the state is terminated: Functions for retrieving the latest error code, retrieving the error code string, and ending the process; The manifest file is stored in the root directory of the training content package; The manifest file includes at least one of the following: Metadata; the metadata is used to describe the training content; Content organization method; the content organization method includes at least one content component; Parameter information; the parameter information is used to describe the content component; The content component locates the physical file of the training content by referencing the parameter description information and parameter values ​​in the parameter information; The physical file includes at least one of the following: At least one training content; the training content includes at least one of a content boot file and auxiliary files; the content boot file is used for startup or training boot file; Metadata description file; the metadata description file is a configuration file used to describe the structure and parameters of the training content; the metadata description file must exist in the root directory of the training content package, and includes: the identifier and name of the training content provider, a list of training content and related descriptive information.

3. A first client, characterized in that, include: The acquisition module is used to acquire at least one training content; The processing module is used to process the training content through at least one preset function in the application interface instance to obtain the process training content. Based on a preset data model, the process training content is compressed to obtain a training content package; The training content package includes at least one of a manifest file and a physical file; The first transceiver module is used to send the training content package to the server; Specifically, during the extended reality application runtime, training content is published through an environment model definition, a communication mechanism is established between the extended reality training management system, the client, and the training content, and the training content is managed based on the communication information between the extended reality training management system, the client, and the training content. The processing environment includes at least one of startup and operation, application interface and data model; The startup and operation are used to enable the browser or terminal application to call the training content through a preset communication mechanism and conduct bidirectional communication through a standardized API interface; the application interface is the communication mechanism for transmitting information between the training content and the browser or terminal application, and performs startup, stop, data acquisition and submission through the API; the data model is used to describe the data model requirements transmitted between the training content and the browser or terminal application, and the data model describes the data structure, data operation and data constraints. The preset function includes at least one of the following: An initialization function; this initialization function is used to establish a communication connection between the client and the server. Interaction point operation mode submission function; the interaction point operation mode submission function is used to submit training interaction process data for extended real-world applications; A submission function; the submission function is used to submit learning result data for extended real-world applications; Latest error code retrieval function; the latest error code retrieval function is used to retrieve the error code when the function called in the training content returns error information; An error code string retrieval function; the error code string retrieval function is used to retrieve the string description corresponding to the error code when the training content uses an error code as a calling parameter; The termination function is used to terminate the communication connection between the client and the server. The training content categorizes function call states into three types: running state, terminated state, and uninitialized state. Call at least one of the following functions when the state is uninitialized: Initialization function, latest error code retrieval function, and error code string retrieval function; Call at least one of the following functions while the application is running: The interaction point operation includes functions for submitting the data, retrieving the latest error code, and retrieving the error code string. Call at least one of the following functions when the state is terminated: Functions for retrieving the latest error code, retrieving the error code string, and ending the process; The manifest file is stored in the root directory of the training content package; The manifest file includes at least one of the following: Metadata; the metadata is used to describe the training content; Content organization method; the content organization method includes at least one content component; Parameter information; the parameter information is used to describe the content component; The content component locates the physical file of the training content by referencing the parameter description information and parameter values ​​in the parameter information; The physical file includes at least one of the following: At least one training content; the training content includes at least one of a content boot file and auxiliary files; the content boot file is used for startup or training boot file; Metadata description file; the metadata description file is a configuration file used to describe the structure and parameters of the training content; the metadata description file must exist in the root directory of the training content package, and includes: the identifier and name of the training content provider, a list of training content and related descriptive information.

4. A server, characterized in that, include: The second transceiver module is used to receive training content packages sent by the first client; the training content package includes at least one of a manifest file and a physical file; The training content package is sent to the second client so that the second client can parse the training content package to obtain at least one training content. The training content package is obtained through the following process: The first client obtains at least one training content; the training content is obtained based on the original data model. The first client processes the training content through at least one preset function in the application interface instance to obtain the process training content; The first client compresses the process training content based on a preset data model to obtain a training content package with a preset standard data structure. Specifically, during the extended reality application runtime, training content is published through an environment model definition, a communication mechanism is established between the extended reality training management system, the client, and the training content, and the training content is managed based on the communication information between the extended reality training management system, the client, and the training content. The processing environment includes at least one of startup and operation, application interface and data model; The startup and operation are used to enable the browser or terminal application to call the training content through a preset communication mechanism and conduct bidirectional communication through a standardized API interface; the application interface is the communication mechanism for transmitting information between the training content and the browser or terminal application, and performs startup, stop, data acquisition and submission through the API; the data model is used to describe the data model requirements transmitted between the training content and the browser or terminal application, and the data model describes the data structure, data operation and data constraints. The preset function includes at least one of the following: An initialization function; this initialization function is used to establish a communication connection between the client and the server. Interaction point operation mode submission function; the interaction point operation mode submission function is used to submit training interaction process data for extended real-world applications; A submission function; the submission function is used to submit learning result data for extended real-world applications; Latest error code retrieval function; the latest error code retrieval function is used to retrieve the error code when the function called in the training content returns error information; An error code string retrieval function; the error code string retrieval function is used to retrieve the string description corresponding to the error code when the training content uses an error code as a calling parameter; The termination function is used to terminate the communication connection between the client and the server. The training content categorizes function call states into three types: running state, terminated state, and uninitialized state. Call at least one of the following functions when the state is uninitialized: Initialization function, latest error code retrieval function, and error code string retrieval function; Call at least one of the following functions while the application is running: The interaction point operation includes functions for submitting the data, retrieving the latest error code, and retrieving the error code string. Call at least one of the following functions when the state is terminated: Functions for retrieving the latest error code, retrieving the error code string, and ending the process; The manifest file is stored in the root directory of the training content package; The manifest file includes at least one of the following: Metadata; the metadata is used to describe the training content; Content organization method; the content organization method includes at least one content component; Parameter information; the parameter information is used to describe the content component; The content component locates the physical file of the training content by referencing the parameter description information and parameter values ​​in the parameter information; The physical file includes at least one of the following: At least one training content; the training content includes at least one of a content boot file and auxiliary files; the content boot file is used for startup or training boot file; Metadata description file; the metadata description file is a configuration file used to describe the structure and parameters of the training content; the metadata description file must exist in the root directory of the training content package, and includes: the identifier and name of the training content provider, a list of training content and related descriptive information.

5. A computer-readable storage medium, characterized in that, Store instructions that, when executed on a computer, cause the computer to perform the method as described in claim 1 or the method as described in claim 2.

Images