An XR content authoring method, system, electronic device, and medium

By introducing edge computing devices between terminal devices and cloud servers, the complex issues of storage and uploading during the creation of XR content have been resolved. This enables users to easily access and continue creating XR content on different terminal devices, improving user experience and data transmission speed.

CN116847133BActive Publication Date: 2025-12-12HUAWEI TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210306591.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-25
Publication Date
2025-12-12
Estimated Expiration
2042-03-25

AI Technical Summary

Technical Problem

In existing technologies, the storage, uploading, and opening of XR content are relatively complex. Users need to perform cumbersome file naming, storage, and login operations when creating content on different terminal devices, making the creation process inconvenient.

Method used

By introducing edge computing devices between terminal devices and cloud servers, the terminal devices send user identity data and creation data to the edge computing devices for processing. The edge computing devices generate creation content and send the content to the target terminal devices when identity matching and operation conditions are met, simplifying the creation of creation space and the storage process of content.

Benefits of technology

It enables users to easily acquire and continue creating XR content on different terminal devices, improving the convenience of creation and data transmission speed, while reducing the complexity of file creation and transmission latency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116847133B_ABST
    Figure CN116847133B_ABST
Patent Text Reader

Abstract

The application relates to the technical field of extended reality, and discloses an XR content creation method, an XR content creation system, an electronic device and a medium. The XR content creation method is applied to an XR content creation system, the XR content creation system comprises a terminal device, an edge computing device and a server; and the method comprises the following steps: the terminal device acquires identity feature data of a user, and generates operation action feature data according to the operation of the user on the terminal device; when the edge computing device detects that the identity feature data of the user sent by the terminal device matches the identity feature data stored in the server, and the operation data meets a preset condition, the edge computing device acquires historical creation content from the server, and sends the historical creation content to the terminal device; and the terminal device displays the historical creation content. Based on the above scheme, the storage of XR content, the creation of an XR content creation space and the mobile creation of XR content are more convenient and simple, and the user experience is improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of extended reality, and in particular to an XR content creation method and system, an electronic device and a medium. BACKGROUND

[0002] At present, XR (Extended reality) technology has been widely applied in various fields such as video production and film shooting. XR technology can include augmented reality, virtual reality, and mixed reality technologies. Specifically, XR technology is a technology that constructs a virtual environment and integrates virtual and real environments.

[0003] For example, in XR video production with a display screen as the background, a virtual scene can be first presented on the display screen using real-time rendering technology, and an actual scene can be captured by a camera device. Then, the actual scene captured by the camera can be integrated with the virtual scene to obtain a fusion scene using XR technology.

[0004] At present, if a user creates XR content on a terminal device, the user generally needs to perform a series of cumbersome operations such as file naming, storage, and uploading to achieve file storage and uploading when storing and uploading a file corresponding to the XR content to a cloud server. If the user intends to open the file corresponding to the XR content on another terminal device to continue creating, the user generally needs to log in to the cloud server using an account and find and open the corresponding file stored in the cloud server. The above-mentioned storage, uploading, and opening of the file corresponding to the XR content are relatively complex. SUMMARY

[0005] To solve the above-mentioned technical problem that the storage, uploading, and opening of the file corresponding to the XR content are relatively complex, the present application provides an XR content creation method, system, electronic device, and medium.

[0006] In a first aspect, an XR content creation method is provided. The method is applied to an XR content creation system, which includes a first terminal device, a second terminal device, an edge computing device, and a server. The method includes the following steps.

[0007] The method includes the following steps.

[0008] The first terminal device obtains first identity feature data and first creation data of a user, and sends the first identity feature data and the first creation data of the user to the edge computing device.

[0009] The edge computing device generates first creation content according to the first creation data, and sends the first creation content and the first identity feature data to the server.

[0010] The server stores the first creative content and the first identity feature data.

[0011] The second terminal device acquires second identity feature data of the user, and generates operation data according to an operation of the user on the second terminal device.

[0012] The edge computing device acquires the first creative content from the server and sends the first creative content to the second terminal device in a case where the second identity feature data of the user sent by the second terminal device is detected to match the first identity feature data, and the operation data sent by the second terminal device satisfies a preset condition.

[0013] The second terminal device displays the first creative content.

[0014] Based on the above scheme, in a first aspect, the user can realize direct acquisition of XR content previously saved on another terminal device through simple operation, facilitating continuous creation of the XR content. In addition, the user can realize creation of an XR content creation space and storage of currently created content through simple operation, so that storage and mobile creation of the XR content are more convenient and simple, and user experience is improved.

[0015] In a second aspect, in the XR content creation method provided in the embodiments of the present application, the terminal device sends various data such as identity feature data and operation data of the user and current creation data to the edge computing device near the terminal device for data processing, and only data storage and other data processing services are executed on the cloud server. Compared with the scheme in some embodiments in which all data involved in creation are directly sent to the cloud server for processing, the data transmission link can be effectively shortened, and the data transmission speed of the XR content can be improved.

[0016] In a possible implementation of the first aspect, the first preset condition is that the operation data matches preset operation data for starting creation.

[0017] It can be understood that in the embodiments of the present application, the operation data of the user can be action feature data generated by the user by showing actions to the terminal device, can be various operation feature data generated by the user by implementing touch screen, key, and other operations on the terminal device, and can be operation feature data generated by the user by operating the terminal device through other devices.

[0018] In a possible implementation of the first aspect, the method further includes:

[0019] The edge computing device creates an authoring space corresponding to the second identity feature data and sends the authoring space to the second terminal device in a case where the second identity feature data of the user sent by the second terminal device is detected to be not matched with the identity feature data stored in the server, and the operation data sent by the second terminal device meets the first preset condition.

[0020] It can be understood that through the above scheme, the user can realize the creation of the XR content authoring space through simple operation, reducing the complexity of file creation.

[0021] In a possible implementation of the first aspect, the method further includes:

[0022] The second terminal device acquires second authoring data of the user while displaying the first authoring content, and sends the second authoring data to the edge computing device;

[0023] The edge computing device generates second authoring content according to the second authoring data, combines the first authoring content and the second authoring content to generate third authoring content, and sends the third authoring content to the second terminal device;

[0024] The second terminal device displays the third authoring content.

[0025] It can be understood that based on the above scheme, the user can create on the basis of the historical authoring content, and can generate the authoring content through the edge computing device close to the terminal device, effectively improving the speed of authoring content generation and transmission.

[0026] In a possible implementation of the first aspect, the method further includes:

[0027] The edge computing device sends the third authoring content and the feature information corresponding to the third authoring content to the server in a case where the operation data of the user sent by the second terminal device is detected to meet a second preset condition;

[0028] The server stores the third authoring content and the feature information corresponding to the third authoring content.

[0029] It can be understood that in the embodiments of the present application, the second preset condition is that the operation data matches the preset operation data for ending authoring. That is, when the edge computing device detects the intention of the user to end the authoring, the current authoring content and the feature information corresponding to the current authoring content can be directly uploaded to the server, so as to facilitate the user to directly acquire the authoring content according to the identity feature information corresponding to the user next time.

[0030] In a possible implementation of the first aspect, the method further includes:

[0031] The edge computing device caches the third creative content and the characteristic information corresponding to the third creative content in the edge computing device in a case where the operation data of the user sent by the second terminal device meets the second preset condition, and sends the third creative content and the characteristic information corresponding to the third creative content to the server after a preset time.

[0032] It can be understood that, based on the above scheme, if the user creates in another terminal device within a preset time, the user can directly obtain the creative space from the edge computing unit. The user does not need to obtain the creative space or the historical creative content from the cloud server, which greatly shortens the time for the user to obtain the creative space. The quick switching of the user in multiple terminal devices is realized.

[0033] In a possible implementation of the first aspect, the second preset condition is that the operation data matches preset operation data for ending the creation.

[0034] In the embodiment of the application, the operation data corresponding to the preset operation for ending the creation can be set arbitrarily, for example, the "wave hand" action can be set as the preset operation data for ending the creation.

[0035] In a possible implementation of the first aspect, the characteristic information corresponding to the third creative content includes an ending creation time, identification information of a creative space where the third creative content is located, first identity characteristic data of the user, identification information corresponding to the second terminal device, and specification information of the creative space where the third creative content is located.

[0036] It can be understood that the terminal device can also send the identification information of the terminal device to the edge computing device, which can be used to represent the association between the terminal device and the creative space or between the creative contents.

[0037] In a possible implementation of the first aspect, the device form of the first terminal device is a single terminal device or one sub-terminal device in a group terminal device.

[0038] The device form of the second terminal device is a single terminal device or one sub-terminal device in a group terminal device.

[0039] The group terminal device includes a plurality of sub-terminal devices, and the plurality of sub-terminal devices have the same group device identification.

[0040] It can be understood that in the embodiments of the present application, the user's creation scene can be various. For example, the user can create in front of a single terminal device for the first time, and continue to create in front of a single terminal device for the second time; or the user can create in front of a single terminal device for the first time, and continue to create in a group terminal device for the second time; or the user can create in a group terminal device for the first time, and continue to create in a single terminal device for the second time; or the user can create in a group terminal device for the first time, and create in a single terminal device for the second time.

[0041] It can be understood that in the embodiments of the present application, the group terminal device can be used in the XR large scene application, that is, the group terminal device can realize the creation of the large scene XR content.

[0042] In a possible implementation of the first aspect, when the second terminal device is in the form of a single terminal device, the identification information corresponding to the second terminal device includes identification information of the second terminal device.

[0043] When the second terminal device is in the form of a sub-terminal device in a group terminal device, the identification information corresponding to the second terminal device includes identification information of the second terminal device and identification information of the group terminal device where the second terminal device is located.

[0044] In a possible implementation of the first aspect, the method further includes:

[0045] When the edge computing device detects for the first time that the second identity feature data of the user sent by the second terminal device matches the first identity feature data, and the operation data of the user sent by the second terminal device meets the first preset condition, the edge computing device acquires the creation content corresponding to the first identity feature data from the server, and determines the creation content with the latest end creation time from the creation content corresponding to the first identity data.

[0046] The creation content with the latest end creation time is sent to the second terminal device.

[0047] In a possible implementation of the first aspect, the method further includes:

[0048] When the edge computing device detects for the second time that the second identity feature data of the user sent by the second terminal device matches the first identity feature data, and the operation data of the user sent by the second terminal device meets the first preset condition, the edge computing device acquires the creation content corresponding to the first identity feature data from the server, and determines the creation content with the second latest end creation time from the creation content corresponding to the first identity data.

[0049] The creation content with the second latest end creation time is sent to the second terminal device.

[0050] It can be understood that in the above embodiment of the present application, when the edge computing device sends the created content to the server, the edge computing device will also send the feature information corresponding to the created content, wherein the feature information includes the time of ending the creation.

[0051] In this way, the server can manage the feature information corresponding to the currently created content in a 'last-in first-out' queue manner. That is, the feature information corresponding to the created content with the latest ending time of creation is arranged at the front end.

[0052] That is, when the user performs an action corresponding to starting the creation, such as a "hand waving" action, the cloud server sends the feature information corresponding to the created content with the latest ending time of creation to the edge computing device, so that the edge computing device can obtain the latest created content according to the feature information corresponding to the currently created content with the latest ending time of creation when the user performs the hand waving action.

[0053] When the user performs the action corresponding to starting the creation for the second time, such as a "hand waving" action, the cloud server sends the feature information corresponding to the created content with the second latest ending time of creation to the edge computing device, so that the edge computing device can obtain the corresponding created content according to the feature information corresponding to the currently created content with the second latest ending time of creation when the user performs the hand waving action.

[0054] In this way, in the case where the user has multiple historical created contents, the user can switch to the required created content through a simple operation.

[0055] In a possible implementation of the above first aspect, the first terminal device and the second terminal device perform communication data transmission with the edge computing device through a 5G network.

[0056] The edge computing device is configured to forward the communication data of the first terminal device and the second terminal device to the server.

[0057] In a possible implementation of the above first aspect, the edge computing device is a base station device.

[0058] In a second aspect, the embodiments of the present application provide an XR content creation system, which includes a first terminal device, a second terminal device, an edge computing device, and a server.

[0059] The first terminal device is configured to obtain first identity feature data and first creation data of a user, and send the first identity feature data and the first creation data of the user to the edge computing device.

[0060] The second terminal device is configured to obtain second identity feature data of the user, generate operation data according to an operation of the user on the second terminal device, and display created content generated by the edge computing device.

[0061] an edge computing device, configured to:

[0062] generate first creative content according to the first creative data, and send the first creative content and the first identity feature data to a server, and

[0063] in a case where it is detected that the second identity feature data of the user sent by the second terminal device matches the first identity feature data, and operation data of the user sent by the second terminal device meets a first preset condition, acquire the first creative content from the server, and send the first creative content to the second terminal device;

[0064] a server, configured to store the first creative content and the first identity feature data.

[0065] In a possible implementation of the second aspect, the first preset condition is that the action feature operation data matches preset action feature operation data for starting a creation.

[0066] In a possible implementation of the second aspect, the edge computing device is configured to, in a case where it is detected that the second identity feature data of the user sent by the second terminal device does not match the identity feature data stored in the server, and the action feature operation data sent by the second terminal device meets the first preset condition, create a creative space corresponding to the second identity feature data, and send the creative space to the second terminal device.

[0067] In a possible implementation of the second aspect, the second terminal device is configured to, while displaying the first creative content, acquire second creative data of the user, and send the second creative data to the edge computing device.

[0068] The edge computing device is configured to generate second creative content according to the second creative data, combine the first creative content and the second creative content to generate third creative content, and send the third creative content to the second terminal device.

[0069] The second terminal device is configured to display the third creative content.

[0070] In a possible implementation of the second aspect, the edge computing device is configured to, in a case where it is detected that the action feature operation data of the user sent by the second terminal device meets a second preset condition, send the third creative content and feature information corresponding to the third creative content to the server.

[0071] The server is configured to store the third creative content and the feature information corresponding to the third creative content.

[0072] In a possible implementation of the second aspect, the edge computing device is configured to: in a case where the action feature operation data of the user sent by the second terminal device meets the second preset condition, cache the third creative content and the feature information corresponding to the third creative content in the edge computing device, and send the third creative content and the feature information corresponding to the third creative content to the server after a preset time.

[0073] In a possible implementation of the second aspect, the second preset condition is that the action feature operation data matches preset action feature operation data for ending the creation.

[0074] In a possible implementation of the second aspect, the feature information corresponding to the third creative content includes an ending creation time, identification information of a creative space where the third creative content is located, first identity feature data of the user, identification information corresponding to the second terminal device, and specification information of the creative space where the third creative content is located.

[0075] In a possible implementation of the second aspect, the first terminal device is a single terminal device or one sub-terminal device in a group terminal device.

[0076] The second terminal device is a single terminal device or one sub-terminal device in a group terminal device.

[0077] The group terminal device includes a plurality of sub-terminal devices, and the plurality of sub-terminal devices have the same group device identification.

[0078] In a possible implementation of the second aspect, when the second terminal device is a single terminal device, the identification information corresponding to the second terminal device includes identification information of the second terminal device.

[0079] When the second terminal device is one sub-terminal device in a group terminal device, the identification information corresponding to the second terminal device includes identification information of the second terminal device and identification information of the group terminal device where the second terminal device is located.

[0080] In a possible implementation of the second aspect, the edge computing device is configured to: in a case where the second identity feature data of the user sent by the second terminal device matches the first identity feature data for the first time and the action feature operation data of the user sent by the second terminal device meets the first preset condition, obtain, from the server, creative content corresponding to the first identity feature data, and determine, from the creative content corresponding to the first identity feature data, creative content with the latest ending creation time.

[0081] Send the creative content with the latest ending creation time to the second terminal device.

[0082] In a possible implementation of the second aspect, the edge computing device is configured to: in a case where the second identity feature data of the user sent by the second terminal device is detected for a second time to match the first identity feature data, and the action feature operation data of the user sent by the second terminal device meets the first preset condition, obtain the creative content corresponding to the first identity feature data from the server, and determine the creative content of the end creative time next night from the creative content corresponding to the first identity feature data;

[0083] send the creative content of the end creative time next night to the second terminal device.

[0084] In a possible implementation of the second aspect, the first terminal device and the second terminal device communicate data with the edge computing device through a 5G network.

[0085] The edge computing device is configured to forward the communication data of the first terminal device and the second terminal device to the server.

[0086] In a possible implementation of the second aspect, the edge computing device is a base station device.

[0087] In a third aspect, an embodiment of the present application provides an edge computing device, comprising:

[0088] An operation and identity recognition module is configured to obtain the first identity feature data and the first creative data of the user sent by the first terminal device, and obtain the second identity feature data of the user sent by the second terminal device, and generate the operation data according to the operation of the user to the second terminal device.

[0089] The operation and identity recognition module is further configured to send the identity recognition result of the second identity feature data matching the first identity feature data, the operation recognition result of the operation data meeting the first preset condition, and the first creative data to an edge computing module.

[0090] The edge computing module is configured to obtain the first creative data sent by the terminal device, generate the creative content according to the first creative data, and send the first creative content and the first identity feature data to the server.

[0091] In a case where the identity recognition result of the second identity feature data matching the first identity feature data and the operation recognition result of the operation data meeting the first preset condition are obtained, the edge computing module is configured to obtain the first creative content from the server, and send the first creative content to the second terminal device.

[0092] In a fourth aspect, an embodiment of the present application provides a server, comprising:

[0093] An XR content creation management module is configured to store the correspondence between the user identity feature data and the user creative content.

[0094] The XR content management module is used to store created content. When it receives a request from an edge computing device, it retrieves the corresponding user-created content based on the user identity feature data carried in the request and sends the corresponding user-created content to the edge computing device.

[0095] Fifthly, embodiments of this application provide an electronic device, including: a memory for storing instructions executed by one or more processors of the electronic device, and a processor, which is one of the one or more processors of the electronic device, for executing any of the above-described XR content creation methods.

[0096] Sixthly, embodiments of this application provide a computer-readable storage medium storing instructions that, when executed on an electronic device, cause the electronic device to perform any of the above-described XR content creation methods.

[0097] In a seventh aspect, embodiments of this application provide a computer program product, including instructions that, when the computer program product is run on a computer, cause the computer to execute any of the above-described XR content creation methods. Attached Figure Description

[0098] Figure 1 According to some embodiments of this application, a schematic diagram of an XR content creation scenario is shown;

[0099] Figure 2 According to some embodiments of this application, a schematic diagram of the structure of an XR content creation system is shown;

[0100] Figure 3 According to some embodiments of this application, a flowchart of an XR content creation method is shown;

[0101] Figure 4 According to some embodiments of this application, a schematic diagram of an XR content creation scenario is shown;

[0102] Figure 5 According to some embodiments of this application, a schematic diagram of an XR content creation scenario is shown;

[0103] Figure 6 According to some embodiments of this application, a schematic diagram of an XR content creation scenario is shown;

[0104] Figure 7 According to some embodiments of this application, a schematic diagram of an XR content creation scenario is shown;

[0105] Figure 8 According to some embodiments of this application, a schematic diagram of an XR content creation scenario is shown;

[0106] Figure 9 According to some embodiments of the present application, a scene schematic diagram of XR content creation is shown. DETAILED DESCRIPTION

[0107] Illustrative embodiments of the present application include, but are not limited to, an XR content creation method, system, electronic device, and medium.

[0108] To clearly understand the scheme in the embodiments of the present application, first some belonging to the present application will be explained.

[0109] Smart screen: a large-screen device for displaying XR content. It has a communication module, a collection module and a display. The communication module can be used for communication between the smart screen and the server or other devices. The collection module generally includes a camera for shooting user images. The display module table is used to display XR content.

[0110] Edge computing device: refers to a base station device integrated with computing and storage functions near the source of things or data. It can be arranged in multiple locations in the geographical space according to actual needs. The edge computing device can process data from terminal devices within its own signal coverage range.

[0111] To solve the above problems, the present application provides an XR content creation method, which can be used in a cloud server, the method comprising: acquiring user identity data and operation data sent by a terminal device, when it is detected that the user sends operation data to the terminal device for a preset starting creation corresponding feature data, determining whether the cloud server stores historical creation content corresponding to the user's identity feature data according to the user's identity data, if there is historical creation content, acquiring the historical creation content corresponding to the user's identity feature data and sending it to the terminal device for display. It can be understood that the historical creation content can be the creation content generated by the user creating in other terminal devices.

[0112] If there is no historical creation content, create a creation space corresponding to the user's identity data and send it to the terminal device for display. And real-time acquisition of user operation data and creation content generated in the creation space. When it is detected that the user's operation data is a preset ending creation corresponding feature data, the current created content of the user can be acquired, and the current created content and the feature information corresponding to the current created content are stored. The feature information corresponding to the current created content includes the user's identity feature data.

[0113] It can be understood that the terminal device mentioned above can be a smart screen.

[0114] It can be understood that the identity feature data can be a face image, an iris image, and the like, which can identify the identity of the user.

[0115] Based on the above scheme, the user can obtain the XR content generated by the user in the creation of other terminal devices in front of the current terminal device by implementing the corresponding action, and the user can create the XR content creation space and directly store the current created content in the cloud server through the action, so that the storage of the XR content and the mobile creation of the XR content are more convenient and simple, and the user experience is improved.

[0116] It can be understood that although the above-mentioned manner solves the technical problem that the existing storage and opening of the XR content corresponding file on another terminal device is too complex, the data processing related to the creation of the XR content in the above scheme is placed in the cloud server for execution, and the transmission link between the terminal device and the cloud server is relatively long, so the transmission speed is slow. Moreover, the cloud server generally needs to process a large amount of data transmitted by the terminal device, so the data amount processed by the cloud server is large, which leads to a slow processing speed of the data related to the XR content.

[0117] To solve the above problems, an embodiment of the present application provides an XR content creation method, applied to an XR content creation system, the XR content creation system comprising a terminal device, a cloud server, and at least one edge computing device arranged between the terminal device and the cloud server.

[0118] The creation method can comprise:

[0119] When the current terminal device obtains the identity feature data and the operation data of the creator, the identity feature data and the operation data are sent to the edge computing device connected with the current terminal device. When the edge computing device detects that the operation data is the preset operation data corresponding to the starting of the creation, it is judged whether there is historical creation content of the creator in the cloud server according to the identity feature data; wherein the historical creation content of the creator is the created content generated by the creator in the creation of other terminal devices. If the judgment result is that there is historical creation content, the historical creation content is obtained and sent to the current terminal device for display.

[0120] If there is no historical creation content, a corresponding creation space is created for the user, and the creation space is sent to the terminal device for display. The operation data of the user and the creation content generated in the creation space are obtained in real time. When the edge computing device detects the preset feature data corresponding to the end of the creation, the current created content of the user is obtained, and the current created content and the feature information corresponding to the current created content are sent to the cloud server for storage.

[0121] Based on the above scheme, in a first aspect, a user can realize direct acquisition of XR content previously saved on another terminal device by implementing simple actions and the like, facilitating continued creation of the XR content. The user can also realize creation of an XR content creation space and storage of currently created content by implementing simple actions, making the storage of the XR content and mobile creation of the XR content more convenient and simple, and improving user experience.

[0122] In a second aspect, in the XR content creation method provided in the embodiments of the present application, the terminal device sends various data, such as user identity feature data, operation data, and current creation data, to an edge computing device near the terminal device for data processing, and only data storage and other data processing services are executed on a cloud server. Compared with the scheme in which all data involved in creation is directly sent to a cloud server for processing in some embodiments, the data transmission link can be effectively shortened, and the data transmission speed of the XR content can be improved.

[0123] It can be understood that the current terminal device can collect current creation data of the user while displaying the historical creation content, and send the current creation data to the edge computing device. The edge computing device can obtain corresponding current creation content according to the current creation data, and send the current creation content and the historical creation content to the current terminal device for display after combining the current creation content and the historical creation content.

[0124] It can be understood that the feature information corresponding to the current created content can further include: text corresponding to operation data for ending creation, time of obtaining the operation data for ending creation, identification information of the user, identification information of the current terminal device, identification information of a creation space where the current created content is located, and creation space specifications.

[0125] It can be understood that the terminal device mentioned in the embodiments of the present application can be a single terminal device or a group terminal device, where the group terminal device can refer to a plurality of terminal devices 100 having a connection relationship.

[0126] The following briefly describes the XR content creation method in the embodiments of the present application, taking the case that a user can create in front of a single terminal device for the first time and continue to create in front of a single terminal device for the second time as an example.

[0127] For example, Figure 1 FIG. 1 shows a scene schematic diagram of creation by a user 001, as shown in Figure 1As shown, the user 001 interacts with the first terminal device 100A to create for the first time, and the first terminal device 100A will first collect the identity feature data of the user 001, such as a face image, and send the identity feature data to the first edge computing device 200A connected with the first terminal device 100A; and the first terminal device 100A will send the collected operation data of the user 001 to the first edge computing device 200A in real time. At the same time, the first terminal device 100A will also send the identification information of the first terminal device 100A to the first edge computing device 200A.

[0128] Suppose the operation data corresponding to the start of creation preset by the first edge computing device 200A is the "hand waving" action, when the first edge computing device 200A detects the "hand waving" action sent by the first terminal device 100A, it is determined according to the face image of the user 001 that there is no historical creation data of the user 001 in the cloud server, that is, the user has not created. Create a corresponding creation space for the user 001, and send the feature information corresponding to the creation space to the cloud server 300 for storage. And can send the corresponding creation space to the first terminal device 100A for display, the user 001 can create XR content in the created creation space. That is, the first terminal device 100A can collect the current creation data of the user 001 while displaying the creation space, and send the current creation data to the edge computing device, and the edge computing device can obtain the corresponding current creation content according to the current creation data, for example, Figure 1 As shown, the current creation content of the user can be a cube 101 created.

[0129] When the first edge computing device 200A detects that the operation data of the user is the preset operation data for ending creation, for example, the "hand clasping" action, the current created content and the feature information corresponding to the current created content are sent to the cloud server for corresponding storage. Among them, the feature information corresponding to the current created content can include: the text corresponding to the "hand clasping" action, such as "clasping", the time when the "hand clasping" action occurs, the identification information of the user 001, the identification information of the terminal device 100A, the identification information of the creation space, and the specification of the creation space.

[0130] When the user 001 comes to the second terminal device 100B, he wants to continue the creation of the above creation content. As shown in Figure 1As shown, the user 001 interacts with the second terminal device 100B, the second terminal device 100B will first collect the identity feature data of the user 001, for example, a face image, and send the identity feature data to the second edge computing device 200B connected with the second terminal device 100B; and the second terminal device 100B will send the collected operation data of the user 001 to the second edge computing device 200B, at the same time, the second terminal device 100B will also send the identification information of the second terminal device 100B to the second edge computing device 200B.

[0131] Suppose the operation data corresponding to the preset starting creation of the second edge computing device 200B is the "hand waving" action, when the second edge computing device 200B detects the "hand waving" action of the user, it is determined according to the face image of the user 001 that there is historical creation content of the user 001 in the cloud server 300, then the historical creation content is obtained and sent to the second terminal device 100B for display, that is, as shown in Figure 1 , the second terminal device 100B will display the cube 101 created by the user before.

[0132] The second terminal device 100B can also collect the current creation data of the user 001 and send it to the second edge computing device 200B, the second edge computing device 200B can obtain the corresponding current creation content according to the current creation data, for example, the current creation content is a cuboid 102. And after combining the current creation content and the historical creation content, the current created content is sent to the second terminal device 100B for display. For example, as shown in Figure 1 , the second terminal device 100B can display a cube 101 and a cuboid 102.

[0133] When the second edge computing device 200B detects that the operation data sent by the second terminal device 100B is the preset operation data for ending creation, for example, the "hand clasping" action, the current created content and the feature information corresponding to the current created content are sent to the cloud server 300 for corresponding storage. The feature information corresponding to the current created content can include the text corresponding to the "hand clasping" action, for example, "clasping", the time when the "hand clasping" action occurs, the user identification information, the terminal device identification information, the creation space identification information, and the creation space specification.

[0134] Before detailing the XR content creation method provided in the embodiments of the present application, first, the XR content creation system in the embodiments of the present application is briefly introduced. Figure 2 , a schematic diagram of an XR content creation system is shown, as shown in Figure 2 , the XR content creation system can include:

[0135] The terminal device can include a 5G communication module, a collection module, a display module, and a processor.

[0136] The 5G communication module can be a physical unit supporting 5G communication, and is configured to communicate with the edge computing device. The 5G communication module can include an antenna and implement the transmission and reception of electromagnetic waves via the antenna. The wireless communication module 120 can provide a wireless communication solution including a wireless local area network (WLAN) (such as a wireless fidelity (Wi-Fi) network), Bluetooth (BT), a global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR) technology, and the like, which are applied to the terminal device.

[0137] The collection module is configured to collect operation data and identity feature data.

[0138] It can be understood that, in the embodiments of the present application, the operation data of the user can be action feature data generated by the user showing actions to the terminal device, can be various operation feature data generated by the user performing touch screen, key, and the like operations on the terminal device, and can be operation feature data generated by the user operating the terminal device through other devices.

[0139] In some embodiments, the action feature data can be an action image of the user, or can be a textual description corresponding to the action image. For example, if the image captured by the camera is an action image of the user waving hands, the action feature data extracted by the feature extraction unit can be the action image of the user waving hands, or can be a textual description such as "wave hands" corresponding to the waving hands action.

[0140] In some embodiments, the collection module can include a camera and a feature extraction unit. The feature extraction unit can be integrated in the camera, and is configured to extract action feature data and identity feature data from the image captured by the camera. Alternatively, the feature extraction unit can be separately provided.

[0141] It can be understood that, in some embodiments, if the collection module does not have a feature extraction unit, the original image captured by the camera can be directly sent to the processor.

[0142] In some embodiments, the collection module can include various sensors for collecting operation characteristic data generated by the user's touch screen, key, and other operations on the terminal device.

[0143] In some embodiments, the identity characteristic data can be an image that can identify the user's identity, such as a face image.

[0144] The display module is configured to display the created content. In some embodiments, the display module can include a display screen, which can have a touch function to support touch operations and obtain touch data, and send the touch data to the processor.

[0145] The processor is configured to obtain the original image or the identity characteristic data and operation data obtained by the collection module, and send the original image or the identity characteristic data and operation data to the operation and identity recognition module of the edge computing device through the 5G communication module. The processor can also be configured to receive the user's historical created content issued by the edge computing device and control the display screen to display the content.

[0146] The processor can also be configured to send the user's current created data to the edge computing device.

[0147] In some embodiments, the processor of the terminal device has an identity recognition and action recognition module, which can directly recognize the original image or the identity characteristic data and operation data sent by the collection module to obtain the identity recognition result or the action recognition result and send them to the edge computing module of the edge computing device.

[0148] The edge computing device can include:

[0149] The operation and identity recognition module is configured to obtain the original image or the identity characteristic data and operation data sent by the processor of the terminal device, and obtain the identity recognition result and the action recognition result according to the original image or the identity characteristic data and operation data. The operation and identity recognition module is also configured to send the corresponding identity recognition result or action recognition result to the edge computing module.

[0150] Specifically, the identity recognition result can be that the user is a registered user or an unregistered user stored in the XR content user management module of the cloud server. The action recognition result can be operation data corresponding to a preset operation of starting creation or operation data corresponding to a preset operation of ending creation or other operation data. In some embodiments, the action recognition result can also be the created content corresponding to the operation data during the user's creation process.

[0151] An edge computing module is configured to calculate corresponding creative content according to operation data and touch data for creation of a user, and send the calculated creative content to a terminal device to control the display screen of the terminal device to display the creative content.

[0152] When receiving the action recognition result of the user starting the creation sent by the operation and identity recognition module, it is determined whether there is historical creative content of the user in the cloud server according to the identity feature data; if the determination result is yes, the historical creative content of the user is downloaded from the XR content management module. If the determination result is no, a corresponding creation space can be created for the user and sent to the current terminal device. The historical creative content of the user is the created content generated by the user in other terminal devices or the current terminal device.

[0153] When receiving the action recognition result of the user ending the creation sent by the operation and identity recognition module, the current created content and the feature information corresponding to the current created content are sent to the edge management module, and the edge management module sends the current created content and the feature information corresponding to the current created content to the XR content creation management module of the cloud server for storage. The feature information corresponding to the current created content can include: the text corresponding to the operation data of ending the creation, the time of obtaining the operation data of ending the creation, the identification information of the user, the identification information of the current terminal device, the identification information of the creation space where the current created content is located, and the specification of the creation space.

[0154] The edge management module is configured to, when receiving the current created content and the feature information corresponding to the current created content sent by the edge computing module, store the current created content and the feature information corresponding to the current created content in the XR content creation management module of the cloud server.

[0155] The edge management module is further configured to manage users within the coverage range of the edge computing device, and obtain user information from the XR content creation center according to actual needs; manage the life cycle of the content creation instance of the edge computing unit, for example, in some embodiments, the edge computing unit will cache the creation space where the current created content of the user is located in an open state when detecting the operation data corresponding to the end of the user's creation. After a preset time, the creation space is closed and the current created content and the feature information corresponding to the current created content are sent to the cloud server. The edge management module is further configured to manage the life cycle of other data cached or saved by the edge computing unit.

[0156] An edge cache and storage module is configured to cache or store the creative content of the user.

[0157] A 5G communication interface is configured to communicate with the terminal device.

[0158] (III) a cloud server, comprising:

[0159] an XR content management module, configured to store the creative content of the user, and when receiving a delivery request of the edge computing device, acquire the creative content of the user corresponding to the user identity feature data carried in the delivery request, and send the creative content of the user corresponding to the user to the edge management module.

[0160] an XR content user management module, configured to store and manage the identity information of the user.

[0161] an XR content creation management module, configured to store the correspondence between the user identity feature data and the creative content of the user, and store and manage the creative space of the XR content user. When the XR content creation management module receives the creative content of the user uploaded by the edge computing unit, the creative content of the user is sent to the creative space of the user.

[0162] The XR content creation method provided by the embodiment of the present application is described in detail below with reference to the above-mentioned XR content creation system. Figure 3 Fig. 1 shows a schematic diagram of a content creation method according to an embodiment of the present application. Figure 3 As shown in Fig. 1, the XR content creation method specifically includes:

[0163] 301: The terminal device acquires user identity feature data and operation data.

[0164] It can be understood that in the embodiment of the present application, the operation data of the user can be action feature data generated by the user showing actions to the terminal device, can be various operation feature data generated by the user performing touch screen, key and other operations on the terminal device, and can be operation feature data generated by the user operating the terminal device through other devices.

[0165] It can be understood that in the embodiment of the present application, the terminal device can capture the image of the user in real time, and extract the action feature data and the identity feature data from the image of the user.

[0166] It can be understood that the action feature data can be an action image of the user, or a text description corresponding to the action image. For example, the terminal device can extract an action image of the user “waving hands” from the image of the user, or extract a “waving hands” text description corresponding to the “waving hands” action from the image of the user.

[0167] The identity feature data can be an image that can identify the identity of the user, such as a face image. That is, the terminal device can extract a face image that can identify the identity of the user from the image of the user.

[0168] In some embodiments, the terminal device can also set a virtual or physical button such as a "start creating" or "end creating" button, and the user can click the "start creating" or "end creating" button, and the terminal device generates corresponding operation feature data according to the operation of clicking the "start creating" or "end creating" button.

[0169] In some embodiments, the terminal device can also generate operation feature data through remote control by other devices such as a remote controller.

[0170] 302: The terminal device sends the identity feature data and operation data of the user to the edge computing device.

[0171] It can be understood that in some embodiments, the terminal device can send the extracted identity feature data and operation data to the edge computing device in real time.

[0172] In other embodiments, if the terminal device has an identity recognition and action recognition module, the identity feature data or operation data can be directly recognized by the operation and identity recognition module to obtain an identity recognition result or an action recognition result, and then sent to the edge computing device.

[0173] For example, the identity recognition result can be that the user is a registered user or an unregistered user of the cloud server. The action recognition result can be that the extracted operation data is operation data corresponding to a preset start creating or operation data corresponding to a preset end creating. Alternatively, the action recognition result can be the operation data corresponding to the creation content during the user's creating process.

[0174] In some embodiments, the terminal device can also send the identification information and screen specification information of the terminal device to the edge computing device, to indicate the association between the terminal device and the creation space. And when creating the creation space later, the specification parameters required by the creation space can be calculated according to the specification of the terminal device, so as to create a creation space with corresponding specification.

[0175] The specification of the terminal device includes the physically displayable specification of the terminal device.

[0176] The determination of the specification parameters required by the creation space is as follows: obtaining the minimum specification available for the creation space and the maximum specification of the creation space that the user can buy. When the physically displayable specification of the terminal device is greater than the minimum specification available for the creation space, the minimum specification available for the creation space is taken as the specification parameter of the creation space.

[0177] When the maximum specification of the creation space that the user can buy is less than the physically displayable specification of the terminal device, the maximum specification of the creation space that the user can buy is taken as the specification parameter of the creation space.

[0178] The determination manner of the specification parameters of the creation space is only illustrative. In the embodiments of the present application, the determination manner of the specification parameters of the creation space can also be any other implementable manner.

[0179] 303: The edge computing device detects that the operation data is the preset operation data corresponding to starting creation.

[0180] It can be understood that the edge computing device can store the operation data corresponding to starting creation and the operation data corresponding to ending creation which are set by the user.

[0181] 304: The edge computing device determines whether the historical creation content of the user exists in the cloud server according to the identity feature data.

[0182] If the determination result is yes, go to 305 to obtain the historical creation content. If the determination result is no, go to 315, and the edge computing device can create the corresponding creation space for the user and send it to the current terminal device.

[0183] The historical creation content of the user is the created content generated by the user in other terminal devices or the current terminal device.

[0184] It can be understood that in the embodiments of the present application, the preset operation data corresponding to starting creation can be set arbitrarily, for example, the "hand stretching" action can be set as the preset operation data corresponding to starting creation. When the edge computing device obtains the "hand stretching" action image sent by the terminal device, it is determined that the user needs to start creation. At this time, it can be determined according to the identity feature data whether the historical creation content of the user exists in the cloud server.

[0185] The determination manner of whether the historical creation content of the user exists in the cloud server according to the identity feature data is as follows:

[0186] Firstly, it is determined according to the identity feature data whether the user is registered in the cloud server.

[0187] It can be understood that the cloud server can store the identification information of the user registered in the cloud server, the identity feature data (for example, the face image) corresponding to the user, and the historical creation content corresponding to the user and the feature information corresponding to the historical creation content. The identification information of the user can be a user account or a user name, etc. The identity feature data of the user can be a face image of the user, etc. The feature information corresponding to the historical creation content can include the identification information corresponding to the historical creation content, for example, the identification serial number, etc., the terminal device identification information corresponding to the historical creation content, the action corresponding to the ending of creation, for example, "hug", the time when the action corresponding to the ending of creation occurs, the user identification information, the creation space identification information, and the creation space specification.

[0188] In some embodiments, when the edge computing device acquires the current user face image, it can acquire all user face images stored in the cloud server from the cloud server, and then match the current face image with all user face images stored in the cloud server to determine whether all user face images stored in the cloud server have a face image matching the current face image. If there is, it is determined that the user has registered with the cloud server.

[0189] Then further query the user identification information and / or historical creation content corresponding to the current face image. When the user identification information and historical creation content corresponding to the current face image are queried, it can be judged that there is historical creation content of the user in the cloud server.

[0190] It can be understood that there are some users who only register but do not create or create and do not save the creation content, therefore, there are cases where the user identification information corresponding to the current face image can be queried, but the historical creation content cannot be queried, at this time, it can be judged that there is no historical creation content of the user in the cloud server.

[0191] In some embodiments, if it is determined that all user face images stored in the cloud server do not have a face image matching the current face image, it is determined that the current user has not registered with the cloud server, and there is no historical creation content of the user.

[0192] 305: The edge computing device acquires historical creation content.

[0193] It can be understood that in the embodiments of the present application, the edge computing device can download the historical creation content corresponding to the user from the cloud server.

[0194] In some embodiments, the edge computing device can acquire feature information corresponding to a plurality of historical creation contents of the user according to the identity feature data corresponding to the user, and acquire the historical creation content with the latest end creation time according to the feature information corresponding to the plurality of historical creation contents, and send the historical creation content with the latest end creation time to the terminal device.

[0195] It can be understood that in some embodiments, when the edge computing device detects the identity feature data of the same user sent by the terminal device for the second time, and the operation data of the user sent by the terminal device matches the preset operation data corresponding to the end creation, the edge computing device can acquire feature information corresponding to a plurality of historical creation contents of the user according to the identity feature data corresponding to the user, and acquire the historical creation content with the second latest end creation time according to the feature information corresponding to the plurality of historical creation contents, and send the historical creation content with the second latest end creation time to the terminal device.

[0196] 306: The edge computing device sends the historical creation content to the terminal device.

[0197] 307: The terminal device displays the historical creation content and collects current creation data of the user.

[0198] It can be understood that in the embodiments of the present application, the terminal device can display the historical creation content through the display screen for the user to watch. At this time, the user can continue to create based on the historical creation content displayed by the terminal device. For example, the historical creation content is a cube created in the creation space, and the user can add content such as a cuboid, or delete content such as the cube, or adjust the content such as the position of the cube, based on the historical creation content.

[0199] It can be understood that in the embodiments of the present application, the creation content can be any content, such as any three-dimensional model, any static image or dynamic image, various videos, music, etc.

[0200] In the embodiments of the present application, the user can create content in the way of showing creation gestures or other operation data and directly through the touch screen. The terminal device can collect the creation gestures and touch screen data of the user. That is, the current creation data of the user can be the creation gestures and touch screen data of the user.

[0201] It can be understood that in the embodiments of the present application, the user can create content in any way that can be realized.

[0202] 308: The terminal device sends the current creation data of the user to the edge computing device.

[0203] 309: The edge computing device obtains the corresponding current creation content according to the current creation data, and obtains the current created content by combining the current creation content and the historical creation content.

[0204] It can be understood that in the embodiments of the present application, the edge computing device can obtain the corresponding rendered current creation content according to the current creation data, that is, the creation gestures and touch screen data of the user. And the current created content is obtained by combining the current creation content and the historical creation content.

[0205] 310: The edge computing device sends the current created content to the current terminal device.

[0206] It can be understood that the edge computing device can send the current created content to the current terminal device; in addition, the first edge computing device 200A can send the current created content of the user to the cloud server at a timing while the user is creating, and the cloud server can store the current created content, the identification information of the user corresponding to the historical created content, the identity feature data (for example, a face image) of the user, and the feature information corresponding to the historical created content, and the like.

[0207] 311: The terminal device displays the current created content.

[0208] It can be understood that in the embodiments of the present application, the terminal device can display the current created content for the user to watch.

[0209] For example, the historical created content is a cube created in the creation space, and the current created content is a cuboid added on the basis of the historical created content, and at this time, the terminal device will display the created content including a cube and a cuboid.

[0210] 312: The edge computing device detects the preset operation data for ending the creation.

[0211] 313: The edge computing device sends the current created content and the feature information corresponding to the current created content to the cloud server.

[0212] It can be understood that in the embodiments of the present application, the feature information corresponding to the current created content can include a word corresponding to the action for ending the creation, for example, “hug”, the time when the action for ending the creation occurs, the user identification information, the terminal device identification information, the creation space identification information, and the creation space specification.

[0213] It can be understood that in the embodiments of the present application, the preset operation data corresponding to the ending of the creation can be set arbitrarily, for example, the “hug hand” action can be set as the preset operation data corresponding to the ending of the creation. When the edge computing device obtains the “hug hand” action image, it can be judged that the user needs to end the creation, at this time, the edge computing device can send the current created content and the feature information corresponding to the current created content to the cloud server for corresponding storage. The feature information corresponding to the current created content can include a word corresponding to the “hug hand” action, for example, “hug”, the time when the “hug hand” action occurs, the user identification information, the terminal device identification information, the creation space identification information, and the creation space specification.

[0214] It can be understood that the creation space identification information can be an identification serial number automatically generated by the edge computing device for the creation space where the historical created content is located. The terminal device identification information can be a terminal device identification number.

[0215] It can be understood that when the terminal device is a single terminal device, the terminal device identification information is a terminal device identification number. When the terminal device is a group terminal device, i.e., multiple terminal devices, the identification information corresponding to each terminal device includes not only the identification number of each terminal device but also a group identification number.

[0216] It can be understood that in some embodiments, the edge computing device stops rendering and issuing the created content when detecting the end-creation operation data of the user. In addition, the creation space in which the user currently creates content is cached in an open state in the edge computing device. After a preset time, the creation space is closed, and the current created content and the feature information corresponding to the current created content are sent to the cloud server. In this way, if the user creates content on another terminal device in a short time, the creation space can be directly obtained from the edge computing device. The user does not need to obtain the creation space or the historical created content from the cloud server, which greatly shortens the time for the user to obtain the creation space. The quick switching of the user between multiple terminal devices for creation is realized.

[0217] 314: The cloud server stores the current created content and the feature information corresponding to the current created content.

[0218] It can be understood that in the embodiments of the present application, the cloud server manages the feature information corresponding to the current created content in a 'last-in first-out' queue manner. That is, the feature information corresponding to the created content with the latest end-creation time is arranged at the front end.

[0219] That is, when the user performs the open-creation operation again, such as the "hand-spread" action, the cloud server sends the feature information corresponding to the created content with the latest time to the edge computing device, so that when the user performs the hand-spread action, the edge computing device can obtain the latest created content according to the feature information corresponding to the current created content with the latest time, i.e., the created content corresponding to the feature information of the current created content.

[0220] When the user performs the open-creation operation again, such as the "hand-spread" action, the cloud server sends the feature information corresponding to the created content with the latest time to the edge computing device, so that when the user performs the hand-spread action, the edge computing device can obtain the latest created content according to the feature information corresponding to the current created content with the latest time, i.e., the created content corresponding to the feature information of the current created content.

[0221] In this way, in the case where the user has multiple historical created contents, the user can switch to the required created content through a simple operation.

[0222] 315: The edge computing device creates a corresponding creation space for the user and sends it to the current terminal device.

[0223] It can be understood that if the edge computing device determines that the historical creation content of the user does not exist in the cloud server according to the identity feature data, the corresponding creation space can be created for the user and sent to the current terminal device so that the user can create content according to the displayed creation space through the display creation gesture or other operation data and directly through the touch screen.

[0224] In some embodiments, after the edge computing device creates the corresponding creation space for the user, the edge computing device can also send the feature information corresponding to the creation space to the cloud server for storage. The feature information corresponding to the creation space can include user identification information, terminal device identification information, creation space identification information, creation space specification information, and the like.

[0225] When the edge computing device detects the preset operation data for ending the creation, the edge computing device sends the current created content and the feature information corresponding to the current created content to the cloud server.

[0226] The XR content creation method provided in the embodiments of the present application enables the user to directly obtain the historical creation content when continuing to create the XR content on another device through action and identity recognition, and directly store the current created content through the preset action for ending the creation, which is more fast and simple, and improves the user experience.

[0227] In addition, the XR content creation method provided in the embodiments of the present application sends a plurality of data, such as the identity feature data and operation data of the user and the current creation data, to the edge computing device near the terminal device for data processing, and only data storage and other data processing are performed on the cloud server. Compared with the scheme in which all data related to the creation are directly sent to the cloud server in some embodiments, the data transmission link can be effectively shortened, the data transmission speed of the XR content can be improved, the data processing amount of the edge computing device can be effectively reduced, and the data processing speed of the XR content can be accelerated.

[0228] It can be understood that in some embodiments, the edge computing device can upload the incremental content of the creation content of the user and the feature information corresponding to the incremental content, or the current created content and the feature information corresponding to the current created content to the cloud server for storage. The feature information corresponding to the current created content can include user identification information, current terminal device identification information, creation space identification information where the current created content is located, and the like.

[0229] It can be understood that the terminal device mentioned in the embodiments of the present application can be a single terminal device or a group terminal device, wherein the group terminal device can include a plurality of sub-terminal devices having a connection relationship or a plurality of sub-terminal devices having the same group device identifier.

[0230] In the embodiments of the present application, the user's creation scene can be various. For example, the user can create in front of a single terminal device for the first time and continue to create in front of a single terminal device for the second time; or the user can create in front of a single terminal device for the first time and continue to create in front of a group terminal device for the second time; or the user can create in front of a group terminal device for the first time and continue to create in front of a single terminal device for the second time; or the user can create in front of a group terminal device for the first time and create in front of a single terminal device for the second time.

[0231] It can be understood that in the embodiments of the present application, the group terminal device can be used in the XR large scene application, that is, the group terminal device can realize the creation of the large scene XR content.

[0232] The foregoing Figure 1 The foregoing

[0233] The foregoing

[0234] Figure 4 A scene schematic diagram in which the user 001 creates in front of a single terminal device, i.e., the terminal device A for the first time and continues to create in front of a second group terminal device for the second time is shown.

[0235] The foregoing Figure 2 The foregoing Figure 4 The foregoing

[0236] When the user 001 comes in front of the terminal device B in the second group of terminal devices and wants to continue creating, the terminal device B will first collect the identity feature data of the user 001, such as a face image, and send the identity feature data to the second edge computing device 200B connected with the terminal device A; and the terminal device B will send the collected operation data of the user 001 to the second edge computing device 200B, and at the same time, the terminal device B will also send the identification information of the terminal device B and the group identification information of the second group of terminal devices to the second edge computing device 200B.

[0237] When the user 001 performs the “hand out” action in front of the terminal device B, the edge computing device detects the “hand out” action, determines that there is historical creation content of the user 001 in the cloud server according to the face image of the user 001, and then obtains the historical creation content and sends the historical creation content to the terminal device B for display. The terminal device B can collect the current creation data of the user 001 and upload it to the second edge computing device 200B by referring to the method shown in Figure 3 .

[0238] When the user 001 continues to perform the “hand out” action in front of the terminal device C, the second edge computing device 200B performs the identification of the identity of the user 001 and the judgment of whether there is historical creation content for the terminal device C. The edge computing device determines that there is already a creation space with the same user 001 identification information and the same group identification information, so it will not create a new creation space, but generate a processing task, which is to send the creation content displayed on the terminal device B to the terminal device C for display, realizing data sharing and resource sharing. The terminal device C can collect the current creation data of the user 001 and upload it to the second edge computing device 200B by referring to the method shown in Figure 3 .

[0239] When the user 001 performs the “hand out” action in front of the terminal device C, the second edge computing device 200B detects the “hand out” action, and then sends the current created content on the terminal device C and the feature information corresponding to the current created content to the cloud server for corresponding storage. The feature information corresponding to the current created content can include: the text corresponding to the “hand out” action, such as “hand out”, the time when the “hand out” action occurs, the user 001 identification information, the terminal device C identification information, the group identification information of the second group of terminal devices, the creation space identification information, the creation space specification, and the creation space processing task identification information.

[0240] Similarly, when the user 001 performs the “hand out” action in front of the terminal device B, the second edge computing device 200B detects the “hand out” action, and then sends the current created content on the terminal device B and the feature information corresponding to the current created content to the cloud server for corresponding storage.

[0241] Figure 5 The scenario diagram is shown, in which the user 001 creates content on the first group of terminal devices for the first time and continues to create content on the single terminal device, i.e., the terminal device C for the second time. As shown in Figure 5 The first group of terminal devices includes two terminal devices, i.e., the terminal device A and the terminal device B.

[0242] When the user 001 interacts with the terminal device A in front of the terminal device A, the terminal device A first collects the identity feature data of the user 001, such as a face image, and the operation data of the user 001 and sends them to the first edge computing device 200A. At the same time, the terminal device A also sends the identification information of the terminal device A and the group identification information of the first group of terminal devices to the first edge computing device 200A.

[0243] When the user 001 performs the hand-out action in front of the terminal device A, when the first edge computing device 200A detects the hand-out action sent by the first terminal device 100A, it is determined according to the face image of the user 001 that there is no historical creation data of the user 001 in the cloud server, i.e., the user 001 has not created content. A corresponding creation space A is created for the user 001, and the corresponding feature information of the creation space A is sent to the cloud server for storage. The corresponding creation space A can be sent to the first terminal device 100A for display, and the user 001 can create XR content in the created creation space.

[0244] When the user 001 performs the hand-out action in front of the terminal device A, the first edge computing device 200A detects the preset operation data for ending the creation, i.e., the hand-out action, and sends the current created content on the terminal device A and the corresponding feature information A of the current created content to the cloud server for corresponding storage. The corresponding feature information A of the current created content can include the text corresponding to the hand-out action, such as “hand”, the time when the hand-out action occurs, the identification information of the user 001, the identification information of the terminal device A, the group identification information of the first group of terminal devices, the identification information of the creation space A, and the specification of the creation space A.

[0245] When the user 001 continues to perform the hand-out action in front of the terminal device B, the second edge computing device 200B performs the same user 001 identity recognition and judgment of whether there is historical creation content as the terminal device A. The edge computing device determines that there is already a creation space with the same user 001 identification information and the same group identification information, so it will not create a new creation space, but generate a processing task, which is to send the content of the same creation space displayed on the terminal device A to the terminal device B for display. The user 001 can create XR content in front of the terminal device B.

[0246] When the user 001 performs the "hand-hugging" action in front of the terminal device B, the first edge computing device 200A detects the preset operation data for ending the creation, i.e., the "hand-hugging" action, and then sends the current created content on the terminal device B and the characteristic information B corresponding to the current created content to the cloud server for corresponding storage. The characteristic information B corresponding to the current created content can include the text corresponding to the "hand-hugging" action, e.g., "hug", the time when the "hand-hugging" action occurs, the user 001 identification information, the terminal device B identification information, the group identification information of the first group of terminal devices, the creation space identification information, the creation space specification, and the creation space processing task B identification information.

[0247] When the user 001 comes in front of the terminal device C and wants to continue the creation of the above created content. The terminal device C will first collect the identity characteristic data of the user 001, such as a face image, and send the identity characteristic data to the second edge computing device 200B connected with the terminal device C; and the terminal device C will send the collected user 001 operation data to the second edge computing device 200B, and at the same time, the terminal device C will also send the identification information of the terminal device C and the group identification information of the second group of terminal devices to the second edge computing device 200A.

[0248] When the second edge computing device 200B detects that the user 001 performs the "hand-hugging" action in front of the terminal device C, and determines that there is historical creation data of the user 001 in the cloud server according to the face image of the user 001, the cloud server sends the characteristic information corresponding to the current created content closest to the time to the base station edge management unit, so that when the user 001 performs the hand-hugging action, the base station edge management unit acquires the latest created content according to the characteristic information corresponding to the current created content closest to the time, e.g., the characteristic information B corresponding to the current created content. At this time, the cloud server can delete the characteristic information A corresponding to the current created content.

[0249] Figure 6 A schematic diagram of a scenario in which the user 001 creates for the first time in the first group of terminal devices and continues to create for the second time in the second group of terminal devices is shown.

[0250] As shown in Figure 6 , the first group of terminal devices includes two terminal devices, i.e., the terminal device A and the terminal device B. The second group of terminal devices includes two terminal devices, i.e., the terminal device C and the terminal device D.

[0251] The creation process of the user 001 in front of the first group of terminal devices can be as described in Figure 5 , which will not be described here again.

[0252] When the user 001 performs creation in front of the second group of terminal devices, for example, when the user 001 comes in front of the terminal device C and wants to continue the creation of the above-mentioned creation content. The terminal device C will first collect the identity feature data of the user 001, for example, the face image, and send the identity feature data to the second edge computing device 200B connected with the terminal device A; and the terminal device C will send the collected operation data of the user 001 to the second edge computing device 200B, at the same time, the terminal device C will also send the identification information of the terminal device C and the group identification information of the second group of terminal devices to the second edge computing device 200B.

[0253] In some embodiments, when the second edge computing device 200B detects that the user 001 performs the “hand out” action in front of the terminal device C, and determines that there is historical creation data of the user 001 in the cloud server according to the face image of the user 001, the historical creation content corresponding to the feature information B with the latest end creation time can be obtained and sent to the terminal device C for display. When the user 001 continues to perform the “hand out” operation in front of the terminal device D, the second edge computing device 200B can obtain the historical creation content corresponding to the feature information A with the second latest end creation time and send it to the terminal device D.

[0254] In some embodiments, when the second edge computing device 200B detects that the user 001 performs the “hand out” action in front of the terminal device C, and determines that there is historical creation data of the user 001 in the cloud server according to the face image of the user 001, the historical creation content corresponding to the feature information B with the latest end creation time can be obtained and sent to the terminal device C for display. When the user 001 continues to perform the “hand out” operation in front of the terminal device D, the second edge computing device 200B can obtain the historical creation content corresponding to the feature information A with the second latest end creation time and send it to the terminal device D.

[0255] It can be understood that the above Figure 6 The scenario schematic diagram of the user 001 creating in the first group of terminal devices and continuing to create in the second group of terminal devices with the same number of devices as the first group of terminal devices is shown.

[0256] It can be understood that when the number of devices of the first group of terminal devices is greater than the number of devices of the second group of terminal devices, when the user 001 performs the “hand out” action in front of the second group of terminal devices, the second base station edge detection unit can send the historical creation content to the corresponding devices in the second group of terminal devices, at the same time, the feature information corresponding to the current created content of the extra devices of the first group of terminal devices will be deleted.

[0257] For example, as Figure 7As shown, the first group of terminal devices includes three terminal devices, namely terminal device A, terminal device B and terminal device C. The second group of terminal devices includes two terminal devices, namely terminal device D and terminal device E.

[0258] As shown, the first group of terminal devices includes three terminal devices, namely terminal device A, terminal device B and terminal device C. The second group of terminal devices includes two terminal devices, namely terminal device D and terminal device E. Figure 5 As shown, the first group of terminal devices includes three terminal devices, namely terminal device A, terminal device B and terminal device C. The second group of terminal devices includes two terminal devices, namely terminal device D and terminal device E.

[0259] As shown, the first group of terminal devices includes three terminal devices, namely terminal device A, terminal device B and terminal device C. The second group of terminal devices includes two terminal devices, namely terminal device D and terminal device E.

[0260] As shown, the first group of terminal devices includes three terminal devices, namely terminal device A, terminal device B and terminal device C. The second group of terminal devices includes two terminal devices, namely terminal device D and terminal device E.

[0261] Wherein, at this time, the historical creation content obtained by the user 001 can be the historical creation content corresponding to the feature information B and the historical creation content corresponding to the feature information A respectively. When the user 001 continues to perform the "hand waving" operation in front of the terminal device E, the second edge computing device 200B can obtain the historical creation content of the next night of the end creation time, for example, the historical creation content corresponding to the feature information B, and send it to the terminal device E.

[0262] In some embodiments, when the second edge computing device 200B detects that the user 001 has implemented the "hand waving" action in front of the terminal device C, and it is determined from the face image of the user 001 that there is historical creation data of the user 001 in the cloud server, the historical creation content corresponding to the feature information C and the historical creation content corresponding to the feature information B can be directly obtained and sent to the terminal device D and the terminal device E for display. At this time, the redundant group creation information, i.e., the feature information corresponding to the current created content corresponding to the feature information A, is deleted.

[0263] It can be understood that when the number of devices in the first group of terminal devices is less than the number of devices in the second group of terminal devices, when the user 001 performs the "hand waving" action in front of the second group of terminal devices, the second base station edge detection unit can send the creation content of each terminal device in the first group of terminal devices to the corresponding device in the second group of terminal devices. The excess devices in the second group of terminal devices will obtain the creation content in the form of generating a new processing task.

[0264] For example, as shown in Figure 8 , the first group of terminal devices includes two terminal devices, namely terminal device A and terminal device B. The second group of terminal devices includes three terminal devices, namely terminal device C, terminal device D, and terminal device E.

[0265] Wherein, the creation process of the user 001 in front of the first group of terminal devices can be as described in the foregoing Figure 5 , which will not be described here. After the user 001 finishes creating in front of the first group of terminal devices, the feature information corresponding to the current created content of the first group of terminal devices saved in the cloud server is respectively the feature information corresponding to the created content of the terminal device A (including the text corresponding to the "hand waving" action, such as "hand waving", the time when the "hand waving" action occurs, the user 001 identification information, the terminal device A identification information, the group identification information of the first group of terminal devices, the identification information of the creation space A, and the specification of the creation space A); the feature information corresponding to the created content of the terminal device B (including the text corresponding to the "hand waving" action, such as "hand waving", the time when the "hand waving" action occurs, the user 001 identification information, the terminal device B identification information, the group identification information of the first group of terminal devices, the identification information of the creation space, the specification of the creation space, and the identification information of the creation space processing task B).

[0266] When the user 001 makes creation in front of the second group of terminal devices, when the user 001 comes in front of the terminal device C and wants to continue the creation of the above-mentioned creation content. The terminal device C will first collect the identity feature data of the user 001, for example, the face image, and send the identity feature data to the second edge computing device 200B connected with the terminal device C; and the terminal device C will send the collected operation data of the user 001 to the second edge computing device 200B, at the same time, the terminal device C will also send the identification information of the terminal device D and the group identification information of the second group of terminal devices to the second edge computing device 200B.

[0267] When the second edge computing device 200B detects that the user 001 performs the "hand out" action in front of the terminal device C, and determines that there is historical creation data of the user 001 in the cloud server according to the face image of the user 001, the historical creation content is obtained and sent to the second group of terminal devices for display. Among them, the terminal device C and the terminal device D will respectively obtain the creation content corresponding to the feature information A and the feature information B corresponding to the current created content corresponding to the feature information, and the second edge computing device 200A will generate a new processing task and send the current created content corresponding to the feature information A or the feature information B to the terminal device E.

[0268] It can be understood that in some embodiments, the edge computing device will stop rendering and issuing the creation content when detecting the operation data corresponding to the end of the user's creation. In addition, the creation space in which the current creation content of the user is located is cached in the edge computing unit in an open state. After a preset time, the creation space is closed and the current created content and the feature information corresponding to the current created content are sent to the cloud server. In this way, if the user comes to another terminal device for creation within a short time, the creation space can be directly obtained from the edge computing unit. Without obtaining the creation space or the historical creation content from the cloud server, the time for the user to obtain the creation space is greatly shortened. The rapid switching of the user's creation in multiple terminal devices is realized.

[0269] For example, Figure 9 A schematic diagram of a scenario in which the user 001 first creates in the terminal device A within the signal coverage range of the first edge computing device 200A and secondly continues to create in the terminal device B within the signal coverage range of the first edge computing device 200A is shown.

[0270] As shown in Figure 9 The user 001 interacts with the first terminal device 100A to make the first creation, wherein the whole process of the user 001 first creating in the terminal device A is similar to the description of the user 001 first creating in front of the first terminal device 100A in Figure 2 the first terminal device 100A, which will not be repeated here.

[0271] When the user 001 performs the "hand waving" action in front of the terminal device A, the first edge computing device 200A detects the "hand waving" action, and then caches the creation space in which the current created content is located in an open state in the edge computing unit. The creation space is closed after a preset time, for example, 30 minutes, and the current created content and the feature information corresponding to the current created content are sent to the cloud server.

[0272] When the user 001 comes to the terminal device B after 15 minutes and wants to continue the creation of the above created content, the terminal device B will first collect the identity feature data of the user 001, for example, a face image, and send the identity feature data to the first edge computing device 200A connected with the terminal device B; and the terminal device B will send the collected operation data of the user 001 to the first edge computing device 200A.

[0273] When the user 001 performs the "hand waving" action in front of the terminal device B, the edge computing device detects the "hand waving" action, and determines that the first edge computing device 200A has cached the historical created content of the user 001 according to the face image of the user 001, and then directly sends the historical created content to the terminal device B for display. The terminal device B can collect the current creation data of the user 001 and upload the current creation data to the first edge computing device 200A by referring to the method shown in Figure 3

[0274] In summary, in the XR content creation method provided in the embodiments of the present application, when the user continues to create the XR content on another device, the user can directly obtain the historical created content through action and identity recognition, and can directly store the current created content by performing a preset action to end the creation, which is more fast and simple, and improves the user experience.

[0275] In addition, in the XR content creation method provided in the embodiments of the present application, the edge computing device attached to the terminal device is used to process the data, such as the identity feature data and operation data of the user 001 and the current creation data, and only the data storage and other data processing are performed in the cloud server. Compared with the scheme in which all data related to the creation are directly sent to the cloud server in some embodiments, the data transmission link can be effectively shortened, the data transmission speed of the XR content can be improved, the data processing amount of the edge computing device can be effectively reduced, and the data processing speed of the XR content can be accelerated.

[0276] ​In addition, the edge computing unit will stop rendering and issuing the creation content when detecting the end creation operation data of the user. In addition, the creation space where the user currently creates the content is cached in the edge computing unit in an open state. After a preset time, the creation space is closed, and the current created content and the feature information corresponding to the current created content are sent to the cloud server. In this way, if the user 001 creates in another terminal device within a short time, the creation space can be directly obtained from the edge computing unit. Without obtaining the creation space or the historical creation content from the cloud server, the time for the user to obtain the creation space is greatly shortened, and the quick switching of the user in multiple terminals is realized.

[0277] An electronic device is provided, including a memory configured to store instructions for execution by one or more processors of the electronic device, and a processor that is one of the one or more processors of the electronic device and is configured to execute the XR content creation method.

[0278] A computer-readable storage medium is provided, and the computer-readable storage medium stores instructions. When the instructions are executed on an electronic device, the electronic device executes the XR content creation method.

[0279] A computer program product is provided, and the computer program product includes instructions. When the computer program product is executed on a computer, the computer executes the XR content creation method.

[0280] Embodiments disclosed in the present application can be implemented in hardware, software, firmware, or a combination thereof. Embodiments of the present application can be implemented as computer programs or program codes executed on programmable systems, including at least one processor, a storage system (including volatile and non-volatile memory and / or storage elements), at least one input device, and at least one output device.

[0281] Program code can be applied to input instructions to perform the functions described in the present application and generate output information. The output information can be applied to one or more output devices in a known manner. For the purposes of the present application, a processing system includes any system that has a processor, such as, for example, a digital signal processor (DSP), a microcontroller, an application specific integrated circuit (ASIC), or a microprocessor.

[0282] Program code can be implemented in a high-level programming language or an object-oriented programming language to communicate with a processing system. When necessary, program code can also be implemented in assembly language or machine language. In fact, the mechanisms described in the present application are not limited to the scope of any particular programming language. In any case, the language can be a compiled language or an interpreted language.

[0283] In some cases, the disclosed embodiments can be implemented in hardware, firmware, software, or any combination thereof. The disclosed embodiments can also be implemented as instructions carried by or stored on a transitory or non-transitory machine-readable (e.g., computer-readable) medium, which can be read and executed by one or more processors. For example, the instructions can be distributed over the network or by other computer readable media. Thus, a machine-readable medium can include any mechanism for storing or transmitting information in a form readable by a machine (e.g., a computer), including without limitation, floppy diskettes, optical disks, optical fiber, ROMs, RAMs, EPROMs, EEPROMs, magnetic or optical cards, flash memory, or tangible or other machine-readable media. Accordingly, a machine-readable medium includes any type of media mechanism that is suitable for storing or transmitting electronic instructions or information in a form readable by a machine (e.g., a computer).

[0284] In the drawings, some of the structural or methodological features can be shown in particular arrangements and / or orders. However, it should be understood that such particular arrangements and / or orders can not be required. Instead, in some embodiments, the features can be arranged differently than shown in the figures. Also, inclusion of a structural or methodological feature in a particular figure does not imply that the feature is required in all embodiments, and in some embodiments, the feature can not be included or can be combined with other features.

[0285] It should be noted that each unit / module mentioned in the embodiments of the present application is a logical unit / module, in physical, one logical unit / module can be one physical unit / module, or a part of a physical unit / module, or be realized in a combination of multiple physical unit / modules, and the physical realization of the logical unit / module itself is not the most important, the combination of the functions realized by the logical unit / module is the key to solve the technical problems proposed in the present application. In addition, in order to highlight the innovative part of the present application, the above-mentioned each device embodiment of the present application does not introduce the unit / module which is not closely related to solving the technical problems proposed in the present application, which does not mean that the above-mentioned device embodiment does not have other units / modules.

[0286] It should be noted that in the examples and description of this patent, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one" does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0287] Although this application has been illustrated and described with reference to certain preferred embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made thereto without departing from the scope of this application.

Claims

1. An XR content authoring method, characterized by, The method is applied to an XR content creation system, the XR content creation system comprising a first terminal device, a second terminal device, an edge computing device and a server; and The method comprises: The first terminal device acquires first identity feature data and first creation data of a user, and sends the first identity feature data and the first creation data of the user to the edge computing device; The edge computing device generates first creation content according to the first creation data, and sends the first creation content and the first identity feature data to the server; The server stores the first creation content and the first identity feature data; The second terminal device acquires second identity feature data of a user, and generates operation data according to the operation of the user on the second terminal device; The edge computing device acquires the first creation content from the server and sends the first creation content to the second terminal device in a case where it is detected that the second identity feature data of the user sent by the second terminal device matches the first identity feature data, and the operation data sent by the second terminal device satisfies a first preset condition; The second terminal device displays the first creation content.

2. The XR content authoring method of claim 1, wherein, The first preset condition is that the operation data matches preset operation data for starting creation.

3. The XR content authoring method of claim 1 or 2, wherein, Further comprising: The edge computing device creates a creation space corresponding to the second identity feature data and sends the creation space to the second terminal device in a case where it is detected that neither the second identity feature data of the user sent by the second terminal device nor the identity feature data stored in the server matches, and the operation data sent by the second terminal device satisfies the first preset condition.

4. The XR content authoring method of claim 1, wherein, Further comprising: The second terminal device acquires second creation data of a user while displaying the first creation content, and sends the second creation data to the edge computing device; The edge computing device generates second creation content according to the second creation data, combines the first creation content and the second creation content to generate third creation content, and sends the third creation content to the second terminal device; The second terminal device displays the third creation content.

5. The XR content authoring method of claim 4, wherein, Further comprising: The edge computing device sends the third creation content and feature information corresponding to the third creation content to the server in a case where it is detected that the operation data of the user sent by the second terminal device satisfies a second preset condition; The server stores the third creation content and the feature information corresponding to the third creation content.

6. The XR content authoring method of claim 4, wherein, Further comprising: The edge computing device caches the third creation content and the feature information corresponding to the third creation content in the edge computing device in a case where it is detected that the operation data of the user sent by the second terminal device satisfies a second preset condition, and sends the third creation content and the feature information corresponding to the third creation content to the server after a preset time.

7. The XR content authoring method of claim 5 or 6, wherein, The second preset condition is that the operation data matches preset operation data for ending creation.

8. The XR content authoring method of claim 5 or 6, wherein, The feature information corresponding to the third creative content includes an end creation time, identification information of a creation space where the third creative content is located, first identity feature data of the user, identification information corresponding to the second terminal device, and specification information of the creation space where the third creative content is located.

9. The XR content authoring method of claim 8, wherein, The first terminal device is in the form of a single terminal device or one sub-terminal device of a group terminal device. The second terminal device is in the form of a single terminal device or one sub-terminal device of a group terminal device. The group terminal device includes a plurality of sub-terminal devices, and the plurality of sub-terminal devices have the same group device identification.

10. The XR content authoring method of claim 9, wherein, When the second terminal device is in the form of a single terminal device, the identification information corresponding to the second terminal device includes identification information of the second terminal device. When the second terminal device is in the form of one sub-terminal device of a group terminal device, the identification information corresponding to the second terminal device includes identification information of the second terminal device and identification information of the group terminal device where the second terminal device is located.

11. The XR content authoring method of claim 10, wherein, Further comprising: When the edge computing device detects for the first time that the second identity feature data of the user sent by the second terminal device matches the first identity feature data, and the operation data of the user sent by the second terminal device meets a first preset condition, the edge computing device acquires, from the server, creative content corresponding to the first identity feature data, and determines, from the creative content corresponding to the first identity feature data, creative content with the latest end creation time; The creative content with the latest end creation time is sent to the second terminal device.

12. The XR content authoring method of claim 11, wherein, Further comprising: When the edge computing device detects for the second time that the second identity feature data of the user sent by the second terminal device matches the first identity feature data, and the operation data of the user sent by the second terminal device meets a first preset condition, the edge computing device acquires, from the server, creative content corresponding to the first identity feature data, and determines, from the creative content corresponding to the first identity feature data, creative content with the second latest end creation time; The creative content with the second latest end creation time is sent to the second terminal device.

13. The XR content authoring method of claim 1, wherein, Comprising: The first terminal device and the second terminal device perform transmission of communication data with the edge computing device through a 5G network; The edge computing device is configured to forward communication data of the first terminal device and the second terminal device to the server.

14. The XR content authoring method of any one of claims 1-2 and 4-6, wherein, The edge computing device is a base station device.

15. An XR content authoring system, comprising: Comprising: A first terminal device, a second terminal device, an edge computing device, and a server; The first terminal device is configured to acquire first identity feature data and first creation data of a user, and send the first identity feature data and the first creation data of the user to the edge computing device; The second terminal device is configured to acquire second identity feature data of a user, generate operation data according to operations of the user on the second terminal device, and display creative content generated by the edge computing device; The edge computing device is configured to: generating first creation content according to the first creation data, and sending the first creation content and the first identity feature data to the server, and in a case where the second identity feature data of the user sent by the second terminal device is detected to match the first identity feature data, and operation data of the user sent by the second terminal device meets a first preset condition, obtaining the first creation content from the server, and sending the first creation content to the second terminal device; the server is configured to store the first creation content and the first identity feature data.

16. An edge computing device, comprising: comprising: an operation and identity recognition module configured to obtain first identity feature data of a user and first creation data sent by a first terminal device; and configured to obtain second identity feature data of the user sent by a second terminal device, and generate operation data according to operation of the user on the second terminal device; and configured to send, to an edge computing module, an identity recognition result that the second identity feature data matches the first identity feature data, and an operation recognition result that the operation data meets a first preset condition, and the first creation data; the edge computing module is configured to obtain the first creation data sent by the terminal device, generate first creation content according to the first creation data, and send the first creation content and the first identity feature data to a server, and in a case where the identity recognition result that the second identity feature data matches the first identity feature data, and the operation recognition result that the operation data meets a first preset condition are obtained, obtain the first creation content from the server, and send the first creation content to the second terminal device.

17. A server, characterized by comprising: an XR content creation management module configured to store a correspondence between user identity feature data and user creation content, the user identity feature data comprising first identity feature data, and the user creation content comprising first creation content, the first creation content being generated by an edge computing device according to first creation data, the first identity feature data and the first creation data being sent by a first terminal device to the edge computing device; an XR content management module configured to store user creation content, and when receiving a distribution request of the edge computing device, obtain corresponding user creation content according to user identity feature data carried in the distribution request, and send the corresponding user creation content to the edge computing device; wherein the operation of receiving the distribution request of the edge computing device, obtaining the corresponding user creation content according to the user identity feature data carried in the distribution request, and sending the corresponding user creation content to the edge computing device comprises: In a case where the edge computing device detects that the second identity feature data of the user sent by the second terminal device matches the first identity feature data, and operation data sent by the second terminal device meets a first preset condition, the first creative content is sent to the edge computing device, wherein the operation data is obtained by the second terminal device from the second identity feature data of the user, and is generated according to the operation of the user on the second terminal device, and the first creative content is used for the second terminal device to display the first creative content.

18. An electronic device, comprising: Comprising: a memory for storing instructions executed by one or more processors of an electronic device, and a processor which is one of the one or more processors of the electronic device, for executing the XR content creation method of any one of claims 1-14.

19. A computer-readable storage medium, characterized in that, The computer readable storage medium has instructions stored thereon, which, when executed on an electronic device, cause the electronic device to perform the XR content creation method of any one of claims 1-14.

20. A computer program product, characterised in that, Comprising instructions that, when the computer program product is run on a computer, cause the computer to perform the XR content creation method of any one of claims 1-14.

Citation Information

Patent Citations

  • Image identification cooperative computation method and system based on neural network

    CN108255605A

  • Techniques for real-time object creation in extended reality environments

    US20220027956A1