Content sharing method and system, and related apparatus
Patent Information
- Application Number
- PCT/CN2026/077151
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-02-21
- Filing Date
- 2026-02-05
- Publication Date
- 2026-08-27
Smart Images

Figure CN2026077151_27082026_PF_FP_ABST
Abstract
Description
A content sharing method, system and related apparatus
[0001] This application claims priority to Chinese Patent Application No. 202510200611.9, filed on February 21, 2025, entitled "A Content Sharing Method, System and Related Device", the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of communication technology, and in particular to a content sharing method, system and related apparatus. Background Technology
[0003] With the development of network communication technology and the enrichment of terminal device functions, users can share content with other users through terminal devices. Currently, common shared content includes images, audio, and video, but this type of content is basically in the two-dimensional (2D) realm. In some scenarios, users often need to share more complex, higher-dimensional content to enhance user perception or engagement, such as in Augmented Reality (AR) and Extended Reality (XR) scenarios. For complex content, the sharing process and its presentation on the terminal device usually require high computing power, and prolonged operation under high computing power will lead to significant power consumption. Summary of the Invention
[0004] This application provides a content sharing method, system, and related apparatus, which helps to reduce the power consumption of terminal devices in content sharing scenarios.
[0005] Firstly, embodiments of this application provide a content sharing method applied to a first network element. Unless otherwise specified, the first network element in this application can refer to the first network element itself (e.g., a unified media plane network element) or a module within the first network element. For example, the module can be a processing module within the first network element, or a circuit or chip within the first network element responsible for processing and communication functions, such as a modem chip (also known as a baseband chip), or a system-on-a-chip (SoC) chip containing a modem core, or a system-in-package (SIP) chip. Alternatively, it can be a logic module or software capable of implementing all or part of the functions of the first network element. For ease of description, the first network element is used as an example below. The method includes:
[0006] When the first network element detects a sharing gesture from a user on the first terminal device, it can determine the target content to be shared by the user based on the gesture. Once the target content is determined, the first network element can further determine the identification information of the target content and then send this identification information so that the third network element can retrieve the target content based on it.
[0007] As can be seen, in this embodiment, the identification information of the target content shared by the user on the first terminal device side is transmitted through the network side, so that the network element of the sharing recipient can obtain and present the target content based on the identification information of the target content, instead of transmitting the shared content through the first and second terminal devices. This helps to reduce the transmission consumption of the terminal devices. Furthermore, by placing the gesture detection operations on the network side at both ends, the power consumption of the terminal devices can be further reduced. At the same time, the computing power requirement of the terminal devices is reduced, making it applicable to both high-computing-power terminal devices and low-computing-power lightweight terminal devices.
[0008] In one possible implementation, the first network element can send a first message to the second network element. The first message includes information about the detected sharing gesture and identification information of the target content. The information about the sharing gesture is used by the second network element to send a first request to the third network element. The first request includes identification information of the target content and is used to request the third network element to obtain the target content based on the identification information of the target content.
[0009] In this implementation, the first network element can trigger the second network element to send a first request to the third network element through the information of the shared gesture in the first message, and carry the identification information of the target content in the first request, so that the third network element can obtain the target content based on the identification information.
[0010] In one possible implementation, the first network element can determine the first target content and / or the second target content shared by the user on the first terminal device side based on the user's sharing gesture. The first target content is virtual content provided by the resource server, which can be virtual 2D content or a virtual 3D (3D) model. The second target content is a first 3D model of a physical object in the physical environment where the user on the first terminal device side is located, generated by the first network element. Once the physical object is determined, the first network element can generate the first 3D model of the physical object. In other words, the target content shared by the user on the first terminal device side includes the first target content and / or the second target content.
[0011] In this implementation, based on the user's sharing gesture on the first terminal device side, the first network element can determine the first target content and / or physical object selected by the user. Once the physical object is determined, the first network element can perform 3D reconstruction to generate a corresponding 3D model (i.e., the first 3D model). The first target content can be 2D or 3D content. From the perspective of content complexity, terminal devices can share both 2D and 3D content, exhibiting diverse characteristics. Simultaneously, 3D content allows users to preview from multiple angles through certain operations, enhancing the user's interactive experience. Regarding the source of the shared content, terminal devices can share pre-set virtual content and / or reconstructed information of the physical world, expanding the scope of shared content. Pre-set virtual content and / or reconstructed information of the physical world can be superimposed onto the recipient user's real environment, improving the recipient user's perception of the shared content.
[0012] In one possible implementation, if the user on the first terminal device side only shares the first target content, before detecting the user's sharing gesture on the first terminal device side, the first network element will also receive a second request from the resource server. The second request includes at least one second 3D model (the at least one second 3D model includes the first target content), and the second request is used to request the first network element to render the at least one second 3D model. The first network element performs rendering of the at least one second 3D model based on the second request, obtaining at least one rendered image corresponding one-to-one with the at least one second 3D model. The first network element sends the at least one rendered image to the first terminal device to present the at least one rendered image through the first terminal device. Based on the sharing gesture, the first network element can determine that the user on the first terminal device side has selected a target rendered image from the at least one rendered image, and determines the second 3D model corresponding to the target rendered image as the first target content.
[0013] In this implementation, the first network element can present at least one rendered image corresponding to at least one second 3D model through the first terminal device, and determine the target rendered image selected by the user based on the user's sharing gesture on the first terminal device side. The second 3D model corresponding to the target rendered image is then used as the first target content shared by the user on the first terminal device side, thereby enabling the sharing of virtual 3D content. Furthermore, performing the rendering operation of at least one second 3D model on the network side helps reduce the power consumption of the first terminal device and lowers the computational requirements for rendering complex content on the terminal device.
[0014] In one possible implementation, when a user on the first terminal device side selects to share a first target content and a first 3D model (and a second target content), before detecting the user's sharing gesture on the first terminal device side, the first network element also receives a second request from a resource server. The second request includes at least one second 3D model and requests the first network element to render the at least one second 3D model. Based on the second request, the first network element performs rendering on the at least one second 3D model, obtaining at least one rendered image corresponding to each of the at least one second 3D model. The first network element sends the at least one rendered image to the first terminal device to present the at least one rendered image. When the first terminal device presents the at least one rendered image, the first network element, in response to the user's operation on the first terminal device side regarding a target rendered image in the at least one rendered image, overlays the target rendered image with a physical object. Based on the sharing gesture, the first network element can determine that the user on the first terminal device side is sharing the overlaid target rendered image and physical object, identifying the second 3D model corresponding to the target rendered image as the first target content, and the first 3D model of the physical object as the second target content.
[0015] In this implementation, the first network element can present at least one rendered second 3D model (i.e., at least one rendered image) through the first terminal device. Based on user actions on the target rendered image within the at least one rendered image, the first network element can overlay the target rendered image onto a physical object. Upon detecting a sharing gesture, the first network element determines the overlay content of the target rendered image and the physical object as the content shared by the user on the first terminal device. Ultimately, the second 3D model corresponding to the target rendered image and the first 3D model corresponding to the physical object are determined as the target content shared by the user. This achieves the sharing of the overlay content (or merged content) of virtual content (i.e., the first target content) and the physical object, expanding the scope of shared content and improving the content presentation effect.
[0016] In one possible implementation, the first network element overlays the target rendered image with the physical object and generates positional information of the first target content relative to the second target content. The first message also includes positional information of the first target content relative to the second target content. The positional information of the first target content relative to the second target content is used by the third network element to render the first target content and the second target content based on the positional information.
[0017] In this implementation, the first network element can transmit the position information of the first target content relative to the second target content to the second network element on the second terminal device side, and then transmit it to the third network element through the second network element, so that the third network element can render the first target content and the second target content based on the position information, and finally present the superimposed content of the first target content and the second target content rendered through the second terminal device.
[0018] In one possible implementation, the second request may also include identification information for at least one second 3D model.
[0019] In this implementation, the second request received by the first network element also includes identification information of at least one second 3D model. If the content selected by the user on the first terminal device side to share includes at least one target second 3D model (i.e., the first target content), the identification information of the target second 3D model can be carried in the first message so that the network element on the second terminal device side can obtain the target second 3D model based on the identification information.
[0020] In one possible implementation, when the target content includes a second target content (i.e., a first 3D model), the first network element generates identification information of the first 3D model, i.e., identification information of the second target content, when generating the first 3D model.
[0021] In this implementation, when the first network element generates the first 3D model, it also generates identification information of the first 3D model, so that the network element on the second terminal device side can perform the acquisition and rendering operation of the second target content based on the identification information.
[0022] In one possible implementation, the first network element also receives a third request from the fourth network element. The third request includes first indication information, which indicates one or more first gestures. The third request requests the first network element to enable the recognition function of the one or more first gestures and subscribe to notifications of recognized first gestures, including sharing gestures. The first network element enables the recognition function of the one or more first gestures based on the first indication information.
[0023] The third request is sent by the fourth network element when it receives a gesture activation message from the first terminal device or resource server. The gesture activation message includes first indication information and is used to trigger the fourth network element to send the third request.
[0024] In this implementation, when the fourth network element receives a gesture activation message from the first terminal device or resource server, it can send a third request to the first network element to request the first network element to activate the recognition function of one or more first gestures based on the first indication information carried in the third request and subscribe to the notification of recognition of one or more first gestures. This facilitates the first network element to perform the detection and recognition of one or more first gestures. When a sharing gesture is recognized, the first network element notifies the fourth network element, which then transmits the sharing gesture information to the network element on the second terminal device side to notify the network element on the second terminal device side that there is shared content from the first terminal device side.
[0025] In one possible implementation, when the first network element has enabled the recognition function of one or more first gestures, it sends a second message to the fourth network element, causing the fourth network element to send a fourth request to the second network element. The second message indicates that the recognition function of one or more first gestures has been successfully enabled, and the fourth request includes second indication information indicating one or more second gestures. The fourth request requests the second network element to enable the recognition function of one or more second gestures. The one or more second gestures include a receiving gesture.
[0026] In this implementation, the first network element can notify the fourth network element through a second message that the recognition function of one or more first gestures has been successfully enabled, so that the fourth network element can request the second network element to enable the recognition function of one or more second gestures. This facilitates the third network element to enable the recognition function of one or more second gestures based on the sixth request of the second network element, and when the receiving gesture is recognized, the shared content is presented through the second terminal device.
[0027] Secondly, embodiments of this application provide a content sharing method applied to a third network element. Unless otherwise specified, the third network element in this application can refer to the third network element itself or a module within the third network element. For example, the module can be a processing module within the third network element, or a circuit or chip within the third network element responsible for processing and communication functions, such as a modem chip (also known as a baseband chip), or a SoC chip or SIP chip containing a modem core. Alternatively, it can be a logic module or software capable of implementing all or part of the functions of the third network element. For ease of description, the following uses a third network element as an example. The method includes:
[0028] The third network element receives the identification information of the target content. This identification information is sent by the first network element after detecting a sharing gesture from a user on the first terminal device and determining the target content to be shared based on the gesture. The third network element can obtain the target content based on the identification information and, upon detecting a receiving gesture from a user on the second terminal device, responds to the gesture by presenting the target content through the second terminal device.
[0029] As can be seen, in this embodiment, the identification information of the target content shared by the user on the first terminal device side is transmitted through the network side, so that the network element of the sharing recipient can obtain and present the target content based on the identification information of the target content, instead of transmitting the shared content through the first and second terminal devices. This helps to reduce the transmission consumption of the terminal devices. Furthermore, by placing the gesture detection operations on the network side at both ends, the power consumption of the terminal devices can be further reduced. At the same time, the computing power requirement of the terminal devices is reduced, making it applicable to both high-computing-power terminal devices and low-computing-power lightweight terminal devices.
[0030] In one possible implementation, the third network element can receive a first request from the second network element. The first request includes identification information of the target content. The first request is sent by the second network element based on the information of the sharing gesture. The information of the sharing gesture and the identification information of the target content are carried in a first message sent by the first network element to the second network element. The first message is sent by the first network element when it detects the sharing gesture and determines the target content based on the sharing gesture.
[0031] In this implementation, the first network element can trigger the second network element to send a first request to the third network element through the information of the shared gesture in the first message, and carry the identification information of the target content in the first request, so that the third network element can obtain the target content based on the identification information.
[0032] In one possible implementation, the target content shared by the user on the first terminal device side includes first target content and / or second target content. The first target content is virtual content provided by the resource server, which can be 2D content or a virtual 3D model. The second target content is a first 3D model of a physical object in the physical environment where the user on the first terminal device side is located, generated by the first network element. That is, the identification information of the target content includes the identification information of the first target content and / or the identification information of the second target content. The third network element can obtain the first target content from the resource server based on the identification information of the first target content, and / or the third network element can obtain the second target content from the first network element based on the identification information of the second target content.
[0033] In this implementation, when the identification information in the first request includes the identification information of the first target content and / or the identification information of the second target content, the third network element can obtain the first target content from the resource server based on the identification information of the first target content, and / or can obtain the second target content from the first network element based on the identification information of the second target content. This eliminates the need for the network element on the first terminal device side to directly transmit the shared first and / or second target content to the network element on the second terminal device side. By simply including the identification information of the first and / or second target content in the first request, the third network element can obtain the first and / or second target content from the content source based on this identification information. This helps reduce bandwidth consumption and transmission latency between the network elements on the first and second terminal devices. In addition, the third network element obtains the corresponding content from the content source of the first target content and / or the content source of the second target content based on the identification information of the first target content and / or the identification information of the second target content, respectively. Each content source can independently process its own content request, avoiding the data pressure on a single point server or network element caused by centralized processing of content requests. The distributed content acquisition method enables a single point server or network element to respond to its own received requests more quickly, which is conducive to improving the efficiency of the third network element in obtaining the first target content and / or the second target content.
[0034] In one possible implementation, upon detecting a user's receiving gesture on the second terminal device side, the third network element sends a third message to the second network element. This third message notifies the second network element that the receiving gesture has been recognized. Upon receiving the third message, the second network element sends a fifth request to the third network element. This fifth request includes identification information for the first target content and / or the second target content, and is used to request rendering of the first and / or second target content. The third network element then performs rendering of the first and / or second target content based on the fifth request.
[0035] In this implementation, when the third network element detects a receiving gesture from the user on the second terminal device, it can send a notification of successful gesture recognition (i.e., a third message) to the second network element. This allows the second network element to send a rendering request to the third network element. The third network element then renders the first target content and / or the second target content based on the rendering request. Finally, the rendered first target content and / or the second target content is presented through the second terminal device, thereby enabling the sharing of virtual 3D models and / or 3D models of real objects. Furthermore, placing the rendering operation of the first target content and / or the second target content on the network side helps reduce the power consumption of the second terminal device and lowers the computational requirements for rendering complex content on the terminal device.
[0036] In one possible implementation, if the target content shared by the user on the first terminal device side includes both first target content and second target content, the fifth request also includes positional information of the first target content relative to the second target content, which is carried in the first message. The third network element renders the first target content and the second target content based on the positional information of the first target content relative to the second target content.
[0037] In this implementation, the first network element can transmit the position information of the first target content relative to the second target content to the second network element on the second terminal device side. When the second network element receives the notification of successful gesture recognition, it can send the position information to the third network element through the fifth request, so that the third network element can render the first target content and the second target content based on the position information, and finally present the superimposed content of the first target content and the second target content rendered by the second terminal device.
[0038] In one possible implementation, the position information of the first target content relative to the second target content is generated by the first network element overlaying the target rendered image with the physical object in response to the user's operation on the target rendered image on the first terminal device side. The target rendered image is the image of the first target content rendered by the first network element and sent to the first terminal device for presentation.
[0039] In this implementation, when the first network element overlays the target rendered image with the physical object, it also obtains the corresponding position information. This position information is the position information of the first target content relative to the second target content. Based on this position information, the third network element on the second terminal device side can render the first target content and the second target content and present the rendered overlay image.
[0040] In one possible implementation, when the third network element obtains the target content shared by the user on the first terminal device side, it sends a fourth message to the second terminal device. The fourth message is used to notify the user on the second terminal device side that there is shared content from the first terminal device, so as to prompt the user on the second terminal device side to perform a receiving gesture.
[0041] In this implementation, when the third network element obtains the target content based on the identification information of the target content, it can output a fourth message through the second terminal device to notify the user on the second terminal device side that there is shared content from the user on the first terminal device side. This allows the user on the second terminal device side to perform a receiving gesture when they need to view the shared content, thereby improving the interaction between the device and the user.
[0042] In one possible implementation, the third network element further receives a sixth request from the second network element. The sixth request includes second indication information, which indicates one or more second gestures. The sixth request requests the third network element to enable the recognition function of one or more second gestures and subscribe to notifications of recognized one or more second gestures, where the one or more second gestures include a receiving gesture. The second indication information is carried in a fourth request sent by the fourth network element to the second network element, which requests the second network element to enable the recognition function of the one or more second gestures. The third network element enables the recognition function of the one or more second gestures based on the second indication information.
[0043] In this implementation, when the second network element receives the fourth request from the fourth network element, it can request the third network element to enable one or more second gesture recognition functions based on the second instruction information through the sixth request. When the third network element enables one or more second gesture recognition functions, it can recognize the receiving gesture based on the media stream on the second terminal device side, and when the receiving gesture is recognized, it can present the shared content through the second terminal device.
[0044] Thirdly, embodiments of this application provide a content sharing method applied to a first terminal device. Unless otherwise specified, the first terminal device in this application can refer to the first terminal device itself or a module within the first terminal device. For example, the module can be a processing module within the first terminal device, or a circuit or chip within the first terminal device responsible for processing and communication functions, such as a modem chip (also known as a baseband chip), or a SoC chip or SIP chip containing a modem core. Alternatively, it can be a logic module or software capable of implementing all or part of the functions of the first terminal device. For ease of description, the following uses a first terminal device as an example. The method includes:
[0045] The first terminal device sends a gesture activation message to the fourth network element. The gesture activation message includes first indication information, which is used to indicate one or more first gestures. The gesture activation message is used by the fourth network element to send a third request to the first network element. The third request includes the second indication information and is used to request the first network element to enable the recognition function of one or more first gestures and subscribe to the notification of the recognition of one or more first gestures. One or more first gestures include a sharing gesture.
[0046] Receive a message from the fourth network element indicating that the gesture recognition function has been successfully enabled.
[0047] As can be seen, in this embodiment of the application, the first terminal device can trigger the fourth network element to send a third request to the first network element through a control message (i.e. a gesture activation message) to request the first network element to enable the recognition function of one or more first gestures based on the first indication information. This allows the first network element to determine the content selected for sharing by the user on the first terminal device side when it recognizes the sharing gesture, and send a gesture recognition success notification to the fourth network element. This enables the fourth network element to notify the network element on the second terminal device side that there is shared content from the first terminal device side.
[0048] In one possible implementation, the first terminal device also receives and presents a first media stream from a first network element. The first media stream includes at least one rendered image, which is obtained by the first network element rendering at least one second 3D model provided by a resource server. The at least one rendered image corresponds to at least one second 3D model.
[0049] In this implementation, the first terminal device can present a rendered image of at least one second 3D model to the user through the first streaming media, thereby facilitating the user to perform a sharing gesture to select the virtual content to be shared.
[0050] In one possible implementation, the first terminal device also sends a second media stream to the first network element. The second media stream includes at least one rendered image, at least one physical object in the physical environment where the user on the first terminal device side is located, and the gesture of the user on the first terminal device side.
[0051] In this implementation, after presenting the first media stream, the first terminal device also transmits a real-time second media stream to the first network element so that the first network element can recognize the gesture in the second media stream and, if the gesture is a sharing gesture, determine the target rendered image selected by the user on the first terminal device side from at least one rendered image, and / or the second target content selected from at least one physical object.
[0052] In one possible implementation, the first terminal device further receives and presents a third media stream from the first network element. The third media stream includes at least one target rendered image highlighted in a rendered image and / or at least one physical object highlighted in a physical object. The target rendered image and / or the physical object are determined by the first network element based on a gesture of the user on the first terminal device side, where the gesture of the user on the first terminal device side is a sharing gesture.
[0053] In this implementation, the first terminal device can present the highlighted target rendered image and / or the highlighted physical object through a third media stream to enhance the user's perception of the selected target rendered image and / or the physical object.
[0054] Fourthly, embodiments of this application provide a content sharing system, which includes a first network element and a third network element; wherein:
[0055] The first network element detects the user's sharing gesture on the first terminal device side; determines the target content to be shared by the user on the first terminal device side based on the sharing gesture; and sends the identification information of the target content.
[0056] The third network element receives the identification information of the target content; obtains the target content based on the identification information of the target content; and, in response to detecting the receiving gesture of the user on the second terminal device, presents the target content through the second terminal device.
[0057] Fifthly, embodiments of this application provide a content sharing system, which includes a first network element and a third network element; wherein the first network element is used to execute the method described in any of the embodiments of the first aspect above; and the third network element is used to execute the method described in any of the embodiments of the second aspect above.
[0058] It is understood that the specific implementations and beneficial effects of the embodiments described in the fourth and fifth aspects can be referred to the specific implementations and beneficial effects of the methods described in the first and second aspects, and will not be repeated here.
[0059] Sixthly, embodiments of this application provide a content sharing apparatus, which includes units for performing the method described in the first aspect, such as a first transceiver unit and a first processing unit; wherein:
[0060] The first processing unit is configured to detect the sharing gesture of a user on the first terminal device side; and determine the target content to be shared by the user on the first terminal device side based on the sharing gesture.
[0061] The first transceiver unit is used to send the identification information of the target content; the identification information of the target content is used to obtain the target content shared by the first terminal device.
[0062] It should be understood that since the method embodiments and the device embodiments are different presentations of the same technical concept, the content of the first aspect of the embodiments of this application should be adapted to the sixth aspect of the embodiments of this application simultaneously, and can achieve the same or similar beneficial effects, which will not be repeated here.
[0063] In a seventh aspect, embodiments of this application provide a content sharing apparatus, which includes units for performing the method described in the second aspect above, such as a second transceiver unit and a second processing unit; wherein:
[0064] The second transceiver unit is used to receive the identification information of the target content. The identification information of the target content is sent by the first network element when it detects the sharing gesture of the user on the first terminal device side and determines the target content shared by the user on the first terminal device side based on the sharing gesture.
[0065] The second processing unit is used to obtain target content based on the identification information of the target content; and to present the target content through the second terminal device in response to the detection of a receiving gesture by the user on the second terminal device side.
[0066] It should be understood that since the method embodiments and the device embodiments are different presentations of the same technical concept, the content of the second aspect of the embodiments of this application should be adapted to the seventh aspect of the embodiments of this application simultaneously, and can achieve the same or similar beneficial effects, which will not be repeated here.
[0067] Eighthly, embodiments of this application provide a content sharing device for implementing any one of the first, second, or third aspects described above, or for implementing a content sharing method in any implementation of any one of the first, second, or third aspects described above. This device can be a network-side network element (such as a unified media plane network element), a module applied to a network-side network element (such as a processor, chip, or chip system), or a logical node, logical module, or software capable of implementing all or part of the network-side functions. When this device is used to implement any one of the third aspects described above or a content sharing method in any implementation of any one of the third aspects described above, the device can be a terminal device (such as a mobile phone or AR glasses), a module applied to a terminal device (such as a processor, chip, or chip system), or a logical node, logical module, or software capable of implementing all or part of the terminal device functions.
[0068] In one possible implementation, the content sharing device in the eighth aspect includes units, modules, or means for executing the methods in any one or any implementation of the first, second, or third aspect. These units, modules, or means can be implemented in software, hardware, or a combination of both.
[0069] In another possible implementation, the content sharing device in the eighth aspect above includes at least one processor; the at least one processor is configured to perform the corresponding functions in the content sharing method described above.
[0070] Optionally, the at least one processor may be coupled to at least one memory for storing necessary programs (instructions) and / or data (such as one or more computer programs) of the device. Optionally, the content sharing device may also include a communication interface for enabling communication between the device and other network elements. Optionally, the at least one memory may be located internally or externally to the content sharing device.
[0071] Optionally, the content sharing device may further include a transceiver unit, with the processor coupled to the transceiver unit. The processor executes computer programs or instructions to control the transceiver unit to receive and send information. When the processor executes the computer programs or instructions, it is also used to implement the above method through logic circuits or executed code instructions. The transceiver unit may be a transceiver, transceiver circuit, or input / output interface, used to receive signals from other devices besides the content sharing device and transmit them to the processor, or to send signals from the processor to other devices besides the content sharing device. When the content sharing device is a chip, the transceiver unit is a transceiver circuit or an input / output interface.
[0072] When the content sharing device in the eighth aspect above is a chip, the sending unit can be an output unit, such as an output circuit or a communication interface; the receiving unit can be an input unit, such as an input circuit or a communication interface. When the content sharing device is a terminal device, the sending unit can be a transmitter or a receiver; the receiving unit can be a receiver or a receiver.
[0073] Ninthly, embodiments of this application provide a chip, including: a processor, configured to call and run a computer program from a memory, causing a device / apparatus having the chip installed to perform the method as described in any of the first, second, or third embodiments above.
[0074] In a tenth aspect, embodiments of this application provide a computer-readable storage medium storing a computer program for execution by a device, wherein the computer program, when executed, implements the method as described in any of the embodiments of the first, second, or third aspects above.
[0075] In one aspect, embodiments of this application provide a computer program product that, when run by a device, causes the device to perform the method as described in any of the embodiments of the first, second, or third aspects above. Attached Figure Description
[0076] To more clearly illustrate the technical solutions in the embodiments of this application or the background art, the accompanying drawings used in the embodiments of this application or the background art will be described below.
[0077] Figure 1 is a schematic diagram of a system architecture provided in an embodiment of this application;
[0078] Figure 2 is a flowchart illustrating a content sharing method provided in an embodiment of this application;
[0079] Figure 3 is a flowchart illustrating another content sharing method provided in an embodiment of this application;
[0080] Figure 4 is a schematic diagram of sharing virtual content provided in an embodiment of this application;
[0081] Figure 5 is a flowchart illustrating another content sharing method provided in an embodiment of this application;
[0082] Figure 6 is a schematic diagram of a 3D model of a real object provided in an embodiment of this application;
[0083] Figure 7 is a flowchart illustrating another content sharing method provided in an embodiment of this application;
[0084] Figure 8 is a schematic diagram of a shared overlay of virtual content and a 3D model of a real object, provided in an embodiment of this application;
[0085] Figure 9 is a flowchart illustrating another content sharing method provided in an embodiment of this application;
[0086] Figure 10 is a schematic diagram of a content sharing system provided in an embodiment of this application;
[0087] Figure 11 is a schematic diagram of the structure of a content sharing device provided in an embodiment of this application;
[0088] Figure 12 is a schematic diagram of another content sharing device provided in an embodiment of this application;
[0089] Figure 13 is a schematic diagram of the structure of a content sharing device provided in an embodiment of this application;
[0090] Figure 14 is a schematic diagram of a baseband hardware provided in an embodiment of this application. Detailed Implementation
[0091] The terms "first," "second," "third," and "fourth," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.
[0092] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a mutually exclusive, independent, or alternative embodiment. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.
[0093] The terms “component,” “module,” “system,” etc., used in this specification are used to refer to computer-related entities, hardware, firmware, combinations of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable file, an execution thread, a program, and / or a computer. As illustrated, an application running on a terminal device and the terminal device can both be components. One or more components may reside in a process and / or an execution thread, and components may be located on a single computer and / or distributed among two or more computers. Furthermore, these components can be executed from various computer-readable media on which various data structures are stored. Components can communicate, for example, via local and / or remote processes based on signals having one or more data packets (e.g., data from two components interacting with another component between a local system, a distributed system, and / or a network, such as the Internet interacting with other systems via signals).
[0094] First, a brief introduction to the technical background of this application will be given to facilitate understanding by those skilled in the art.
[0095] (1) Gesture recognition: refers to the technology of capturing and analyzing human hand movements or postures through sensors, cameras, or other input devices, and converting them into instructions or data that computers can understand and respond to. Through gesture recognition technology, devices can determine the relevant information of user gestures, thereby clarifying the operation corresponding to the user's gestures;
[0096] (2) 3D Reconstruction Technology: This refers to the process of converting real-world objects or scenes into digital 3D models. This technology has wide applications in fields such as computer vision, virtual reality (VR), and augmented reality (AR). The generated 3D models can be represented in various ways, such as meshes, voxels, and point clouds.
[0097] (3) Simultaneous Localization and Mapping (SLAM): A technology that simultaneously enables device localization and environmental mapping. This technology is crucial for fields such as robotics, autonomous driving, and AR. For example, in the AR field, AR glasses need to perceive the user's position and orientation in physical space in real time, and SLAM technology can provide this high-precision, low-latency positioning information to meet the positioning needs of AR glasses. When the user moves or turns their head, SLAM technology can continuously monitor changes in the user's position and perspective, ensuring that AR content is stably superimposed on the real world. At the same time, SLAM technology helps AR glasses recognize and understand the surrounding environment, including planes, objects, corners, etc., which is important for placing virtual objects in the correct positions.
[0098] One existing technology proposes a content sharing method that enables gesture recognition on the device side. Terminal device A detects the user's grasping gesture in real time, selects the content selected by the grasping gesture as the sharing content, and then transmits the sharing content to terminal device B. Terminal device B detects the user's release gesture in real time and determines whether the detected gesture is a shortcut gesture. Based on the determination result, it displays the content shared by terminal device A. However, in this solution, gesture recognition is implemented on the terminal side, requiring continuous gesture detection on the terminal device. This not only places high demands on the terminal's computing power but also leads to high power consumption due to prolonged gesture detection. In addition, the content selected by the user on terminal device A to share is 2D content such as images, applications, documents, audio, and video, which cannot be presented from multiple angles like 3D content or overlaid into the real environment for preview, resulting in insufficient interactivity.
[0099] To overcome the shortcomings of existing technologies, this application provides a content sharing method, which can be implemented based on the system architecture shown in Figure 1. As shown in Figure 1, the system architecture includes a User Equipment (UE)-A, a unified control plane-A and a unified media plane-A providing services to UE-A, a UE-B, and a unified control plane-B and a unified media plane-B providing services to UE-B. UE-A can request the unified media plane-A to enable gesture recognition functionality through the unified control plane-A. After enabling gesture recognition functionality, the unified media plane-A sends a message indicating successful activation of gesture recognition functionality to the unified control plane-A. The unified control plane-A then requests the unified media plane-B to enable gesture recognition functionality through the unified control plane-B. The gesture types that the unified media plane-A and unified media plane-B can recognize can be preset or provided by both control planes. The preset gesture types can be determined by the gesture recognition models deployed on both media planes. The unified media plane-A detects the media stream on the UE-A side, recognizes the sharing gesture of the user on the UE-A side, and determines the content shared by the user on the UE-A side based on this sharing gesture. This content includes the content presented by the application used by the user on the UE-A side (actually provided by the resource server corresponding to the application, which is virtual content), content generated based on the physical object selected by the user on the UE-A side, and / or the overlay of virtual content and real-time generated content. After determining the content shared by the user on the UE-A side, the Unified Media Plane-A notifies the Unified Control Plane-B through the Unified Control Plane-A. The Unified Control Plane-B requests the Unified Media Plane-B to retrieve the content shared by UE-A from the resource server and / or the Unified Media Plane-A, and prompts the UE-B that the other party has content to share. When the Unified Media Plane-B recognizes the user's receiving gesture on the UE-B side, it renders the retrieved content and sends the rendered content to the UE-B for presentation. It should be understood that the rendering on both sides must be based on the perspectives of UE-A and UE-B and the user's environment, so that the rendered content is more adapted to the environment of both parties. This requires the use of SLAM technology. In the system architecture shown in Figure 1, the UE can also be a terminal device, terminal, access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, wireless communication device, user agent, or user equipment. The terminal device can be a cellular phone, cordless phone, personal digital assistant (PDA), handheld device with wireless communication function, computing device, vehicle-mounted device, wearable device, etc., such as a mobile phone or AR glasses.
[0100] It should be understood that the system architecture described above for the embodiments of this application is merely illustrative, and the system architecture applicable to the embodiments of this application is not limited thereto. Any system architecture capable of implementing the functions of the UE, unified control plane network element, and unified media plane network element described above is applicable to the embodiments of this application. It should be understood that the unified control plane network element and the unified media plane network element both belong to network-side network elements.
[0101] It should also be understood that the above naming is defined solely for the purpose of distinguishing different functions and should not constitute any limitation on this application. This application does not preclude the possibility of using other names in 5th Generation (5G) networks and other future networks. For example, in 6G networks, some or all of the above-mentioned network terms may be retained from 5G, or other names may be used.
[0102] The content sharing method provided in this application can be implemented based on various communication systems, such as 5G mobile communication systems, next-generation ubiquitous real-time communication network (URCN) systems, future evolution systems, or multiple communication convergence systems, or it can be implemented based on existing communication systems. The application scenarios of the technical solution provided in this application can include various scenarios, such as machine-to-machine (M2M), macro-micro communication, enhanced mobile broadband (eMBB), ultra-reliable and low-latency communication (uRLLC), and massive machine-type communication (mMTC).
[0103] The technical solution provided in this application will be described in detail below with reference to specific implementation methods.
[0104] Please refer to Figure 2, which is a flowchart illustrating a content sharing method provided in an embodiment of this application. This method can be implemented based on the system architecture shown in Figure 1, or it can be implemented based on other system architectures. As shown in Figure 2, the method includes steps 201-205:
[0105] 201: The first network element detected the user's sharing gesture on the first terminal device side.
[0106] In this embodiment, the first terminal device and the second terminal device are the two ends of content sharing. The first network element and the fourth network element are network elements that provide services to the first terminal device, and the second network element and the third network element are network elements that provide services to the second terminal device. For example, the first network element and the third network element can be media plane network elements, mainly used to perform media plane task processing, such as a unified media plane network element; the second network element and the fourth network element can be control plane network elements, mainly used to perform control plane message processing, such as a unified control plane network element.
[0107] For example, the first network element initiates the recognition function of one or more first gestures, including a sharing gesture. For example, a sharing gesture can be understood as a gesture corresponding to a sharing operation, such as a grab gesture, a pick-up gesture, a double-tap gesture, a click-and-push gesture, etc. It should be understood that gesture recognition can be achieved through a trained gesture recognition model, and the actual operation corresponding to the gesture can be used as a label for the sample data of the model training. The first terminal device transmits a media stream to the first network element in real time. The media stream transmitted by the first terminal device includes gestures performed by the user on the first terminal device side. The first network element performs gesture detection based on the media stream. When the user on the first terminal device side makes a sharing gesture, the first network element can detect or recognize the sharing gesture.
[0108] 202: The first network element determines the target content to be shared by the user on the first terminal device side based on the sharing gesture.
[0109] In this embodiment of the application, the first network element can determine the position of the sharing gesture based on the media stream transmitted by the first terminal device. When the distance between the position of the sharing gesture and the position of a certain content (or a certain object) in the media stream is less than or equal to a preset distance (such as the two positions overlapping), the first network element can determine the content selected by the user on the first terminal device side. Based on the content, the first network element can determine the target content shared by the user on the first terminal device side.
[0110] Specifically, based on the sharing gesture of the user on the first terminal device side, the first target content and / or second target content selected by the user on the first terminal device side can be determined. The first target content is virtual content provided by the resource server, such as the virtual content presented by an application when the user uses it on the first terminal device. This virtual content can also be called pre-set content, and can be 2D content such as text, voice, images, and videos, or 3D models. The second target content is a 3D model of a physical object in the physical environment where the user on the first terminal device side is located (hereinafter referred to as the first 3D model), generated by the first network element, such as the physical furniture seen by the user when browsing a physical furniture store. When the sharing gesture determines that the user on the first terminal device side has selected a physical object, the first network element responds to the user's selection by generating the first 3D model of the physical object. Therefore, the first network element can ultimately determine that the target content selected by the user on the first terminal device side to share includes the first target content and / or the second target content based on the sharing gesture. The first network element can use 3D reconstruction technology to scan the physical environment where the user on the first terminal device side is located, perform 3D reconstruction of the physical objects, and thus generate the first 3D model.
[0111] For example, a resource server can be an application server, a business server, or an operations management platform.
[0112] In this implementation, based on the user's sharing gesture on the first terminal device side, the first network element can determine the first target content and / or physical object selected by the user. If the user has selected a physical object, the first network element can perform 3D reconstruction to generate a corresponding 3D model (i.e., the first 3D model). The first target content can be 2D or 3D content. From the perspective of content complexity, terminal devices can share both 2D and 3D content, exhibiting diverse characteristics. Furthermore, 3D content allows users to preview from multiple angles through certain operations, enhancing the user's interactive experience. Regarding the source of the shared content, terminal devices can share pre-set virtual content and / or reconstructed information about the physical world, expanding the scope of shared content. Pre-set virtual content and / or reconstructed information about the physical world can be overlaid onto the recipient user's real environment, improving the recipient user's perception of the shared content.
[0113] 203: Identification information of the target content sent by the first network element.
[0114] Correspondingly, the third network element receives the identification information of the target content. This identification information comes from the resource server and / or the first network element. The identification information includes the identification information of the first target content and / or the identification information of the first 3D model (i.e., the second target content). The identification information of the first target content comes from the resource server, and the identification information of the first 3D model is generated by the first network element when it generates the first 3D model.
[0115] For example, in addition to directly sending the identification information of the target content, the first network element can also send a first message to the second network element. The first message includes information about the detected sharing gesture and the identification information of the target content. For example, the sharing gesture information can be type information, identification information, indication information, etc., which characterize the operation corresponding to the gesture as sharing. The identification information of the target content can be an index, a Uniform Resource Identifier (URI), the storage address of the target content, etc.
[0116] For example, the first network element can send a first message to the second network element through the fourth network element. For instance, the fourth network element can subscribe to a notification from the first network element indicating that a sharing gesture has been recognized. When the first network element recognizes a sharing gesture, it sends a successful sharing gesture recognition notification to the fourth network element, which includes information about the sharing gesture. If the first network element determines that the content selected for sharing by the user on the first terminal device includes a first target content and / or a second target content, the notification may also include identification information of the first target content and / or the second target content. Upon receiving the successful sharing gesture recognition notification from the first network element, the fourth network element sends the first message to the second network element.
[0117] For example, the second network element sends a first request to the third network element based on the information of the sharing gesture in the first message. The first request includes identification information of the target content. Based on the sharing gesture information, the second network element can determine that there is content that needs to be obtained, and thus sends the first request to the third network element to request the third network element to obtain the target content corresponding to the carried identification information.
[0118] 204: The third network element obtains the target content based on the target content's identification information.
[0119] In this embodiment, the third network element can obtain the target content from its source based on the target content's identification information. For example, when the target content's identification information includes the identification information of a first target content and / or a second target content, the third network element obtains the first target content from a resource server based on the first target content's identification information. For instance, the first target content's identification information indicates the address or path (e.g., URI) of the first target content on the resource server. The third network element can send a download request to the resource server, which includes the first target content's identification information, to download the first target content from the resource server. And / or, the second target content's identification information indicates the address or path (e.g., URI) of the second target content on the first network element. The third network element obtains a first 3D model from the first network element based on the second target content's identification information. For instance, the third network element can send a download request to the first network element, which includes the first 3D model's identification information, to download the first 3D model from the first network element.
[0120] In this implementation, when the identification information in the first request includes the identification information of the first target content and / or the identification information of the second target content, the third network element can obtain the first target content from the resource server based on the identification information of the first target content, and / or can obtain the second target content from the first network element based on the identification information of the second target content. This eliminates the need for the network element on the first terminal device side to directly transmit the shared first and / or second target content to the network element on the second terminal device side. By simply including the identification information of the first and / or second target content in the first request, the third network element can obtain the first and / or second target content from the content source based on this identification information. This helps reduce bandwidth consumption and transmission latency between the network elements on the first and second terminal devices. In addition, the third network element obtains the corresponding content from the content source of the first target content and / or the content source of the second target content based on the identification information of the first target content and / or the identification information of the second target content, respectively. Each content source can independently process its own content request, avoiding the data pressure on a single point server or network element caused by centralized processing of content requests. The distributed content acquisition method enables a single point server or network element to respond to its own received requests more quickly, which is conducive to improving the efficiency of the third network element in obtaining the first target content and / or the second target content.
[0121] 205: The third network element responds to the detection of the user's receiving gesture on the second terminal device side and presents the target content through the second terminal device.
[0122] In this embodiment, when the third network element obtains the target content shared by the user on the first terminal device side, it outputs a fourth message through the second terminal device. The fourth message is used to notify the user on the second terminal device side that there is shared content from the first terminal device, prompting the user on the second terminal device side to perform a receiving gesture. For example, when the third network element obtains the target content shared by the user on the first terminal device side, it can send a target content acquisition success notification to the second network element. Upon receiving the notification, the second network element sends the fourth message to the second terminal device.
[0123] For example, the third network element initiates the recognition function of one or more second gestures, including a receiving gesture. For example, a receiving gesture can be understood as the operation corresponding to the gesture being a receiving gesture, such as a release gesture, a double-tap gesture, a palm-open gesture, a grab-and-release gesture, etc.
[0124] The third network element performs gesture detection based on the media stream sent by the second terminal device. This media stream includes gestures performed by the user on the second terminal device. Upon detecting a received gesture, if the target content (e.g., 2D content) does not require further operation (e.g., rendering), the third network element can directly transmit the target content to the second terminal device for presentation. If the target content (e.g., 3D content) requires rendering, the third network element can render the target content and transmit the rendered media stream to the second terminal device. This media stream includes the rendered target content, and the second terminal device presents the rendered target content through this media stream. For example, the third network element can render the target content based on the position of the received gesture; for instance, anchoring the rendering position of the target content to the position of the received gesture. For example, if the received gesture is an open palm, the third network element can render the target content in the palm. Alternatively, the third network element can also render the target content based on a default position, such as the center position of the image captured by the second terminal device.
[0125] In this implementation, when the third network element obtains the target content based on the identification information of the target content, it can output a fourth message through the second terminal device to notify the user on the second terminal device side that there is shared content from the user on the first terminal device side. This allows the user on the second terminal device side to perform a receiving gesture when they need to view the shared content, thereby improving the interaction between the device and the user.
[0126] As can be seen, in this embodiment, when the first network element detects a sharing gesture from a user on the first terminal device side, it can determine the target content shared by the user on the first terminal device side based on the sharing gesture. Once the target content is determined, the first network element can further determine the identification information of the target content and then send the identification information. The third network element receives the identification information of the target content from the first network element. Based on the identification information, the third network element can obtain the target content and, upon detecting a receiving gesture from a user on the second terminal device side, responds to the receiving gesture by presenting the target content through the second terminal device. This method, by transmitting the identification information of the target content shared by the user on the first terminal device side through the network side, the network element of the sharing recipient can obtain and present the target content based on the identification information, without transmitting the shared content through the first and second terminal devices, which helps reduce the transmission consumption of the terminal devices. Furthermore, by placing the gesture detection operation on the network side at both ends, the power consumption of the terminal devices can be further reduced, and the computing power requirement of the terminal devices is also reduced. This method is applicable to both high-computing-power terminal devices and low-computing-power lightweight terminal devices (such as AR glasses).
[0127] Please refer to Figure 3, which is a flowchart illustrating another content sharing method provided in this application embodiment. The embodiment shown in Figure 3 mainly describes the sharing process for virtual content (or pre-built content) provided by a resource server. As shown in Figure 3, the method includes steps 301-311:
[0128] 301: The resource server sends a second request to the first network element.
[0129] Correspondingly, the first network element receives a second request from the resource server. The second request includes at least one second 3D model and identification information for each second 3D model, and is used to request the first network element to render the at least one second 3D model. For example, the first terminal device and the second terminal device have established a session; the first network element has enabled one or more first gesture recognition functions; the fourth network element has subscribed to the first network element for successful recognition notifications of the one or more first gestures; the third network element has enabled one or more second gesture recognition functions; and the second network element has subscribed to the third network element for successful recognition notifications of the one or more second gestures. In response to the user on the first terminal device opening an application (such as an AR application), the resource server sends the second request to the first network element.
[0130] 302: The first network element renders the at least one second 3D model based on the second request and presents at least one rendered image through the first terminal device.
[0131] In this configuration, at least one rendered image corresponds one-to-one with at least one second 3D model, meaning each rendered image is obtained by rendering the corresponding second 3D model. The first network element sends at least one rendered image to the first terminal device to present the at least one rendered image via the first terminal device. For example, the first network element may send a first media stream to the first terminal device, the first media stream including the at least one rendered image, meaning at least one rendered image is presented via the first media stream.
[0132] 303: The first network element detected a sharing gesture from the user on the first terminal device side.
[0133] For example, the first terminal device also sends a second media stream to the first network element. The second media stream includes at least one rendered image, at least one physical object in the physical environment where the user is located on the first terminal device side, and a gesture of the user on the first terminal device side. The first network element performs gesture detection based on the second media stream and identifies the user's gesture as a sharing gesture.
[0134] 304: The first network element determines, based on the sharing gesture, that the user on the first terminal device side has selected the target rendered image in the at least one rendered image, and determines the second 3D model corresponding to the target rendered image as the first target content.
[0135] For example, the first network element determines the target rendered image as the rendered image whose position overlaps with at least one position in the rendered image. The first network element can also send a third media stream to the first terminal device, which receives and presents the third media stream. The third media stream includes the target rendered image after highlighting at least one rendered image.
[0136] In this implementation, the first network element can present at least one rendered image corresponding to at least one second 3D model through the first terminal device, and determine the target rendered image selected by the user based on the user's sharing gesture on the first terminal device side, and use the second 3D model corresponding to the target rendered image as the first target content selected by the user on the first terminal device side for sharing, thereby enabling the sharing of virtual 3D content.
[0137] 305: The first network element sends the first message to the second network element.
[0138] Correspondingly, the second network element receives a first message from the first network element. This first message includes information about the sharing gesture and identification information of the first target content. For example, the first network element can send the first message to the second network element through a fourth network element. For instance, the fourth network element can subscribe to a notification from the first network element indicating that a sharing gesture has been recognized. When the first network element recognizes a sharing gesture, it sends a successful sharing gesture recognition notification to the fourth network element, which includes information about the sharing gesture and identification information of the first target content. Upon receiving the successful sharing gesture recognition notification from the first network element, the fourth network element sends the first message to the second network element.
[0139] 306: The second network element sends a first request to the third network element based on the information from the sharing gesture.
[0140] Accordingly, the third network element receives a first request from the second network element. This first request includes identification information for a first target content. Based on the information from the sharing gesture, the second network element can determine that there is content that needs to be obtained, and thus sends the first request to the third network element to request the third network element to obtain the first target content corresponding to the carried identification information.
[0141] 307: The third network element obtains the first target content based on the identification information of the first target content.
[0142] For example, a third network element can send a download request to a resource server, the download request including identification information of the first target content, in order to download the first target content from the resource server.
[0143] 308: The third network element outputs the fourth message through the second terminal device.
[0144] The third network element can directly send a fourth message to the second terminal device. Alternatively, it can send a notification of successful acquisition of the first target content to the second network element, which, upon receiving the notification, will send a fourth message to the second terminal device. The fourth message is used to notify the user on the second terminal device that there is shared content from the first terminal device, prompting the user on the second terminal device to perform a receive gesture.
[0145] 309: The third network element responds to the detection of the user's receiving gesture on the second terminal device side by sending a third message to the second network element.
[0146] Correspondingly, the second network element receives a third message from the third network element. This third message includes information about the received gesture and is used to notify the second network element that the gesture has been recognized.
[0147] 310: The second network element sends a fifth request to the third network element based on the third message.
[0148] Correspondingly, the third network element receives a fifth request from the second network element. This fifth request includes identification information of the first target content and is used to request rendering of the first target content. For example, the fifth request can be a predefined rendering request, or it can carry rendering instruction information, which instructs the third network element to render the first target content.
[0149] 311: The third network element renders the first target content based on the fifth request, and presents the rendered first target content through the second terminal device.
[0150] In this embodiment, the third network element can render the first target content and transmit the rendered media stream to the second terminal device. The media stream includes the rendered first target content, and the second terminal device presents the rendered first target content through the media stream. For example, the third network element can render the first target content based on the position of the received gesture; for instance, if the received gesture is an open palm, the third network element can render the first target content in the palm. Alternatively, the third network element can also render the first target content based on a default position.
[0151] In this implementation, when the third network element detects a receiving gesture from the user on the second terminal device, it can send a notification of successful gesture recognition (i.e., a third message) to the second network element. This allows the second network element to send a rendering request to the third network element. The third network element then renders the first target content based on the rendering request, and finally presents the rendered first target content through the second terminal device, thereby achieving the sharing of a virtual 3D model. Furthermore, placing the rendering of at least one second 3D model and the first target content on the network side helps reduce the power consumption of both the first and second terminal devices and lowers the computational requirements for rendering complex content on the terminal devices.
[0152] For example, taking user A wearing AR glasses browsing a furniture application as an example, as shown in Figure 4, the furniture application displays a sofa stool. The displayed sofa stool is an image rendered by the first network element after the 3D model of the sofa stool provided by the furniture application server is rendered. User A wants to share this sofa stool with user B. User A selects the sofa stool by grasping the gesture. The first network element determines that user A has selected to share the 3D model corresponding to the sofa stool based on the position of the grasping gesture. The first network element sends a notification of successful grasping gesture recognition to the fourth network element, carrying the gesture type information and the URI of the 3D model corresponding to the sofa stool. The fourth network element sends a first message to the second network element, carrying the gesture type information and the URI. The second network element determines that there is content to be downloaded for sharing based on the gesture type information, and then sends a first request to the third network element, carrying the URI. The third network element downloads the 3D model of the sofa stool from the furniture application server based on the URI, and sends a response or notification to the second network element indicating successful sharing. The second network element outputs a prompt that the content shared by user A is available through user B's AR glasses (or mobile phone). User B receives the prompt at home and places the sofa stool in the living room to view the matching effect by releasing the gesture. Upon detecting the release gesture, the third network element sends a notification to the second network element that the gesture has been recognized. The second network element sends a rendering request for the 3D model of the sofa stool to the third network element. After the third network element renders the 3D model at the appropriate location, the sofa stool shared by user A is displayed in user B's living room through user B's AR glasses (or mobile phone).
[0153] Please refer to Figure 5, which is a flowchart illustrating another content sharing method provided in this application embodiment. The embodiment shown in Figure 5 mainly describes the sharing process for a 3D reconstructed model of a real object. As shown in Figure 5, the method includes steps 501-510:
[0154] 501: The first network element detected a sharing gesture from the user on the first terminal device side.
[0155] In this embodiment of the application, the first terminal device and the second terminal device have established a session, the first network element has enabled the recognition function of one or more first gestures, the fourth network element has subscribed to the first network element for the recognition success notification of the one or more first gestures, the third network element has enabled the recognition function of one or more second gestures, and the second network element has subscribed to the third network element for the recognition success notification of one or more second gestures.
[0156] For example, the first terminal device also sends a second media stream to the first network element. The second media stream includes at least one physical object in the physical environment where the user on the first terminal device is located and the user's gesture on the first terminal device. The first network element performs gesture detection based on the second media stream.
[0157] 502: The first network element determines the physical object shared by the user on the first terminal device side based on the sharing gesture.
[0158] Specifically, the first network element can determine the real object shared by the user on the first terminal device based on the position of the sharing gesture. For example, if the position of the sharing gesture overlaps with the position of a physical object displayed on the first terminal device, then that physical object is identified as the shared object. For instance, if the first network element determines that no virtual content is displayed at the position of the sharing gesture, then the object whose position overlaps with the position of the sharing gesture is identified as a real object. For instance, the first network element can also send a third media stream to the first terminal device, which receives and displays the third media stream. The third media stream includes at least one highlighted second target content from a physical object.
[0159] 503: The first 3D model of the physical object generated by the first network element and the identification information of the first 3D model.
[0160] In this embodiment of the application, the first 3D model is the same as the second target content. For example, the identification information can be the URI of the first 3D model.
[0161] 504: The first network element sends the first message to the second network element.
[0162] Correspondingly, the second network element receives a first message from the first network element. This first message includes information about the sharing gesture and the identification information of the first 3D model. For example, the first network element can send the first message to the second network element via a fourth network element. For instance, if the first network element recognizes a sharing gesture, it sends a notification of successful sharing gesture recognition to the fourth network element, which includes information about the sharing gesture and the identification information of the first 3D model. Upon receiving the notification of successful sharing gesture recognition from the first network element, the fourth network element sends the first message to the second network element.
[0163] 505: The second network element sends a first request to the third network element based on the information from the sharing gesture.
[0164] Correspondingly, the third network element receives a first request from the second network element. This first request includes the identification information of the first 3D model. Based on the information from the sharing gesture, the second network element determines that there is content that needs to be obtained and sends this first request to the third network element, requesting the third network element to obtain the first 3D model corresponding to the carried identification information (i.e., obtain the shared content).
[0165] 506: The third network element obtains the shared content based on the identification information it carries, such as obtaining the first 3D model based on the identification information of the first 3D model.
[0166] For example, a third network element can send a download request to a first network element, the download request including the identification information of the first 3D model, in order to download the first 3D model from the first network element.
[0167] 507: The third network element outputs the fourth message through the second terminal device.
[0168] The third network element can directly send a fourth message to the second terminal device. Alternatively, it can send a notification of successful acquisition of the first 3D model to the second network element, which, upon receiving the notification, will send a fourth message to the second terminal device. The fourth message is used to notify the user on the second terminal device that there is shared content from the first terminal device, such as the first 3D model, prompting the user on the second terminal device to perform a receiving gesture.
[0169] 508: The third network element responds to the detection of the user's receiving gesture on the second terminal device side by sending a third message to the second network element.
[0170] Correspondingly, the second network element receives a third message from the third network element. This third message includes information about the received gesture and is used to notify the second network element that the gesture has been recognized.
[0171] 509: The second network element sends a fifth request to the third network element based on the third message.
[0172] Correspondingly, the third network element receives a fifth request from the second network element. This fifth request includes identification information of the first 3D model and is used to request rendering of the first 3D model. For example, the fifth request may be a predefined rendering request, or it may carry rendering instruction information, which instructs the third network element to render the first 3D model.
[0173] 510: The third network element renders the first 3D model based on the fifth request, and presents the rendered first 3D model through the second terminal device.
[0174] In this embodiment, the third network element can render the first 3D model and transmit the rendered media stream to the second terminal device. The media stream includes the rendered first 3D model, and the second terminal device presents the rendered first 3D model through this media stream. For example, the third network element can render the first 3D model based on the position of the received gesture; for instance, if the gesture is an open palm, the third network element can render the first 3D model within the palm. Alternatively, the third network element can render the first 3D model based on a default position. It can be seen that placing the rendering operation of the first 3D model on the network side helps reduce the power consumption of the second terminal device and lowers the computational requirements for rendering complex content on the terminal device.
[0175] For example, taking user A wearing AR glasses browsing a physical furniture store as an example, as shown in Figure 6, user A sees a chair in the furniture store and wants to share it with user B. User A selects the chair using a grab gesture. The first network element determines that user A has selected to share the chair based on the position of the grab gesture, and then performs 3D reconstruction of the chair, generating a 3D model of the chair and the URI of the 3D model. The first network element sends a notification of successful grab gesture recognition to the fourth network element, carrying the gesture type information and the URI of the 3D model of the chair. The fourth network element sends a first message to the second network element, carrying the gesture type information and the URI. The second network element determines that there is content to be downloaded for sharing based on the gesture type information, and then sends a first request to the third network element, carrying the URI. The third network element downloads the 3D model of the chair from the first network element based on the URI, and sends a response or notification to the second network element indicating successful sharing. The second network element outputs a prompt that there is shared content from user A through user B's AR glasses (or mobile phone). Upon receiving the prompt, user B releases the chair by placing it in their palm to view it. When the third network element detects the release gesture, it sends a notification to the second network element that the gesture has been recognized. The second network element then sends a rendering request for the 3D model of the chair to the third network element. After the third network element renders the 3D model at the location of the release gesture, it displays the chair shared by user A through user B's AR glasses (or mobile phone).
[0176] Please refer to Figure 7, which is a flowchart illustrating another content sharing method provided in an embodiment of this application. The embodiment shown in Figure 7 mainly describes the sharing process for simultaneously sharing virtual content and 3D reconstructed models of real objects. As shown in Figure 7, the method includes steps 701-712:
[0177] 701: The resource server sends a second request to the first network element.
[0178] Correspondingly, the first network element receives a second request from the resource server. The second request includes at least one second 3D model and identification information for each second 3D model, and is used to request the first network element to render the at least one second 3D model. For example, the first terminal device and the second terminal device have established a session; the first network element has enabled one or more first gesture recognition functions; the fourth network element has subscribed to the first network element for successful recognition notifications of the one or more first gestures; the third network element has enabled one or more second gesture recognition functions; and the second network element has subscribed to the third network element for successful recognition notifications of the one or more second gestures. In response to the user on the first terminal device opening an application (such as an AR application), the resource server sends the second request to the first network element.
[0179] 702: The first network element renders the at least one second 3D model based on the second request and presents at least one rendered image through the first terminal device.
[0180] In this configuration, at least one rendered image corresponds one-to-one with at least one second 3D model, meaning each rendered image is obtained by rendering the corresponding second 3D model. The first network element sends at least one rendered image to the first terminal device to present the at least one rendered image via the first terminal device. For example, the first network element may send a first media stream to the first terminal device, the first media stream including the at least one rendered image, meaning at least one rendered image is presented via the first media stream.
[0181] 703: The first network element responds to the user's operation on the first terminal device side for the target rendered image in at least one rendered image, and overlays the target rendered image with the physical object to generate position information.
[0182] Among them, the user's operation on the target rendered image on the first terminal device side can be to move their head to overlay the target rendered image with the physical object in the real world, or it can be to perform a corresponding gesture to overlay the target rendered image with the physical object.
[0183] 704: The first network element detected a sharing gesture from the user on the first terminal device side.
[0184] For example, the first terminal device also sends a second media stream to the first network element. The second media stream includes at least one rendered image, at least one physical object in the physical environment where the user is located on the first terminal device side, and a gesture of the user on the first terminal device side. The first network element performs gesture detection based on the second media stream and identifies the user's gesture as a sharing gesture.
[0185] 705: The first network element determines the target rendered image and physical object shared and superimposed by the user on the first terminal device side based on the sharing gesture, determines the second 3D model corresponding to the target rendered image as the first target content, and generates the first 3D model of the physical object and the identification information of the first 3D model.
[0186] In this implementation, the first network element can present at least one rendered second 3D model (i.e., at least one rendered image) through the first terminal device. Based on user actions on the target rendered image within the at least one rendered image, the first network element can overlay the target rendered image onto a physical object. Upon detecting a sharing gesture, the first network element determines the overlay content of the target rendered image and the physical object as the content selected by the user on the first terminal device, based on the sharing gesture. Ultimately, the second 3D model corresponding to the target rendered image and the first 3D model corresponding to the physical object (i.e., the second target content) are determined as the target content shared by the user. This achieves the sharing of the overlay (or merged) content of virtual content (i.e., the first target content) and the physical object, expanding the scope of shared content and improving the content presentation effect.
[0187] In step 703, the position information generated is the position information of the first target content relative to the second target content.
[0188] 706: The first network element sends the first message to the second network element.
[0189] Correspondingly, the second network element receives a first message from the first network element. This first message includes information about the sharing gesture, identification information of the first target content, identification information of the second target content, and position information of the first target content relative to the second target content. For example, the sharing gesture information may be type information, identification information, instruction information, etc., which characterize the operation corresponding to the gesture as sharing. The identification information of the first target content may indicate the address or path (e.g., URI) of the first target content on the resource server, and the identification information of the second target content may indicate the address or path (e.g., URI) of the first 3D model on the first network element.
[0190] 707: The second network element sends a first request to the third network element based on the information from the sharing gesture.
[0191] Correspondingly, the third network element receives a first request from the second network element. The first request includes identification information for the first target content and identification information for the second target content.
[0192] 708: The third network element obtains the first target content from the resource server based on the identification information of the first target content, and obtains the second target content from the first network element based on the identification information of the second target content.
[0193] 709: The third network element outputs the fourth message through the second terminal device.
[0194] The third network element can directly send a fourth message to the second terminal device. Alternatively, it can send a notification of successful acquisition of the first target content to the second network element, which, upon receiving the notification, will send a fourth message to the second terminal device. The fourth message is used to notify the user on the second terminal device that there is shared content from the first terminal device, prompting the user on the second terminal device to perform a receive gesture.
[0195] 710: The third network element responds to the detection of the user's receiving gesture on the second terminal device side by sending a third message to the second network element.
[0196] Correspondingly, the second network element receives a third message from the third network element. This third message includes information about the received gesture and is used to notify the second network element that the gesture has been recognized.
[0197] 711: The second network element sends a fifth request to the third network element based on the third message.
[0198] Correspondingly, the third network element receives a fifth request from the second network element. This fifth request includes identification information for the first target content, identification information for the second target content, and positional information of the first target content relative to the second target content. The fifth request is used to request rendering of both the first and second target content. For example, the fifth request can be a predefined rendering request, or it can carry rendering instruction information, which instructs the third network element to render both the first and second target content.
[0199] 712: The third network element renders the first target content and the second target content based on the position information of the first target content relative to the second target content, and presents the rendered first target content and the second target content through the second terminal device.
[0200] In this implementation, the first network element can transmit the position information of the first target content relative to the second target content to the second network element on the second terminal device side. When the second network element receives the notification of successful gesture recognition, it can send the position information to the third network element through the fifth request, so that the third network element can render the first target content and the second target content based on the position information, and finally present the superimposed content of the first target content and the second target content rendered by the second terminal device.
[0201] Some of the implementation methods in steps 701-712 can also refer to the corresponding descriptions in the embodiments shown in Figures 2, 3, and 5, and can achieve the same or similar beneficial effects.
[0202] For example, consider user A browsing a furniture store while wearing AR glasses. User A sees a table in the store and then selects a virtual vase on the AR glasses application. The virtual vase is rendered by the first network element from a 3D vase model provided by the application server and displayed on user A's AR glasses. As shown in Figure 8, user A overlays the virtual vase onto the table through a certain operation, and the first network element generates the position information of the virtual vase relative to the table. User A wants user B to see the effect of the vase on the table, so they perform a grab gesture, selecting the overlaid virtual vase and the table. The first network element determines, based on the position of the grab gesture, that user A has chosen to share the 3D model corresponding to the table, and generates the 3D model of the table and its URI. The first network element sends a notification to the fourth network element that the grab gesture recognition was successful, carrying the gesture type information, the URI of the vase's 3D model, the URI of the table's 3D model, and the generated position information. The URI of the vase's 3D model comes from the application server. The fourth network element sends a first message to the second network element, carrying the gesture type information, the URI of the 3D model of the vase, the URI of the 3D model of the table, and the generated location information. The second network element determines that there is content to be downloaded based on the gesture type information, and then sends a first request to the third network element, carrying the URIs of the 3D models of the vase and the table. The third network element downloads the 3D model of the vase from the application server based on the vase's URI and downloads the 3D model of the table from the first network element based on the table's URI, and sends a response or notification to the second network element indicating successful sharing. The second network element outputs a notification through user B's AR glasses (or mobile phone) indicating that there is shared content from user A. User B receives this notification at home and releases a gesture to place the superimposed content of the virtual vase and table in the living room to view the combined effect. When the third network element detects a release gesture, it sends a notification to the second network element that the gesture has been recognized. The second network element then sends a rendering request to the third network element, carrying the URI of the 3D model of the vase, the URI of the 3D model of the table, and the generated location information. Based on the location information, the third network element renders the 3D models of the vase and the table, and then displays the vase and table shared by user A in user B's living room through user B's AR glasses (or mobile phone).
[0203] Please refer to Figure 9, which is a flowchart illustrating another content sharing method provided in this application embodiment. In Figure 9, the first terminal device and the second terminal device have established a session; the first terminal device and the fourth network element have established a connection; the second terminal device and the second network element have established a connection, enabling them to exchange control messages; the first terminal device and the first network element have established a connection; and the second terminal device and the third network element have established a connection, enabling them to exchange media messages. As shown in Figure 9, the method includes steps 901-914:
[0204] 901: The fourth network element sends a third request to the first network element.
[0205] Accordingly, the third request includes first indication information, which is used to indicate one or more first gestures. For example, the first indication information may be type information of one or more first gestures. The third request is used to request the first network element to enable the recognition function of the one or more first gestures and subscribe to the notification of the recognition of one or more first gestures. The one or more first gestures may include sharing gestures, and further may include receiving gestures, releasing gestures, etc.
[0206] For example, the fourth network element can receive a gesture activation message from the first terminal device or resource server. The gesture activation message includes first indication information and is used to trigger the fourth network element to send a third request to the first network element.
[0207] For example, in some other implementations, the third request is used to request the first network element to enable its gesture recognition function and subscribe to notifications of one or more recognized first gestures. Here, all gestures supported by the first network element include these one or more first gestures.
[0208] 902: The first network element enables the recognition function of one or more first gestures based on the first instruction information.
[0209] In this implementation, when the fourth network element receives a gesture activation message from the first terminal device, it can send a third request to the first network element to request the first network element to activate the recognition function of one or more first gestures based on the first indication information in the third request and subscribe to the notification of recognition of one or more first gestures. This facilitates the first network element to perform the detection and recognition of one or more first gestures. When a sharing gesture is recognized, the first network element notifies the fourth network element, which then transmits the sharing gesture information to the network element on the second terminal device side to notify the network element on the second terminal device side that there is shared content from the first terminal device side.
[0210] 903: The first network element sends a message to the fourth network element that the gesture recognition function has been successfully enabled.
[0211] Correspondingly, the fourth network element receives a message from the first network element indicating that the gesture recognition function has been successfully enabled. This message is the aforementioned second message. For example, when the unified media plane network element accessed by the first terminal device enables one or more first gestures, it sends a message indicating that the gesture recognition function has been successfully enabled (the second message) to the unified control plane network element accessed by the first terminal device.
[0212] 904: The fourth network element sends a message to the first terminal device indicating that the gesture recognition function has been successfully enabled.
[0213] For example, the unified control plane network element accessed by the first terminal device sends a message to the first terminal device: "Gesture recognition function successfully enabled!"
[0214] 905: The fourth network element sends a fourth request to the second network element.
[0215] Correspondingly, the second network element receives a fourth request from the fourth network element. The fourth request includes second indication information, which indicates one or more second gestures; for example, the second indication information may be type information of one or more second gestures. The fourth request requests the second network element to enable the recognition function of one or more second gestures. The one or more second gestures include a receiving gesture, and further, may also include a sharing gesture.
[0216] In cases where multiple first gestures include sharing and receiving gestures, multiple second gestures can be identical to multiple first gestures, for example, all including sharing and receiving gestures. When one or more first gestures do not include a receiving gesture, the fourth network element, having enabled the sharing gesture recognition function based on the first network element, can request the second network element to enable the receiving gesture based on the business scenario. For example, if the first gesture only includes a sharing gesture, the second gesture can only include a receiving gesture; if the first gesture includes a sharing gesture and an overlay gesture, the second gesture can include a receiving gesture and an overlay gesture, or the second gesture can include a sharing gesture, a receiving gesture, and an overlay gesture.
[0217] 906: The second network element sends a sixth request to the third network element.
[0218] Correspondingly, the third network element receives a sixth request from the second network element. The sixth request includes second instruction information, and is used to request the third network element to enable the recognition function of one or more second gestures and subscribe to notifications of the recognition of one or more second gestures.
[0219] In this implementation, the first network element can notify the fourth network element through a second message that the recognition function of one or more first gestures has been successfully enabled, so that the fourth network element can request the second network element to enable the recognition function of one or more second gestures. This facilitates the third network element to enable the recognition function of one or more second gestures based on the sixth request of the second network element, and when the receiving gesture is recognized, the shared content is presented through the second terminal device.
[0220] 907: The third network element enables the recognition function of one or more second gestures based on the second instruction information.
[0221] 908: The third network element sends a notification to the second network element that the recognition function of one or more second gestures has been successfully enabled.
[0222] 909: The third network element sends a notification to the second terminal device that one or more second gesture recognition functions have been successfully enabled.
[0223] 910: The first network element detected the user's sharing gesture on the first terminal device side.
[0224] 911: The first network element determines the target content to be shared by the user on the first terminal device side based on the sharing gesture.
[0225] 912: Identification information of the target content sent by the first network element.
[0226] 913: The third network element obtains the target content based on the target content's identification information.
[0227] 914: The third network element responds to the detection of the user's receiving gesture on the second terminal device side and presents the target content through the second terminal device.
[0228] The specific implementation methods of steps 910-914 have been explained in Figures 2-8, and will not be repeated here. For example, they can be referred to the corresponding descriptions in steps 201-206, and can achieve the same or similar beneficial effects.
[0229] The methods of the embodiments of this application have been described above. The content sharing system and apparatus of the embodiments of this application are provided below.
[0230] Please refer to Figure 10, which is a schematic diagram of a content sharing system provided in an embodiment of this application. As shown in Figure 10, the content sharing system includes a first network element 1001 and a third network element 1002. The first network element 1001 detects a sharing gesture from a user on a first terminal device; determines the target content to be shared by the user on the first terminal device based on the sharing gesture; and sends identification information of the target content. The third network element 1002 receives the identification information of the target content; obtains the target content based on the identification information of the target content; and, in response to detecting a receiving gesture from a user on a second terminal device, presents the target content through the second terminal device. Specifically, the first network element 1001 executes the steps implemented by the first network element in the content sharing method shown in Figures 2-9, and the third network element 1002 executes the steps implemented by the third network element in the content sharing method shown in Figures 2-9. The specific implementation and beneficial effects can be found in the corresponding descriptions in Figures 2-9.
[0231] Please refer to Figure 11, which is a schematic diagram of a content sharing device provided in an embodiment of this application. This device is applied to a first network element, and as shown in Figure 11, it includes at least a first transceiver unit 1101 and a first processing unit 1102. Wherein:
[0232] The first processing unit 1102 is configured to detect a sharing gesture from a user on the first terminal device side; and determine the target content to be shared by the user on the first terminal device side based on the sharing gesture.
[0233] The first transceiver unit 1101 is used to send the identification information of the target content; the identification information of the target content is used to obtain the target content shared by the first terminal device.
[0234] In one possible implementation, in sending the identification information of the target content, the first transceiver unit 1101 is specifically used to: send a first message to the second network element, the first message including information of the sharing gesture and identification information of the target content, wherein the information of the sharing gesture is used by the second network element to send a first request to the third network element, the first request including the identification information of the target content, the first request being used to request the third network element to obtain the target content based on the identification information of the target content.
[0235] In one possible implementation, the target content includes a first target content and / or a second target content. The first target content is a virtual 3D model provided by the resource server, and the second target content is a first 3D model of a physical object in the physical environment where the user is located on the first terminal device side, generated by the first network element.
[0236] In one possible implementation, when the target content only includes the first target content, the first transceiver unit 1101 is further configured to receive a second request from the resource server, the second request including at least one second 3D model; the first processing unit 1102 is further configured to render the at least one second 3D model based on the second request to obtain at least one rendered image, the at least one rendered image corresponding one-to-one with at least one second 3D model; and send the at least one rendered image to the first terminal device to present the at least one rendered image through the first terminal device.
[0237] In determining the target content to be shared by the user on the first terminal device side based on the sharing gesture, the first processing unit 1102 is specifically used for:
[0238] The target rendered image is determined from at least one rendered image based on the sharing gesture;
[0239] The second 3D model corresponding to the target rendered image is determined as the first target content.
[0240] In one possible implementation, when the target content includes a first target content and a second target content, the first transceiver unit 1101 is further configured to receive a second request from a resource server, the second request including at least one second 3D model; the first processing unit 1102 is further configured to render the at least one second 3D model based on the second request to obtain at least one rendered image, the at least one rendered image corresponding one-to-one with at least one second 3D model; send the at least one rendered image to a first terminal device to present the at least one rendered image through the first terminal device; and in response to an operation by a user on the first terminal device on a target rendered image in the at least one rendered image, overlay the target rendered image with a physical object;
[0241] In determining the target content to be shared by the user on the first terminal device side based on the sharing gesture, the first processing unit 1102 is specifically used for:
[0242] The target rendered image and physical object after user sharing and overlay are determined based on the sharing gesture on the first terminal device side;
[0243] The second 3D model corresponding to the target rendered image is determined as the first target content;
[0244] The first 3D model of the physical object is determined as the second target content.
[0245] In one possible implementation, the second request may also include identification information for at least one second 3D model.
[0246] In one possible implementation, when the target content includes a first 3D model, the first processing unit 1102 is further configured to:
[0247] Generate identification information for the second target content.
[0248] In one possible implementation, the first transceiver unit 1101 is further configured to receive a third request from a fourth network element. The third request includes first indication information, which is used to indicate one or more first gestures. The third request is used to request the first network element to enable the recognition function of one or more first gestures and subscribe to the notification of the recognition of one or more first gestures. One or more first gestures include a sharing gesture.
[0249] The first processing unit 1102 is also used to enable the recognition function of one or more first gestures based on the first instruction information.
[0250] In one possible implementation, the first transceiver unit 1101 is further configured to:
[0251] A second message is sent to the fourth network element. The second message indicates that the recognition function of one or more of the first gestures has been successfully activated.
[0252] It should be noted that the implementation of each unit described in FIG11 can also correspond to the descriptions of the embodiments shown in FIG2 to FIG9. Furthermore, the beneficial effects of the content sharing device described in FIG11 can be described in the corresponding descriptions of the embodiments shown in FIG2 to FIG9, and will not be repeated here.
[0253] Please refer to Figure 12, which is a schematic diagram of another content sharing device provided in an embodiment of this application. This device is applied to a third network element, and as shown in Figure 12, it includes at least a second transceiver unit 1201 and a second processing unit 1202. Wherein:
[0254] The second transceiver unit 1201 is used to receive the identification information of the target content. The identification information of the target content is sent by the first network element when it detects the sharing gesture of the user on the first terminal device side and determines the target content shared by the user on the first terminal device side based on the sharing gesture.
[0255] The second processing unit 1202 is used to obtain target content based on the identification information of the target content; and to present the target content through the second terminal device in response to detecting the receiving gesture of the user on the second terminal device side.
[0256] In one possible implementation, the second transceiver unit 1201 is specifically used for receiving the identification information of the target content as follows:
[0257] A first request is received from a second network element. The first request includes the identification information of the target content. The first request is sent by the second network element based on the information of the sharing gesture. The information of the sharing gesture and the identification information of the target content are carried in a first message sent by the first network element to the second network element. The first message is sent by the first network element when it detects the sharing gesture and determines the target content based on the sharing gesture.
[0258] In one possible implementation, the target content includes a first target content and / or a second target content, wherein the first target content is a virtual 3D model provided by the resource server, and the second target content is a first 3D model of a physical object in the physical environment of the user on the first terminal device side generated by the first network element.
[0259] In obtaining target content based on the identifier information of the target content, the second processing unit 1202 is specifically used for:
[0260] The first target content is obtained from the resource server based on the identification information of the first target content;
[0261] And / or,
[0262] The second target content is obtained from the first network element based on the identification information of the second target content.
[0263] In one possible implementation, upon detecting a receiving gesture, the second transceiver unit 1201 is further configured to send a third message to the second network element, the third message being used to notify the second network element that the receiving gesture has been recognized; and to receive a fifth request from the second network element, the fifth request including identification information of the first target content and / or identification information of the second target content, the fifth request being sent by the second network element upon receiving the third message;
[0264] The second processing unit 1202 is also used to render the first target content and / or the second target content based on the fifth request.
[0265] In one possible implementation, if the target content includes a first target content and a second target content, the fifth request also includes position information of the first target content relative to the second target content, and the position information of the first target content relative to the second target content is carried in the first message;
[0266] In rendering the first target content and the second target content, the second processing unit 1202 is specifically used for:
[0267] Based on the positional information of the first target content relative to the second target content, the first target content and the second target content are rendered.
[0268] In one possible implementation, the position information of the first target content relative to the second target content is generated by the first network element overlaying the target rendered image with the physical object in response to the user's operation on the target rendered image on the first terminal device side. The target rendered image is the image of the first target content rendered by the first network element and sent to the first terminal device for presentation.
[0269] In one possible implementation, the second transceiver unit 1201 is further configured to:
[0270] A fourth message is sent to the second terminal device. The fourth message is used to notify the user on the second terminal device that there is shared content from the first terminal device, so as to prompt the user on the second terminal device to perform a receiving gesture.
[0271] In one possible implementation, the second transceiver unit 1201 is further configured to receive a sixth request from the second network element. The sixth request includes second indication information, which is used to indicate one or more second gestures. The sixth request is used to request the third network element to enable the recognition function of one or more second gestures and subscribe to the notification of the recognition of one or more second gestures. The one or more second gestures include receiving gestures. The second indication information is carried in a fourth request sent by the fourth network element to the second network element. The fourth request is used to request the second network element to enable the recognition function of one or more second gestures.
[0272] The second processing unit 1202 is used to enable the recognition function of one or more second gestures based on the second instruction information.
[0273] It should be noted that the implementation of each unit described in FIG12 can also correspond to the descriptions of the embodiments shown in FIG2 to FIG9. Furthermore, the beneficial effects of the content sharing device described in FIG12 can be described in the corresponding descriptions of the embodiments shown in FIG2 to FIG9, and will not be repeated here.
[0274] Based on the descriptions of the above method embodiments, system embodiments, and device embodiments, this application also provides a content sharing device. Please refer to FIG13, which is a schematic diagram of the structure of a content sharing device provided in this application embodiment. The content sharing device includes at least one processor 1301. Optionally, the content sharing device may further include an interface circuit 1302 (shown as dashed lines in the figure), with the processor 1301 and the interface circuit 1302 coupled to each other. It is understood that the interface circuit 1302 can be a transceiver or an input / output interface. Optionally, the content sharing device may further include at least one memory 1303 (shown as dashed lines in the figure), which is used to store instructions (such as one or more computer programs) executed by at least one processor 1301, or to store input data required for at least one processor 1301 to execute instructions, or to store data generated after at least one processor 1301 executes instructions. This content sharing device can be used to execute relevant steps of the content sharing method. The at least one processor 1301 in the content sharing device is used to read the computer program code stored in the at least one memory 1303 and execute the method of any one of the embodiments shown in FIG2 to FIG9.
[0275] At least one memory 1303 includes, but is not limited to, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM), or compact disc read-only memory (CD-ROM).
[0276] At least one processor 1301 may be one or more central processing units (CPUs). When processor 1301 is a CPU, the CPU may be a single-core CPU or a multi-core CPU.
[0277] For example, when the content sharing device is used to implement the function of the first network element, at least one processor 1301 in the content sharing device can be used to read one or more programs stored in the at least one memory 1303 and perform the following operations:
[0278] The user's sharing gesture was detected on the first terminal device side;
[0279] The target content to be shared by the user on the first terminal device side is determined based on the sharing gesture.
[0280] Send the identification information of the target content, which is used to obtain the target content shared by the first terminal device.
[0281] For example, when the content sharing device is used to implement the functions of a third network element, at least one processor 1301 in the content sharing device can be used to read one or more programs stored in the at least one memory 1303 and perform the following operations:
[0282] The identification information of the target content is received. The identification information of the target content is sent by the first network element when it detects the sharing gesture of the user on the first terminal device side and determines the target content shared by the user on the first terminal device side based on the sharing gesture.
[0283] Obtain the target content based on the target content's identifier information;
[0284] In response to the detection of a receiving gesture by the user on the second terminal device, the target content is presented through the second terminal device.
[0285] It should be noted that the implementation of each operation can also correspond to the description of the method in any of the embodiments shown in Figures 2 to 9.
[0286] It should be noted that although the content sharing device shown in FIG13 only illustrates at least one processor 1301, interface circuit 1302, and at least one memory 1303, those skilled in the art should understand that in specific implementations, the content sharing device may also include other devices necessary for normal operation. Furthermore, depending on specific needs, those skilled in the art should understand that the content sharing device may also include hardware devices for implementing other additional functions. Moreover, those skilled in the art should understand that the content sharing device may only include the devices necessary for implementing the embodiments of this application, and not necessarily all the devices shown in FIG13.
[0287] This application also provides a chip, including a processor for calling and running a computer program from a memory, causing a device with the chip installed to perform the method described in any of the embodiments shown in Figures 2 to 9 above. This chip may be a chip in a content sharing device.
[0288] This application also provides a computer-readable storage medium (memory) storing a computer program that, when executed, implements the method described in any of the embodiments shown in Figures 2 to 9. It is understood that the computer-readable storage medium here may include both built-in storage media within a device and extended storage media supported by the device. The computer-readable storage medium provides storage space containing the device's operating system. Furthermore, one or more computer programs suitable for loading and execution by the device's processor are also stored in this storage space. It should be noted that the computer-readable storage medium here may be high-speed RAM or non-volatile memory, such as at least one disk storage device; optionally, it may also be at least one computer-readable storage medium located remotely from the aforementioned processor.
[0289] This application also provides a computer program product, which includes computer program code. When the computer program code is run by a content sharing device, the method flow described in any one of the embodiments in Figures 2 to 9 is implemented.
[0290] Please refer to Figure 14, which is a schematic diagram of a baseband hardware provided in an embodiment of this application. As shown in Figure 14, the baseband can be implemented using a processing system including one or more processors. The processor may include a microprocessor, microcontroller, CPU, graphics processing unit (GPU), or other general-purpose processors, digital signal processors (DSPs), application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), programmable logic devices (PLDs), state machines, gated logic, discrete hardware circuits, and other suitable hardware configured to various functions. That is, the processor used in the baseband can be used to implement any one or more of the processes described below. It should be understood that the content sharing device shown in Figure 13 can be the baseband shown in Figure 14.
[0291] Processing systems can be implemented using a bus architecture, typically represented by a bus. A bus can include any number of interconnect buses and bridges, depending on the specific application and overall design constraints of the processing system. The bus couples various circuits together, including one or more processors (typically represented by a processor), memory, and computer-readable media (typically represented by a computer-readable storage medium). The bus can also link various other circuits, such as timing sources, peripherals, voltage regulators, and power management circuits, which are well-known in the art and will not be described further here. The bus interface provides the interface between the bus and transceivers, as well as between the bus and the interface.
[0292] A transceiver provides a communication interface or means for communicating with various other devices via a wireless transmission medium. The transceiver may be coupled to an antenna array, and the transceiver and antenna array may be used together for communication with a corresponding network type. At least one interface (e.g., a network interface and / or a user interface) provides a communication interface or means for communication via an internal bus or via an external transmission medium.
[0293] The processor manages the bus and general processing, including executing software stored on a computer-readable storage medium. When the processor executes the software, it causes the processing system to perform the various functions described below for any particular device. Functions that can be implemented by the processor, memory, and computer-readable medium may include: gesture recognition, rendering, encoding, decoding, rate matching, rate dematching, scrambling, descrambling, modulation, demodulation, layer mapping, fast Fourier transform (FFT), inverse fast Fourier transform (IFFT), inverse discrete Fourier transform (IDFT), precoding, resource element (RE) mapping, channel equalization, RE demapping, digital beamforming (BF), and so on.
[0294] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.
[0295] It should be understood that the processor mentioned in the embodiments of this application can be a CPU, or other general-purpose processors, DSPs, ASICs, FPGAs, or other PLDs, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor can be a microprocessor or any conventional processor, etc.
[0296] It should also be understood that the memory mentioned in the embodiments of this application can be volatile memory or non-volatile memory, or may include both volatile and non-volatile memory. Non-volatile memory can be ROM, Programmable Read-Only Memory (PROM), EPROM, Electrically Erasable Programmable Read-Only Memory (EEPROM), or flash memory. Volatile memory can be RAM, which is used as an external cache. By way of example, but not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), Synchlink Dynamic Random Access Memory (SLDRAM), and Direct Rambus RAM (DR RAM).
[0297] It should be noted that when the processor is a general-purpose processor, DSP, ASIC, FPGA, or other programmable logic device, discrete gate or transistor logic device, or discrete hardware component, the memory (storage module) is integrated into the processor.
[0298] It should be noted that the memories described herein are intended to include, but are not limited to, these and any other suitable types of memories.
[0299] It should be understood that in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0300] In the several embodiments provided in this application, it should be understood that the disclosed systems, apparatuses, and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely exemplary. For instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or units may be electrical, mechanical, or other forms.
[0301] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0302] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium.
[0303] In this application, "at least one" means one or more, and "more than one" means two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone, where A and B can be singular or plural. In the textual description of this application, the character " / " generally indicates that the preceding and following related objects have an "or" relationship.
[0304] The steps in the method of this application embodiment can be adjusted, combined, or deleted according to actual needs.
[0305] The modules in the device of this application embodiment can be merged, divided, and deleted according to actual needs.
[0306] The above-described embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit it. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.
Claims
1. A content sharing method, characterized in that, Applied to the first network element; the method includes: The user's sharing gesture was detected on the first terminal device side; The target content to be shared by the user on the first terminal device side is determined based on the sharing gesture. The identification information of the target content is sent, and the identification information of the target content is used to obtain the target content shared by the first terminal device.
2. The method according to claim 1, characterized in that, The identification information for sending the target content includes: A first message is sent to the second network element. The first message includes information about the sharing gesture and identification information of the target content. The information about the sharing gesture is used by the second network element to send a first request to the third network element. The first request includes identification information of the target content. The first request is used by the third network element to obtain the target content based on the identification information of the target content.
3. The method according to claim 1 or 2, characterized in that, The target content includes a first target content and / or a second target content. The first target content is a virtual 3D model provided by the resource server, and the second target content is a first 3D model of a physical object in the physical environment where the user on the first terminal device side is located, generated by the first network element.
4. The method according to claim 3, characterized in that, When the target content only includes the first target content, the method further includes: Receive a second request from the resource server, the second request including at least one second three-dimensional model; Based on the second request, the at least one second three-dimensional model is rendered to obtain at least one rendered image, and the at least one rendered image corresponds one-to-one with the at least one second three-dimensional model; Send the at least one rendered image to the first terminal device so that the at least one rendered image can be presented through the first terminal device; The step of determining the target content to be shared by the user on the first terminal device side based on the sharing gesture includes: The target rendered image in the at least one rendered image is determined based on the sharing gesture; The second three-dimensional model corresponding to the target rendered image is determined as the first target content.
5. The method according to claim 3, characterized in that, When the target content includes both the first target content and the second target content, the method further includes: Receive a second request from the resource server, the second request including at least one second three-dimensional model; Based on the second request, the at least one second three-dimensional model is rendered to obtain at least one rendered image, and the at least one rendered image corresponds one-to-one with the at least one second three-dimensional model; Send the at least one rendered image to the first terminal device so that the at least one rendered image can be presented through the first terminal device; In response to an operation by a user on the first terminal device side on a target rendered image in the at least one rendered image, the target rendered image is superimposed on the physical object; The step of determining the target content to be shared by the user on the first terminal device side based on the sharing gesture includes: Based on the sharing gesture, the target rendered image and the physical object shared and superimposed by the user on the first terminal device side are determined; The second three-dimensional model corresponding to the target rendered image is determined as the first target content; The first three-dimensional model of the physical object is determined as the second target content.
6. The method according to claim 5, characterized in that, The first message also includes position information of the first target content relative to the second target content. The position information of the first target content relative to the second target content is generated based on the superposition of the target rendered image and the physical object. The position information of the first target content relative to the second target content is used by the third network element to render the first target content and the second target content based on the position information.
7. The method according to any one of claims 4-6, characterized in that, The second request also includes identification information of the at least one second three-dimensional model.
8. The method according to claim 3, characterized in that, If the target content includes the second target content, the method further includes: Generate the identification information for the second target content.
9. The method according to any one of claims 1-8, characterized in that, The method further includes: The system receives a third request from a fourth network element. The third request includes first indication information, which is used to indicate one or more first gestures. The third request is used to request the first network element to enable the recognition function of the one or more first gestures and subscribe to the notification of the recognition of the one or more first gestures. The one or more first gestures include the sharing gesture. The recognition function of one or more first gestures is activated based on the first instruction information.
10. The method according to claim 9, characterized in that, The method further includes: A second message is sent to the fourth network element, the second message indicating that the recognition function of one or more first gestures has been successfully enabled.
11. A content sharing method, characterized in that, Applied to a third network element; the method includes: The identification information of the target content is received. The identification information of the target content is sent by the first network element when it detects the sharing gesture of the user on the first terminal device side and determines the target content shared by the user on the first terminal device side based on the sharing gesture. The target content is obtained based on the identification information of the target content; In response to detecting a receiving gesture from a user on the second terminal device, the target content is presented via the second terminal device.
12. The method according to claim 11, characterized in that, The identification information for receiving the target content includes: A first request is received from a second network element. The first request includes the identification information of the target content. The first request is sent by the second network element based on the information of the sharing gesture. The information of the sharing gesture and the identification information of the target content are carried in a first message sent by the first network element to the second network element. The first message is sent by the first network element when it detects the sharing gesture and determines the target content based on the sharing gesture.
13. The method according to claim 11 or 12, characterized in that, The target content includes a first target content and / or a second target content. The first target content is a virtual three-dimensional model provided by the resource server, and the second target content is a first three-dimensional model of a physical object in the physical environment where the user is located on the first terminal device side, generated by the first network element. Obtaining the target content based on the identifier information of the target content includes: The first target content is obtained from the resource server based on the identification information of the first target content; And / or, The second target content is obtained from the first network element based on the identification information of the second target content.
14. The method according to claim 13, characterized in that, If the receiving gesture is detected, the method further includes: Send a third message to the second network element, the third message being used to notify the second network element that the receiving gesture has been recognized; Receive a fifth request from the second network element, the fifth request including the identification information of the first target content and / or the identification information of the second target content, the fifth request being sent by the second network element upon receiving the third message; Render the first target content and / or the second target content based on the fifth request.
15. The method according to claim 13, characterized in that, When the target content includes the first target content and the second target content, the fifth request further includes the position information of the first target content relative to the second target content, and the position information of the first target content relative to the second target content is carried in the first message; The rendering of the first target content and the second target content includes: Based on the positional information of the first target content relative to the second target content, the first target content and the second target content are rendered.
16. The method according to claim 15, characterized in that, The position information of the first target content relative to the second target content is generated by the first network element superimposing the target rendered image with the physical object in response to the user's operation on the target rendered image on the first terminal device side. The target rendered image is the image of the first target content rendered by the first network element and sent to the first terminal device for presentation.
17. The method according to any one of claims 11-16, characterized in that, The method further includes: A fourth message is sent to the second terminal device. The fourth message is used to notify the user on the second terminal device that there is shared content from the first terminal device, so as to prompt the user on the second terminal device to perform the receiving gesture.
18. The method according to any one of claims 11-17, characterized in that, The method further includes: A sixth request is received from the second network element. The sixth request includes second indication information, which is used to indicate one or more second gestures. The sixth request is used to request the third network element to enable the recognition function of the one or more second gestures and subscribe to the notification of the recognition of the one or more second gestures. The one or more second gestures include the receiving gesture. The second indication information is carried in a fourth request sent by the fourth network element to the second network element. The fourth request is used to request the second network element to enable the recognition function of the one or more second gestures. The recognition function of one or more second gestures is activated based on the second instruction information.
19. A content sharing system, characterized in that, Including the first network element and the third network element; among which: The first network element detects a sharing gesture from a user on the first terminal device side; determines the target content to be shared by the user on the first terminal device side based on the sharing gesture; and sends the identification information of the target content. The third network element receives the identification information of the target content; obtains the target content based on the identification information of the target content; and, in response to detecting a receiving gesture from a user on the second terminal device, presents the target content through the second terminal device.
20. A content sharing system, characterized in that, It includes a first network element and a third network element; wherein the first network element is used to perform the method as described in any one of claims 1-10; and the third network element is used to perform the method as described in any one of claims 11-18.
21. A content sharing device, characterized in that, It includes a module for performing the method as described in any one of claims 1-10; or, it includes a module for performing the method as described in any one of claims 11-18.
22. A content sharing device, characterized in that, The device includes at least one processor coupled to at least one memory for storing one or more computer programs; the at least one processor is configured such that when the content sharing device executes the one or more computer programs, it implements the method as claimed in any one of claims 1-10 or 11-18.
23. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program for execution by the device, which, when executed, implements the method as claimed in any one of claims 1-10 or 11-18.
24. A computer program product, characterized in that, When the computer program product is run by the device, the device performs the method as claimed in any one of claims 1-10 or 11-18.