Virtual item issuing method, receiving method, system, display device, and medium

Abstract

Embodiments of the present disclosure disclose a virtual item issuing method, a receiving method, a system, a display device and a medium. A specific embodiment of the method comprises: scanning a physical space by a spatial scanning device on a head-mounted display device of a sending end to construct a three-dimensional scene map under a world coordinate system of the sending end; displaying an item configuration window in a three-dimensional display space of the head-mounted display device; in response to detecting a sending trigger operation, collecting sending action information of a sending user; based on the sending action information, generating motion trajectory information corresponding to at least one virtual item; based on the motion trajectory information and item configuration information corresponding to the item configuration window, displaying the three-dimensional scene map and the at least one virtual item in the three-dimensional display space; and sending the three-dimensional scene map, the item configuration information and the motion trajectory information to at least one associated receiving end. The embodiment improves user experience.

Description

TECHNICAL FIELD

[0001] Embodiments of the present disclosure relate to the field of computer technology, and in particular, to a virtual item issuing method, a receiving method, a system, a display device and a medium. BACKGROUND

[0002] With the development of computer technology, the rise and popularity of sending virtual items (for example, electronic red packets, virtual gold coins, virtual gold ingots) through a network, virtual item issuing is a technology for sending virtual items. At present, when sending virtual items, the commonly used way is to send virtual items (for example, electronic red packets) through an application on a mobile device or to send virtual items through a page trigger.

[0003] However, when sending virtual items in the above way, the following technical problems often exist:

[0004] Sending virtual items (for example, electronic red packets) through an application on a mobile device or sending virtual items through a page trigger does not involve a real throwing process, and the sending user can only see a two-dimensional item image and a text prompt, and cannot feel the throwing process of the virtual item in a three-dimensional scene, resulting in poor user experience.

[0005] The above information disclosed in the background section is only intended to enhance the understanding of the background of the present inventive concept, and therefore, it can include information that does not form the prior art known to those of ordinary skill in the art. SUMMARY

[0006] The summary section of the present disclosure is used to introduce the concept in a brief form, which will be described in detail in the specific embodiments section. The summary section of the present disclosure is not intended to identify key or essential features of the claimed technical solution, nor is it intended to limit the scope of the claimed technical solution.

[0007] Some embodiments of the present disclosure propose a virtual item issuing method, a virtual item receiving method, a virtual item issuing and receiving system, a head-mounted display device and a computer readable medium to solve one or more of the technical problems mentioned in the background section.

[0008] In a first aspect, some embodiments of the present disclosure provide a virtual item delivery method applied to a sending end, the method comprising: scanning a physical space through a spatial scanning device on a head-mounted display device of the sending end to construct a three-dimensional scene map in a world coordinate system of the sending end; displaying an item configuration window in a three-dimensional display space of the head-mounted display device; in response to detecting a sending trigger operation, collecting sending action information of a sending user; based on the sending action information, generating motion trajectory information of at least one virtual item; based on the motion trajectory information and item configuration information corresponding to the item configuration window, displaying the three-dimensional scene map and the at least one virtual item in the three-dimensional display space, wherein the at least one virtual item is displayed in the three-dimensional scene map, and the at least one virtual item moves from a preset point outward in the three-dimensional scene map; and sending the three-dimensional scene map, the item configuration information, and the motion trajectory information to at least one associated receiving end.

[0009] Optionally, the method further comprises: scanning the physical space through the spatial scanning device on the head-mounted display device of the sending end to obtain a physical space image sequence; and based on the physical space image sequence, constructing a point cloud map corresponding to the physical space in the world coordinate system of the sending end as the three-dimensional scene map.

[0010] Optionally, the method further comprises: determining at least one configuration item information configured by the sending user in the item configuration window as the item configuration information, wherein the item configuration information comprises at least one of the following: item quantity information, item value information, and single-trigger item quantity information.

[0011] Optionally, the method further comprises: dividing the spatial point coordinate information sequence to obtain a sequence of divided spatial point coordinate information groups, wherein each divided spatial point coordinate information group in the sequence of divided spatial point coordinate information groups comprises preceding spatial coordinate point information and subsequent spatial coordinate point information; based on the sequence of divided spatial point coordinate information groups, generating an item throwing information sequence; and based on the item throwing information sequence, generating motion trajectory information of at least one virtual item, wherein the motion trajectory information comprises each spatial passing point coordinate information, and each spatial passing point coordinate information corresponds to a passing time point.

[0012] Optionally, the method further comprises: for each of the divided space point coordinate information groups, performing the following steps: determining a time interval between a collection time corresponding to the previous space coordinate point information in the divided space point coordinate information group and a collection time corresponding to the subsequent space coordinate point information; generating movement speed information corresponding to the divided space point coordinate information group based on the previous space coordinate point information, the subsequent space coordinate point information, and the time interval; generating movement direction information corresponding to the divided space point coordinate information group based on the previous space coordinate point information and the subsequent space coordinate point information; determining the movement speed information and the movement direction information as the item throwing information; and generating a sequence of item throwing information based on the determined item throwing information.

[0013] In a second aspect, some embodiments of the present disclosure provide a virtual item receiving method applied to a receiving end, which comprises: scanning a physical space through a space scanning device on a receiving head-mounted display device of the receiving end to construct a receiving three-dimensional scene map in a world coordinate system of the receiving end; generating conversion matrix information from a three-dimensional scene map to a receiving three-dimensional scene map based on the receiving three-dimensional scene map and a three-dimensional scene map sent by a sending end; generating receiving movement trajectory information of a virtual item in the world coordinate system of the receiving end based on the conversion matrix information and movement trajectory information sent by the sending end; displaying at least one virtual item and the receiving three-dimensional scene map in a three-dimensional display space of the receiving head-mounted display device based on item configuration information sent by the sending end and the receiving movement trajectory information, wherein the at least one virtual item is displayed in the receiving three-dimensional scene map and moves from a preset point to a direction of a receiving user; collecting receiving action information of the receiving user; generating space touch detection information based on the receiving action information and the receiving movement trajectory information; and performing virtual item receiving interaction feedback processing based on the space touch detection information.

[0014] Optionally, the method further comprises: performing feature point matching processing on the receiving three-dimensional scene map and the three-dimensional scene map to obtain a plurality of matched point cloud data point groups, wherein each of the matched point cloud data point groups comprises a receiving scene point cloud data point and a sending scene point cloud data point; generating a rotation matrix and a translation matrix based on the plurality of matched point cloud data point groups; and determining the rotation matrix and the translation matrix as the conversion matrix information from the three-dimensional scene map to the receiving three-dimensional scene map.

[0015] Optionally, the method further comprises: determining each collection time point corresponding to the received action information and each passing time point corresponding to the received motion trajectory information; determining the intersection of each collection time point and each passing time point to obtain each target time point; for each target time point in the target time points, performing the following spatial touch detection step: determining the spatial passing point coordinate information corresponding to the target time point as the to-be-detected spatial passing point coordinate information; generating bounding box space information based on each hand key point spatial coordinate information included in the received user hand posture information corresponding to the target time point; in response to determining that the spatial position corresponding to the to-be-detected spatial passing point coordinate information is within the spatial region corresponding to the bounding box space information, determining information representing that the virtual object and the receiving user exist in touch as spatial touch information; and in response to determining that the number of determined spatial touch information is greater than a preset value, determining information representing that there is spatial touch as spatial touch detection information.

[0016] Optionally, the method further comprises: sending the spatial touch detection information to a preset processing device, so that the preset processing device generates capture event information and virtual object has been collected information; and in response to receiving the capture event information sent by the preset processing device, performing virtual object receiving interaction feedback processing.

[0017] In a third aspect, some embodiments of the present disclosure provide a virtual object distribution and receiving system, comprising: the preset processing device, the sending end, and at least one receiving end, wherein the sending end is configured to perform the method described in any one of the implementations of the first aspect; each receiving end in the at least one receiving end is configured to perform the method described in any one of the implementations of the second aspect; and the preset processing device is configured to perform capture state synchronization processing.

[0018] Optionally, the preset processing device is configured to perform capture state synchronization processing, comprising: receiving at least one spatial touch detection information sent by at least one receiving end; generating capture event information and virtual object has been collected information based on the at least one spatial touch detection information, wherein the capture event information has a corresponding receiving end identifier; sending the capture event information to the receiving end corresponding to the receiving end identifier; and sending the virtual object has been collected information to the sending end and at least one target receiving end.

[0019] The above various embodiments of the present disclosure have the following beneficial effects: through the virtual item issuing method of some embodiments of the present disclosure, the user experience is improved. Specifically, the reason why the user experience is poor is that sending a virtual item (for example, an electronic red envelope) through an application on a mobile device or sending a virtual item through a page trigger does not involve a real throwing process, and the sending user can only see a two-dimensional item image and a text prompt, and cannot feel the throwing process of the virtual item in a three-dimensional scene, so the user experience is poor. Based on this, the virtual item issuing method of some embodiments of the present disclosure first scans the physical space through a spatial scanning device on the head-mounted display device of the sending end to construct a three-dimensional scene map in the world coordinate system of the sending end. Thus, a three-dimensional scene map of the physical space where the sending user is located can be constructed. Then, an item configuration window is displayed in the three-dimensional display space of the above head-mounted display device. Thus, the item configuration window can be displayed for the sending user to configure the virtual item. Then, in response to detecting a sending trigger operation, the sending action information of the sending user is collected. Thus, after detecting the trigger operation of sending the item, the action information of the sending user sending the item can be collected. Then, based on the above sending action information, the motion trajectory information of at least one virtual item is generated. Thus, the motion trajectory information of at least one virtual item in a three-dimensional scene can be generated according to the sending action information. Then, based on the above motion trajectory information and the item configuration information corresponding to the above item configuration window, the three-dimensional scene map and the above at least one virtual item are displayed in the above three-dimensional display space, wherein the above at least one virtual item is displayed in the above three-dimensional scene map, and the above at least one virtual item moves from a preset point to the outside in the above three-dimensional scene map. Thus, the throwing process of the item in the three-dimensional scene can be displayed by displaying the motion of the virtual item in the three-dimensional scene map in the three-dimensional display space. Then, the above three-dimensional scene map, the above item configuration information and the above motion trajectory information are sent to at least one associated receiving end. Also because the three-dimensional scene map of the physical space where the sending user is located is created before sending the virtual item. By collecting the action information of the sending user sending the item, displaying at least one virtual item in the three-dimensional scene map displayed by the three-dimensional display space, and displaying the throwing process of the item in the three-dimensional scene, the user experience is improved. BRIEF DESCRIPTION OF DRAWINGS

[0020] The above and other features, advantages, and aspects of the embodiments of the present disclosure will become more apparent by describing in detail some embodiments thereof with reference to the attached drawings. Throughout the drawings, the same or similar reference numerals refer to the same or similar elements. It should be understood that the drawings are schematic, and elements and elements are not necessarily drawn to scale.

[0021] Figure 1 is a flowchart of some embodiments of the virtual item issuing method according to the present disclosure;

[0022] Figure 2 is a flowchart of another embodiment of a virtual item issuance method according to the present disclosure;

[0023] Figure 3 is a flowchart of some embodiments of a virtual item reception method according to the present disclosure;

[0024] Figure 4 is an architectural diagram of an exemplary system of a virtual item issuance and reception system according to the present disclosure;

[0025] Figure 5 is a structural schematic diagram of a head-mounted display device suitable for use to implement some embodiments of the present disclosure. DETAILED DESCRIPTION

[0026] Embodiments of the present disclosure will be described below in greater detail with reference to the accompanying drawings. While certain embodiments of the present disclosure are shown in the drawings, it is understood that the present disclosure can be embodied in various forms and should not be construed as being limited to the embodiments set forth herein. Rather, these embodiments are provided so that the present disclosure will be thoroughly and completely understood. It should be understood that the drawings of the present disclosure and the embodiments thereof are only for illustrative purposes and are not intended to limit the scope of protection of the present disclosure.

[0027] It should also be noted that, for the sake of brevity, only the portions of the drawings that are relevant to the present disclosure are shown. The embodiments in the present disclosure and the features in the embodiments can be combined with each other in the case of no conflict.

[0028] It should be noted that the terms “first”, “second”, and the like in the present disclosure are only used to distinguish different devices, modules, or units, and are not intended to limit the order or interdependence of the functions performed by these devices, modules, or units.

[0029] It should be noted that the terms “one”, “multiple” in the present disclosure are illustrative and not restrictive, and those skilled in the art should understand that, unless otherwise explicitly stated in the context, it should be understood as “one or more”.

[0030] The names of the messages or information exchanged between the devices in the embodiments of the present disclosure are only for illustrative purposes, and are not intended to limit the scope of the messages or information.

[0031] The present disclosure will be described in detail below with reference to the accompanying drawings and in conjunction with the embodiments.

[0032] Figure 1 A flowchart 100 of some embodiments of a virtual item issuance method according to the present disclosure is shown. The virtual item issuance method includes the following steps:

[0033] Step 101, scanning the physical space through the space scanning device on the head-mounted display device of the sending end to construct a three-dimensional scene map under the world coordinate system of the sending end.

[0034] In some embodiments, the execution subject of the virtual item issuing method (for example, the head-mounted display device worn by the sending user) can scan the physical space through the space scanning device on the head-mounted display device of the sending end to construct a three-dimensional scene map under the world coordinate system of the sending end. Wherein, the above-mentioned head-mounted display device can be but not limited to: AR glasses, VR glasses, MR glasses, which are not specifically limited here. The above-mentioned space scanning device can be a camera, a depth camera or a camera for capturing and recording the surrounding physical environment. In practice, first, the above-mentioned execution subject can scan the physical space through the above-mentioned space scanning device to obtain various space images of the physical space at various angles. Then, through image stitching technology, the collected various space images are stitched into a panoramic map representing the physical space. After that, the above-mentioned execution subject can process the above-mentioned panoramic map through virtual reality technology to obtain a VR panoramic map. Finally, the above-mentioned execution subject can extract three-dimensional information of the physical space from the above-mentioned VR panoramic map through three-dimensional reconstruction technology, and generate a corresponding three-dimensional digital model as a three-dimensional scene map. Wherein, the world coordinate system of the sending end can be a world coordinate system with the spatial position coordinates of a preset point on the space scanning device of the sending end as the coordinate system origin.

[0035] In some optional implementations of some embodiments, the above-mentioned execution subject can scan the physical space through the space scanning device on the head-mounted display device of the sending end to construct a three-dimensional scene map under the world coordinate system of the sending end by the following steps:

[0036] First, scan the physical space through the space scanning device on the head-mounted display device of the sending end to obtain a physical space image sequence. Wherein, each physical space image in the above-mentioned physical space image sequence can be each image of the above-mentioned physical space taken at each angle.

[0037] Second, based on the above-mentioned physical space image sequence, construct a point cloud map corresponding to the physical space under the world coordinate system of the sending end as a three-dimensional scene map. In practice, the above-mentioned subject execution subject can generate a point cloud map corresponding to the above-mentioned physical space image sequence through SLAM algorithm. Then, the above-mentioned execution subject can determine the above-mentioned point cloud map as a three-dimensional scene map under the world coordinate system of the sending end.

[0038] Step 102, displaying an item configuration window in the three-dimensional display space of the head-mounted display device.

[0039] In some embodiments, the execution subject can display an item configuration window in a three-dimensional display space of the aforementioned head-mounted display device. The three-dimensional display space can be a virtual three-dimensional space. The item configuration window can be a window for configuring attribute information of a virtual item. The attribute information can include, but is not limited to, at least one of the following: item quantity information, item value information, and single-trigger item quantity information. The item quantity information can represent the quantity of virtual items to be sent. The item value information can represent the value of the virtual item. The single-trigger item quantity information can represent the quantity of virtual items to be sent at one time when a sending trigger is activated. The virtual item can be a digital object (for example, a virtual red packet, a virtual gift, a virtual decoration, etc.) presented in an augmented reality environment.

[0040] In some optional implementations of some embodiments, the execution subject can determine at least one configuration item information configured by the sending user in the item configuration window as item configuration information. The item configuration information can include at least one of the following: item quantity information, item value information, and single-trigger item quantity information. In practice, the sending user can configure the item configuration information in the item configuration window by using gesture, eye movement, ray, etc. The sending user can be a user who configures the item configuration information of the virtual item and sends the virtual item by using the head-mounted display device.

[0041] Thus, the item configuration information of the virtual item can be determined by the aforementioned embodiments.

[0042] In step 103, the sending action information of the sending user is collected in response to detecting a sending trigger operation.

[0043] In some embodiments, the execution subject can collect the sending action information of the sending user in response to detecting a sending trigger operation. The trigger operation can include, but is not limited to, one of the following: gesture trigger, touch trigger. The sending action information can represent the information of the hand throwing action of the sender. The sending action information can be the spatial coordinates of a preset point in the wrist of the wrist during the movement of the wrist in the three-dimensional space. The sending action information includes a sequence of spatial point coordinate information, and each spatial point coordinate information in the sequence of spatial point coordinate information corresponds to a collection time. The spatial point coordinate information can represent the position of the preset point in the wrist in the three-dimensional space. In practice, the execution subject can collect the sending action information of the sending user by using a tracker.

[0044] In step 104, the movement trajectory information of at least one virtual item is generated based on the sending action information.

[0045] In some embodiments, the execution subject can generate motion trajectory information of the at least one virtual object based on the sending action information. The motion trajectory information can represent the motion trajectory of the at least one virtual object after being thrown in the three-dimensional space. The motion trajectory information includes various spatial passing point coordinate information, and each spatial passing point coordinate information in the motion trajectory information corresponds to a passing time point. Each spatial passing point coordinate information can be a three-dimensional coordinate. In practice, the execution subject can input the spatial point coordinate information sequence included in the sending action information and the various collection time corresponding to each spatial point coordinate information in the spatial point coordinate information sequence into a pre-created object motion rule model to obtain the various spatial passing point coordinate information and the various passing time points. Each spatial passing point coordinate information corresponds to each passing time point. The object motion rule model can be a dynamics model.

[0046] In some optional implementations of some embodiments, the execution subject can generate the motion trajectory information of the at least one virtual object based on the sending action information by the following steps:

[0047] Firstly, the spatial point coordinate information sequence is divided to obtain a sequence of divided spatial point coordinate information groups. Each divided spatial point coordinate information group in the sequence of divided spatial point coordinate information groups includes preceding spatial coordinate point information and subsequent spatial coordinate point information. In practice, the execution subject can perform sliding window division on the spatial point coordinate information sequence according to a preset sliding step and a preset sliding window size to obtain the sequence of divided spatial point coordinate information groups.

[0048] Secondly, the sequence of object throwing information is generated based on the sequence of divided spatial point coordinate information groups.

[0049] Thirdly, the motion trajectory information of the at least one virtual object is generated based on the sequence of object throwing information. In practice, first, the execution subject can adjust the preset parameter information (such as gravity acceleration, air resistance coefficient, boundary condition, etc.) to the parameters of the physical engine. Then, the execution subject can input the last object throwing information in the sequence of object throwing information into the physical engine to simulate the motion trajectory of the at least one virtual object in the three-dimensional space and obtain the motion trajectory information of the at least one virtual object. The physical engine can be a virtual engine (for example, Unity physical engine, Chaos physical engine) for simulating the motion of virtual objects in the three-dimensional space.

[0050] Therefore, the motion trajectory of the virtual object in the three-dimensional space can be simulated based on the sending action information of the sending user by the above embodiments.

[0051] In some optional implementations of some embodiments, the execution subject can generate a sequence of item throwing information based on the sequence of divided space point coordinate information groups by the following steps:

[0052] Firstly, for each divided space point coordinate information group in the sequence of divided space point coordinate information groups, the following steps are performed:

[0053] Firstly, determine the time interval between the collection time corresponding to the previous space coordinate point information and the collection time corresponding to the subsequent space coordinate point information in the divided space point coordinate information group.

[0054] Secondly, generate the moving speed information corresponding to the divided space point coordinate information group based on the previous space coordinate point information, the subsequent space coordinate point information and the time interval. In practice, the execution subject can determine the distance between the space position corresponding to the previous space coordinate point information and the space position corresponding to the subsequent space coordinate point information as the target distance. Then, the time interval between the collection time corresponding to the subsequent space coordinate point information and the collection time corresponding to the previous space coordinate point information is determined as the target time interval. Then, the execution subject can determine the ratio of the target distance to the target time interval as the moving speed information. As an example, the previous space coordinate point information can be (x t y t z t ), the subsequent space coordinate point information can be (x t+1 y t+1 z t+1 ), the target distance can be The target time interval can be (t+1)-t, and the moving speed information can be

[0055] Thirdly, generate the moving direction information corresponding to the divided space point coordinate information group based on the previous space coordinate point information and the subsequent space coordinate point information. In practice, the moving direction information can be the vector from the space position corresponding to the previous space coordinate point information to the space position corresponding to the subsequent space coordinate point information. As an example, the moving direction information can be represented as

[0056] Fourthly, determine the moving speed information and the moving direction information as the item throwing information.

[0057] ​Secondly, based on the determined each item throwing information, an item throwing information sequence is generated. In practice, the subject can arrange each item throwing information in the item throwing information sequence according to the order of the divided space point coordinate information groups corresponding to the item throwing information in the divided space point coordinate information group sequence.

[0058] Thus, the item throwing information sequence representing the moving speed and moving direction of the preset point in the wrist of the sending user at each space coordinate in the path of the wrist in the three-dimensional space during the movement of the wrist can be determined according to the above embodiments.

[0059] Step 105, based on the motion trajectory information and the item configuration information corresponding to the item configuration window, displaying a three-dimensional scene map and at least one virtual item in the three-dimensional display space.

[0060] In some embodiments, the execution subject can display a three-dimensional scene map and the at least one virtual item in the three-dimensional display space based on the motion trajectory information and the item configuration information corresponding to the item configuration window. The at least one virtual item is displayed in the three-dimensional scene map, and the at least one virtual item moves outward from a preset point in the three-dimensional scene map. In practice, the execution subject can determine each path time point corresponding to each space passing point coordinate information included in the motion trajectory information. Then, in the three-dimensional scene map displayed in the three-dimensional display space, the at least one virtual item (for example, a virtual red packet or a virtual gold coin) corresponding to the item configuration information is displayed at the position corresponding to the space passing point coordinate information at the path time point in sequence. The preset point can be the space point position corresponding to the space passing point coordinate information in the motion trajectory information.

[0061] Before the above method, the method further includes: firstly, based on the motion trajectory information and the item configuration information, performing real-time rendering processing on the at least one virtual item by using real-time rendering technology. Then, the rendered virtual item is projected into the field of view of the sending user through an optical display system (such as a micro projector or a transparent display screen), and is superimposed with the real scene. Thus, the sending user can see the superimposed effect of the real world and the at least one virtual item at the same time. Step 106, sending the three-dimensional scene map, the item configuration information and the motion trajectory information to at least one associated receiving end.

[0062] In some embodiments, the execution subject can send the three-dimensional scene map, the item configuration information and the motion trajectory information to at least one associated receiving end. Each receiving end in the at least one receiving end can be a head-mounted display device worn by a receiving user.

[0063] The above various embodiments of the present disclosure have the following beneficial effects: through the virtual item issuing method of some embodiments of the present disclosure, the user experience is improved. Specifically, the reason why the user experience is poor is that sending a virtual item (for example, an electronic red envelope) through an application on a mobile device or sending a virtual item through a page trigger does not involve a real throwing process, and the sending user can only see a two-dimensional item image and a text prompt, and cannot feel the throwing process of the virtual item in a three-dimensional scene, resulting in poor user experience. Based on this, the virtual item issuing method of some embodiments of the present disclosure first scans the physical space through a space scanning device on the head-mounted display device of the sending end to construct a three-dimensional scene map under the world coordinate system of the sending end. Thus, a three-dimensional scene map of the physical space where the sending user is located can be constructed. Then, an item configuration window is displayed in the three-dimensional display space of the above head-mounted display device. Thus, the item configuration window can be displayed for the sending user to configure the virtual item. Then, in response to detecting a sending trigger operation, the sending action information of the sending user is collected. Thus, after detecting the trigger operation of sending the item, the action information of the sending user sending the item can be collected. Then, based on the above sending action information, the motion trajectory information of at least one virtual item is generated. Thus, the motion trajectory information of at least one virtual item in a three-dimensional scene can be generated according to the sending action information. Then, based on the above motion trajectory information and the item configuration information corresponding to the above item configuration window, the three-dimensional scene map and the above at least one virtual item are displayed in the above three-dimensional display space, wherein the above at least one virtual item is displayed in the above three-dimensional scene map, and the above at least one virtual item moves from a preset point to the outside in the above three-dimensional scene map. Thus, the throwing process of the item in the three-dimensional scene can be displayed by displaying the motion of the virtual item in the three-dimensional scene map in the three-dimensional display space. Then, the above three-dimensional scene map, the above item configuration information and the above motion trajectory information are sent to at least one associated receiving end. Also because the three-dimensional scene map of the physical space where the sending user is located is created before sending the virtual item. By collecting the action information of the sending user sending the item, displaying at least one virtual item in the three-dimensional scene map displayed by the three-dimensional display space, and displaying the throwing process of the item in the three-dimensional scene, the user experience is improved.

[0064] Further reference is made to Figure 2 which shows the flow 200 of some other embodiments of the virtual item issuing method. The flow 200 of the three-dimensional scene configuration method includes the following steps:

[0065] Step 201, scanning the physical space through a space scanning device on the head-mounted display device of the sending end to construct a three-dimensional scene map under the world coordinate system of the sending end.

[0066] Step 202, displaying an item configuration window in the three-dimensional display space of the head-mounted display device.

[0067] Step 202, in response to detecting the sending trigger operation, collecting sending action information of the sending user.

[0068] Step 204, generating motion trajectory information corresponding to at least one virtual item based on the sending action information.

[0069] Step 205, displaying a three-dimensional scene map and at least one virtual item in the three-dimensional display space based on the motion trajectory information and the item configuration information corresponding to the item configuration window.

[0070] Step 206, sending the three-dimensional scene map, the item configuration information and the motion trajectory information to at least one associated receiving end.

[0071] In some embodiments, the specific implementation of steps 201-206 and the resulting technical effects can refer to Figure 1 The steps 101-106 in the corresponding embodiments are not described here.

[0072] Step 207, scanning the physical space through a space scanning device on the head-mounted display device of the sending end to obtain a physical space image sequence.

[0073] In some embodiments, the execution subject of the virtual item issuing method (for example, the processor built-in in the head-mounted display device worn by the sending user) can scan the physical space through a space scanning device on the head-mounted display device of the sending end to obtain a physical space image sequence.

[0074] Step 208, constructing a point cloud map corresponding to the physical space in the world coordinate system of the sending end as the three-dimensional scene map based on the physical space image sequence.

[0075] In some embodiments, the above execution subject can construct a point cloud map corresponding to the physical space in the world coordinate system of the sending end as the three-dimensional scene map based on the above physical space image sequence.

[0076] From Figure 2 It can be seen that, compared with Figure 1 the description of some embodiments corresponding to Figure 2The flow 200 of the virtual item sending method in some embodiments corresponds to the flow of the virtual item receiving method. The flow 200 of the virtual item sending method embodies that a physical space is scanned by a spatial scanning device on a head-mounted display device to obtain a physical space image sequence. A point cloud map representing the physical space in a world coordinate system of a sending end is generated based on the physical space image sequence. The point cloud map can be used to represent any type of three-dimensional shape, including irregular shapes, with high flexibility, and can represent objects or scenes in the real world, making the map more vivid, intuitive, and three-dimensional. Through the point cloud map, users can more clearly understand the objects or scenes in the real world, improve the user's understanding of the scene, and further improve the user's experience.

[0077] Figure 3 The flow 300 of some embodiments of the virtual item receiving method according to the present disclosure is shown. The virtual item receiving method includes the following steps:

[0078] Step 301, a physical space is scanned by a spatial scanning device on a receiving head-mounted display device of a receiving end to construct a receiving three-dimensional scene map in a world coordinate system of the receiving end.

[0079] In some embodiments, the execution subject of the virtual item receiving method (for example, a head-mounted display device worn by a receiving user) can scan a physical space by a spatial scanning device on a receiving head-mounted display device of a receiving end to construct a receiving three-dimensional scene map in a world coordinate system of the receiving end. The receiving head-mounted display device can be a head-mounted display device worn by the receiver. In practice, first, the execution subject can scan a physical space by a spatial scanning device on a receiving head-mounted display device to obtain a receiving physical space image sequence. Then, the execution subject can generate a point cloud map corresponding to the receiving physical space image sequence by a SLAM algorithm. After that, the execution subject can determine the point cloud map as a receiving three-dimensional scene map in a world coordinate system of the receiving end. The world coordinate system of the receiving end can be a world coordinate system in which the spatial position coordinates of a preset point on the spatial scanning device of the receiving end are the coordinates of the origin.

[0080] Step 302, based on the receiving three-dimensional scene map and the associated three-dimensional scene map sent by the sending end, a conversion matrix information from the three-dimensional scene map to the receiving three-dimensional scene map is generated.

[0081] In some embodiments, the execution subject can generate the conversion matrix information from the three-dimensional scene map to the received three-dimensional scene map based on the received three-dimensional scene map and the three-dimensional scene map sent by the associated sending end. The received three-dimensional scene map includes respective received scene point cloud data points, and the three-dimensional scene map includes respective sending scene point cloud data points. Each of the respective received scene point cloud data points can represent a spatial point in the three-dimensional scene where the receiving user is located. The received scene point cloud data points can include, but are not limited to, at least one of the following: three-dimensional coordinates, spatial point attribute information (such as color, reflectivity, intensity, etc.). Each of the respective sending scene point cloud data points can represent a spatial point in the three-dimensional scene where the sender is located. The sending scene point cloud data points can include, but are not limited to, at least one of the following: three-dimensional coordinates, spatial point attribute information (such as color, reflectivity, intensity, etc.). In practice, the execution subject can generate a rotation matrix and a translation matrix from the three-dimensional scene map to the received three-dimensional scene map by using an iterative closest point (ICP) algorithm. Then, the execution subject can determine the rotation matrix and the translation matrix as the conversion matrix information.

[0082] In some optional implementations of some embodiments, the execution subject can generate the conversion matrix information from the three-dimensional scene map to the received three-dimensional scene map based on the received three-dimensional scene map and the three-dimensional scene map sent by the associated sending end by the following steps:

[0083] First, feature point matching processing is performed on the received three-dimensional scene map and the three-dimensional scene map to obtain respective matching point cloud data point groups. Each of the respective matching point cloud data point groups includes a received scene point cloud data point and a sending scene point cloud data point. In practice, the execution subject can perform feature point matching processing on the received three-dimensional scene map and the three-dimensional scene map by using a pre-set image feature point matching algorithm (such as a SIFT (Scale Invariant Feature Transform) algorithm, an ORB (Oriented FAST and Rotated BRIEF) algorithm) to obtain respective matching point cloud data point groups.

[0084] Secondly, based on the above each matched point cloud data group, a rotation matrix and a translation matrix are generated. In practice, the above execution subject can remove the noise matched point cloud data group (i.e. the incorrect matched point cloud data group) from the above each matched point cloud data group by using the nearest neighbor method, RANSAC algorithm or the like to obtain each denoised matched point cloud data group. Then, the above execution subject can generate the rotation matrix and the translation matrix from the above three-dimensional scene map to the received three-dimensional scene map according to each denoised matched point cloud data group by using the normal distribution transform (NDT) algorithm.

[0085] Thirdly, the above rotation matrix and the above translation matrix are determined as the conversion matrix information from the above three-dimensional scene map to the received three-dimensional scene map.

[0086] Therefore, the received three-dimensional scene map and the three-dimensional scene map can be matched by the above embodiment to obtain each matched point cloud data group. The conversion matrix information from the above three-dimensional scene map to the received three-dimensional scene map is generated based on each matched point cloud data group.

[0087] In step 303, the received motion trajectory information of the virtual object in the world coordinate system of the receiving end is generated based on the conversion matrix information and the motion trajectory information sent by the sending end.

[0088] In some embodiments, the above execution subject can generate the received motion trajectory information of the virtual object in the world coordinate system of the receiving end based on the above conversion matrix information and the motion trajectory information sent by the sending end. In practice, for each space passing point coordinate information in the motion trajectory information, the above execution subject can determine the product of the rotation matrix included in the above conversion matrix information and the three-dimensional coordinate corresponding to the above space passing point coordinate information as the rotated three-dimensional coordinate. Then, the above execution subject can determine the sum of the rotated three-dimensional coordinate and the translation matrix included in the above conversion matrix information as the space passing point coordinate information in the world coordinate system of the receiving end. Finally, the above execution subject can determine each space passing point coordinate information in the world coordinate system of the receiving end as the received motion trajectory information. As an example, the above space passing point coordinate information can be P, The above rotation matrix can be R, and the rotated three-dimensional coordinate can be P′, The translation matrix can be represented by t, and the space passing point coordinate information in the world coordinate system of the receiving end can be represented by P new new P = P′ + t. The above rotated three-dimensional coordinate corresponds to the above space passing point coordinate information, and the above space passing point coordinate information corresponds to the time point. The space passing point coordinate information in the world coordinate system of the receiving end corresponds to the time point.​

[0089] In step 304, based on the item configuration information sent by the sending end and the receiving motion trajectory information, at least one virtual item and a receiving three-dimensional scene map are displayed in a three-dimensional display space of the receiving head-mounted display device.

[0090] In some embodiments, the execution subject can display at least one virtual item and a receiving three-dimensional scene map in a three-dimensional display space of the receiving head-mounted display device based on the item configuration information sent by the sending end and the receiving motion trajectory information, wherein the at least one virtual item is displayed in the receiving three-dimensional scene map, and the at least one virtual item moves from a preset point to the direction of the receiving user. In practice, the execution subject can display at least one virtual item corresponding to the item configuration information at a position corresponding to the space passing point coordinate information in the world coordinate system of the receiving end at the passing time according to the order of the passing time in the receiving three-dimensional scene map displayed in the three-dimensional display space.

[0091] Before the above method, the above method further includes: first, based on the receiving motion trajectory information and the item configuration information, at least one virtual item is processed by real-time rendering technology. Then, the rendered virtual item is projected into the field of view of the receiving user through an optical display system (such as a micro projector or a transparent display screen), and is superimposed with the real scene. In this way, the receiving user can see the superimposed effect of the real world and at least one virtual item at the same time.

[0092] In step 305, receiving action information of the receiving user is collected.

[0093] In some embodiments, the execution subject can collect receiving action information of the receiving user. Wherein the receiving action information includes each receiving user hand posture information, each receiving user hand posture information in the receiving action information corresponds to a collection time point, and the receiving user hand posture information includes each hand key point space coordinate information. Each hand key point space coordinate information in the receiving action information can represent the position of the receiving user hand preset point in the three-dimensional space. For example, the hand key point space coordinate information can be "thumb tip coordinate (2, 3, 4), index finger tip (3, 5, 5), little finger tip (5, 3, 4)". In practice, the execution subject can collect the receiving action information of the receiving user through a tracker. Alternatively, the execution subject can collect the receiving action information of the receiving user through an infrared high-speed camera. Wherein the receiver's hand is attached with a reflective ball.

[0094] In step 306, based on the receiving action information and the receiving motion trajectory information, space touch detection information is generated.

[0095] In some embodiments, the execution subject can generate the space touch detection information based on the received action information and the received motion trajectory information.

[0096] In the process of adopting technical solutions to solve the problems mentioned in the background, the following problems are often accompanied:

[0097] When determining whether the receiver touches the virtual object, the usual way is to directly generate the space touch detection information by judging whether the received action information and the received motion trajectory information have intersection at the same time.

[0098] However, directly judging whether the received action information and the received motion trajectory information have intersection at the same time is to judge the intersection between points at the same time point, which may cause misjudgment due to precision problems or calculation errors, thereby reducing the accuracy of the space touch detection information. At the same time, by directly judging whether the received action information and the received motion trajectory information have intersection at the same time, it is necessary to compare each space passing point coordinate information corresponding to the received motion trajectory information and each hand key point space coordinate information included in the received action information one by one at each time, which has large calculation amount and wastes computer power resources.

[0099] In the face of the above technical problems, the following solutions are adopted:

[0100] In some optional implementation manners of some embodiments, the execution subject can generate the space touch detection information based on the received action information and the received motion trajectory information by the following steps:

[0101] First, determine the collection time points corresponding to the received action information and the passing time points corresponding to the received motion trajectory information.

[0102] Second, determine the intersection of each collection time point and each passing time point to obtain each target time point.

[0103] Third, for each target time point in the target time points, the following space touch detection steps are performed:

[0104] First sub-step, determine the space passing point coordinate information corresponding to the target time point as the to-be-detected space passing point coordinate information.

[0105] The second sub-step is to generate bounding box spatial information based on the spatial coordinate information of each hand key point included in the received user hand posture information corresponding to the above-mentioned target time point. In practice, first, the above-mentioned execution entity may determine the horizontal coordinate with the largest absolute value among the horizontal coordinates included in the spatial coordinate information of each hand key point as the first horizontal coordinate. Then, the above-mentioned execution entity may determine the horizontal coordinate with the smallest absolute value among the horizontal coordinates as the second horizontal coordinate. Then, the above-mentioned execution entity may determine the vertical coordinate with the largest absolute value among the vertical coordinates included in the spatial coordinate information of each hand key point as the first vertical coordinate. After that, the above-mentioned execution entity may determine the vertical coordinate with the smallest absolute value among the vertical coordinates as the second vertical coordinate. Then, the above-mentioned execution entity may determine the vertical coordinate with the largest absolute value among the vertical coordinates included in the spatial coordinate information of each hand key point as the first vertical coordinate. Then, the above-mentioned execution entity may determine the vertical coordinate with the smallest absolute value among the vertical coordinates as the second vertical coordinate. Afterwards, the above-mentioned execution entity can determine (first horizontal coordinate, first vertical coordinate, first vertical coordinate), (first horizontal coordinate, first vertical coordinate, second vertical coordinate), (first horizontal coordinate, second vertical coordinate, first vertical coordinate), (first horizontal coordinate, second vertical coordinate, second vertical coordinate), (second horizontal coordinate, first vertical coordinate, first vertical coordinate), (second horizontal coordinate, second vertical coordinate, first vertical coordinate), (second horizontal coordinate, first vertical coordinate, second vertical coordinate), (second horizontal coordinate, first vertical coordinate, second vertical coordinate) as the bounding box space information.

[0106] In a third sub-step, in response to determining that the spatial position corresponding to the coordinate information of the to-be-detected spatial waypoint is within the spatial region corresponding to the bounding box spatial information, information indicating contact between the virtual object and the receiving user is determined as spatial contact information. The information indicating contact between the virtual object and the receiving user can be represented by textual information, for example, "The virtual object and the receiving user have contacted." The information indicating contact between the virtual object and the receiving user can be represented by a Boolean value of true.

[0107] In a fourth step, in response to determining that the number of the determined spatial touch information is greater than a preset value, the information indicating the presence of the spatial touch is determined as the spatial touch detection information.

[0108] The technical solution and related content thereof serve as one invention point of the embodiments of the present disclosure, and solve the technical problem of low accuracy of final space touch detection information and waste of computer computing resources. Factors leading to the waste of computer computing resources are often as follows: directly judging whether the received action information and the received motion trajectory information have intersections at the same time, which is to judge the intersection between points at the same time, and the misjudgment caused by precision problems or calculation errors may lead to low accuracy of space touch detection information. At the same time, by directly judging whether the received action information and the received motion trajectory information have intersections at the same time, each space passing point coordinate information corresponding to the received motion trajectory information and each hand key point space coordinate information included in the received action information need to be compared one by one at each time, which is large in calculation amount and wastes computer computing resources. If the above factors are solved, the accuracy of space touch detection information can be improved and the waste of computer computing resources can be reduced. In order to achieve this effect, first, each collection time point corresponding to the above received action information and each passing time point corresponding to the above received motion trajectory information are determined. Thus, each collection time for generating the intersection of collection time and passing time (i.e., each target time point) can be obtained. Then, the intersection of each collection time point and each passing time point is determined to obtain each target time point. Then, for each target time point in the above each target time point, the following space touch detection steps are performed: first, the space passing point coordinate information corresponding to the target time point is determined as the to-be-detected space passing point coordinate information. Second, the to-be-detected space passing point coordinate information for generating the space touch information can be obtained. Third, based on each hand key point space coordinate information included in the received user hand posture information corresponding to the target time point, the bounding box space information is generated. Thus, the bounding box space information for generating the space touch information can be obtained. Fourth, in response to determining that the space position corresponding to the to-be-detected space passing point coordinate information is within the space region corresponding to the bounding box space information, the information representing that the virtual object and the received user exist touch is determined as the space touch information. Thus, whether the to-be-detected space passing point and the received user exist touch can be detected by using the bounding box space information to generate the space touch information. This reduces the misjudgment caused by precision problems or calculation errors, improves the accuracy of the space touch information, and simplifies the hand region to a single geometric body for collision detection by using the bounding box corresponding to the bounding box information, without comparing each space passing point coordinate information and each hand key point space coordinate information at the same time. Then, in response to determining that the number of determined space touch information is greater than a preset value, the information representing that there exists space touch is determined as the space touch detection information. Also, the bounding box space information is generated by using each hand key point space coordinate information at the target time point.The bounding box space information is used to detect whether the to-be-detected space passing point is in contact with the receiving user, so as to generate space contact information. The false positives caused by precision problems or calculation errors are reduced, the accuracy of the space contact information is improved, and the accuracy of the space contact detection information is improved. At the same time, the hand region is simplified to a single geometric body for collision detection by using the bounding box corresponding to the bounding box information, and it is not necessary to compare whether each space passing point coordinate information and each hand key point space coordinate information intersect at the same time, so that the calculation amount is reduced and the waste of computer computing resources is reduced.

[0109] In step 307, based on the space contact detection information, a virtual item receiving interaction feedback processing is performed.

[0110] In some embodiments, the execution subject can perform the virtual item receiving interaction feedback processing based on the space contact detection information. In practice, the execution subject can send the space contact detection information to a preset processing device (for example, a server of a service end). In response to receiving the capture event information sent by the preset processing device, the execution subject can make the receiver feel the touch through the tactile receptor or the vibration motor, and the execution subject can play the sound effect of taking the item to make the receiver feel the hearing of taking. The capture event information is used as a signal or data for triggering the virtual item receiving interaction feedback processing.

[0111] In some optional implementations of some embodiments, the execution subject can perform the virtual item receiving interaction feedback processing based on the space contact detection information by the following steps:

[0112] Firstly, the space contact detection information is sent to a preset processing device, so that the preset processing device generates capture event information and virtual item taking information.

[0113] Secondly, in response to receiving the capture event information sent by the preset processing device, the virtual item receiving interaction feedback processing is performed. In practice, in response to receiving the capture event information sent by the preset processing device, the execution subject can make the receiver feel the touch through the tactile receptor or the vibration motor, and the execution subject can play the sound effect of taking the item to make the receiver feel the hearing of taking.

[0114] Thus, the virtual item receiving interaction feedback processing can be implemented by the above embodiments, so that the receiving user receiving the capture event information can experience the interaction feedback after receiving the virtual item (e.g., the feedback of hearing and touch after receiving the virtual item). The above embodiments of the present disclosure have the following beneficial effects: the virtual item receiving method of some embodiments of the present disclosure improves the experience of the user receiving the virtual item. Specifically, the reason why the experience of receiving the virtual item is poor is that the user usually receives the virtual item (e.g., an electronic red envelope) through an application on a mobile device or receives the virtual item through a page trigger, and the receiving user can only receive the virtual item through the clicking operation of the finger, cannot interact with the virtual item in the three-dimensional space, and cannot easily experience the process of the virtual item being put into the three-dimensional scene. The receiving only involves the clicking operation of the finger and the visual experience of the two-dimensional item image and text prompt, and the receiving user experience is poor. Based on this, the virtual item receiving method of some embodiments of the present disclosure first scans the physical space through the spatial scanning device on the receiving head-mounted display device of the receiving end to construct a receiving three-dimensional scene map in the world coordinate system of the receiving end. Thus, the receiving three-dimensional scene map of the physical space where the receiving user is located can be constructed. Then, based on the above receiving three-dimensional scene map and the three-dimensional scene map associated with the sending three-dimensional scene map sent by the sending end, the conversion matrix information from the above three-dimensional scene map to the above receiving three-dimensional scene map is generated. Thus, the conversion matrix information for converting the motion trajectory information into the receiving motion trajectory information in the world coordinate system of the receiving end can be obtained. Then, based on the above conversion matrix information and the motion trajectory information sent by the sending end, the receiving motion trajectory information of the virtual item in the world coordinate system of the receiving end is generated. Thus, the receiving motion trajectory information of at least one virtual item in the receiving three-dimensional scene map can be obtained. Then, based on the above sending end sending the item configuration information and the above receiving motion trajectory information, at least one virtual item and the above receiving three-dimensional scene map are displayed in the three-dimensional display space of the above receiving head-mounted display device, wherein the above at least one virtual item is displayed in the above receiving three-dimensional scene map, and the above at least one virtual item moves from a preset point to the direction of the receiving user. Thus, the receiving user can be displayed the process of the virtual item being put into the three-dimensional scene. Then, the receiving action information of the receiving user is collected. Thus, the receiving action information of the user in the three-dimensional space when receiving the virtual item can be collected. Then, based on the above receiving action information and the above receiving motion trajectory information, the spatial touch detection information is generated. Thus, the spatial touch detection information of whether the user interacts with the virtual item in the three-dimensional space can be generated. Based on the above spatial touch detection information, the virtual item receiving interaction feedback processing is performed. Thus, the receiving user can experience the interaction feedback after receiving the virtual item when the receiving user touches the virtual item. Also, the receiving three-dimensional scene map of the physical space where the receiving user is located is created before receiving the virtual item.When the virtual item is delivered, a process of the virtual item being dropped in the three-dimensional scene is displayed to the receiving user. By collecting receiving action information of the receiving user in the three-dimensional space when the virtual item is received, it is determined whether the receiving user contacts the virtual item. When the receiving user contacts the virtual item, an item receiving interaction feedback processing is performed to make the receiving user feel the interaction feedback after receiving the virtual item, thereby improving the receiving user experience.

[0115] Reference will now be made to the following description Figure 4 , Figure 4 An exemplary system architecture 400 of an exemplary system of a virtual item delivery and receiving system to which some embodiments of the present disclosure can be applied is shown.

[0116] As shown in Figure 4 , the system architecture 400 can include the above-mentioned preset processing device 401, the above-mentioned sending end 402, and at least one receiving end 403. The above-mentioned preset processing device 401 is connected to the above-mentioned sending end 402 and the above-mentioned at least one receiving end 403 through a communication link medium. For example, the above-mentioned communication link medium can be a wired, wireless communication link, or an optical fiber cable, etc.

[0117] In some embodiments, the above-mentioned sending end 402 can be configured to perform Figures 1-2 the steps in the corresponding embodiments, which are not repeated here.

[0118] In some embodiments, each of the above-mentioned at least one receiving end 403 is configured to perform Figure 3 the steps in the corresponding embodiments, which are not repeated here.

[0119] In some embodiments, the above-mentioned preset processing device 401 can be configured to perform a capture state synchronization processing. In practice, in response to receiving at least one space touch detection information sent by the at least one receiving end, the above-mentioned preset processing device 401 can send information representing that the virtual item has been taken to the above-mentioned sending end and the at least one receiving end.

[0120] In some optional implementations of some embodiments, the above-mentioned preset processing device 401 can perform the capture state synchronization processing by the following steps:

[0121] First, receive at least one space touch detection information sent by the at least one receiving end.

[0122] Secondly, based on the at least one spatial touch detection information, a capture event information and a virtual item taken information are generated, wherein the capture event information has a corresponding receiving end identifier. In practice, the execution subject can determine at least one receiving time of receiving the at least one spatial touch detection information. Then, the execution subject can determine a receiving end identifier corresponding to a receiving time satisfying a preset condition in the at least one receiving time. After that, the execution subject can generate a capture event information for the receiving end identifier. The virtual item taken information can represent information that the virtual item has been taken.

[0123] Thirdly, the capture event information is sent to a receiving end corresponding to the receiving end identifier.

[0124] Fourthly, the virtual item taken information is sent to the sending end and at least one target receiving end. The at least one target receiving end can be each receiving end in the virtual item sending and receiving system except the receiving end corresponding to the receiving end identifier.

[0125] The virtual item sending and receiving system according to some embodiments of the present disclosure improves the experience of the sending user and the receiving user in the process of sending and receiving the virtual item. The sending end included in the virtual item sending and receiving system simulates the movement process of the virtual item being thrown in the three-dimensional scene, improving the experience of the sending user. The at least one receiving end included in the virtual item sending and receiving system displays the movement process of the virtual item sent by the sending end in the three-dimensional scene where the receiving user is located, improving the user experience of the receiving user.

[0126] Reference will now be made to the following description Figure 5 which shows a hardware structure diagram of a head-mounted display device 500 suitable for implementing some embodiments of the present disclosure. Figure 5 The head-mounted display device shown is only an example and should not bring any limitation to the function and use range of the embodiments of the present disclosure.

[0127] As Figure 5As shown, the head-mounted display device 500 can include a processing apparatus 501 (e.g., a central processor, a graphics processor, etc.), a memory 502, an input unit 503, and an output unit 504. Among them, the processing apparatus 501, the memory 502, the input unit 503, and the output unit 504 are connected to each other through a bus 505. Here, the method according to the embodiments of the present disclosure can be implemented as a computer program and stored in the memory 502. For example, some embodiments of the present disclosure include a computer program product including a computer program carried on a computer readable medium, the computer program containing program codes for executing the method shown in the flowchart. The processing apparatus 501 in the head-mounted display device specifically implements the virtual item issuing method or the virtual item receiving method of the present disclosure by invoking the above-mentioned computer program stored in the memory 502. In some implementations, the input unit 503 can include camera, microphone, gyroscope, accelerometer, magnetometer, etc. devices, and the output unit 504 can include a micro display screen, a speaker, a vibrator, etc. The head-mounted display device can include a display module. The display module can include an optical element and a micro display screen. Thus, when the processing apparatus 501 invokes the above-mentioned computer program to execute the virtual item issuing or virtual item receiving function, it can control the input unit 503 to acquire the sending action information of the sending user or receive the item configuration information and motion trajectory information sent by the sending end, and control the output unit 504 to display the motion of the virtual item.

[0128] Note that the computer readable medium in some embodiments of the present disclosure can be a computer readable signal medium or a computer readable storage medium or any combination thereof. The computer readable storage medium can be, for example but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any suitable combination of the foregoing. More specific examples of the computer readable storage medium can include, but are not limited to, an electrical connection having one or more wires, a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In some embodiments of the present disclosure, the computer readable storage medium can be any tangible medium that contains or stores a program used by or in connection with an instruction execution system, apparatus or device. In some embodiments of the present disclosure, the computer readable signal medium can include a data signal propagated in baseband or propagated as a carrier wave in a propagated data signal, in which the computer readable program code is contained. Such propagated data signal can take a variety of forms, including but not limited to electro-magnetic, optical or any suitable combination thereof. The computer readable signal medium can also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate or transport program for use by or in connection with an instruction execution system, apparatus or device. Program code contained in the computer readable medium can be transmitted by any suitable medium, including but not limited to wire, cable, RF (radio frequency), etc., or any suitable combination of the foregoing.

[0129] In some embodiments, the client, server, or both can communicate using any current known or future developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet, and peer-to-peer networks (e.g., ad hoc peer-to-peer networks), as well as any current known or future developed networks.

[0130] The computer readable medium can be included in the head-mounted display device or exist separately from the head-mounted display device. The computer readable medium carries one or more programs that, when executed by the head-mounted display device, cause the head-mounted display device to: scan a physical space by a spatial scanning device on a sending head-mounted display device to construct a three-dimensional scene map in a world coordinate system of the sending head-mounted display device; display an item configuration window in a three-dimensional display space of the head-mounted display device; in response to detecting a sending trigger operation, collect sending action information of a sending user; based on the sending action information, generate motion trajectory information of at least one virtual item; based on the motion trajectory information and item configuration information corresponding to the item configuration window, display the three-dimensional scene map and the at least one virtual item in the three-dimensional display space, wherein the at least one virtual item is displayed in the three-dimensional scene map and moves outward from a preset point in the three-dimensional scene map; and send the three-dimensional scene map, the item configuration information, and the motion trajectory information to at least one associated receiving end.

[0131] or cause the head-mounted display device to: scan a physical space by a spatial scanning device on a receiving head-mounted display device to construct a receiving three-dimensional scene map in a world coordinate system of the receiving head-mounted display device; based on the receiving three-dimensional scene map and a three-dimensional scene map sent by an associated sending end, generate conversion matrix information from the three-dimensional scene map to the receiving three-dimensional scene map; based on the conversion matrix information and motion trajectory information sent by the sending end, generate receiving motion trajectory information of a virtual item in the world coordinate system of the receiving end; based on item configuration information sent by the sending end and the receiving motion trajectory information, display at least one virtual item and the receiving three-dimensional scene map in a three-dimensional display space of the receiving head-mounted display device, wherein the at least one virtual item is displayed in the receiving three-dimensional scene map and moves from a preset point in the direction of a receiving user; collect receiving action information of the receiving user; based on the receiving action information and the receiving motion trajectory information, generate spatial touch detection information; and based on the spatial touch detection information, perform virtual item receiving interaction feedback processing.

[0132] Computer program code for carrying out operations of some embodiments of the present disclosure can be written in any combination of one or more programming languages, including an object oriented programming language such as Java, Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The program code can execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computer (for example, through the Internet using an Internet Service Provider).

[0133] The computer program instructions can also be loaded onto a computer or other programmable information processing apparatus to cause a series of operations to be performed on the computer or other programmable information processing apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable information processing apparatus implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0134] The functions described herein above can be performed, at least in part, by one or more hardware logic components. For example, and without limitation, illustrative types of hardware logic components that can be used include Field-programmable Gate Arrays (FPGAs), Program-specific Integrated Circuits (ASICs), Program-specific Standard Products (ASSPs), System-on-a-chip systems (SOCs), Complex Programmable Logic Devices (CPLDs), etc.

[0135] The above description is merely exemplary of some of the many possible embodiments of the present disclosure and of the principles thereof. It is to be understood that those skilled in the art will be able to devise various embodiments of the present disclosure without departing from the scope of the present disclosure, that the scope of the present disclosure is not limited to the specific embodiments described herein, and that the scope of the present disclosure also covers any subsequent technical equivalents, which do not depart from the principles of the present disclosure, of the technical features of the present disclosure, or of the equivalents thereof. For example, the scope of the present disclosure also covers technical solutions formed by replacing features disclosed in the embodiments of the present disclosure with features having similar functions (not limited to features disclosed in the embodiments of the present disclosure).

Claims

1. A method for distributing virtual items, applied to a sending end, comprising: Scanning the physical space through a space scanning device on a head-mounted display device at the sending end to construct a three-dimensional scene map in the world coordinate system of the sending end; Displaying an item configuration window in the three-dimensional display space of the head-mounted display device; In response to detecting a sending trigger operation, collecting sending action information of the sending user; generating motion trajectory information corresponding to at least one virtual item based on the sent action information; Based on the motion trajectory information and the item configuration information corresponding to the item configuration window, displaying a three-dimensional scene map and the at least one virtual item in the three-dimensional display space, wherein the at least one virtual item is displayed in the three-dimensional scene map, and in the three-dimensional scene map, the at least one virtual item moves outward from a preset position; The three-dimensional scene map, the item configuration information, and the motion trajectory information are sent to at least one associated receiving end.

2. The method according to claim 1, wherein Scanning the physical space by a space scanning device on a head-mounted display device of the sending end to construct a three-dimensional scene map in the world coordinate system of the sending end includes: Scanning the physical space by a space scanning device on a head-mounted display device at the transmitting end to obtain a physical space image sequence; Based on the physical space image sequence, a point cloud map corresponding to the physical space in the world coordinate system of the sending end is constructed as a three-dimensional scene map.

3. The method according to claim 1, wherein The method further comprises: At least one configuration item information configured by the sending user in the item configuration window is determined as item configuration information, wherein the item configuration information includes at least one of the following: item quantity information, item value information, and single-trigger item quantity information.

4. The method according to claim 1, wherein The sending action information includes a spatial point coordinate information sequence, each spatial point coordinate information in the spatial point coordinate information sequence corresponds to a collection time, and the generating of motion trajectory information corresponding to at least one virtual item based on the sending action information includes: Dividing the spatial point coordinate information sequence to obtain a divided spatial point coordinate information group sequence, wherein each divided spatial point coordinate information group in the divided spatial point coordinate information group sequence includes preceding spatial coordinate point information and succeeding spatial coordinate point information; Based on the division of the spatial point coordinate information group sequence, an item throwing information sequence is generated; Based on the item throwing information sequence, motion trajectory information corresponding to at least one virtual item is generated, wherein the motion trajectory information includes coordinate information of each spatial waypoint, and the coordinate information of each spatial waypoint corresponds to each path time point.

5. The method according to claim 4, wherein The method of generating an item throwing information sequence based on dividing the spatial point coordinate information group sequence includes: For each divided space point coordinate information group in the divided space point coordinate information group sequence, perform the following steps: Determine the time interval between the acquisition time corresponding to the preceding spatial coordinate point information and the acquisition time corresponding to the subsequent spatial coordinate point information in the divided spatial point coordinate information group; generating movement speed information corresponding to the divided spatial point coordinate information groups based on the preceding spatial coordinate point information, the succeeding spatial coordinate point information, and the time interval; generating, based on the preceding spatial coordinate point information and the succeeding spatial coordinate point information, movement direction information corresponding to the divided spatial point coordinate information groups; determining the moving speed information and the moving direction information as item throwing information; Based on the determined information of each item throwing, an item throwing information sequence is generated.

6. A method for receiving virtual items, applied to a receiving end, comprising: Scanning the physical space by a space scanning device on a receiving head-mounted display device at the receiving end to construct a receiving three-dimensional scene map in a world coordinate system of the receiving end; Based on the received three-dimensional scene map and the three-dimensional scene map sent by the associated sending end, generating conversion matrix information from the three-dimensional scene map to the received three-dimensional scene map; generating, based on the conversion matrix information and the motion trajectory information sent by the sending end, receiving motion trajectory information of the virtual object in the world coordinate system of the receiving end; Based on the item configuration information sent by the sending end and the received motion trajectory information, displaying at least one virtual item and the received three-dimensional scene map in a three-dimensional display space of the receiving head-mounted display device, wherein the at least one virtual item is displayed in the received three-dimensional scene map and moves from a preset position toward the receiving user; Collecting receiving action information of the receiving user; generating spatial touch detection information based on the received action information and the received motion trajectory information; Based on the spatial touch detection information, a virtual item receiving interactive feedback process is executed.

7. The method according to claim 6, wherein: The received three-dimensional scene map includes each received scene point cloud data point, the three-dimensional scene map includes each sent scene point cloud data point, and the generating of conversion matrix information from the three-dimensional scene map to the received three-dimensional scene map based on the received three-dimensional scene map and the three-dimensional scene map sent by the associated sender, including: Performing feature point matching processing on the received three-dimensional scene map and the three-dimensional scene map to obtain respective matching point cloud data point groups, wherein each matching point cloud data point group in the respective matching point cloud data point groups includes a received scene point cloud data point and a sent scene point cloud data point; generating a rotation matrix and a translation matrix based on each of the matching point cloud data point groups; The rotation matrix and the translation matrix are determined as conversion matrix information from the three-dimensional scene map to the received three-dimensional scene map.

8. The method according to claim 6, wherein: The performing of virtual item receiving interactive feedback processing based on the spatial touch detection information includes: Sending the spatial touch detection information to a preset processing device so that the preset processing device generates capture event information and virtual item claim information; In response to receiving the capture event information sent by the preset processing device, executing virtual item reception interactive feedback processing.

9. A virtual item distribution and receipt system, comprising: A preset processing device, a sending end, and at least one receiving end, wherein: The sending end is configured to perform the method according to any one of claims 1 to 5; Each of the at least one receiving end is configured to perform the method according to any one of claims 6 to 8; The preset processing device is configured to perform capture state synchronization processing.

10. The system according to claim 9, wherein: The preset processing device is configured to perform capture state synchronization processing, including: receiving at least one spatial touch detection information sent by at least one receiving end; Generate capture event information and virtual item claim information based on the at least one spatial touch detection information, wherein the capture event information has a corresponding receiving end identifier; Sending the capture event information to a receiving end corresponding to the receiving end identifier; The virtual item claim information is sent to the sending end and at least one target receiving end.

11. A head-mounted display device, comprising: a display module configured to form an image in front of the user's eyes; one or more processors; a storage device having one or more programs stored thereon; When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 8.

12. A computer-readable medium having a computer program stored thereon, wherein: When the computer program is executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images