Method and device for comparing and displaying virtual objects

Abstract

The present invention discloses a method and device for comparing and displaying virtual objects, and relates to the field of computer technology. A specific implementation of the method includes: constructing a placement space for virtual objects according to the posture information of a reference virtual object and the position of an observation point, wherein the virtual objects include a reference virtual object and a comparison virtual object, and each virtual object is at an equal distance from the observation point in the placement space; determining the posture information of the comparison virtual object in the placement space; and performing a comparison display of the virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object. This implementation has the same observation angle and observation effect for each virtual object, and will not affect the comparison result of the items when adjusting the model orientation, posture, etc.

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a method and device for comparing and displaying virtual objects. Background Art

[0002] Traditional two-dimensional static object displays have become increasingly difficult to meet user needs, giving rise to more diverse display forms such as dynamic videos, animated images, and 3D models. Object display devices have also evolved from PCs (Personal Computers) and mobile phones to MR (Mixed Reality) devices. Currently, when users browse objects through MR devices and compare and display multiple virtual objects, the solution is mostly to place the virtual objects to be compared and displayed on a straight line relative to each other, with the observation point as the center and placed in a certain arc to facilitate user observation and comparison.

[0003] In the process of implementing the present invention, the inventors found that there are at least the following problems in the prior art: when users compare virtual object models in MR or AR (Augmented Reality) space, it is difficult to satisfy the requirement of having equal observation effects for all models, and adjustments to the model's orientation, posture, etc. will affect the object comparison results. Summary of the invention

[0004] In view of this, an embodiment of the present invention provides a method and device for comparing and displaying virtual objects, which can construct a placement space of virtual objects based on the posture information of a reference virtual object, so that each virtual object is at an equal distance from an observation point in the placement space, and determine the placement posture of the comparison virtual object in combination with the placement space of the virtual object, thereby achieving the same observation angle and observation effect for each virtual object, and will not affect the object comparison result when adjusting the model orientation, posture, etc.

[0005] To achieve the above-mentioned purpose, according to one aspect of an embodiment of the present invention, a method for comparative display of virtual objects is provided, comprising: constructing a placement space for virtual objects according to posture information of a reference virtual object and a position of an observation point, the virtual objects comprising the reference virtual object and a comparative virtual object, and each virtual object having an equal distance from the observation point in the placement space; determining the posture information of the comparative virtual object in the placement space; and performing comparative display of virtual objects based on the posture information of the reference virtual object and the posture information of the comparative virtual object.

[0006] Optionally, constructing a placement space for a virtual object based on the posture information of a reference virtual object and the position of an observation point includes: setting the reference virtual object to a preset size and facing the observation point to obtain the posture information of the reference virtual object; taking the vertical line where the observation point is located as the central axis, determining at least one circle center from the central axis; for each circle center, taking the distance from the circle center to the front face of the reference virtual object as the radius, constructing a placement space for the virtual object based on the circle center and the radius, wherein the front face of the reference virtual object is the front rectangle of the bounding box of the reference virtual object.

[0007] Optionally, constructing a placement space for a virtual object based on the posture information of a reference virtual object and the position of an observation point includes: setting the reference virtual object to a preset size and facing the observation point, and adjusting the distance between the reference virtual object and the observation point to obtain the posture information of the reference virtual object; taking the vertical line at which the observation point is located as the central axis, determining at least one circle center from the central axis; for each circle center, taking the distance between the reference virtual object and the observation point as the radius, constructing a placement space for the virtual object based on the circle center and the radius, wherein the distance between the reference virtual object and the observation point is the distance between the front center point of the reference virtual object and the vertical line at which the observation point is located, and the front center point of the reference virtual object is the center point of the front rectangle of the bounding box of the reference virtual object.

[0008] Optionally, the preset size is an actual size of the reference virtual object.

[0009] Optionally, taking the vertical line where the observation point is located as the central axis, at least one circle center is determined from the central axis, including: taking the height of the front center point of the reference virtual object as the height, taking the vertical line where the observation point is located as the central axis, and determining the circle center from the central axis according to the height.

[0010] Optionally, determining the posture information of the comparison virtual object in the placement space includes: determining a placement reference position of each virtual object according to the placement space and size information of each virtual object; determining the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, the posture information including position information, rotation information and scaling information.

[0011] Optionally, the placement reference position of each virtual object is determined according to the placement space and the size information of each virtual object, including: for each virtual object, taking the center point of the front face of the virtual object as the tangent point between the front face of the virtual object and the placement space, the front face of the virtual object is the front rectangle of the bounding box of the virtual object, and the center point of the front face of the virtual object is the center point of the front rectangle of the bounding box of the virtual object; taking the tangent point as the center of the circle and the front width of the virtual object as the diameter, determining the placement reference position of the virtual object, the front width of the virtual object being the width of the front rectangle of the bounding box of the virtual object.

[0012] Optionally, determining the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object includes: projecting the placement space and the placement reference position of each virtual object onto a horizontal plane of the space where the placement reference position of each virtual object is located to obtain a projection image; and determining, on the projection image, the posture information of the comparison virtual object in the placement space in combination with the size information of each virtual object.

[0013] Optionally, determining the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object includes: calculating the displacement matrix, rotation matrix and scaling matrix of the comparison virtual object respectively based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, and determining the posture information of the comparison virtual object in the placement space based on the displacement matrix, the rotation matrix and the scaling matrix.

[0014] Optionally, based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, calculating the displacement matrix of the comparison virtual object includes: determining the coordinates of a first tangent point between the reference virtual object and the placement space based on the placement space and the placement reference position of the reference virtual object; determining an angle between the reference virtual object and the comparison virtual object based on the placement reference position of each virtual object and the size information of each virtual object, wherein the angle is a central angle corresponding to a chord formed by a front center of the reference virtual object and a front center of the comparison virtual object in the placement space; determining the coordinates of a second tangent point between the comparison virtual object and the placement space based on the coordinates of the first tangent point and the angle; determining the position coordinates of the comparison virtual object based on the placement space and the coordinates of the second tangent point, and generating the displacement matrix of the comparison virtual object based on the position coordinates of the comparison virtual object.

[0015] Optionally, the method further includes: scaling the reference virtual object and the comparison virtual object in equal proportion; and interactively displaying virtual objects based on the adjusted reference virtual object and the comparison virtual object.

[0016] Optionally, the method further includes: determining at least one target virtual object from the virtual objects, and scaling and / or rotating the at least one target virtual object to perform interactive display of the virtual objects.

[0017] Optionally, the placement reference position of each virtual object is variable.

[0018] According to another aspect of an embodiment of the present invention, a device for comparing and displaying virtual objects is provided, comprising: a placement space construction module, used to construct a placement space for virtual objects according to posture information of a reference virtual object and an observation point position, wherein the virtual objects include the reference virtual object and a comparison virtual object, and each virtual object has an equal distance from the observation point in the placement space; a posture information determination module, used to determine the posture information of the comparison virtual object in the placement space; and a comparison display module, used to perform a comparison display of virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object.

[0019] According to another aspect of an embodiment of the present invention, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method for comparative display of virtual objects provided in an embodiment of the present invention.

[0020] According to another aspect of an embodiment of the present invention, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method for comparing and displaying virtual objects provided in an embodiment of the present invention is implemented.

[0021] According to another aspect of an embodiment of the present invention, a computer program product is provided, including a computer program, and when the computer program is executed by a processor, the method for comparing and displaying virtual objects provided in an embodiment of the present invention is implemented.

[0022] An embodiment of the above invention has the following advantages or beneficial effects: by constructing a placement space for virtual objects according to the posture information of the reference virtual object and the position of the observation point, the virtual objects include the reference virtual object and the comparison virtual object, and each virtual object is at the same distance from the observation point in the placement space; determining the posture information of the comparison virtual object in the placement space; a technical scheme for comparative display of virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object can construct the placement space for virtual objects based on the posture information of the reference virtual object, so that each virtual object is at the same distance from the observation point in the placement space, and determine the placement posture of the comparison virtual object in combination with the placement space of the virtual object, thereby achieving the same observation angle and observation effect for each virtual object, and the object comparison result will not be affected when adjusting the model orientation, posture, etc.

[0023] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with the specific implementation manner. BRIEF DESCRIPTION OF THE DRAWINGS

[0024] The accompanying drawings are used to better understand the present invention and do not constitute an improper limitation of the present invention.

[0025] Figure 1 is a schematic diagram of main steps of a method for comparing and displaying virtual objects according to an embodiment of the present invention;

[0026] Figure 2 is a spatial schematic diagram of a head mounted device according to an embodiment of the present invention;

[0027] Figure 3 is a schematic diagram of a placement space for a virtual object according to an embodiment of the present invention;

[0028] Figure 4 is a projection diagram of a placement space for a virtual object and a placement reference circle for a virtual object according to an embodiment of the present invention;

[0029] Figure 5 is a schematic diagram of main modules of a device for comparing and displaying virtual objects according to an embodiment of the present invention;

[0030] Figure 6 is an exemplary system architecture diagram to which embodiments of the present invention may be applied;

[0031] Figure 7 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0032] The following is a description of exemplary embodiments of the present invention in conjunction with the accompanying drawings, including various details of the embodiments of the present invention to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for clarity and conciseness, the description of well-known functions and structures is omitted in the following description.

[0033] It should be noted that the collection, collection, updating, analysis, processing, use, transmission, storage and other aspects of user personal information involved in the technical solution disclosed in the present invention are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0034] When comparing and displaying virtual objects in a virtual space, the existing technical solutions are difficult to ensure that all virtual object models have the same observation effect, and the impact of different distances of observation points on the final comparison effect is not taken into account; users need to adjust virtual objects to relatively appropriate positions by interacting with them, which includes moving, rotating, scaling and other interactions, which is time-consuming and adds a burden to the comparison of real objects, causing users to feel fatigue and other discomfort.

[0035] Accordingly, the present invention provides a method for assisting users in operating virtual objects in an MR / AR environment, which mainly solves two problems: how users can better compare models in the MR / AR space to meet the optimal observation angle; when users compare virtual object models in the MR / AR space, they can avoid the influence of the model's orientation, posture, etc. on the comparison results of the virtual objects as much as possible.

[0036] Figure 1 FIG. 1 is a schematic diagram of the main steps of the method for comparing and displaying virtual objects according to an embodiment of the present invention. Figure 1 As shown, the virtual object comparison display method of the embodiment of the present invention mainly includes the following steps S101 to S103.

[0037] Step S101: constructing a placement space for virtual objects according to the posture information of the reference virtual object and the position of the observation point, wherein the virtual objects include the reference virtual object and the comparison virtual object, and each virtual object is equidistant from the observation point in the placement space.

[0038] According to an embodiment of the present invention, constructing a placement space of a virtual object according to the posture information of a reference virtual object and the position of an observation point may specifically include: setting the reference virtual object to a preset size and facing the observation point to obtain the posture information of the reference virtual object; taking the vertical line where the observation point is located as the central axis, determining the center of a circle from the central axis; for each center of a circle, taking the distance from the center of the circle to the front of the reference virtual object as the radius, constructing a placement space of the virtual object according to the center of the circle and the radius, and the front of the reference virtual object is the front rectangle of the bounding box of the reference virtual object. In an embodiment of the present invention, there may be one or more selected center of the circle, and accordingly, the constructed placement space is one or more layers. Among them, the preset size may be the actual size of the reference virtual object, or the size after scaling the actual size of the reference virtual object by a certain ratio, which may be flexibly set according to needs. Accordingly, in order to facilitate accurate comparison between the reference virtual object and the comparison virtual object, the size of the comparison virtual object may also be its actual size, or the size after scaling according to the same ratio as the scaling ratio of the reference virtual object.

[0039] According to another embodiment of the present invention, constructing a placement space of a virtual object according to the posture information of a reference virtual object and the position of an observation point may specifically include: setting the reference virtual object to a preset size and facing the observation point, and adjusting the distance between the reference virtual object and the observation point to obtain the posture information of the reference virtual object; taking the vertical line where the observation point is located as the central axis, determining at least one circle center from the central axis; for each circle center, taking the distance between the reference virtual object and the observation point as the radius, constructing a placement space of the virtual object according to the circle center and the radius, wherein the distance between the reference virtual object and the observation point is the distance between the front center point of the reference virtual object and the vertical line where the observation point is located, and the front center point of the reference virtual object is the center point of the front rectangle of the bounding box of the reference virtual object. In this embodiment, when determining the posture information of the reference virtual object, in addition to setting the reference virtual object to a preset size and facing the observation point, the distance between the reference virtual object and the observation point may also be adjusted to adjust the reference virtual object to the best observation position or the most convenient position for operation. At this time, when constructing the placement space of the virtual object, the adjusted distance between the reference virtual object and the observation point is used as the radius to construct the placement space of the virtual object.

[0040] In a preferred embodiment of the present invention, taking the vertical line where the observation point is located as the central axis, determining at least one circle center from the central axis, specifically may include: taking the height of the front center point of the reference virtual object as the height, taking the vertical line where the observation point is located as the central axis, and determining the circle center from the central axis according to the height. In this embodiment, a circle center is determined from the central axis, and the height of the circle center is the same as the front center point of the reference virtual object. Accordingly, the circle center and the center of the reference virtual object are also at the same height, so the calculation of the posture information of the subsequent comparison virtual object can be simplified.

[0041] The present invention discloses a method for comparing and displaying virtual objects in an MR space, which is mainly used for comparing and displaying virtual object models of objects, and determines the posture of the virtual object model of the object to be compared in the current observation space in conjunction with the model posture of the object in the user's current observation space, so as to have a better observation angle to achieve the best observation effect. To achieve this purpose, the present invention proposes to construct a placement space for virtual objects based on the posture information of the reference virtual object and the posture information of the observation point, and to surround and place the reference virtual object and the comparison virtual object around the central axis formed by the vertical line where the observation point is located, and to place the comparison virtual object at a position tangent to the circle, so that each virtual object can be kept equidistant from the observation point to achieve the best observation angle.

[0042] Figure 2 FIG. 1 is a schematic diagram of a head mounted device space according to an embodiment of the present invention. Figure 2 As shown, the head-mounted device space of an embodiment of the present invention is shown, wherein the user's standing position is taken as the origin of the spatial coordinate system, the vertical direction (i.e., the direction of the perpendicular line where the user's observation point is located) is the Y-axis, the direction the user is facing is the Z-axis, and the straight line where the user's shoulders are located is the X-axis, to construct the head-mounted device space coordinate system.

[0043] Generally, when making a model (virtual object), the front of the model is the positive direction of the Z axis. When adjusting the model's posture, the Z axis will face the user's observation point. All virtual objects will be calculated to construct the AABB geometric structure of the virtual object (AABB is the abbreviation of Axis-Aligned Bounding Box, which is a simple and effective geometric structure used for collision detection and space segmentation. AABB is a rectangle (in two-dimensional space) or a cuboid (in three-dimensional space) parallel to the coordinate axis). Among them, the AABB geometric structure is constructed based on the bounding box algorithm. The bounding box algorithm is an algorithm for solving the optimal bounding space of a discrete point set. The basic idea is to use a geometric body (called a bounding box) with a slightly larger volume and simpler characteristics to approximate complex geometric objects. In an embodiment of the present invention, virtual objects can have various shapes, but the AABB geometric structure (i.e., bounding box) of the virtual object will be used as a reference for calculation.

[0044] Figure 3 Schematic diagram of the placement space of virtual objects in an embodiment of the present invention. In one embodiment of the present invention, it is assumed that the reference virtual object is represented by A (eg Figure 3 Any rectangular parallelepiped model shown in FIG), the virtual object to be added for comparison is represented as B (such as Figure 3 any rectangular parallelepiped model different from A shown in FIG, then according to the position of the reference virtual object A (based on the position of the center of A) P A (not shown in the figure) and the observation point position, the placement space of the virtual object can be constructed. Specifically, the reference virtual object A is first set to the actual size and facing the observation point to obtain the posture information of the reference virtual object A. The actual size of the reference virtual object A is, for example, the real size of the commodity A, so as to ensure that the reference virtual object A enters the observation state with the best observation angle. Among them, the center of A is the center of A's bounding box.

[0045] Then, take the height of the front center of the reference virtual object A as the height, and the vertical line where the observation point is located (such as Figure 3 The Y axis shown in FIG. 1 is the center axis, and the center of the circle is determined from the center axis according to the height, that is, the center of the circle is at the same height as the front center point of the reference virtual object A; the distance from the center of the circle to the reference virtual object A (that is, the distance from the center of the circle to the front center point of the reference virtual object A) is the radius, and the placement space of the virtual object is constructed according to the center of the circle and the radius (such as Figure 3 ) as shown in the circle constructed around the Y-axis.

[0046] Step S102: Determine the posture information of the virtual object in the placement space. After the placement space for placing the virtual object is constructed, the posture information of the virtual object in the placement space can be determined. The posture information mainly includes position information, scaling information and rotation information.

[0047] According to an embodiment of the present invention, determining the posture information of the comparison virtual object in the placement space may specifically include: determining the placement reference position of each virtual object according to the placement space and the size information of each virtual object; determining the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, wherein the posture information includes position information, rotation information and scaling information. By first determining the placement reference position of each virtual object, and then determining the posture information of the comparison virtual object in the placement space based on the placement reference position, the posture information of the comparison virtual object in the placement space can be calculated more accurately and quickly.

[0048] According to an embodiment of the present invention, the placement reference position of each virtual object is determined based on the placement space and the size information of each virtual object, which may specifically include: for each virtual object, the front center point of the virtual object is used as the tangent point between the front of the virtual object and the placement space, the front of the virtual object is the front rectangle of the virtual object's bounding box, and the front center point of the virtual object is the center point of the front rectangle of the virtual object's bounding box; with the tangent point as the center of the circle and the front width of the virtual object as the diameter, the placement reference position of the virtual object is determined, and the front width of the virtual object is the width of the front rectangle of the virtual object's bounding box. In an embodiment of the present invention, the placement reference position is, for example, a placement reference circle. Accordingly, it may also be other shapes, such as a rectangle, and so on.

[0049] In order to adapt to the placement of virtual object models of different specifications and sizes and to present the best visual effect, the present invention constructs a placement space for virtual objects through the above-mentioned step S101. The placement space is tangent to the front of the reference virtual object, and the tangent point is the center point of the front of the reference virtual object (i.e., the center point of the front rectangle of the virtual object). In an embodiment of the present invention, the fronts of multiple virtual objects to be compared and displayed can be tangent to the placement space of the virtual object, and the tangent point is the center point of the front of each virtual object. In this way, it can be ensured that the front of each virtual object is equidistant from the observation point, and the best visual effect can be achieved by equal height and equal distance, and all observed virtual objects are kept consistent, so as to minimize the impact of other factors on the results in terms of comparison effect. At the same time, the placement reference positions of any two virtual objects do not overlap, so that the situation where the virtual objects are blocked and cannot be fully displayed can be avoided.

[0050] In the embodiment of the present invention, the placement reference position of each virtual object is variable and is not limited to a fixed position. It is only necessary to keep the placement reference positions of the virtual objects non-overlapping.

[0051] According to another embodiment of the present invention, determining the posture information of the virtual object in the placement space based on the placement space, the placement reference position of each virtual object, and the size information of each virtual object can specifically include: projecting the placement space and the placement reference position of each virtual object onto the horizontal plane of the space where the placement reference position of each virtual object is located to obtain a projection diagram; and, on the projection diagram, determining the posture information of the virtual object in the placement space in combination with the size information of each virtual object. In an embodiment of the present invention, in order to facilitate understanding and reduce computational complexity, the placement space of the virtual object and the placement reference position of each virtual object can be projected onto the horizontal plane of the space where the placement reference position of each virtual object is located to obtain a projection diagram, and relevant calculations can be performed in the projection diagram.

[0052] Figure 4 : is a projection diagram of a virtual object placement space and a virtual object placement reference circle according to an embodiment of the present invention. Figure 4 As shown in the projection diagram, the projection of the virtual object placement space is circle O, and the projection of the virtual object placement reference circle is the projection circle corresponding to the virtual objects A, B, and C in the diagram. Taking the projection circle corresponding to virtual object A as an example, the projection circle is the tangent point between the front face of virtual object A and circle O. As the center of the circle, the front width of the virtual object A is taken as the diameter. Combine O and The connection line and the thickness information of the virtual object A (also recorded as depth information) can be used to calculate the tangent point The location coordinates of .

[0053] According to an embodiment of the present invention, determining the posture information of the virtual object in the placement space based on the placement space, the placement reference position of each virtual object, and the size information of each virtual object may specifically include: calculating the displacement matrix, rotation matrix, and scaling matrix of the virtual object based on the placement space, the placement reference position of each virtual object, and the size information of each virtual object, and determining the posture information of the virtual object in the placement space based on the displacement matrix, the rotation matrix, and the scaling matrix. Generally, the posture information of the virtual object includes information such as the position, rotation angle, and scaling coefficient of the virtual object. The posture information of the virtual object can be obtained by calculating the corresponding displacement matrix, rotation matrix, and scaling matrix.

[0054] According to one embodiment of the present invention, based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, calculating the displacement matrix of the comparison virtual object, can specifically include: determining the coordinates of the first tangent point between the reference virtual object and the placement space based on the placement space and the placement reference position of the reference virtual object; determining the angle between the reference virtual object and the comparison virtual object based on the placement reference position of each virtual object and the size information of each virtual object, wherein the angle is the central angle of a chord formed by the front center of the reference virtual object and the front center of the comparison virtual object in the placement space corresponding to the angle; determining the coordinates of the second tangent point between the comparison virtual object and the placement space based on the coordinates of the first tangent point and the angle; determining the position coordinates of the comparison virtual object based on the coordinates of the placement space and the second tangent point, and generating the displacement matrix of the comparison virtual object based on the position coordinates of the comparison virtual object.

[0055] Specifically, combined Figure 4 When calculating the displacement matrix of the virtual object B, the following steps may be specifically included:

[0056] (1) Calculate the chord length L of the virtual object B: ,in, To place the spacing, one method used in practice is to use 1 / 4 of the smaller value of the front width of A or B as , so that there is enough display space for subsequent virtual interactive display, so as not to cause mutual interference between the two virtual objects; is the diameter of the reference circle for placing virtual object A, is the diameter of the reference circle for placing the virtual object B;

[0057] (2) Calculate the central angle corresponding to the chord length L : , where R is the radius of circle O;

[0058] (3) Calculate the tangent point between the virtual object B and the circle O coordinate ,pass Around The axis is rotated to obtain: ,in, is the tangent point between the virtual object A and the circle O The coordinates of is the center of the virtual object A, is the angle of rotation;

[0059] (4) Calculate the actual placement position of virtual object B for, , where the actual placement position of the virtual object B is That is, the position coordinates of the center of the virtual object B, is the thickness of the virtual object B, That is, O and The distance between

[0060] (5) Calculate the displacement matrix , where I is the identity matrix.

[0061] According to the above steps (1) to (5), the displacement matrix of the virtual object B can be calculated, and the rotation matrix and scaling matrix of the virtual object B will be calculated later.

[0062] Specifically, according to the vector And compare the initial orientation unit vector of virtual object B , you can calculate the rotation angle of the virtual object B around the Y axis : , and then get the rotation matrix .

[0063] In the embodiment of the present invention, assuming that the model scaling factor of the comparison virtual object B is s, the scaling matrix is: At this time, it is assumed that when performing a comparison display of virtual objects, the base virtual object A is of actual size, that is, the scaling factor of the base virtual object A is 1. Therefore, in order to perform a more accurate comparison display of virtual objects, the scaling factor of the comparison virtual object B is also s=1.

[0064] After obtaining the displacement matrix, rotation matrix and scaling matrix of the comparison virtual object B, the posture information of the comparison virtual object in the placement space can be calculated. For example, the placement posture information of the comparison virtual object can be obtained as follows: .

[0065] Step S103: Performing a comparative display of virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object. After obtaining the parameters according to the aforementioned steps S101 to S102, each virtual object can be placed at a corresponding placement reference position with corresponding posture information to perform a comparative display of virtual objects.

[0066] According to one embodiment of the present invention, the method for comparing and displaying virtual objects may further include: adjusting the scale of the reference virtual object and the comparison virtual object in equal proportion; and interactively displaying virtual objects based on the adjusted reference virtual object and the comparison virtual object. Specifically, by adjusting the scale factor of the scale matrix in the gesture information of the reference virtual object and the comparison virtual object, the reference virtual object and the comparison virtual object may be enlarged or reduced in equal proportion, so as to facilitate comparison of details, overall comparison or operation experience of the reference virtual object and the comparison virtual object, thereby better meeting the needs and usage experience of users.

[0067] According to another embodiment of the present invention, the method for comparing and displaying virtual objects may further include: determining at least one target virtual object from the virtual objects, and scaling and / or rotating at least one target virtual object to perform interactive display of the virtual objects. The target virtual object may be a reference virtual object or a comparison virtual object. There may be one or more target virtual objects to be determined. According to operational requirements, the determined target virtual object may be scaled and / or rotated to achieve interactive display of the virtual object. When scaling and / or rotating the target virtual object, there is no need to scale and / or rotate the non-target virtual objects that are not selected, so that interactive display of virtual objects can be performed flexibly.

[0068] Figure 5 2 is a schematic diagram of the main modules of the virtual object comparison display device according to an embodiment of the present invention. Figure 5As shown, the virtual object comparison display device 500 of the embodiment of the present invention mainly includes a placement space construction module 501, a posture information determination module 502 and a comparison display module 503.

[0069] A placement space construction module 501 is used to construct a placement space for virtual objects according to the posture information of the reference virtual object and the position of the observation point, wherein the virtual objects include the reference virtual object and the comparison virtual object, and each virtual object is at an equal distance from the observation point in the placement space;

[0070] A posture information determination module 502, used to determine the posture information of the comparison virtual object in the placement space;

[0071] The comparison and display module 503 is used to compare and display virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object.

[0072] According to one embodiment of the present invention, the placement space construction module 501 can be specifically used to: set the reference virtual object to a preset size and face the observation point to obtain the posture information of the reference virtual object; use the vertical line where the observation point is located as the central axis, and determine at least one circle center from the central axis; for each circle center, use the distance from the circle center to the front face of the reference virtual object as the radius, and construct the placement space of the virtual object according to the circle center and the radius, with the front face of the reference virtual object being the front rectangle of the bounding box of the reference virtual object.

[0073] According to another embodiment of the present invention, the placement space construction module 501 can be specifically used to: set the reference virtual object to a preset size and face the observation point, and adjust the distance between the reference virtual object and the observation point to obtain the posture information of the reference virtual object; take the vertical line where the observation point is located as the central axis, and determine at least one circle center from the central axis; for each circle center, take the distance between the reference virtual object and the observation point as the radius, and construct the placement space of the virtual object according to the circle center and the radius, wherein the distance between the reference virtual object and the observation point is the distance between the front center point of the reference virtual object and the vertical line where the observation point is located, and the front center point of the reference virtual object is the center point of the front rectangle of the bounding box of the reference virtual object.

[0074] According to yet another embodiment of the present invention, the preset size is the actual size of the reference virtual object.

[0075] According to another embodiment of the present invention, when the placement space construction module 501 takes the vertical line at the observation point as the central axis and determines at least one center of a circle from the central axis, it can be specifically used to: take the height of the front center point of the reference virtual object as the height, take the vertical line at the observation point as the central axis, and determine the center of the circle from the central axis according to the height.

[0076] According to another embodiment of the present invention, the posture information determination module 502 can be specifically used to: determine the placement reference position of each virtual object according to the placement space and the size information of each virtual object; determine the posture information of the virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, the posture information including position information, rotation information and scaling information.

[0077] According to another embodiment of the present invention, when the posture information determination module 502 determines the placement reference position of each virtual object based on the placement space and the size information of each virtual object, it can be specifically used to: for each virtual object, use the front center point of the virtual object as the tangent point between the front of the virtual object and the placement space, the front of the virtual object is the front rectangle of the virtual object's bounding box, and the front center point of the virtual object is the center point of the front rectangle of the virtual object's bounding box; with the tangent point as the center of the circle and the front width of the virtual object as the diameter, determine the placement reference position of the virtual object, and the front width of the virtual object is the width of the front rectangle of the virtual object's bounding box.

[0078] According to another embodiment of the present invention, when the posture information determination module 502 determines the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, it can be specifically used to: project the placement space and the placement reference position of each virtual object onto the horizontal plane of the space where the placement reference position of each virtual object is located to obtain a projection image; and, on the projection image, determine the posture information of the comparison virtual object in the placement space in combination with the size information of each virtual object.

[0079] According to another embodiment of the present invention, when the posture information determination module 502 determines the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, it can be specifically used to: calculate the displacement matrix, rotation matrix and scaling matrix of the comparison virtual object respectively based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, and determine the posture information of the comparison virtual object in the placement space based on the displacement matrix, the rotation matrix and the scaling matrix.

[0080] According to another embodiment of the present invention, when the posture information determination module 502 calculates the displacement matrix of the comparison virtual object based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, it can be specifically used to: determine the coordinates of the first tangent point between the reference virtual object and the placement space based on the placement space and the placement reference position of the reference virtual object; determine the angle between the reference virtual object and the comparison virtual object based on the placement reference position of each virtual object and the size information of each virtual object, wherein the angle is the central angle of a chord formed by the front center of the reference virtual object and the front center of the comparison virtual object in the placement space corresponding to the center of the circle; determine the coordinates of the second tangent point between the comparison virtual object and the placement space based on the coordinates and the angle of the first tangent point; determine the position coordinates of the comparison virtual object based on the coordinates of the placement space and the second tangent point, and generate the displacement matrix of the comparison virtual object based on the position coordinates of the comparison virtual object.

[0081] According to another embodiment of the present invention, the virtual object comparison display device 500 may further include a virtual interactive display module (not shown in the figure), which is used to: perform proportional scaling adjustment on the reference virtual object and the comparison virtual object; and perform interactive display of virtual objects based on the adjusted reference virtual object and the comparison virtual object.

[0082] According to another embodiment of the present invention, the virtual interactive display module (not shown in the figure) can also be used to: determine at least one target virtual object from the virtual objects, and scale and / or rotate at least one target virtual object to perform interactive display of the virtual objects.

[0083] According to yet another embodiment of the present invention, the placement reference position of each virtual object is variable.

[0084] According to the technical solution of the embodiment of the present invention, by constructing a placement space of virtual objects according to the posture information of the reference virtual object and the position of the observation point, the virtual objects include the reference virtual object and the comparison virtual object, and the distance between each virtual object and the observation point in the placement space is equal; determining the posture information of the comparison virtual object in the placement space; and performing comparative display of the virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object, the placement space of the virtual object can be constructed based on the posture information of the reference virtual object, so that the distance between each virtual object and the observation point in the placement space is equal, and the placement posture of the comparison virtual object is determined in combination with the placement space of the virtual object, thereby achieving the same observation angle and observation effect for each virtual object, and the object comparison result will not be affected when adjusting the model orientation, posture, etc.

[0085] Figure 6An exemplary system architecture 600 is shown to which a method for comparing and displaying virtual objects or an apparatus for comparing and displaying virtual objects according to an embodiment of the present invention may be applied.

[0086] like Figure 6 As shown, the system architecture 600 may include at least one of a first terminal device 601, a second terminal device 602, and a third terminal device 603, a network 604, and a server 605. The network 604 is used to provide a medium for a communication link between the first terminal device 601, the second terminal device 602, the third terminal device 603, and the server 605. The network 604 may include various connection types, such as wired, wireless communication links, or optical fiber cables, etc.

[0087] The user can use the first terminal device 601, the second terminal device 602, and the third terminal device 603 to interact with the server 605 through the network 604 to receive or send messages, etc. Various communication client applications can be installed on the first terminal device 601, the second terminal device 602, and the third terminal device 603, such as shopping applications, web browser applications, search applications, instant messaging tools, email clients, social platform software, etc. (only for example).

[0088] The first terminal device 601, the second terminal device 602, and the third terminal device 603 may be various electronic devices having display screens and supporting web browsing, including but not limited to smart phones, tablet computers, laptop computers, desktop computers, and the like.

[0089] The server 605 may be a server that provides various services, such as a background management server (for example only) that provides support for shopping websites browsed by users using the first terminal device 601, the second terminal device 602, and the third terminal device 603. The background management server may construct a placement space for virtual objects based on the posture information of the reference virtual object and the position of the observation point for the received data such as the comparison display request of virtual objects, wherein the virtual objects include the reference virtual object and the comparison virtual object, and each virtual object is at an equal distance from the observation point in the placement space; determine the posture information of the comparison virtual object in the placement space; perform the comparison display of virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object, and feed back the processing results (such as the comparison display results - for example only) to the terminal device.

[0090] It should be noted that the virtual object comparison display method provided in the embodiment of the present invention is generally executed by the server 605 , and accordingly, the virtual object comparison display device is generally disposed in the server 605 .

[0091] It should be understood that Figure 6The number of terminal devices, networks and servers in the embodiment is only for illustration. Any number of terminal devices, networks and servers may be provided according to implementation requirements.

[0092] Reference below Figure 7 , which shows a schematic diagram of the structure of a computer system 700 of a terminal device or a server suitable for implementing an embodiment of the present invention. Figure 7 The terminal device or server shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0093] like Figure 7 As shown, the computer system 700 includes a central processing unit (CPU) 701, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 702 or a program loaded from a storage part 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the system 700 are also stored. The CPU 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.

[0094] The following components are connected to the I / O interface 705: an input section 706 including a keyboard, a mouse, etc.; an output section 707 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 708 including a hard disk, etc.; and a communication section 709 including a network interface card such as a LAN card, a modem, etc. The communication section 709 performs communication processing via a network such as the Internet. A drive 710 is also connected to the I / O interface 705 as needed. A removable medium 711, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 710 as needed, so that a computer program read therefrom is installed into the storage section 708 as needed.

[0095] In particular, according to the embodiments disclosed in the present invention, the process described above with reference to the flowchart can be implemented as a computer software program. For example, the embodiments disclosed in the present invention include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication part 709, and / or installed from the removable medium 711. When the computer program is executed by the central processing unit (CPU) 701, the above-mentioned functions defined in the system of the present invention are executed.

[0096] It should be noted that the computer-readable medium shown in the present invention may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device. In the present invention, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. This propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate or transmit a program for use by or in conjunction with an instruction execution system, apparatus or device. The program code contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, optical cable, RF, etc., or any suitable combination of the above.

[0097] The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present invention. In this regard, each box in the flow chart or block diagram can represent a module, a program segment, or a part of a code, and the above-mentioned module, program segment, or a part of a code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flow chart, and the combination of the boxes in the block diagram or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0098] The units or modules involved in the embodiments of the present invention may be implemented in software or hardware. The units or modules described may also be arranged in a processor, for example, may be described as: a processor includes a placement space construction module, a posture information determination module and a comparison display module. Among them, the names of these units or modules do not constitute a limitation on the units or modules themselves under certain circumstances. For example, the comparison display module may also be described as "a module for performing a comparison display of virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object".

[0099] As another aspect, the present invention also provides a computer-readable medium, which may be included in the device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by a device, the device includes: constructing a placement space for virtual objects according to the posture information of the reference virtual object and the position of the observation point, wherein the virtual objects include the reference virtual object and the comparison virtual object, and each virtual object is at an equal distance from the observation point in the placement space; determining the posture information of the comparison virtual object in the placement space; and performing a comparison display of virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object.

[0100] According to the technical solution of the embodiment of the present invention, by constructing a placement space of virtual objects according to the posture information of the reference virtual object and the position of the observation point, the virtual objects include the reference virtual object and the comparison virtual object, and the distance between each virtual object and the observation point in the placement space is equal; determining the posture information of the comparison virtual object in the placement space; and performing comparative display of the virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object, the placement space of the virtual object can be constructed based on the posture information of the reference virtual object, so that the distance between each virtual object and the observation point in the placement space is equal, and the placement posture of the comparison virtual object is determined in combination with the placement space of the virtual object, thereby achieving the same observation angle and observation effect for each virtual object, and the object comparison result will not be affected when adjusting the model orientation, posture, etc.

[0101] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions may occur depending on design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for comparing and displaying virtual objects, characterized in that: include: Constructing a placement space for virtual objects according to the posture information of the reference virtual object and the position of the observation point, wherein the virtual objects include the reference virtual object and the comparison virtual object, and each virtual object is at an equal distance from the observation point in the placement space; Determine the posture information of the comparison virtual object in the placement space, the posture information including position information, rotation information and scaling information; wherein determining the posture information of the comparison virtual object in the placement space includes: determining the placement reference position of each virtual object according to the placement space and the size information of each virtual object; determining the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object; A comparison display of virtual objects is performed based on the posture information of the reference virtual object and the posture information of the comparison virtual object.

2. The method according to claim 1, characterized in that: The placement space of the virtual object is constructed according to the posture information and observation point position of the reference virtual object, including: Setting the reference virtual object to a preset size and facing the observation point to obtain the posture information of the reference virtual object; Taking the perpendicular line where the observation point is located as the central axis, determine at least one circle center from the central axis; For each circle center, the distance from the circle center to the front face of the reference virtual object is taken as the radius, and a placement space for the virtual object is constructed according to the circle center and the radius, wherein the front face of the reference virtual object is the front rectangle of the bounding box of the reference virtual object.

3. The method according to claim 1, characterized in that The placement space of the virtual object is constructed according to the posture information and observation point position of the reference virtual object, including: Setting a reference virtual object to a preset size and facing an observation point, and adjusting a distance between the reference virtual object and the observation point to obtain posture information of the reference virtual object; Taking the perpendicular line where the observation point is located as the central axis, determine at least one circle center from the central axis; For each circle center, the distance between the reference virtual object and the observation point is taken as the radius, and a placement space for the virtual object is constructed according to the circle center and the radius, wherein the distance between the reference virtual object and the observation point is the distance between the front center point of the reference virtual object and the vertical line where the observation point is located, and the front center point of the reference virtual object is the center point of the front rectangle of the bounding box of the reference virtual object.

4. The method according to claim 2 or 3, characterized in that: The preset size is the actual size of the reference virtual object.

5. The method according to claim 2 or 3, characterized in that: Taking the vertical line where the observation point is located as the central axis, determine at least one circle center from the central axis, including: The height of the front center point of the reference virtual object is taken as the height, the vertical line where the observation point is located is taken as the central axis, and the center of the circle is determined from the central axis according to the height.

6. The method according to claim 1, characterized in that Determining a placement reference position of each virtual object according to the placement space and size information of each virtual object includes: For each virtual object, the front center point of the virtual object is used as the tangent point between the front of the virtual object and the placement space, the front of the virtual object is the front rectangle of the bounding box of the virtual object, and the front center point of the virtual object is the center point of the front rectangle of the bounding box of the virtual object; The placement reference position of the virtual object is determined by taking the tangent point as the center of the circle and the front width of the virtual object as the diameter, wherein the front width of the virtual object is the width of the front rectangle of the bounding box of the virtual object.

7. The method according to claim 1, characterized in that Determining the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object, and the size information of each virtual object includes: Projecting the placement space and the placement reference position of each virtual object onto a horizontal plane of the space where the placement reference position of each virtual object is located to obtain a projection image; And, on the projection image, the posture information of the comparison virtual object in the placement space is determined in combination with the size information of each virtual object.

8. The method according to claim 1 or 7, characterized in that: Determining the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object, and the size information of each virtual object includes: Based on the placement space, the placement reference position of each virtual object and the size information of each virtual object, the displacement matrix, rotation matrix and scaling matrix of the comparison virtual object are calculated respectively, and the posture information of the comparison virtual object in the placement space is determined based on the displacement matrix, the rotation matrix and the scaling matrix.

9. The method according to claim 8, characterized in that Calculating a displacement matrix of the compared virtual object based on the placement space, the placement reference position of each virtual object, and the size information of each virtual object includes: determining the coordinates of a first tangent point between the reference virtual object and the placement space based on the placement space and a placement reference position of the reference virtual object; Determine an angle between the reference virtual object and the comparison virtual object based on the placement reference position of each virtual object and the size information of each virtual object, wherein the angle is a central angle corresponding to a chord formed by the front center of the reference virtual object and the front center of the comparison virtual object in the placement space; Determining the coordinates of a second tangent point between the comparison virtual object and the placement space based on the coordinates of the first tangent point and the angle; Based on the placement space and the coordinates of the second tangent point, the position coordinates of the comparison virtual object are determined, and based on the position coordinates of the comparison virtual object, a displacement matrix of the comparison virtual object is generated.

10. The method according to claim 1, characterized in that The method further comprises: Performing proportional scaling adjustment on the reference virtual object and the comparison virtual object; The virtual objects are interactively displayed based on the adjusted baseline virtual objects and the comparison virtual objects.

11. The method according to claim 1, characterized in that: The method further comprises: At least one target virtual object is determined from the virtual objects, and the at least one target virtual object is scaled and / or rotated to perform interactive display of the virtual objects.

12. The method according to claim 1, characterized in that The placement reference position of each virtual object is changeable.

13. A virtual object comparison display device, characterized in that: include: A placement space construction module, used to construct a placement space of virtual objects according to the posture information of the reference virtual object and the position of the observation point, wherein the virtual objects include the reference virtual object and the comparison virtual object, and each virtual object is at an equal distance from the observation point in the placement space; A posture information determination module, used to determine the posture information of the comparison virtual object in the placement space, wherein the posture information includes position information, rotation information and scaling information; The posture information determination module is further used to: determine a placement reference position of each virtual object according to the placement space and the size information of each virtual object; determine the posture information of the comparison virtual object in the placement space based on the placement space, the placement reference position of each virtual object and the size information of each virtual object; The comparison and display module is used to compare and display virtual objects based on the posture information of the reference virtual object and the posture information of the comparison virtual object.

14. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 12.

15. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

16. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 12 is implemented.

Images