Virtual object display method and apparatus, electronic device, and storage medium

Abstract

Embodiments of the present disclosure provide a virtual object display method and apparatus, an electronic device, and a storage medium. The method comprises: determining a target virtual object, and, by means of a virtual reality engine, rendering and displaying the target virtual object in a virtual display space; in response to a first operation on the target virtual object in the virtual display space, adjusting the target virtual object in the virtual display space on the basis of an adjustment action corresponding to the first operation; and in response to a second operation on the target virtual object in the virtual display space, displaying a target virtual object migration operation page corresponding to the target virtual object, wherein the target virtual object migration operation page is used to ensure that the target virtual object is no longer displayed in the virtual display space after migration.

Description

Virtual object display method, device, electronic device and storage medium

[0001] This application claims priority to the Chinese patent application filed with the State Intellectual Property Office of China on December 29, 2023, with application number 202311868797.2 and invention name “Virtual object display method, device, electronic device and storage medium”, the entire contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present disclosure relate to the field of virtual reality technology, and in particular to a method, device, electronic device, and storage medium for displaying a virtual object. Background Art

[0003] Online acquisition of physical objects has become one of the main ways to migrate physical objects. Most online platforms for acquiring physical objects still rely on traditional 2D pictures and videos to display physical objects. Although this method of migrating physical objects can provide basic information and a two-dimensional display of physical objects, it has certain limitations in physical object migration and cannot allow users to fully understand the appearance, texture, and function of physical objects. Since users can only imagine the actual effects of physical objects through pictures and videos, they lack realism and interactivity. This may lead to disappointment with the actual effects of physical objects after acquiring them, reducing the satisfaction with physical object migration.

[0004] Summary of the Invention

[0005] The present disclosure provides a virtual object display method, device, electronic device, and storage medium to rapidly construct a physical object migration platform capable of three-dimensional rendering and display of physical objects, allowing immersive browsing and manipulation of physical objects in a virtual reality environment, providing a more realistic and intuitive physical object migration experience.

[0006] In a first aspect, an embodiment of the present disclosure provides a method for displaying a virtual object, the method comprising:

[0007] Determining a target virtual object, wherein the target virtual object is a physical object model existing in a virtual environment by constructing a three-dimensional model of the target physical object;

[0008] Rendering and displaying the target virtual object in a virtual display space through a virtual reality engine, wherein the virtual display space is a pre-built virtual environment corresponding to a three-dimensional model space for displaying the target virtual object;

[0009] In response to a first operation on a target virtual object in a virtual presentation space, adjusting the target virtual object in the virtual presentation space according to an adjustment action corresponding to the first operation;

[0010] In response to a second operation on a target virtual object in the virtual presentation space, a target virtual object migration operation page corresponding to the target virtual object is displayed, wherein the target virtual object migration operation page is used to cause the target virtual object to no longer be displayed in the virtual presentation space after migration.

[0011] In a second aspect, an embodiment of the present disclosure further provides a virtual object display device, the device comprising:

[0012] A determination module is used to determine a target virtual object, wherein the target virtual object is a physical object model existing in a virtual environment by constructing a three-dimensional model of the target physical object;

[0013] A display module, configured to render and display the target virtual object in a virtual display space through a virtual reality engine, wherein the virtual display space is a pre-built virtual environment corresponding to a three-dimensional model space for displaying the target virtual object;

[0014] an adjustment module, configured to, in response to a first operation on a target virtual object in a virtual presentation space, adjust the target virtual object in the virtual presentation space according to an adjustment action corresponding to the first operation;

[0015] The migration module is configured to display a target virtual object migration operation page corresponding to the target virtual object in response to a second operation on the target virtual object in the virtual display space, wherein the target virtual object migration operation page is configured to cause the target virtual object to no longer be displayed in the virtual display space after migration.

[0016] In a third aspect, an embodiment of the present disclosure further provides an electronic device, the electronic device comprising:

[0017] at least one processor; and

[0018] a memory communicatively connected to the at least one processor; wherein,

[0019] The memory stores a computer program that can be executed by the at least one processor. The computer program is executed by the at least one processor to enable the at least one processor to execute the virtual object display method according to any one of the above embodiments.

[0020] In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable medium, wherein the computer-readable medium stores computer instructions, and the computer instructions are used to enable a processor to implement the virtual object display method described in any one of the above embodiments when executed.

[0021] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become readily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and other features, advantages, and aspects of the various embodiments of the present disclosure will become more apparent with reference to the following detailed description in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numerals represent the same or similar elements. It should be understood that the drawings are schematic and that the originals and elements are not necessarily drawn to scale.

[0023] FIG1 is a flow chart of a method for displaying a virtual object provided by an embodiment of the present disclosure;

[0024] FIG2 is a spatial schematic diagram of a virtual display space during a physical object migration process provided by an embodiment of the present disclosure;

[0025] FIG3 is a schematic structural diagram of a virtual object display device provided by an embodiment of the present disclosure;

[0026] FIG4 is a schematic structural diagram of an electronic device for implementing a virtual object display method provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0027] The following describes embodiments of the present disclosure in more detail with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as limited to the embodiments described herein. Rather, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of protection of the present disclosure.

[0028] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0029] As used herein, the term "including" and its variations are open-ended, i.e., "including but not limited to." The term "based on" means "based, at least in part, on." The term "one embodiment" means "at least one embodiment," the term "another embodiment" means "at least one additional embodiment," and the term "some embodiments" means "at least some embodiments." Other terms are defined in the following description.

[0030] It should be noted that the concepts of "first" and "second" mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

[0031] It should be noted that the modifications of "one" and "multiple" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, they should be understood as "one or more".

[0032] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0033] Figure 1 is a flow chart illustrating a method for displaying a virtual object provided by an embodiment of the present disclosure. This embodiment of the present disclosure is applicable to the display of a virtual object that is a physical object. This method can be performed by a virtual object display device, which can be implemented in software and / or hardware and generally integrated into any electronic device with network communication capabilities, such as a mobile terminal, PC, or server. Through the embodiments of the present disclosure, virtual reality technology and 3D modeling capabilities can be combined to interact with virtual objects in a virtual reality environment and manipulate physical objects online.

[0034] As shown in FIG1 , the virtual object display method according to an embodiment of the present disclosure may include the following process:

[0035] S110 , determining a target virtual object, where the target virtual object is a physical object model existing in a virtual environment by constructing a three-dimensional model of the target physical object.

[0036] Physical object acquisition platforms rely on traditional 2D images and videos to display physical objects and then acquire them. While this approach can provide basic information about physical objects, it has certain limitations in terms of interactive experience. Traditional 2D images and videos cannot fully display the three-dimensional form and details of physical objects, making it difficult to accurately understand the actual appearance and texture of the physical object. This can lead to disappointment with the actual effect of the physical object after acquisition, thus reducing satisfaction with the acquisition of the physical object.

[0037] An entity object is an object in a computer program that represents a specific object or concept in the real world, with specific properties and behaviors. For example, on an e-commerce platform, every item sold can be considered an entity object, with properties such as name, price, description, and inventory quantity.

[0038] To this end, in the scenario of acquiring the target entity object, the idea of ​​constructing a three-dimensional model of the target entity object is introduced. By constructing a three-dimensional model of the target entity object and the target virtual object existing in the virtual environment, it is possible to easily create and display a 3D model of the target entity object. In this way, in the process of acquiring the target entity object, the three-dimensional form and size information of the target virtual object can be rendered and displayed, so as to fully display the size, shape and proportion of the entity object, thereby fully understanding the appearance, texture and function of the entity object, rather than just imagining the actual effect of the entity object through pictures and videos, which lacks realism and interactivity.

[0039] S120: Rendering and displaying the target virtual object in a virtual display space through a virtual reality engine. The virtual display space is a pre-built virtual environment corresponding to a three-dimensional model space for displaying the target virtual object.

[0040] Traditional 2D images and videos used to display physical objects not only fail to fully display the three-dimensional form and details of the physical object, making it difficult to accurately understand the physical object's actual appearance and texture, but also have certain limitations in the interactive experience during the acquisition of the physical object. As shown in Figure 2, more advanced virtual reality technology can be introduced to provide a more realistic and interactive physical object acquisition experience.

[0041] Alternatively, as shown in Figure 2 , a virtual display space can be created using virtual reality technology. A virtual reality engine can be used to render and display at least one virtual object within the virtual display space, achieving high-quality 3D model rendering and smooth display. This allows users to immersively browse and try out the virtual objects displayed in the virtual display space, thereby better understanding the characteristics and performance of the physical objects. The 3D models corresponding to the virtual objects are accurately rendered and displayed within the virtual display space, supporting display from multiple angles and distances, and supporting gesture interaction, such as moving and picking up virtual objects.

[0042] As an optional but non-limiting implementation, determining the target virtual object includes the following steps A1-A2:

[0043] Step A1: For each target entity object, obtain at least two entity object image information obtained by shooting the target entity object from different shooting angles and directions through a three-dimensional modeling application.

[0044] Step A2: Based on the image information of at least two physical objects, a three-dimensional model of the target physical object is automatically constructed through a three-dimensional modeling application to obtain a target virtual object corresponding to the target physical object.

[0045] 3D modeling of target physical objects typically requires specialized equipment and technical expertise, potentially requiring significant investment in time and resources to learn and master the technology, or requiring a dedicated team to perform the work. This undoubtedly increases the resource consumption of 3D modeling. To address this, 3D modeling applications that automate 3D modeling can be introduced. These applications provide simple guidance and prompts to quickly and easily capture and model the physical object, ensuring optimal results.

[0046] Optionally, the terminal device has a built-in depth-sensing camera or a high-resolution ordinary camera, and the depth-sensing camera or high-resolution ordinary camera of the terminal device is called to capture the target entity object to obtain multiple entity object image information, ensuring that the terminal device uses the depth-sensing camera or high-resolution ordinary camera to capture the target entity object from different angles and directions to obtain enough information about the target entity object to construct a 3D model corresponding to the target entity object.

[0047] After obtaining enough physical object image information through the 3D modeling application, the 3D modeling application in the terminal device is called to automatically use computer vision and machine learning algorithms to process the physical object image information corresponding to the target physical object, so as to realize the 3D model construction of the target physical object and the target virtual object existing in the virtual environment. Alternatively, the target virtual object corresponding to the target physical object is automatically generated from the target physical object image information taken from multiple angles by combining deep learning and geometric reconstruction technology. The process covers steps such as feature extraction, point cloud generation, and surface reconstruction. Optionally, after the modeling is completed, the 3D model corresponding to the generated target virtual object can be viewed in the 3D modeling application of the terminal device, such as rotating, scaling, or adjusting the details of the model.

[0048] As an optional but non-limiting implementation, the at least two entity object image information includes key frame images and key feature points corresponding to the target entity object obtained by continuously moving around the target entity object along different shooting angles and directions.

[0049] When calling the terminal device's depth-sensing camera or high-resolution ordinary camera to capture images of the target entity object, prompt the user to move around the target entity object at different angles, and at the same time call the 3D modeling application in the terminal device to automatically capture the target entity object's image information, including key frames and feature points, corresponding to the target entity object. A processing algorithm based on SLAM reconstruction technology is then used to convert the captured target entity object image information into a high-precision 3D model. This process requires operations such as depth map generation, mesh optimization, and texture mapping. In addition, the 3D model corresponding to the target virtual object also needs to be optimized through model simplification, denoising, and texture optimization to ensure that the target virtual object can be displayed smoothly in a virtual reality environment later.

[0050] This solution combines virtual reality technology with the 3D modeling capabilities of the 3D modeling application in the terminal device to provide an interactive way to access physical objects, enhancing the interactive experience. Through the immersive virtual reality environment, the physical object's form can be more intuitively understood. Furthermore, the 3D modeling application in the terminal device can easily create 3D models of physical objects, reducing the resource consumption required for 3D modeling.

[0051] As an optional but non-limiting implementation, rendering and displaying the target virtual object in the virtual display space by using a virtual reality engine includes the following steps B1-B2:

[0052] Step B1: Rendering a target virtual object through a virtual reality engine and displaying it on a shelf model in a virtual display space. The shelf is a pre-built three-dimensional model used to carry the rendered target virtual object in the virtual display space.

[0053] Step B2: configuring lighting effects and material effects for the target virtual object rendered and displayed on the shelf model in the virtual display space according to the target physical object characteristics and material corresponding to the target virtual object.

[0054] As shown in Figure 2, a virtual reality engine receives and parses 3D model files of target virtual objects constructed from target physical objects, uploaded from a 3D modeling application on a terminal device. Standard formats supported include OBJ and FBX. Examples of virtual reality engines include Unity and Unreal Engine. Based on the rendering requirements for the target virtual objects in the virtual display space, the virtual reality engine adjusts rendering settings, such as resolution, frame rate, and anti-aliasing, to render and display each target virtual object on a shelf model within the virtual display space.

[0055] Referring to FIG. 2 , appropriate lighting effects can be set for the target virtual object rendered and displayed on the shelf model in the virtual display space based on the target physical object characteristics and materials corresponding to the target virtual object. These can include ambient light, directional light, point light sources, etc., and the intensity, color, and direction of the lighting can be adjusted to create realistic lighting effects. At the same time, the material properties of the target virtual object rendered and displayed on the shelf model in the virtual display space can be adjusted based on the target physical object characteristics and materials corresponding to the target virtual object. These can include color, reflectivity, roughness, etc., and appropriate material properties can be set based on the appearance and texture of the target physical object to enhance the sense of reality. Furthermore, appropriate textures can be added to the surface of the target virtual object based on the target physical object characteristics and materials corresponding to the target virtual object. This can be done by importing texture images or using the texture library provided by the engine. Textures can increase the details and realism of the model.

[0056] S130: In response to a first operation on a target virtual object in a virtual presentation space, adjust the target virtual object in the virtual presentation space according to an adjustment action corresponding to the first operation.

[0057] Referring to FIG. 2 , a first operation can be performed on the target virtual object among the target virtual objects rendered and displayed in the virtual display space. The first operation can be used to interact with the target virtual object (for example, support the use of gestures for interaction, browse different target virtual objects by sliding gestures, select the target virtual object by clicking gestures, and enlarge or reduce the size of the target virtual object by zooming gestures, etc.), display the target virtual object (for example, display the 3D model corresponding to the target virtual object in the virtual display space, so that the target virtual object can be rendered and displayed from multiple angles and different distances), and support the use of gestures to "pick up" the target virtual object and observe it closely, so that the details of the target virtual object can be displayed more carefully. In addition, virtual reality interaction is supported: virtual handles or gestures can be used to navigate and operate in the virtual display space, and scaling, rotating and moving 3D models are supported to provide a realistic interactive experience.

[0058] As an optional but non-limiting implementation, adjusting the target virtual object in the virtual presentation space according to the adjustment action corresponding to the first operation includes the following steps:

[0059] When the first operation is a first interactive operation for reference display of the target virtual object, the target virtual object rendered and displayed on the shelf model of the virtual display space is adjusted and displayed, and the reference display is to enlarge, reduce or rotate the target virtual object.

[0060] As shown in Figure 2, the tracking function of the virtual reality device can be used to detect a first interaction operation for displaying a reference target virtual object. By identifying the operation type of the first interaction operation, different target virtual objects can be selected, grabbed, and manipulated in the virtual display space. For example, when a target virtual object is selected using the first interaction operation, a corresponding interaction event can be triggered to select the target virtual object in the virtual display space, such as using a hand gesture to select the target virtual object.

[0061] Referring to FIG. 2 , in order to adjust the size of the target virtual object, a first interaction operation may be used to implement operations such as zooming in, zooming out, or rotating the target virtual object. For example, a pinching gesture may be used to zoom out the target virtual object, or a spreading gesture may be used to zoom in the target virtual object. Optionally, when interacting with the target virtual object using the first interaction operation, the result of the first interaction operation may be conveyed to the user through visual, tactile, or audio means, such as displaying a change in the size of the target virtual object, providing tactile vibration, or playing a sound effect.

[0062] As an optional but non-limiting implementation, adjusting the target virtual object in the virtual presentation space according to the adjustment action corresponding to the first operation includes the following steps:

[0063] When the first operation is a second interactive operation for adjusting the position of the target virtual object, the target virtual object rendered and displayed on the shelf model in the virtual display space is moved in position and / or adjusted in posture according to the second interactive operation, so that the target virtual object is displayed from different angles and distances. The second interactive operation is used to indicate the adjusted position and posture of the target virtual object.

[0064] As an optional but non-limiting implementation, adjusting the target virtual object in the virtual presentation space according to the adjustment action corresponding to the first operation includes the following steps C1-C2:

[0065] Step C1: When the first operation is a third interactive operation for grabbing a target virtual object, receiving a grab position and a posture of the target virtual object in the virtual presentation space through the third interactive operation.

[0066] Step C2: adjusting the position and posture of the target virtual object in the virtual display space according to the grasping position and posture of the target virtual object in the virtual display space, and simulating a grasping action for the target virtual object in the virtual display space.

[0067] Referring to Figure 2 , the tracking function of the virtual reality device is utilized to detect the grabbing position and posture corresponding to the third interactive operation for grabbing the target virtual object. Since an interactive event for picking up the target virtual object in the virtual display space is predefined, such as being triggered when the grabbing position approaches the target virtual object, when the interactive event is triggered, the action of grabbing the target virtual object in the virtual display space is simulated based on the grabbing position and posture corresponding to the third interactive operation. This can be achieved by changing the position, rotation, or scaling of the target virtual object in the virtual display space. Of course, to increase the sense of realism, tactile feedback can be considered, providing appropriate tactile vibration or force feedback when the target virtual object is picked up.

[0068] As an optional but non-limiting implementation, adjusting the target virtual object in the virtual presentation space according to the adjustment action corresponding to the first operation includes the following steps D1-D3:

[0069] Step D1: When the first operation is a posture adjustment operation of a reference object, position and posture information of the reference object is received, and the reference object is used to obtain image content of a target virtual object that is rendered and displayed.

[0070] Step D2: Determine, based on the position and posture information of the reference object, a target acquisition angle and a target acquisition position of the reference object relative to the target virtual object when acquiring image content of the target virtual object in the virtual display space.

[0071] Step D3: Rendering and display adjustment of the target virtual object on the shelf model of the virtual display space according to the target acquisition angle and the target acquisition position.

[0072] Use the head tracking sensors (such as gyroscopes and accelerometers) in the virtual reality device to detect the head movement and direction of the reference object. Of course, in addition to head tracking, an external position tracking system (such as a VR positioning base station) can also be used to determine the position of the reference object in the physical space. Based on the head tracking and position tracking data, the real-time viewing angle of the reference object is calculated (that is, the target acquisition angle relative to the target virtual object when acquiring image content of the target virtual object), and the virtual reality engine is used to render the 3D model of the target virtual object into the real-time viewing angle range of the reference object and display it on the virtual reality device, ensuring that the rendering frame rate is high enough to provide a smooth experience.

[0073] Optionally, during the head movement, a smooth transition of the perspective is achieved to avoid dizziness caused by sudden changes in perspective, and it is detected whether the reference object's head collides with the target virtual object in the virtual display space to avoid penetrating the target virtual object or appearing in an unreasonable position.

[0074] S140. In response to a second operation on the target virtual object in the virtual display space, display a target virtual object migration operation page corresponding to the target virtual object, where the target virtual object migration operation page is used to migrate the target virtual object so that the target virtual object is not displayed in the virtual display space after migration.

[0075] Referring to Figure 2, after the virtual reality device receives the second operation on the target virtual object in the virtual display space, a target virtual object migration operation page for migrating the target virtual object corresponding to the target physical object can be displayed on the virtual reality device. When the migration of the target virtual object is confirmed on the target virtual object migration operation page, the right to use the target physical object can be obtained, so that the target virtual object will no longer be displayed in the virtual display space, indicating that the physical object corresponding to the target virtual object has been obtained.

[0076] Optionally, when confirming the migration of the target virtual object displayed in the virtual exhibition space on the target virtual object migration operation page, the display state of the target virtual object in the virtual exhibition space will be adjusted from the visible state to the hidden state, and the number of virtual objects in the visible state displayed in the virtual exhibition space will be reduced.

[0077] Optionally, when confirming the migration of the target virtual object displayed in the virtual display space on the target virtual object migration operation page, not only will the display state of the target virtual object in the virtual display space be adjusted from a visible state to a hidden state, but the target virtual object will also be displayed in the virtual display space corresponding to the reference user, and the reference user is the user who confirmed the migration of the target virtual object displayed in the virtual display space on the target virtual object migration operation page.

[0078] Optionally, when confirming the migration of the target virtual object displayed in the virtual exhibition space on the target virtual object migration operation page, not only will the display state of the target virtual object in the virtual exhibition space be adjusted from the visible state to the hidden state, a virtual container of the reference user will be displayed in the virtual exhibition space, and the target virtual object adjusted from the visible state to the hidden state will be displayed in the virtual container of the reference user, and the reference user is the user who confirmed the migration of the target virtual object displayed in the virtual exhibition space on the target virtual object migration operation page.

[0079] The technical solution of the disclosed embodiment is to obtain a target virtual object that can exist in a virtual environment by constructing a three-dimensional model of the target physical object, and to render and display the target virtual object in a virtual display space. Then, a first operation can be performed on any target virtual object in the virtual display space, and the target virtual object displayed in the virtual display space can be adjusted according to the adjustment action corresponding to the first operation. It can also respond to a second operation to display a target virtual object migration operation page that is no longer displayed in the virtual display space after the target virtual object is migrated, so as to achieve the migration and exchange of the target physical object corresponding to the target virtual object. This solution can combine virtual reality technology and 3D modeling capabilities to provide a way to interact with virtual objects and operate online to obtain physical objects in a virtual reality environment. The physical objects can be displayed more intuitively through an immersive virtual reality environment. At the same time, the 3D modeling capabilities of the device can quickly model physical objects for display in a virtual reality environment, providing unprecedented convenience and interactivity for the migration of physical objects.

[0080] Figure 3 is a structural schematic diagram of a virtual object display device provided by an embodiment of the present disclosure. The embodiment of the present disclosure is applicable to the situation where a virtual object of a physical object is migrated and displayed. The virtual object display device can be implemented in the form of software and / or hardware and is generally integrated on any electronic device with network communication function, which can be a mobile terminal, PC or server, etc.

[0081] As shown in FIG3 , the virtual object display device according to an embodiment of the present disclosure may include the following:

[0082] A determination module 310 is configured to determine a target virtual object, wherein the target virtual object is a physical object model existing in a virtual environment by constructing a three-dimensional model of the target physical object;

[0083] A display module 320 is configured to render and display the target virtual object in a virtual display space using a virtual reality engine. The virtual display space is a pre-built virtual environment corresponding to a three-dimensional model space for displaying the target virtual object.

[0084] an adjustment module 330 for adjusting the target virtual object in the virtual display space according to an adjustment action corresponding to a first operation on the target virtual object in the virtual display space;

[0085] The migration module 340 is configured to display a target virtual object migration operation page corresponding to the target virtual object in response to a second operation on the target virtual object in the virtual display space, wherein the target virtual object migration operation page is configured to cause the target virtual object to no longer be displayed in the virtual display space after migration.

[0086] Based on the technical solution of the above embodiment, optionally, determining the target virtual object includes:

[0087] For each target entity object, obtaining at least two entity object image information obtained by photographing the target entity object from different shooting angles and directions through a three-dimensional modeling application;

[0088] Based on the at least two physical object image information, a three-dimensional model of the target physical object is automatically constructed through a three-dimensional modeling application to obtain a target virtual object corresponding to the target physical object.

[0089] Based on the technical solution of the above embodiment, optionally, the at least two entity object image information includes key frame images and key feature points corresponding to the target entity object obtained by continuously moving around the target entity object along different shooting angles and directions.

[0090] Based on the technical solution of the above embodiment, optionally, rendering and displaying the target virtual object in a virtual display space by using a virtual reality engine includes:

[0091] Rendering the target virtual object and displaying it on a shelf model in a virtual display space through a virtual reality engine, wherein the shelf is a pre-built three-dimensional model for supporting the rendered target virtual object in the virtual display space;

[0092] According to the target physical object characteristics and materials corresponding to the target virtual object, lighting effects and material effects are configured for the target virtual object rendered and displayed on the shelf model of the virtual display space.

[0093] Based on the technical solution of the above embodiment, optionally, adjusting the target virtual object in the virtual presentation space according to the adjustment action corresponding to the first operation includes:

[0094] When the first operation is a first interactive operation for performing a reference display on the target virtual object, adjusting the display of the target virtual object rendered and displayed on the shelf model in the virtual display space, wherein the reference display is to enlarge, reduce, or rotate the target virtual object;

[0095] When the first operation is a second interactive operation for adjusting the position of the target virtual object, the target virtual object rendered and displayed on the shelf model in the virtual display space is moved in position and / or adjusted in posture according to the second interactive operation, so that the target virtual object is displayed from different angles and distances. The second interactive operation is used to indicate the adjusted position and posture of the target virtual object.

[0096] Based on the technical solution of the above embodiment, optionally, adjusting the target virtual object in the virtual presentation space according to the adjustment action corresponding to the first operation includes:

[0097] When the first operation is a third interactive operation for grabbing the target virtual object, receiving a grab position and a posture of the target virtual object in the virtual presentation space through the third interactive operation;

[0098] According to the grasping position and posture of the target virtual object in the virtual display space, the posture of the target virtual object in the virtual display space is adjusted, and a grasping action of the target virtual object is simulated in the virtual display space.

[0099] Based on the technical solution of the above embodiment, optionally, adjusting the target virtual object in the virtual presentation space according to the adjustment action corresponding to the first operation includes:

[0100] When the first operation is a posture adjustment operation of a reference object, receiving position and posture information of the reference object, the reference object is used to obtain image content of a rendered and displayed target virtual object;

[0101] determining, based on the position and posture information of the reference object, a target acquisition angle and a target acquisition position of the reference object relative to the target virtual object when acquiring image content of the target virtual object in the virtual presentation space;

[0102] The target virtual object on the shelf model of the virtual display space is rendered and displayed according to the target acquisition angle and the target acquisition position.

[0103] The technical solution of the disclosed embodiment is to obtain a target virtual object that can exist in a virtual environment by constructing a three-dimensional model of the target physical object, and to render and display the target virtual object in a virtual display space. Then, a first operation can be performed on any target virtual object in the virtual display space, and the target virtual object displayed in the virtual display space can be adjusted according to the adjustment action corresponding to the first operation. It can also respond to a second operation to display a target virtual object migration operation page that is no longer displayed in the virtual display space after the target virtual object is migrated, so as to achieve the migration and exchange of the target physical object corresponding to the target virtual object. This solution can combine virtual reality technology and 3D modeling capabilities to provide a way to interact with virtual objects and operate online to obtain physical objects in a virtual reality environment. The physical objects can be displayed more intuitively through an immersive virtual reality environment. At the same time, the 3D modeling capabilities of the device can quickly model physical objects for display in a virtual reality environment, providing unprecedented convenience and interactivity for the migration of physical objects.

[0104] The virtual object display device provided in the embodiments of the present disclosure can execute the virtual object display method provided in any embodiment of the present disclosure, and has the corresponding functional modules and beneficial effects of the execution method.

[0105] It is worth noting that the various units and modules included in the above-mentioned device are only divided according to functional logic, but are not limited to the above-mentioned division, as long as the corresponding functions can be achieved; in addition, the specific names of the functional units are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the embodiments of the present disclosure.

[0106] FIG4 is a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. Referring to FIG4 , a schematic diagram of the structure of an electronic device (such as a terminal device or server in FIG4 ) 400 suitable for implementing an embodiment of the present disclosure is shown below. The terminal device in the embodiment of the present disclosure may include, but is not limited to, mobile terminals such as mobile phones, laptop computers, digital broadcast receivers, PDAs (personal digital assistants), PADs (tablet computers), PMPs (portable multimedia players), vehicle-mounted terminals (such as vehicle-mounted navigation terminals), etc., and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG4 is merely an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

[0107] As shown in FIG4 , the electronic device 400 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 401, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 402 or a program loaded from a storage device 408 into a random access memory (RAM) 403. Various programs and data required for the operation of the electronic device 400 are also stored in the RAM 403. The processing device 401, the ROM 402, and the RAM 403 are connected to each other via a bus 404. An edit / output (I / O) interface 405 is also connected to the bus 404.

[0108] Typically, the following devices may be connected to the I / O interface 405: an input device 406 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 407 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 408 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 409. The communication device 409 may allow the electronic device 400 to communicate with other devices wirelessly or by wire to exchange data. Although FIG4 shows the electronic device 400 with various devices, it should be understood that not all of the devices shown are required to be implemented or present. More or fewer devices may alternatively be implemented or present.

[0109] In particular, according to an embodiment of the present disclosure, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 409, or installed from the storage device 408, or installed from the ROM 402. When the computer program is executed by the processing device 401, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0110] The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

[0111] The electronic device provided by the embodiment of the present disclosure and the virtual object display method provided by the above embodiment belong to the same inventive concept. For technical details not fully described in this embodiment, please refer to the above embodiment, and this embodiment has the same beneficial effects as the above embodiment.

[0112] An embodiment of the present disclosure provides a computer storage medium having a computer program stored thereon, which, when executed by a processor, implements the virtual object display method provided in the above embodiment.

[0113] It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the two. A computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or component, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such a propagated data signal may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to wires, optical cables, RF (radio frequency), etc., or any suitable combination thereof.

[0114] In some embodiments, the client and server can communicate using any currently known or later developed network protocol, such as HTTP (HyperText Transfer Protocol), and can be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network ("LAN"), a wide area network ("WAN"), an internet (e.g., the Internet), and a peer-to-peer network (e.g., an ad hoc peer-to-peer network), as well as any currently known or later developed network.

[0115] The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

[0116] The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: determines a target virtual object, which is a physical object model existing in a virtual environment by constructing a three-dimensional model of the target physical object; renders and displays the target virtual object in a virtual display space through a virtual reality engine, and the virtual display space is a virtual environment corresponding to a pre-constructed three-dimensional model space for displaying the target virtual object; in response to a first operation on the target virtual object in the virtual display space, adjusts the target virtual object in the virtual display space according to an adjustment action corresponding to the first operation; in response to a second operation on the target virtual object in the virtual display space, displays a target virtual object migration operation page corresponding to the target virtual object, and the target virtual object migration operation page is used to migrate the target virtual object so that the target virtual object is not displayed in the virtual display space after migration.

[0117] Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, or a combination thereof, including, but not limited to, object-oriented programming languages ​​such as Java, Smalltalk, C++, and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a stand-alone software package, partially on the user's computer and partially on a remote computer, or entirely on the remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0118] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the module, program segment, or a part of code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order than that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flowchart, and the combination of the boxes in the block diagram and / or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0119] The units involved in the embodiments described in this disclosure may be implemented in software or hardware. In some cases, the name of a unit does not limit the unit itself. For example, the first acquisition unit may also be described as a "unit for acquiring at least two Internet Protocol addresses."

[0120] The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

[0121] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0122] The above description is merely a preferred embodiment of the present disclosure and an illustration of the technical principles employed. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by the specific combination of the above-mentioned technical features, but also includes other technical solutions formed by any combination of the above-mentioned technical features or their equivalents without departing from the above-mentioned disclosed concepts. For example, a technical solution formed by replacing the above-mentioned features with (but not limited to) technical features with similar functions disclosed in this disclosure.

[0123] In addition, although each operation is described in a specific order, this should not be understood as requiring these operations to be performed in the specific order shown or in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Similarly, although some specific implementation details have been included in the above discussion, these should not be interpreted as limiting the scope of the present disclosure. Some features described in the context of a separate embodiment can also be implemented in a single embodiment in combination. On the contrary, the various features described in the context of a single embodiment can also be implemented in multiple embodiments individually or in any suitable sub-combination mode.

[0124] Although the subject matter has been described in language specific to structural features and / or methodological logical acts, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims

1. A method for displaying virtual objects, the method comprising: Determine a target virtual object, where the target virtual object is an entity object model existing in a virtual environment constructed by performing three-dimensional modeling on a target entity object; Render and display the target virtual object in a virtual display space through a virtual reality engine, where the virtual display space is a virtual environment corresponding to a three-dimensional model space pre-constructed for displaying the target virtual object; In response to a first operation on the target virtual object in the virtual display space, adjust the target virtual object in the virtual display space according to an adjustment action corresponding to the first operation; In response to a second operation on the target virtual object in the virtual display space, display a target virtual object migration operation page corresponding to the target virtual object, where the target virtual object migration operation page is used to migrate the target virtual object so that the target virtual object is not displayed in the virtual display space after migration.

2. The method according to claim 1, wherein, Determining the target virtual object includes: For each target entity object, obtain at least two entity object image information obtained by taking images of the target entity object from different shooting angles and directions through a three-dimensional modeling application; Automatically construct a three-dimensional model of the target entity object based on the at least two entity object image information through a three-dimensional modeling application to obtain a target virtual object corresponding to the target entity object.

3. The method according to claim 2, wherein The at least two entity object image information includes key frame images and key feature points corresponding to the target entity object obtained by continuously moving around the target entity object along different shooting angles and directions.

4. The method according to claim 1, wherein, Rendering and displaying the target virtual object in the virtual display space through a virtual reality engine includes: Render and display the target virtual object on a shelf model in the virtual display space through a virtual reality engine, where the shelf is a three-dimensional model pre-constructed for carrying the rendered target virtual object in the virtual display space; Configure the lighting effect and material effect of the target virtual object rendered and displayed on the shelf model in the virtual display space according to the characteristics and materials of the target entity object corresponding to the target virtual object.

5. The method according to claim 1, wherein Adjusting the target virtual object in the virtual display space according to the adjustment action corresponding to the first operation includes: When the first operation is a first interaction operation for reference display of the target virtual object, adjust the display of the target virtual object on the shelf model rendered and displayed in the virtual display space, where the reference display is to magnify, reduce, or rotate the display of the target virtual object; When the first operation is a second interaction operation for pose adjustment of the target virtual object, move the position and / or Adjust the pose of the target virtual object on the shelf model rendered and displayed in the virtual display space according to the second interaction operation so as to display the target virtual object from different angles and distances, where the second interaction operation is used to indicate the adjustment position and adjustment pose of the target virtual object.

6. The method according to claim 1, wherein Adjusting the target virtual object in the virtual display space according to the adjustment action corresponding to the first operation includes: When the first operation is a third interaction operation for grasping a target virtual object, receive the grasping position and posture of the target virtual object in the virtual display space through the third interaction operation; According to the grasping position and posture of the target virtual object in the virtual display space, adjust the position and posture of the target virtual object in the virtual display space, and virtualize the grasping action of the target virtual object in the virtual display space.

7. The method according to claim 1, wherein Adjust the target virtual object in the virtual display space according to the adjustment action corresponding to the first operation, including: When the first operation is a pose adjustment operation of a reference object, receive the position and posture information of the reference object, where the reference object is used to obtain image content of the rendered and displayed target virtual object; According to the position and posture information of the reference object, determine the target acquisition angle and target acquisition position of the reference object relative to the target virtual object when obtaining image content of the target virtual object in the virtual display space; Render and display the target virtual object on the shelf model in the virtual display space according to the target acquisition angle and target acquisition position.

8. A virtual object display device, the device includes: A determination module, configured to determine a target virtual object, where the target virtual object is an entity object model existing in a virtual environment constructed by performing three-dimensional model construction on a target entity object; A display module, configured to render and display the target virtual object in a virtual display space through a virtual reality engine, where the virtual display space is a virtual environment corresponding to a three-dimensional model space pre-constructed for displaying the target virtual object; An adjustment module, configured to respond to a first operation on the target virtual object in the virtual display space, and adjust the target virtual object in the virtual display space according to the adjustment action corresponding to the first operation; A migration module, configured to respond to a second operation on the target virtual object in the virtual display space, and display a target virtual object migration operation page corresponding to the target virtual object, where the target virtual object migration operation page is used to make the target virtual object no longer displayed in the virtual display space after migration.

9. An electronic device, the electronic device includes: One or more processors; A storage device, configured to store one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the virtual object display method according to any one of claims 1-7.

10. A storage medium containing computer-executable instructions, where the computer-executable instructions are used to execute the virtual object display method according to any one of claims 1-7 when executed by a computer processor.

Images