Method and device for displaying virtual object in three-dimensional scene, and storage medium

By adding a target model to a 3D scene and adding preset lighting to it, the problem of compositing virtual objects in a real scene is solved, a realistic virtual object display effect is achieved, and the fusion of virtual and real is optimized.

CN117351177BActive Publication Date: 2025-12-19REALSEE (BEIJING) TECHNOLOGY CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202311355369.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2023-10-18
Publication Date
2025-12-19
Estimated Expiration
2043-10-18

AI Technical Summary

Technical Problem

How to synthesize realistic virtual objects in real-world scenarios to achieve an immersive, realistic mixed reality effect that blends the virtual and the real.

Method used

Add a target model to the 3D scene and add preset lighting, including high dynamic range lighting or ambient lighting. Adjust the model's position using a mesh collision detection algorithm to optimize the display effect.

Benefits of technology

It achieves the effect of displaying realistic virtual objects in virtual reality 3D scenes, optimizes the display effect of target models in real 3D space, and realizes a realistic virtual-real fusion.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN117351177B_ABST
    Figure CN117351177B_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure disclose a method and device for displaying a virtual object in a three-dimensional scene and a storage medium, wherein the method comprises: in response to receiving a task of adding a mixed reality model, adding a target model to be added to a three-dimensional scene to obtain a target three-dimensional scene containing the target model; adding preset lighting to the target model in the target three-dimensional scene; and rendering and displaying the target three-dimensional scene. The technical scheme of the present disclosure realizes realistic virtual-real fusion effect by adding a virtual model in a real three-dimensional space for interaction and display, and optimizes the display effect of the virtual object in the real three-dimensional space model.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of mixed reality, and in particular, to a method and device for displaying a virtual object in a three-dimensional scene and a storage medium. BACKGROUND

[0002] Mixed reality (MR) technology is a further development of virtual reality technology. It presents virtual scene information in a real scene, and builds an interactive feedback information loop between the real world, the virtual world and the user to enhance the sense of reality of the user experience. How to synthesize a virtual object into a real scene / picture to complete realistic virtual-real fusion is an urgent problem to be solved in the field of immersive reality mixed reality. SUMMARY

[0003] One technical problem to be solved by embodiments of the present disclosure is to provide a method and device for displaying a virtual object in a three-dimensional scene and a storage medium.

[0004] According to an aspect of an embodiment of the present disclosure, a method for displaying a virtual object in a three-dimensional scene is provided, and the method is characterized in that the method comprises:

[0005] in response to receiving a task of adding a mixed reality model, adding a target model to be added to a three-dimensional scene to obtain a target three-dimensional scene containing the target model;

[0006] adding a preset light to the target model in the target three-dimensional scene;

[0007] rendering and displaying the target three-dimensional scene.

[0008] In some embodiments of the present disclosure, the adding of the preset light to the target model in the target three-dimensional scene comprises:

[0009] adding a preset high dynamic range light to the target model in the target three-dimensional scene;

[0010] or,

[0011] extracting an ambient light at a placement position of the target model in the three-dimensional scene;

[0012] adding the ambient light to the target model in the target three-dimensional scene.

[0013] In some embodiments of the present disclosure, the method further comprises:

[0014] in response to receiving an adding operation of adding a mixed reality model triggered by a user in a virtual reality client interface, determining that the task of adding a mixed reality model is received.

[0015] In some embodiments of the present disclosure, the adding the target model to be added into the three-dimensional scene comprises:

[0016] According to the adding operation, the target model to be added is determined;

[0017] The target model is placed in the three-dimensional scene.

[0018] In some embodiments of the present disclosure, the placing the target model in the three-dimensional scene comprises:

[0019] An adjustment operation triggered by the user in the virtual reality client interface is received;

[0020] According to the adjustment operation, the target model is placed.

[0021] In some embodiments of the present disclosure, the adjustment operation comprises:

[0022] An adjustment operation triggered in a property setting window displayed by the virtual reality client interface; or

[0023] An adjustment operation triggered in a panorama and / or three-dimensional model page displayed by the virtual reality client interface.

[0024] In some embodiments of the present disclosure, the method further comprises:

[0025] In response to receiving an adding task of a mixed reality model in the task manager, it is determined that the task of adding the mixed reality model is received.

[0026] In some embodiments of the present disclosure, the adding the target model to be added into the three-dimensional scene comprises:

[0027] According to the task information of the adding task, the target model to be added, the three-dimensional scene and the placement position are determined;

[0028] The target model is placed in the placement position of the three-dimensional scene;

[0029] The position of the target model is adjusted iteratively through a grid collision detection algorithm.

[0030] According to another aspect of the embodiments of the present disclosure, a virtual object display device in a three-dimensional scene is provided, and the device comprises:

[0031] An adding module is configured to add a target model to be added into a three-dimensional scene in response to receiving a task of adding a mixed reality model, to obtain a target three-dimensional scene containing the target model;

[0032] The illumination setting module is configured to add preset illumination to a target model in the target three-dimensional scene.

[0033] The rendering module is configured to render and display the target three-dimensional scene.

[0034] In some embodiments of the present disclosure, the illumination setting module comprises:

[0035] The first adding submodule is configured to add preset high dynamic range illumination to the target model in the target three-dimensional scene.

[0036] Alternatively,

[0037] The extraction submodule is configured to extract ambient illumination at a placement position of the target model in the three-dimensional scene.

[0038] The second adding submodule is configured to add the ambient illumination to the target model in the target three-dimensional scene.

[0039] In some embodiments of the present disclosure, the device further comprises:

[0040] The first receiving module is configured to determine that a task of adding a mixed reality model is received in response to receiving an adding operation of adding a mixed reality model triggered by a user in a virtual reality client interface.

[0041] In some embodiments of the present disclosure, the adding module comprises:

[0042] The first determining submodule is configured to determine the target model to be added according to the adding operation.

[0043] The first placement submodule is configured to place the target model in the three-dimensional scene.

[0044] In some embodiments of the present disclosure, the first placement submodule is specifically configured to receive an adjustment operation triggered by the user in the virtual reality client interface; and place the target model according to the adjustment operation.

[0045] In some embodiments of the present disclosure, the adjustment operation comprises:

[0046] an adjustment operation triggered in a property setting window displayed by the virtual reality client interface; or

[0047] an adjustment operation triggered in a panorama and / or three-dimensional model page displayed by the virtual reality client interface.

[0048] In some embodiments of the present disclosure, the device further comprises:

[0049] The second receiving module is configured to, in response to receiving an adding task of a mixed reality model in the task manager, determine that the adding task of the mixed reality model is received.

[0050] In some embodiments of the present disclosure, the adding module comprises:

[0051] The second determining submodule is configured to determine the target model to be added, the three-dimensional scene, and the placement position according to task information of the adding task.

[0052] The second placing submodule is configured to place the target model at the placement position of the three-dimensional scene.

[0053] The collision detection submodule is configured to iteratively adjust the position of the target model by using a mesh collision detection algorithm.

[0054] According to still another aspect of the embodiments of the present disclosure, an electronic device is provided, which comprises:

[0055] The memory is configured to store a computer program.

[0056] The processor is configured to execute the computer program stored in the memory, and when the computer program is executed, the three-dimensional scene virtual object display method described above is implemented.

[0057] According to still another aspect of the embodiments of the present disclosure, a computer readable storage medium is provided, which stores a computer program, and when the computer program is executed by a processor, the three-dimensional scene virtual object display method described above is implemented.

[0058] According to still another aspect of the embodiments of the present disclosure, a computer program product is provided, which comprises computer programs / instructions, and when the computer programs / instructions are executed by a processor, the three-dimensional scene virtual object display method described above is implemented.

[0059] Based on the three-dimensional scene virtual object display method, device, and storage medium provided in the above embodiments of the present disclosure, after receiving an adding task of a mixed reality model, a target model to be added is automatically added to a three-dimensional scene, preset light is added to the target model in the target three-dimensional scene, the target three-dimensional scene is rendered, and a real virtual object effect can be displayed in a virtual reality three-dimensional scene. The technical solution of the present disclosure can realize adding a target model in a collected real three-dimensional space for interaction and display, adding preset light to the target model to optimize the display effect of the target model in the real three-dimensional space model, and realizing a realistic virtual-real fusion effect.

[0060] The technical solutions of the present disclosure will be described in further detail below with reference to the drawings and embodiments. BRIEF DESCRIPTION OF DRAWINGS

[0061] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0062] The present disclosure can be more clearly understood and appreciated from the following detailed description, taken in conjunction with the following drawings of which:

[0063] Figure 1 Flow chart for one embodiment of the method for displaying virtual objects in a three-dimensional scene of the present disclosure;

[0064] Figure 2A Flow chart for one embodiment of the method for displaying mixed reality models in a three-dimensional scene of the present disclosure by interactive means;

[0065] Figure 2B Schematic diagram for adjusting the placement attributes of mixed reality models in a three-dimensional scene of the present disclosure Figure 1 ;

[0066] Figure 2C Schematic diagram for adjusting the placement attributes of mixed reality models in a three-dimensional scene of the present disclosure

[0067] Figure 3 Flow chart for one embodiment of the method for displaying mixed reality models in a three-dimensional scene of the present disclosure by algorithmic means;

[0068] Figure 4 Structural schematic diagram for one embodiment of the device for displaying virtual objects in a three-dimensional scene of the present disclosure;

[0069] Figure 5 Structural schematic diagram for another embodiment of the device for displaying virtual objects in a three-dimensional scene of the present disclosure;

[0070] Figure 6 Structural schematic diagram for another embodiment of the device for displaying virtual objects in a three-dimensional scene of the present disclosure;

[0071] Figure 7 Structural diagram of an electronic device provided by an illustrative embodiment of the present disclosure. DETAILED DESCRIPTION

[0072] Various exemplary embodiments of the present disclosure will now be described in detail below with reference to the accompanying drawings. Note that the relative arrangement, numerical expressions, and numerical values of the components and steps set forth in these embodiments are not limiting to the scope of the present disclosure unless otherwise specifically stated.

[0073] Meanwhile, it should be understood that the sizes of the various portions shown in the drawings are not drawn in accordance with actual proportions for the sake of convenience in description.

[0074] The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the disclosure or its application or uses.

[0075] Techniques, methods, and devices known to those of ordinary skill in the relevant art can not be discussed in detail herein. However, where appropriate, such techniques, methods, and devices can be considered part of the specification.

[0076] It is to be noted that like reference numerals and letters throughout the several views in the drawings represent similar objects, and thus, discussion of the same will not be repeated within each of the Figures.

[0077] Embodiments of the present disclosure can be applied to computer system / server and other electronic devices, which can operate in conjunction with many other general purpose or special purpose computing system environments or configurations. Examples of well-known computing systems, environments, and / or configurations that can be suitable for use with computer system / server and other electronic devices include, but are not limited to, personal computer systems, server computer systems, thin clients, thick clients, handheld or laptop devices, microprocessor-based systems, set-top boxes, programmable consumer electronics, network personal computers, minicomputer systems, mainframe computer systems, and distributed cloud computing environments that include any of the above systems or devices, and the like.

[0078] Computer system / server and other electronic devices can be described in the general context of computer system-executable instructions, such as program modules, being executed by a computer system. Generally, program modules can include routines, programs, objects, components, logic, data structures, and the like, that perform particular tasks or implement particular abstract data types. Computer system / server can operate in a distributed cloud computing environment where tasks are performed by remote processing devices that are linked through a communications network. In a distributed cloud computing environment, program modules can be located in both local and remote computer system storage media including memory storage devices.

[0079] SUMMARY

[0080] The technical solution provided by the embodiments of the present disclosure is applied to a scene of displaying an MR model in a VR space, and can be applied to a mobile terminal h5 (a web page of a mobile terminal), a portable android device (Pad) terminal, a personal computer (PC) terminal, and the like.

[0081] EXEMPLARY EMBODIMENTS

[0082] Figure 1A flowchart of one embodiment of a method for displaying a virtual object in a three-dimensional scene of the present disclosure; the method for displaying a virtual object in a three-dimensional scene can be applied on an electronic device (such as a computer system, a server), as shown in Figure 1 The method for displaying a virtual object in a three-dimensional scene can include the following steps:

[0083] In step 101, in response to receiving a task of adding a mixed reality model, a target model to be added is added to a three-dimensional scene, obtaining a target three-dimensional scene containing the target model.

[0084] The task of adding a mixed reality model refers to a task of adding an MR model in a virtual reality (VR) three-dimensional scene.

[0085] In some embodiments, the present disclosure provides two ways to trigger the task of adding a mixed reality model. One is to trigger the task of adding a mixed reality model through a client interface interaction method, that is, to trigger the task of adding a mixed reality model through an adding operation of a mixed reality model triggered by a user in a virtual reality client interface. The other is to trigger the task of adding a mixed reality model through an algorithm method, that is, to trigger the task of adding a mixed reality model when a task manager receives an adding task of a mixed reality model detected by a task scheduling system.

[0086] The two ways of triggering the task of adding a mixed reality model in the above examples can be applied in different scenarios of adding an MR model. The client interface interaction method can be applied in a scenario of adding an MR model in a single VR three-dimensional scene or a small number of VR three-dimensional scenes. The algorithm method can be applied in a scenario of adding an MR model in a large number of VR three-dimensional scenes, for example, adding a sofa MR model in thousands of indoor spaces. In this case, a task can be input in the task scheduling system. The task information can indicate in which VR three-dimensional scenes to add an MR model, the identification information of the target model to be added, and the placement position.

[0087] In some embodiments, after receiving the task of adding a mixed reality model, the target model to be added can be determined according to the task information of the task, and a target three-dimensional scene containing the target model is obtained.

[0088] The target model is an MR model, which can be a static MR model or a dynamic MR model. The storage format of the MR model can be an obj model or a glb model.

[0089] The implementation of adding a target model through a client interface interaction method can refer to the embodiment shown in Figure 2A The implementation of automatically adding a target model through an algorithm method can refer to the embodiment shown in Figure 3In the illustrated embodiment, no further details are given here.

[0090] In step 102, a preset light is added to the target model in the target three-dimensional scene.

[0091] In some embodiments, the preset light can be a fixed High Dynamic Range (HDR) light, which can be directly displayed in the target three-dimensional space to achieve simplicity.

[0092] In some embodiments, the preset light can be the ambient light at the placement position of the target model in the three-dimensional scene. The ambient light at the placement position of the target model in the three-dimensional scene can be extracted by an algorithm, and then the ambient light is added to the target model in the target three-dimensional scene.

[0093] After determining the preset light, the preset light can be added to the target model in the target three-dimensional scene in a manner known in the art.

[0094] In step 103, the target three-dimensional scene is rendered and displayed.

[0095] The VR three-dimensional scene is rendered and displayed, which can more realistically display the effect.

[0096] The above steps 101-103, after receiving the task of adding a mixed reality model, automatically add the target model to be added to the three-dimensional scene, then add a preset light to the target model in the target three-dimensional scene, render the target three-dimensional scene, and display the real virtual object effect in the virtual reality three-dimensional scene. The technical solution of the present disclosure can realize the addition of a target model in a collected real three-dimensional space for interaction and display, optimize the display effect of the target model in the real three-dimensional space model by adding a preset light to the target model, and achieve a realistic virtual-real fusion effect.

[0097] To better illustrate the scheme of the present disclosure for displaying virtual objects in a three-dimensional scene, another embodiment is described below.

[0098] Figure 2A A flowchart for implementing a mixed reality model display in a three-dimensional scene through an interactive manner in an embodiment of the present disclosure, Figure 2B A schematic diagram for adjusting the placement properties of a mixed reality model in a three-dimensional scene in the present disclosure Figure 1 , Figure 2C A second schematic diagram for adjusting the placement properties of a mixed reality model in a three-dimensional scene in the present disclosure; this embodiment is exemplarily described by taking how to add a mixed reality model in a three-dimensional scene through an interactive manner as an example, as Figure 2A shown, comprising the following steps:

[0099] In step 201, in response to receiving the adding operation of adding a mixed reality model triggered by the user in the virtual reality client interface, it is determined that the task of adding a mixed reality model is received.

[0100] In some embodiments, in order to implement the technical solutions of the present disclosure, a VR editor function module for adding an MR item can be set in advance in the VR space rendering software, so that the user can trigger the adding operation of adding a mixed reality model through an interface button or operation command on the virtual reality client interface.

[0101] In some embodiments, the adding operation can indicate the target model to be added, for example, can include the identification information of the target model.

[0102] In step 202, the target model to be added is determined according to the adding operation.

[0103] Among them, a large number of MR models can be obtained in advance in the network server, for example, the MR models can be downloaded in some public website servers, and then the downloaded MR models can be uploaded to the local server. When it is needed to add an MR model, the effect diagram of a group of MR models can be displayed through the virtual reality client interface, and the user can select to use through the adding operation.

[0104] In step 203, the target model is placed in the three-dimensional scene.

[0105] In some embodiments, the MR model can be adsorbed and the position can be selected through a mouse; or the placement position information of the MR model can be set through the client operation interface when the adding operation is triggered, for example, the placement position is set as the floor.

[0106] In step 204, the adjustment operation triggered by the user in the virtual reality client interface is received.

[0107] In some embodiments, after the target model is placed, the adjustment operation can be triggered in the virtual reality client interface to adjust the size, position and angle of the placed MR model.

[0108] Among them, the adjustment operation can be an adjustment operation triggered in the attribute setting window displayed in the virtual reality client interface; or an adjustment operation triggered in the panorama and / or three-dimensional model page displayed in the virtual reality client interface, see Figure 2B and Figure 2C .

[0109] In some embodiments, the attribute setting window can be an independent window triggered by an attribute setting command, or can be a region window displayed on the panorama interface, see Figure 2B andFigure 2C The properties settings window on the right.

[0110] In panoramic mode, you can directly drag the MR model with the mouse in the panoramic image to adjust its position, size, and angle; you can also adjust the position, size, and angle of the MR model in the corresponding property settings window.

[0111] In the 3D model mode, you can directly view the effect of the MR model in 3D space on the 3D model page, and then trigger adjustment operations on the 3D model page.

[0112] In step 205, the target model is placed according to the adjustment operation.

[0113] In some embodiments, after placing the model, a target three-dimensional space containing the MR model can be stored, and the attribute information of the MR model in the target three-dimensional space, including position, size, and angle, can be recorded.

[0114] By switching between the 3D model mode and the panoramic mode, and making adjustments from multiple angles, the optimal placement effect of the MR model in 3D space can be achieved.

[0115] Figure 3 This is a flowchart illustrating an implementation of the algorithmic display of a mixed reality model in a 3D scene according to this disclosure. This embodiment uses the example of adding a mixed reality model to a 3D scene using an algorithm as an example for illustrative purposes. Figure 3 As shown, it includes the following steps:

[0116] In step 301, in response to receiving a mixed reality model addition task in the task manager, it is determined that a mixed reality model addition task has been received.

[0117] In some embodiments, for scenarios where MR models need to be added to a large number of VR scenes, a task can be generated in advance in the task scheduling system for each VR scene. The task includes the indication information of the MR model to be added, the VR scene to be added, and the addition location, which is used to instruct the task scheduling system to trigger the task at a specified time point and add the task to the task manager for execution.

[0118] In step 302, the target model to be added, the 3D scene, and the placement position are determined based on the task information of the added task.

[0119] In some embodiments, task information may indicate the VR 3D scene where an MR model needs to be added, the MR model to be added, and its placement.

[0120] The user can select a position as the placement position from preset positions such as a floor, a sofa, a bed, and the like, and the operation is simple and fast; the user can also customize a position as the placement position in the three-dimensional scene, so that the placement position is more in line with the user's preference habit.

[0121] In some embodiments, after receiving the task of adding the mixed reality model, the target model to be added can be determined according to the task information of the task, and a target three-dimensional scene containing the target model is obtained.

[0122] In step 303, the target model is placed at the placement position of the three-dimensional scene.

[0123] In some embodiments, if the placement position is a sofa, the MR model can be automatically placed on the sofa, such as in the middle position of the sofa.

[0124] In order to realize the placement of the MR model, the placement position in the three-dimensional scene needs to be identified by a model recognition algorithm first, for example, if the placement position is a sofa, the sofa needs to be identified in the three-dimensional scene first, and then the placement of the MR model is performed.

[0125] In step 304, the position of the target model is iteratively adjusted by a mesh collision detection algorithm.

[0126] In some embodiments, after the MR model is placed at the placement position indicated by the task, the mesh collision detection algorithm can be further used to detect whether collision or penetration occurs between the MR model and the placement position, and if collision or penetration occurs, the position of the MR model can be adjusted, and then the mesh collision detection algorithm is used to detect whether collision occurs, so as to iteratively adjust the position of the target model to a suitable position.

[0127] Through steps 301-304, the batch addition of the MR model can be realized by an algorithm, and the position of the MR model is iteratively adjusted by the mesh collision detection algorithm to avoid collision or penetration, so that the placement effect of the MR model in the three-dimensional space can be optimized.

[0128] Corresponding to the foregoing embodiments of the method for displaying a virtual object in a three-dimensional scene, the disclosure also provides corresponding embodiments of a device for displaying a virtual object in a three-dimensional scene.

[0129] Figure 4 A structural schematic diagram of an embodiment of the device for displaying a virtual object in a three-dimensional scene of the disclosure is shown in FIG. 1. Figure 4 As shown in FIG. 1, the device includes:

[0130] The adding module 41 is configured to add a target model to be added into the three-dimensional scene to obtain a target three-dimensional scene containing the target model, in response to receiving a task of adding a mixed reality model;

[0131] The light setting module 42 is configured to add preset light for the target model in the target three-dimensional scene;

[0132] The rendering module 43 is configured to render and display the target three-dimensional scene.

[0133] Figure 5 A structural schematic diagram of still another embodiment of the virtual object display device in the three-dimensional scene of the present disclosure is shown in Figure 5 As shown in Figure 4 Based on the embodiment shown in, in some embodiments, the light setting module 42 comprises:

[0134] The first adding sub-module 421 is configured to add preset high dynamic range light for the target model in the target three-dimensional scene;

[0135] Alternatively,

[0136] The extraction sub-module 422 is configured to extract ambient light at a placement position of the target model in the three-dimensional scene;

[0137] The second adding sub-module 423 is configured to add the ambient light for the target model in the target three-dimensional scene.

[0138] In some embodiments, the device further comprises:

[0139] The first receiving module 44 is configured to determine that the task of adding the mixed reality model is received, in response to receiving an adding operation of adding a mixed reality model triggered by a user in a virtual reality client interface.

[0140] In some embodiments, the adding module 41 comprises:

[0141] The first determining sub-module 411 is configured to determine the target model to be added according to the adding operation;

[0142] The first placement sub-module 412 is configured to place the target model in the three-dimensional scene.

[0143] In some embodiments, the first placement sub-module 412 is specifically configured to receive an adjustment operation triggered by the user in the virtual reality client interface; and place the target model according to the adjustment operation.

[0144] In some embodiments, the adjustment operation comprises:

[0145] an adjustment operation triggered in a property setting window displayed by the virtual reality client interface; or

[0146] an adjustment operation triggered in a panorama and / or three-dimensional model page displayed by the virtual reality client interface.

[0147] Figure 6 A structural schematic diagram of still another embodiment of the virtual object display device in a three-dimensional scene of the present disclosure is shown in Figure 6 As shown in Figure 4 and / or Figure 5 Based on the embodiments shown in the foregoing, in some embodiments, the device further comprises:

[0148] The second receiving module 45 is configured to determine that the task of adding the mixed reality model is received in response to receiving the task of adding the mixed reality model in the task manager.

[0149] In some embodiments, the adding module 41 comprises:

[0150] The second determining sub-module 413 is configured to determine the target model to be added, the three-dimensional scene, and the placement position according to the task information of the adding task.

[0151] The second placing sub-module 414 is configured to place the target model at the placement position of the three-dimensional scene.

[0152] The collision detection sub-module 415 is configured to iteratively adjust the position of the target model by using a grid collision detection algorithm.

[0153] The functions and roles of the units in the device described above are implemented in the implementation process of the corresponding steps in the method described above, which will not be repeated here.

[0154] For the device embodiment, since it basically corresponds to the method embodiment, the related parts can be referred to the part of the method embodiment. The device embodiments described above are only schematic, and the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, i.e., they can be located in one place, or distributed on multiple network units. According to the actual needs, some or all of the modules can be selected to achieve the purpose of the present disclosure. Those skilled in the art can understand and implement without creative labor.

[0155] Next, the electronic device according to the embodiment of the present disclosure will be described with reference to Figure 7 which can integrate the device implementing the method of the present disclosure. Figure 7 A structural diagram of the electronic device provided by an illustrative embodiment of the present disclosure is shown inFigure 7 As shown, the electronic device includes one or more processors 71, a memory 72 of one or more computer-readable storage media, and a computer program stored on the memory and executable on the processor. When the program of the memory 72 is executed, the above-mentioned virtual object display method in a three-dimensional scene can be implemented.

[0156] Specifically, in actual application, the electronic device can further include input devices 73, output devices 74, and the like. These components are interconnected through a bus system and / or other forms of connection mechanism (not shown). Those skilled in the art can understand that, Figure 7 The structure of the electronic device shown in the figure does not constitute a limitation on the electronic device, and can include more or fewer components than shown, or certain components, or different arrangement of components. Among them:

[0157] The processor 71 can be a central processing unit (CPU) or other forms of processing unit with data processing and / or instruction execution capabilities. By running or executing software programs and / or modules stored in the memory 72 and calling data stored in the memory 72, the processor 71 performs various functions and processes data, thereby monitoring the entire electronic device.

[0158] The memory 72 can include one or more computer program products, which can include various forms of computer readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may, for example, include random access memory (RAM) and / or cache memory, etc. Non-volatile memory may, for example, include read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions can be stored on the computer readable storage medium, and the processor 71 can run the program instructions to implement the above-mentioned virtual object display method in a three-dimensional scene and / or other desired functions of various embodiments of the present disclosure. Various contents such as input signals, signal components, noise components, etc. can also be stored in the computer readable storage medium.

[0159] The input device 73 can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.

[0160] The output device 74 can output various information to the outside, including the determined distance information, direction information, etc. The output device 74 can include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, and the like.

[0161] The electronic device can further include a power supply to supply power to each of the components, and can be logically connected with the processor 71 through a power management system, so that the power management system performs functions of managing charging, discharging, power consumption management, etc. The power supply can further include one or more of a direct current or alternating current power source, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, etc.

[0162] Of course, in order to simplify, Figure 7 Only some of the components in the electronic device 7 related to the present disclosure are shown in the middle, and components such as buses, input / output interfaces, etc. are omitted. In addition, the electronic device can further include any other appropriate components according to specific application cases.

[0163] In addition to the above method and device, an embodiment of the present disclosure can also be a computer program product, which includes computer program instructions that, when executed by a processor, cause the processor to perform the steps of the virtual object display method in a three-dimensional scene according to various embodiments of the present disclosure described in the above "Exemplary Method" section of the present specification.

[0164] The computer program product can be written in any combination of one or more programming languages, including object-oriented programming languages, such as Java, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. The program code can be executed entirely on a user computing device, partially on a user device, as an independent software package, partially on a user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0165] In addition, an embodiment of the present disclosure can also be a computer readable storage medium having stored thereon computer program instructions, which, when executed by a processor, cause the processor to perform the steps of the virtual object display method in a three-dimensional scene according to various embodiments of the present disclosure described in the above "Exemplary Method" section of the present specification.

[0166] The computer readable storage medium can be any combination of one or more computer readable medium(s). The computer readable medium can be a computer readable signal medium or a computer readable storage medium. A computer readable storage medium can be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include an electrical connection having one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0167] The above describes the basic principles of the present disclosure in combination with specific embodiments, but it should be noted that the advantages, benefits, effects and the like mentioned in the present disclosure are only examples and are not limiting, and these advantages, benefits, effects and the like cannot be considered as necessary for each embodiment of the present disclosure. In addition, the above specific details of the disclosure are only for the purpose of example and for the purpose of understanding, and are not limiting, and the above details do not limit the present disclosure to be necessarily implemented with the above specific details.

[0168] Each embodiment in the specification is described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same or similar parts between each embodiment can be mutually referred to. For system embodiments, since they basically correspond to method embodiments, the description is relatively simple, and the relevant parts can be referred to the part of the method embodiment.

[0169] Those of ordinary skill in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction-related hardware, and the foregoing program can be stored in a computer readable storage medium. When the program is executed, the steps of the method embodiments are executed; and the foregoing storage medium includes ROM, RAM, magnetic disk or optical disk and various media that can store program codes.

[0170] The methods and apparatuses of the present disclosure can be implemented in many ways. For example, the methods and apparatuses of the present disclosure can be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of the steps for the method is only for illustration, and the steps of the method of the present disclosure are not limited to the above specifically described order, unless otherwise specifically described. In addition, in some embodiments, the present disclosure can also be implemented as programs recorded in recording media, which include machine readable instructions for implementing the method according to the present disclosure. Thus, the present disclosure also covers the recording media storing the programs for executing the method according to the present disclosure.

[0171] The description of the present disclosure is given for illustrative and descriptive purposes, and is not exhaustive or limited to the forms disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art. The embodiments are chosen and described in order to best explain the principles of the present disclosure and its practical application, and to thereby enable others skilled in the art to best utilize the present disclosure for various embodiments with various modifications as are suited to the particular use contemplated.

Claims

1. A method for displaying virtual objects in a three-dimensional scene, characterized in that, The method comprises: in response to receiving a task of adding a mixed reality model, adding a target model to be added into a three-dimensional scene to obtain a target three-dimensional scene containing the target model; adding preset lighting for the target model in the target three-dimensional scene; rendering and displaying the target three-dimensional scene; The method further comprises: in response to receiving a task of adding a mixed reality model in a task manager, determining that the task of adding the mixed reality model is received; the adding of the target model to be added into the three-dimensional scene comprises: determining the target model to be added, the three-dimensional scene, and a placement position according to task information of the adding task, the task information being capable of indicating identification information of the target model to be added and the placement position; placing the target model at the placement position of the three-dimensional scene; adjusting the position of the target model through a grid collision detection algorithm.

2. The method of claim 1, wherein, The adding of preset lighting for the target model in the target three-dimensional scene comprises: adding preset high dynamic range lighting for the target model in the target three-dimensional scene; or extracting ambient lighting at the placement position of the target model in the three-dimensional scene; adding the ambient lighting for the target model in the target three-dimensional scene. The method further comprises:

3. The method of claim 1, wherein, in response to receiving an adding operation of adding a mixed reality model triggered by a user in a virtual reality client interface, determining that the task of adding the mixed reality model is received. The adding of the target model to be added into the three-dimensional scene comprises:

4. The method of claim 3, wherein, determining the target model to be added according to the adding operation; placing the target model in the three-dimensional scene. The placing of the target model in the three-dimensional scene comprises:

5. The method of claim 4, wherein, receiving an adjusting operation triggered by the user in the virtual reality client interface; placing the target model according to the adjusting operation. The adjusting operation comprises:

6. The method of claim 5, wherein, an adjusting operation triggered in a property setting window displayed by the virtual reality client interface; or an adjusting operation triggered in a panorama and / or three-dimensional model page displayed by the virtual reality client interface. The device comprises:

7. A virtual object presentation device in a three-dimensional scene, characterized by an adding module, configured to add a target model to be added into a three-dimensional scene in response to receiving a task of adding a mixed reality model, to obtain a target three-dimensional scene containing the target model; a lighting setting module, configured to add preset lighting for the target model in the target three-dimensional scene; a rendering module, configured to render and display the target three-dimensional scene; further comprising: a second receiving module, configured to determine that the task of adding the mixed reality model is received in response to receiving a task of adding a mixed reality model in a task manager; the adding module comprises: a second determining submodule, configured to determine the target model to be added, the three-dimensional scene, and a placement position according to task information of the adding task, the task information being capable of indicating identification information of the target model to be added and the placement position; a second placing submodule, configured to place the target model at the placement position of the three-dimensional scene. ​ A collision detection submodule is configured to iteratively adjust the position of the target model by using a mesh collision detection algorithm.

8. A computer readable storage medium having stored thereon computer instructions, wherein, The computer instructions, when executed by a processor, implement the method of any one of claims 1-6.

Citation Information

Patent Citations

  • Image processing method and device

    CN115984515A