A method and device for displaying three-dimensional entities on a two-dimensional interactive interface

Abstract

The present invention discloses a method and device for displaying a three-dimensional entity on a two-dimensional interactive interface, and relates to the field of image processing technology. A specific implementation of the method includes: being able to construct a virtual portal on a two-dimensional interactive interface in a spatial scene to obtain the three-dimensional entity of the object to be displayed; making the front-end perspective of the two-dimensional interactive interface display the three-dimensional entity from the virtual space through the virtual portal to the spatial scene; and the back-end perspective of the two-dimensional interactive interface not display the three-dimensional entity. The embodiment of the present invention overcomes the problem that three-dimensional objects cannot break through the virtual portal in existing methods, and achieves the visual effect of the three-dimensional object image breaking through the virtual portal and penetrating into the spatial scene, thereby improving the user experience.

Description

Technical Field

[0001] The present invention relates to the field of image processing technology, and in particular to a method and device for displaying a three-dimensional entity on a two-dimensional interactive interface. Background Art

[0002] With the development of computer technology, virtual reality and augmented reality technologies are being used more and more. Augmented reality technology can simultaneously display the real space and a virtual portal superimposed on the real space, and enter a specific application virtual space through the virtual portal.

[0003] A virtual portal is a two-dimensional view on a two-dimensional interactive interface. In different application scenarios, a virtual portal can be used to display two-dimensional object images or three-dimensional object images. However, in existing methods of displaying images in a virtual portal, three-dimensional object images can only be displayed in the two-dimensional view of the virtual portal and cannot break through the two-dimensional space of the virtual portal. Therefore, there is currently a lack of methods to break through the two-dimensional view of the three-dimensional object image and achieve the visual effect of displaying part of the three-dimensional object in the virtual portal and part of it in the real space, which affects the user's application experience. Summary of the Invention

[0004] In light of this, embodiments of the present invention provide a method and apparatus for displaying three-dimensional entities on a two-dimensional interactive interface. These methods construct a virtual portal on the two-dimensional interactive interface within a spatial scene, capturing the three-dimensional entity of the object to be displayed. The front-end perspective of the two-dimensional interactive interface displays the three-dimensional entity as it passes through the virtual portal and into the spatial scene; however, the back-end perspective of the two-dimensional interactive interface does not display the three-dimensional entity. This embodiment overcomes the problem of existing methods preventing three-dimensional objects from passing through the virtual portal, achieving the visual effect of a three-dimensional object image passing through the virtual portal and into the spatial scene, thereby improving the user experience.

[0005] To achieve the above-mentioned purpose, according to one aspect of an embodiment of the present invention, a method for displaying a three-dimensional entity on a two-dimensional interactive interface is provided, characterized in that it includes: constructing a virtual portal on the two-dimensional interactive interface in a spatial scene; wherein the virtual portal is the entrance between the spatial scene and the virtual space; obtaining the three-dimensional entity of the object to be displayed; the front-end perspective of the two-dimensional interactive interface displays the three-dimensional entity, and the three-dimensional entity passes through the virtual space through the virtual portal to the spatial scene; the back-end perspective of the two-dimensional interactive interface does not display the three-dimensional entity.

[0006] Optionally, after obtaining the three-dimensional entity of the object to be displayed, it further includes: cutting the three-dimensional entity into a foreground three-dimensional entity and a background three-dimensional entity with the virtual portal as a section, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal, and the background three-dimensional entity is displayed in the virtual space inside the virtual portal; splicing the foreground three-dimensional entity and the background three-dimensional entity so that the displayed three-dimensional entity passes through the virtual portal from the virtual space to the spatial scene.

[0007] Optionally, the display of the three-dimensional entity from the virtual space through the virtual portal to the spatial scene further includes: the display range of the area in the virtual space displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal; and / or, the display range of the area in the spatial scene displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal.

[0008] Optionally, after constructing the virtual portal on the two-dimensional interactive interface in the spatial scene, it further includes: constructing a rendering view of the virtual portal, and setting the rendering view on the upper layer of the two-dimensional interactive interface; using the rendering view to load the foreground three-dimensional entity and the background three-dimensional entity, and rendering the background three-dimensional entity and the foreground three-dimensional entity in accordance with the rendering layer order; wherein, the foreground three-dimensional entity is set at the top layer of the rendering layer.

[0009] Optionally, the method of displaying the foreground three-dimensional entity in the spatial scene outside the virtual portal and the background three-dimensional entity in the virtual space inside the virtual portal includes: obtaining the position offset of the background three-dimensional entity; calculating the distance value between the background three-dimensional entity and the cross-section of the two-dimensional interactive interface based on the position offset, and using the distance value as the display depth; determining the display position based on the display depth, and displaying the background three-dimensional entity and the foreground three-dimensional entity based on the display position, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal and the background three-dimensional entity is displayed in the virtual space inside the virtual portal.

[0010] Optionally, after taking the distance value as the display depth, it further includes: adjusting the display depth to generate a target display depth according to the display position of the foreground three-dimensional entity; wherein the display position is the position of the foreground three-dimensional entity displayed in the spatial scene outside the virtual portal; and adjusting the original display positions of the background three-dimensional entity and the foreground three-dimensional entity according to the target display depth.

[0011] Optionally, the method for displaying a three-dimensional entity on a two-dimensional interactive interface further includes: configuring corresponding attribute data for multiple components on the server side, wherein the components include a two-dimensional interactive interface, a rendering view, a foreground three-dimensional entity, a background three-dimensional entity, a three-dimensional entity attribute component, and a custom component; when constructing any one of the multiple components, obtaining the attribute data corresponding to the component from the server side.

[0012] Optionally, the corresponding attribute data is configured for multiple components on the server side, including: when configuring attribute data for the foreground three-dimensional entity and the background three-dimensional entity, the reflective attribute in the attribute data of the foreground three-dimensional entity and the background three-dimensional entity is configured to be disabled, so that the display tones of the foreground three-dimensional entity and the background three-dimensional entity are consistent.

[0013] To achieve the above-mentioned purpose, according to a second aspect of an embodiment of the present invention, there is provided an apparatus for displaying a three-dimensional entity on a two-dimensional interactive interface, comprising: a component construction module, an entity acquisition module, and a display module; wherein,

[0014] The construction component module is used to construct a virtual portal on a two-dimensional interactive interface in the spatial scene; wherein the virtual portal is the entrance between the spatial scene and the virtual space;

[0015] The entity acquisition module is used to acquire the three-dimensional entity of the object to be displayed;

[0016] The display module is used to display the three-dimensional entity from the front-end perspective of the two-dimensional interactive interface, and the three-dimensional entity passes through the virtual portal from the virtual space to the spatial scene; the three-dimensional entity is not displayed from the back-end perspective of the two-dimensional interactive interface.

[0017] Optionally, the device for displaying a three-dimensional entity on a two-dimensional interactive interface, after obtaining the three-dimensional entity of the object to be displayed, further includes: cutting the three-dimensional entity into a foreground three-dimensional entity and a background three-dimensional entity with a virtual portal as a section, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal, and the background three-dimensional entity is displayed in the virtual space inside the virtual portal; splicing the foreground three-dimensional entity and the background three-dimensional entity so that the displayed three-dimensional entity passes through the virtual portal from the virtual space to the spatial scene.

[0018] Optionally, the device for displaying a three-dimensional entity on a two-dimensional interactive interface is used to display the three-dimensional entity from the virtual space through the virtual portal to the spatial scene, further including: the display range of the area in the virtual space displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal; and / or, the display range of the area in the spatial scene displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal.

[0019] Optionally, the device for displaying three-dimensional entities on a two-dimensional interactive interface is used to construct a virtual portal on the two-dimensional interactive interface in a spatial scene, and further includes: constructing a rendering view of the virtual portal, and setting the rendering view on the upper layer of the two-dimensional interactive interface; using the rendering view to load the foreground three-dimensional entity and the background three-dimensional entity, and rendering the background three-dimensional entity and the foreground three-dimensional entity in accordance with the rendering layer order; wherein, the foreground three-dimensional entity is set at the top layer of the rendering layer.

[0020] Optionally, a device for displaying a three-dimensional entity on a two-dimensional interactive interface is used to display the foreground three-dimensional entity in the spatial scene outside the virtual portal and the background three-dimensional entity in the virtual space inside the virtual portal, including: obtaining a position offset of the background three-dimensional entity; calculating a distance value between the background three-dimensional entity and a cross-section of the two-dimensional interactive interface based on the position offset, and using the distance value as the display depth; determining a display position based on the display depth, and displaying the background three-dimensional entity and the foreground three-dimensional entity based on the display position, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal and the background three-dimensional entity is displayed in the virtual space inside the virtual portal.

[0021] Optionally, the device for displaying a three-dimensional entity on a two-dimensional interactive interface is used to, after using the distance value as the display depth, further include: adjusting the display depth to generate a target display depth according to the display position of the foreground three-dimensional entity; wherein the display position is the position of the foreground three-dimensional entity displayed in the spatial scene outside the virtual portal; and adjusting the original display positions of the background three-dimensional entity and the foreground three-dimensional entity according to the target display depth.

[0022] Optionally, the device for displaying a three-dimensional entity on a two-dimensional interactive interface is further used to configure corresponding attribute data for multiple components on the server side, wherein the components include a two-dimensional interactive interface, a rendering view, a foreground three-dimensional entity, a background three-dimensional entity, a three-dimensional entity attribute component, and a custom component; when constructing any one of the multiple components, the attribute data corresponding to the component is obtained from the server side.

[0023] Optionally, a device for displaying three-dimensional entities on a two-dimensional interactive interface is used to configure corresponding attribute data for multiple components on the server side, including: when configuring attribute data for foreground three-dimensional entities and background three-dimensional entities, configuring the reflective attributes in the attribute data of the foreground three-dimensional entities and the background three-dimensional entities to be disabled so that the display tones of the foreground three-dimensional entities and the background three-dimensional entities are consistent.

[0024] To achieve the above-mentioned purpose, according to the third aspect of an embodiment of the present invention, an electronic device for displaying a three-dimensional entity on a two-dimensional interactive interface is provided, characterized in that it includes: one or more processors; a storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, the one or more processors implement any of the methods described above for displaying a three-dimensional entity on a two-dimensional interactive interface.

[0025] To achieve the above-mentioned purpose, according to the fourth aspect of an embodiment of the present invention, a computer-readable medium is provided, on which a computer program is stored, characterized in that when the program is executed by a processor, it implements any of the methods described above for displaying a three-dimensional entity on a two-dimensional interactive interface.

[0026] To achieve the above-mentioned purpose, according to the fifth aspect of an embodiment of the present invention, a computer program product is provided, comprising a computer program, characterized in that when the computer program is executed by a processor, it implements any of the above-mentioned methods for displaying a three-dimensional entity on a two-dimensional interactive interface.

[0027] One embodiment of the aforementioned invention has the following advantages or beneficial effects: it can construct a virtual portal on a two-dimensional interactive interface within a spatial scene, obtaining a three-dimensional entity of the object to be displayed; the front-end perspective of the two-dimensional interactive interface displays the three-dimensional entity from the virtual space through the virtual portal into the spatial scene; while the back-end perspective of the two-dimensional interactive interface does not display the three-dimensional entity. This embodiment of the present invention overcomes the problem of three-dimensional objects being unable to penetrate the virtual portal in existing methods, achieving the visual effect of a three-dimensional object image penetrating the virtual portal into the spatial scene, thereby improving the user experience.

[0028] The further effects of the above-mentioned non-conventional optional manner will be described below in conjunction with specific embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The accompanying drawings are provided for a better understanding of the present invention and are not intended to limit the present invention.

[0030] Figure 1 This is a flow chart of a method for displaying a three-dimensional entity on a two-dimensional interactive interface provided by one embodiment of the present invention;

[0031] FIG2A is an example diagram of displaying a three-dimensional entity in a virtual portal from a front-end perspective corresponding to a two-dimensional interactive interface according to an embodiment of the present invention;

[0032] FIG2B is a schematic diagram of displaying a three-dimensional entity on a two-dimensional interactive interface according to an embodiment of the present invention;

[0033] Figure 3 This is a schematic diagram of the structure of a virtual portal provided by one embodiment of the present invention;

[0034] Figure 4 This is a schematic structural diagram of a device for displaying a three-dimensional entity on a two-dimensional interactive interface, provided by one embodiment of the present invention;

[0035] FIG5 is a diagram of an exemplary system architecture in which embodiments of the present invention may be applied;

[0036] Figure 6 It is a schematic diagram of the structure of a computer system of a terminal device or a server suitable for implementing an embodiment of the present invention. DETAILED DESCRIPTION

[0037] The following description of exemplary embodiments of the present invention is made in conjunction with the accompanying drawings, in which various details of the embodiments of the present invention are included to facilitate understanding. These details should be considered as merely exemplary. Therefore, it should be appreciated by those skilled in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present invention. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0038] It should be noted that in the technical solution of the present invention, the collection, use, storage, sharing and transfer of user personal information involved are in compliance with the provisions of relevant laws and regulations, and it is necessary to inform the user and obtain the user's consent or authorization. When applicable, the user's personal information is de-identified and / or anonymized and / or encrypted.

[0039] like Figure 1 As shown, an embodiment of the present invention provides a method for displaying a three-dimensional entity on a two-dimensional interactive interface. The method may include the following steps:

[0040] Step S101: constructing a virtual portal on a two-dimensional interactive interface in a spatial scene; wherein the virtual portal is an entrance between the spatial scene and the virtual space.

[0041] Specifically, in virtual reality and augmented reality application scenarios, different spatial scenes typically exist, which can be real or virtual. A virtual portal is constructed on a two-dimensional interactive interface within the spatial scene, making the virtual portal the entrance between the spatial scene and the virtual space. For example, a user in an office can use an augmented reality device to see all objects within the office (i.e., the real spatial scene), or a virtual office scene, while also seeing multiple virtual portals constructed on the two-dimensional interactive interface displayed within the spatial scene. For example, a virtual portal displays an application icon or an object description to prompt the user to access the virtual space corresponding to the virtual portal. For example, if virtual portal A displays an image of item A, then virtual portal A corresponds to the virtual space with the details of item A. Another example is using virtual portal B to directly display the virtual space of a furniture display area or a three-dimensional venue.

[0042] Furthermore, the virtual portal is a two-dimensional view. In existing methods, images displayed in the virtual portal can be three-dimensional images. However, three-dimensional images cannot break through the limitations of the two-dimensional view of the virtual portal when displayed. In embodiments of the present invention, the method of steps S101 to S103 overcomes the problem of three-dimensional entities being unable to break through the limitations of the two-dimensional view of the virtual portal when displayed.

[0043] Below through Figure 2A Schematic diagram of Figure 2A FIG. 1 shows a schematic diagram of a virtual portal and a three-dimensional entity display corresponding to a front-end perspective of a two-dimensional interactive interface according to an embodiment of the present invention; FIG. Figure 2A As shown in the figure, the black background area of the "Leisure Living Room" represents a virtual portal built on a two-dimensional interactive interface. The space of the "Leisure Living Room" contains three-dimensional entities such as sofas, tables, chairs, and carpets. Among them, part of the three-dimensional entity of the carpet (as well as the round coffee table and chairs) is displayed in the virtual space, and part is displayed in the spatial scene (such as the Figure 2A The real space scene shown includes a rectangular coffee table, green plants, paper, etc.), thereby achieving the visual effect of three-dimensional entities such as carpets (as well as round coffee tables and chairs) penetrating from the virtual space of the virtual portal through the virtual portal into the space scene, thereby achieving a "broken window" effect of three-dimensional entities penetrating from the virtual space of the virtual portal to the space scene (real space scene), which greatly improves the visual experience.

[0044] Specifically, embodiments of the present invention construct a virtual portal within a two-dimensional interactive interface within a spatial scene, where the virtual portal can be a two-dimensional view (2D view). Furthermore, a three-dimensional entity is constructed for an object to be displayed within the virtual portal. The object to be displayed can be a single object or a collection of multiple objects, and is a three-dimensional object. Embodiments of the present invention fuse two three-dimensional entities (a foreground three-dimensional entity, frontentity, and a background three-dimensional entity, rootentity) with the two-dimensional portal view to achieve a "broken window" effect, where the three-dimensional entity penetrates the virtual portal. From the front perspective of the two-dimensional interactive interface, the three-dimensional entity appears partially within the spatial scene and partially within the virtual space. From the side perspective of the two-dimensional interactive interface, the three-dimensional entity appears partially within the spatial scene, while from the back perspective of the two-dimensional interactive interface, the three-dimensional entity is invisible. Specifically, the front perspective of the two-dimensional interactive interface displays the three-dimensional entity, which penetrates from the virtual space through the virtual portal into the spatial scene; the back perspective of the two-dimensional interactive interface does not display the three-dimensional entity. Embodiments of the present invention achieve a breakthrough in the two-dimensional virtual portal when displaying the three-dimensional entity, and the displayed three-dimensional entity has different forms from different perspectives, thereby improving the visual effect of displaying the three-dimensional entity on the two-dimensional interactive interface and enhancing the user experience.

[0045] Step S102: Acquire the three-dimensional entity of the object to be displayed.

[0046] Step S103: The front-end perspective of the two-dimensional interactive interface displays the three-dimensional entity, which passes through the virtual portal from the virtual space to the spatial scene; the back-end perspective of the two-dimensional interactive interface does not display the three-dimensional entity.

[0047] Specifically, steps S102 to S103 describe a method for displaying a three-dimensional entity of an object to be displayed on a two-dimensional interactive interface and showing that the three-dimensional entity passes through a virtual portal from a virtual space to a spatial scene according to an embodiment of the present invention.

[0048] Specifically, the methods for displaying a three-dimensional entity from a virtual space through a virtual portal into a spatial scene include the following two methods:

[0049] The first method: after obtaining the three-dimensional entity of the object to be displayed, it further includes: cutting the three-dimensional entity into a foreground three-dimensional entity and a background three-dimensional entity with a virtual portal as a section, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal, and the background three-dimensional entity is displayed in the virtual space inside the virtual portal; splicing the foreground three-dimensional entity and the background three-dimensional entity so that the displayed three-dimensional entity passes through the virtual portal from the virtual space to the spatial scene.

[0050] Specifically, the following Figure 2B The structural diagram of Figure 2B As shown, a virtual portal 201 (built on a two-dimensional interactive interface, assuming it is a virtual portal of a living room) is shown, and the three-dimensional entities of the objects to be displayed (carpet, furniture A, furniture B). Taking the carpet as an example, the three-dimensional entity (carpet) is cut into a foreground three-dimensional entity 203 and a background three-dimensional entity 202 using the virtual portal 201 as a section (represented by a dotted line). Similarly, the three-dimensional entities corresponding to furniture A and furniture B are also cut into a foreground three-dimensional entity and a background three-dimensional entity using the virtual portal as a section (represented by a dotted line). Figure 2B As shown, the foreground three-dimensional entities of the carpet, furniture A, and furniture B are displayed in the spatial scene outside the virtual portal, and the background three-dimensional entities are displayed in the virtual space inside the virtual portal, so that the displayed three-dimensional entities (carpet, furniture A, furniture B) pass through the virtual portal from the virtual space to the spatial scene.

[0051] Thereby, the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal, and the background three-dimensional entity is displayed in the virtual space inside the virtual portal; the foreground three-dimensional entity and the background three-dimensional entity are spliced so that the displayed three-dimensional entity passes through the virtual space and into the spatial scene through the virtual portal.

[0052] The second method is to construct two three-dimensional entities for the object to be displayed, namely a foreground three-dimensional entity and a background three-dimensional entity; perform truncation processing on the foreground three-dimensional entity and the background three-dimensional entity respectively using the virtual portal as the section, and fuse the parts of the foreground three-dimensional entity and the background three-dimensional entity obtained after the truncation processing to obtain an overall fused three-dimensional result of the object to be displayed. Specifically, since the foreground three-dimensional entity and the background three-dimensional entity have the same model parameters, the foreground three-dimensional entity and the background three-dimensional entity can be truncated and spliced respectively according to the position and display part of the background three-dimensional entity; specifically, obtain the vertex data of each vertex of the three-dimensional model of the background three-dimensional entity and the position offset of the background three-dimensional entity; synchronize the vertex data of each vertex of the three-dimensional model of the background three-dimensional entity and the position offset of the background three-dimensional entity to the foreground three-dimensional entity; so that the foreground three-dimensional entity and the background three-dimensional entity have the same three-dimensional model attribute data. Furthermore, based on the virtual portal as a section, the foreground three-dimensional entity and the background three-dimensional entity are truncated respectively, the front half of the foreground three-dimensional entity and the back half of the background three-dimensional entity are retained, and then the retained parts are spliced to form a complete visual model; the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal, and the background three-dimensional entity is displayed in the virtual space inside the virtual portal; the foreground three-dimensional entity and the background three-dimensional entity are spliced so that the displayed three-dimensional entity passes through the virtual space from the virtual space to the spatial scene through the virtual portal.

[0053] It is understood that a 3D entity corresponds to a 3D model, which can be a mesh composed of triangles, each of which is composed of three vertices. The 3D model at least determines the shape, size, and position of the object to be displayed. Specifically, the vertex data of each vertex of the 3D model of the background 3D entity, as well as the position offset of the background 3D entity, are obtained.

[0054] In this embodiment of the present invention, multiple attribute components, such as a PortalComponent and a worldComponent, are bound to a background 3D entity. The PortalComponent is used to configure the 3D entity as a component that leads to different spaces. The worldComponent is a component that defines a space, separating the 3D entity and its descendants from the spatial scene (e.g., a real space or a virtual space), making the 3D entity visible only through a virtual portal. Using these different attribute components, attribute data for the background 3D entity can be flexibly configured.

[0055] Furthermore, in an embodiment of the present invention, the background 3D entity is displayed inside the virtual portal, while the foreground 3D entity is displayed outside the virtual portal (in real space). Therefore, the vertex data of each vertex of the background 3D entity's 3D model, as well as the position offset of the background 3D entity, are synchronized with the foreground 3D entity, so that the foreground and background 3D entities have the same 3D model attribute data. This model attribute data includes size, position offset, vertex data, and so on.

[0056] In an embodiment of the present invention, the two-dimensional view of the virtual portal and the fusion of two three-dimensional entities enable the front-end perspective of the two-dimensional interactive interface to display the three-dimensional entity from the virtual space through the virtual portal to the spatial scene; the back-end perspective of the two-dimensional interactive interface does not display the three-dimensional entity.

[0057] Furthermore, preferably, the embodiment of the present invention further includes the following steps: the display range of the area in the virtual space displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal; and / or the display range of the area in the spatial scene displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal. For example, if the three-dimensional entity to be displayed is an irregular three-dimensional entity, part of its foreground three-dimensional entity is relatively large and its background three-dimensional entity is relatively small, the display range of the area in the spatial scene displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal, that is, it breaks through the virtual portal and is displayed within a display range that matches its volume in the spatial scene; similarly, for the background three-dimensional entity, the display range of the area in the virtual space displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal. This improves the visual effect of the three-dimensional entity from the virtual space through the virtual portal to the spatial scene.

[0058] Furthermore, in an embodiment of the present invention, the method for displaying background three-dimensional entities and foreground three-dimensional entities includes: after constructing a virtual portal on a two-dimensional interactive interface in a spatial scene, further including: constructing a rendering view of the virtual portal, setting the rendering view on the upper layer of the two-dimensional interactive interface; using the rendering view to load the foreground three-dimensional entity and the background three-dimensional entity, and rendering the background three-dimensional entity and the foreground three-dimensional entity in accordance with the rendering layer sequence; wherein the foreground three-dimensional entity is set at the top layer of the rendering layer. Figure 3 The description is the same as that of , so I will not repeat it here.

[0059] Furthermore, in an embodiment of the present invention, to achieve a visual effect of a three-dimensional entity being displayed through, when displaying a background three-dimensional entity and a foreground three-dimensional entity, a display position (display position) is first calculated, i.e., such that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal and the background three-dimensional entity is displayed in the virtual space inside the virtual portal. This calculation includes: obtaining a position offset of the background three-dimensional entity; calculating a distance value between the background three-dimensional entity and a cross-section of the two-dimensional interactive interface based on the position offset, and using the distance value as the display depth; determining a display position based on the display depth, and displaying the background three-dimensional entity and the foreground three-dimensional entity based on the display position, such that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal and the background three-dimensional entity is displayed in the virtual space inside the virtual portal. Specifically, because the foreground three-dimensional entity and the background three-dimensional entity are fused and linked, the display position of the fused three-dimensional entity is determined by calculating the display position of the background three-dimensional entity.

[0060] Furthermore, the display position can be adjusted, that is, after taking the distance value as the display depth, further comprising: adjusting the display depth to generate a target display depth according to the display position of the foreground three-dimensional entity; wherein the display position is the position of the foreground three-dimensional entity displayed in the spatial scene outside the virtual portal; and adjusting the original display positions of the background three-dimensional entity and the foreground three-dimensional entity according to the target display depth. Specifically, after calculating the display depth for the background three-dimensional entity, the display depth is further adjusted, and the basis for the adjustment is whether the foreground three-dimensional entity can be fully displayed in the spatial scene outside the virtual portal, and the positions of the background three-dimensional entity and the foreground three-dimensional entity are adjusted based on this basis to achieve the optimal display effect; for example, the adjustment method is: obtaining the display depth depth, calculating depth / 2 = depth, and moving the three-dimensional model by a distance of depth to ensure that, based on the display position of the foreground three-dimensional entity, the entire foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal.

[0061] In an embodiment of the present invention, steps S101 to S103 can be completed through interaction between the server and the client, that is, corresponding attribute data is configured for multiple components on the server, where the components include a two-dimensional interactive interface, a rendering view, a foreground three-dimensional entity, a background three-dimensional entity, a three-dimensional entity attribute component, and a custom component; when the client needs to build components such as a two-dimensional interactive interface, a rendering view, a foreground three-dimensional entity, and a background three-dimensional entity, the corresponding attribute data is pulled from the server; and the processing, rendering, and display steps are further performed based on the pulled attribute data, that is, when building any one of the multiple components, the attribute data corresponding to the component is obtained from the server.

[0062] By configuring the attribute data of multiple components on the server side, the flexibility of configuring the components and the efficiency of displaying the virtual portal and the objects to be displayed on the client side are improved.

[0063] Furthermore, corresponding attribute data is configured for various components on the server side, including: when configuring attribute data for the foreground 3D entity and the background 3D entity, disabling the reflective attribute in the attribute data of the foreground 3D entity and the background 3D entity to ensure consistent display tones for the foreground 3D entity and the background 3D entity. In an embodiment of the present invention, since the foreground 3D entity and the background 3D entity have different display spaces, in order to ensure consistent display tones for the two, the reflective attribute of both is configured to be disabled. The reflective attribute is an IBL (Image Base Lighting) attribute, and the reflective attribute of both (the background entity and the foreground entity) is disabled by setting rootentity.iblEnable = false and frontEntity.iblEnable = false. Configuring the reflective attribute improves the display effect of merging the background 3D entity and the foreground 3D entity into the upper layer of the virtual portal, improving the visual effect of displaying the foreground 3D entity of the object to be displayed within the virtual portal while simultaneously displaying the foreground 3D entity of the object to be displayed in the real space scene outside the virtual portal.

[0064] In an embodiment of the present invention, the foreground 3D entity and the background 3D entity can also be displayed separately by animation. In order to achieve the synchronous display of the foreground 3D entity and the background 3D entity, a method of recording the animation progress and adjusting the time by using a timer is used.

[0065] Specifically, the global variable CanPlay can be set to control whether the foreground 3D entity and the background 3D entity have been loaded. The animation can only be started after the loading is confirmed to be complete. Furthermore, a custom thread queue DispatchSemaphore is set to coordinate the loading process of the foreground 3D entity and the background 3D entity. When the 3D entity model is initialized, the semaphore attribute semaphore is defined so that after loading is complete, semaphore.signal() is called to notify the semaphore. Based on the two semaphore notifications, the loading is confirmed to be complete and the animation can continue to play. Furthermore, the semaphore.wait() method is used to wait for the semaphore notification. After the model of each entity (foreground 3D entity and background 3D entity) is loaded, semaphore.signal() is called to reduce the semaphore count by 1. The above steps and methods are used to achieve the synchronization of the start of the animation of the foreground 3D entity and the background 3D entity.

[0066] Furthermore, multiple functions are set up to synchronize each frame of animation. For example, a timer is set up to synchronize the screen refresh rate with a CADisplayLink; a progress property is set up to indicate the animation progress; a CADisplayLink is used to synchronize progress updates; a startAnimation function is set up to create and start the CADisplayLink, recording the animation start time and the last update time; a stopAnimation function is set up to stop and destroy the CADisplayLink; a pauseAnimation function is set up to pause the CADisplayLink and record the current progress and time; a resumeAnimation function is set up to resume the CADisplayLink and adjust the startTime to maintain synchronization; and an updateAnimation function is set up to be called once per frame to calculate the animation progress and synchronize the model's progress. Detect and handle exceptions. When resource usage is high, lags may occur. After lags, a specific compensation algorithm needs to be implemented in updateAnimation.

[0067] Among them, the updateAnimation method includes: firstly judging whether the animation playback is in a stopped state, if it is in a non-stop state, obtaining the current animation playback time, subtracting the start time from the current playback time to obtain a time difference, and then obtaining the overall duration of the animation, while detecting abnormal time states, using the current time and the final time as the difference to obtain the current frame rate FPS, if the number of frames of the two models of the foreground 3D entity and the background 3D entity is different, analyzing that the model with the smaller FPS has animation jamming, first obtaining the progress of the low frame rate model, and making the animation smooth transition through sin(difference time / total animation time xFPS - FPS / 2)+1) / 2) to improve the jamming problem, and then increasing the progress and FPS to the progress of the higher model, wherein FPS is calculated by the formula "exp(difference time / total animation time-1) / exp(1) - 1” is obtained to ensure that the two animations of the foreground 3D entity and the background 3D entity are synchronized in each frame; in the field of mathematics, the function exp(x) represents the natural exponential function, that is, the exponential function with the real number e (e≈2.71828) as the base. Its expression is exp(x)=e x , the characteristic of this function is that its derivative is equal to itself. The natural exponential function has a wide range of applications in calculus, probability theory, statistics and other fields. It is used to describe the process of exponential growth or decay, as well as some distributions related to probability density functions.

[0068] By making the playback animation of the foreground 3D entity and the background 3D entity consistent, the user experience is further improved, overcoming the problem of inconsistent playback animation of different entity models (foreground 3D entity and background 3D entity) in different spaces (spatial scenes and virtual spaces) in the existing technology.

[0069] like Figure 3 As shown, an embodiment of the present invention provides a schematic diagram of a structure for displaying a three-dimensional entity on a two-dimensional interactive interface. The structure may include the following components:

[0070] Virtual portal 301; rendering view 302; foreground 3D entity 303 and background 3D entity 304. That is, after constructing the virtual portal on the two-dimensional interactive interface in the spatial scene, the process further includes: constructing a rendering view for the virtual portal, placing the rendering view on top of the two-dimensional interactive interface; using the rendering view to load the foreground 3D entity and the background 3D entity, and sequentially rendering the background 3D entity and the foreground 3D entity according to the rendering layers; wherein the foreground 3D entity is placed on the topmost layer of the rendering layer.

[0071] Specifically, an embodiment of the present invention constructs a rendering view on the upper layer of the virtual portal of the two-dimensional interactive interface, uses the rendering view to load the foreground three-dimensional entity and the background three-dimensional entity, and after processing the foreground three-dimensional entity and the background three-dimensional entity, uses the rendering view to render the background three-dimensional entity and the foreground three-dimensional entity in the order of the rendering layers; by setting the foreground three-dimensional entity at the top layer of the rendering layer, the visual effect of displaying the foreground three-dimensional entity in the spatial scene outside the virtual portal is achieved.

[0072] like Figure 4 As shown, an embodiment of the present invention provides a device 400 for displaying a three-dimensional entity on a two-dimensional interactive interface, comprising: a component construction module 401, an entity acquisition module 402, and a display module 403; wherein,

[0073] The construction component module 401 is used to construct a virtual portal on a two-dimensional interactive interface in a spatial scene; wherein the virtual portal is the entrance between the spatial scene and the virtual space;

[0074] The entity acquisition module 402 is used to acquire the three-dimensional entity of the object to be displayed;

[0075] The display module 403 is used to display the three-dimensional entity from the front-end perspective of the two-dimensional interactive interface. The three-dimensional entity passes through the virtual portal from the virtual space to the spatial scene; the three-dimensional entity is not displayed from the back-end perspective of the two-dimensional interactive interface.

[0076] An embodiment of the present invention also provides an electronic device for displaying a three-dimensional entity on a two-dimensional interactive interface, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the method provided in any of the above embodiments.

[0077] An embodiment of the present invention further provides a computer-readable medium having a computer program stored thereon, and when the program is executed by a processor, the method provided in any of the above embodiments is implemented.

[0078] An embodiment of the present invention further provides a computer program product, including a computer program, which implements any of the above methods for displaying a three-dimensional entity on a two-dimensional interactive interface when executed by a processor.

[0079] Figure 5 An exemplary system architecture 500 is shown, to which the method for displaying a three-dimensional entity on a two-dimensional interactive interface or the apparatus for displaying a three-dimensional entity on a two-dimensional interactive interface according to an embodiment of the present invention can be applied.

[0080] like Figure 5As shown, system architecture 500 may include terminal devices 501, 502, 503, a network 504, and a server 505. Network 504 is used to provide a medium for communication links between terminal devices 501, 502, 503 and server 505. Network 504 may include various connection types, such as wired or wireless communication links or fiber optic cables.

[0081] Users can use terminal devices 501, 502, and 503 to interact with server 505 via network 504 to receive or send messages, etc. Various client applications can be installed on terminal devices 501, 502, and 503, such as e-commerce client applications, web browser applications, search applications, instant messaging tools, and email clients.

[0082] The terminal devices 501 , 502 , and 503 may be various electronic devices having a display screen and supporting various client applications, including but not limited to smart phones, tablet computers, laptop computers, and desktop computers.

[0083] Server 505 may be a server that provides various services, such as a background management server that provides support for client applications used by users using terminal devices 501, 502, and 503. The background management server may process received requests for component attribute data and feed back the corresponding attribute data to the terminal device.

[0084] It should be noted that the method for displaying three-dimensional entities on a two-dimensional interactive interface provided by an embodiment of the present invention is generally executed by terminal devices 501, 502, and 503. Accordingly, the device for displaying three-dimensional entities on a two-dimensional interactive interface is generally set in the terminal devices 501, 502, and 503.

[0085] It should be understood that Figure 5 The number of terminal devices, networks and servers in the embodiment is merely illustrative. Any number of terminal devices, networks and servers may be provided as required.

[0086] Reference below Figure 6 , which shows a schematic structural diagram of a computer system 600 of a terminal device suitable for implementing an embodiment of the present invention. Figure 6 The terminal device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0087] like Figure 6As shown, computer system 600 includes a central processing unit (CPU) 601, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 602 or a program loaded from a storage unit 608 into a random access memory (RAM) 603. Various programs and data required for the operation of system 600 are also stored in RAM 603. CPU 601, ROM 602, and RAM 603 are connected to each other via a bus 604. An input / output (I / O) interface 605 is also connected to bus 604.

[0088] The following components are connected to the I / O interface 605: an input section 606 including a keyboard, mouse, and the like; an output section 607 including devices such as a cathode ray tube (CRT), a liquid crystal display (LCD), and speakers; a storage section 608 including devices such as a hard disk; and a communication section 609 including a network interface card such as a LAN card or a modem. The communication section 609 performs communication processing via a network such as the Internet. A drive 610 is also connected to the I / O interface 605 as needed. Removable media 611, such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, is installed in the drive 610 as needed, so that computer programs read from the removable media can be installed in the storage section 608 as needed.

[0089] In particular, according to embodiments disclosed herein, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments disclosed herein include a computer program product comprising a computer program embodied on a computer-readable medium, the computer program containing program code for executing the methods illustrated in the flowcharts. In such embodiments, the computer program can be downloaded and installed from a network via communication section 609 and / or installed from removable media 611. When executed by central processing unit (CPU) 601, the computer program performs the aforementioned functions defined in the system of the present invention.

[0090] It should be noted that the computer-readable medium described in the present invention may be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. Computer-readable storage media may include, for example, but not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or components, or any combination thereof. More specific examples of computer-readable storage media may include, but are not limited to, an electrical connection having one or more conductors, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present invention, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, device, or component. In the present invention, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such a propagated data signal may take a variety of forms, including, but not limited to, electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device. Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to wireless, wireline, optical fiber cable, RF, or any suitable combination thereof.

[0091] The flowcharts and block diagrams in the accompanying drawings illustrate the possible implementation architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present invention. In this regard, each box in the flowchart or block diagram can represent a module, program segment, or a part of code, and the above-mentioned module, program segment, or a part of code contains one or more executable instructions for implementing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in an order different from that marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart, can be implemented with a dedicated hardware-based system that performs the specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0092] The modules and / or units involved in the embodiments of the present invention may be implemented in software or hardware. The modules and / or units described may also be provided in a processor. For example, they may be described as follows: a processor includes a component construction module, an entity acquisition module, and a display module. The names of these modules do not, in some cases, constitute limitations on the modules themselves. For example, the entity acquisition module may also be described as a "module for acquiring a three-dimensional entity of an object to be displayed."

[0093] As another aspect, the present invention further provides a computer-readable medium, which may be included in the device described in the above embodiment; or may exist independently and not be incorporated into the device. The computer-readable medium carries one or more programs, and when executed by a device, causes the device to: construct a virtual portal on a two-dimensional interactive interface in a spatial scene; wherein the virtual portal is the entrance between the spatial scene and the virtual space; obtain a three-dimensional entity of an object to be displayed; display the three-dimensional entity from the front-end perspective of the two-dimensional interactive interface, wherein the three-dimensional entity extends from the virtual space through the virtual portal into the spatial scene; and not display the three-dimensional entity from the back-end perspective of the two-dimensional interactive interface.

[0094] Embodiments of the present invention enable the construction of a virtual portal on a two-dimensional interactive interface within a spatial scene, capturing the three-dimensional entity of the object to be displayed. This allows the front-end perspective of the two-dimensional interactive interface to display the object extending from the virtual space through the virtual portal into the spatial scene, while the back-end perspective of the two-dimensional interactive interface does not display the three-dimensional entity. This embodiment overcomes the existing problem of three-dimensional objects being unable to penetrate the virtual portal, achieving the visual effect of a three-dimensional object image penetrating the virtual portal into the spatial scene, thus improving the user experience.

[0095] The above specific embodiments do not limit the scope of protection of the present invention. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may occur depending on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of the present invention are intended to be included within the scope of protection of the present invention.

Claims

1. A method for displaying a three-dimensional entity on a two-dimensional interactive interface, characterized in that: include: Constructing a virtual portal on a two-dimensional interactive interface in a spatial scene; wherein the virtual portal is an entrance between the spatial scene and the virtual space; Obtaining a three-dimensional entity of an object to be displayed; The front perspective of the two-dimensional interactive interface displays the three-dimensional entity, and the three-dimensional entity penetrates from the virtual space through the virtual portal into the spatial scene; The back-end perspective of the two-dimensional interactive interface does not display the three-dimensional entity; The method of displaying that the three-dimensional entity passes through the virtual space and into the space scene through the virtual portal includes: The three-dimensional entity is cut into a foreground three-dimensional entity and a background three-dimensional entity using the virtual portal as a section, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal, and the background three-dimensional entity is displayed in the virtual space inside the virtual portal; the foreground three-dimensional entity and the background three-dimensional entity are spliced; or, a foreground three-dimensional entity and a background three-dimensional entity are constructed for the object to be displayed; the foreground three-dimensional entity and the background three-dimensional entity are respectively cut using the virtual portal as a section, and the partial foreground three-dimensional entity and the partial background three-dimensional entity obtained after the truncation are merged.

2. The method according to claim 1, characterized in that The displaying of the three-dimensional entity from the virtual space through the virtual portal to the spatial scene further includes: The display range of the area of the virtual space displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal; and / or, the display range of the area of the space scene displaying the three-dimensional entity may exceed the two-dimensional display range of the virtual portal.

3. The method according to claim 1, characterized in that After constructing the virtual portal on the two-dimensional interactive interface in the spatial scene, the method further includes: Constructing a rendering view of the virtual portal, and setting the rendering view on an upper layer of the two-dimensional interactive interface; The foreground three-dimensional entity and the background three-dimensional entity are loaded using the rendering view, and the background three-dimensional entity and the foreground three-dimensional entity are rendered using the rendering view in a rendering layer order; wherein the foreground three-dimensional entity is set at the top layer of the rendering layer.

4. The method according to claim 1, wherein The step of displaying the foreground three-dimensional entity in the spatial scene outside the virtual portal and the background three-dimensional entity in the virtual space inside the virtual portal includes: Obtaining the position offset of the background three-dimensional entity; Calculating a distance value between the background three-dimensional entity and the cross section of the two-dimensional interactive interface according to the position offset, and using the distance value as a display depth; The display position is determined according to the display depth, and the background three-dimensional entity and the foreground three-dimensional entity are displayed based on the display position, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal and the background three-dimensional entity is displayed in the virtual space inside the virtual portal.

5. The method according to claim 4, characterized in that After using the distance value as the display depth, the method further includes: Adjusting the display depth to generate a target display depth according to a display position of the foreground three-dimensional entity; wherein the display position is a position of the foreground three-dimensional entity displayed in the spatial scene outside the virtual portal; The original display positions of the background three-dimensional entity and the foreground three-dimensional entity are adjusted according to the target display depth.

6. The method according to any one of claims 1 to 5, characterized in that Further including: Configuring corresponding attribute data for various components on the server side, wherein the components include a two-dimensional interactive interface, a rendering view, a foreground three-dimensional entity, a background three-dimensional entity, a three-dimensional entity attribute component, and a custom component; When constructing any one of the multiple components, attribute data corresponding to the component is obtained from the server.

7. The method according to claim 6, characterized in that The server configures corresponding attribute data for various components, including: When configuring attribute data for a foreground 3D entity and a background 3D entity, the reflective attribute in the attribute data of the foreground 3D entity and the background 3D entity is configured to be disabled so that the display tones of the foreground 3D entity and the background 3D entity are consistent.

8. A device for displaying a three-dimensional entity on a two-dimensional interactive interface, characterized in that: include: Construct component module, obtain entity module and display module; among them, The construction component module is used to construct a virtual portal on a two-dimensional interactive interface in the spatial scene; wherein the virtual portal is the entrance between the spatial scene and the virtual space; The entity acquisition module is used to acquire the three-dimensional entity of the object to be displayed; The display module is used to display the three-dimensional entity from the front-end perspective of the two-dimensional interactive interface, and the three-dimensional entity penetrates from the virtual space through the virtual portal to the spatial scene; the three-dimensional entity is not displayed from the back-end perspective of the two-dimensional interactive interface; wherein, the method of displaying the three-dimensional entity penetrating from the virtual space through the virtual portal to the spatial scene includes: truncating the three-dimensional entity into a foreground three-dimensional entity and a background three-dimensional entity with the virtual portal as a section, so that the foreground three-dimensional entity is displayed in the spatial scene outside the virtual portal, and the background three-dimensional entity is displayed in the virtual space inside the virtual portal; splicing the foreground three-dimensional entity and the background three-dimensional entity; or, constructing a foreground three-dimensional entity and a background three-dimensional entity for the object to be displayed; truncating the foreground three-dimensional entity and the background three-dimensional entity respectively with the virtual portal as a section, and fusing the partial foreground three-dimensional entity and the partial background three-dimensional entity obtained after truncation.

9. An electronic device, characterized in that: include: one or more processors; a storage device for storing one or more programs, When the one or more programs are executed by the one or more processors, the one or more processors implement the method according to any one of claims 1 to 7.

10. A computer-readable medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

11. A computer program product comprising a computer program, characterized in that When the program is executed by a processor, the method according to any one of claims 1 to 7 is implemented.

Images