Three-dimensional model presentation method and device, augmented reality equipment and storage medium

Abstract

The invention provides a three-dimensional model presentation method and device, augmented reality equipment and a storage medium, and relates to the technical field of computers. The three-dimensional model presentation method comprises the following steps: setting a mid-scene picture in a two-dimensional user interaction interface; respectively loading the original three-dimensional model to a foreground area in front of the middle scene picture and a background area behind the middle scene picture to serve as a first three-dimensional model and a second three-dimensional model; cutting the first three-dimensional model into a first sub-model and a second sub-model, wherein a cutting surface between the first sub-model and the second sub-model is parallel to the mid-scene picture; cutting the second three-dimensional model into a third sub-model which is the same as the first sub-model and a fourth sub-model which is the same as the second sub-model; the first sub-model is presented in the foreground area, the fourth sub-model is presented in the background area, and the cutting face of the first sub-model and the cutting face of the fourth sub-model are aligned and make contact with each other.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a three-dimensional model presentation method and apparatus, an extended reality device, and a storage medium. Background Art

[0002] XR (Extended Reality) technology refers to the combination of the real world and the virtual world through computers to create a virtual environment that can realize human-computer interaction. It is also a general term for multiple technologies such as AR (Augmented Reality), VR (Virtual Reality) and MR (Mixed Reality). Devices that use XR technology are called XR devices. For example, XR devices can include but are not limited to: glasses, helmets and other head-mounted devices. Summary of the invention

[0003] The inventors noticed that in the prior art, the XR device can only display two-dimensional information of a specified target in the two-dimensional user interface of an application, but cannot display a three-dimensional model of the specified target, thereby reducing the user's interactive experience.

[0004] Accordingly, the present disclosure provides a three-dimensional model presentation method, which presents a three-dimensional model of a specified target by utilizing a foreground area and a background area in a two-dimensional user interaction interface, thereby providing users with a better user interaction experience.

[0005] According to a first aspect of an embodiment of the present disclosure, a three-dimensional model presentation method is provided, comprising: setting a mid-ground picture in a two-dimensional user interaction interface; loading an original three-dimensional model into a foreground area in front of the mid-ground picture and a background area behind the mid-ground picture, respectively, as a first three-dimensional model and a second three-dimensional model; cutting the first three-dimensional model into a first sub-model and a second sub-model, wherein a cutting surface between the first sub-model and the second sub-model is parallel to the mid-ground picture; cutting the second three-dimensional model into a third sub-model identical to the first sub-model and a fourth sub-model identical to the second sub-model; presenting the first sub-model in the foreground area and presenting the fourth sub-model in the background area, wherein the cutting surface of the first sub-model and the cutting surface of the fourth sub-model are aligned and in contact with each other.

[0006] In some embodiments, the first sub-model is the front part of the original three-dimensional model, and the second sub-model is the back part of the original three-dimensional model.

[0007] In some embodiments, in response to a user's movement operation, the first three-dimensional model is cut to obtain a fifth sub-model and a sixth sub-model, wherein a cutting plane between the fifth sub-model and the sixth sub-model is parallel to the middle ground picture, and a first length of the sub-model currently presented in the foreground area in a direction perpendicular to the middle ground picture is different from a second length of the fifth sub-model in a direction perpendicular to the middle ground picture; the second three-dimensional model is cut to obtain a seventh sub-model identical to the fifth sub-model and an eighth sub-model identical to the sixth sub-model; the fifth sub-model is presented in the foreground area, and the eighth sub-model is presented in the background area, wherein the cutting plane of the fifth sub-model and the cutting plane of the eighth sub-model are aligned and in contact with each other.

[0008] In some embodiments, when the moving operation is a forward moving operation, a first length of the sub-model currently presented in the foreground area in the direction is smaller than a second length of the fifth sub-model in the direction.

[0009] In some embodiments, when the moving operation is a forward moving operation, the difference between the second length and the first length increases by a predetermined amplitude.

[0010] In some embodiments, when the fifth sub-model is the first three-dimensional model, the first three-dimensional model is presented in the foreground area, and any sub-model of the second three-dimensional model is not presented in the background area.

[0011] In some embodiments, when the moving operation is a backward moving operation, a third length of the sub-model currently presented in the background area in the direction is smaller than a fourth length of the eighth sub-model in the direction.

[0012] In some embodiments, when the moving operation is a backward moving operation, the difference between the fourth length and the third length increases by a predetermined amplitude.

[0013] In some embodiments, when the eighth sub-model is the second three-dimensional model, the second three-dimensional model is presented in the background area, and any sub-model of the first three-dimensional model is not presented in the foreground area.

[0014] In some embodiments, the fifth sub-model is the front part of the original three-dimensional model, and the sixth sub-model is the back part of the original three-dimensional model.

[0015] In some embodiments, in response to the configuration operation of the user, at least one of the following is performed: configuring a texture of the middle view, configuring a transparency of the middle view, and configuring an image loaded in the middle view.

[0016] In some embodiments, a background image or video file is presented in the background area.

[0017] In some embodiments, the background image is a depth of field image; and the video file is a depth of field video file.

[0018] In some embodiments, the original three-dimensional model is associated with a predetermined target.

[0019] In some embodiments, the display areas of the foreground area and the background area are larger than the display area of ​​the mid-ground image.

[0020] According to a second aspect of an embodiment of the present disclosure, a three-dimensional model presentation device is provided, comprising: a memory; and a processor, coupled to the memory, the processor being configured to execute a method as described in any of the above embodiments based on instructions stored in the memory.

[0021] According to a third aspect of an embodiment of the present disclosure, there is provided an extended reality device, comprising: a three-dimensional model presentation device as described in any of the above embodiments.

[0022] According to a fourth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and when the instructions are executed by a processor, the method involved in any of the above embodiments is implemented.

[0023] According to a fifth aspect of an embodiment of the present disclosure, there is provided a computer program product, comprising computer instructions, wherein the computer instructions, when executed by a processor, implement the method involved in any of the above embodiments.

[0024] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0025] In order to more clearly illustrate the embodiments of the present disclosure or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0026] Figure 1 A schematic diagram of a flow chart of a three-dimensional model presentation method according to an embodiment of the present disclosure;

[0027] Figure 2 A schematic diagram of a two-dimensional user interaction interface according to an embodiment of the present disclosure;

[0028] Figure 3A schematic diagram of a three-dimensional model of an embodiment of the present disclosure;

[0029] Figure 4 A schematic diagram showing a three-dimensional model of an embodiment of the present disclosure;

[0030] Figure 5 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0031] Figure 6 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0032] Figure 7 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0033] Figure 8 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0034] Fig. 9 A schematic diagram of a three-dimensional model of another embodiment of the present disclosure;

[0035] Fig.10 A schematic diagram showing a first sub-three-dimensional model according to an embodiment of the present disclosure;

[0036] Fig.11 A schematic diagram showing a second sub-three-dimensional model according to an embodiment of the present disclosure;

[0037] Fig.12 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0038] Fig.13 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0039] Fig.14 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0040] Fig.15 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0041] Fig.16 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0042] Fig.17 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0043] Fig.18 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0044] Fig.19 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0045] Fig. 20 A schematic diagram showing a three-dimensional model of another embodiment of the present disclosure;

[0046] Fig.21 A schematic diagram of depth of field video presentation according to an embodiment of the present disclosure;

[0047] Fig. 22 A schematic diagram of depth of field video presentation according to another embodiment of the present disclosure;

[0048] Fig.23 A schematic diagram of the structure of a three-dimensional model presentation device according to an embodiment of the present disclosure;

[0049] Fig.24 A schematic diagram of the structure of an extended reality device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0050] The following will be combined with the drawings in the embodiments of the present disclosure to clearly and completely describe the technical solutions in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all of the embodiments. The following description of at least one exemplary embodiment is actually only illustrative and is by no means intended to limit the present disclosure and its application or use. Based on the embodiments in the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0051] Unless specifically stated otherwise, the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure.

[0052] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0053] Technologies, methods, and apparatus known to ordinary technicians in the relevant field may not be discussed in detail, but where appropriate, such technologies, methods, and apparatus should be considered part of the authorization specification.

[0054] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0055] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0056] Figure 1The following is a flow chart of a 3D model presentation method according to an embodiment of the present disclosure. In some embodiments, the following 3D model presentation method is performed by a 3D model presentation device, including steps 11-16.

[0057] In step 11, a mid-ground image is set in the two-dimensional user interaction interface.

[0058] It should be noted here that the two-dimensional user interaction interface may include but is not limited to: the home page, list page, content page or detail page of the XR application. For example, the two-dimensional user interaction interface may be a card in the home page of the XR application.

[0059] For example, Figure 2 As described above, a middle view picture 21 is set in the two-dimensional user interaction interface 20 , the front of the middle view picture 21 is the foreground area 22 , and the back of the middle view picture 21 is the background area 23 .

[0060] It should be noted here that the foreground area 22 and the background area 23 are partial areas in the two-dimensional user interaction interface 20, rather than a three-dimensional display space.

[0061] In some embodiments, the display areas of the foreground area and the background area are larger than the display area of ​​the mid-ground image, thereby facilitating the complete presentation of the three-dimensional model.

[0062] In step 12, the original three-dimensional models are loaded into the foreground area in front of the middle view and the background area behind the middle view, respectively, to serve as the first three-dimensional model and the second three-dimensional model.

[0063] That is, the first three-dimensional model located in the foreground area and the second three-dimensional model located in the background area are the same model.

[0064] In some embodiments, the original three-dimensional model is associated with a predetermined target.

[0065] In step 13, the first three-dimensional model is cut into a first sub-model and a second sub-model, wherein a cutting plane between the first sub-model and the second sub-model is parallel to the mid-ground image.

[0066] In some embodiments, the first sub-model is the front part of the original 3D model, and the second sub-model is the back part of the original 3D model. For example, if the original 3D model is a puppy, the first sub-model includes the puppy's head and the front half of the body, and the second sub-model includes the back half of the puppy's body and the tail.

[0067] In step 14, the second three-dimensional model is cut into a third sub-model identical to the first sub-model and a fourth sub-model identical to the second sub-model.

[0068] It should be noted here that if the first sub-model is the front part of the original 3D model and the second sub-model is the back part of the original 3D model, then the third sub-model is the front part of the original 3D model and the fourth sub-model is the back part of the original 3D model.

[0069] In step 15, the first sub-model is presented in the foreground area, and the fourth sub-model is presented in the background area, wherein the cutting surface of the first sub-model and the cutting surface of the fourth sub-model are aligned and contact with each other.

[0070] It should be noted that, since the first sub-model located in the foreground area is the front part of the original three-dimensional model, and the fourth sub-model located in the background area is the back part of the original three-dimensional model, a complete three-dimensional model is presented by aligning the cutting surface of the first sub-model and the cutting surface of the fourth sub-model and making them contact each other. At the same time, since the first sub-model is located in the foreground area and the fourth sub-model is located in the background area, a visual impact effect of the three-dimensional model breaking out of the window of the two-dimensional user interaction interface is created.

[0071] For example, the original three-dimensional model 30 of the specified target is as follows: Figure 3 shown.

[0072] Next, the original three-dimensional model 30 is loaded into the foreground area in front of the middle ground picture and the background area behind the middle ground picture respectively as the first three-dimensional model and the second three-dimensional model. The first three-dimensional model is cut into a first sub-model and a second sub-model, wherein the cutting surface between the first sub-model and the second sub-model is parallel to the middle ground picture. The second three-dimensional model is cut into a third sub-model identical to the first sub-model and a fourth sub-model identical to the second sub-model. Then, the first sub-model is presented in the foreground area, and the fourth sub-model is presented in the background area, wherein the cutting surface of the first sub-model and the cutting surface of the fourth sub-model are aligned and contact each other.

[0073] For example, Figure 4 As shown, in the two-dimensional user interaction interface, the first sub-model 41 is presented in the foreground area in front of the middle view 40, and the fourth sub-model 42 is presented in the background area behind the middle view 40. Since the cutting surface of the first sub-model 41 and the cutting surface of the fourth sub-model 42 are aligned and contacted with each other, a complete three-dimensional model is presented. At the same time, since the first sub-model 41 is located in the foreground area and the fourth sub-model 42 is located in the background area, a visual impact effect of the three-dimensional model breaking out of the window of the two-dimensional user interaction interface is created.

[0074] It should be noted that, in order to show that the fourth sub-model 42 is located in the background area, the fourth sub-model 42 is represented by a dotted line.

[0075] In some embodiments, the three-dimensional model presented in the two-dimensional user interaction interface can be moved forward and backward to improve the user's visual experience.

[0076] For example, the above-mentioned moving operation includes the following contents.

[0077] 1) In response to a movement operation of the user, the first three-dimensional model is cut to obtain a fifth sub-model and a sixth sub-model, wherein a cutting plane between the fifth sub-model and the sixth sub-model is parallel to the middle ground picture, and a first length of the sub-model currently presented in the foreground area in a direction perpendicular to the middle ground picture is different from a second length of the fifth sub-model in a direction perpendicular to the middle ground picture.

[0078] For example, the fifth sub-model is the front part of the original three-dimensional model, and the sixth sub-model is the back part of the original three-dimensional model.

[0079] In some embodiments, when the moving operation is a forward moving operation, a first length of the sub-model currently presented in the foreground area in the above direction is smaller than a second length of the fifth sub-model in the above direction.

[0080] In some embodiments, when the moving operation is a backward moving operation, a first length of the sub-model currently presented in the foreground area in the above direction is greater than a second length of the fifth sub-model in the above direction.

[0081] 2) Cutting the second three-dimensional model to obtain a seventh sub-model that is the same as the fifth sub-model and an eighth sub-model that is the same as the sixth sub-model.

[0082] It should be noted here that if the fifth sub-model is the front part of the original three-dimensional model and the sixth sub-model is the back part of the original three-dimensional model, then the seventh sub-model is the front part of the original three-dimensional model and the eighth sub-model is the back part of the original three-dimensional model.

[0083] It should also be noted that, when the moving operation is a forward moving operation, the first length of the sub-model currently presented in the foreground area in the above direction is smaller than the second length of the fifth sub-model in the above direction. Correspondingly, the third length of the sub-model currently presented in the background area in the above direction is larger than the fourth length of the sixth sub-model in the above direction.

[0084] In the case where the moving operation is a backward moving operation, the first length of the sub-model currently presented in the foreground area in the above direction is greater than the second length of the fifth sub-model in the above direction. Correspondingly, the third length of the sub-model currently presented in the background area in the above direction is less than the fourth length of the sixth sub-model in the above direction.

[0085] 3) Presenting the fifth sub-model in the foreground area and the eighth sub-model in the background area, wherein the cutting surface of the fifth sub-model and the cutting surface of the eighth sub-model are aligned and in contact with each other.

[0086] Through the above operations, the original three-dimensional model can be pulled out from the two-dimensional user interaction interface, or the original three-dimensional model can be pushed into the two-dimensional user interaction interface, thereby effectively improving the user's interactive experience.

[0087] In some embodiments, when the moving operation is a forward moving operation, Figure 4 On the basis of the foreground region, the length of the first sub-model 41 is increased, while the length of the fourth sub-model 42 is reduced accordingly, thereby creating a visual effect that the original three-dimensional model moves forward, such as Figure 5 shown.

[0088] For example, when the moving operation is a forward moving operation, the length of the sub-model currently presented in the foreground area in the above direction is the first length, and the length of the fifth sub-model in the above direction is the second length, then the difference between the second length and the first length increases by a predetermined amplitude.

[0089] That is, as the user moves forward, the original three-dimensional model will move from the background area to the foreground area in a smooth manner, thereby providing the user with a better visual experience.

[0090] In some embodiments, when the move operation is a backward move operation, Figure 4 On the basis of the above, the length of the first sub-model 41 located in the foreground area is reduced, while the length of the fourth sub-model 42 located in the background area is increased accordingly, thereby creating a visual effect that the original three-dimensional model moves backwards, such as Figure 6 shown.

[0091] For example, when the moving operation is a backward moving operation, the length of the sub-model currently presented in the foreground area in the above direction is the first length, and the length of the fifth sub-model in the above direction is the second length, then the difference between the second length and the first length decreases by a predetermined amount. Correspondingly, the third length of the sub-model currently presented in the background area in the direction is less than the fourth length of the eighth sub-model in the direction, then the difference between the fourth length and the third length increases by a predetermined amount.

[0092] That is, as the user moves backward, the original three-dimensional model will move from the foreground area to the background area in a smooth manner, thereby providing the user with a better visual experience.

[0093] In some embodiments, during the moving operation being a forward moving operation, when the fifth sub-model is the first 3D model, the complete first 3D model is presented in the foreground area, and any sub-model of the second 3D model is not presented in the background area.

[0094] That is, as the user moves forward, the entire original 3D model moves to the foreground area. Figure 7 As shown, the three-dimensional model 41 presented in the foreground area is a complete first three-dimensional model, and any sub-model of the second three-dimensional model is not presented in the background area.

[0095] In some embodiments, during the moving operation being a backward moving operation, when the eighth sub-model is the second 3D model, the complete second 3D model is presented in the background area, and any sub-model of the first 3D model is not presented in the foreground area.

[0096] That is, as the user moves backward, the entire original 3D model moves to the background area. Figure 8 As shown, the three-dimensional model 42 presented in the background area is a complete second three-dimensional model, and any sub-model of the first three-dimensional model is not presented in the foreground area.

[0097] In some embodiments, in response to a configuration operation by the user, at least one of the following is performed: configuring a texture of the middle view picture, configuring a transparency of the middle view picture, and configuring an image loaded in the middle view picture.

[0098] It should be noted here that by configuring the texture, transparency and image loaded in the mid-ground picture, it is possible to further highlight which parts of the presented three-dimensional model are presented in the foreground area and which parts are presented in the background area, thereby further enhancing the user's visual experience.

[0099] In some embodiments, a background image or video file is presented in the background area.

[0100] For example, the background image is a depth of field image, and the video file is a depth of field video file.

[0101] It should be noted here that by presenting a depth of field image or a depth of field video file in the background area, when the user views the two-dimensional user interaction interface from different angles, the user can see the content of different areas in the depth of field image or the depth of field video file, thereby achieving a three-dimensional window display effect and further improving the user's visual experience.

[0102] The present disclosure is described below through specific examples.

[0103] like Fig. 9 As shown, the original 3D model includes sofas, chairs, coffee tables, carpets, etc.

[0104] Next, in the two-dimensional user interface, Fig. 9The original 3D models shown are loaded into the foreground area in front of the middle view and the background area behind the middle view as the first 3D model and the second 3D model. Then, the first 3D model is cut into a first sub-model and a second sub-model, wherein the cutting plane between the first sub-model and the second sub-model is parallel to the middle view. The second 3D model is cut into a third sub-model identical to the first sub-model and a fourth sub-model identical to the second sub-model.

[0105] For example, the first three-dimensional model and the second three-dimensional model are cut, and the obtained first sub-model and third sub-model are as follows: Fig.10 As shown, the obtained second sub-model and fourth sub-model are as follows Fig.11 As shown. Fig.10 In , the first sub-model and the third sub-model include part of the coffee table, part of the chair, and part of the carpet. Fig.11 The second sub-model and the fourth sub-model include Fig.10 Other parts than those shown in .

[0106] Next, if Fig.12 As shown, in the two-dimensional user interaction interface, the foreground area is presented as follows Fig.10 The first sub-model shown in the background area is shown as Fig.11 The fourth sub-model is shown. Since the cutting surface of the first sub-model and the cutting surface of the fourth sub-model are aligned and in contact with each other, a complete original three-dimensional model is presented. At the same time, since the first sub-model is located in the foreground area and the fourth sub-model is located in the background area, a visual impact effect of the three-dimensional model breaking out of the two-dimensional user interaction interface is created.

[0107] Fig.13 for Fig.12 Side view of the Fig.10 The first submodel shown is located in the foreground area, so Fig.13 The first submodel can be seen more clearly in Fig.11 The fourth sub-model shown is located in the background area. Fig.13 Only part of the fourth sub-model can be seen in the image. This can provide users with a better visual experience.

[0108] In some embodiments, the user Fig.12 The presented three-dimensional model moves forward. In this case, the length of the first sub-model located in the foreground area increases, while the length of the fourth sub-model located in the background area decreases accordingly, thereby creating a visual effect that the displayed three-dimensional model moves forward, as shown in FIG. Fig.14 shown.

[0109] contrast Fig.14 and Fig.12 , it can be clearly seen that the displayed three-dimensional model moves forward obviously.

[0110] Fig.15 for Fig.14 Side view of the . Fig.15 and Fig.13 , it can be clearly seen that most of the displayed 3D model is already in the foreground area.

[0111] In some embodiments, as the user moves forward, the displayed 3D model will continue to move forward. If the displayed 3D model is entirely in the foreground area, the user will be presented with a visual effect that the displayed 3D model completely breaks through the wall, such as Fig.16 shown.

[0112] contrast Fig.16 and Fig.14 , it can be clearly seen that the displayed 3D model is completely in the foreground area.

[0113] Fig.17 for Fig.16 Side view of the . Fig.17 and Fig.15 It can be clearly seen that the displayed 3D model is completely in the foreground area.

[0114] In some embodiments, the user Fig.12 The presented three-dimensional model performs a backward movement operation. In this case, the length of the first sub-model located in the foreground area increases, while the length of the fourth sub-model located in the background area decreases accordingly, thereby creating a visual effect that the displayed three-dimensional model moves backward.

[0115] As the user moves backward, the displayed 3D model will continue to move backward. If the displayed 3D model is entirely in the background area, the user will be presented with a visual effect that the displayed 3D model is completely inside the 2D user interaction interface, such as Fig.18 shown.

[0116] contrast Fig.18 and Fig.12 , it can be clearly seen that the displayed 3D model is completely in the background area.

[0117] Fig.19 for Fig.18 Side view of the . Fig.19 and Fig.13 It can be clearly seen that the displayed 3D models are all in the background area.

[0118] In some embodiments, in response to a user's configuration operation, the transparency of the mid-view image is configured, such as Fig. 20shown.

[0119] It should be noted here that Fig. 20 As shown, by configuring the transparency of the mid-ground image, in the presented three-dimensional model, the portion in the background area presents a lighter color than the portion in the foreground area, thereby further improving the user's visual experience.

[0120] In some embodiments, Fig.21 As shown, a depth of field image is presented in the background area. Fig. 22 for Fig.21 Side view of.

[0121] By comparison Fig.21 and Fig. 22 It can be found that since the depth of field image is presented in the background area, when the user views the two-dimensional user interaction interface from different angles, he can see the contents of different areas in the depth of field image. This is similar to the user viewing a shop window from different angles and being able to see the goods placed in different areas of the window, thereby achieving a three-dimensional window effect and further improving the user's visual experience.

[0122] It should be noted here that Figure 12-Figure 22 In the figure, the black box is the two-dimensional user interaction interface.

[0123] Fig.23 The present invention is a schematic structural diagram of a three-dimensional model presentation device according to an embodiment of the present invention.

[0124] like Fig.23 As shown in FIG. 2 , the 3D model rendering apparatus 230 is in the form of a general-purpose computing device. The 3D model rendering apparatus 230 includes a memory 231, a processor 232, and a bus 233 connecting different system components.

[0125] The memory 231 may include, for example, a system memory, a non-volatile storage medium, etc. The system memory may store, for example, an operating system, an application, a boot loader, and other programs. The system memory may include a volatile storage medium, such as a random access memory (RAM) and / or a cache memory. The non-volatile storage medium may store, for example, instructions of a corresponding embodiment of at least one three-dimensional model rendering method being executed. The non-volatile storage medium includes, but is not limited to, a disk memory, an optical memory, a flash memory, etc.

[0126] The processor 232 can be implemented by a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistors, etc. Discrete hardware components. Accordingly, each module such as an acquisition module, a calculation module, and an adjustment module can be implemented by a central processing unit (CPU) running instructions in a memory that execute corresponding steps, or can be implemented by a dedicated circuit that executes corresponding steps.

[0127] For example, the processor 232 is configured to execute instructions stored in the memory to implement the following Figure 1 The method of any one of the embodiments.

[0128] The bus 233 may use any of a variety of bus structures, including, but not limited to, an Industry Standard Architecture (ISA) bus, a Micro Channel Architecture (MCA) bus, and a Peripheral Component Interconnect (PCI) bus.

[0129] The interfaces 234, 235, 236 of the 3D model rendering device 230, the memory 231, and the processor 232 can be connected via a bus 233. The input / output interface 234 provides a connection interface for input / output devices such as a display, a mouse, and a keyboard. The network interface 235 provides a connection interface for various networked devices. The storage interface 236 provides a connection interface for external storage devices such as a floppy disk, a USB flash drive, and an SD card.

[0130] Here, various aspects of the present disclosure are described with reference to flowcharts and / or block diagrams of methods, devices, and computer program products according to embodiments of the present disclosure. It should be understood that each frame of the flowchart and / or block diagram and the combination of frames can be implemented by computer-readable program instructions.

[0131] These computer-readable program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable device to produce a machine, so that the processor executes the instructions to produce means for implementing the functions specified in one or more blocks in the flowchart and / or block diagram.

[0132] These computer-readable program instructions may also be stored in a computer-readable memory, which cause the computer to work in a specific manner to produce an article of manufacture, including instructions for implementing the functions specified in one or more blocks in the flowchart and / or block diagram.

[0133] The present disclosure can take the form of an entirely hardware embodiment, an entirely software embodiment, or an embodiment combining software and hardware aspects.

[0134] The present disclosure also provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer instructions, and when the instructions are executed by a processor, the following is implemented: Figure 1 The method of any one of the embodiments.

[0135] The present disclosure also provides a computer program product, including computer instructions, wherein when the computer instructions are executed by a processor, the following is achieved: Figure 1 The method of any one of the embodiments.

[0136] Fig.24 A schematic diagram of the structure of an extended reality device according to an embodiment of the present disclosure.

[0137] like Fig.24 As shown, the extended reality device 240 includes a three-dimensional model rendering device 241, and the three-dimensional model rendering device 241 is Fig.23 An extended reality device as described in any of the embodiments.

[0138] It should be noted here that the extended reality device may include: display screen, various sensors, cameras, etc., and further include: audio equipment (such as headphones or microphones), controllers (such as handles or touchpads), and batteries and charging systems. Depending on the implementation form of the extended reality device, the various components included will also be different, and the above are only examples. For example, the head-mounted device may not include components such as handles or touchpads. Among them, the extended reality device may include the following components: 1. Display. It can provide a high-resolution visual experience for the extended reality device and provide users with a co-immersive experience. 2. Sensors. The sensors in the extended reality device are crucial for capturing the user's movements, positions, and postures. The sensors in the extended reality device may include but are not limited to: optical sensors, motion sensors, depth sensors, environmental sensors, etc. Among them, optical sensors are often used to track the user's eye movements to achieve eye tracking functions. Eye tracking contributes to more natural and intuitive user interactions, for example, controlling virtual interfaces or selecting objects through the user's line of sight. Optical sensors also include: cameras, which can capture images of the real world and accurately superimpose virtual elements on these images. Cameras can also be used for environmental recognition, helping devices understand the user's surroundings in order to provide a more intelligent and personalized experience. Motion sensors are used to capture the user's head and hand movements in real time and convert them into corresponding operations in the virtual environment, thereby providing a basis for the interaction between spatial computing devices and users. For example, motion sensors capture whether the user initiates a one-hand pinch operation or a one-hand release operation. Depth sensors can measure the distance between the user and objects in the real world, which is critical for accurately superimposing virtual objects into the real world. Depth sensors help spatial computing devices understand the user's surroundings and provide a more realistic and natural experience by measuring the depth information of the surface of an object. Environmental sensors include temperature sensors, humidity sensors, and light sensors, which are used to monitor the environmental conditions around spatial computing devices. Environmental sensors help devices automatically adjust parameters such as display brightness and temperature control to provide a more comfortable user experience.

[0139] By implementing the above-mentioned embodiments of the present disclosure, a three-dimensional model of a designated target is presented by utilizing the foreground area and the background area in a two-dimensional user interaction interface, thereby providing a better user interaction experience for the user.

[0140] In some embodiments, the functional modules described above can be implemented as a general-purpose processor, a programmable logic controller (PLC), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components or any appropriate combination thereof for performing the functions described in the present disclosure.

[0141] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0142] The description of the present disclosure is given for the purpose of illustration and description, and is not intended to be exhaustive or to limit the present disclosure to the disclosed form. Many modifications and variations will be apparent to those of ordinary skill in the art. The embodiments are selected and described in order to better illustrate the principles and practical applications of the present disclosure, and to enable those of ordinary skill in the art to understand the present disclosure and thereby design various embodiments with various modifications suitable for specific uses.

Claims

1. A three-dimensional model presentation method, comprising: Set the mid-ground image in the 2D user interface; Loading the original three-dimensional models into the foreground area in front of the middle ground picture and the background area behind the middle ground picture respectively as the first three-dimensional model and the second three-dimensional model; Cutting the first three-dimensional model into a first sub-model and a second sub-model, wherein a cutting plane between the first sub-model and the second sub-model is parallel to the mid-ground picture; cutting the second three-dimensional model into a third sub-model identical to the first sub-model and a fourth sub-model identical to the second sub-model; The first sub-model is presented in the foreground area, and the fourth sub-model is presented in the background area, wherein a cutting surface of the first sub-model and a cutting surface of the fourth sub-model are aligned and contact with each other.

2. The method according to claim 1, wherein: The first sub-model is the front part of the original three-dimensional model, and the second sub-model is the back part of the original three-dimensional model.

3. The method according to claim 1, wherein: In response to a movement operation by a user, the first three-dimensional model is cut to obtain a fifth sub-model and a sixth sub-model, wherein a cutting plane between the fifth sub-model and the sixth sub-model is parallel to the middle ground picture, and a first length of the sub-model currently presented in the foreground area in a direction perpendicular to the middle ground picture is different from a second length of the fifth sub-model in a direction perpendicular to the middle ground picture; cutting the second three-dimensional model to obtain a seventh sub-model identical to the fifth sub-model and an eighth sub-model identical to the sixth sub-model; The five sub-models are presented in the foreground area, and the eighth sub-model is presented in the background area, wherein a cutting surface of the fifth sub-model and a cutting surface of the eighth sub-model are aligned and in contact with each other.

4. The method according to claim 3, wherein: In a case where the moving operation is a forward moving operation, a first length of the sub-model currently presented in the foreground area in the direction is smaller than a second length of the fifth sub-model in the direction.

5. The method according to claim 4, wherein: In a case where the moving operation is a forward moving operation, the difference between the second length and the first length increases by a predetermined amplitude.

6. The method according to claim 4, wherein: In the case that the fifth sub-model is the first three-dimensional model, the first three-dimensional model is presented in the foreground area, and any sub-model of the second three-dimensional model is not presented in the background area.

7. The method according to claim 3, wherein: In a case where the moving operation is a backward moving operation, a third length of the sub-model currently presented in the background area in the direction is smaller than a fourth length of the eighth sub-model in the direction.

8. The method according to claim 7, wherein: In a case where the moving operation is a backward moving operation, the difference between the fourth length and the third length increases by a predetermined magnitude.

9. The method according to claim 7, wherein: In the case that the eighth sub-model is the second three-dimensional model, the second three-dimensional model is presented in the background area, and any sub-model of the first three-dimensional model is not presented in the foreground area.

10. The method according to claim 3, wherein: The fifth sub-model is the front part of the original three-dimensional model, and the sixth sub-model is the back part of the original three-dimensional model.

11. The method according to claim 1, further comprising: In response to the configuration operation of the user, at least one of the following is performed: The texture of the middle ground picture is configured, the transparency of the middle ground picture is configured, and the image loaded by the middle ground picture is configured.

12. The method according to claim 1, further comprising: A background image or video file is presented in the background area.

13. The method according to claim 12, wherein: The background image is a depth of field image; The video file is a depth-of-field video file.

14. The method according to claim 1, wherein: The original three-dimensional model is associated with a predetermined object.

15. The method according to any one of claims 1 to 14, wherein: The display areas of the foreground area and the background area are larger than the display area of ​​the middle ground picture.

16. A three-dimensional model presentation device, comprising: Memory; A processor is coupled to the memory, and the processor is configured to execute the method according to any one of claims 1 to 15 based on instructions stored in the memory.

17. An extended reality device, comprising: A three-dimensional model rendering device as described in claim 16.

18. A computer-readable storage medium, wherein: The computer-readable storage medium stores computer instructions, and when the instructions are executed by a processor, the method according to any one of claims 1 to 15 is implemented.

19. A computer program product, comprising computer instructions, wherein when the computer instructions are executed by a processor, the method according to any one of claims 1 to 15 is implemented.

Images