Method and apparatus for displaying internal structure of virtual controlled object, and display device

Abstract

The present disclosure relates to the technical field of computers, and provides a method and apparatus for displaying the internal structure of a virtual controlled object, and a display device. The method comprises: acquiring position information of a control point; on the basis of the position information of the control point, determining a controlled region of a virtual controlled object; and on the basis of position information of the virtual controlled object and the position information of the control point, adjusting transparency corresponding to the controlled region, so as to display the internal structure of the controlled region.

Description

Internal structure display method, device and display equipment of virtual controlled object

[0001] Cross-reference to Related Applications

[0002] This application is based on the application with CN application number 202411595319.3, application date November 8, 2024, and claims priority thereto, the disclosure of which is hereby incorporated by reference in its entirety. TECHNICAL FIELD

[0003] The present disclosure relates to the field of computer technology, and particularly relates to an internal structure display method, device and display equipment of a virtual controlled object. BACKGROUND

[0004] Virtual scenes usually show some complete 3D (Dimensional) models. Most models have complex internal structures, and users want to view the internal structure of product models in order to have a deeper understanding of the products, for example, users want to view the internal structure of a refrigerator. To meet this demand, in related technologies, methods such as model animation and showing and hiding external structures are usually used to display the internal structure of product models. SUMMARY

[0005] According to an aspect of the present disclosure, an internal structure display method of a virtual controlled object is provided, including: obtaining position information of a control point; determining a controlled region of the virtual controlled object based on the position information of the control point; and adjusting transparency of the controlled region based on position information of the virtual controlled object and the position information of the control point, to display an internal structure of the controlled region.

[0006] In some embodiments, determining the controlled region of the virtual controlled object based on the position information of the control point includes: obtaining a control radius based on the position information of the control point; and obtaining the controlled region based on the control radius.

[0007] In some embodiments, obtaining the control radius based on the position information of the control point includes: determining depth information of a virtual control point corresponding to the control point in the virtual controlled object according to the position information of the control point; and determining the control radius according to the depth information of the virtual control point in the virtual controlled object.

[0008] In some embodiments, obtaining the position information of the control point includes: identifying whether the virtual controlled object and the virtual control point collide according to a first collision body of the virtual controlled object and a second collision body of the virtual control point corresponding to the control point; and obtaining the position information of the control point in a case where it is determined that the virtual controlled object and the virtual control point collide.

[0009] In some embodiments, adjusting the transparency of the controlled region comprises: adjusting a transparency parameter of a material template corresponding to the controlled region; and rendering the virtual controlled object by using the material template.

[0010] In some embodiments, adjusting the transparency parameter of the material template corresponding to the controlled region comprises: obtaining a difference distance corresponding to each model mesh space point of the virtual controlled object based on the position information of each model mesh space point and the position information of the control point; obtaining a control radius based on the position information of the control point; and adjusting the transparency parameter of the material template corresponding to the controlled region based on a ratio of the difference distance corresponding to each model mesh space point to the control radius.

[0011] In some embodiments, adjusting the transparency parameter of the material template corresponding to the controlled region based on the ratio of the difference distance corresponding to each model mesh space point to the control radius comprises: determining a first model mesh space point position in the controlled region whose ratio is less than a first threshold value; and setting the transparency parameter of the material template at the first model mesh space point position to be greater than a transparency threshold value.

[0012] In some embodiments, adjusting the transparency parameter of the material template corresponding to the controlled region based on the ratio of the difference distance corresponding to each model mesh space point to the control radius further comprises: determining a second model mesh space point position in the controlled region whose ratio is greater than or equal to a first threshold value and less than or equal to a second threshold value, and a third model mesh space point position whose ratio is greater than the second threshold value; setting a value of a transparent channel of the material template at the second model mesh space point position according to the ratio corresponding to the second model mesh space point position; and setting the value of the transparent channel of the material template at the third model mesh space point position according to an original primary color of the material template at the third model mesh space point position.

[0013] In some embodiments, obtaining the difference distance corresponding to each model mesh space point based on the position information of each model mesh space point and the position information of the control point comprises: converting the position information of each model mesh space point and the position information of the control point to a same coordinate system; calculating a difference between a coordinate position of each model mesh space point and a coordinate position of the control point in the same coordinate system to obtain a difference matrix; and obtaining the difference distance corresponding to each model mesh space point according to the difference matrix.

[0014] According to another aspect of the present disclosure, a virtual controlled object internal structure display device is also provided, comprising: an acquisition module configured to acquire position information of a control point; a determination module configured to determine a controlled region of a virtual controlled object based on the position information of the control point; and a display module configured to adjust a transparency of the controlled region based on position information of the virtual controlled object and the position information of the control point, to display an internal structure of the controlled region.

[0015] According to another aspect of this disclosure, a virtual controlled object internal structure display device is also proposed, comprising: a memory; and a processor coupled to the memory, the processor being configured to execute the virtual controlled object internal structure display method as described above based on instructions stored in the memory.

[0016] According to another aspect of this disclosure, a head-mounted display device is also proposed, comprising: the aforementioned internal structure display device for the virtual controlled object.

[0017] According to another aspect of this disclosure, a computer-readable storage medium is also proposed, on which computer program instructions are stored, which, when executed by a processor, implement the method for displaying the internal structure of a virtual controlled object as described above.

[0018] According to another aspect of this disclosure, a computer program product is also proposed, including a computer program or instructions, which, when executed by a processor, implement the above-described method for displaying the internal structure of a virtual controlled object.

[0019] According to another aspect of this disclosure, a computer program is also proposed, comprising: instructions that, when executed by a processor, cause the processor to perform the above-described method for displaying the internal structure of a virtual controlled object.

[0020] Other features and advantages of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0021] The accompanying drawings, which form part of this specification, illustrate embodiments of this disclosure and, together with the specification, serve to explain the principles of this disclosure.

[0022] This disclosure will become clearer with reference to the accompanying drawings and the following detailed description, wherein:

[0023] Figure 1 is a flowchart illustrating some embodiments of the method for displaying the internal structure of a virtual controlled object disclosed herein;

[0024] Figure 2 is a flowchart illustrating some other embodiments of the method for displaying the internal structure of a virtual controlled object disclosed herein;

[0025] Figure 3 is a schematic diagram of the default display effect of some virtual controlled objects in this disclosure;

[0026] Figure 4 is a schematic diagram of the gesture interaction effects of some virtual controlled objects disclosed herein;

[0027] Figure 5 is a schematic diagram of the default display effect of some other virtual controlled objects disclosed herein;

[0028] Figure 6 is a schematic diagram of the gesture interaction effects of some other virtual controlled objects disclosed herein;

[0029] Figure 7 is a schematic diagram of the structure of some embodiments of the virtual controlled object internal structure display device of this disclosure;

[0030] Figure 8 is a schematic diagram of the internal structure display device for the virtual controlled object of this disclosure in some other embodiments. Detailed Implementation

[0031] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that, unless otherwise specifically stated, the relative arrangement, numerical expressions, and values ​​of the components and steps set forth in these embodiments do not limit the scope of the present disclosure.

[0032] At the same time, it should be understood that, for ease of description, the dimensions of the various parts shown in the accompanying drawings are not drawn according to actual scale.

[0033] The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this disclosure or its application or use.

[0034] Techniques, methods, and equipment known to those skilled in the art may not be discussed in detail, but where appropriate, such techniques, methods, and equipment should be considered part of the specification.

[0035] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limitations. Therefore, other examples of exemplary embodiments may have different values.

[0036] It should be noted that similar labels and letters in the following figures indicate similar items; therefore, once an item is defined in one figure, it does not need to be discussed further in subsequent figures.

[0037] To make the objectives, technical solutions, and advantages of this disclosure clearer, the following detailed description is provided in conjunction with specific embodiments and the accompanying drawings.

[0038] In related technologies, displaying the internal structure of a product model through model animation increases both the model's production cost and complexity, requiring additional control over the animation's on / off state. While displaying the internal structure by showing or hiding the external structure can reduce production costs, the controlled area for showing or hiding objects is typically large, resulting in weaker user interactivity.

[0039] This disclosure provides a scheme for displaying the internal structure of a virtual controlled object, which can improve the interactivity with the user when displaying the internal structure of the virtual controlled object without increasing model complexity and production costs. The scheme will be described in detail below using specific embodiments.

[0040] Figure 1 is a flowchart illustrating some embodiments of the method for displaying the internal structure of a virtual controlled object according to the present disclosure. This embodiment is executed by an internal structure display device for the virtual controlled object, such as a head-mounted display device. This embodiment includes steps S11-S13.

[0041] In step S11, the location information of the control points is obtained.

[0042] The control point is, for example, a touch point for a gesture, or a touch point of a component that enables control, such as a touch point of a device like a controller.

[0043] In some embodiments, the gesture touch point is captured by an image acquisition device such as a camera, thereby determining the position information of the gesture touch point in the world coordinate system. This position information is three-dimensional coordinate information. For example, the two-dimensional coordinates of the gesture touch point are converted into three-dimensional spatial coordinates.

[0044] In step S12, the controlled area of ​​the virtual controlled object is determined based on the location information of the control points.

[0045] In some embodiments, the virtual controlled object is a virtual product model, such as a model of a virtual product with an internal structure, such as a virtual oven or a virtual refrigerator. The creation of the three-dimensional model of the virtual controlled object is not specifically limited in this disclosure.

[0046] In some embodiments, a control radius is obtained based on the location information of the control points; and a controlled region is obtained based on the control radius. The control radius is, for example, a spatial radius, and the controlled region is a three-dimensional region. For example, the controlled region may be a circular region corresponding to the control radius.

[0047] In step S13, based on the location information of the virtual controlled object and the location information of the control point, the transparency of the controlled area is adjusted to display the internal structure of the controlled area.

[0048] For example, by adjusting the transparency of the controlled area, the controlled area of ​​the virtual controlled object can have a transparent effect, that is, the internal structure of the controlled area of ​​the virtual controlled object can be displayed.

[0049] In the above embodiment, by utilizing the information from control points to control the transparency of different areas of the virtual controlled object, a penetration effect can be achieved in the controlled area of ​​the virtual controlled object, thereby revealing the internal structure of the controlled area. This embodiment achieves user interaction with the virtual controlled object without increasing the complexity of the model or production costs, allowing users to disassemble and view the internal structure of the virtual controlled object, thus improving the interactivity between the user and the virtual controlled object.

[0050] In some embodiments, transparent display in certain areas is achieved by adjusting the transparency parameter of the material template.

[0051] For example, by adjusting the transparency parameter of the material template corresponding to the controlled area, the virtual controlled object can be rendered using the material template to display the internal structure of the controlled area. This transparency parameter is the same as the alpha channel parameter in the color parameters.

[0052] In some embodiments, a material template, such as a material sphere, can be predefined to represent how virtual objects are presented in three-dimensional space. This material sphere can implement material mapping, as well as functions such as transforming model mesh points and resetting colors.

[0053] For example, a material sphere can be used to map standard PBR (Physically Based Rendering) textures onto a virtual controlled object. Textures include basecolor, metal, roughness, normal, and AO (Ambient Occlusion). First, the virtual controlled object is rendered based on the initialized material sphere, mapping its base material. Then, based on the position information of each model mesh point and control point of the virtual controlled object, the transparency of different areas is dynamically controlled through color resetting.

[0054] In the above embodiments, by utilizing the position information of the control points and the material template of the virtual controlled object, the transparency parameter of the material template corresponding to the controlled area of ​​the virtual controlled object can be adjusted to achieve the penetration effect of the controlled area, thereby realizing the display of the internal structure of the controlled area. Without increasing the complexity of the model and the production cost, the interaction between the user and the virtual controlled object can be improved while displaying the internal structure of the virtual controlled object.

[0055] In some embodiments, the transparency parameters of the material template corresponding to the controlled area are adjusted based on the position information of the virtual controlled object and the position information of the control points. This can be achieved through the embodiment shown in Figure 2. Figure 2 is a flowchart illustrating some other embodiments of the method for displaying the internal structure of a virtual controlled object according to this disclosure, including steps S131-S133.

[0056] In step S131, based on the position information of each model grid spatial point and the position information of the control point of the virtual controlled object, the difference distance corresponding to each model grid spatial point is obtained.

[0057] In some embodiments, the position information of each model grid spatial point and the position information of the control point are transformed to the same coordinate system; the difference between the coordinate position of each model grid spatial point and the coordinate position of the control point in the same coordinate system is calculated to obtain a difference matrix; and the difference distance corresponding to each model grid spatial point is obtained based on the difference matrix.

[0058] For example, the position coordinates of each model grid spatial point in the model coordinate system, i.e., the position coordinates in the virtual controlled object coordinate system, are converted into position coordinates in the world coordinate system; the difference between the position coordinates of each model grid spatial point in the world coordinate system and the position coordinates of the control point in the world coordinate system is calculated to obtain the difference matrix; and the difference distance corresponding to each model grid spatial point is obtained based on the difference matrix.

[0059] For example, based on the world matrix, the position data of each model grid point is transformed from the model coordinate system (modelPosition) to the world coordinate system in parallel. Then, the difference between the position coordinates of each model grid point in the world coordinate system and the gesture position information point (touchpoint) is calculated to obtain the difference matrix, and thus the difference distance corresponding to each model grid point is obtained. For example, the difference distance corresponding to each model grid point is represented as length(worldMatrix*modelPosition-touchPoint).

[0060] In step S132, the control radius is obtained based on the location information of the control points.

[0061] In some embodiments, the depth information of the virtual control point corresponding to the control point in the virtual controlled object is determined based on the location information of the control point; and the control radius is determined based on the depth information of the virtual control point in the virtual controlled object.

[0062] For example, the control radius of a gesture can be calculated based on the depth of the gesture within a virtual oven. This involves first calculating the 3D bounding box of the virtual oven in the world coordinate system, then calculating the distance between the coordinates of the gesture's touch point in the world coordinate system and the center point of that 3D bounding box, and finally mapping this distance relationship to the depth information of the gesture within the virtual oven to obtain the gesture control radius.

[0063] In step S133, the transparency parameter of the material template corresponding to the controlled area is adjusted based on the ratio of the difference distance to the control radius corresponding to each model mesh spatial point.

[0064] In some embodiments, the location of a first model mesh spatial point within the controlled area whose ratio is less than a first threshold is determined; and the transparency parameter of the material template at the location of the first model mesh spatial point is set to be greater than the transparency threshold. For example, the color parameter of the material sphere is set to black and completely transparent, such as setting the parameters of the RGB (red, green, blue) channel and the transparency channel of the material sphere to 0.

[0065] For example, the first threshold is 0.9. Those skilled in the art should understand that this setting of 0.9 is merely an example, and other values, such as 0.8, 0.85, 0.95, etc., can be set according to actual circumstances. If the ratio of the difference distance between the points in the model grid space to the control radius is less than the first threshold, it indicates that the control radius of the gesture is not greater than the virtual controlled object. Therefore, the virtual controlled object is within the control range, and the transparency of the controlled area of ​​the virtual controlled object can be adjusted.

[0066] In some embodiments, the locations of second model mesh spatial points within the controlled area with a ratio greater than or equal to a first threshold and less than or equal to a second threshold, and the locations of third model mesh spatial points with a ratio greater than the second threshold are determined; the value of the transparency channel of the material template at the second model mesh spatial point location is set according to the ratio corresponding to the second model mesh spatial point location; and the value of the transparency channel of the material template at the third model mesh spatial point location is set according to the original main color of the material template at the third model mesh spatial point location.

[0067] The second threshold is set to 1, for example. Those skilled in the art should understand that this setting is merely an example, and other values ​​can be set according to actual circumstances. In this embodiment, setting the second threshold allows for the creation of a transition region between the internal structure and the outer surface of the object.

[0068] For example, if the calculated ratio is greater than or equal to 0.9 and less than or equal to 1, then that value is set as the alpha (transparency) channel value of the material sphere. Additionally, the primary color of the material sphere, diffuseColor, is calculated using the formula diffuseColor = blueColor * (1 - alpha) + baseColor * alpha, where blueColor is the blue value and baseColor is the primary color of the original PBR material of the virtual controlled object. In other words, the primary color of the material sphere is calculated based on the value of the alpha channel.

[0069] If the calculated ratio is greater than 1, the baseColor of the original PBR material of the virtual controlled object is decomposed. For example, the corresponding RGB color is assigned to the base color channel of the PBR material, and the value of the alpha channel of the original PBR material is assigned to the transparency channel of the PBR material sphere.

[0070] In the above embodiments, by adjusting the color parameters of the material template corresponding to the controlled area according to the ratio of the difference distance to the control radius of each model grid spatial point, the transparency of different areas can be dynamically controlled, thereby achieving the penetration effect of the virtual controlled object.

[0071] In some embodiments of this disclosure, a collision between the virtual controlled object and the virtual control point is identified based on the first collider of the virtual controlled object and the second collider of the virtual control point corresponding to the control point; if a collision between the virtual controlled object and the virtual control point is determined, the position information of the control point is obtained.

[0072] For example, by loading a virtual scene and creating colliders, collisions between virtual objects can be monitored. Then, an initialized custom material is loaded and mapped onto the virtual controlled object, completing the mapping of the virtual controlled object's base material. If a collision occurs between the virtual controlled object and a virtual control point, it indicates that the display of the virtual controlled object's internal structure has been triggered by controlling the control point. By obtaining the control point's position information, the depth information of the virtual control point within the virtual controlled object is determined, thus obtaining the control radius and the controlled area. Based on the ratio of the difference distance between each model mesh point in space to the control radius, the color parameters of the material template corresponding to the controlled area are adjusted. Finally, using the material template, the virtual controlled object is rendered, thereby displaying the internal structure of the controlled area.

[0073] The following description uses gesture touch points as an example of control points and a cube model with a cylindrical internal structure as an example of a virtual controlled object to illustrate the above solution. This embodiment uses a custom material sphere to allow viewing of the internal structure of the cube model. The solution disclosed herein is applicable to immersive interactive experience scenarios such as head-mounted display devices.

[0074] First, a custom material sphere is designed, built on top of PBR. This material sphere needs to implement functions such as material mapping, model mesh spatial point transformation, and color resetting.

[0075] After a gesture is triggered, the 2D coordinates of the gesture touch point are converted into 3D coordinates, such as 3D coordinates in the world coordinate system. The gesture interacts with a custom material. Based on the 3D coordinates, the depth information of the gesture within the cube model is calculated, leading to the gesture control radius. These 3D coordinates and the control radius are then passed to the custom material for model mesh spatial point transformation. Point-by-point, the position data of each model mesh spatial point is transformed from the model coordinate system to the world coordinate system in parallel. The difference between this transformation and the 3D coordinates is calculated to obtain a difference matrix, which is then used to calculate the difference distance. This difference distance is divided by the gesture control radius to obtain an intermediate temporary variable, such as a float type. Based on the magnitude of this intermediate temporary variable, the material's color is reset according to a predetermined rule, returning the color parameters of the PBR material.

[0076] For example, if the intermediate temporary variable is less than 0.9, the values ​​of the four channels of the primary color diffuseColor are set to (0, 0, 0, 0), i.e., completely transparent black. If the intermediate temporary variable is greater than or equal to 0.9 and less than or equal to 1, the value of the intermediate temporary variable is assigned to the alpha channel. The value of the PBR material's base color channel is calculated, for example, using the formula blueColor*(1-alpha)+baseColor*alpha. If the intermediate temporary variable is greater than 1, the primary color of the original model's PBR material is decomposed, and the corresponding RGB colors are assigned to the PBR material's base color channel, while the alpha channel value is assigned to the PBR material's transparency channel. When the user lifts their hand, the control radius is reset, and the above process is repeated until the gesture trigger ends.

[0077] For example, mapping gesture interactions to a custom material sphere produces a comparison of the interaction effects shown in Figures 3 and 4. Figure 3 illustrates the default display effect of some virtual controlled objects disclosed in this invention, and Figure 4 illustrates the gesture interaction effect of some virtual controlled objects disclosed in this invention. Through the above process, the internal structure of the virtual controlled object can be disassembled and viewed.

[0078] In some embodiments, as shown in Figure 5 or Figure 6, Figure 5 is a schematic diagram of the default display effect of some other virtual controlled objects of this disclosure, and Figure 6 is a schematic diagram of the gesture interaction effect of some other virtual controlled objects of this disclosure. After the user wears a head-mounted display device, the internal structure of the oven is displayed by gesture. The user touches the virtual oven with gestures, and the radius of the visible internal structure of the virtual oven is obtained according to the depth of the gesture in the virtual oven, forming a control area. By adjusting the transparency of the control area, a penetration effect of the control area is achieved, so that the user can view the internal structure of the virtual oven.

[0079] Figure 7 is a schematic diagram of some embodiments of the internal structure display device of the virtual controlled object disclosed herein. The internal structure display device includes an acquisition module 710, a determination module 720, and a display module 730.

[0080] The acquisition module 710 is configured to acquire the location information of the control points.

[0081] For example, the two-dimensional coordinates of the touch point of the controlled object can be obtained through a camera, and then the two-dimensional coordinates can be converted into position information in the world coordinate system.

[0082] The control object can be, for example, a gesture, or a control device such as a handle.

[0083] The determination module 720 is configured to determine the controlled area of ​​the virtual controlled object based on the location information of the control points.

[0084] In some embodiments, a control radius is obtained based on the location information of the control points; and a controlled area is obtained based on the control radius. For example, the circle corresponding to the control radius is taken as the controlled area.

[0085] For example, based on the location information of the control point, the depth information of the virtual control point in the virtual controlled object is determined; and based on the depth information of the virtual control point in the virtual controlled object, the control radius is determined.

[0086] The display module 730 is configured to adjust the transparency of the controlled area based on the position information of each model grid spatial point and the position information of the control point of the virtual controlled object, so as to display the internal structure of the controlled area.

[0087] In the above embodiments, by utilizing the information from control points to control the transparency of different areas of the virtual controlled object, a penetration effect can be achieved in the controlled area of ​​the virtual controlled object, thereby revealing the internal structure of the controlled area. This embodiment achieves user interaction with the virtual controlled object without increasing the complexity of the model or production costs, allowing users to disassemble and view the internal structure of the virtual controlled object, thus improving the interactivity between the user and the virtual controlled object.

[0088] In some embodiments, the display module 730 is configured to adjust the transparency parameter of the material template corresponding to the controlled area, and render the virtual controlled object using the material template.

[0089] In some embodiments, the display module 730 obtains the difference distance corresponding to each model mesh spatial point based on the position information of each model mesh spatial point and the position information of the control points; obtains the control radius based on the position information of the control points; and adjusts the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model mesh spatial point to the control radius. This transparency parameter is the parameter of the transparency channel in the color parameters.

[0090] For example, determine the location of a first model mesh spatial point within the controlled area whose ratio is less than a first threshold; and set the transparency parameter of the material template at the location of the first model mesh spatial point to be greater than the transparency threshold. For example, set the material sphere to be fully transparent, that is, set the color parameter of the material sphere to black and fully transparent.

[0091] For example, determine the location of a second model mesh spatial point within the controlled area whose ratio is greater than or equal to a first threshold and less than or equal to a second threshold, and the location of a third model mesh spatial point whose ratio is greater than the second threshold; set the value of the transparency channel of the material template at the location of the second model mesh spatial point according to the ratio corresponding to the location of the second model mesh spatial point; and set the value of the transparency channel of the material template at the location of the third model mesh spatial point according to the original main color of the material template at the location of the third model mesh spatial point.

[0092] In some embodiments, the display module 730 is configured to convert the position information of each model grid spatial point and the position information of the control point to the same coordinate system, calculate the difference between the coordinate position of each model grid spatial point and the coordinate position of the control point in the same coordinate system, obtain a difference matrix, and obtain the difference distance corresponding to each model grid spatial point based on the difference matrix.

[0093] For example, the position information of each model grid spatial point in the model coordinate system is converted into the position information in the world coordinate system; the difference between the position information of each model grid spatial point in the world coordinate system and the three-dimensional coordinates of the control point is calculated to obtain the difference matrix; and the difference distance corresponding to each model grid spatial point is obtained based on the difference matrix.

[0094] In the above embodiments, by utilizing the position information of the control points and the material template of the virtual controlled object, the transparency parameter of the material template corresponding to the controlled area of ​​the virtual controlled object can be adjusted, that is, the transparency of different areas of the virtual controlled object can be controlled, thereby achieving the penetration effect of the controlled area and displaying the internal structure of the controlled area. This can be achieved without increasing the complexity of the model and the production cost, while improving the user's interactive experience with the virtual controlled object.

[0095] In some embodiments, the internal structure display device further includes an initialization module (not shown in the figures), which is configured to create a first collider of the virtual controlled object and a second collider of the virtual control point corresponding to the control point, and to initialize a material template; wherein, the acquisition module 710 is further configured to identify whether the virtual controlled object and the virtual control point collide based on the first collider of the virtual controlled object and the second collider of the virtual control point corresponding to the control point, and to acquire the position information of the controlled object if it is determined that the virtual controlled object and the virtual control point collide.

[0096] Figure 8 is a schematic diagram of the internal structure display device of a virtual controlled object according to some other embodiments of the present disclosure. The internal structure display device includes a memory 810 and a processor 820. The memory 810 can be a disk, flash memory, or any other non-volatile storage medium. The memory is used to store the instructions in the above embodiments. The processor 820 is coupled to the memory 810 and can be implemented as one or more integrated circuits, such as a microprocessor or microcontroller. The processor 820 is used to execute the instructions stored in the memory.

[0097] In some embodiments, the processor 820 is coupled to the memory 810 via a BUS bus 830. This internal structure display device can also be connected to an external storage device 850 via a storage interface 840 to access external data, and can also be connected to a network or another computer system (not shown) via a network interface 860. Further details are omitted here.

[0098] In this embodiment, by storing data instructions in a memory and then processing the instructions by a processor, the internal structure of the virtual controlled object can be displayed while improving the interactivity between the user and the virtual controlled object without increasing the complexity of the model or the production cost.

[0099] In other embodiments of this disclosure, a head-mounted display device is protected, which includes the internal structure display device of the virtual controlled object in the above embodiments, thereby applying the solution to immersive interactive experience scenarios.

[0100] In other embodiments, a computer-readable storage medium stores computer program instructions that, when executed by a processor, implement the steps of the methods described above. Those skilled in the art will understand that embodiments of this disclosure can be provided as methods, apparatus, or computer program products. Therefore, this disclosure can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this disclosure can take the form of a computer program product embodied on one or more computer-usable non-transitory storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0101] In some embodiments, a computer program product is protected, comprising a computer program or instructions that, when executed by a processor, implement the aforementioned internal structure display method. The computer program product includes a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowchart. In such embodiments, the computer program can be downloaded and installed from a network via a communication device, or installed from a storage device, or installed from ROM. When the computer program is executed by the CPU, it performs the functions defined in the methods of the embodiments of this disclosure.

[0102] In some embodiments of this disclosure, a computer program is also provided, comprising: instructions that, when executed by a processor, cause the processor to perform the internal structure display method as described above.

[0103] This disclosure is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this disclosure. It will be understood that each block of the flowchart illustrations and / or block diagrams, as well as combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in one or more flowchart illustrations and / or one or more block diagrams.

[0104] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means that implement the functions specified in one or more flowcharts and / or one or more block diagrams.

[0105] These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer-implemented process, such that the instructions, which execute on the computer or other programmable apparatus, provide steps for implementing the functions specified in one or more flowcharts and / or one or more block diagrams.

[0106] The technical solutions disclosed herein comply with relevant laws and regulations regarding the collection, updating, analysis, processing, use, transmission, and storage of user personal information. These aspects are used for legitimate purposes and do not violate public order and good morals. Necessary measures are taken to prevent unauthorized access to user personal information data and to safeguard user personal information security, network security, and national security.

[0107] This concludes the detailed description of the present disclosure. To avoid obscuring the concept of the disclosure, some details known in the art have not been described. Those skilled in the art will fully understand how to implement the technical solutions disclosed herein based on the above description.

[0108] The methods and apparatus of this disclosure may be implemented in many ways. For example, they may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above-described order of steps for the methods is for illustrative purposes only, and the steps of the methods of this disclosure are not limited to the order specifically described above unless otherwise specifically stated. Furthermore, in some embodiments, this disclosure may also be implemented as a program recorded on a recording medium, the program including machine-readable instructions for implementing the methods according to this disclosure. Thus, this disclosure also covers recording media storing programs for performing the methods according to this disclosure.

[0109] While specific embodiments of this disclosure have been described in detail by way of example, those skilled in the art should understand that the examples are for illustrative purposes only and not intended to limit the scope of this disclosure. Those skilled in the art should understand that modifications can be made to the above embodiments without departing from the scope and spirit of this disclosure. The scope of this disclosure is defined by the appended claims.

Claims

1. A method for displaying the internal structure of a virtual controlled object, comprising: Obtain the location information of the control points; Based on the location information of the control points, the controlled area of ​​the virtual controlled object is determined; as well as Based on the location information of the virtual controlled object and the location information of the control point, the transparency of the controlled area is adjusted to display the internal structure of the controlled area.

2. The internal structure display method according to claim 1, wherein, The process of determining the controlled area of ​​the virtual controlled object based on the location information of the control points includes: Based on the location information of the control points, the control radius is obtained; and The controlled area is obtained based on the control radius.

3. The internal structure display method according to claim 2, wherein, The control radius obtained based on the location information of the control points includes: Based on the location information of the control point, determine the depth information of the virtual control point corresponding to the control point within the virtual controlled object; and The control radius is determined based on the depth information of the virtual control point within the virtual controlled object.

4. The internal structure display method according to any one of claims 1 to 3, wherein, The acquisition of the control point location information includes: Based on the first collider of the virtual controlled object and the second collider of the virtual control point corresponding to the control point, identify whether a collision occurs between the virtual controlled object and the virtual control point; and If a collision is determined between the virtual controlled object and the virtual control point, the position information of the control point is obtained.

5. The internal structure display method according to any one of claims 1 to 4, wherein, Adjusting the transparency of the controlled area includes: Adjust the transparency parameters of the material template corresponding to the controlled area; and The virtual controlled object is rendered using the material template.

6. The internal structure display method according to claim 5, wherein, The adjustment of the transparency parameters of the material template corresponding to the controlled area includes: Based on the position information of each model grid spatial point of the virtual controlled object and the position information of the control point, the difference distance corresponding to each model grid spatial point is obtained; Based on the location information of the control points, the control radius is obtained; and Based on the ratio of the difference distance between each spatial point of the model mesh to the control radius, the transparency parameter of the material template corresponding to the controlled area is adjusted.

7. The internal structure display method according to claim 6, wherein, The step of adjusting the transparency parameter of the material template corresponding to the controlled region based on the ratio of the difference distance between each spatial point of the model mesh to the control radius includes: Determine the location of the first model grid spatial point within the controlled region whose ratio is less than a first threshold; and Set the transparency parameter of the material template at the spatial point of the first model mesh to be greater than the transparency threshold.

8. The internal structure display method according to claim 7, wherein, The step of adjusting the transparency parameter of the material template corresponding to the controlled region based on the ratio of the difference distance corresponding to each model mesh spatial point to the control radius further includes: Determine the location of a second model grid spatial point within the controlled area whose ratio is greater than or equal to the first threshold and less than or equal to the second threshold, and the location of a third model grid spatial point whose ratio is greater than the second threshold; Based on the ratio corresponding to the spatial point positions of the second model mesh, set the transparency channel value of the material template at the spatial point position of the second model mesh; and Based on the original primary color of the material template at the spatial point position of the third model mesh, set the value of the transparency channel of the material template at the spatial point position of the third model mesh.

9. The internal structure display method according to any one of claims 6 to 8, wherein, The step of obtaining the difference distance corresponding to each model grid spatial point based on the position information of each model grid spatial point and the position information of the control point includes: Transform the position information of each model grid spatial point and the position information of the control point to the same coordinate system; Calculate the difference between the coordinate positions of each model grid point and the control point in the same coordinate system to obtain a difference matrix; and Based on the difference matrix, the difference distance corresponding to each model grid spatial point is obtained.

10. A display device for the internal structure of a virtual controlled object, comprising: The acquisition module is configured to acquire the location information of control points; The determination module is configured to determine the controlled area of ​​the virtual controlled object based on the location information of the control points; The display module is configured to adjust the transparency of the controlled area based on the position information of the virtual controlled object and the position information of the control point, so as to display the internal structure of the controlled area.

11. A display device for the internal structure of a virtual controlled object, comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute the method for displaying the internal structure of a virtual controlled object as described in any one of claims 1 to 9 based on instructions stored in the memory.

12. A head-mounted display device, comprising: The internal structure display device of the virtual controlled object as described in claim 10 or 11.

13. A computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the method for displaying the internal structure of a virtual controlled object as described in any one of claims 1 to 9.

14. A computer program product comprising a computer program or instructions, wherein the computer program or instructions, when executed by a processor, implement the method for displaying the internal structure of a virtual controlled object as described in any one of claims 1 to 9.

15. A computer program comprising: Instructions, when executed by a processor, cause the processor to perform the method for displaying the internal structure of a virtual controlled object according to any one of claims 1 to 9.

Images