Method, device and display equipment for displaying the internal structure of a virtual controlled object

Abstract

The present disclosure provides a method, apparatus, and display device for displaying the internal structure of a virtual controlled object, relating to the field of computer technology. The method comprises: obtaining position information of control points; determining a controlled area of the virtual controlled object based on the position information of the control points; and adjusting the transparency of the controlled area based on the position information of the virtual controlled object and the position information of the control points to display the internal structure of the controlled area.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method, apparatus, and display device for displaying the internal structure of a virtual controlled object. Background Art

[0002] Virtual scenes typically display complete 3D (Dimensional) models. Most models have complex internal structures. To gain a deeper understanding of a product, users often want to view the internal structure of the product model, for example, a refrigerator. To address this need, related technologies typically use methods such as model animation and displaying and hiding the external structure to achieve this display. Summary of the Invention

[0003] A technical problem to be solved by the present disclosure is to provide a method, apparatus and display device for displaying the internal structure of a virtual controlled object, which can realize the internal structure display of the virtual controlled object without increasing the complexity and production cost of the model and improving the user interaction experience.

[0004] According to one aspect of the present disclosure, a method for displaying the internal structure of a virtual controlled object is proposed, comprising: obtaining position information of a control point; determining a controlled area of the virtual controlled object based on the position information of the control point; and adjusting the transparency of the controlled area based on the position information of the virtual controlled object and the position information of the control point to display the internal structure of the controlled area.

[0005] In some embodiments, determining the controlled area of the virtual controlled object based on the position information of the control point includes: obtaining a control radius based on the position information of the control point; and obtaining the controlled area based on the control radius.

[0006] In some embodiments, obtaining the control radius based on the position information of the control point includes: determining depth information of a virtual control point corresponding to the control point in the virtual controlled object according to the position information of the control point; and determining the control radius according to the depth information of the virtual control point in the virtual controlled object.

[0007] In some embodiments, obtaining the position information of the control point includes: identifying whether the virtual controlled object and the virtual control point collide based on the first collision body of the virtual controlled object and the second collision body of the virtual control point corresponding to the control point; and obtaining the position information of the control point when it is determined that the virtual controlled object and the virtual control point collide.

[0008] In some embodiments, adjusting the transparency of the controlled area includes: adjusting a transparency parameter of a material template corresponding to the controlled area; and rendering the virtual controlled object using the material template.

[0009] In some embodiments, adjusting the transparency parameter of the material template corresponding to the controlled area includes: obtaining the difference distance corresponding to each model grid space point based on the position information of each model grid space point of the virtual controlled object and the position information of the control point; obtaining the control radius based on the position information of the control point; and adjusting the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius.

[0010] In some embodiments, based on the ratio of the difference distance corresponding to each model grid space point to the control radius, adjusting the transparency parameter of the material template corresponding to the controlled area includes: determining the position of the first model grid space point in the controlled area whose ratio is less than a first threshold; and setting the transparency parameter of the material template at the first model grid space point position to be greater than the transparency threshold.

[0011] In some embodiments, adjusting the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius also includes: determining the position of a second model grid space point in the controlled area whose ratio is greater than or equal to the first threshold and less than or equal to the second threshold, and the position of a third model grid space point whose ratio is greater than the second threshold; setting the value of the transparent channel of the material template at the second model grid space point position according to the ratio corresponding to the second model grid space point position; and setting the value of the transparent channel of the material template at the third model grid space point position according to the original main color of the material template at the third model grid space point position.

[0012] In some embodiments, based on the position information of each model grid space point and the position information of the control point, obtaining the difference distance corresponding to each model grid space point includes: converting the position information of each model grid space point and the position information of the control point to the same coordinate system; calculating the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system to obtain a difference matrix; and obtaining the difference distance corresponding to each model grid space point according to the difference matrix.

[0013] According to another aspect of the present disclosure, a device for displaying the internal structure of a virtual controlled object is proposed, comprising: an acquisition module configured to acquire position information of a control point; a determination module configured to determine a controlled area of the virtual controlled object based on the position information of the control point; and a display module configured to adjust the transparency of the controlled area based on the position information of the virtual controlled object and the position information of the control point to display the internal structure of the controlled area.

[0014] According to another aspect of the present disclosure, a device for displaying the internal structure of a virtual controlled object is provided, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the method for displaying the internal structure of the virtual controlled object as described above based on instructions stored in the memory.

[0015] According to another aspect of the present disclosure, a head-mounted display device is further provided, comprising: the internal structure display device of the virtual controlled object described above.

[0016] According to another aspect of the present disclosure, a computer-readable storage medium is provided, on which computer program instructions are stored. When the instructions are executed by a processor, the internal structure display method of the virtual controlled object as described above is implemented.

[0017] According to another aspect of the present disclosure, a computer program product is also provided, including a computer program or instructions, which implements the above-mentioned method for displaying the internal structure of a virtual controlled object when the computer program or instructions are executed by a processor.

[0018] In this disclosed embodiment, the transparency of different regions of a virtual object is controlled by leveraging control point information, creating a transparent effect within the controlled region of the virtual object, thereby revealing the internal structure of the controlled region. This embodiment enables user interaction with the virtual object, allowing users to disassemble and view its internal structure without increasing the model's complexity or production costs.

[0019] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0021] The present disclosure can be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0022] Figure 1 Schematic diagram of the flow of some embodiments of the method for displaying the internal structure of a virtual controlled object disclosed in the present invention;

[0023] Figure 2 Schematic diagram of the flow chart of other embodiments of the method for displaying the internal structure of a virtual controlled object disclosed in the present invention;

[0024] Figure 3 Schematic diagram of the default display effects of some virtual controlled objects disclosed in the present invention;

[0025] Figure 4 Schematic diagram of gesture interaction effects of some virtual controlled objects disclosed in the present invention;

[0026] Figure 5 Schematic diagram of default display effects of other virtual controlled objects disclosed in the present invention;

[0027] Figure 6 Schematic diagrams of gesture interaction effects of other virtual controlled objects disclosed in the present invention;

[0028] Figure 7 Schematic diagrams of the structures of some embodiments of the internal structure display device of the virtual controlled object disclosed in the present invention;

[0029] Figure 8 Schematic diagrams of the structures of other embodiments of the internal structure display device of the virtual controlled object disclosed in the present invention. DETAILED DESCRIPTION

[0030] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that unless otherwise specifically stated, the relative arrangement of components and steps, numerical expressions and numerical values set forth in these embodiments do not limit the scope of the present disclosure.

[0031] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0032] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0033] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered part of the specification.

[0034] In all examples shown and discussed herein, any specific values should be interpreted as merely exemplary and not limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0035] It should be noted that like reference numerals and letters refer to like items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0036] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in conjunction with specific embodiments and with reference to the accompanying drawings.

[0037] Related technologies that use model animation to display the internal structure of a product model increase model production costs and complexity, requiring additional animation control switches. While displaying the internal structure of a product model by revealing or hiding the external structure can reduce production costs, the controlled area of the visible or hidden object is often too large, resulting in weak user interactivity.

[0038] The present disclosure provides a solution for displaying the internal structure of a virtual controlled object, which can improve the interactivity between the virtual controlled object and the user when displaying the internal structure without increasing the model complexity and production cost. The solution of the present disclosure will be described in detail below using specific embodiments as examples.

[0039] Figure 1 This is a flowchart of some embodiments of the method for displaying the internal structure of a virtual controlled object disclosed herein. This embodiment is executed by an internal structure display device of the virtual controlled object, such as a head-mounted display device. This embodiment includes steps S11-S13.

[0040] In step S11, the position information of the control point is obtained.

[0041] The control point is, for example, a touch point of a gesture, or a touch point of a component capable of achieving control, such as a touch point of a device such as a handle.

[0042] In some embodiments, the gesture touch point is captured by an image capture device such as a camera, and the position information of the gesture touch point in the world coordinate system can be determined. This position information is three-dimensional coordinate information. For example, the two-dimensional coordinates of the gesture touch point are converted into three-dimensional space coordinates.

[0043] In step S12, based on the position information of the control point, the controlled area of the virtual controlled object is determined.

[0044] In some embodiments, the virtual controlled object is a virtual product model, such as a model of a virtual product with an internal structure, such as a virtual oven, a virtual refrigerator, etc. The three-dimensional model of the virtual controlled object is established without specific limitation in this disclosure.

[0045] In some embodiments, a control radius is obtained based on the position information of the control point; and a controlled area is obtained based on the control radius. The control radius is, for example, a spatial radius, and the controlled area is a three-dimensional area. For example, a circular area corresponding to the control radius is the controlled area.

[0046] In step S13 , based on the position information of the virtual controlled object and the position information of the control point, the transparency of the controlled area is adjusted to display the internal structure of the controlled area.

[0047] For example, the transparency of the controlled area is adjusted so that the controlled area of the virtual controlled object has a penetrating effect, that is, the internal structure of the controlled area of the virtual controlled object is displayed.

[0048] In the above embodiment, by utilizing control point information to control the transparency of different regions of the virtual controlled object, a see-through effect can be achieved within the controlled region of the virtual controlled object, thereby enabling the display of the internal structure of the controlled region. This embodiment enables user interaction with the virtual controlled object, allowing users to disassemble and view the virtual controlled object's internal structure without increasing the complexity and production cost of the model, thus improving user interactivity with the virtual controlled object.

[0049] In some embodiments, transparent display of certain locations is achieved by adjusting the transparency parameters of the material template.

[0050] For example, the transparency parameter of the material template corresponding to the controlled area is adjusted, and the material template is used to render the virtual controlled object to display the internal structure of the controlled area. The transparency parameter is the parameter of the transparent channel in the color parameter.

[0051] In some embodiments, a material template can be predefined, such as a material ball, which is used to express the presentation of a virtual object in three-dimensional space. The material ball can implement functions such as material mapping, model grid space point transformation, and color resetting.

[0052] For example, using a material ball, you can map standard PBR (Physically-Based-Rendering) textures to a virtual object. Textures include baseColor, metal, roughness, normal, and ambient occlusion (AO). The virtual object is first rendered based on the initialized material ball, mapping its base material. Then, based on the position of each mesh point and control point in the virtual object's model, the transparency of different areas is dynamically controlled by resetting the colors.

[0053] In the above embodiment, by utilizing the position information of the control point and the material template of the virtual controlled object and adjusting the transparency parameter of the material template corresponding to the controlled area of the virtual controlled object, a penetration effect of the controlled area can be achieved, thereby realizing the display of the internal structure of the controlled area. Without increasing the complexity and production cost of the model, the user's interactivity with the virtual controlled object can be improved while displaying the internal structure of the virtual controlled object.

[0054] In some embodiments, based on the position information of the virtual controlled object and the position information of the control point, the transparency parameter of the material template corresponding to the controlled area can be adjusted by Figure 2 The embodiment shown is implemented. Figure 2 1 is a flow chart of other embodiments of the method for displaying the internal structure of a virtual controlled object disclosed herein, including steps S131 - S133 .

[0055] In step S131 , based on the position information of each model grid space point of the virtual controlled object and the position information of the control point, a difference distance corresponding to each model grid space point is obtained.

[0056] In some embodiments, the position information of each model grid space point and the position information of the control point are converted to the same coordinate system; the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system is calculated to obtain a difference matrix; and based on the difference matrix, the difference distance corresponding to each model grid space point is obtained.

[0057] For example, the position coordinates of each model grid space point in the model coordinate system, that is, the position coordinates in the virtual controlled object coordinate system, are converted to the position coordinates in the world coordinate system; the difference between the position coordinates of each model grid space point in the world coordinate system and the position coordinates of the control point in the world coordinate system is calculated to obtain a difference matrix; and based on the difference matrix, the difference distance corresponding to each model grid space point is obtained.

[0058] For example, based on the world matrix (worldMatrix), the position data of each model grid space point is transformed from the model coordinate system modelPosition to the world coordinate system in parallel. The difference between the position coordinates of each model grid space point in the world coordinate system and the gesture position information point (touchpoint) is then calculated to obtain a difference matrix, and then the difference distance corresponding to each model grid space point is obtained. For example, the difference distance corresponding to each model grid space point is expressed as length(worldMatrix*modelPosition-touchPoint).

[0059] In step S132, the control radius is obtained based on the position information of the control point.

[0060] In some embodiments, depth information of a virtual control point corresponding to the control point in the virtual controlled object is determined based on the position information of the control point; and a control radius is determined based on the depth information of the virtual control point in the virtual controlled object.

[0061] For example, the control radius of a gesture can be calculated based on its depth within a virtual oven. For example, the three-dimensional bounding box of the virtual oven in the world coordinate system is first calculated. The distance between the touch point of the gesture in the world coordinate system and the center of the three-dimensional bounding box is then calculated. Finally, this distance is mapped to the depth of the gesture within the virtual oven to determine the control radius of the gesture.

[0062] In step S133 , based on the ratio of the difference distance corresponding to each model grid space point to the control radius, the transparency parameter of the material template corresponding to the controlled area is adjusted.

[0063] In some embodiments, a first model grid space point location within the controlled area having a ratio less than a first threshold is determined; and a transparency parameter of a material template at the first model grid space point location is set to be greater than the transparency threshold. For example, the color parameters of the material ball are set to black and fully transparent, such as setting the parameters of the RGB (red, green, and blue) channels and the transparency channel of the material ball to 0.

[0064] For example, the first threshold is 0.9. Those skilled in the art will appreciate that the first threshold is set to 0.9 for illustrative purposes only and may be set to other values, such as 0.8, 0.85, 0.95, etc., depending on actual circumstances. If the ratio of the difference distance corresponding to the model grid space point to the control radius is less than the first threshold, it indicates that the control radius of the gesture is not greater than the virtual controlled object. Therefore, the virtual controlled object is within the control range, and the transparency of the controlled area of the virtual controlled object can be adjusted.

[0065] In some embodiments, a second model grid space point position in the controlled area whose ratio is greater than or equal to the first threshold and less than or equal to the second threshold, and a third model grid space point position whose ratio is greater than the second threshold are determined; the value of the transparent channel of the material template of the second model grid space point position is set according to the ratio corresponding to the second model grid space point position; and the value of the transparent channel of the material template of the third model grid space point position is set according to the original main color of the material template of the third model grid space point position.

[0066] The second threshold is set to 1, for example. Those skilled in the art will appreciate that the second threshold being set to 1 is merely an example and may be set to other values depending on the actual situation. In this embodiment, the second threshold is set so that a transition region can be set between displaying the internal structure and the outer surface of the object.

[0067] For example, if the calculated ratio is greater than or equal to 0.9 and less than or equal to 1, then the value is set as the value of the alpha (transparency) channel of the material ball. In addition, the formula diffuseColor = blueColor * (1-alpha) + baseColor * alpha is used to calculate the main color diffuseColor of the material ball, where blueColor is the blue value and baseColor is the main color of the original PBR material of the virtual controlled object. In other words, the main color of the material ball is calculated based on the value of the transparency channel.

[0068] If the calculated ratio is greater than 1, the main color baseColor of the original PBR material of the virtual controlled object is decomposed. For example, the corresponding RGB color is assigned to the basic color channel of the PBR material, and the value of the alpha channel of the original PBR material is assigned to the transparent channel of the PBR material ball.

[0069] In the above embodiment, the transparency of different areas can be dynamically controlled by adjusting the color parameters of the material template corresponding to the controlled area according to the ratio of the difference distance corresponding to each model grid space point to the control radius, thereby achieving the penetration effect of the virtual controlled object.

[0070] In some embodiments of the present disclosure, whether a collision occurs between the virtual controlled object and the virtual control point is identified based on a first collision body of the virtual controlled object and a second collision body of the virtual control point corresponding to the control point; if it is determined that a collision occurs between the virtual controlled object and the virtual control point, the position information of the control point is obtained.

[0071] For example, by loading a virtual scene and creating a collision body, you can monitor whether there is a collision between virtual objects. Then, load the initialized custom material ball and map the custom material ball to the virtual controlled object to complete the mapping of the basic material of the virtual controlled object. If the virtual controlled object collides with the virtual control point, it means that the control point has been triggered to control the display of the internal structure of the virtual controlled object. By obtaining the position information of the control point, the depth information of the virtual control point in the virtual controlled object is determined, thereby obtaining the control radius and the controlled area. Based on the ratio of the difference distance corresponding to each model grid space point to the control radius, the color parameters of the material template corresponding to the controlled area are adjusted, and then the material template is used to render the virtual controlled object to display the internal structure of the controlled area.

[0072] The following describes the above solution, using gesture touch points as an example of control points and a cube model with a cylindrical internal structure as an example of a virtual controlled object. This embodiment uses a custom material ball to enable viewing of the cube model's internal structure. The disclosed solution is suitable for immersive interactive experience scenarios such as head-mounted display devices.

[0073] First, a custom material ball is designed based on PBR. This material ball needs to implement functions such as material mapping, model grid space point transformation, and color resetting.

[0074] After the gesture trigger starts, the two-dimensional coordinates of the gesture touch point are converted into the three-dimensional coordinates of the gesture. The three-dimensional coordinates of the gesture are, for example, three-dimensional coordinates in the world coordinate system, and the gesture interacts with the custom material ball through the gesture. According to the three-dimensional coordinates of the gesture, the depth information of the gesture in the cube model is calculated, and then the gesture control radius is calculated. The three-dimensional coordinates of the gesture and the control radius are passed to the custom material ball to perform the model grid space point transformation. The position data of each model grid space point is converted from the model coordinate system to the world coordinate system in parallel, and then the difference is calculated with the three-dimensional coordinates of the gesture to obtain the difference matrix, and then the difference distance is calculated. The difference distance is divided by the gesture control radius to obtain an intermediate temporary variable, which is, for example, a float type. According to the size of the intermediate temporary variable, the color of the material ball is reset according to the predetermined rules, that is, the color parameters of the PBR material are returned.

[0075] For example, if the intermediate temporary variable is less than 0.9, the values of the four channels of the main color diffuseColor are set to (0, 0, 0, 0), that is, black and fully transparent. If the temporary intermediate variable is greater than or equal to 0.9 and less than or equal to 1, the value of the intermediate temporary variable is assigned to the alpha channel, and the value of the PBR material base color channel is calculated according to the formula blueColor*(1-alpha)+baseColor*alpha. If the temporary intermediate variable is greater than 1, the main color of the PBR material of the original model is decomposed, the corresponding RGB color is assigned to the PBR material base color channel, and the value of the alpha channel is assigned to the transparent channel of the PBR material ball. When the user gesture is lifted, the control radius is reset, and the above process is repeated until the gesture trigger ends.

[0076] For example, mapping gesture interaction behavior to a custom material ball, the interactive effect comparison is as follows: Figure 3 and Figure 4 shown. Figure 3 Schematic diagram of the default display effect of some virtual controlled objects disclosed in this disclosure. Figure 4 The following is a schematic diagram of the gesture interaction effects of some virtual controlled objects disclosed in the present invention. Through the above process, the internal structure of the virtual controlled object can be disassembled and viewed.

[0077] In some embodiments, as Figure 5 or Figure 6 As shown, Figure 5 Schematic diagram of the default display effect of other virtual controlled objects disclosed in the present invention. Figure 6Schematic diagrams of gesture interaction effects for other virtual controlled objects disclosed herein. After donning a head-mounted display, a user triggers a display of the oven's internal structure through gestures. The user touches the virtual oven with a gesture. The depth of the gesture within the virtual oven determines the radius within which the virtual oven's internal structure can be viewed, forming a control area. By adjusting the transparency of this control area, a see-through effect is achieved, allowing the user to view the virtual oven's internal structure.

[0078] Figure 7 Schematic diagram of the structure of some embodiments of the internal structure display device of the virtual controlled object disclosed in the present invention, the internal structure display device includes an acquisition module 710 , a determination module 720 , and a display module 730 .

[0079] The acquisition module 710 is configured to acquire position information of a control point.

[0080] For example, the two-dimensional coordinates of the touch point of the control object are obtained through a camera, and then the two-dimensional coordinates are converted into position information in the world coordinate system.

[0081] The control object may be, for example, a gesture, or a control device such as a handle.

[0082] The determination module 720 is configured to determine a controlled area of the virtual controlled object based on the position information of the control point.

[0083] In some embodiments, a control radius is obtained based on the position information of the control point, and a controlled area is obtained based on the control radius. For example, a circle corresponding to the control radius is used as the controlled area.

[0084] For example, the depth information of the virtual control point corresponding to the control point in the virtual controlled object is determined according to the position information of the control point; and the control radius is determined according to the depth information of the virtual control point in the virtual controlled object.

[0085] The display module 730 is configured to adjust the transparency of the controlled area based on the position information of each model grid space point of the virtual controlled object and the position information of the control point to display the internal structure of the controlled area.

[0086] In the above embodiment, by utilizing control point information to control the transparency of different regions of the virtual controlled object, a see-through effect can be achieved within the controlled region of the virtual controlled object, thereby enabling the display of the internal structure of the controlled region. This embodiment enables user interaction with the virtual controlled object, allowing users to disassemble and view the virtual controlled object's internal structure without increasing the complexity and production cost of the model, thus improving user interactivity with the virtual controlled object.

[0087] In some embodiments, the display module 730 is configured to adjust the transparency parameter of the material template corresponding to the controlled area, and render the virtual controlled object using the material template.

[0088] In some embodiments, the display module 730 obtains the difference distance corresponding to each model grid space point based on the position information of each model grid space point and the position information of the control point; obtains the control radius based on the position information of the control point; and adjusts the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius. The transparency parameter is the parameter of the transparent channel in the color parameter.

[0089] For example, a first model grid spatial point location within the controlled area having a ratio less than a first threshold is determined; and a transparency parameter of a material template at the first model grid spatial point location is set to be greater than the transparency threshold. For example, a material ball is set to be fully transparent, that is, the color parameter of the material ball is set to black and fully transparent.

[0090] For another example, determine the second model grid space point position in the controlled area whose ratio is greater than or equal to the first threshold and less than or equal to the second threshold, and the third model grid space point position whose ratio is greater than the second threshold; set the value of the transparent channel of the material template of the second model grid space point position according to the ratio corresponding to the second model grid space point position; and set the value of the transparent channel of the material template of the third model grid space point position according to the original main color of the material template of the third model grid space point position.

[0091] In some embodiments, the display module 730 is configured to convert the position information of each model grid space point and the position information of the control point into the same coordinate system, calculate the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system, obtain a difference matrix, and obtain the difference distance corresponding to each model grid space point based on the difference matrix.

[0092] For example, the position information of each model grid space point in the model coordinate system is converted into the position information in the world coordinate system; the difference between the position information of each model grid space point in the world coordinate system and the three-dimensional coordinates of the control point is calculated to obtain a difference matrix; and according to the difference matrix, the difference distance corresponding to each model grid space point is obtained.

[0093] In the above embodiment, by utilizing the position information of the control point and the material template of the virtual controlled object, and adjusting the transparency parameter of the material template corresponding to the controlled area of the virtual controlled object, that is, controlling the transparency of different areas of the virtual controlled object, a penetration effect of the controlled area can be achieved, thereby realizing the display of the internal structure of the controlled area. Without increasing the complexity and production cost of the model, the user's interactive experience with the virtual controlled object can be improved while displaying the internal structure of the virtual controlled object.

[0094] In some embodiments, the internal structure display device also includes an initialization module (not shown in the drawings), which is configured to create a first collision body of the virtual controlled object and a second collision body of the virtual control point corresponding to the control point, and initialize the material template; wherein the acquisition module 710 is also configured to identify whether the virtual controlled object and the virtual control point collide based on the first collision body of the virtual controlled object and the second collision body of the virtual control point corresponding to the control point, and obtain the position information of the controlled object when it is determined that the virtual controlled object and the virtual control point collide.

[0095] Figure 8 Schematic diagrams of other embodiments of the internal structure display device for a virtual controlled object disclosed herein include a memory 810 and a processor 820. The memory 810 can be a disk, flash memory, or any other non-volatile storage medium. The memory is used to store instructions in the above embodiments. The processor 820 is coupled to the memory 810 and can be implemented as one or more integrated circuits, such as a microprocessor or microcontroller. The processor 820 is used to execute the instructions stored in the memory.

[0096] In some embodiments, the processor 820 is coupled to the memory 810 via a BUS 830. The internal structure display device can also be connected to an external storage device 850 via a storage interface 840 to access external data, and can also be connected to a network or another computer system (not shown) via a network interface 860. Detailed description is omitted here.

[0097] In this embodiment, by storing data instructions in a memory and then processing the instructions through a processor, it is possible to improve the interactivity between the user and the virtual controlled object while displaying the internal structure of the virtual controlled object without increasing the complexity and production cost of the model.

[0098] In other embodiments of the present disclosure, a head-mounted display device is provided, which includes the internal structure display device of the virtual controlled object in the above embodiment, so as to apply the solution to an immersive interactive experience scenario.

[0099] In other embodiments, a computer-readable storage medium stores computer program instructions thereon, which, when executed by a processor, implement the steps of the method in the above-described embodiment. Those skilled in the art will appreciate that the embodiments of the present disclosure may be provided as methods, devices, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0100] In some embodiments, a computer program product is protected, including a computer program or instructions, which implement the above-mentioned driving strategy determination method or driving control method when executed by a processor. The computer program product includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network through a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by the CPU, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

[0101] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram and the combination of processes and / or blocks in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 a process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0102] These computer program instructions may also be stored in a computer readable memory that can direct a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 a process or multiple processes and / or boxes Figure 1 The function specified in one or more boxes.

[0103] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing the instructions executed on the computer or other programmable device for implementing the process. Figure 1 a process or multiple processes and / or boxes Figure 1 A step that specifies a function in one or more boxes.

[0104] The collection, collection, updating, analysis, processing, use, transmission, and storage of user personal information involved in the technical solutions disclosed herein comply with relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures will be taken with respect to user personal information to prevent unauthorized access to user personal information data and safeguard the security of user personal information, network security, and national security.

[0105] The present disclosure has been described in detail so far. To avoid obscuring the concept of the present disclosure, some details known in the art have not been described. Based on the above description, those skilled in the art can fully understand how to implement the technical solutions disclosed herein.

[0106] The methods and apparatus of the present disclosure may be implemented in many ways. For example, the methods and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless otherwise specifically stated. In addition, in some embodiments, the present disclosure may also be implemented as programs recorded in a recording medium, which include machine-readable instructions for implementing the methods according to the present disclosure. Therefore, the present disclosure also covers recording media that store programs for executing the methods according to the present disclosure.

[0107] Although some specific embodiments of the present disclosure have been described in detail by way of examples, those skilled in the art will appreciate that the above examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Those skilled in the art will appreciate that modifications may be made to the above embodiments without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A method for displaying the internal structure of a virtual controlled object, comprising: Get the location information of the control point; determining a controlled area of the virtual controlled object based on the position information of the control point; as well as Based on the position information of each model grid space point of the virtual controlled object and the position information of the control point, obtaining a difference distance corresponding to each model grid space point; Based on the position information of the control point, a control radius is obtained; Based on the ratio of the difference distance corresponding to each model grid space point to the control radius, the transparency parameter of the material template corresponding to the controlled area is adjusted, and the virtual controlled object is rendered using the material template to display the internal structure of the controlled area.

2. The internal structure display method according to claim 1, wherein: The determining of the controlled area of the virtual controlled object based on the position information of the control point includes: Based on the position information of the control point, a control radius is obtained; and Based on the control radius, the controlled area is obtained.

3. The internal structure display method according to claim 2, wherein: The obtaining of the control radius based on the position information of the control point includes: Determining depth information of a virtual control point corresponding to the control point in the virtual controlled object according to the position information of the control point; and The control radius is determined according to depth information of the virtual control point in the virtual controlled object.

4. The internal structure display method according to claim 1, wherein: The obtaining of the position information of the control point includes: identifying whether a collision occurs between the virtual controlled object and the virtual control point according to a first collision body of the virtual controlled object and a second collision body of the virtual control point corresponding to the control point; and When it is determined that the virtual controlled object collides with the virtual control point, position information of the control point is acquired.

5. The internal structure display method according to claim 1, wherein: The adjusting the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius includes: Determine a position of a first model grid space point in the controlled area where the ratio is less than a first threshold; and The transparency parameter of the material template at the position of the first model grid space point is set to be greater than a transparency threshold.

6. The internal structure display method according to claim 5, wherein: The adjusting the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius further includes: Determining a position of a second model grid space point in the controlled area where the ratio is greater than or equal to the first threshold and less than or equal to a second threshold, and a position of a third model grid space point where the ratio is greater than the second threshold; Setting the value of the transparent channel of the material template at the second model grid space point position according to the ratio corresponding to the second model grid space point position; and The value of the transparent channel of the material template at the third model grid space point position is set according to the original main color of the material template at the third model grid space point position.

7. The internal structure display method according to claim 1, wherein: The obtaining, based on the position information of each model grid space point and the position information of the control point, the difference distance corresponding to each model grid space point comprises: Converting the position information of each model grid space point and the position information of the control point into the same coordinate system; Calculating the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system to obtain a difference matrix; and According to the difference matrix, the difference distance corresponding to each model grid space point is obtained.

8. A device for displaying the internal structure of a virtual controlled object, comprising: an acquisition module, configured to acquire position information of a control point; a determination module configured to determine a controlled area of the virtual controlled object based on the position information of the control point; A display module is configured to obtain a difference distance corresponding to each model grid space point based on the position information of each model grid space point of the virtual controlled object and the position information of the control point; A control radius is obtained based on the position information of the control point; a transparency parameter of a material template corresponding to the controlled area is adjusted based on the ratio of the difference distance corresponding to each model grid space point to the control radius, and the virtual controlled object is rendered using the material template to display the internal structure of the controlled area.

9. A device for displaying the internal structure of a virtual controlled object, comprising: Memory; as well as A processor coupled to the memory, wherein the processor is configured to execute the internal structure display method of the virtual controlled object according to any one of claims 1 to 7 based on instructions stored in the memory.

10. A head-mounted display device, comprising: The internal structure display device of the virtual controlled object according to claim 8 or 9.

11. A computer-readable storage medium having computer program instructions stored thereon, wherein when the instructions are executed by a processor, the method for displaying the internal structure of a virtual controlled object according to any one of claims 1 to 7 is implemented.

12. A computer program product, comprising a computer program or instructions, wherein when the computer program or instructions are executed by a processor, the method for displaying the internal structure of a virtual controlled object according to any one of claims 1 to 7 is implemented.

Images