Internal structure display method and device of virtual controlled object and display equipment

Abstract

The invention provides an internal structure display method and device of a virtual controlled object and display equipment, and relates to the technical field of computers. The method comprises the following steps: acquiring position information of a control point; determining a controlled area of the virtual controlled object based on the position information of the control point; and adjusting the transparency corresponding to the controlled area based on the position information of the virtual controlled object and the position information of the control point so as to display the internal structure of the controlled area.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a method, an apparatus and a display device for displaying the internal structure of a virtual controlled object. Background Art

[0002] Virtual scenes usually display some complete 3D (Dimensional) models. Most models have complex internal structures. In order to have a deeper understanding of the product, users want to view the internal structure of the product model. For example, users want to view the internal structure of a refrigerator. In response to this demand, related technologies usually use methods such as model animation and displaying and hiding external structures to display the internal structure of the product model. Summary of the invention

[0003] A technical problem to be solved by the present disclosure is to provide a method, apparatus and display device for displaying the internal structure of a virtual controlled object, which can realize the internal structure display of the virtual controlled object without increasing the complexity and production cost of the model and improving the user interaction experience.

[0004] According to one aspect of the present disclosure, a method for displaying the internal structure of a virtual controlled object is proposed, comprising: obtaining position information of a control point; determining a controlled area of ​​the virtual controlled object based on the position information of the control point; and adjusting the transparency of the controlled area based on the position information of the virtual controlled object and the position information of the control point to display the internal structure of the controlled area.

[0005] In some embodiments, determining the controlled area of ​​the virtual controlled object based on the position information of the control point includes: obtaining a control radius based on the position information of the control point; and obtaining the controlled area based on the control radius.

[0006] In some embodiments, obtaining the control radius based on the position information of the control point includes: determining the depth information of the virtual control point corresponding to the control point in the virtual controlled object according to the position information of the control point; and determining the control radius according to the depth information of the virtual control point in the virtual controlled object.

[0007] In some embodiments, obtaining the position information of the control point includes: identifying whether the virtual controlled object and the virtual control point collide based on the first collision body of the virtual controlled object and the second collision body of the virtual control point corresponding to the control point; and obtaining the position information of the control point when it is determined that the virtual controlled object and the virtual control point collide.

[0008] In some embodiments, adjusting the transparency of the controlled area includes: adjusting the transparency parameter of the material template corresponding to the controlled area; and rendering the virtual controlled object using the material template.

[0009] In some embodiments, adjusting the transparency parameter of the material template corresponding to the controlled area includes: obtaining the difference distance corresponding to each model grid space point based on the position information of each model grid space point of the virtual controlled object and the position information of the control point; obtaining the control radius based on the position information of the control point; and adjusting the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius.

[0010] In some embodiments, based on the ratio of the difference distance corresponding to each model grid space point to the control radius, adjusting the transparency parameter of the material template corresponding to the controlled area includes: determining the position of the first model grid space point in the controlled area whose ratio is less than a first threshold; and setting the transparency parameter of the material template at the first model grid space point position to be greater than the transparency threshold.

[0011] In some embodiments, based on the ratio of the difference distance corresponding to each model grid space point to the control radius, adjusting the transparency parameter of the material template corresponding to the controlled area also includes: determining the position of a second model grid space point in the controlled area whose ratio is greater than or equal to the first threshold and less than or equal to the second threshold, and the position of a third model grid space point whose ratio is greater than the second threshold; setting the value of the transparent channel of the material template at the second model grid space point position according to the ratio corresponding to the second model grid space point position; and setting the value of the transparent channel of the material template at the third model grid space point position according to the original main color of the material template at the third model grid space point position.

[0012] In some embodiments, based on the position information of each model grid space point and the position information of the control point, obtaining the difference distance corresponding to each model grid space point includes: converting the position information of each model grid space point and the position information of the control point to the same coordinate system; calculating the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system to obtain a difference matrix; and obtaining the difference distance corresponding to each model grid space point according to the difference matrix.

[0013] According to another aspect of the present disclosure, a device for displaying the internal structure of a virtual controlled object is also proposed, comprising: an acquisition module configured to acquire position information of a control point; a determination module configured to determine a controlled area of ​​the virtual controlled object based on the position information of the control point; and a display module configured to adjust the transparency of the controlled area based on the position information of the virtual controlled object and the position information of the control point to display the internal structure of the controlled area.

[0014] According to another aspect of the present disclosure, a device for displaying the internal structure of a virtual controlled object is also proposed, comprising: a memory; and a processor coupled to the memory, wherein the processor is configured to execute the internal structure display method of the virtual controlled object as described above based on instructions stored in the memory.

[0015] According to another aspect of the present disclosure, a head-mounted display device is also provided, comprising: the internal structure display device of the virtual controlled object mentioned above.

[0016] According to another aspect of the present disclosure, a computer-readable storage medium is also provided, on which computer program instructions are stored, and when the instructions are executed by a processor, the internal structure display method of the virtual controlled object as described above is implemented.

[0017] According to another aspect of the present disclosure, a computer program product is also proposed, including a computer program or an instruction, and when the computer program or the instruction is executed by a processor, the internal structure display method of the virtual controlled object is implemented.

[0018] In the disclosed embodiment, the information of the control points is used to control the transparency of different areas of the virtual controlled object, so that the penetration effect of the controlled area of ​​the virtual controlled object can be achieved, thereby realizing the display of the internal structure of the controlled area. This embodiment can complete the interaction between the user and the virtual controlled object and disassemble and view the internal structure of the virtual controlled object without increasing the complexity and production cost of the model.

[0019] Other features and advantages of the present disclosure will become apparent from the following detailed description of exemplary embodiments of the present disclosure with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which constitute a part of the specification, illustrate embodiments of the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0021] The present disclosure may be more clearly understood from the following detailed description with reference to the accompanying drawings, in which:

[0022] Figure 1 It is a flowchart of some embodiments of the method for displaying the internal structure of a virtual controlled object disclosed in the present invention;

[0023] Figure 2 Schematic diagram of the flow chart of other embodiments of the method for displaying the internal structure of a virtual controlled object disclosed in the present invention;

[0024] Figure 3 Schematic diagram of default display effects of some virtual controlled objects disclosed in the present invention;

[0025] Figure 4 A schematic diagram of gesture interaction effects of some virtual controlled objects disclosed in the present invention;

[0026] Figure 5 Schematic diagram of default display effects of other virtual controlled objects disclosed in the present invention;

[0027] Figure 6 Schematic diagrams of gesture interaction effects of other virtual controlled objects disclosed in the present invention;

[0028] Figure 7 It is a structural schematic diagram of some embodiments of the internal structure display device of the virtual controlled object disclosed in the present invention;

[0029] Figure 8 Schematic diagrams of structures of other embodiments of the internal structure display device of the virtual controlled object disclosed in the present invention. DETAILED DESCRIPTION

[0030] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless otherwise specifically stated.

[0031] At the same time, it should be understood that for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0032] The following description of at least one exemplary embodiment is merely illustrative in nature and is in no way intended to limit the present disclosure, its application, or uses.

[0033] Technologies, methods, and equipment known to ordinary technicians in the relevant art may not be discussed in detail, but where appropriate, the technologies, methods, and equipment should be considered as part of the specification.

[0034] In all examples shown and discussed herein, any specific values ​​should be interpreted as merely exemplary and not as limiting. Therefore, other examples of the exemplary embodiments may have different values.

[0035] It should be noted that like reference numerals and letters refer to similar items in the following figures, and therefore, once an item is defined in one figure, it need not be further discussed in subsequent figures.

[0036] In order to make the objectives, technical solutions and advantages of the present disclosure more clearly understood, the present disclosure is further described in detail below in combination with specific embodiments and with reference to the accompanying drawings.

[0037] In the related art, the display of the internal structure of the product model is realized by model animation, which increases the model production cost on the one hand and the model complexity on the other hand, and requires the addition of control animation switches to achieve it. Although the display of the internal structure of the product model by showing and hiding the external structure can reduce the model production cost, the controlled area of ​​the visible and hidden object is usually large, and the interaction with the user is weak.

[0038] The present disclosure provides a solution for displaying the internal structure of a virtual controlled object, which can improve the interactivity between the virtual controlled object and the user when displaying the internal structure without increasing the model complexity and production cost.

[0039] Figure 1 This is a flowchart of some embodiments of the method for displaying the internal structure of a virtual controlled object disclosed in the present invention. The embodiment is executed by an internal structure display device of the virtual controlled object, and the internal structure display device is, for example, a head-mounted display device. The embodiment includes steps S11-S13.

[0040] In step S11, the position information of the control point is obtained.

[0041] The control point is, for example, a touch point of a gesture, or a touch point of a component that can achieve control, such as a touch point of a device such as a handle.

[0042] In some embodiments, the gesture touch point is photographed by an image acquisition device such as a camera, and the position information of the gesture touch point in the world coordinate system can be determined. The position information is three-dimensional coordinate information. For example, the two-dimensional coordinates of the gesture touch point are converted into three-dimensional space coordinates.

[0043] In step S12, based on the position information of the control point, the controlled area of ​​the virtual controlled object is determined.

[0044] In some embodiments, the virtual controlled object is a virtual product model, such as a model of a virtual product with an internal structure, such as a virtual oven, a virtual refrigerator, etc. The three-dimensional model of the virtual controlled object is established, which is not specifically limited in the present disclosure.

[0045] In some embodiments, based on the position information of the control point, a control radius is obtained; based on the control radius, a controlled area is obtained. The control radius is, for example, a radius in space, and the controlled area is a three-dimensional area. For example, a circular area corresponding to the control radius is the controlled area.

[0046] In step S13, based on the position information of the virtual controlled object and the position information of the control point, the transparency of the controlled area is adjusted to display the internal structure of the controlled area.

[0047] For example, the transparency of the controlled area is adjusted so that the controlled area of ​​the virtual controlled object has a penetrating effect, that is, the display of the internal structure of the controlled area of ​​the virtual controlled object is realized.

[0048] In the above embodiment, the transparency of different areas of the virtual controlled object is controlled by using the information of the control point, so that the penetration effect of the controlled area of ​​the virtual controlled object can be achieved, and then the internal structure of the controlled area can be displayed. This embodiment can complete the interaction between the user and the virtual controlled object without increasing the complexity and production cost of the model, disassemble and view the internal structure of the virtual controlled object, and improve the interactivity between the user and the virtual controlled object.

[0049] In some embodiments, transparent display of certain locations is achieved by adjusting the transparency parameters of the material template.

[0050] For example, the transparency parameter of the material template corresponding to the controlled area is adjusted, and the virtual controlled object is rendered using the material template to display the internal structure of the controlled area. The transparency parameter is the parameter of the transparent channel in the color parameter.

[0051] In some embodiments, a material template may be predefined, such as a material ball, which is used to express the presentation of a virtual object in a three-dimensional space. The material ball may implement functions such as material mapping, model grid space point transformation, and color resetting.

[0052] For example, the material ball can be used to implement the mapping of standard PBR (Physicallly-Based-Rendering) textures of virtual controlled objects, including baseColor, metal, rough, normal, ao (Ambient Occlusion), etc. First, the virtual controlled object is rendered according to the initialized material ball to implement the mapping of the basic material of the virtual controlled object, and then the transparency of different areas is dynamically controlled by resetting the color according to the position information of each model grid space point of the virtual controlled object and the position information of the control point.

[0053] In the above embodiment, by utilizing the position information of the control point and the material template of the virtual controlled object and adjusting the transparency parameter of the material template corresponding to the controlled area of ​​the virtual controlled object, the penetration effect of the controlled area can be achieved, thereby realizing the display of the internal structure of the controlled area. Without increasing the complexity and production cost of the model, the interactivity between the user and the virtual controlled object can be improved while displaying the internal structure of the virtual controlled object.

[0054] In some embodiments, based on the position information of the virtual controlled object and the position information of the control point, the transparency parameter of the material template corresponding to the controlled area can be adjusted by Figure 2 The embodiment shown implements. Figure 2 1 is a flow chart of other embodiments of the method for displaying the internal structure of a virtual controlled object disclosed in the present invention, including steps S131-S133.

[0055] In step S131, based on the position information of each model grid space point of the virtual controlled object and the position information of the control point, the difference distance corresponding to each model grid space point is obtained.

[0056] In some embodiments, the position information of each model grid space point and the position information of the control point are converted to the same coordinate system; the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system is calculated to obtain a difference matrix; and based on the difference matrix, the difference distance corresponding to each model grid space point is obtained.

[0057] For example, the position coordinates of each model grid space point in the model coordinate system, that is, the position coordinates in the virtual controlled object coordinate system, are converted to the position coordinates in the world coordinate system; the difference between the position coordinates of each model grid space point in the world coordinate system and the position coordinates of the control point in the world coordinate system is calculated to obtain a difference matrix; and according to the difference matrix, the difference distance corresponding to each model grid space point is obtained.

[0058] For example, based on the world matrix (worldMatrix), the position data of each model grid space point is transformed from the model coordinate system modelPosition to the world coordinate system in parallel. Then, the difference between the position coordinates of each model grid space point in the world coordinate system and the gesture position information point (touchpoint) is solved to obtain a difference matrix, and then the difference distance corresponding to each model grid space point is obtained. For example, the difference distance corresponding to each model grid space point is expressed as length(worldMatrix*modelPosition-touchPoint).

[0059] In step S132, the control radius is obtained based on the position information of the control point.

[0060] In some embodiments, the depth information of the virtual control point corresponding to the control point in the virtual controlled object is determined according to the position information of the control point; and the control radius is determined according to the depth information of the virtual control point in the virtual controlled object.

[0061] For example, the control radius of the gesture can be calculated based on the depth of the gesture in the virtual oven. For example, the three-dimensional bounding box of the virtual oven in the world coordinate system is first calculated, and then the distance relationship between the coordinates of the gesture touch point in the world coordinate system and the center point of the three-dimensional bounding box is calculated. Finally, the distance relationship is mapped to the depth information of the gesture in the virtual oven, and then the control radius of the gesture is obtained.

[0062] In step S133, based on the ratio of the difference distance corresponding to each model grid space point to the control radius, the transparency parameter of the material template corresponding to the controlled area is adjusted.

[0063] In some embodiments, the position of a first model grid space point in the controlled area whose ratio is less than a first threshold is determined; and the transparency parameter of the material template at the first model grid space point position is set to be greater than the transparency threshold. For example, the color parameter of the material ball is set to black and fully transparent, such as setting the parameters of the RGB (red, green, and blue) channel and the transparent channel of the material ball to 0.

[0064] For example, the first threshold is 0.9. Those skilled in the art should understand that the first threshold is set to 0.9 for example only, and can be set to other values ​​according to actual conditions, such as 0.8, 0.85, 0.95, etc. If the ratio of the difference distance corresponding to the model grid space point to the control radius is less than the first threshold, it means that the control radius of the gesture is not greater than the virtual controlled object. Therefore, the virtual controlled object is within the control range, and the transparency of the controlled area of ​​the virtual controlled object can be adjusted.

[0065] In some embodiments, a second model grid space point position in the controlled area whose ratio is greater than or equal to the first threshold and less than or equal to the second threshold, and a third model grid space point position whose ratio is greater than the second threshold are determined; the value of the transparent channel of the material template of the second model grid space point position is set according to the ratio corresponding to the second model grid space point position; and the value of the transparent channel of the material template of the third model grid space point position is set according to the original main color of the material template of the third model grid space point position.

[0066] The second threshold is set to 1, for example. Those skilled in the art should understand that the second threshold is set to 1 for example only, and can also be set to other values ​​according to actual conditions. In this embodiment, the second threshold is set so that a transition area can be set between displaying the internal structure and the outer surface of the object.

[0067] For example, if the calculated ratio is greater than or equal to 0.9 and less than or equal to 1, the value is set as the value of the alpha (transparency) channel of the material ball. In addition, the formula diffuseColor = blueColor*(1-alpha)+baseColor*alpha is used to calculate the main color diffuseColor of the material ball, where blueColor is the blue value and baseColor is the main color of the original PBR material of the virtual controlled object. That is, the main color of the material ball is calculated according to the value of the transparent channel.

[0068] If the calculated ratio is greater than 1, the main color baseColor of the original PBR material of the virtual controlled object is decomposed, for example, the corresponding RGB color is assigned to the basic color channel of the PBR material, and the value of the alpha channel of the original PBR material is assigned to the transparent channel of the PBR material ball.

[0069] In the above embodiment, the transparency of different areas can be dynamically controlled by adjusting the color parameters of the material template corresponding to the controlled area according to the ratio of the difference distance corresponding to each model grid space point to the control radius, thereby achieving the penetration effect of the virtual controlled object.

[0070] In some embodiments of the present disclosure, whether a collision occurs between the virtual controlled object and the virtual control point is identified based on a first collision body of the virtual controlled object and a second collision body of the virtual control point corresponding to the control point; if it is determined that a collision occurs between the virtual controlled object and the virtual control point, the position information of the control point is acquired.

[0071] For example, by loading a virtual scene and creating a collision body, you can monitor whether there is a collision between virtual objects, then load the initialized custom material ball, map the custom material ball to the virtual controlled object, and complete the mapping of the basic material of the virtual controlled object. If the virtual controlled object collides with the virtual control point, it means that the display of the internal structure of the virtual controlled object has been triggered by controlling the control point. By obtaining the position information of the control point, the depth information of the virtual control point in the virtual controlled object is determined, thereby obtaining the control radius and the controlled area. Based on the ratio of the difference distance corresponding to each model grid space point to the control radius, the color parameters of the material template corresponding to the controlled area are adjusted, and then the virtual controlled object is rendered using the material template to display the internal structure of the controlled area.

[0072] The following control point takes a gesture touch point as an example, and the virtual controlled object takes a cube model with a cylindrical internal structure as an example to introduce the above solution. This embodiment uses a custom material ball to view the internal structure of the cube model. The solution disclosed in this disclosure is suitable for immersive interactive experience scenarios such as head-mounted display devices.

[0073] First, design a custom material ball based on PBR. The material ball needs to implement functions such as material mapping, model grid space point transformation, and color reset.

[0074] After the gesture trigger starts, the two-dimensional coordinates of the gesture touch point are converted into the three-dimensional coordinates of the gesture, which are, for example, the three-dimensional coordinates in the world coordinate system, and interact with the custom material ball through gestures. According to the three-dimensional coordinates of the gesture, the depth information of the gesture in the cube model is calculated, and then the gesture control radius is calculated. The three-dimensional coordinates of the gesture and the control radius are passed to the custom material ball to perform the model grid space point transformation. The position data of each model grid space point is converted from the model coordinate system to the world coordinate system in parallel point by point, and then the difference is calculated with the three-dimensional coordinates of the gesture to obtain the difference matrix, and then the difference distance is calculated, and the difference distance is divided by the gesture control radius to obtain an intermediate temporary variable, which is, for example, a float type. According to the size of the intermediate temporary variable, the color of the material ball is reset according to the predetermined rules, that is, the color parameters of the PBR material are returned.

[0075] For example, if the intermediate temporary variable is less than 0.9, the values ​​of the four channels of the main color diffuseColor are set to (0, 0, 0, 0), that is, black and fully transparent. If the temporary intermediate variable is greater than or equal to 0.9, and less than or equal to 1, the value of the intermediate temporary variable is assigned to the alpha channel, and the value of the base color channel of the PBR material is calculated according to the formula blueColor*(1-alpha)+baseColor*alpha. If the temporary intermediate variable is greater than 1, the main color of the PBR material of the original model is decomposed, the corresponding RGB color is assigned to the base color channel of the PBR material, and the value of the alpha channel is assigned to the transparent channel of the PBR material ball. When the user's gesture is lifted, the control radius is reset, and the above process is repeated until the gesture trigger ends.

[0076] For example, the gesture interaction behavior is mapped to the custom material ball, and the interactive effect comparison is as follows: Figure 3 and Figure 4 shown. Figure 3 Schematic diagram of the default display effect of some virtual controlled objects disclosed in the present invention. Figure 4 The following is a schematic diagram of the gesture interaction effects of some virtual controlled objects disclosed in the present invention. Through the above process, the internal structure of the virtual controlled object can be disassembled and viewed.

[0077] In some embodiments, Figure 5 or Figure 6 As shown, Figure 5 Schematic diagram of the default display effect of other virtual controlled objects disclosed in the present invention. Figure 6Schematic diagram of gesture interaction effects of other virtual controlled objects disclosed in the present invention. After the user wears the head-mounted display device, the internal structure of the oven is triggered by gestures. The user touches the virtual oven through gestures, and according to the depth of the gesture in the virtual oven, the radius of the virtual oven in which the internal structure can be viewed is obtained to form a control area. By adjusting the transparency of the control area, the penetration effect of the control area is achieved, and the user can view the internal structure of the virtual oven.

[0078] Figure 7 Schematic diagram of the structure of some embodiments of the internal structure display device of the virtual controlled object disclosed in the present invention. The internal structure display device includes an acquisition module 710 , a determination module 720 , and a display module 730 .

[0079] The acquisition module 710 is configured to acquire the position information of the control point.

[0080] For example, the two-dimensional coordinates of the touch point of the control object are obtained through a camera, and then the two-dimensional coordinates are converted into position information in the world coordinate system.

[0081] The control object may be, for example, a gesture, or a control device such as a handle.

[0082] The determination module 720 is configured to determine a controlled area of ​​the virtual controlled object based on the position information of the control point.

[0083] In some embodiments, a control radius is obtained based on the position information of the control point, and a controlled area is obtained based on the control radius. For example, a circle corresponding to the control radius is used as the controlled area.

[0084] For example, the depth information of the virtual control point corresponding to the control point in the virtual controlled object is determined according to the position information of the control point; and the control radius is determined according to the depth information of the virtual control point in the virtual controlled object.

[0085] The display module 730 is configured to adjust the transparency of the controlled area based on the position information of each model grid space point of the virtual controlled object and the position information of the control point to display the internal structure of the controlled area.

[0086] In the above embodiment, the transparency of different areas of the virtual controlled object is controlled by using the information of the control point, so that the penetration effect of the controlled area of ​​the virtual controlled object can be achieved, and then the internal structure of the controlled area can be displayed. This embodiment can complete the interaction between the user and the virtual controlled object, disassemble and view the internal structure of the virtual controlled object, and improve the interactivity between the user and the virtual controlled object without increasing the complexity and production cost of the model.

[0087] In some embodiments, the display module 730 is configured to adjust the transparency parameter of the material template corresponding to the controlled area, and render the virtual controlled object using the material template.

[0088] In some embodiments, the display module 730 obtains the difference distance corresponding to each model grid space point based on the position information of each model grid space point and the position information of the control point; obtains the control radius based on the position information of the control point; and adjusts the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius. The transparency parameter is the parameter of the transparent channel in the color parameter.

[0089] For example, the position of the first model grid space point in the controlled area whose ratio is less than the first threshold is determined; and the transparency parameter of the material template of the first model grid space point position is set to be greater than the transparency threshold. For example, the material ball is set to be fully transparent, that is, the color parameter of the material ball is set to be fully transparent black.

[0090] For another example, determine the second model grid space point position in the controlled area whose ratio is greater than or equal to the first threshold and less than or equal to the second threshold, and the third model grid space point position whose ratio is greater than the second threshold; set the value of the transparent channel of the material template of the second model grid space point position according to the ratio corresponding to the second model grid space point position; and set the value of the transparent channel of the material template of the third model grid space point position according to the original main color of the material template of the third model grid space point position.

[0091] In some embodiments, the display module 730 is configured to convert the position information of each model grid space point and the position information of the control point into the same coordinate system, calculate the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system, obtain a difference matrix, and obtain the difference distance corresponding to each model grid space point based on the difference matrix.

[0092] For example, the position information of each model grid space point in the model coordinate system is converted into the position information in the world coordinate system; the difference between the position information of each model grid space point in the world coordinate system and the three-dimensional coordinates of the control point is calculated to obtain a difference matrix; and according to the difference matrix, the difference distance corresponding to each model grid space point is obtained.

[0093] In the above embodiment, by utilizing the position information of the control point and the material template of the virtual controlled object, by adjusting the transparency parameter of the material template corresponding to the controlled area of ​​the virtual controlled object, that is, controlling the transparency of different areas of the virtual controlled object, the penetration effect of the controlled area can be achieved, and then the display of the internal structure of the controlled area can be achieved. Without increasing the complexity and production cost of the model, the interactive experience of the user and the virtual controlled object can be improved while displaying the internal structure of the virtual controlled object.

[0094] In some embodiments, the internal structure display device also includes an initialization module (not shown in the drawings), which is configured to create a first collision body of the virtual controlled object and a second collision body of the virtual control point corresponding to the control point, and initialize a material template; wherein the acquisition module 710 is also configured to identify whether the virtual controlled object and the virtual control point collide based on the first collision body of the virtual controlled object and the second collision body of the virtual control point corresponding to the control point, and acquire the position information of the controlled object when it is determined that the virtual controlled object and the virtual control point collide.

[0095] Figure 8 Schematic diagram of the structure of some other embodiments of the internal structure display device of the virtual controlled object disclosed in the present invention, the internal structure display device includes a memory 810 and a processor 820. Wherein: the memory 810 can be a disk, a flash memory or any other non-volatile storage medium. The memory is used to store the instructions in the above embodiments. The processor 820 is coupled to the memory 810 and can be implemented as one or more integrated circuits, such as a microprocessor or a microcontroller. The processor 820 is used to execute the instructions stored in the memory.

[0096] In some embodiments, the processor 820 is coupled to the memory 810 via a BUS bus 830. The internal structure display device can also be connected to an external storage device 850 via a storage interface 840 to call external data, and can also be connected to a network or another computer system (not shown) via a network interface 860. No further detailed description will be given here.

[0097] In this embodiment, by storing data instructions in a memory and processing the instructions through a processor, the interactivity between the user and the virtual controlled object can be improved while displaying the internal structure of the virtual controlled object without increasing the complexity and production cost of the model.

[0098] In other embodiments of the present disclosure, a head-mounted display device is provided, which includes an internal structure display device of a virtual controlled object in the above-mentioned embodiment, so as to apply the solution to an immersive interactive experience scenario.

[0099] In other embodiments, a computer-readable storage medium stores computer program instructions, which implement the steps of the methods in the above-mentioned embodiments when executed by a processor. It should be understood by those skilled in the art that the embodiments of the present disclosure may be provided as methods, devices, or computer program products. Therefore, the present disclosure may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Moreover, the present disclosure may take the form of a computer program product implemented on one or more computer-usable non-transient storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program codes.

[0100] In some embodiments, a computer program product is protected, including a computer program or an instruction, which implements the above-mentioned driving strategy determination method or driving control method when executed by a processor. The computer program product includes a computer program carried on a computer-readable medium, and the computer program contains program code for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication device, or installed from a storage device, or installed from a ROM. When the computer program is executed by the CPU, the above-mentioned functions defined in the method of the embodiment of the present disclosure are executed.

[0101] The present disclosure is described with reference to flowcharts and / or block diagrams of methods, devices (systems) and computer program products according to embodiments of the present disclosure. It should be understood that each process and / or block in the flowchart and / or block diagram and the combination of processes and / or blocks in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, an embedded processor or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device generate instructions for implementing the processes in the flowchart and / or block diagram. Figure 1 A process or multiple processes and / or boxes Figure 1 A device that provides the functions specified in a block or multiple blocks.

[0102] These computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to operate in a specific manner, so that the instructions stored in the computer-readable memory produce an article of manufacture comprising an instruction device, which implements the process Figure 1 A process or multiple processes and / or boxes Figure 1 A function specified in one or more boxes.

[0103] These computer program instructions can also be loaded onto a computer or other programmable data processing device so that a series of operating steps are executed on the computer or other programmable device to produce a computer-implemented process, thereby providing instructions for implementing the process. Figure 1 A process or multiple processes and / or boxes Figure 1 The steps for the functions specified in one or more boxes.

[0104] In the technical solution disclosed in this disclosure, the collection, collection, update, analysis, processing, use, transmission, storage and other aspects of user personal information involved are in compliance with the provisions of relevant laws and regulations, are used for legitimate purposes, and do not violate public order and good morals. Necessary measures are taken for user personal information to prevent illegal access to user personal information data and maintain the security of user personal information, network security and national security.

[0105] So far, the present disclosure has been described in detail. In order to avoid obscuring the concept of the present disclosure, some details known in the art are not described. Based on the above description, those skilled in the art can fully understand how to implement the technical solution disclosed here.

[0106] The method and apparatus of the present disclosure may be implemented in many ways. For example, the method and apparatus of the present disclosure may be implemented by software, hardware, firmware, or any combination of software, hardware, and firmware. The above order of steps for the method is for illustration only, and the steps of the method of the present disclosure are not limited to the order specifically described above, unless otherwise specifically stated. In addition, in some embodiments, the present disclosure may also be implemented as a program recorded in a recording medium, which includes machine-readable instructions for implementing the method according to the present disclosure. Therefore, the present disclosure also covers a recording medium storing a program for executing the method according to the present disclosure.

[0107] Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims

1. A method for displaying the internal structure of a virtual controlled object, comprising: Get the location information of the control point; Determining a controlled area of ​​the virtual controlled object based on the position information of the control point; as well as Based on the position information of the virtual controlled object and the position information of the control point, the transparency of the controlled area is adjusted to display the internal structure of the controlled area.

2. The internal structure display method according to claim 1, wherein: The determining the controlled area of ​​the virtual controlled object based on the position information of the control point comprises: Based on the position information of the control point, a control radius is obtained; and Based on the control radius, the controlled area is obtained.

3. The internal structure display method according to claim 2, wherein: The obtaining of the control radius based on the position information of the control point comprises: Determining depth information of a virtual control point corresponding to the control point in the virtual controlled object according to the position information of the control point; and The control radius is determined according to depth information of the virtual control point in the virtual controlled object.

4. The internal structure display method according to claim 1, wherein: The obtaining of the position information of the control point comprises: identifying whether a collision occurs between the virtual controlled object and the virtual control point according to a first collision body of the virtual controlled object and a second collision body of the virtual control point corresponding to the control point; and When it is determined that the virtual controlled object collides with the virtual control point, position information of the control point is acquired.

5. The internal structure display method according to any one of claims 1 to 4, wherein: The adjusting the transparency of the controlled area comprises: Adjusting the transparency parameter of the material template corresponding to the controlled area; and The virtual controlled object is rendered using the material template.

6. The internal structure display method according to claim 5, wherein: The step of adjusting the transparency parameter of the material template corresponding to the controlled area includes: Based on the position information of each model grid space point of the virtual controlled object and the position information of the control point, obtaining the difference distance corresponding to each model grid space point; Based on the position information of the control point, a control radius is obtained; and Based on the ratio of the difference distance corresponding to each model grid space point to the control radius, the transparency parameter of the material template corresponding to the controlled area is adjusted.

7. The internal structure display method according to claim 6, wherein: The adjusting the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius comprises: Determine a first model grid space point position in the controlled area where the ratio is less than a first threshold; and The transparency parameter of the material template at the position of the first model grid space point is set to be greater than a transparency threshold.

8. The internal structure display method according to claim 7, wherein: The adjusting the transparency parameter of the material template corresponding to the controlled area based on the ratio of the difference distance corresponding to each model grid space point to the control radius also includes: Determine a second model grid space point position in the controlled area where the ratio is greater than or equal to the first threshold and less than or equal to a second threshold, and a third model grid space point position where the ratio is greater than the second threshold; According to the ratio corresponding to the second model grid space point position, setting the value of the transparent channel of the material template at the second model grid space point position; and According to the original main color of the material template at the third model grid space point position, the value of the transparent channel of the material template at the third model grid space point position is set.

9. The internal structure display method according to claim 6, wherein: The obtaining, based on the position information of each model grid space point and the position information of the control point, the difference distance corresponding to each model grid space point comprises: Convert the position information of each model grid space point and the position information of the control point into the same coordinate system; Calculating the difference between the coordinate position of each model grid space point and the coordinate position of the control point in the same coordinate system to obtain a difference matrix; and According to the difference matrix, the difference distance corresponding to each model grid space point is obtained.

10. A device for displaying the internal structure of a virtual controlled object, comprising: An acquisition module, configured to acquire position information of a control point; a determination module, configured to determine a controlled area of ​​the virtual controlled object based on the position information of the control point; The display module is configured to adjust the transparency of the controlled area based on the position information of the virtual controlled object and the position information of the control point to display the internal structure of the controlled area.

11. A device for displaying the internal structure of a virtual controlled object, comprising: Memory; as well as A processor coupled to the memory, the processor being configured to execute the internal structure display method of the virtual controlled object according to any one of claims 1 to 9 based on instructions stored in the memory.

12. A head mounted display device, comprising: The internal structure display device of the virtual controlled object as claimed in claim 10 or 11.

13. A computer-readable storage medium having computer program instructions stored thereon, wherein when the instructions are executed by a processor, the internal structure display method of a virtual controlled object as claimed in any one of claims 1 to 9 is implemented.

14. A computer program product, comprising a computer program or an instruction, wherein when the computer program or the instruction is executed by a processor, the method for displaying the internal structure of a virtual controlled object according to any one of claims 1 to 9 is implemented.

Images