Virtual object display method, electronic equipment and storage medium

Abstract

The invention relates to a virtual object display method, electronic equipment and a storage medium, and the method comprises the steps: reading the space information of a display screen under the condition that a virtual object is displayed on the display screen of folding equipment; cutting the virtual object according to the spatial information of the display screen to obtain profile information of the virtual object; and displaying the profile information through one or more display screens of the folding equipment. In this way, the internal structure information of the virtual object is displayed, a user can know the virtual object from different angles in a more detailed mode, interactivity is improved, and user experience is improved.

Description

Technical Field

[0001] The present application relates to the field of augmented reality technology, and in particular to a virtual object display method, electronic device and storage medium. Background Art

[0002] With the rapid development of augmented reality technology and foldable mobile phone technology, more and more users are seeking to experience more realistic, three-dimensional and interactive three-dimensional virtual environments in order to obtain a more immersive three-dimensional interactive experience.

[0003] In the prior art, users generally adjust their own angles or the angles of virtual objects through handheld or head-mounted display devices, or other wearable devices, to achieve three-dimensional interaction with virtual objects. However, this three-dimensional interaction method is mainly to restore the overall appearance of virtual objects in space. The displayed content is very simple and the interaction is insufficient, which makes it impossible for users to understand virtual objects in more detail, affecting user experience. Summary of the invention

[0004] The present application provides a virtual object display method, electronic device and storage medium, so as to at least solve the technical problems of the existing three-dimensional interactive mode such as single display and insufficient interaction.

[0005] In a first aspect, the present application provides a method for displaying a virtual object, the method comprising: when displaying a virtual object on a display screen of a folding device, reading spatial information of the display screen; cutting the virtual object according to the spatial information of the display screen to obtain cross-sectional information of the virtual object; and displaying the cross-sectional information through one or more display screens of the folding device.

[0006] In a second aspect, the present application provides an electronic device, comprising: a processor and a memory, wherein the processor is used to execute a program for displaying a virtual object stored in the memory to implement the virtual object display method described in any one of the first aspects.

[0007] In a third aspect, the present application provides a storage medium storing one or more programs, and the one or more programs can be executed by one or more processors to implement the virtual object display method described in any one of the first aspects.

[0008] The technical solution provided by the present application reads the spatial information of the display screen when displaying a virtual object on the display screen of a folding device, cuts the virtual object according to the spatial information of the display screen, obtains the cross-sectional information of the virtual object, and displays the cross-sectional information through one or more display screens of the folding device. It is possible to cut the virtual object at different angles and display the cross-sectional information of the virtual object, thereby displaying the internal structure information of the virtual object, so that the user can understand the virtual object in more detail from different angles, increase interactivity, and improve user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0010] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0011] One or more embodiments are exemplarily described by pictures in the corresponding drawings, and these exemplified descriptions do not constitute limitations on the embodiments. Elements with the same reference numerals in the drawings represent similar elements, and unless otherwise stated, the figures in the drawings do not constitute proportional limitations.

[0012] Figure 1 A flowchart of an embodiment of a virtual object display method provided in an embodiment of the present application;

[0013] Figure 2 A schematic diagram of a virtual object being cut by a folded display screen provided in an embodiment of the present application;

[0014] Figure 3 A flowchart of another method for displaying a virtual object provided in an embodiment of the present application;

[0015] Figure 4 A schematic diagram of establishing a rectangular coordinate system provided in an embodiment of the present application;

[0016] Figure 5 A flowchart of another embodiment of a virtual object display method provided in an embodiment of the present application;

[0017] Figure 6 A schematic diagram of a wearable device cutting a virtual object provided in an embodiment of the present application;

[0018] Figure 7A block diagram of an embodiment of a virtual object display device provided in an embodiment of the present application;

[0019] Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0020] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0021] The disclosure below provides many different embodiments or examples to implement different structures of the present invention. In order to simplify the disclosure of the present invention, the parts and settings of specific examples are described below. Of course, they are only examples, and the purpose is not to limit the present invention. In addition, the present invention can repeat reference numbers and / or letters in different examples. This repetition is for the purpose of simplification and clarity, and does not itself indicate the relationship between the various embodiments and / or settings discussed.

[0022] In order to at least solve the technical problems in the prior art that the three-dimensional interaction method is mainly for restoring the overall appearance of the virtual object in space, the displayed content is very simple, and the interaction is insufficient, the present application provides a virtual object display method, which can cut the virtual object and display the cross-sectional information of the virtual object, thereby realizing the display of the internal structure information of the virtual object, so that the user can understand the virtual object in more detail, increase interactivity, and enhance the user experience.

[0023] Figure 1 The following is a flowchart of a method for displaying a virtual object provided in an embodiment of the present application. Figure 1 As shown, the process may include the following steps:

[0024] Step 101: When a virtual object is displayed on a display screen of a foldable device, read spatial information of the display screen.

[0025] The above-mentioned spatial information refers to the spatial parameters related to the display screen. For example, when the display screen is folded, the spatial information may be the folding angle of the folded display screen, or the position information of the display screen relative to the reference coordinate system, or the relative position information between the display screen and the virtual object.

[0026] The above-mentioned foldable device refers to a device whose display screen can be folded, which can be a foldable mobile phone, a foldable tablet, etc.

[0027] The above-mentioned virtual objects refer to virtual objects formed by AR (Augmented Reality) technology, which may include images, videos, texts, three-dimensional models, etc.

[0028] In the present application, the executing entity of the present application may be the above-mentioned folding device, in which an AR application may be installed, and users may share virtual objects on the folding screen through the AR application in the folding device, so that users may interact with the virtual objects more intuitively.

[0029] In one embodiment, the foldable device may store the virtual object in advance. Based on this, when it is determined to display the virtual object, the virtual object may be displayed on the foldable screen of the foldable device through the installed AR application.

[0030] In another embodiment, the folding device can be connected to a three-dimensional scanning device, such as a three-dimensional scanner, and the folding device can scan objects in the real world through the three-dimensional scanning device, thereby generating corresponding virtual objects according to the scanning results. Afterwards, the virtual object can be displayed on the display screen of the folding device through the installed AR application.

[0031] In the present application, the folding device may include two display screens, and the virtual object may be displayed on any one of the display screens or on both display screens, which is not limited in the embodiment of the present invention.

[0032] In an exemplary embodiment, the foldable device may display virtual objects on the two display screens.

[0033] In one embodiment, when determining that a virtual object is displayed on a display screen of a foldable device, the execution subject of the present application may read spatial information of the display screen.

[0034] As an implementation in an exemplary embodiment, the spatial information of the display screen can be read directly by reading a file for recording display screen parameters in the folding device.

[0035] As another implementation in an exemplary embodiment, the spatial information of the display screen may be determined with the aid of a third-party device.

[0036] As another implementation in an exemplary embodiment, when the above-mentioned spatial information includes multiple spatial parameters, after determining one of the spatial parameters (such as the folding angle of the folded display screen), other spatial parameters (such as the cross-sectional model of the folded display screen) can be determined based on the spatial parameter.

[0037] Step 102: Cut the virtual object according to the spatial information of the display screen to obtain cross-sectional information of the virtual object.

[0038] The above-mentioned cross-section information refers to information parameters related to the cross-section formed after the virtual object is cut, which may include shape information of the cross-section, surface structure information, etc.

[0039] In the present application, the displayed virtual object can be cut according to the spatial information of the display screen of the folding device to obtain a cross-section of the virtual object and cross-sectional information of the cross-section, so that the user can not only understand the overall information of the virtual object, but also understand the internal structure information of the virtual object in more detail.

[0040] In an exemplary embodiment, the folding device may include two display screens, and the user may fold the display screens so that the plane where the folded display screens are located can form an intersection with the virtual object, and the intersection can be used as a cross section of the virtual object, thereby realizing cutting of the virtual object. Figure 2 , which is a schematic diagram of a folded display cutting a virtual object provided by an embodiment of the present application. As shown in the figure, the intersection line between the folded display and the virtual object, that is, the black ring where the sphere intersects with the bent part of the screen, will intersect the plane where the folded display is located and the virtual object at different positions with different bending angles.

[0041] As a possible implementation, the user can fold one of the display screens and cut the virtual object at different levels by folding it at different angles, wherein each folding can obtain a cross section of the virtual object.

[0042] As another possible implementation, the user can fold the two display screens of the folding device to cut the virtual object from different angles at the same time, wherein two cross-sections of the virtual object can be obtained each time the display screens are folded.

[0043] Furthermore, in order to prevent cutting errors due to inaccurate folding angles when cutting virtual objects through the folded display screen, repeated folding is required, thereby reducing the service life of the folding screen, in the present application, after the virtual object is cut through the folded display screen, the virtual object can be subsequently cut through a connected wearable device in conjunction with the folded display screen to reduce the folding frequency, thereby extending the service life of the display screen.

[0044] As for how to cut the virtual object according to the spatial information of the folded display screen and determine the cross-sectional information of the virtual object, and how to cut the virtual object through the wearable device and the folded display screen and determine the cross-sectional information, it can be respectively described below. Figure 3 and Figure 5 The process shown is explained and will not be described in detail here.

[0045] Step 103: Display the cross-sectional information through one or more display screens of the foldable device.

[0046] In the present application, after the virtual object is cut through the folded display screen and the cross-sectional information of the virtual object is obtained, the corresponding cross-sectional information can be displayed through one or more display screens of the folding device, so that the user can understand the cross-sectional information of the virtual object more intuitively and in detail.

[0047] As a possible implementation manner, if both display screens of the folding device are folded, and the virtual object is cut through the two folded display screens of the folding device, cross-sectional information obtained by cutting the folded display screens may be displayed on each folded display screen.

[0048] As another possible implementation, if one of the display screens of the folding device is folded, and the virtual object is cut through the folded display screen, cross-sectional information of the virtual object may be displayed on the folded display screen.

[0049] In one embodiment, in order to achieve the effect of switching between upper and lower levels on the mobile phone screen, generate three-dimensional space application information, increase the playability, display space and display depth of the mobile phone, the execution subject of this application can obtain the application information corresponding to the folding device and map the application information on the above virtual object.

[0050] Based on this, when the executor of the present application displays the cross-sectional information of a virtual object through one or more display screens of a folding device, it can display the above cross-sectional information through one or more display screens of the folding device based on the application information mapped on the virtual object.

[0051] The technical solution provided by the present application reads the spatial information of the display screen when displaying a virtual object on the display screen of a folding device, cuts the virtual object according to the spatial information of the display screen, obtains the cross-sectional information of the virtual object, and displays the cross-sectional information through one or more display screens of the folding device. This technical solution, by utilizing the folding feature of the folding device, folds the display screen of the folding device to cut the virtual object according to the spatial information of the display screen, obtains the cross-sectional information of the virtual object, realizes cutting of the virtual object at different angles, displays the cross-sectional information of the virtual object, and thus realizes displaying the internal structure information of the virtual object, so that the user can understand the virtual object in more detail from different angles, increases interactivity, and improves user experience.

[0052] See also Figure 3 , which is a flow chart of another embodiment of a virtual object display method provided in an embodiment of the present application. Figure 3 The process shown in Figure 1Based on the process shown, it is described how to cut the virtual object according to the spatial information of the display screen to obtain the cross-sectional information of the virtual object when it is detected that the display screen of the folding device is in the folded state. Figure 3 As shown, the process may include the following steps:

[0053] Step 301: Display a virtual object on the display screen of the folding device, and when it is detected that the display screen of the folding device is in a folded state, read the folding angle of the folded display screen.

[0054] Step 302: Determine a first cross-sectional model corresponding to the folded display screen according to the folding angle of the folded display screen.

[0055] The following is a unified description of step 301 and step 302:

[0056] The above-mentioned folding angle refers to the angle at which the folded display screen is folded on the folding device.

[0057] The above-mentioned first cross-sectional model refers to the model corresponding to the plane where the folded display screen is located, which can be an equation or a model expression, and the embodiment of the present application does not limit this.

[0058] In the present application, when it is detected that a virtual object is displayed on the display screen of the folding device and the display screen of the folding device is in a folded state, the folding angle of the folded display screen can be determined as the spatial information of the folded display screen.

[0059] Based on this, the executive body of the present application can read the folding angle of the folded display screen.

[0060] As a possible implementation manner, the folding angle of the folded display screen may be determined by reading parameter information about the folding display screen in the folding device.

[0061] As another possible implementation manner, the folding angle of the folded display screen may be measured by a third-party device.

[0062] In the present application, after the folding angle of the folded display screen is determined, in order to allow the plane where the folded display screen is located to cut the virtual object, a first cross-sectional model corresponding to the folded display screen may be determined according to the folding angle of the folded display screen.

[0063] In one embodiment, when a display screen of the folding device is folded, a rectangular coordinate system may be established based on the unfolded display screen as a reference plane, and position information corresponding to the folded display screen may be determined based on the rectangular coordinate system and the folding angle (hereinafter referred to as "first position information" for ease of description). The first position information here refers to the position information of the folded display screen in the rectangular coordinate system, such as the coordinates of any point of the folded display screen in the rectangular coordinate system.

[0064] Afterwards, a first cross-sectional model corresponding to the folded display screen may be determined according to the first position information.

[0065] In an exemplary embodiment, the midpoint of the folding line of the two display screens of the foldable mobile phone is used as the origin, and the plane where the unfolded display screen is located is used as the reference plane, that is, the plane where the x-axis and y-axis in the rectangular coordinate system are located, to establish a rectangular coordinate system. Figure 4 , which is a schematic diagram of establishing a rectangular coordinate system provided by an embodiment of the present application. Afterwards, the coordinates of any point on the plane where the folded display screen is located, as well as the normal vector of the plane, are determined, and the equation expression of the plane is determined by using the principle that the line connecting any point and the origin is perpendicular to the normal vector, and the expression has multiple unknowns.

[0066] Afterwards, the direction cosines of the normal vector direction can be determined based on the folding angle, and based on this, the unknowns in the above equation expression can be solved to obtain the equation expression of the plane where the folded display screen is located.

[0067] For example, first, find a vector perpendicular to the plane where the folded display screen is located, and this vector is the normal vector of the plane. The normal vector is n = (A, B, C), where A, B, and C are not all zero.

[0068] Then, using the property that the line connecting any point P(x, y, z) on the plane and the origin O(0, 0, 0) is perpendicular to the normal vector, we can obtain the point normal equation of the plane: A(x-0)+B(y-0)+C(z-0)=0, that is, Ax+By+Cz=0.

[0069] Finally, according to the above folded angle, determine the direction cosine of the normal vector. Assume that the angle between the above plane and the x-axis is α, that is, the folding angle of the folded display is α, then cosα=frac{A}{sqrt{A^{2}+B^{2}+C^{2}}}. Similarly, suppose that the angles between the plane where the folded display is located and the y-axis and z-axis are β and γ respectively, then cosβ=frac{B}{sqrt{A^{2}+B^{2}+C^{2}}} and cosγ=frac{C}{sqrt{A^{2}+B^{2}+C^{2}}}. From this, the values ​​of A, B, and C can be solved, and the equation of the plane can be obtained by substituting Ax+By+Cz=0.

[0070] Finally, it can be obtained from the calculation that when the folding angle of the folded display screen is α, the cross-sectional equation of the folded display screen (that is, the first cross-sectional model) is: cos(α)x+sin(α)z=0.

[0071] In another embodiment, when the two display screens of the folding device are folded, the two display screens before folding can be used as reference planes to establish a rectangular coordinate system (for example, Figure 4 The rectangular coordinate system established as shown in the figure) is used, and according to the rectangular coordinate system and the folding angle of each folded display screen, the position information corresponding to each folded display screen (hereinafter referred to as the fourth position information for the convenience of description) is determined. The fourth position information here refers to the position information of each folded display screen in the rectangular coordinate system, for example, the coordinates of any point of each folded display screen in the rectangular coordinate system.

[0072] Afterwards, the first cross-sectional model corresponding to each folded display screen may be determined according to the fourth position information.

[0073] As for how to determine the first cross-sectional model corresponding to each folded display screen, reference may be made to the above-mentioned process of determining the first cross-sectional model of the folded display screen when a display screen of the folding device is folded.

[0074] Step 303: Determine first page information of a first intersection surface between the folded display screen and the virtual object according to the first cross-sectional model of the folded display screen.

[0075] Step 304: determine the first page information as the cross-section information of the virtual object.

[0076] The following is a unified description of step 303 and step 304:

[0077] The first intersection plane refers to a plane where the folded display screen intersects with the virtual object.

[0078] Correspondingly, the first page information refers to the page information corresponding to the first intersection surface, which may include but is not limited to the plane shape and plane structure information of the first intersection surface.

[0079] In the present application, the folding device may include two display screens, and the user may fold at least one of the display screens so that the plane where the folded display screen is located can form an intersection with the virtual object (hereinafter referred to as the "first intersection surface" for ease of description), and use the first intersection surface as a cross section of the virtual object, thereby realizing cutting of the virtual object. Afterwards, the page information of the first intersection surface may be determined (hereinafter referred to as the "first page information" for ease of description), and the first page information may be determined as the cross section information of the virtual object.

[0080] In an exemplary embodiment, it can be seen from the above step description that when determining the first cross-sectional model corresponding to the folded display screen, a rectangular coordinate system can be established and determined based on the position information of the folded display screen in the rectangular coordinate system.

[0081] Based on this, when determining the first page information of the first intersection surface of the folded display screen and the virtual object, the position information of the virtual object in the rectangular coordinate system (hereinafter referred to as the second position information for ease of description) can be determined.

[0082] Afterwards, a first three-dimensional model corresponding to the virtual object may be constructed according to the second position information. The first three-dimensional model here refers to a model that approximately represents the virtual object, such as a triangular mesh model.

[0083] Based on this, the executing entity of the embodiment of the present application can determine the first page information of the first intersection surface of the folded display screen and the virtual object according to the above-mentioned first cross-sectional model and the first three-dimensional model, and determine the first page information as the cross-sectional information of the virtual object.

[0084] In an exemplary embodiment, the first page information of the first intersection surface can be determined in the following manner: first, based on the above-mentioned first cross-sectional model and the first stereoscopic model, an expression of the first intersection surface between the folded display screen and the virtual object (hereinafter referred to as the first expression for ease of description) can be determined. The first expression can be used to represent the coordinates of the first intersection surface between the folded display screen and the virtual object in an established rectangular coordinate system.

[0085] Afterwards, a plurality of intersection points between the folded display screen and the virtual object may be determined according to the first expression, and the plurality of intersection points may be critical points of a first intersection surface between the folded display screen and the virtual object.

[0086] Based on this, shape information of the first intersection surface between the folded display screen and the virtual object (hereinafter referred to as first shape information for ease of description) can be determined based on multiple intersection points. At this time, the first shape information of the first intersection surface can be used to characterize the shape of the first intersection surface, but at this time the entire plane is covered by the model surface of the first three-dimensional model. For example, if the first three-dimensional model corresponding to the virtual object is a triangular mesh model, then at this time the first intersection surface is all triangles.

[0087] Therefore, the executing entity of the embodiment of the present application can remove the model surface corresponding to the first intersecting surface in the above-mentioned first three-dimensional model, so as to obtain the plane structure information corresponding to the first intersecting surface. Since the first intersecting surface belongs to any plane of the virtual object, the plane structure information of the first intersecting surface can represent the internal structure information of the virtual object.

[0088] Finally, the first shape information and the first plane structure information may be determined as the first page information of the first intersection surface.

[0089] For example, taking the first three-dimensional model mentioned above as a triangular mesh model, assume that the surface of the virtual object is composed of n triangles, each triangle is determined by three vertices P_i, Q_i, R_i (i=1, 2,..., n), and the plane corresponding to the folded display screen is determined by the equation ax+by+cz+d=0, where (a, b, c) is the normal vector of the plane, and d is a constant.

[0090] In an exemplary embodiment, for each triangle, suppose that the ray L_i starts from any point on the plane and is emitted along the direction of the normal vector of the plane, that is, L_i(t)=(x_0, y_0, z_0)+t(a, b, c), where t is a parameter, (x_0, y_0, z_0) is any point on the plane, which can be obtained by substituting into the plane equation.

[0091] After that, find the intersection point S_i of the ray L_i and the triangle P_iQ_iR_i. If it exists, it can be calculated by the following formula:

[0092] Suppose the edge vector of the triangle is u_i=Q_i-P_i, vi_i=R_i-P_i, and the direction vector of the ray is w=(a, b, c), then S_i=P_i+s u_i+t v_i=L_i(r)=(x_0,y_0,z_0)+rw, where s, t, r are unknowns.

[0093] After that, substituting the coordinates of S_i into the above equation, we can get a system of linear equations: [u_i v_i-w][str]^T=(x_0, y_0, z_0)-P_i, where [u_i v_i-w] is a 3x3 matrix and [str]^T is a 3x1 column vector.

[0094] After that, by solving this linear equation system, we can get the values ​​of s, t, and r. If this matrix is ​​singular, that is, the determinant is zero, it means that the ray is parallel or coplanar with the triangle and there is no intersection; if s, t, and r are all non-negative numbers and s+t<=1, it means that the intersection S_i is inside the triangle; otherwise, it means that the intersection is outside the triangle or does not exist.

[0095] After that, all the intersection points S_i inside the triangle are collected, and these points constitute the boundary points of the cross section, that is, the intersection points of the folded display screen and the AR object. Some algorithms can be used to connect these points to form one or more closed polygons, such as convex hull algorithm or alpha-shape algorithm.

[0096] Afterwards, the first intersecting surface can be represented by the following first expression: suppose the cross section is composed of m polygons, each polygon is composed of k_j (j=1,2,...,m) vertices, and the vertices are arranged in a counterclockwise direction as V_{j1}, V_{j2},..., V_{jk_j} (j=1,2,...,m), then the first shape information = {polygon_1, polygon_2,..., polygon_m}, polygon_j = {V_{j1}, V_{j2},..., V_{jk_j}} (j=1,2,...,m), V_{ji} = (x_{ji}, y_{ji}, z_{ji}) (i = 1,2,..., k_j; j = 1,2,..., m).

[0097] Finally, the triangular face of the object model on one side of the screen may be removed according to the normal direction of the intersecting first intersection surface, so as to display the object structure in the cross section after being cut, that is, the first plane structure information.

[0098] Step 305: Display the above-mentioned cross-sectional information through the folded display screen of the folding device.

[0099] In the present application, in order to facilitate users to understand the cross-sectional information of the above-mentioned virtual object being cut more intuitively and clearly, the executing entity of the present application can map the above-mentioned cross-sectional page information on the corresponding folded display screen for display, that is, the cross-sectional information is obtained by cutting the virtual object by the first display screen, and then the cross-sectional information is mapped on the first display screen for display.

[0100] In addition, before displaying the above-mentioned cross-sectional information through one or more display screens of the folding device, the executing entity of the embodiment of the present application may obtain application information of the folding device and map the application information on the virtual object.

[0101] Based on this, the execution subject of the embodiment of the present application can display the following contents including but not limited to: the internal structure information of the virtual object, the page information where the virtual object is cut, and the application information of the folding device through one or more display screens of the folding device. The above internal structure information includes the first plane structure information, and the above page information includes the first shape information.

[0102] The technical solution provided by the present application is to display a virtual object on the display screen of a folding device, and when it is detected that the display screen of the folding device is in a folded state, read the folding angle of the folded display screen, determine the first cross-sectional model corresponding to the folded display screen according to the folding angle of the folded display screen, determine the first page information of the first intersection surface between the folded display screen and the virtual object according to the first cross-sectional model of the folded display screen, determine the first page information as the cross-sectional information of the virtual object, and display the above cross-sectional information through the folded display screen of the folding device. This technical solution, by folding at least one display screen of the folding device so that the folded display screen and the virtual object form an intersection surface, thereby realizing cutting of the virtual object, and displaying the shape and structural information of the intersection surface, enables users to freely cut virtual objects, and displays the internal structural information of virtual objects, so that users can understand virtual objects from different angles in more detail, thereby improving user experience.

[0103] See also Figure 5 , which is a flow chart of another embodiment of a virtual object display method provided in an embodiment of the present application. Figure 5 The process shown in Figure 3 Based on the process shown in FIG, this paper describes how to use wearable devices to cut virtual objects. Figure 5 As shown, the process may include the following steps:

[0104] Step 501: Display a virtual object on the display screen of the folding device, and when it is detected that the display screen of the folding device is in a folded state, read the folding angle of the folded display screen.

[0105] Step 502: Determine a first cross-sectional model corresponding to the folded display screen according to the folding angle of the folded display screen.

[0106] The detailed description of step 501 and step 502 can refer to the description of step 301 and step 302, which will not be repeated here.

[0107] Step 503: When the wearable device is detected to be moving, the movement data of the wearable device is obtained.

[0108] The wearable device may be a wearable device connected to the foldable device, which may be a watch, earphones, AR glasses, or AR helmet, etc., and this application does not limit this. The connection between the foldable device and the wearable device may be a Bluetooth connection or an electrical connection, and this application does not limit this.

[0109] The above-mentioned movement data refers to the movement data of the wearable device relative to the folding device, which may include but is not limited to the movement distance, movement direction, etc.

[0110] In the present application, when the folding device detects that the wearable device connected to it moves, the movement data of the wearable device can be obtained.

[0111] As an implementation in an exemplary embodiment, the folding device can obtain the movement data of the wearable device in real time.

[0112] As another implementation in an exemplary embodiment, the foldable device may periodically obtain movement data of the wearable device.

[0113] As another implementation in an exemplary embodiment, the folding device may obtain movement data of the wearable device after detecting that the wearable device stops moving.

[0114] Step 504: Determine second page information of a second intersection surface between the folded display screen and the virtual object according to the first cross-sectional model and the movement data.

[0115] Step 505: Determine the second page information as the cross-section information of the virtual object.

[0116] The following is a unified description of step 504 and step 505:

[0117] Depend on Figure 3 It can be seen from the process description that the first cross-sectional model may be a cross-sectional model corresponding to the plane where the folded display screen is located.

[0118] In this application, since there may be errors when the folded display screen cuts the virtual object, the user needs to fold the display screen continuously to achieve accurate cutting of the virtual object. However, frequent folding of the display screen may shorten the life of the display screen. Therefore, after folding at least one display screen, the virtual object can be moved through the wearable device to achieve accurate cutting of the virtual object, thereby reducing the number of folding times of the display screen and extending the life of the display screen of the folding device.

[0119] In an exemplary embodiment, after at least one display screen of the folding device is folded, the angle between the two display screens of the folding device is less than 180°. At this time, if the virtual object is moved, the intersection position of the folded display screen and the AR object can be changed, thereby forming a new intersection plane (hereinafter referred to as the "second intersection plane" for ease of description). Figure 6 , is a schematic diagram of a wearable device cutting a virtual object provided by an embodiment of the present application. Figure 6 As shown, taking a watch as an example of a wearable device, the watch is connected to the folding device via Bluetooth, and the user wears the watch and moves the arm wearing the watch to move the virtual object and cut the virtual object through the folded display screen.

[0120] In one embodiment, when there is only one folded display screen, the mobile wearable device may form a new second intersection surface.

[0121] In another embodiment, when there are two folded display screens, the mobile wearable device may form two new second intersection surfaces.

[0122] Afterwards, second page information of the second intersection surface may be determined, and the second page information may be determined as the cross-sectional information of the virtual object.

[0123] In an exemplary implementation, the second page information of the second intersection surface may be determined in the following manner:

[0124] First, a second three-dimensional model corresponding to the virtual object may be determined according to the movement data. The second three-dimensional model here refers to a model that approximately represents the virtual object, such as a triangular mesh model.

[0125] As an implementation method in an exemplary embodiment, when a display screen of a folding device is folded, the execution subject of the present application can establish a rectangular coordinate system based on the unfolded display screen, and determine the position information of the virtual object in the rectangular coordinate system before it moves (for the convenience of description, referred to as the third position information below), and then, a second three-dimensional model corresponding to the virtual object can be constructed according to the above third position information and movement data.

[0126] In an exemplary embodiment, a rectangular coordinate system is established with the midpoint of the folding line of the two display screens of the foldable mobile phone as the origin and the plane where the unfolded display screen is located as the reference plane, that is, the plane where the x-axis and y-axis in the rectangular coordinate system are located.

[0127] As another implementation in an exemplary embodiment, when the two display screens of the folding device are folded, the two display screens before folding can be used as reference planes to establish a rectangular coordinate system (for example, Figure 4The rectangular coordinate system established as shown in FIG. 1 is used to determine the position information of the virtual object in the rectangular coordinate system before it moves (hereinafter referred to as the third position information for ease of description). Afterwards, a second three-dimensional model corresponding to the virtual object can be constructed according to the third position information and the movement data.

[0128] In an exemplary embodiment, the position information of the virtual object in the rectangular coordinate system after movement (hereinafter referred to as the fifth position information for ease of description) can be determined based on the third position information and movement data, and then a second three-dimensional model of the virtual object can be constructed based on the fifth position information.

[0129] For example, assuming that the coordinates of a point in the AR object are (1, 0, 5) and the movement data is (5, 0, 5), then after combining the position information with the movement data, the new coordinates of the point are (6, 0, 5).

[0130] The specific process of constructing the three-dimensional model according to the position information of the virtual model in the rectangular coordinate system is the same as the construction process in the prior art, and will not be repeated here.

[0131] Then, based on the above-mentioned first cross-sectional model and the second three-dimensional model, an expression of the second intersection surface between the folded display screen and the virtual object (hereinafter referred to as the second expression for ease of description) can be determined, and the second expression can be used to represent the coordinates of the second intersection surface where the folded display screen and the virtual object intersect in the established rectangular coordinate system.

[0132] Afterwards, a plurality of intersection points between the folded display screen and the virtual object may be determined according to the second expression, and the plurality of intersection points may be critical points of a second intersection surface between the folded display screen and the virtual object.

[0133] Based on this, shape information of the second intersection surface between the folded display screen and the virtual object (hereinafter referred to as second shape information for ease of description) can be determined based on multiple intersection points. At this time, the second shape information of the second intersection surface can be used to characterize the shape of the second intersection surface, but at this time the entire plane is covered by the model surface of the second three-dimensional model. For example, if the second three-dimensional model corresponding to the virtual object is a triangular mesh model, then at this time the second intersection surface is all triangles.

[0134] In an exemplary embodiment, the plurality of intersection points may be connected using a preset algorithm to obtain the second shape information of the second intersection surface. The algorithm may be a convex hull algorithm or an alpha-shape algorithm.

[0135] Therefore, the executing entity of the embodiment of the present application can remove the model surface corresponding to the second intersecting surface in the above-mentioned second three-dimensional model, so as to obtain the plane structure information corresponding to the second intersecting surface. Since the second intersecting surface belongs to any plane of the virtual object, the plane structure information of the second intersecting surface can represent the internal structure information of the virtual object.

[0136] Finally, the second shape information and the second plane structure information may be determined as the second page information of the second intersection surface.

[0137] Step 506: Display the above-mentioned cross-sectional information through the folded display screen of the folding device.

[0138] In the present application, in order to facilitate users to understand the cross-sectional information of the above-mentioned virtual object being cut more intuitively and clearly, the executing entity of the present application can map the above-mentioned cross-sectional page information on the corresponding folded display screen for display, that is, the cross-sectional information is obtained by cutting the virtual object by the first display screen, and then the cross-sectional information is mapped on the first display screen for display.

[0139] In addition, before displaying the above-mentioned cross-sectional information through one or more display screens of the folding device, the executing entity of the embodiment of the present application may obtain application information of the folding device and map the application information on the virtual object.

[0140] Based on this, the execution subject of the embodiment of the present application can display the following contents including but not limited to: internal structure information of the virtual object, page information of the virtual object being cut, and application information of the folding device through one or more display screens of the folding device. The above internal structure information includes the first plane structure information or the second plane structure information, and the above page information includes the first shape information or the second shape information.

[0141] The technical solution provided by the present application is to display a virtual object on the display screen of a folding device, and when it is detected that the display screen of the folding device is in a folded state, read the folding angle of the folded display screen, determine the first cross-sectional model corresponding to the folded display screen according to the folding angle of the folded display screen, obtain the movement data of the wearable device when the wearable device is detected to be moving, determine the second page information of the second intersection surface of the folded display screen and the virtual object according to the first cross-sectional model and the above movement data, and determine the second page information as the cross-sectional information of the virtual object. This technical solution can accurately cut the virtual object through the wearable device connected to the folding device in combination with the folded display screen after the virtual object is cut on the folded display screen, thereby reducing the number of folding times of the display screen and extending the life of the display screen of the folding device.

[0142] See also Figure 7, is a block diagram of an embodiment of a virtual object display device provided in an embodiment of the present application. Figure 7 As shown, the device may include:

[0143] A reading module 71, configured to read spatial information of a display screen of a foldable device when a virtual object is displayed on the display screen;

[0144] A cutting module 72, configured to cut the virtual object according to the spatial information of the display screen to obtain cross-sectional information of the virtual object;

[0145] The display module 73 is used to display the cross-sectional information through one or more display screens of the folding device.

[0146] like Figure 8 As shown, a schematic diagram of the structure of an electronic device is provided in an embodiment of the present application, including a processor 101, a communication interface 102, a memory 103 and a communication bus 104, wherein the processor 101, the communication interface 102, and the memory 103 communicate with each other through the communication bus 104.

[0147] Memory 103, used for storing computer programs;

[0148] In one embodiment of the present application, the processor 101 is used to execute the program stored in the memory 103 to implement the AR object display method provided by any of the above method embodiments, including:

[0149] In a case where a virtual object is displayed on a display screen of a foldable device, reading spatial information of the display screen;

[0150] Cutting the virtual object according to the spatial information of the display screen to obtain cross-sectional information of the virtual object;

[0151] The cross-sectional information is displayed via one or more display screens of the foldable device.

[0152] An embodiment of the present application further provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by one or more processors, the steps of the virtual object display method provided in any of the aforementioned method embodiments are implemented.

[0153] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0154] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a general hardware platform, and of course, by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0155] It should be understood that the terms used herein are only for the purpose of describing specific example embodiments and are not intended to be limiting. Unless the context clearly indicates otherwise, the singular forms "one", "an" and "said" as used herein may also be meant to include plural forms. The terms "include", "comprise", "contain", and "have" are inclusive, and therefore specify the existence of stated features, steps, operations, elements and / or parts, but do not exclude the existence or addition of one or more other features, steps, operations, elements, parts, and / or combinations thereof. The method steps, processes, and operations described herein are not interpreted as necessarily requiring them to be performed in the specific order described or illustrated, unless the execution order is clearly indicated. It should also be understood that additional or alternative steps may be used.

[0156] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A virtual object display method, characterized in that: The method comprises: In a case where a virtual object is displayed on a display screen of a foldable device, reading spatial information of the display screen; Cutting the virtual object according to the spatial information of the display screen to obtain cross-sectional information of the virtual object; The cross-sectional information is displayed via one or more display screens of the foldable device.

2. The method according to claim 1, characterized in that When it is detected that the display screen of the folding device is in a folded state, reading the spatial information of the display screen includes: Read the folding angle of the folded display; The step of cutting the virtual object according to the spatial information of the display screen to obtain cross-sectional information of the virtual object includes: Determining a first cross-sectional model corresponding to the folded display screen according to a folding angle of the folded display screen; Determining first page information of a first intersection surface between the folded display screen and the virtual object according to a first cross-sectional model of the folded display screen; The first page information is determined as the cross-section information of the virtual object.

3. The method according to claim 2, characterized in that When a display screen of the folding device is folded, determining a first cross-sectional model corresponding to the folded display screen according to a folding angle of the folded display screen includes: Establishing a rectangular coordinate system based on the unfolded display screen; Determining first position information of the folded display screen according to the rectangular coordinate system and the folding angle; A first cross-sectional model corresponding to the folded display screen is determined according to the first position information.

4. The method according to claim 3, characterized in that The step of determining first page information of a first intersection surface between the folded display screen and the virtual object according to the first cross-sectional model of the folded display screen: Determining second position information of the virtual object in the rectangular coordinate system; constructing a first three-dimensional model corresponding to the virtual object according to the second position information; First page information of a first intersection surface between the folded display screen and the virtual object is determined according to the first cross-sectional model and the first stereoscopic model.

5. The method according to claim 4, characterized in that The determining, according to the first cross-sectional model and the first stereoscopic model, first page information of a first intersection surface between the folded display screen and the virtual object comprises: Determine a first expression of a first intersection surface between the folded display screen and the virtual object based on the first cross-sectional model and the first stereoscopic model; Determine, according to the first expression, a plurality of intersection points between the folded display screen and the virtual object; Determining first shape information of a first intersection surface between the folded display screen and the virtual object according to the plurality of intersection points; Removing a model surface corresponding to the first intersecting surface in the first three-dimensional model to obtain first plane structure information of the virtual object corresponding to the first intersecting surface; The first shape information and the first plane structure information are determined as first page information of the first intersection surface.

6. The method according to claim 2, characterized in that The folding device is connected to a wearable device, and the virtual object is cut according to the spatial information of the display screen to obtain the cross-sectional information of the virtual object, including: When the wearable device is detected to be moving, obtaining movement data of the wearable device; Determining second page information of a second intersection surface between the folded display screen and the virtual object according to the first cross-sectional model and the movement data; The second page information is determined as the cross-section information of the virtual object.

7. The method according to claim 6, characterized in that The determining, according to the first cross-sectional model and the movement data, second page information of a second intersection surface between the folded display screen and the virtual object comprises: Determining a second three-dimensional model corresponding to the virtual object according to the movement data; Determine a second expression of a second intersection surface between the folded display screen and the virtual object based on the first cross-sectional model and the second three-dimensional model; According to the second expression, determining a plurality of intersection points between the folded display screen and the virtual object; Determining second shape information of a second intersection surface between the folded display screen and the virtual object according to the plurality of intersection points; Removing the model surface corresponding to the second intersecting surface in the second three-dimensional model to obtain second plane structure information of the virtual object corresponding to the second intersecting surface; The second shape information and the second plane structure information are determined as second page information of the second intersection surface.

8. The method according to claim 7, characterized in that When a display screen of the folding device is folded, determining a second three-dimensional model corresponding to the virtual object according to the movement data includes: Establishing a rectangular coordinate system based on the unfolded display screen; determining third position information of the virtual object in the rectangular coordinate system before the virtual object moves; A second three-dimensional model corresponding to the virtual object is constructed according to the third position information and the movement data.

9. The method according to claim 5 or 7, characterized in that: Before displaying the cross-sectional information on one or more display screens of the folding device, the method further includes: Obtaining application information corresponding to the folding device; mapping the application information onto the virtual object; The displaying of the cross-sectional information by one or more display screens of the folding device comprises: One or more of the following is displayed through the folded display screen of the folding device: the internal structure of the virtual object, the page information of the cut virtual object, and the application information of the folding device, wherein the internal structure includes the first plane structure information or the second plane structure information, and the page information includes the first shape information or the second shape information.

10. An electronic device, characterized in that: include: One or more memories and one or more processors, wherein the one or more processors are used to execute a virtual object display program stored in the one or more memories to implement the virtual object display method according to any one of claims 1 to 9.

11. A storage medium, characterized in that: The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the virtual object display method according to any one of claims 1 to 9.

Images