Three-dimensional scene automatic browsing method and system based on snapshot

Abstract

The invention discloses a snapshot-based three-dimensional scene automatic browsing method and system, and the method comprises the following steps: recording inflection points from a three-dimensional scene, each inflection point being matched with inflection point information; forming a three-dimensional browsing route by a series of ordered inflection points, and storing the three-dimensional browsing route in a corresponding medium; when browsing is carried out in the three-dimensional browsing route, interpolation is carried out on the adjacent inflection points to obtain each observation view angle of the three-dimensional browsing route, the observation view angles are set in a camera, and automatic browsing of the route is completed. According to the method, the three-dimensional scene which can be seen by each inflection point on the line can be accurately checked, so that the automatic browsing effect of the three-dimensional scene can be accurately adjusted, camera parameters are recorded at each inflection point, meanwhile, each inflection point is recorded by using the visual angle of the first person, and if the inflection point needs to be adjusted, the automatic browsing effect of the three-dimensional scene can be accurately adjusted. The corresponding inflection point parameter can be directly set to the camera, the first person view angle of the inflection point is obtained again, recording is carried out again, and the parameter of each inflection point can be adjusted more conveniently and more accurately.

Description

Technical Field

[0001] The present invention relates to the technical field of three-dimensional scene browsing, and in particular to a snapshot-based three-dimensional scene automatic browsing method and system. Background Art

[0002] In the prior art, automatic browsing of 3D scenes generally adopts drawing a 3D curve in the 3D scene, and using the curve as the browsing route of the 3D scene. Although this method can see the browsing route of the 3D scene at a macro level, it is impossible to accurately predict the specific scene that can be reached on the browsing route. Summary of the invention

[0003] The purpose of the present invention is to provide a technical solution of a snapshot-based three-dimensional scene automatic browsing method and system to address the deficiencies in the prior art. Not only can the three-dimensional scene that can be seen at each turning point on the route be accurately viewed during the process of making a three-dimensional scene browsing route so as to accurately adjust the automatic browsing effect of the three-dimensional scene, but also the camera parameters are recorded at each turning point, and each turning point is recorded using a first-person perspective. If the turning point needs to be adjusted, the corresponding turning point parameters can be directly set to the camera, and the first-person perspective of the turning point can be obtained again for re-recording. The parameters of each turning point can be adjusted more conveniently and accurately.

[0004] In order to solve the above technical problems, the present invention adopts the following technical solutions:

[0005] A method for automatically browsing a three-dimensional scene based on snapshots, characterized by comprising the following steps:

[0006] Step 1: Collect inflection points from the 3D scene, and each inflection point is matched with inflection point information;

[0007] Step 2, a series of orderly turning points are used to form a three-dimensional browsing route, and the route is stored in a corresponding medium;

[0008] Step 3. When browsing in the 3D browsing route, interpolate adjacent inflection points to obtain each observation angle of the 3D browsing route, set it in the camera, and complete the automatic browsing of the route.

[0009] This method can not only accurately view the three-dimensional scene that can be seen at each turning point on the route during the process of making a three-dimensional scene browsing route, so as to accurately adjust the automatic browsing effect of the three-dimensional scene, but also record the camera parameters at each turning point, and record each turning point using the first-person perspective. If the turning point needs to be adjusted, the corresponding turning point parameters can be directly set to the camera, and the first-person perspective of the turning point can be obtained again for re-recording. This makes it more convenient and more accurate to adjust the parameters of each turning point.

[0010] Further, obtaining the inflection point in step 1 specifically includes the following steps:

[0011] Step1.1 Operate the 3D scene with the mouse;

[0012] Step 1.2 Operate the 3D scene to reach the desired viewing angle;

[0013] Step1.3 Get the current camera parameters;

[0014] Step 1.4 is decomposed into inflection point parameters, and then the next inflection point is obtained.

[0015] Furthermore, the inflection point information in step Step 1 includes the XYZ coordinates of the current three-dimensional camera, the heading angle and pitch angle of the camera viewing angle, and a screenshot of the viewing angle at the inflection point.

[0016] Furthermore, the storing in the corresponding medium in step 2 includes splitting the inflection point information into fields and storing them in a relational database.

[0017] Furthermore, in step 3, interpolating adjacent inflection points specifically includes the following steps:

[0018] Step 3.1 Read the first inflection point A;

[0019] Step 3.2 Read the second inflection point B;

[0020] Step 3.3 interpolate to obtain a temporary turning point C based on the current playback progress;

[0021] Step 3.4 The temporary inflection point C is set to the camera parameters, so that the camera reaches the observation angle described by the temporary inflection point C;

[0022] Step 3.5 determines whether the temporary inflection point C coincides with the inflection point B. If not, returns to step 3.3;

[0023] Step 3.6 If yes, assign inflection point B to inflection point A and continue with step Step 3.2.

[0024] A snapshot-based 3D scene automatic browsing system, characterized by: comprising:

[0025] The inflection point input module is used to input inflection points from the three-dimensional scene, and each inflection point is matched with inflection point information;

[0026] The inflection point storage module is used to form a three-dimensional browsing route with a series of ordered inflection points and store it in a corresponding medium;

[0027] The inflection point interpolation module is used to interpolate adjacent inflection points when browsing in the three-dimensional browsing route, obtain each observation angle of the three-dimensional browsing route, set it to the camera, and complete the automatic browsing of the route.

[0028] The system can not only accurately view the 3D scenes that can be seen at each turning point on the route during the production of the 3D scene browsing route, so as to accurately adjust the automatic browsing effect of the 3D scene, but also record the camera parameters at each turning point, and record each turning point using the first-person perspective. If you want to adjust the turning point, you can directly set the corresponding turning point parameters to the camera, obtain the first-person perspective of the turning point again, and re-record it, which can adjust the parameters of each turning point more conveniently and accurately.

[0029] Further, obtaining the inflection point specifically includes the following steps:

[0030] Step1.1 Operate the 3D scene with the mouse;

[0031] Step 1.2 Operate the 3D scene to reach the desired viewing angle;

[0032] Step1.3 Get the current camera parameters;

[0033] Step 1.4 is decomposed into inflection point parameters, and then the next inflection point is obtained.

[0034] Furthermore, the inflection point information includes the XYZ coordinates of the current 3D camera, the heading angle and pitch angle of the camera's viewing angle, and a screenshot of the viewing angle at the inflection point.

[0035] Furthermore, storing in a corresponding medium includes splitting the inflection point information into fields and storing them in a relational database.

[0036] Furthermore, interpolating adjacent inflection points specifically includes the following steps:

[0037] Step 3.1 Read the first inflection point A;

[0038] Step 3.2 Read the second inflection point B;

[0039] Step 3.3 interpolate to obtain a temporary turning point C based on the current playback progress;

[0040] Step 3.4 The temporary inflection point C is set to the camera parameters, so that the camera reaches the observation angle described by the temporary inflection point C;

[0041] Step 3.5 determines whether the temporary inflection point C coincides with the inflection point B. If not, returns to step 3.3;

[0042] Step 3.6 If yes, assign inflection point B to inflection point A and continue with step Step 3.2.

[0043] The present invention has the following beneficial effects due to the adoption of the above technical solution:

[0044] The present invention can not only accurately view the three-dimensional scenes that can be seen at each turning point on the route during the process of making a three-dimensional scene browsing route, so as to accurately adjust the automatic browsing effect of the three-dimensional scene, but also record the camera parameters at each turning point, and record each turning point using the first-person perspective. If the turning point needs to be adjusted, the corresponding turning point parameters can be directly set to the camera, and the first-person perspective of the turning point can be obtained again for re-recording. This makes it more convenient and more accurate to adjust the parameters of each turning point. BRIEF DESCRIPTION OF THE DRAWINGS

[0045] The present invention will be further described below in conjunction with the accompanying drawings:

[0046] Figure 1 A flowchart of a snapshot-based automatic browsing method for a three-dimensional scene and an automatic browsing method in a system of the present invention;

[0047] Figure 2 A flow chart for obtaining an inflection point in the present invention;

[0048] Figure 3 A flow chart of interpolating and forming a dynamic browsing path in the present invention;

[0049] Figure 4 Schematic diagram of the system in the present invention. DETAILED DESCRIPTION

[0050] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The present invention will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0051] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only embodiments of a part of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0052] In the following description, specific embodiments of the present invention will be described with reference to steps and symbols of operations performed by one or more computers, unless otherwise stated. Therefore, it will be understood that these steps and operations, which are several times referred to as being performed by a computer, include manipulation by a computer processing unit of electronic signals representing data in a structured form. This manipulation transforms the data or maintains it at a location in the memory system of the computer, which can be reconfigured or otherwise change the operation of the computer in a manner familiar to those skilled in the art. The data structure in which the data is maintained is a physical location in the memory, which has specific characteristics defined by the data format. However, the principles of the present invention are described in the above text, which does not represent a limitation, and those skilled in the art will understand that the various steps and operations described below can also be implemented in hardware.

[0053] As used herein, the terms "component," "module," "system," "interface," "process," and the like are generally intended to refer to a computer-related entity: hardware, a combination of hardware and software, software, or software in execution. For example, a component can be, but is not limited to, a process running on a processor, a processor, an object, an executable application, a thread of execution, a program, and / or a computer. By way of illustration, both an application running on a controller and the controller can be components. One or more components can be within a process and / or thread of execution, and a component can be located on one computer and / or distributed between two or more computers.

[0054] Moreover, the claimed subject matter may be implemented as a method, apparatus, or article of manufacture that uses standard programming and / or engineering techniques to produce software, firmware, hardware, or any combination thereof to control a computer to implement the disclosed subject matter. The term "article of manufacture" as used herein is intended to include a computer program that can be accessed from any computer-readable device, carrier, or medium. Of course, those skilled in the art will recognize that many modifications may be made to this configuration without departing from the scope or spirit of the claimed subject matter.

[0055] like Figure 1 As shown, a snapshot-based 3D scene automatic browsing method of the present invention comprises the following steps:

[0056] Step 1: Collect inflection points from the three-dimensional scene, and each inflection point is matched with inflection point information.

[0057] The method of obtaining the inflection point is as follows Figure 2 As shown, the specific steps include:

[0058] Step1.1 Operate the 3D scene with the mouse;

[0059] Step 1.2 Operate the 3D scene to reach the desired viewing angle;

[0060] Step1.3 Get the current camera parameters;

[0061] Step 1.4 is decomposed into inflection point parameters, and then the next inflection point is obtained.

[0062] The inflection point information includes the XYZ coordinates of the current 3D camera, the heading angle and pitch angle of the camera's viewing angle, and a screenshot of the viewing angle at the inflection point, which is used as an inflection point preview.

[0063] Step 2: A series of ordered turning points are used to form a three-dimensional browsing route and stored in the corresponding medium.

[0064] Storing in the corresponding medium includes splitting the inflection point information into fields and storing them in a relational database. The table structure of the inflection point sequence is shown in Table 1.

[0065]

[0066]

[0067] Table 1

[0068] Step 3. When browsing in the 3D browsing route, interpolate adjacent inflection points to obtain each observation angle of the 3D browsing route, set it in the camera, and complete the automatic browsing of the route.

[0069] The method of interpolating adjacent inflection points is as follows Figure 3 As shown, the specific steps include:

[0070] Step 3.1 Read the first inflection point A;

[0071] Step 3.2 Read the second inflection point B;

[0072] Step 3.3 interpolate to obtain a temporary turning point C based on the current playback progress;

[0073] Step 3.4 The temporary inflection point C is set to the camera parameters, so that the camera reaches the observation angle described by the temporary inflection point C;

[0074] Step 3.5 determines whether the temporary inflection point C coincides with the inflection point B. If not, returns to step 3.3;

[0075] Step 3.6 If yes, assign inflection point B to inflection point A and continue with step Step 3.2.

[0076] The parameters of the current 3D scene camera are directly obtained through the inflection point entry module. It is a regular 4*4 matrix. The parameters of the current camera [X, Y, Z, Angle1, Angle2] can be calculated based on this matrix. The snapshot contains an Image object, which is a preview image of the snapshot and will not directly participate in the automatic browsing calculation.

[0077] Inflection point A: [X A ,Y A ,Z A ,Angle1 A ,Angle2 A ]

[0078] Inflection point B: [X B ,Y B ,Z B ,Angle1 B ,Angle2 B ]

[0079] The current browsing time process t is interpolated according to [0%, 100%].

[0080] The first step is conventional numerical interpolation:

[0081] In the real number domain, assume that there are two real numbers P and Q, where P is not equal to Q. The interpolation result R is between P and Q and changes with the change of the variable t.

[0082] The variable t is a quantity that changes uniformly from 0 to 1. When t is 0, R = P. When t is 1, R = Q.

[0083] When t is between 0 and 1, the value of R is between P and Q, that is:

[0084] R=P*(1-t)+Q*t

[0085] As t changes, R is always in the interval [P,Q].

[0086] The second step is multi-value interpolation:

[0087] The above inflection point is a combination of multiple parameters, including XYZ, Angle1 and Angle2, and has more than one value. The temporary inflection point C is interpolated between inflection point A and inflection point B, and each value in inflection point A and inflection point B is interpolated separately.

[0088] Get the temporary inflection point C: [

[0090] X C =X A *(1-t)+X B *t,

[0091] Y C =Y A *(1-t)+Y B *t,

[0092] Z C =Z A *(1-t)+Z B *t,

[0093] Angle1 C =Angle1 A *(1-t)+Angle1 B *t,

[0094] Angle2 C =Angle2 A *(1-t)+Angle2 B *t, ]

[0096] The temporary inflection point C is calculated and directly used as the camera parameter, and then set to the 3D scene camera.

[0097] This method can not only accurately view the three-dimensional scene that can be seen at each turning point on the route during the process of making a three-dimensional scene browsing route, so as to accurately adjust the automatic browsing effect of the three-dimensional scene, but also record the camera parameters at each turning point, and record each turning point using the first-person perspective. If the turning point needs to be adjusted, the corresponding turning point parameters can be directly set to the camera, and the first-person perspective of the turning point can be obtained again for re-recording. This makes it more convenient and more accurate to adjust the parameters of each turning point.

[0098] A snapshot-based 3D scene automatic browsing system, such as Figure 4 As shown, it includes an inflection point input module, an inflection point storage module and an inflection point interpolation module.

[0099] The inflection point input module is used to input inflection points from the 3D scene. Each inflection point is matched with inflection point information. The inflection point input module directly obtains the parameters of the current 3D scene camera, which can be a 4*4 regular matrix. The parameters of the current camera can be calculated based on this matrix.

[0100] Obtaining the inflection point specifically includes the following steps:

[0101] Step1.1 Operate the 3D scene with the mouse;

[0102] Step 1.2 Operate the 3D scene to reach the desired viewing angle;

[0103] Step1.3 Get the current camera parameters;

[0104] Step 1.4 is decomposed into inflection point parameters, and then the next inflection point is obtained.

[0105] The inflection point information includes the XYZ coordinates of the current 3D camera, the heading angle and pitch angle of the camera's viewing angle, and a screenshot of the viewing angle at the inflection point.

[0106] The inflection point storage module is used to form a three-dimensional browsing route with a series of ordered inflection points, and store it in a corresponding medium.

[0107] Storing in the corresponding medium includes splitting the inflection point information into fields and storing them in a relational database.

[0108] The inflection point interpolation module is used to interpolate adjacent inflection points when browsing in a three-dimensional browsing route, obtain each observation angle of the three-dimensional browsing route, set it to the camera, and complete automatic browsing of the route.

[0109] The interpolation of adjacent inflection points specifically includes the following steps:

[0110] Step 3.1 Read the first inflection point A;

[0111] Step 3.2 Read the second inflection point B;

[0112] Step 3.3 interpolate to obtain a temporary turning point C based on the current playback progress;

[0113] Step 3.4 The temporary inflection point C is set to the camera parameters, so that the camera reaches the observation angle described by the temporary inflection point C;

[0114] Step 3.5 determines whether the temporary inflection point C coincides with the inflection point B. If not, returns to step 3.3;

[0115] Step 3.6 If yes, assign inflection point B to inflection point A and continue with step Step 3.2.

[0116] The parameters of the current 3D scene camera are directly obtained through the inflection point entry module. It is a regular 4*4 matrix. The parameters of the current camera [X, Y, Z, Angle1, Angle2] can be calculated based on this matrix. The snapshot contains an Image object, which is a preview image of the snapshot and will not directly participate in the automatic browsing calculation.

[0117] Inflection point A: [X A ,Y A ,Z A ,Angle1 A ,Angle2 A ]

[0118] Inflection point B: [X B ,Y B ,ZB ,Angle1 B ,Angle2 B ]

[0119] The current browsing time process t is interpolated according to [0%, 100%].

[0120] The first step is conventional numerical interpolation:

[0121] In the real number domain, assume that there are two real numbers P and Q, where P is not equal to Q. The interpolation result R is between P and Q and changes with the change of the variable t.

[0122] The variable t is a quantity that changes uniformly from 0 to 1. When t is 0, R = P. When t is 1, R = Q.

[0123] When t is between 0 and 1, the value of R is between P and Q, that is:

[0124] R=P*(1-t)+Q*t

[0125] As t changes, R is always in the interval [P,Q].

[0126] The second step is multi-value interpolation:

[0127] The above inflection point is a combination of multiple parameters, including XYZ, Angle1 and Angle2, and has more than one value. The temporary inflection point C is interpolated between inflection point A and inflection point B, and each value in inflection point A and inflection point B is interpolated separately.

[0128] Get the temporary inflection point C: [

[0130] X C =X A *(1-t)+X B *t,

[0131] Y C =Y A *(1-t)+Y B *t,

[0132] Z C =Z A *(1-t)+Z B *t,

[0133] Angle1 C =Angle1 A *(1-t)+Angle1 B *t,

[0134] Angle2 C=Angle2 A *(1-t)+Angle2 B *t, ]

[0136] The temporary inflection point C is calculated and directly used as the camera parameter, and then set to the 3D scene camera.

[0137] The system can not only accurately view the 3D scenes that can be seen at each turning point on the route during the production of the 3D scene browsing route, so as to accurately adjust the automatic browsing effect of the 3D scene, but also record the camera parameters at each turning point, and record each turning point using the first-person perspective. If you want to adjust the turning point, you can directly set the corresponding turning point parameters to the camera, obtain the first-person perspective of the turning point again, and re-record it, which can adjust the parameters of each turning point more conveniently and accurately.

[0138] The above are only specific embodiments of the present invention, but the technical features of the present invention are not limited thereto. Any simple changes, equivalent replacements or modifications made based on the present invention to achieve basically the same technical effects are all included in the protection scope of the present invention.

Claims

1. A method for automatically browsing a three-dimensional scene based on snapshots, characterized in that The steps include: Step 1: Collect inflection points from the 3D scene, and each inflection point is matched with inflection point information; Step 2, forming a three-dimensional browsing route with a series of orderly turning points, and storing the route in a corresponding medium; Step 3: When browsing in the three-dimensional browsing route, interpolate the adjacent inflection points to obtain each viewing angle of the three-dimensional browsing route, set it in the camera, and complete the automatic browsing of the route.

2. The method for automatically browsing a three-dimensional scene based on snapshots according to claim 1, characterized in that: Obtaining the inflection point in step 1 specifically includes the following steps: Step1.1 Operate the 3D scene with the mouse; Step 1.2 Operate the 3D scene to reach the desired viewing angle; Step1.3 Get the current camera parameters; Step 1.4 is decomposed into inflection point parameters, and then the next inflection point is obtained.

3. The method for automatically browsing a three-dimensional scene based on snapshots according to claim 1, characterized in that: The inflection point information in step Step 1 includes the XYZ coordinates of the current three-dimensional camera, the heading angle and pitch angle of the camera viewing angle, and a screenshot of the viewing angle at the inflection point.

4. The method for automatically browsing a three-dimensional scene based on snapshots according to claim 1, characterized in that: The storing in the corresponding medium in step Step 2 includes splitting the inflection point information into fields and storing them in a relational database.

5. The method for automatically browsing a three-dimensional scene based on snapshots according to claim 1, characterized in that: In step 3, interpolating the adjacent inflection points specifically includes the following steps: Step 3.1 Read the first inflection point A; Step 3.2 Read the second inflection point B; Step 3.3 interpolate to obtain a temporary turning point C based on the current playback progress; Step 3.4 The temporary inflection point C is set to the camera parameters, so that the camera reaches the observation angle described by the temporary inflection point C; Step 3.5 determines whether the temporary inflection point C coincides with the inflection point B. If not, returns to step 3.3; Step 3.6 If yes, assign inflection point B to inflection point A and continue with step Step 3.

2.

6. A snapshot-based 3D scene automatic browsing system, characterized in that: include, The inflection point recording module is used to record inflection points from the three-dimensional scene, and each inflection point is matched with inflection point information; the inflection point storage module is used to form a three-dimensional browsing route with a series of ordered inflection points, and store it in a corresponding medium; and an inflection point interpolation module, which is used to interpolate adjacent inflection points when browsing in the three-dimensional browsing route, obtain each observation angle of the three-dimensional browsing route, set it in the camera, and complete automatic browsing of the route.

7. The snapshot-based 3D scene automatic browsing system according to claim 6, characterized in that: The obtaining of the inflection point specifically comprises the following steps: Step1.1 Operate the 3D scene with the mouse; Step 1.2 Operate the 3D scene to reach the desired viewing angle; Step1.3 Get the current camera parameters; Step 1.4 is decomposed into inflection point parameters, and then the next inflection point is obtained.

8. The snapshot-based 3D scene automatic browsing system according to claim 6, characterized in that: The inflection point information includes the XYZ coordinates of the current 3D camera, the heading angle and pitch angle of the camera viewing angle, and a screenshot of the viewing angle at the inflection point.

9. The snapshot-based 3D scene automatic browsing system according to claim 6, characterized in that: The storing in the corresponding medium includes splitting the inflection point information into fields and storing them in a relational database.

10. The snapshot-based 3D scene automatic browsing system according to claim 6, characterized in that: Interpolating adjacent inflection points specifically includes the following steps: Step 3.1 Read the first inflection point A; Step 3.2 Read the second inflection point B; Step 3.3 interpolate to obtain a temporary turning point C based on the current playback progress; Step 3.4 The temporary inflection point C is set to the camera parameters, so that the camera reaches the observation angle described by the temporary inflection point C; Step 3.5 determines whether the temporary inflection point C coincides with the inflection point B. If not, returns to step 3.3; Step 3.6 If yes, assign inflection point B to inflection point A and continue with step Step 3.2.

Images