A three-dimensional scene video generation method, system, device and medium

Abstract

The present invention relates to a three-dimensional scene video generation method, system, device and medium for a virtual reality psychotherapy system, and the method comprises: first, matching a corresponding three-dimensional scene for a user based on a preset three-dimensional scene library; second, abstracting the three-dimensional scene into a graph, and determining a VR roaming path based on the graph; then, generating a corresponding predefined perspective for each observation node on the VR roaming path; finally, transmitting the three-dimensional scene, VR roaming path and predefined perspective to a VR device so that the user can interact with the VR device. The present invention solves the problem that the psychological relaxation therapy video material is single and easy to make the user tired. By proposing a three-dimensional scene path generation method, the problem of the singleness of the video material is solved, and the psychological relaxation therapy effect is effectively improved. In addition, the present invention generates a corresponding roaming path and predefined perspective for the user, collects the user's subjective feelings and saves them in a database, and realizes the user's individualized psychological relaxation therapy.

Description

Technical Field

[0001] The present invention relates to the technical field of three-dimensional scene video processing, and in particular to a three-dimensional scene video generation method, system, device and medium for a virtual reality psychotherapy system. Background Art

[0002] Videos are needed for auxiliary treatment in psychotherapy. Users follow fixed soothing music and videos for psychological relaxation training. The videos are pre-shot, and the doctor discusses and negotiates with the user to finally select the video scene. During the treatment process, the user cannot change the content of the scene they watch. The user roams in the scene following the video roaming route and viewing angle. Through visual and auditory stimulation, combined with professional psychological relaxation treatment guidance, a relaxing atmosphere is created for the user to conduct psychological relaxation treatment.

[0003] At present, the traditional method is still used in psychological relaxation therapy based on three-dimensional scenes, that is, doctors use professional psychological knowledge and experience to analyze the user's scale and other data to select a fixed virtual reality scene. First, due to the limited virtual reality video resources, watching the same virtual reality psychological relaxation video many times will give users a single and boring visual stimulation, which will inevitably make users feel tired of the treatment. Secondly, existing research still alleviates the fatigue of psychological relaxation therapy from the perspective of three-dimensional scene selection, and does not make full use of the "three-dimensional" resources such as scene paths and scene elements in three-dimensional scenes to generate different virtual reality videos. At the same time, the pre-defined virtual reality video is used in the process of psychological relaxation therapy, and the video will not be modified. It is impossible to take into account the psychological changes and preference changes of different users at different stages to achieve personalized psychological relaxation therapy. Summary of the invention

[0004] 1. Technical issues to be resolved

[0005] In view of the above-mentioned shortcomings and deficiencies of the prior art, the present invention provides a three-dimensional scene video generation method for a virtual reality psychotherapy system, which solves the technical problem that the existing virtual reality psychotherapy system has a single video material and easily causes users to feel tired.

[0006] (II) Technical solution

[0007] In order to achieve the above object, the main technical solutions adopted by the present invention include:

[0008] In a first aspect, an embodiment of the present invention provides a method for generating a three-dimensional scene video for a virtual reality psychotherapy system, comprising:

[0009] Match the corresponding 3D scene for the user based on the preset 3D scene library;

[0010] Abstracting the three-dimensional scene into a graph, and determining a VR roaming path based on the graph;

[0011] For each observation node on the VR roaming path, generating a corresponding predefined perspective;

[0012] The three-dimensional scene, VR roaming path, and predefined viewing angle are transmitted to the VR device so that the user can interact with the VR device.

[0013] Optionally, matching a corresponding three-dimensional scene for a user based on a preset three-dimensional scene library includes:

[0014] Based on the obtained user identity information, determine whether this is the first time for the user to undergo virtual reality psychotherapy;

[0015] If the user is undergoing psychological relaxation therapy for the first time, a corresponding three-dimensional scene is matched for the user from a preset three-dimensional scene library based on expert experience and / or prior knowledge;

[0016] If it is not the first time for the user to undergo psychological relaxation therapy, the scene navigation data of the user is read from a preset database, and the corresponding three-dimensional scene is matched from the three-dimensional scene library in combination with the user's subjective feeling scale in the database.

[0017] Optionally, abstracting the three-dimensional scene into a graph, and determining the VR roaming path based on the graph includes:

[0018] Abstract the three-dimensional scene into a graph G(V,E);

[0019] Randomly select the starting point V i , and away from the starting point V i Path length l±l t Randomly select the end point V j , the roaming speed is v;

[0020] Traverse the graph G(V,E) and get the starting point V i and the end point V j There are m paths between them;

[0021] Calculate the interest values ​​of m paths respectively through the path interest value formula, and select the path with the highest interest value as the VR roaming path P[x];

[0022] The path interest value formula is as follows:

[0023] IC=f(C,CNum)

[0024] Where C = [c 0 ,c 1 ,…,c n-1] is the interest value of different scene elements, n is the number of selected different scene elements, CNum[num 0 ,num 2 ,…,num n-1 ] is the number of scene elements corresponding to C within the set line of sight d, f is the function of calculating the path interest value; V is the set of nodes abstracted from the scene, and E is the set of edges abstracted from the scene.

[0025] Optionally, for each observation node on the VR roaming path, generating a corresponding predefined perspective includes:

[0026] Set observation nodes on the VR roaming path P[x] at every path length e;

[0027] The interest value of each observation node at different observation angles is calculated by the interest value formula of the observation angle, and the observation angle with a higher interest value is selected as the predefined viewing angle of the observation node;

[0028] Determine the roaming angular velocity ψ;

[0029] The formula for the interest value of the observation angle is:

[0030] IAC=g(C,ACNum)

[0031] Among them, ACNum[anum 0 ,anum 2 ,…,anum n-1 ] is the number of scene elements within the visible range R of a certain observation angle of the observation point; g is the function for calculating the interest value of a certain observation angle of the observation point; the binocular field of view of the VR device is ω°, the line of sight angle direction of the scene x-axis is 0°, and the observation angle is the angle θ between the observation direction and the x-axis.

[0032] Optionally, there are t observation nodes on the VR roaming path, and the initial observation node is V 0 , the last observation node is V t-1 ; Each observation node stores the world coordinates of the observation node.

[0033] Optionally, the visible range R is a sector-shaped area whose length from the observation point is less than or equal to h and is located within the binocular field of view ω°, where h is the farthest observable length.

[0034] Optionally, the method further comprises:

[0035] After the user stops interacting with the VR device, collecting the user's subjective perception scores of the scene elements and generating a user subjective perception scale;

[0036] The user's subjective feeling scale and scene roaming data are stored in a preset database.

[0037] In a second aspect, an embodiment of the present invention provides a virtual reality psychotherapy system, comprising:

[0038] A virtual reality interaction module, used to transmit the video data obtained from the three-dimensional scene roaming content generation module to the VR device, so that the user can interact with the VR device;

[0039] A data collection module, used to generate a user subjective feeling scale based on the collected user's subjective feeling scores of scene elements after the user stops interacting with the VR device, and store the scale in a preset database;

[0040] A 3D scene roaming content generation module is used to retrieve user subjective feeling data from a preset database and generate a corresponding 3D scene for the user based on the preset 3D scene library;

[0041] The three-dimensional scene roaming content generation module includes: a three-dimensional scene selection module, a three-dimensional scene roaming path generation module and a three-dimensional scene roaming path predefined viewing angle module;

[0042] The 3D scene selection module is used to generate a corresponding 3D scene for the user based on a preset 3D scene library;

[0043] The three-dimensional scene roaming path generation module is used to abstract the three-dimensional scene into a graph, and determine the VR roaming path based on the graph;

[0044] The three-dimensional scene roaming path predefined perspective module is used to generate a corresponding predefined perspective for each observation node on the VR roaming path.

[0045] In a third aspect, an embodiment of the present invention provides a VR device for virtual reality psychotherapy, comprising:

[0046] At least one database; and a memory in communication with the at least one database; wherein the memory stores instructions that can be executed by the at least one database, and the instructions are executed by the at least one database so that the at least one database can execute the three-dimensional scene video generation method for a virtual reality psychotherapy system as described above.

[0047] In a fourth aspect, an embodiment of the present invention provides a computer-readable medium having computer executable instructions stored thereon, which, when executed by a processor, implements the three-dimensional scene video generation method for a virtual reality psychotherapy system as described above.

[0048] (III) Beneficial effects

[0049] The beneficial effects of the present invention are as follows: the present invention solves the problem that the psychological relaxation therapy video material is single and easily causes users to feel tired. By proposing a method for generating a three-dimensional scene path, the problem of the singleness of the video material is solved, and the psychological relaxation therapy effect is effectively improved. Secondly, compared with the existing method of alleviating the problem of the singleness of the video material by scene selection, the method based on the generation of a three-dimensional scene path is not limited to the selection of scenes, and makes full use of the "three-dimensional" resources such as the scene path and scene elements of the video scene. It is worth mentioning that, unlike the traditional psychological relaxation therapy video that directly uses pre-defined videos without changing the viewing content, the present invention takes into account the psychological changes and preference changes of different users at different stages, and through the generation of scene paths and the generation of pre-defined scene perspectives, it takes into account the different levels of interest of different users in scene elements, collects the subjective feelings of users and saves them in a database, and realizes the individualized psychological relaxation therapy of users. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1 A schematic flow chart of a method for generating a three-dimensional scene video for a virtual reality psychotherapy system provided by the present invention;

[0051] Figure 2 A specific flow chart of step S1 of a method for generating a three-dimensional scene video for a virtual reality psychotherapy system provided by the present invention;

[0052] Figure 3 A specific flow chart of step S2 of a method for generating a three-dimensional scene video for a virtual reality psychotherapy system provided by the present invention;

[0053] Figure 4 A schematic diagram of a three-dimensional scene for a three-dimensional scene video generation method for a virtual reality psychotherapy system provided by the present invention;

[0054] Figure 5 A schematic diagram of an abstracted three-dimensional scene video generation method for a virtual reality psychotherapy system provided by the present invention;

[0055] Figure 6 A plurality of roaming paths of a three-dimensional scene video generation method for a virtual reality psychotherapy system provided by the present invention;

[0056] Figure 7 A specific flow chart of step S3 of a method for generating a three-dimensional scene video for a virtual reality psychotherapy system provided by the present invention;

[0057] Figure 8 A schematic diagram of the observation point field of view of a three-dimensional scene video generation method for a virtual reality psychotherapy system provided by the present invention;

[0058] Fig. 9 A schematic diagram of other steps of a method for generating a three-dimensional scene video for a virtual reality psychotherapy system provided by the present invention;

[0059] Fig.10 A schematic diagram of the composition of a virtual reality psychotherapy system provided by the present invention. DETAILED DESCRIPTION

[0060] In order to better explain the present invention and facilitate understanding, the present invention is described in detail below through specific implementation modes in conjunction with the accompanying drawings.

[0061] like Figure 1 As shown, a three-dimensional scene video generation method for a virtual reality psychotherapy system proposed in an embodiment of the present invention includes: first, matching a corresponding three-dimensional scene for a user based on a preset three-dimensional scene library; second, abstracting the three-dimensional scene into a graph, and determining a VR roaming path based on the graph; then, generating a corresponding predefined viewing angle for each observation node on the VR roaming path; finally, transmitting the three-dimensional scene, VR roaming path, and predefined viewing angle to a VR device, so that the user can interact with the VR device.

[0062] The present invention solves the problem that the psychological relaxation therapy video material is single and easily makes users feel tired. By proposing a method for generating a three-dimensional scene path, the problem of the singleness of the video material is solved, and the effect of psychological relaxation therapy is effectively improved. Secondly, compared with the existing method of alleviating the problem of the singleness of video material by scene selection, the method based on the generation of a three-dimensional scene path is not limited to the selection of scenes, and makes full use of the "three-dimensional" resources such as the scene path and scene elements of the video scene. It is worth mentioning that, unlike the traditional psychological relaxation therapy video that directly uses pre-defined videos without changing the viewing content, the present invention takes into account the psychological changes and preference changes of different users at different stages, and takes into account the different levels of interest of different users in scene elements through the generation of scene paths and pre-defined scene perspectives, collects the subjective feelings of users and saves them in a database, and realizes the individualized psychological relaxation therapy of users.

[0063] In order to better understand the above technical solution, exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments described herein. On the contrary, these embodiments are provided to enable a clearer and more thorough understanding of the present invention and to fully convey the scope of the present invention to those skilled in the art.

[0064] Specifically, the present invention provides a method for generating a three-dimensional scene video for a virtual reality psychotherapy system, comprising:

[0065] S1. Matching a corresponding 3D scene for a user based on a preset 3D scene library.

[0066] like Figure 2 As shown, step S1 includes:

[0067] S11. Determine, based on the acquired user identity information, whether this is the first time for the user to undergo virtual reality psychotherapy.

[0068] S12a: If the user is undergoing psychological relaxation therapy for the first time, based on expert experience and / or prior knowledge, a corresponding three-dimensional scene is matched for the user from a preset three-dimensional scene library. If the user is undergoing psychological relaxation therapy for the first time, a three-dimensional scene is selected for the user from the three-dimensional scene library based on professional psychological knowledge and experience.

[0069] S12b: If it is not the first time for the user to undergo psychological relaxation therapy, the scene navigation data of the user is read from a preset database, and a corresponding three-dimensional scene is matched from a three-dimensional scene library in combination with the user's subjective feeling scale in the database.

[0070] S2. Abstract the three-dimensional scene into a graph, and determine a VR roaming path based on the graph.

[0071] like Figure 3 As shown, step S2 includes:

[0072] S21. Abstract the three-dimensional scene into a graph G(V, E).

[0073] S22, randomly select starting point V i , and away from the starting point V i Path length l±l t Randomly select the end point V j , the roaming speed is v. The path length is calculated by the world coordinates of the path nodes, and the position change in space is calculated by the Euclidean distance calculation formula. The roaming speed v is obtained by the following steps: if the user is undergoing psychological relaxation therapy for the first time, it is obtained based on expert experience and / or prior experience; if the user is not undergoing psychological relaxation therapy for the first time, the scene roaming data of the user is read from a preset database, and the roaming speed is determined in combination with the user's subjective feeling scale in the database.

[0074] S23, traverse the graph G(V,E) and obtain the starting point V i and the end point V j Each path refers to a sequence, for example, P[0] = v i v 2…v j , there is an edge between each pair of adjacent nodes in the sequence, and P[0] is called a path between nodes.

[0075] S24. Calculate the interest values ​​of the m paths respectively using the path interest value formula, and select the path with the highest interest value as the VR roaming path P[x].

[0076] The interest value is used to measure the user's interest in the path. Since each user has different interests in the scene elements along the path, the path interest value formula is as follows:

[0077] IC=f(C,CNum)

[0078] Where C = [c 0 ,c 1 ,…,c n-1 ] is the interest value of different scene elements, n is the number of selected different scene elements, CNum[num 0 ,num 2 ,…,num n-1 ] is the number of scene elements corresponding to C within the set line of sight d, f is the function of calculating the path interest value; V is the set of nodes abstracted from the scene, and E is the set of edges abstracted from the scene.

[0079] In a specific embodiment,

[0080] First, select the corresponding 3D scene. Figure 4 The content selected in the middle box is the selected 3D scene;

[0081] Secondly, if Figure 5 As shown, the received three-dimensional scene is abstracted into a graph;

[0082] Next, randomly select the starting point v 1 (430,4520,0), the coordinate unit is the measurement unit UnrealUnit (abbreviated as uu) in the UE4 engine, and the filter distance is v 1 The endpoint with a straight-line distance of 4000±100uu, the alternative endpoints that meet the requirements are v 12 ,v 13 , randomly select the endpoint v from the alternative endpoints 13 (3120,1460,20), and set the roaming speed to 4uu / s;

[0083] Furthermore, we traverse the graph G(V,E) abstracted from the 3D scene and obtain 10 paths P[x] between the starting point and the end point. A path is a sequence, and there is an edge between each pair of adjacent nodes in the sequence. The 10 paths P[x] are specifically:

[0084] P[0]=v 1 v 4 v 9 v 10 v 11 v 12 v 13 ,

[0085] P[1]=v 1 v 4 v 9 v 10 v 11 v 14 v 15 v 13 ,

[0086] P[2]=v 1 v 4 v 7 v 8 v 14 v 11 v 12 v 13 ,

[0087] P[3]=v 1 v 4 v 7 v 8 v 14 v 15 v 13 ,

[0088] P[5]=v 1 v 2 v 15 v 14 v 8 v 7 v 4 v 9 v 10 v 11 v 12 v 13 ,

[0089] P[3]=v 1 v 2 v 15 v 14 v 11 v 12 v 13 ,

[0090] P[6]=v 1 v 2 v 15 v 13 ,

[0091] P[7]=v 1 v 2 v3 v 16 v 15 v 14 v 8 v 7 v 4 v 9 v 10 v 11 v 12 v 13 ,

[0092] P[8]=v 1 v 2 v 3 v 16 v 15 v 14 v 11 v 12 v 13 ,

[0093] P[9]=v 1 v 2 v 3 v 16 v 15 v 13 .

[0094] Finally, calculate the 1 To the end point v 13 The interest values ​​of the 10 paths are as follows: Figure 6 As shown, the path P[6] = v 1 v 2 v 15 v 13 For example, three scene elements are selected: bird, tree, and flower. The scene element interest value is set to C = [2, 3, 1]. The path interest range is set to the range of 60uu from the path. The path P[6] = v 1 v 2 v 15 v 13 The range of interest R is within the blue dotted line. By counting the number of selected scene elements within the range of interest, we get CNum[2,5,5]. If the path interest value calculation formula is IC = C·CNum = c 0 *num 0 +c 1 *num 1 +…+c n-1 *num n-1 , the interest value of the path is 24. Using the same interest value calculation method, the interest values ​​of the 10 paths from the start point to the end point can be obtained, and the path with the highest interest value is selected as the VR roaming path.

[0095] S3. Generate a corresponding predefined perspective for each observation node on the VR roaming path.

[0096] like Figure 7 As shown, step S3 includes:

[0097] S31, setting an observation node O[t] at every path length e on the VR roaming path P[x]; there are t observation nodes on the VR roaming path, and the initial observation node is V 0 , the last observation node is V t-1 ; Each observation node O[t] stores the world coordinates of the observation node.

[0098] S32. Calculate the interest values ​​of different observation angles of each observation node using the interest value formula of the observation angle, and select the observation angle with a higher interest value as the predefined viewing angle of the observation node.

[0099] S33, determine the roaming angular velocity ψ, during the roaming process, from the predefined viewing angle θ of the observation node O[m] m , moving at a constant angular velocity ψ to the predefined viewing angle θ of the adjacent observation point O[m+1] m+1 The roaming angular velocity ψ is obtained through the following steps: if it is the first time for the user to undergo psychological relaxation therapy, it is obtained based on expert experience and / or prior experience; if it is not the first time for the user to undergo psychological relaxation therapy, the scene roaming data of the user is read from a preset database, and the roaming angular velocity is determined in combination with the user's subjective feeling scale in the database.

[0100] The interest value of a certain sight angle of the observation node is calculated by counting the number of scene elements with different interest values ​​within the field of view. Different virtual reality head display devices have different field of view, such as Figure 8 As shown, the binocular field of view of the VR device is ω°, the sight angle direction of the scene x-axis is 0°, and the observation angle is the angle θ between the observation direction and the x-axis. The formula for the interest value of the observation angle is:

[0101] IAC=g(C,ACNum)

[0102] Among them, ACNum[anum 0 ,anum 2 ,…,anum n-1 ] is the number of scene elements within the visible range R of a certain observation angle of the observation point; g is the function for calculating the interest value of a certain observation angle of the observation point; the binocular field of view of the VR device is ω°, the line of sight angle direction of the scene x-axis is 0°, and the observation angle is the angle θ between the observation direction and the x-axis.

[0103] Preferably, the visible range R is a sector-shaped area whose length from the observation point is less than or equal to h and is located within the binocular field of view ω°, wherein h is the farthest observable length.

[0104] In a specific embodiment,

[0105] First, select P[6]=v with the highest interest value 1 v 2 v 15 v 13 As a VR roaming path;

[0106] Secondly, in the roaming path P[6] = v 1 v 2 v 15 v 13 An observation node is set every 800uu of the path length. The initial observation node is v 0 , the last observation node is the end point v 13 .

[0107] Next, the interest values ​​IAC of different observation angles of each observation node are calculated respectively, and the observation angle θ with a higher interest value is selected as the predefined viewing angle of the observation node. The interest value of a certain sight angle of the observation node is calculated by counting the number of scene elements with different interest values ​​within the field of view. Different virtual reality head display devices have different field of view, such as Figure 8 As shown in the figure, if the stereo binocular field of view of the device is 104°, the sight angle direction of the scene x-axis can be set to 0°, and the observation angle is the angle θ between the observation direction and the x-axis. The three different scene elements (birds, flowers, and trees) selected can be obtained by asking users to fill in the subjective feeling scale to obtain the interest value C = [2,3,1]; the farthest observable length is set to 300uu, and the visible range R is a fan-shaped area with a distance from the observation point less than or equal to 300uu and located within the binocular field of view of 104°. The formula for selecting the interest value of a certain angle of a certain observation node is:

[0108] IAC=C·ACNum=c 0 *Anum 0 +c 1 *Anum 1 +…+c n-1 *Anum n-1

[0109] Take the initial observation node v 0 Taking the observation angle of 90° as an example, the number of scene elements ACNum[2,1,7] within the field of view can be counted, and the initial observation node v can be obtained by the interest value calculation formula. 0The interest value of the observation angle of 90° is 14. By calculating the interest values ​​of the observation node at different observation angles, the highest interest value is selected as the predefined viewing angle of the observation point. Similarly, the roaming path can be calculated as P[6]=v 1 v 2 v 15 v 13 Predefined viewing angles of other observation nodes on the same node.

[0110] Finally, the roaming angular velocity is set to 0.05 rad / s. During the roaming process, the predefined viewing angle θ of the observation node O[m] is m , moving at a constant angular velocity of 0.05 rad / s to the predefined viewing angle θ of the adjacent observation point O[m+1] m+1 .

[0111] like Fig. 9 As shown, the method also includes:

[0112] S51. After the user stops interacting with the VR device, collect the user's subjective perception scores of scene elements and generate a user subjective perception scale.

[0113] S52: storing the user's subjective feeling scale and scene roaming data in a preset database. The subjective feeling scale is stored in the database for use in generating the three-dimensional scene roaming content for the next psychological relaxation treatment.

[0114] like Fig.10 As shown, the embodiment of the present invention further provides a virtual reality psychotherapy system, comprising:

[0115] A virtual reality interaction module, used to transmit the video data obtained from the three-dimensional scene roaming content generation module to the VR device, so that the user can interact with the VR device;

[0116] A data collection module, used to generate a user subjective feeling scale based on the collected user's subjective feeling scores of scene elements after the user stops interacting with the VR device, and store the scale in a preset database;

[0117] A 3D scene roaming content generation module is used to retrieve user subjective feeling data from a preset database and generate a corresponding 3D scene for the user based on the preset 3D scene library;

[0118] The three-dimensional scene roaming content generation module includes: a three-dimensional scene selection module, a three-dimensional scene roaming path generation module and a three-dimensional scene roaming path predefined viewing angle module;

[0119] The 3D scene selection module is used to generate a corresponding 3D scene for the user based on a preset 3D scene library;

[0120] The three-dimensional scene roaming path generation module is used to abstract the three-dimensional scene into a graph, and determine the VR roaming path based on the graph;

[0121] The three-dimensional scene roaming path predefined perspective module is used to generate a corresponding predefined perspective for each observation node on the VR roaming path.

[0122] Since the system / device described in the above embodiments of the present invention is a system / device used to implement the method of the above embodiments of the present invention, a person skilled in the art can understand the specific structure and deformation of the system / device based on the method described in the above embodiments of the present invention, and thus will not be described in detail here. All systems / devices used in the method of the above embodiments of the present invention belong to the scope of protection of the present invention.

[0123] In addition, an embodiment of the present invention further provides a VR device for virtual reality psychotherapy, including:

[0124] At least one database; and a memory in communication with the at least one database; wherein the memory stores instructions that can be executed by the at least one database, and the instructions are executed by the at least one database so that the at least one database can execute the three-dimensional scene video generation method for a virtual reality psychotherapy system as described above.

[0125] Furthermore, an embodiment of the present invention further provides a computer-readable medium having computer-executable instructions stored thereon, and when the executable instructions are executed by a processor, the three-dimensional scene video generation method for a virtual reality psychotherapy system as described above is implemented.

[0126] In summary, the present invention provides a three-dimensional scene video generation method, system, device and medium for a virtual reality psychotherapy system. The present invention proposes a path generation method based on a three-dimensional scene, which can make full use of the material resources in the three-dimensional scene and generate different virtual reality videos from the path planning level of the three-dimensional scene. At the same time, a suitable virtual reality video is generated for the personalized psychological relaxation therapy of the visitor, which is used in a virtual reality psychological relaxation therapy system based on three-dimensional scene path generation.

[0127] It will be appreciated by those skilled in the art that embodiments of the present invention may be provided as methods, systems or computer program products. Therefore, the present invention may take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware. Furthermore, the present invention may take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0128] The present invention is described with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present invention. It should be understood that each process and / or box in the flowchart and / or block diagram, as well as the combination of the processes and / or boxes in the flowchart and / or block diagram, can be implemented by computer program instructions.

[0129] It should be noted that in the claims, any reference numerals placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claims. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention may be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In the claims enumerating several means, several of these means may be embodied by the same hardware. The use of the words first, second, third, etc., is for convenience of expression only and does not indicate any order. These words may be understood as part of the component name.

[0130] In addition, it should be noted that, in the description of this specification, the description of the terms "one embodiment", "some embodiments", "embodiment", "example", "specific example" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0131] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments after knowing the basic creative concept. Therefore, the claims should be interpreted as including the preferred embodiments and all changes and modifications falling within the scope of the present invention.

[0132] Obviously, those skilled in the art can make various modifications and variations to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention should also include these modifications and variations.

Claims

1. A method for generating three-dimensional scene videos for virtual reality psychotherapy systems, It is characterized in that include: Match the corresponding 3D scene for the user based on the preset 3D scene library; Abstracting the three-dimensional scene into a graph, and determining a VR roaming path based on the graph; For each observation node on the VR roaming path, generating a corresponding predefined perspective; Transmitting the three-dimensional scene, VR roaming path, and predefined viewing angle to a VR device so that a user can interact with the VR device; Abstracting the three-dimensional scene into a graph, and determining a VR roaming path based on the graph includes: Abstract the three-dimensional scene into a graph G(V,E); Randomly select the starting point V i , and away from the starting point V i Path length l±l t Randomly select the end point V j ; Traverse the graph G(V,E) and get the starting point V i and the end point V j There are m paths between them; Calculate the interest values ​​of m paths respectively through the path interest value formula, and select the path with the highest interest value as the VR roaming path P[x]; The path interest value formula is as follows: IC=f(C,CNum) Where C = [c 0 ,c 1 ,...,c n-1 ] is the interest value of different scene elements, n is the number of selected different scene elements, CNum[num 0 ,num 2 ,...,num n-1 ] is the number of scene elements corresponding to C within the set line of sight d, f is the function of calculating the path interest value; V is the set of nodes abstracted from the scene, and E is the set of edges abstracted from the scene.

2. A method for generating a three-dimensional scene video for a virtual reality psychotherapy system as claimed in claim 1, It is characterized in that The 3D scenes that are matched to users based on the preset 3D scene library include: Based on the obtained user identity information, determine whether this is the first time for the user to undergo virtual reality psychotherapy; If the user is undergoing psychological relaxation therapy for the first time, a corresponding three-dimensional scene is matched for the user from a preset three-dimensional scene library based on expert experience and / or prior knowledge; If it is not the first time for the user to undergo psychological relaxation therapy, the scene navigation data of the user is read from a preset database, and the corresponding three-dimensional scene is matched from the three-dimensional scene library in combination with the user's subjective feeling scale in the database.

3. A method for generating a three-dimensional scene video for a virtual reality psychotherapy system as claimed in claim 1, It is characterized in that For each observation node on the VR roaming path, generating a corresponding predefined perspective includes: Set observation nodes on the VR roaming path P[x] at every path length e; The interest value of each observation node at different observation angles is calculated by the interest value formula of the observation angle, and the observation angle with a higher interest value is selected as the predefined viewing angle of the observation node; Determine the roaming angular velocity ψ; The formula for the interest value of the observation angle is: IAC=g(C,ACNum) Among them, ACNum[anum 0 ,anum 2 ,...,anum n-1 ] is the number of scene elements within the visible range R of a certain observation angle of the observation point; g is the function for calculating the interest value of a certain observation angle of the observation point; the binocular field of view of the VR device is ω 0 , the scene x-axis line of sight angle direction is 0 0 , the observation angle is the angle θ between the observation direction and the x-axis.

4. A method for generating a three-dimensional scene video for a virtual reality psychotherapy system as claimed in claim 1, It is characterized in that There are t observation nodes in total on the VR roaming path, and the initial observation node is V 0 , the last observation node is V t-1 ; Each observation node stores the world coordinates of the observation node.

5. A method for generating a three-dimensional scene video for a virtual reality psychotherapy system as claimed in claim 3, It is characterized in that The visible range R is a distance less than or equal to h from the observation point and within the binocular field of view ω 0 The fan-shaped area within, where h is the farthest observable length.

6. A method for generating a three-dimensional scene video for a virtual reality psychotherapy system according to any one of claims 1 to 5, It is characterized in that The method further comprises: After the user stops interacting with the VR device, collecting the user's subjective perception scores of the scene elements and generating a user subjective perception scale; The user's subjective feeling scale and scene roaming data are stored in a preset database.

7. A virtual reality psychotherapy system, It is characterized in that include: A virtual reality interaction module, used to transmit the video data obtained from the three-dimensional scene roaming content generation module to the VR device, so that the user can interact with the VR device; A data collection module, used to generate a user subjective feeling scale based on the collected user's subjective feeling scores of scene elements after the user stops interacting with the VR device, and store the scale in a preset database; A 3D scene roaming content generation module is used to retrieve user subjective feeling data from a preset database and generate a corresponding 3D scene for the user based on the preset 3D scene library; The three-dimensional scene roaming content generation module includes: a three-dimensional scene selection module, a three-dimensional scene roaming path generation module and a three-dimensional scene roaming path predefined viewing angle module; The 3D scene selection module is used to generate a corresponding 3D scene for the user based on a preset 3D scene library; The three-dimensional scene roaming path generation module is used to abstract the three-dimensional scene into a graph, and determine the VR roaming path based on the graph; The three-dimensional scene roaming path predefined perspective module is used to generate a corresponding predefined perspective for each observation node on the VR roaming path; And, abstracting the three-dimensional scene into a graph, and determining a VR roaming path based on the graph includes: Abstract the three-dimensional scene into a graph G(V,E); Randomly select the starting point V i , and away from the starting point V i Path length l±l t Randomly select the end point V j ; Traverse the graph G(V,E) and get the starting point V i and the end point V j There are m paths between them; Calculate the interest values ​​of m paths respectively through the path interest value formula, and select the path with the highest interest value as the VR roaming path P[x]; The path interest value formula is as follows: IC=f(C,CNum) Where C = [c 0 ,c 1 ,...,c n-1 ] is the interest value of different scene elements, n is the number of selected different scene elements, CNum[num 0 ,num 2 ,...,num n-1 ] is the number of scene elements corresponding to C within the set line of sight d, f is the function of calculating the path interest value; V is the set of nodes abstracted from the scene, and E is the set of edges abstracted from the scene.

8. A VR device for virtual reality psychotherapy, It is characterized in that include: at least one database; And a memory communicatively connected to the at least one database; wherein the memory stores instructions executable by the at least one database, and the instructions are executed by the at least one database so that the at least one database can execute the three-dimensional scene video generation method for a virtual reality psychotherapy system as described in any one of claims 1-6.

9. A computer-readable medium having computer-executable instructions stored thereon, It is characterized in that When the executable instructions are executed by the processor, the three-dimensional scene video generation method for a virtual reality psychotherapy system as described in any one of claims 1 to 6 is implemented.

Images