Social ability training method based on virtual reality and related device
By evaluating the user's social ability level and personal characteristics tags, personalized virtual social scenes are created, which solves the problem of poor training results caused by fixed virtual reality social scenes in the existing technology, and achieves more flexible and efficient social ability training.
Patent Information
- Application Number
- CN202411017885.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-29
- Publication Date
- 2024-11-26
AI Technical Summary
The existing virtual reality social scenarios are fixed, which cannot meet the personalized social skills needs of different students, affecting the training effect.
By obtaining the user's behavioral data in the preset virtual social scenario, evaluating their social ability levels and personal characteristics tags, create personalized target virtual social scenarios for training.
It improves the flexibility and intelligence of the training system, enhances the user experience, and optimizes the social ability training effect.
Smart Images

Figure CN119027256A_ABST
Abstract
Description
Technical Field
[0001] The present application belongs to the field of computer technology, and specifically relates to a social skills training method based on virtual reality and related devices. Background Art
[0002] At present, good social skills have gradually become one of the training goals of various schools for students. However, the personal situations of each student are different, and it is objectively difficult to build a suitable actual social occasion for all students to practice social skills. Therefore, it is necessary to simulate social occasions by creating virtual scenes, so that students can practice social skills in virtual scenes. However, the virtual scenes in the existing technology are generally fixed scenes, and the strengths of social skills of different students are different, or the social skills of the same student in different social scenes are different. Fixed virtual scenes cannot meet the personalized needs of students, lack flexibility, and affect the training effect. Summary of the invention
[0003] The embodiment of the present application provides a social skills training method and related devices based on virtual reality, in order to create targeted virtual scenes for different students to assist in training students' social skills, improve the flexibility of the system, and enhance the training effect.
[0004] In a first aspect, an embodiment of the present application provides a social skills training method based on virtual reality, which is applied to a server of a virtual reality system, and the method includes:
[0005] Acquiring first behavior data of a user in a preset virtual social evaluation scene, where the virtual social evaluation scene is used to evaluate the social ability of the user;
[0006] determining a first social competence level of the user according to the first behavior data, wherein the first social competence level is used to characterize the social competence of the user before starting social competence training;
[0007] Acquire a personal characteristic tag of the user, where the personal characteristic tag is used to characterize the personal personality and social preference of the user;
[0008] A target virtual social scene is created according to the first social ability level and the personal characteristic tag, and the target virtual social scene is used to train the social ability of the user.
[0009] In a second aspect, an embodiment of the present application provides a social skills training device based on virtual reality, which is applied to a server of a virtual reality system, and the device includes:
[0010] A first receiving unit, configured to obtain first behavior data of a user in a preset evaluation virtual social scene, wherein the evaluation virtual social scene is used to evaluate the social ability of the user;
[0011] A first processing unit is used to determine a first social ability level of the user based on the first behavior data, wherein the first social ability level is used to characterize the social ability of the user before starting social ability training; obtain a personal characteristic label of the user, wherein the personal characteristic label is used to characterize the personal character and social preference of the user; and create a target virtual social scene based on the first social ability level and the personal characteristic label, wherein the target virtual social scene is used to train the social ability of the user.
[0012] In a third aspect, an embodiment of the present application provides a server, comprising a processor, a memory, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the first aspect of the embodiment of the present application.
[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium having a computer program / instructions stored thereon, which, when executed by a processor, implement the steps in the first aspect of the embodiment of the present application.
[0014] In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute part or all of the steps described in the first aspect of the embodiment of the present application.
[0015] It can be seen that in the embodiment of the present application, the server first obtains the first behavior data of the user in the preset evaluation virtual social scene, then determines the first social ability level of the user based on the first behavior data, then obtains the user's personal characteristic label, and finally creates a target virtual social scene based on the first social ability level and the personal characteristic label to train the user's social ability. In this way, the server first collects the student's performance behavior through the preset virtual social scene, thereby making a preliminary evaluation of the student's social ability, and then creates a targeted virtual scene based on the evaluation results to train the user's social ability, so that the student user can perform social training in a personalized scene, which improves the flexibility and intelligence of the system, enhances the training effect, and optimizes the user's experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0016] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0017] Figure 1 is a structural schematic diagram of a virtual reality system provided in an embodiment of the present application;
[0018] Figure 2 is a structural diagram of a server in a virtual reality system provided by an embodiment of the present application;
[0019] Figure 3 is a schematic diagram of the structure of another server in a virtual reality system provided in an embodiment of the present application;
[0020] Figure 4 It is a flowchart of a social skills training method based on virtual reality provided in an embodiment of the present application;
[0021] Figure 5 This is a block diagram of the functional units of a social skills training device based on virtual reality provided in an embodiment of the present application;
[0022] Figure 6 This is a block diagram of the functional units of another social skills training device based on virtual reality provided in an embodiment of the present application;
[0023] Figure 7 It is a structural block diagram of a server provided in an embodiment of the present application. DETAILED DESCRIPTION
[0024] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0025] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0026] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0027] See also Figure 1 , Figure 1 is a structural block diagram of a virtual reality system provided by an embodiment of the present application. Figure 1 As shown, the virtual reality system 100 includes a mobile terminal 110 and a server 120, and the server 120 is connected to the mobile terminal 110 for data exchange. The server 120 can be a server, a server cluster composed of several servers, or a cloud computing service center. The mobile terminal 110 can be a smart phone, a wearable virtual reality device, etc.
[0028] The virtual scenes in the current existing technology are generally fixed scenes, but different students have different social abilities or the same student has different social abilities in different social scenes. Fixed virtual scenes cannot meet the personalized needs of students, lack flexibility, and affect the training effect.
[0029] During daily use of the virtual reality system 100, the server 120 first obtains the user's first behavior data in a preset evaluation virtual social scene, then determines the user's first social ability level based on the first behavior data, then obtains the user's personal characteristic label, and finally creates a target virtual social scene based on the first social ability level and the personal characteristic label to train the user's social ability.
[0030] See also Figure 2 , Figure 2 Schematic diagram of the structure of a server in a virtual reality system provided by an embodiment of the present application. Figure 2As shown, the server 120 includes a behavior data acquisition module 201, a social ability evaluation module 202 and a virtual scene creation module 203, the behavior data acquisition module 201 is communicatively connected to the social ability evaluation module 202, and the virtual scene creation module 203 is communicatively connected to the social ability evaluation module 202.
[0031] The behavior data acquisition module 201 is used to acquire first behavior data of a user in a preset evaluation virtual social scene, where the evaluation virtual social scene is used to evaluate the social ability of the user.
[0032] The social ability evaluation module 202 is used to determine the first social ability level of the user based on the first behavior data, and the first social ability level is used to characterize the social ability of the user before starting social ability training; and to obtain the personal characteristic label of the user, and the personal characteristic label is used to characterize the personal character and social preference of the user.
[0033] The virtual scene creation module 203 is used to create a target virtual social scene according to the first social ability level and the personal characteristic label, and the target virtual social scene is used to train the social ability of the user.
[0034] See also Figure 3 , Figure 3 FIG. 1 is a schematic diagram of the structure of another server in a virtual reality system provided in an embodiment of the present application. Figure 3 As shown, the server 120 includes a processor 310 and a memory 320, and the processor 310 is in communication with the memory 320. Among them, one or more programs are stored in the memory 320, and the one or more programs are configured to be executed by the processor 310. The functions of the one or more programs are to obtain the first behavior data of the user in the preset evaluation virtual social scene, and the evaluation virtual social scene is used to evaluate the social ability of the user; determine the first social ability level of the user according to the first behavior data, and the first social ability level is used to characterize the social ability of the user before starting social ability training; obtain the user's personal characteristic label, and the personal characteristic label is used to characterize the user's personal personality and social preference; create a target virtual social scene according to the first social ability level and the personal characteristic label, and the target virtual social scene is used to train the user's social ability.
[0035] The following describes a social skills training method based on virtual reality provided in an embodiment of the present application.
[0036] See also Figure 4 , Figure 4 is a flow chart of a social skills training method based on virtual reality provided in an embodiment of the present application, which is applied to Figure 1In the server 120 shown in FIG. Figure 4 As shown, the method includes:
[0037] Step S401, obtaining the first behavior data of the user in the preset evaluation virtual social scene.
[0038] The evaluation virtual social scene is used to evaluate the social ability of the user. Specifically, the server sends a pre-created evaluation virtual social scene to the mobile terminal so that the mobile terminal displays the evaluation virtual social scene, and the mobile terminal can collect the user's first behavior data through the evaluation virtual social scene and send the first behavior data to the server.
[0039] The evaluation virtual social scene may be an evaluation virtual social scene that tests multiple dimensions of a user's social ability, and is used to obtain the user's first behavior data in an evaluation virtual social scene; the evaluation virtual social scene may also be a collection of multiple evaluation virtual social scenes that test multiple dimensions of a user's social ability in different social scenes, and is used to obtain multiple first behavior data of the user in multiple evaluation virtual social scenes, and the single first behavior data is used to indicate the user's social ability in a single social scene. Different social scenes may be, for example, meeting discussion scenes, team building scenes, and demonstration and explanation scenes.
[0040] Among them, different social ability dimensions may be, for example, a social initiative dimension, a social immersion dimension, and a communication ability dimension.
[0041] Step S402: determining a first social ability level of the user according to the first behavior data.
[0042] The first social ability level is used to characterize the social ability of the user before starting social ability training.
[0043] The first social ability level may be the first social ability level in one social scenario, or may be a collection of multiple first social ability levels for different social scenarios.
[0044] In a possible embodiment, the first behavior data includes the number of active communications, body movement data, and communication voice data, and determining the first social ability level of the user based on the first behavior data includes: determining the first social positivity level of the user based on the number of active communications, the first social positivity level being used to characterize the social positivity of the user in social scenarios; determining the first social immersion level of the user based on the body movement data, the first social immersion level being used to characterize the body communication ability of the user in social scenarios; determining the first communication ability level of the user based on the communication voice data, the first communication ability level being used to characterize the language communication ability of the user in social scenarios.
[0045] Among them, the mobile terminal can collect the user's active communication times through the camera and microphone, collect the user's body movement data through the motion sensor and camera, and collect the user's communication voice data through the microphone.
[0046] Wherein, determining the first social positivity level of the user according to the number of active communications includes: obtaining a preset communication frequency level comparison table; determining the first social positivity level according to the number of active communications and the communication frequency level comparison table. For example, the communication frequency level comparison table includes: within 1 hour, 0-3 times correspond to a social positivity level of 1, 4-6 times correspond to a social positivity level of 2, and 7-9 times correspond to a social positivity level of 3. If the number of active communications of the user within 1 hour is 5 times, the first social positivity level of the user is 2.
[0047] Among them, determining the first social immersion level of the user based on the limb movement data includes: importing the limb movement data into a preset motion recognition model to obtain the user's limb movements; calculating the user's social immersion index based on the user's limb movements; and determining the first social immersion level based on the social immersion index and a preset social immersion level comparison table.
[0048] Among them, the limb movement data includes eye route data, and the determining of the first social immersion level of the user based on the limb movement data can be, for example: importing the eye route data into a preset action recognition model to obtain the user's eye movement route; calculating the user's social immersion index based on the eye route, for example, calculating the target proportion of the user's eyes staying on the face or eyes of the conversation partner, for example, 60%, and determining the social immersion index based on the target proportion, for example, normalizing the target proportion, such as normalizing to between 0-1, and obtaining a social immersion index of 0.6; looking up in a social immersion comparison table, it is found that the social immersion level corresponding to the social immersion index of 0.6 is level 3, and then the first social immersion level is determined to be level 3.
[0049] It can be seen that in this example, the user's social ability is evaluated in multiple dimensions, and a multi-dimensional social ability evaluation result is obtained, so that student users can conduct social training in personalized scenarios, which improves the flexibility and intelligence of the system, enhances the training effect, and optimizes the user experience.
[0050] In a possible embodiment, determining the first communication ability level of the user based on the communication voice data includes: determining a communication voice text based on the communication voice data; obtaining a preset communication ability evaluation model and a communication ability level comparison table; importing the communication voice text into the communication ability evaluation model to obtain a communication ability index; and determining the first communication ability level based on the communication ability index and the communication ability level comparison table.
[0051] The determining of the communication voice text according to the communication voice data may be, for example, performing voice recognition on the communication voice data.
[0052] The communication ability evaluation model may be a scoring model obtained by using a large amount of voice text and corresponding social ability scores as training data.
[0053] Among them, the communication ability evaluation model can be a ChatGPT model.
[0054] It can be seen that in this example, the user's voice data in social scenarios is evaluated, so that student users can perform social training in personalized scenarios, which improves the flexibility and intelligence of the system, enhances the training effect, and optimizes the user experience.
[0055] Step S403: obtaining the user's personal characteristic tag.
[0056] The personal characteristic tag is used to characterize the user's personal personality and social preference.
[0057] Among them, the personal characteristic label can be obtained by obtaining personal preference information input by the user, inputting the personal preference information into a preset psychological analysis model, outputting the psychological analysis result, and creating a user portrait according to the psychological analysis result. The user portrait includes the personal characteristic keywords, that is, the personal characteristic label.
[0058] In a possible embodiment, the method for obtaining the personal characteristic label includes the following steps: pushing a preset Jung cognitive function test scale to the user; obtaining the user's filled-in content; determining the user's personal function based on the filled-in content, the personal function including perception function and judgment function, the perception function is used to characterize the user's emotional perception ability in social scenarios, and the judgment function is used to characterize the user's thinking and judgment ability in social scenarios; determining the perception differentiation type of the user's perception function, the perception differentiation type includes introverted intuitive type, extroverted intuitive type, introverted sensing type, and extroverted sensing type; determining the judgment differentiation type of the user's judgment function, the judgment differentiation type includes introverted thinking type, extroverted thinking type, introverted feeling type, and extroverted feeling type; determining the user's personality type based on the perception differentiation type and the judgment differentiation type to obtain the personal characteristic label.
[0059] The Jungian cognitive function test scale is a personality test scale based on the psychological type theory of psychologist Carl Jung.
[0060] Wherein, the determining the personality type of the user according to the perception differentiation type and the judgment differentiation type includes: determining the personality type of the user according to the functional ranking of the user's introverted intuitive type (Ni), extroverted intuitive type (Ne), introverted sensing type (Si), extroverted sensing type (Se), introverted thinking type (Ti), extroverted thinking type (Te), introverted feeling type (Fi), and extroverted feeling type (Fe), and the personality type and the corresponding functional ranking are shown in the following table:
[0061]
[0062]
[0063] When it is determined that the personality type of the user is ENFP, the personal characteristic labels of the user include ENFP, striver.
[0064] It can be seen that in this example, by judging the user's personality type and obtaining the user's personal characteristic label, student users can conduct social training in personalized scenarios, which improves the flexibility and intelligence of the system, enhances the training effect, and optimizes the user experience.
[0065] Step S404: creating a target virtual social scene according to the first social ability level and the personal characteristic label.
[0066] The target virtual social scene is used to train the user's social skills.
[0067] The target virtual social scene may be one target virtual social scene, or a collection of multiple target virtual social scenes trained for different social scenes.
[0068] Among them, creating a target virtual social scene according to the first social ability level and the personal characteristic label includes creating a target virtual social scene according to the first social ability level and personal characteristic label of at least one student user among multiple student users, and the at least one student user is a student user with the same first social ability level and / or personal characteristic label among the multiple student users.
[0069] Among them, the at least one student user can also be a student user among the multiple student users who has the same first social ability level and complementary personal characteristic labels; among them, student users with complementary personal characteristic labels refer to student users whose personal characteristic labels have a complementary relationship, for example: student user A with a personal characteristic label of ENFP and a student user with a personal characteristic label of INTP have a complementary relationship, and student user C with a personal characteristic label of ISFP and a student user with a personal characteristic label of ENFJ have a complementary relationship. The complementary relationship can be queried in a preset complementary relationship table. Student users with complementary relationships can drive each other in the target virtual social scene, thereby enhancing the training effect.
[0070] In a possible embodiment, creating a target virtual social scene based on the first social ability level and the personal characteristic label includes: obtaining a preset virtual scene material library, the virtual scene material library including multiple scene materials and a material relationship comparison table, the multiple scene materials including a digital human, and the material relationship comparison table is used to characterize the first social ability level and personal characteristic label corresponding to a single scene material; determining a target virtual social scene material set in the virtual scene material library based on the first social ability level, the personal characteristic label and the material relationship comparison table; and creating the target virtual social scene based on the target virtual social scene material set.
[0071] Among them, a single scene material corresponds to at least one personal characteristic label. For example, the scene material of a group discussion table with four people corresponds to the personal characteristic labels ISTJ / ISFJ / INTJ / INFJ / ISTP / INTP / ISFP / INFP.
[0072] Among them, the target virtual social scene material set is determined in the virtual scene material library according to the first social ability level, the personal characteristic label and the material relationship comparison table. For example, it can be: when the user's first social ability level is level 1 and the user's personal characteristic label is INFP, a search is performed in the material relationship comparison table to filter out virtual scene materials with the first social ability level of level 1 and corresponding to INFP from the virtual scene material library.
[0073] The creating of the target virtual social scene according to the target virtual social scene material set refers to adding the scene materials included in the target virtual social scene material set to the basic virtual scene. For example, the basic virtual scene is an empty room, and the target virtual social scene materials include the decoration style of the activity room, a 4-person group discussion table, digital person No. 1 with a personality type of ENFP, digital person No. 2 with a personality type of ISTJ, and digital person No. 3 with a personality type of ESFP. The decoration style of the activity room, the 4-person group discussion table, digital person No. 1 with a personality type of ENFP, digital person No. 2 with a personality type of ISTJ, and digital person No. 3 with a personality type of ESFP are added to the empty room.
[0074] It can be seen that in this example, by screening out virtual scene materials corresponding to the user's social ability level and personal characteristics to create a target virtual social scene, student users can conduct social training in personalized scenes, which improves the flexibility and intelligence of the system, enhances the training effect, and optimizes the user experience.
[0075] In a possible embodiment, the first social ability level includes a first social positivity level, a first social immersion level, and a first communication ability level. The determining a target virtual social scene material set in the virtual scene material library according to the first social ability, the personal characteristic label, and the material relationship comparison table includes: obtaining a preset first priority level of the first social positivity level, a second priority level of the first social immersion level, a third priority level of the first communication ability level, and a fourth priority level of the personal characteristic label; sorting the multiple scene materials in the virtual scene material library according to the first social positivity level, the first social immersion level, the first communication ability level, the personal characteristic label, and the material relationship comparison table to obtain a scene material sequence, wherein the scene material sequence is a sequence obtained by sorting the multiple scene materials under a first arrangement condition constraint, wherein the first arrangement condition refers to a first arrangement constraint relationship between the multiple scene materials, and the first arrangement constraint relationship is used to characterize a priority arrangement order of the first priority level, the second priority level, the third priority level, and the fourth priority level; and determining the target virtual social scene material set according to the scene material sequence.
[0076] Among them, according to the first social positivity level, the first social immersion level, the first communication ability level, the personal characteristic label and the material relationship comparison table, the multiple scene materials in the virtual scene material library are sorted to obtain a scene material sequence. For example, it can be: if the user's first social positivity level is level 1, the first social immersion level is level 2, the first communication ability level is level 3, the personal characteristic label is INFP, and the first priority level is level A, the second priority level is level B, the third priority level is level C, and the fourth priority level is level D, then, the first scene material with the corresponding personal characteristic label of INFP in the multiple scene materials is arranged at the front of the multiple scene materials, the second scene material with the corresponding communication ability level of 3 in the first scene material is arranged at the front of the first scene material, the third scene material with the corresponding social immersion level of 2 in the second scene material is arranged at the front of the second scene material, and the fourth scene material with the corresponding social positivity level of 1 in the third scene material is arranged at the front of the third scene material to obtain a scene material sequence.
[0077] The step of determining the target virtual social scene material set according to the scene material sequence may, for example, be: determining the top 10 scene materials in the scene material sequence as the target virtual social scene material set.
[0078] It can be seen that in this example, the materials in the virtual scene material library are sorted and screened according to the user's first social ability level and the user's personal characteristic label, so as to obtain the target virtual social scene that best suits the user's actual characteristics, enabling student users to conduct social training in personalized scenes, thereby improving the flexibility and intelligence of the system, enhancing the training effect, and optimizing the user experience.
[0079] In a possible embodiment, after creating the target virtual social scene according to the first social ability level and the personal characteristic label, the method further includes: obtaining second behavior data of the user in the target virtual social scene; determining the second social ability level of the user according to the second behavior data, the second social ability level being used to characterize the social ability of the user after social ability training; and updating the target virtual social scene according to the second social ability level and the personal characteristic label, so that changes in the target virtual social scene are synchronized with changes in the social ability of the user.
[0080] Among them, the obtaining of the second behavior data of the user in the target virtual social scene is performed after a target time period, and the target time period may be, for example, 7 days later; or, the obtaining of the second behavior data of the user in the target virtual social scene is performed after completing a target number of social ability training times, and the target number of social ability training times may be, for example, 3 times.
[0081] Among them, updating the target virtual social scene according to the second social ability level and the personal characteristic label so that the change of the target virtual social scene is synchronized with the change of the user's social ability refers to repeating the step of determining the target virtual social scene material set in the virtual scene material library according to the first social ability, personal characteristic label and the material relationship comparison table described in the above embodiment according to the second social ability level and the personal characteristic label.
[0082] It can be seen that in this example, after the user receives social training in the target virtual social scene, the target virtual social scene is updated according to the user's social ability and personal characteristic labels after the social training, so that the target virtual social scene changes synchronously with the user's social ability, allowing student users to conduct social training in personalized scenarios, improving the flexibility and intelligence of the system, enhancing the training effect, and optimizing the user experience.
[0083] It can be seen that in the embodiment of the present application, the server first obtains the first behavior data of the user in the preset evaluation virtual social scene, then determines the first social ability level of the user based on the first behavior data, then obtains the user's personal characteristic label, and finally creates a target virtual social scene based on the first social ability level and the personal characteristic label to train the user's social ability. In this way, the server first collects the student's performance behavior through the preset virtual social scene, thereby making a preliminary evaluation of the student's social ability, and then creates a targeted virtual scene based on the evaluation results to train the user's social ability, so that the student user can perform social training in a personalized scene, which improves the flexibility and intelligence of the system, enhances the training effect, and optimizes the user's experience.
[0084] In accordance with the above-mentioned embodiments, please refer to Figure 5 , Figure 5 is a block diagram of the functional units of a social skills training device based on virtual reality provided in an embodiment of the present application, such as Figure 5As shown, the social ability training device 500 based on virtual reality includes: a first receiving unit 501, used to obtain first behavior data of a user in a preset evaluation virtual social scene, and the evaluation virtual social scene is used to evaluate the social ability of the user; a first processing unit 502, used to determine the first social ability level of the user according to the first behavior data, and the first social ability level is used to characterize the social ability of the user before starting social ability training; obtain the personal characteristic label of the user, and the personal characteristic label is used to characterize the personal character and social preference of the user; create a target virtual social scene according to the first social ability level and the personal characteristic label, and the target virtual social scene is used to train the social ability of the user.
[0085] In one possible example, in terms of creating a target virtual social scene based on the first social ability level and the personal characteristic label, the first processing unit 502 is specifically used to: obtain a preset virtual scene material library, the virtual scene material library including multiple scene materials and a material relationship comparison table, the material relationship comparison table being used to characterize the first social ability level and personal characteristic label corresponding to a single scene material; determine a target virtual social scene material set in the virtual scene material library based on the first social ability level, the personal characteristic label and the material relationship comparison table; and create the target virtual social scene based on the target virtual social scene material set.
[0086] In a possible example, the first social ability level includes a first social positivity level, a first social immersion level, and a first communication ability level. In determining the target virtual social scene material set in the virtual scene material library according to the first social ability, the personal characteristic label, and the material relationship comparison table, the first processing unit 502 is specifically used to: obtain a preset first priority level of the first social positivity level, a second priority level of the first social immersion level, a third priority level of the first communication ability level, and a fourth priority level of the personal characteristic label; sort the multiple scene materials in the virtual scene material library according to the first social positivity level, the first social immersion level, the first communication ability level, the personal characteristic label, and the material relationship comparison table to obtain a scene material sequence, wherein the scene material sequence is a sequence obtained by sorting the multiple scene materials under the constraint of a first arrangement condition, wherein the first arrangement condition refers to a first arrangement constraint relationship between the multiple scene materials, and the first arrangement constraint relationship is used to characterize the priority arrangement order of the first priority level, the second priority level, the third priority level, and the fourth priority level; and determine the target virtual social scene material set according to the scene material sequence.
[0087] In a possible example, the method for obtaining the personal characteristic label includes the following steps: pushing a preset Jung cognitive function test scale to the user; obtaining the user's filled-in content; determining the user's personal function based on the filled-in content, the personal function including perception function and judgment function, the perception function is used to characterize the user's emotional perception ability in social scenarios, and the judgment function is used to characterize the user's thinking and judgment ability in social scenarios; determining the perception differentiation type of the user's perception function, the perception differentiation type includes introverted intuitive type, extroverted intuitive type, introverted sensing type, and extroverted sensing type; determining the judgment differentiation type of the user's judgment function, the judgment differentiation type includes introverted thinking type, extroverted thinking type, introverted feeling type, and extroverted feeling type; determining the user's personality type based on the perception differentiation type and the judgment differentiation type to obtain the personal characteristic label.
[0088] In a possible example, the first behavior data includes the number of active communications, body movement data, and communication voice data. In terms of determining the first social ability level of the user based on the first behavior data, the first processing unit 502 is specifically used to: determine the first social positivity level of the user based on the number of active communications, the first social positivity level is used to characterize the social positivity of the user in social scenarios; determine the first social immersion level of the user based on the body movement data, the first social immersion level is used to characterize the body communication ability of the user in social scenarios; determine the first communication ability level of the user based on the communication voice data, the first communication ability level is used to characterize the language communication ability of the user in social scenarios.
[0089] In one possible example, in terms of determining the first communication ability level of the user based on the communication voice data, the first processing unit 502 is specifically used to: determine the communication voice text based on the communication voice data; obtain a preset communication ability evaluation model and a communication ability level comparison table; import the communication voice text into the communication ability evaluation model to obtain a communication ability index; and determine the first communication ability level based on the communication ability index and the communication ability level comparison table.
[0090] In one possible example, after creating the target virtual social scene according to the first social ability level and the personal characteristic label, the virtual reality-based social ability training device 500 is further used to: obtain second behavior data of the user in the target virtual social scene; determine the second social ability level of the user according to the second behavior data, the second social ability level being used to characterize the social ability of the user after social ability training; and update the target virtual social scene according to the second social ability level and the personal characteristic label, so that changes in the target virtual social scene are synchronized with changes in the user's social ability.
[0091] It can be understood that since the method embodiment and the device embodiment are different presentation forms of the same technical concept, the content of the method embodiment part in this application should be synchronously adapted to the device embodiment part and will not be repeated here.
[0092] In the case of an integrated unit, such as Figure 6 As shown, Figure 6 This is a functional unit block diagram of another social skills training device based on virtual reality provided by an embodiment of the present application. Figure 6 In the embodiment, the social skills training device 500 based on virtual reality includes: a communication module 611 and a processing module 612. The processing module 612 is used to control and manage the actions of the device, for example, to execute the steps of the first receiving unit 501 and the first processing unit 502, and / or to execute other processes of the technology described herein. The communication module 611 is used to support the interaction between the device and other devices. Figure 6 As shown, the social skills training device 500 based on virtual reality may further include a storage module 613, and the storage module 613 is used to store program codes and data of the device.
[0093] Among them, the processing module 612 can be a processor or a controller, for example, a central processing unit (CPU), a general processor, a digital signal processor (DSP), an ASIC, an FPGA or other programmable logic device, a transistor logic device, a hardware component or any combination thereof. It can implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements a computing function, for example, a combination of one or more microprocessors, a combination of a DSP and a microprocessor, and the like. The communication module 611 can be a transceiver, an RF circuit or a communication interface, and the like. The storage module 613 can be a memory.
[0094] Among them, all relevant contents of each scenario involved in the above method embodiment can be referred to the functional description of the corresponding functional module, and will not be repeated here. The above social ability training device based on virtual reality can execute the above Figure 4 The social skills training method based on virtual reality is shown.
[0095] The above embodiments can be implemented in whole or in part by software, hardware, firmware or any other combination. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions or computer programs. When the computer instructions or computer programs are loaded or executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website site, computer, server or data center to another website site, computer, server or data center by wired or wireless means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that contains one or more available media sets. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium. The semiconductor medium can be a solid-state hard disk.
[0096] See also Figure 7 , Figure 7 is a structural block diagram of a server provided in an embodiment of the present application. Figure 7 As shown, the server 120 may include one or more of the following components: a processor 310, and a memory 320 coupled to the processor 310, wherein the memory 320 may store one or more computer programs 321, and the one or more computer programs 321 may be configured to implement the methods described in the above embodiments when executed by one or more processors 310.
[0097] The processor 310 may include one or more processing cores. The processor 310 uses various interfaces and lines to connect the various parts of the entire server 120, and executes various functions and processes data of the server 120 by running or executing instructions, programs, code sets or instruction sets stored in the memory 320, and calling data stored in the memory 320. Optionally, the processor 310 can be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), and programmable logic array (PLA). The processor 310 can integrate one or a combination of a central processing unit (CPU), a graphics processing unit (GPU), and a modem. Among them, the CPU mainly processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing display content; and the modem is used to process wireless communications. It can be understood that the above-mentioned modem may not be integrated into the processor 310, but may be implemented separately through a communication chip.
[0098] The memory 320 may include a random access memory (RAM) or a read-only memory (ROM). The memory 320 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 320 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The data storage area may also store data created by the server 120 during use, etc.
[0099] It is understandable that the server 120 may include more or fewer structural elements than those in the above structural block diagram, which is not limited here. The present application embodiment provides a computer-readable storage medium on which a computer program / instruction is stored, and when the computer program / instruction is executed by a processor, the steps of the method described in any possible embodiment are implemented.
[0100] An embodiment of the present application also provides a computer storage medium, on which a computer program / instruction is stored. When the computer program / instruction is executed by a processor, part or all of the steps of any method recorded in the above method embodiments are implemented.
[0101] An embodiment of the present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute part or all of the steps of any method recorded in the above method embodiments.
[0102] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0103] In the several embodiments provided in the present application, it should be understood that the disclosed methods and devices can be implemented in other ways. For example, the device embodiments described above are merely schematic; for example, the division of the units is only a logical function division, and there may be other division methods in actual implementation; for example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interfaces, devices or units, which can be electrical, mechanical or other forms.
[0104] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0105] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may be physically included separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of hardware plus software functional units.
[0106] The above-mentioned integrated unit implemented in the form of a software functional unit can be stored in a computer-readable storage medium. The above-mentioned software functional unit is stored in a storage medium, including a number of instructions for a computer device to perform some steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: a USB flash drive, a mobile hard disk, a magnetic disk, an optical disk, a volatile memory or a non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct rambus RAM (DR RAM), etc., various media that can store program code.
[0107] Although the present invention is disclosed as above, the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions without departing from the spirit and scope of the present invention, and can make various changes and modifications, including the combination of the above-mentioned different functions and implementation steps, including software and hardware implementation methods, all of which are within the scope of protection of the present invention.
Claims
1. A social skills training method based on virtual reality, characterized in that: A server applied to a virtual reality system, the method comprising: Acquiring first behavior data of a user in a preset virtual social evaluation scene, where the virtual social evaluation scene is used to evaluate the social ability of the user; determining a first social competence level of the user according to the first behavior data, wherein the first social competence level is used to characterize the social competence of the user before starting social competence training; Acquire a personal characteristic tag of the user, where the personal characteristic tag is used to characterize the personal personality and social preference of the user; A target virtual social scene is created according to the first social ability level and the personal characteristic tag, and the target virtual social scene is used to train the social ability of the user.
2. The method according to claim 1, characterized in that The step of creating a target virtual social scene according to the first social ability level and the personal characteristic label includes: Acquire a preset virtual scene material library, the virtual scene material library including a plurality of scene materials and a material relationship comparison table, the plurality of scene materials including a digital human, the material relationship comparison table being used to characterize a first social ability level and a personal characteristic label corresponding to a single scene material; Determine a target virtual social scene material set in the virtual scene material library according to the first social ability level, the personal characteristic label and the material relationship comparison table; The target virtual social scene is created according to the target virtual social scene material set.
3. The method according to claim 2, characterized in that The first social ability level includes a first social positivity level, a first social immersion level, and a first communication ability level. The step of determining a target virtual social scene material set in the virtual scene material library according to the first social ability, the personal characteristic label, and the material relationship comparison table includes: Obtaining a preset first priority level of the first social positivity level, a second priority level of the first social immersion level, a third priority level of the first communication ability level, and a fourth priority level of the personal characteristic label; According to the first social positivity level, the first social immersion level, the first communication ability level, the personal characteristic label and the material relationship comparison table, the multiple scene materials in the virtual scene material library are sorted to obtain a scene material sequence, wherein the scene material sequence is a sequence obtained by sorting the multiple scene materials under the constraint of a first arrangement condition, wherein the first arrangement condition refers to a first arrangement constraint relationship of the multiple scene materials, and the first arrangement constraint relationship is used to characterize a priority arrangement order of the first priority level, the second priority level, the third priority level and the fourth priority level; The target virtual social scene material set is determined according to the scene material sequence.
4. The method according to claim 3, characterized in that The method for obtaining the personal characteristic label comprises the following steps: Pushing a preset Jungian cognitive function test scale to the user; Obtaining the user's filled-in content; Determine the user's personal function according to the filled content, the personal function includes a perception function and a judgment function, the perception function is used to characterize the user's emotional perception ability in social scenarios, and the judgment function is used to characterize the user's thinking and judgment ability in social scenarios; Determining a perceptual differentiation type of the perceptual function of the user, wherein the perceptual differentiation type includes an introverted intuitive type, an extroverted intuitive type, an introverted sensing type, and an extroverted sensing type; Determining a judgment differentiation type of the judgment function of the user, wherein the judgment differentiation type includes an introverted thinking type, an extroverted thinking type, an introverted feeling type, and an extroverted feeling type; The personality type of the user is determined according to the perception differentiation type and the judgment differentiation type to obtain the personal characteristic label.
5. The method according to claim 4, characterized in that The first behavior data includes the number of active communication times, body movement data, and communication voice data. The determining the first social ability level of the user according to the first behavior data includes: Determining the first social positivity level of the user according to the number of active communications, where the first social positivity level is used to characterize the social positivity of the user in a social scenario; Determining the first social immersion level of the user according to the limb movement data, where the first social immersion level is used to characterize the limb communication ability of the user in a social scene; The first communication ability level of the user is determined according to the communication voice data, where the first communication ability level is used to characterize the language communication ability of the user in a social scenario.
6. The method according to claim 5, characterized in that The determining the first communication ability level of the user according to the communication voice data includes: Determining a communication voice text according to the communication voice data; Obtain the preset communication ability evaluation model and communication ability level comparison table; Importing the communication speech text into the communication ability evaluation model to obtain a communication ability index; The first communication ability level is determined according to the communication ability index and the communication ability level comparison table.
7. The method according to claim 6, characterized in that After creating the target virtual social scene according to the first social ability level and the personal characteristic label, the method further includes: Acquiring second behavior data of the user in the target virtual social scene; determining a second social competence level of the user according to the second behavior data, wherein the second social competence level is used to characterize the social competence of the user after social competence training; The target virtual social scene is updated according to the second social ability level and the personal characteristic tag, so that changes in the target virtual social scene are synchronized with changes in the social ability of the user.
8. A social skills training device based on virtual reality, characterized in that: A server applied to a virtual reality system, the device comprising: A first receiving unit, configured to obtain first behavior data of a user in a preset evaluation virtual social scene, wherein the evaluation virtual social scene is used to evaluate the social ability of the user; A first processing unit is used to determine a first social ability level of the user based on the first behavior data, wherein the first social ability level is used to characterize the social ability of the user before starting social ability training; obtain a personal characteristic label of the user, wherein the personal characteristic label is used to characterize the personal character and social preference of the user; and create a target virtual social scene based on the first social ability level and the personal characteristic label, wherein the target virtual social scene is used to train the social ability of the user.
9. A server, characterized in that: The method comprises a processor, a memory and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.
10. A computer-readable storage medium having a computer program / instruction stored thereon, characterized in that: When the computer program / instructions are executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.
