A virtual sandbox system and its application in psychological assessment
Through the virtual sandbox system, combined with AR helmets and physical cards, low-cost, portable, and highly private self- and remote psychological assessments are achieved, solving the problems of high economic cost and lack of privacy in existing technologies, and improving the accuracy and flexibility of psychological assessments.
Patent Information
- Application Number
- CN202210328657.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-03-31
- Publication Date
- 2025-09-09
- Estimated Expiration
- 2042-03-31
AI Technical Summary
In the existing technology, physical sandbox tools have high economic costs in psychological assessment, users cannot afford the economic expenses of augmented reality technology, and are difficult to use independently in remote environments. It is impossible for psychologists to intervene in the assessment at any time, and the privacy and usage scenarios are limited.
A virtual sandbox system is used, including an AR helmet, a virtual sandbox background board and physical cards. Cameras, data processors and displays are used to process video image data and display three-dimensional models. Combined with heart rate sensors and system servers, self- and remote psychological assessments are achieved.
It reduces manufacturing costs and difficulty, improves economy and privacy, and allows users to remotely access the system for assessment via mobile networks, enhancing the sense of immersion and the accuracy of psychological assessments. Psychologists can intervene in the assessment process at any time.
Smart Images

Figure CN114663635B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of medical equipment, and in particular relates to a virtual sandbox system and its application in psychological assessment. Background Art
[0002] Currently, physical sand trays are widely used in the exploration of psychological issues. While physical flat sand trays mostly use models for static representation, augmented reality technology has also been further applied in the sand tray field.
[0003] However, augmented reality technology is rarely used in the field of psychological assessment. Existing technologies typically use four multi-projectors to stitch images together to create an immersive space, and use target detection to track the user's finger position. However, this solution is costly, and currently, the average user cannot afford the financial expenditure of this type of augmented reality technology. Furthermore, in remote environments, the sandbox tools that users can use independently are lackluster, making it difficult to assist psychologists in making detailed judgments remotely. On the other hand, directly using existing augmented reality technology prevents psychologists from intervening in the assessment process at any time, and the overly large projection area makes it difficult to ensure privacy during use, limiting the use scenarios. Summary of the Invention
[0004] In order to overcome one or more defects and shortcomings of the prior art, the first purpose of the present invention is to provide a virtual sandbox system, the second purpose is to provide the application of the virtual sandbox system in the first purpose in self-psychological assessment, and the third purpose is to provide the application of the virtual sandbox system in the first purpose in remote psychological assessment, so that users and doctors can conduct psychological assessments conveniently.
[0005] In order to achieve the above object, the present invention adopts the following technical solutions.
[0006] A virtual sandbox system, including an AR helmet, a virtual sandbox background board, and physical cards;
[0007] The AR helmet includes a camera, a data processor, and a display;
[0008] The camera is used to capture video image data of the virtual sandbox background board and / or physical cards and / or user gestures, and the camera is electrically connected to the data processing machine;
[0009] The data processor is used to store video image data of the virtual sandbox background board and / or physical cards and / or user gestures, recognize the video image data of the virtual sandbox background board and / or physical cards, recognize the trajectory of the user's gestures, convert the video image data of the virtual sandbox background board and / or physical cards into corresponding three-dimensional model data, and analyze the psychological state information conveyed by the video image data of the virtual sandbox background board and / or physical cards and / or user gestures; the data processor is electrically connected to the display;
[0010] The display is used to display the three-dimensional model data and / or video image data corresponding to the virtual sandbox background board and / or the physical cards;
[0011] Virtual sand table background boards and physical cards are used to represent physical content in psychological assessments.
[0012] Preferably, the virtual sandbox system further includes a heart rate sensor, which transmits signals to the data processor and / or the virtual sandbox background board via wireless communication.
[0013] Preferably, a light strip is provided on the background board of the virtual sandbox, and the light strip expresses the user emotions of the AR helmet user through a combination of lighting modes.
[0014] Preferably, the data processing machine includes a local storage module, a local self-assessment module, a virtual conversion module and a gesture recognition module;
[0015] The local storage module is used to store video image data of the virtual sandbox background board and / or physical cards and / or user gestures. The local storage module is electrically connected to the camera and the display, and the local storage module exchanges data with the local self-assessment module, the virtual conversion module, and the gesture recognition module.
[0016] The local self-assessment module is used to automatically analyze the video image data of the virtual sandbox background board and / or the physical cards and / or the user's gestures to obtain the results of the self-psychological assessment;
[0017] The virtual conversion module is used to convert the video image data of the virtual sandbox background board and / or the physical cards into three-dimensional model data and output it to the display for AR display;
[0018] The gesture recognition module is used to recognize user gestures.
[0019] Furthermore, the data processing machine also includes a mobile communication module;
[0020] The mobile communication module is used for wireless communication with the outside, and is electrically connected to the local storage module.
[0021] Preferably, the virtual sandbox system further includes a system server;
[0022] The system server communicates with the data processing machine via the mobile Internet and / or Bluetooth network and / or broadband network, and the system server is used for data transmission and data synchronization with the data processing machine.
[0023] Furthermore, the system server includes a system communication module, a data storage module, and a user self-test module;
[0024] The system communication module is used for data transmission and data synchronization with the data processing machine, and the system communication module is electrically connected to the data storage module;
[0025] The data storage module is used to store the video image data transmitted by the AR helmet, the three-dimensional model data corresponding to the virtual sandbox background board and / or the physical cards. The data storage module interacts with the user self-test module for data;
[0026] The user self-test module is used to automatically analyze the psychological condition of the AR helmet user based on the video image data transmitted by the AR helmet to obtain self-psychological assessment results.
[0027] Furthermore, the system server also includes a physician remote module;
[0028] The physician remote module is used to provide a data interface for remote reading and writing, and the physician remote module interacts with the data storage module for data.
[0029] An application of a virtual sandbox system in self-psychological assessment, comprising any one of the aforementioned virtual sandbox systems;
[0030] The application of the virtual sandbox system in self-psychological assessment includes the following steps:
[0031] Prepare the corresponding virtual sandbox background and physical cards according to the type of psychological problem to be assessed, and display the corresponding operation steps on the display of the AR helmet;
[0032] The camera of the AR helmet takes pictures to obtain the two-dimensional information of the corresponding virtual sandbox background and physical cards, converts the two-dimensional information into the corresponding three-dimensional model, and then displays the three-dimensional model on the monitor;
[0033] The AR helmet's camera captures video, identifies corresponding user gestures, and obtains the placement order of the virtual sandbox background and physical cards;
[0034] The local self-assessment module of the data processing machine combines the information of user gestures, virtual sandbox background board and the placement order of physical cards to perform intelligent psychological analysis and evaluation to obtain the self-assessment results.
[0035] An application of a virtual sandbox system in remote psychological assessment, comprising any of the aforementioned virtual sandbox systems;
[0036] The application of the virtual sandbox system in remote psychological assessment includes the following steps:
[0037] Based on the type of psychological problem to be assessed, the corresponding virtual sandbox background board and three-dimensional model of physical cards, as well as the gamification analysis steps, are set in the physician remote module of the system server. The corresponding data is then sent to the AR helmet for display, prompting the user to make corresponding user gestures according to the prompts of the gamification analysis steps.
[0038] Prepare the corresponding virtual sandbox background board and physical cards, and the AR helmet captures the corresponding video images of the virtual sandbox background board and physical cards as well as the user's gestures;
[0039] The AR helmet transmits the captured video images and user gesture data back to the system server, and the physician remote module performs a remote psychological assessment based on the returned data.
[0040] Compared with the prior art, the technical solution of the present invention has the following beneficial effects:
[0041] Compared with a physical sandbox, the virtual sandbox background board and physical cards are easy to carry, and the manufacturing cost and difficulty are far lower than that of a physical sandbox; compared with existing augmented reality technology, this virtual sandbox system does not require a large projection space and projection equipment, making it highly economical; users can remotely access the system server to interact with a psychologist only when there is a mobile network, and can also use the local self-assessment module to choose to conduct a simple self-assessment directly in a local mode without the intervention of a psychologist, which is highly flexible and improves security and privacy; the integrated integration of the camera, data processor and display eliminates the need for users to be equipped with special operating handles and gesture recognition devices like existing augmented reality technology, while enhancing the sense of immersion, allowing users to more accurately express their emotions and behaviors, and improving the accuracy of psychological assessments; the system server uses the physician remote module to provide an interface for psychologists, combined with the data storage module to realize the function of flexibly setting the assessment process; psychologists can set psychological assessments and psychological treatment plans for users to execute through the system server, realizing intervention and guidance at any time while users use augmented reality technology, avoiding the disadvantage of existing augmented reality technology that requires users to leave the virtual reality environment to receive physician information. BRIEF DESCRIPTION OF THE DRAWINGS
[0042] Figure 1 This is a structural block diagram of a virtual sandbox system of the present invention;
[0043] Figure 2 for Figure 1 Flowchart of the application of virtual sandbox system in self-psychological assessment;
[0044] Figure 3 for Figure 1 A structural diagram of the further optimization of the virtual sandbox system;
[0045] Figure 4 for Figure 3 Flowchart of the application of virtual sandbox system in remote psychological assessment. DETAILED DESCRIPTION
[0046] In order to make the purpose, technical solutions and advantages of the present invention more clearly understood, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments thereof. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.
[0047] Example 1
[0048] like Figure 1 As shown, a virtual sandbox system of this embodiment specifically includes: a system server, an AR helmet, a heart rate sensor, a virtual sandbox background board and physical cards, wherein the AR helmet, heart rate sensor, virtual sandbox background board and physical cards can be designed to be placed in a toolbox to create an effect that is easy to carry and use.
[0049] The virtual sand table backdrop is a flat surface, typically made of cardboard, plastic, or other materials. It displays the two-dimensional image of the sand table, with corresponding three-dimensional models appearing on the virtual sand table backdrop. The virtual sand table backdrop can be sized to accommodate individual use or multi-user interaction, and its dimensions are consistent with the screen size of typical mobile devices for portability.
[0050] The physical cards are a variety of flat cards, and the specific materials used are preferably consistent with the virtual sandbox background board. The physical cards are drawn with two-dimensional information of various physical objects, including people, transportation, buildings, natural scenery, animals, plants, daily necessities, etc. The two-dimensional information of different physical objects corresponds to their three-dimensional models. For example, if the two-dimensional information is a pattern or text of "cow", its three-dimensional model is projected as a three-dimensional graphic of a cow. If the two-dimensional information is blue or green, its three-dimensional model is projected as "ocean" or "grassland". In this way, physical cards are used to represent various different types of actual objects. The virtual sandbox background board is the area where the virtual sandbox three-dimensional model is projected, and the physical cards are the area where the real object three-dimensional model is projected. The three-dimensional model is specifically developed through the Unity platform to ensure its ability to be quickly developed and deployed.
[0051] The virtual sandbox background also includes a light strip, which includes a peripheral circuit for driving the light strip to emit light in different lighting combinations. The peripheral circuit is electrically connected to the heart rate sensor. In this embodiment, the peripheral circuit and the heart rate sensor are preferably connected wirelessly. The heart rate sensor is used to collect the user's heart rate signal for heart rate monitoring and transmit the signal to the peripheral circuit of the light strip. The heart rate signal collected by the heart rate sensor serves as the driving signal for the peripheral circuit to control the light strip's illumination. The heart rate sensor in this embodiment is preferably worn on the user's finger or wrist in the form of a ring or wristband.
[0052] The light strip on the virtual sandbox background board visualizes the user's current emotional characteristics by representing the corresponding heart rate through different lighting methods. In this embodiment, the light strip preferably flashes blue light less than 60 times per minute to represent that the user is depressed, flashes white light 60-100 times per minute to represent that the user is calm, flashes yellow light 100-120 times per minute to represent that the user is excited, and flashes red light more than 120 times per minute to represent that the user is very excited.
[0053] The AR helmet includes a head fixture, a camera, a data processor and a display. The camera, data processor and display are all detachably mounted on the front end of the head fixture. The user wears the entire AR helmet on the head using the head fixture. The distance between the eyeball and the display after the user wears the head fixture is set to 8 cm, thereby achieving the user's naked eye three-dimensional vision effect. The camera is electrically connected to the data processor, and the data processor is electrically connected to the display. The camera is used to capture video images of the light strip, user gestures, virtual sandbox background board, and physical cards. The data processor is used to send, receive and process data. The display is used to output the three-dimensional models of the virtual sandbox and physical cards. In this embodiment, the camera, data processor and display are preferably integrated into the form of a mobile phone in terms of hardware.
[0054] The data processing machine includes a mobile communication module, a local storage module, a local self-assessment module, a virtual conversion module and a gesture recognition module.
[0055] The mobile communication module is used to exchange data with the system server. In this embodiment, data transmission and reception between the mobile communication module and the system server is preferably carried out via mobile internet or Bluetooth communication. The mobile communication module is electrically connected to the local storage module and the heart rate sensor. In this embodiment, the mobile communication module is preferably connected to the peripheral circuits of the light strip via wireless communication, with the data processor serving as a backup communication link forwarding node between the heart rate sensor and the light strip.
[0056] The local storage module is electrically connected to the mobile communication module and the camera for data transmission and reception. It can download 2D information and 3D models of various virtual sandbox backgrounds and physical cards from the system server via the mobile communication module, download physician assessment texts, and upload user information texts. The local storage module also transmits data to the display, local self-assessment module, virtual conversion module, and gesture recognition module. The local storage module is used to store data, including video images captured by the camera, 2D information of the virtual sandbox background and physical cards captured by the camera, the user's heart rate captured by the heart rate sensor, user emotions indicated by lighting changes, 3D models of the virtual sandbox background and physical cards, user gestures captured by the camera, user information texts, physician assessment texts, and gamification analysis data. User information texts and physician assessment texts include, but are not limited to, commonly used texts and tables in the field of psychological assessment and treatment, such as anxiety self-rating scales and medical records. The gamification analysis data includes, but is not limited to, graphical representations of the user's treatment progress and the gamification analysis steps provided by the physician. In this embodiment, the local storage module preferably transmits stored content directly to the display for display, and also immediately outputs corresponding data to the display when the virtual conversion module, gesture recognition module, or local self-assessment module inputs corresponding user data. The various types of user data in the local storage module are mapped and organized according to their relevance.
[0057] The virtual conversion module is used to convert the two-dimensional information of the virtual sandbox background board and physical cards captured by the camera into corresponding three-dimensional models, and then return the results to the local storage module. The local storage module outputs the three-dimensional model of the virtual sandbox, the three-dimensional model of the physical card corresponding to the real object, the captured user gestures and the light strip light to the display for projection, thereby achieving the effect of allowing the projected three-dimensional model to move with the virtual sandbox background board or physical card.
[0058] The gesture recognition module is used to call the user gesture information in the local storage module, and determine the user operation content made by the user based on this information, and then transmit the user operation content to the local storage module, which transmits it to the display.
[0059] The local self-assessment module is used to call the user's heart rate, user gestures and emotions reflected by video images, and the content of user information text in the local storage module, and automatically perform intelligent psychological analysis and assessment of the user's psychological condition based on these contents to obtain a self-assessment result. The self-assessment result is then represented as the corresponding type of content in the user information text and transmitted to the local storage module, which then transmits it to the display.
[0060] The system server includes a system communication module, a data storage module, and a user self-test module.
[0061] The system communication module communicates with the data processor's mobile communication module and also provides physicians with a way to communicate with the system server, either remotely or by logging into the server locally. Whenever the AR headset and the system server communicate, data between the two (user and system) is synchronized automatically or periodically.
[0062] The data storage module is electrically connected to the system communication module and the user self-test module for data transmission. The data storage module is used to store data. The sources of data include video images and user information texts transmitted from the AR helmet, physician evaluation texts established by physicians accessing and logging into the system server, and three-dimensional model data and gamification analysis data set by the system server itself. The data content not only includes the local storage module of the AR helmet. Among them, the three-dimensional model data and gamification analysis data can be constructed locally on the system server and provided to users and physicians for download and update. Physicians and users respectively transmit the latest data generated by each to the data storage module to exchange data between the two to achieve psychological assessment interaction.
[0063] The user self-test module is used to automatically perform intelligent psychological analysis and evaluation on the user's psychological condition based on the video images and other data stored in the data storage module to obtain the evaluation results, and then return the evaluation results to the data storage module in the form of user information text data for other modules to call.
[0064] Compared with the prior art, this embodiment has the following beneficial effects:
[0065] Compared with the physical sandbox, the virtual sandbox background board and physical cards of this virtual sandbox system are easy to carry, and the manufacturing cost and difficulty are much lower than the physical sandbox; compared with the existing augmented reality technology, this virtual sandbox system does not require a large projection space and projection equipment, making it highly economical. At the same time, the AR helmet, heart rate sensor, virtual sandbox background board and physical cards are also easy for users to carry. Users only need to have a mobile network to remotely access the system server to interact with psychologists. They can also use the local self-assessment module to choose to conduct simple self-assessment directly in the local mode without the intervention of a psychologist. It is highly flexible and does not require a large projection space and camera. The imaging equipment also allows users to choose a sufficiently private space for psychological assessment, improving safety and privacy; the integrated integration of cameras, data processors and displays allows users to directly connect user gestures with the actual behavior of operating the virtual sandbox background board and physical cards, without the need for special operating handles and gesture recognition equipment like existing augmented reality technology. At the same time, it enhances the sense of immersion, allowing users to express their emotions and behaviors more accurately, and improves the accuracy of psychological assessment; the system server can be set up directly in the psychologist's office or on the user's side, and then provided for remote access by users or psychologists, making it convenient for users and doctors to flexibly carry out online assessment activities.
[0066] Example 2
[0067] like Figure 2 As shown, this embodiment provides an application of the virtual sandbox system in Example 1 in self-psychological assessment. The specific process of the application includes the following steps in sequence:
[0068] S1. Prepare the corresponding virtual sandbox background and physical cards according to the type of psychological problem to be assessed, and output the corresponding operation steps on the display;
[0069] S2: The camera takes an image, obtains the corresponding two-dimensional information of the virtual sandbox background and physical cards, and inputs it into the local storage module of the data processor. The virtual conversion module of the data processor converts the two-dimensional information into the corresponding three-dimensional model and returns it to the local storage module. The local storage module outputs the three-dimensional model to the display;
[0070] S3: The heart rate sensor monitors the user's heart rate data and uses it to drive the lighting of the light strip on the virtual sand table background board to change. At the same time, the camera captures video and inputs it into the local storage module. The gesture recognition module recognizes the corresponding user gestures, obtains the placement order of the virtual sand table background board and physical cards, and obtains the user's emotions represented by the lighting changes of the light strip;
[0071] S4. After the gesture recognition module recognizes that all corresponding operation steps have been completed, the local self-assessment module obtains the user's gestures, user emotions, the placement order of the virtual sandbox background board and physical cards, and the content of the three-dimensional model from the local storage module, and combines the information of the above four data to perform intelligent psychological analysis and evaluation to obtain a self-assessment result, and then returns the self-assessment result to the data storage module in the form of user information text data;
[0072] S5. The local storage module sends the self-assessment result in the form of user information text data to the display, and synchronizes it to the system server through the mobile communication module.
[0073] Compared with the existing technology, the beneficial effect of this embodiment is that this embodiment achieves the effect of augmented reality through a portable virtual sandbox background board and physical cards, combined with the virtual conversion module and gesture recognition module of the data processing machine, and realizes the rapid self-psychological assessment function on the user side in an economical, convenient and highly private manner, without the need to configure dedicated gesture recognition equipment and projection space.
[0074] Example 3
[0075] like Figure 3 As shown, the virtual sandbox system of this embodiment is a further optimization of embodiment 1. Based on embodiment 1, this embodiment further adds a physician remote module in the system server. The data storage module is electrically connected to the physician remote module.
[0076] The physician remote module is used to provide an operation interface for psychologists. Psychologists can access relevant data in the data storage module through the physician remote module, and write physician evaluation texts and gamification analysis data to the data storage module, thereby enabling psychologists to conduct psychological analysis and psychological intervention on users.
[0077] Compared with the prior art, the present embodiment has the following beneficial effects: the system server uses the physician remote module to provide an interface for the psychologist, and combines the data storage module to realize the function of flexibly setting the evaluation process.
[0078] Example 4
[0079] like Figure 4 As shown, this embodiment provides an application of the virtual sandbox system in Example 1 in remote psychological assessment. The specific process of the application includes the following steps in sequence:
[0080] S1. Based on the type of psychological problem to be assessed, the corresponding virtual sandbox background board and three-dimensional model of the physical cards, as well as the gamification analysis steps (all in the form of graphical data) are set in the physician remote module of the system server. The corresponding data is then stored in the data storage module of the system server, which transmits the data to the AR helmet via the system communication module for display, prompting the user to perform corresponding user gestures according to the prompts of the gamification analysis steps;
[0081] S2. Prepare the virtual sandbox background and physical cards corresponding to step S1, and use the AR helmet to capture video images of the corresponding virtual sandbox background and physical cards, as well as user gestures;
[0082] S3. When the AR helmet recognizes that the user has completed the user gesture corresponding to all the gamification analysis steps, the AR helmet will transmit the captured video images and other data back to the system server. The psychologist will conduct a psychological diagnosis or treatment evaluation based on the returned data on the physician remote module, and generate a physician evaluation text and send it to the data storage module for storage.
[0083] Compared with the prior art, this embodiment has the following beneficial effects:
[0084] Psychologists can set up psychological assessments and psychological treatment plans through the system server and give them to users to execute, so that they can intervene and guide users at any time while they are using augmented reality technology, avoiding the disadvantage of existing augmented reality technology that requires users to leave the virtual reality environment to receive external information.
[0085] The above embodiments are preferred implementation modes of the present invention, but the implementation modes of the present invention are not limited to the above embodiments. Any other changes, modifications, substitutions, combinations, and simplifications that do not deviate from the spirit and principles of the present invention should be considered as equivalent replacement methods and are included in the scope of protection of the present invention.
Claims
1. A virtual sandbox system, characterized in that: Includes AR helmet, virtual sandbox background board and physical cards; The AR helmet includes a camera, a data processor and a display; The camera is used to capture video image data of the virtual sandbox background, the physical cards, and the user's gestures, and the camera is electrically connected to the data processing machine; The data processor is used to store video image data of the virtual sandbox background board, physical cards, and user gestures, recognize the video image data of the virtual sandbox background board and physical cards, recognize the trajectory of the user's gestures, convert the video image data of the virtual sandbox background board and physical cards into corresponding three-dimensional model data, and analyze psychological state information conveyed by the video image data of the virtual sandbox background board, physical cards, and user gestures; the data processor is electrically connected to the display; The data processing machine includes a local storage module, a local self-evaluation module, a virtual conversion module and a gesture recognition module; The local storage module is used to store video image data of the virtual sandbox background board, physical cards and user gestures. The local storage module is electrically connected to the camera and the display respectively, and the local storage module interacts with the local self-assessment module, the virtual conversion module and the gesture recognition module respectively. The local self-assessment module is used to automatically analyze the video image data of the virtual sandbox background board, the physical cards and the user's gestures to obtain the results of the self-psychological assessment; The virtual conversion module is used to convert the video image data of the virtual sandbox background board and the physical cards into three-dimensional model data and output it to the display for AR display; The gesture recognition module is used to recognize user gestures; The display is used to display the virtual sandbox background board, the three-dimensional model data and video image data corresponding to the physical cards; The virtual sandbox background board and the physical cards are both used to represent the physical content in the psychological assessment.
2. The virtual sandbox system according to claim 1, characterized in that: The virtual sandbox system also includes a heart rate sensor, which transmits signals to the data processor and the virtual sandbox background board through wireless communication.
3. The virtual sandbox system according to claim 1, characterized in that: A light strip is provided on the background of the virtual sandbox, and the light strip represents the user's emotions through a combination of lighting modes; The data processing machine and the light strip transmit signals via wireless connection.
4. The virtual sandbox system according to claim 1, characterized in that: The data processing machine also includes a mobile communication module; The mobile communication module is used for wireless communication with the outside, and is electrically connected to the local storage module.
5. The virtual sandbox system according to any one of claims 1 to 4, characterized in that: The virtual sandbox system also includes a system server; The system server communicates with the data processing machine via mobile Internet, Bluetooth network or broadband network, and the system server is used for data transmission and data synchronization with the data processing machine.
6. The virtual sandbox system according to claim 5, characterized in that: The system server includes system communication module, data storage module, and user self-test module; The system communication module is used for data transmission and data synchronization with the data processing machine, and the system communication module is electrically connected to the data storage module; The data storage module is used to store the video image data transmitted by the AR helmet, the three-dimensional model data corresponding to the virtual sandbox background board and the physical cards, and the data storage module interacts with the user self-test module for data; The user self-test module is used to automatically analyze the psychological condition of the AR helmet user based on the video image data transmitted by the AR helmet to obtain a self-psychological assessment result.
7. The virtual sandbox system according to claim 6, characterized in that: The system server also includes a physician remote module; The physician remote module is used to provide a data interface for remote reading and writing, and the physician remote module interacts with the data storage module for data.
8. An application of a virtual sandbox system in self-psychological assessment, characterized in that: A virtual sandbox system according to any one of claims 1 to 4; The application of the virtual sandbox system in self-psychological assessment includes the following steps: Prepare the corresponding virtual sandbox background and physical cards according to the type of psychological problem to be assessed, and display the corresponding operation steps on the display of the AR helmet; The camera of the AR helmet takes pictures to obtain the two-dimensional information of the corresponding virtual sandbox background and physical cards, converts the two-dimensional information into the corresponding three-dimensional model, and then displays the three-dimensional model on the monitor; The AR helmet's camera captures video, identifies corresponding user gestures, and obtains the placement order of the virtual sandbox background and physical cards; The local self-assessment module of the data processing machine combines the information of user gestures, virtual sandbox background board and the placement order of physical cards to perform intelligent psychological analysis and evaluation to obtain the self-assessment results.
9. An application of a virtual sandbox system in remote psychological assessment, characterized in that: A virtual sandbox system according to any one of claims 5 to 7 is provided; The application of the virtual sandbox system in remote psychological assessment includes the following steps: According to the type of psychological problem to be assessed, the corresponding virtual sandbox background board and three-dimensional model of physical cards, as well as the gamification analysis steps, are set in the physician remote module of the system server. The corresponding data is then sent to the AR helmet for display, prompting the user to make corresponding user gestures according to the prompts of the gamification analysis steps; Prepare the corresponding virtual sandbox background board and physical cards, and the AR helmet captures the corresponding video images of the virtual sandbox background board and physical cards as well as the user's gestures; The AR helmet transmits the captured video images and user gesture data back to the system server, and the physician remote module performs a remote psychological assessment based on the returned data.
Citation Information
Patent Citations
Psychoanalysis system and method based on VR (virtual reality) interactive electronic sand table
CN107280693A
Augmented reality display method for real physical model
CN108510592A
Internet of things and virtual reality-based psychological sand disk device and realizing method
CN109431525A
Simulated sand table system
CN109920283A
Psychological testing treatment system based on virtual reality
CN109949896A