Virtual reality tactile feedback interaction system

Abstract

The invention relates to the technical field of virtual reality tactile feedback interaction, and discloses a virtual reality tactile feedback interaction system which comprises a contact module, a sensing module and a sensing information extraction and information feedback module. The contact module is arranged to be an electrical stimulation device and a flexible electrode array, the contact module is connected with the sensing module, and the contact module is used for collecting the reaction of people in contact with different objects and events in a virtual environment and providing the feeling close to reality for people; the sensing module comprises a corresponding driving circuit and is used for generating a signal representing parameters in the current virtual environment, and the skin of people is in contact with the virtual environment through the sensing module; the perceptual information extraction is used for tactile sensing, olfactory sensing and auditory sensing respectively; the information feedback module comprises a head-mounted virtual projection device, stimulation and tactile feedback are generated on the human body through an electrical stimulation device and a flexible electrode array, and rendered information is processed and transmitted to the feedback module.

Description

Technical Field

[0001] The present invention relates to the field of virtual reality touch interaction technology, and more specifically, to a virtual reality tactile feedback interaction system. Background Art

[0002] With the advancement of science and technology, virtual reality (VR) technology has gained widespread application, particularly in gaming, film, education, remote control, and healthcare. VR technology holds broad promise. It is an advanced human-computer interaction technology that effectively simulates human vision, hearing, and movement in a natural environment. VR technology uses computer graphics to construct a virtual environment and, with the help of appropriate hardware devices such as data gloves, head-mounted displays, or stereoscopic glasses, provides sensory stimulation for sight, hearing, touch, and smell. This immerses users in the virtual environment and creates a sense of immersion. Electrotactile feedback interaction system technology is a method for tactile perception in VR.

[0003] In practical applications, virtual reality usually collects information and provides feedback based on people's sense of touch, vision, and hearing. Although people's sense of touch can be triggered by objects or events in the virtual environment, existing virtual reality interaction technology is difficult to provide people with a good olfactory experience, which reduces the effect of people's virtual experience. Summary of the Invention

[0004] In order to overcome the deficiencies of the prior art, the present invention provides a virtual reality tactile feedback interaction system, which has the advantage of more precise operation.

[0005] To achieve the above-mentioned object, the present invention provides the following technical solutions: a virtual reality tactile feedback interaction system, comprising: a contact module, a sensing module, a perception information extraction and information feedback module; The contact module is respectively configured as an electrical stimulation device and a flexible electrode array. The contact module is connected to the sensing module and is used to collect people's reactions to different objects and events in the virtual environment, providing people with a feeling close to reality; the sensing module includes a corresponding driving circuit for generating a signal representing the parameters in the current virtual environment, and bringing people's skin into contact with the virtual environment through the sensing module; the perceptual information extraction is respectively targeted at tactile sensing, olfactory sensing and auditory sensing, thereby extracting people's perceptual information from multiple aspects, and identifying and transmitting the extracted perceptual information; the information feedback module includes a head-mounted virtual projection device, which stimulates the human body and provides tactile feedback through an electrical stimulation device and a flexible electrode array, and releases sounds and different smells to people according to events in the virtual environment. The rendered information is processed and transmitted to the feedback module.

[0006] As an optimal technical solution of the present invention, the contact module is in contact with people's skin by hand-held and pasted methods, and the head-mounted virtual projection device contacts people's olfactory and auditory senses; it has effects on people's touch, smell and hearing.

[0007] As a preferred technical solution of the present invention, after receiving the signal from the contact module, the sensing module collects the information through the provided driving circuit. The sensing module stores the collected contact signal, thereby facilitating processing of the collected signal.

[0008] As a preferred technical solution of the present invention, the sensing module is provided with a storage module, which stores a large amount of collected information, and stores the sensing information and the extracted data of the perception information respectively, to prevent the loss of information data.

[0009] As a preferred technical solution of the present invention, the perceptual information extraction is performed through different sensing devices when performing sensing extraction on touch, smell and hearing respectively; maintaining a clear division of labor and improving the efficiency of perception and extraction.

[0010] As a preferred technical solution of the present invention, the signal data of tactile perception are collected by an electrical stimulation device and a flexible electrode array, and the olfactory sensing and auditory sensing are collected and extracted by a head-mounted virtual projection device; the touch, smell and hearing are divided into two parts for collection, which facilitates accurate feedback.

[0011] As a preferred technical solution of the present invention, after the perception information is extracted, the information features are identified and feedback is given corresponding to different perception positions. Only feedback corresponding to different perceptions can be identified, which can improve the accuracy of feedback.

[0012] As a preferred technical solution of the present invention, the rendering and information transmission include a virtual agent model and a potential field model, maintaining real-time data transmission to the information feedback module; and enhancing people's virtual display experience.

[0013] As a preferred technical solution of the present invention, the information feedback module provides tactile feedback to the user through vibration and force action, while the sense of smell and hearing are provided through gas and sound, thereby improving the realism of people's virtual reality interaction.

[0014] As a preferred technical solution of the present invention, the flexible electrode array is distributed in a rectangular array at the output end of the electrical stimulation device, and the electrical pulse parameters of the electrical stimulation device are adjusted and controlled according to people's conditions, preventing people from being injured when experiencing virtual reality interaction.

[0015] Compared with the existing technology, the beneficial effects of the present invention are as follows: by adding olfactory and auditory perception in addition to tactile perception during virtual reality interaction, people's experience in virtual display interaction can be greatly enhanced, wherein the sense of touch is set as a separate part, and the sense of smell and hearing are divided into the same part. By collecting, rendering and feedback information for the sense of touch separately, the proportion of tactile perception is increased, and people's personal experience is enhanced. The sense of smell and hearing are respectively intervened by gas and sound, which further optimizes the user's experience in the virtual reality interaction process. According to the contact of the user in the virtual environment or event, the same taste and sound are corresponding, which increases the contact points of virtual reality interaction and can bring users a good interactive experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a schematic diagram of the overall module of the present invention; DETAILED DESCRIPTION

[0017] The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0018] like Figure 1 As shown, the present invention provides a virtual reality tactile feedback interaction system, comprising: a contact module, a sensing module, a perception information extraction and information feedback module; The contact module is respectively configured as an electrical stimulation device and a flexible electrode array. The contact module is connected to the sensing module and is used to collect people's reactions to different objects and events in the virtual environment, providing people with a feeling close to reality; the sensing module includes a corresponding driving circuit for generating a signal representing the parameters in the current virtual environment, and bringing people's skin into contact with the virtual environment through the sensing module; the perceptual information extraction is respectively targeted at tactile sensing, olfactory sensing and auditory sensing, thereby extracting people's perceptual information from multiple aspects, and identifying and transmitting the extracted perceptual information; the information feedback module includes a head-mounted virtual projection device, which stimulates the human body and provides tactile feedback through an electrical stimulation device and a flexible electrode array, and releases sounds and different smells to people according to events in the virtual environment. The rendered information is processed and transmitted to the feedback module.

[0019] The contact module is in contact with people's skin by hand-held and pasted manner, and the head-mounted virtual projection device contacts people's olfactory and auditory senses, producing effects on people's touch, smell and hearing.

[0020] After receiving the signal from the contact module, the sensing module collects the information through the provided driving circuit. The sensing module stores the collected contact signal, which facilitates processing of the collected signal.

[0021] The sensing module is provided with a storage module, which stores a large amount of collected information, and stores the sensing information and the extracted data of the perception information respectively, to prevent the loss of information data.

[0022] Among them, the perception information extraction is performed through different sensing devices when performing sensing extraction on touch, smell and hearing respectively; maintaining a clear division of labor and improving the efficiency of perception and extraction.

[0023] Among them, the signal data of tactile perception are collected by the electrical stimulation device and the flexible electrode array, and the olfactory sensing and auditory sensing are collected and extracted by the head-mounted virtual projection device; the touch, smell and hearing are divided into two parts for collection, which facilitates accurate feedback.

[0024] After the perception information is extracted, the information features are identified and feedback is given corresponding to different perception positions. Only feedback corresponding to different perceptions can be identified, which can improve the accuracy of the feedback.

[0025] The rendering and information transmission include a virtual agent model and a potential field model, maintaining real-time data transmission to the information feedback module and enhancing people's virtual display experience.

[0026] The information feedback module provides tactile feedback to the user through vibration and force action, while the sense of smell and hearing are provided through gas and sound, thereby improving the realism of people's virtual reality interaction.

[0027] The flexible electrode array is distributed in a rectangular array at the output end of the electrical stimulation device, and the electrical pulse parameters of the electrical stimulation device are adjusted and controlled according to people's conditions, preventing people from being injured when experiencing virtual reality interaction.

[0028] In the above embodiment, the flexible electrode array is set on the user by hand-holding and sticking, the electric stimulation device is adjusted to the appropriate electric pulse parameters, and the user is connected to the interior of the virtual environment through the contact module, so that the user can personally experience the interaction between the virtual environment and the display. The sensing module collects the sensory information in the virtual environment and stores it in the storage module. The collected perceptual information that requires interaction is extracted through the storage module. After the tactile, olfactory and auditory perception data are extracted respectively, the information features are identified, and the information is identified as tactile, olfactory and auditory and split. The flexible electrode array can directly provide feedback to the user's skin senses, while the olfactory and auditory perceptions are fed back through the head-mounted virtual projection device. Before the information is fed back, it needs to be rendered and transmitted through the rendering model to transmit the user's tactile, olfactory and auditory respectively. Finally, the information feedback module provides feedback on the user's interaction.

[0029] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus.

[0030] While embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions, and variations may be made to these embodiments without departing from the principles and spirit of the invention, and that the scope of the invention is defined by the appended claims and their equivalents.

Claims

1. A virtual reality tactile feedback interaction system, characterized in that: It includes: contact module, sensing module, perception information extraction and information feedback module; The contact module is respectively configured as an electrical stimulation device and a flexible electrode array, and the contact module is connected to the sensing module to collect people's reactions to contact with different objects and events in the virtual environment, providing people with a feeling close to reality; the sensing module includes a corresponding driving circuit, which is used to generate a signal representing the parameters in the current virtual environment, and the skin of people is brought into contact with the virtual environment through the sensing module; the perceptual information extraction is respectively targeted at tactile sensing, olfactory sensing and auditory sensing, so as to extract people's perceptual information from multiple aspects, and identify and transmit the extracted perceptual information; the information feedback module includes a head-mounted virtual projection device, which stimulates the human body and provides tactile feedback through an electrical stimulation device and a flexible electrode array, and releases sounds and different smells to people according to events in the virtual environment, and the rendered information is processed and transmitted to the feedback module.

2. A virtual reality tactile feedback interaction system according to claim 1, characterized in that: The contact module is in contact with people's skin by means of hand-holding and sticking, and the head-mounted virtual projection device is in contact with people's olfactory and auditory senses.

3. A virtual reality tactile feedback interactive system according to claim 1, characterized in that: After receiving the signal from the contact module, the sensing module collects the information through the set driving circuit, and the sensing module stores the collected contact signal.

4. A virtual reality tactile feedback interactive system according to claim 1, characterized in that: The sensing module is provided with a storage module, through which a large amount of collected information is stored, and the sensing information and the extracted data of the perception information are stored respectively.

5. The virtual reality tactile feedback interactive system according to claim 1, characterized in that: The sensory information extraction is performed by collecting and extracting the senses of touch, smell and hearing respectively through different sensor devices.

6. A virtual reality tactile feedback interaction system according to claim 1, characterized in that: The signal data of tactile perception are collected by the electrical stimulation device and the flexible electrode array, and the olfactory sensing and auditory sensing are collected and extracted by the head-mounted virtual projection device.

7. The virtual reality tactile feedback interactive system according to claim 1, characterized in that: After the perception information is extracted, the information features are identified and feedback is given corresponding to different perception positions. Only feedback corresponding to different perceptions can be identified.

8. The virtual reality tactile feedback interactive system according to claim 1, characterized in that: The rendering and information transmission include a virtual agent model and a potential field model, maintaining real-time data transmission to an information feedback module.

9. The virtual reality tactile feedback interactive system according to claim 1, characterized in that: The information feedback module provides tactile feedback to the user through vibration and force action, while the sense of smell and hearing are provided through gas and sound.

10. The virtual reality tactile feedback interactive system according to claim 1, characterized in that: The flexible electrode array is distributed in a rectangular array at the output end of the electrical stimulation device, and the electrical pulse parameters of the electrical stimulation device are adjusted and controlled according to people's conditions.

Images