Haptic simulation method, apparatus, device, and medium

Abstract

The present disclosure relates to a haptic simulation method, device, equipment and medium. The haptic simulation method comprises: obtaining a target simulation scene; obtaining a facial image of a user, performing feature extraction on the facial image of the user to obtain facial features of the user; correcting a haptic simulation parameter of the target simulation scene based on the target simulation scene and the facial features of the user to obtain a target haptic simulation parameter; and controlling a preset sensor to perform haptic simulation of the target simulation scene based on the target haptic simulation parameter. According to the embodiment of the present disclosure, haptic simulation of different users in different virtual reality simulation scenes can be realized, and the delay of haptic simulation is reduced. The user can have a more realistic feeling through multi-dimensional simulation of vision, hearing and touch.

Description

Technical Field

[0001] This disclosure relates to the field of virtual reality simulation technology, and in particular to a tactile simulation method, apparatus, device, and medium. Background Technology

[0002] Currently, Virtual Reality (VR) refers to users bringing their consciousness into a virtual world by wearing designated devices. Everything you see here is an unreal thing simulated by computer equipment, just like in the movie Ready Player One. You can run and jump around in the virtual world, do all kinds of actions, and see all kinds of strange and even terrifying things. For example, well-known commercial devices include Conquest Pro and MetaQuest 2. Because it is a purely virtual scene, the designated devices used for virtual reality mainly bring users a different virtual experience in terms of vision and sound.

[0003] Of course, some virtual reality simulation scenarios use real physical contact for tactile simulation, such as placing a robotic arm directly in contact with your lips and teeth, or using heating wires to generate heat or fans to simulate airflow. Obviously, tactile simulation using physical contact methods is affected by the tactile simulation equipment, which limits tactile simulation in different virtual reality simulation scenarios, and this method has high latency. Summary of the Invention

[0004] To address the aforementioned technical problems, this disclosure provides a tactile simulation method, apparatus, device, and medium.

[0005] A first aspect of this disclosure provides a tactile simulation method, comprising:

[0006] Obtain the target simulation scene;

[0007] Acquire the user's facial image, extract features from the user's facial image, and obtain the user's facial features;

[0008] Based on the target simulation scene and the user's facial features, the tactile simulation parameters of the target simulation scene are corrected to obtain the target tactile simulation parameters;

[0009] Based on the target tactile simulation parameters, preset sensors are controlled to perform tactile simulation of the target simulation scene.

[0010] A second aspect of this disclosure provides a tactile simulation device, comprising:

[0011] The scene acquisition module is used to acquire the target simulation scene;

[0012] The feature acquisition module is used to acquire the user's facial image, extract features from the user's facial image, and obtain the user's facial features.

[0013] The parameter correction module is used to correct the tactile simulation parameters of the target simulation scene based on the target simulation scene and the user's facial features, so as to obtain the target tactile simulation parameters.

[0014] The parameter control module is used to control preset sensors to perform tactile simulation of the target simulation scene based on the target tactile simulation parameters.

[0015] A third aspect of this disclosure provides an electronic device, including:

[0016] processor;

[0017] Memory, used to store executable instructions;

[0018] The processor is used to read executable instructions from memory and execute the executable instructions to implement the tactile simulation method provided in the first aspect above.

[0019] A fourth aspect of this disclosure provides a computer-readable storage medium storing a computer program that, when executed by a processor, causes the processor to implement the tactile simulation method provided in the first aspect.

[0020] The technical solution provided in this disclosure has the following advantages compared with the prior art:

[0021] The tactile simulation method, apparatus, device, and medium provided in this disclosure can acquire a target simulation scene and a user's facial image, extract features from the user's facial image to obtain the user's facial features, and then correct the tactile simulation parameters of the target simulation scene based on the target simulation scene and the user's facial features to obtain target tactile simulation parameters. Based on the target tactile simulation parameters, a preset sensor is controlled to perform tactile simulation of the target simulation scene. Thus, the tactile simulation parameters of the target simulation scene can be corrected according to the facial images of different users to obtain target tactile simulation parameters, and then the preset sensor is controlled to perform tactile simulation of the target simulation scene, thereby adapting to different users, realizing tactile simulation for different users in different virtual reality simulation scenes and reducing the latency of tactile simulation. Through multi-dimensional simulation of vision, hearing, and touch, it brings users a more realistic feeling. Attached Figure Description

[0022] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0023] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0024] Figure 1 This is a flowchart of a tactile simulation method provided in an embodiment of this disclosure;

[0025] Figure 2 This is a flowchart of another tactile simulation method provided in this embodiment of the present disclosure;

[0026] Figure 3 This is a flowchart of yet another tactile simulation method provided in this disclosure embodiment;

[0027] Figure 4 This is a schematic diagram of the structure of a tactile simulation device provided in an embodiment of this disclosure;

[0028] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure. Detailed Implementation

[0029] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.

[0030] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.

[0031] It should be understood that the steps described in the method embodiments of this disclosure may be performed in different orders and / or in parallel. Furthermore, the method embodiments may include additional steps and / or omit the steps shown. The scope of this disclosure is not limited in this respect.

[0032] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0033] It should be noted that the terms "a" and "a plurality of" used in this disclosure are illustrative rather than restrictive, and those skilled in the art should understand that, unless otherwise expressly indicated in the context, they should be understood as "one or more".

[0034] Typically, devices used in virtual reality (VR) primarily provide users with a unique virtual experience through visuals and sound. Some VR simulations utilize real physical contact for tactile simulation, such as placing a robotic arm directly in contact with your lips and teeth, or using heating wires to generate heat or fans to simulate airflow. However, tactile simulation using physical contact methods is limited by the tactile simulation device itself, restricting its application in different VR scenarios, and this method also suffers from high latency. To address this issue, this disclosure provides a tactile simulation method, which will be described below with reference to specific embodiments.

[0035] Figure 1 This is a flowchart of a tactile simulation method provided in an embodiment of the present disclosure. The method can be executed by a tactile simulation device, which can be implemented in software and / or hardware. The tactile simulation device can be configured in an electronic device, such as a VR headset.

[0036] like Figure 1 As shown, the tactile simulation method provided in this embodiment includes the following steps.

[0037] S110, Obtain the target simulation scenario.

[0038] In this embodiment of the disclosure, the electronic device acquires a target simulation scene when tactile simulation is required.

[0039] In this embodiment of the disclosure, a simulated scene can be understood as a simulated environment generated by a computer, providing users with simulations of senses such as vision, hearing, and touch, giving users a sense of immersion and enabling them to interact in a virtual reality environment.

[0040] In this embodiment of the disclosure, the simulated scene can be expanded and updated in real time. For example, the simulated scene can be expanded and updated manually in the background of the server in real time, and the user can select the target simulated scene in the updated simulated scene.

[0041] Furthermore, the target simulation scenario can be a simulation scenario selected by the user.

[0042] In some embodiments of this disclosure, the electronic device downloads at least one preset simulation scene from a server to the electronic device and stores it in the database of the electronic device. When in response to a user's selection operation, the target simulation scene is directly obtained from at least one preset simulation scene in the database.

[0043] In other embodiments of this disclosure, the electronic device, in response to a user's selection operation, directly downloads the target simulation scene from the server, thereby obtaining the target simulation scene.

[0044] S120. Obtain the user's facial image, extract features from the user's facial image, and obtain the user's facial features.

[0045] In this embodiment of the disclosure, after acquiring the target simulated scene, the electronic device acquires the user's facial image, extracts features from the user's facial image, and obtains the user's facial features.

[0046] In this embodiment of the disclosure, the electronic device can acquire a user's facial image through an image sensor, and the image sensor uploads the acquired user's facial image to the electronic device, thereby the electronic device obtains the user's facial image.

[0047] Specifically, after acquiring a user's facial image, the electronic device inputs the user's facial image into a pre-trained machine learning model. The pre-trained machine learning model extracts features from the user's facial image and outputs the user's facial features, thereby obtaining the user's facial characteristics.

[0048] S130. Based on the target simulation scene and the user's facial features, the tactile simulation parameters of the target simulation scene are corrected to obtain the target tactile simulation parameters.

[0049] In this embodiment of the disclosure, after acquiring the user's facial features, the electronic device corrects the tactile simulation parameters of the target simulated scene based on the target simulated scene and the user's facial features to obtain the target tactile simulation parameters.

[0050] In this embodiment of the disclosure, tactile simulation parameters can be understood as parameters used to perform tactile simulation on a target simulation scene.

[0051] Furthermore, tactile simulation parameters may include analog signal strength, analog signal direction, simulation duration, analog signal mode, etc.

[0052] In this embodiment of the disclosure, the target tactile simulation parameters can be understood as parameters determined based on the user's facial features for performing tactile simulation on the target simulation scene, and the target tactile simulation parameters vary depending on the user's facial features.

[0053] Specifically, after acquiring the user's facial features, the electronic device corrects the tactile simulation parameters of the target simulated scene based on the user's facial features, and obtains tactile simulation parameters adapted to the user's facial features, namely the target tactile simulation parameters.

[0054] S140. Based on the target tactile simulation parameters, control the preset sensor to perform tactile simulation of the target simulation scene.

[0055] In this embodiment of the disclosure, after acquiring the target tactile simulation parameters, the electronic device controls a preset sensor to perform tactile simulation of the target simulation scene based on the target tactile simulation parameters.

[0056] In this embodiment of the disclosure, the preset sensor can be understood as a sensor that can emit energy particles of different intensities according to the target tactile simulation parameters to achieve tactile simulation. For example, the preset sensor can be an ultrasonic sensor.

[0057] Furthermore, there can be one or more preset sensors, distributed in different locations, and the preset sensors can be rotated, meaning their orientation can be adjusted for tactile simulation.

[0058] Taking a VR headset as an example, a VR headset may contain at least one preset sensor. The preset sensor may be distributed at the position where the VR headset faces the face, or it may be concentrated at the position where the VR headset faces the mouth. Furthermore, the preset sensor can be adjusted in direction to emit energy particles of different intensities at different positions on the face.

[0059] Specifically, after acquiring the target tactile simulation parameters, the electronic device controls the preset sensor according to the target tactile simulation parameters, and the resulting preset sensor performs the corresponding tactile simulation according to the target tactile simulation parameters.

[0060] In this embodiment, a target simulation scene can be acquired, and a user's facial image can be acquired. Feature extraction is performed on the user's facial image to obtain the user's facial features. Then, based on the target simulation scene and the user's facial features, the tactile simulation parameters of the target simulation scene are corrected to obtain target tactile simulation parameters. Based on the target tactile simulation parameters, a preset sensor is controlled to perform tactile simulation of the target simulation scene. Thus, the tactile simulation parameters of the target simulation scene can be corrected according to the facial images of different users to obtain target tactile simulation parameters, and then the preset sensor is controlled to perform tactile simulation of the target simulation scene. This adapts to different users, realizes tactile simulation for different users in different virtual reality simulation scenes, and reduces the latency of tactile simulation. Through multi-dimensional simulation of vision, hearing, and touch, a more realistic feeling is brought to the user.

[0061] Based on the above embodiments disclosed, S110 may specifically include: obtaining the target simulation scene in response to the selection operation of the target simulation scene.

[0062] The selection of the target simulation scene can include manual selection and / or voice selection.

[0063] In some embodiments of this disclosure, the selection of the target simulation scene can be a manual selection operation.

[0064] Figure 2 This is a flowchart of another tactile simulation method provided in this disclosure. The following will be combined with... Figure 2 The tactile simulation method is explained in detail.

[0065] In this embodiment of the disclosure, in response to the selection operation of the target simulation scene, obtaining the target simulation scene may specifically include S210, S220 and S230.

[0066] S210, Obtain the user's hand gestures.

[0067] In this embodiment of the disclosure, the electronic device acquires the user's hand movements when it needs to acquire a target simulated scene.

[0068] Optionally, the user's hand movements may include the orientation of the user's fingers, the user's hand movement tendencies, etc.

[0069] Specifically, when an electronic device needs to acquire a target simulated scene, it uses an image sensor to capture images of the user's hand in real time. The image sensor then uploads these images to the electronic device, which analyzes them to obtain the user's hand movements.

[0070] S220. Based on the hand movement, determine the position of the virtual display screen corresponding to the hand movement.

[0071] In this embodiment of the disclosure, after the electronic device acquires the user's hand gesture, it determines the position of the virtual display screen corresponding to the hand gesture based on the hand gesture.

[0072] In this context, a virtual display screen can be understood as a display screen used for selecting simulated scenes in a target simulation scenario.

[0073] Specifically, after the electronic device acquires the user's hand gesture, it matches the position determined by the user's hand gesture with its position on the virtual display screen to determine the position of the virtual display screen corresponding to the hand gesture.

[0074] S230. Determine the simulated scene corresponding to the position of the virtual display screen as the target simulated scene.

[0075] In this embodiment of the disclosure, after determining the position of the virtual display screen corresponding to the hand movement, the electronic device determines the simulated scene corresponding to the position of the virtual display screen as the target simulated scene.

[0076] Optionally, at least one simulated scene is displayed on the virtual screen for the user to select.

[0077] Optionally, at least one simulated scene displayed on the virtual display screen can be a simulated scene pre-stored in the database of the electronic device, or it can be a simulated scene that has not been downloaded. These undownloaded simulated scenes can be automatically downloaded and stored in the database according to the user's selection, and can be opened directly as the target simulated scene after the download is completed, so that the user can directly select and use the simulated scene the next time.

[0078] S240. Obtain the user's facial image, extract features from the user's facial image, and obtain the user's facial features.

[0079] S250. Based on the target simulation scene and the user's facial features, the tactile simulation parameters of the target simulation scene are corrected to obtain the target tactile simulation parameters.

[0080] S260: Based on the target tactile simulation parameters, control the preset sensor to perform tactile simulation of the target simulation scene.

[0081] In this embodiment, S240-S260 are similar to S120-S140 in the above embodiments, and will not be described again here.

[0082] In this embodiment of the disclosure, the electronic device can determine the position of the virtual display screen corresponding to the user's hand movements based on the hand movements, and then determine the target simulation scene based on the simulation scene corresponding to the position of the virtual display screen. The target simulation scene is then obtained, and the target tactile simulation parameters are determined based on the target simulation scene and the user's facial features. The preset sensors are then controlled to perform tactile simulation of the target simulation scene based on the target tactile simulation parameters. Thus, while adapting to different users and realizing tactile simulation for different users in different virtual reality simulation scenes and reducing the latency of tactile simulation, the user experience is further improved.

[0083] In other embodiments of this disclosure, the selection operation of the target simulation scene can be a voice selection operation.

[0084] Specifically, the electronic device can select a voice based on the user's simulated scenario, determine the corresponding voice text, and match the voice text with the scene identifier or keywords in the simulated scenario, thereby determining the target simulated scenario with the highest matching value.

[0085] Therefore, electronic devices can directly obtain the target simulation scene based on the user's voice selection, making the selection of the target simulation scene simpler, more convenient, and faster.

[0086] Figure 3 This is a flowchart of another tactile simulation method provided in the embodiments of this disclosure.

[0087] like Figure 3 As shown, the tactile simulation method may include the following steps.

[0088] S310. Obtain the target simulation scenario.

[0089] In this embodiment of the disclosure, S310 is the same as described above. Figure 1 S110 or in the embodiment Figure 2 The specific implementation method for obtaining the target simulation scene is similar and will not be elaborated here.

[0090] S320. Obtain the user's facial image, extract features from the user's facial image, and obtain the user's facial features.

[0091] In this embodiment, S320 is similar to S120 in the above embodiment, and will not be described in detail here.

[0092] In this embodiment of the disclosure, the tactile simulation parameters of the target simulation scene are modified based on the target simulation scene and the user's facial features to obtain target tactile simulation parameters, which may specifically include S330, S340 and S350.

[0093] S330. Obtain the target facial features corresponding to the tactile simulation parameters of the target simulation scene.

[0094] In this embodiment of the disclosure, after acquiring the target simulated scene or after acquiring the target simulated scene and the user's facial image, the electronic device acquires the target facial features corresponding to the tactile simulation parameters of the target simulated scene.

[0095] In this embodiment of the disclosure, the target facial features can be understood as the facial features corresponding to the tactile simulation parameters of the target simulated scene.

[0096] Specifically, after acquiring the target simulated scene, the electronic device determines the target facial features corresponding to the tactile simulation parameters of the target simulated scene based on the tactile simulation parameters corresponding to the target simulated scene.

[0097] In some embodiments of this disclosure, the database of the electronic device stores target facial features corresponding to each simulated scene. The electronic device can directly search for the target facial features corresponding to the target simulated scene from the pre-stored database according to the scene identifier of the target simulated scene, and then obtain the target facial features corresponding to the tactile simulation parameters of the target simulated scene.

[0098] In some other embodiments of this disclosure, the database of the electronic device does not store the target facial features corresponding to each simulated scene. In this case, the electronic device determines the target facial features based on the scene data of the target simulated scene and the tactile simulation parameters corresponding to each moment in the target simulated scene.

[0099] For example, at a certain moment in the target simulation scene, the action of drinking water is simulated tactilely. At this time, the position pointed to by the simulated signal direction corresponding to the tactile simulation parameters is the position of the mouth, thereby determining the target mouth features. Based on the tactile simulation parameters corresponding to each moment in the target simulation scene, the target facial features corresponding to the tactile simulation parameters of the target simulation scene are determined.

[0100] S340. Compare the feature values ​​corresponding to the target facial features and the feature values ​​corresponding to the user's facial features to obtain the feature value difference between the target facial features and the user's facial features.

[0101] In this embodiment of the disclosure, after acquiring the target facial features, the electronic device compares the feature value corresponding to the target facial features with the feature value corresponding to the user's facial features to obtain the feature value difference between the target facial features and the user's facial features.

[0102] Specifically, after acquiring the target facial features, the electronic device extracts the feature values ​​corresponding to the target facial features and the user's facial feature values, and compares the extracted feature values ​​corresponding to the target facial features and the user's facial features to obtain the feature value difference between the target facial features and the user's facial features.

[0103] S350. Based on the difference in eigenvalues, the tactile simulation parameters of the target simulation scene are corrected to obtain the target tactile simulation parameters.

[0104] In this embodiment of the disclosure, after obtaining the feature value difference, the electronic device corrects the tactile simulation parameters of the target simulated scene based on the feature value difference to obtain the target tactile simulation parameters.

[0105] Optionally, the tactile simulation parameters include the simulated signal intensity and the simulated signal direction. The tactile simulation parameters of the target simulated scene are corrected based on the feature value difference to obtain the target tactile simulation parameters. Specifically, this can include determining a first difference corresponding to the simulated signal intensity and a second difference corresponding to the simulated signal direction based on the feature value difference, and correcting the tactile simulation parameters based on the first difference and the second difference to obtain the target tactile simulation parameters.

[0106] In this embodiment of the disclosure, the direction of the analog signal is the direction corresponding to the energy particles emitted by the preset sensor. For example, if the action of drinking water is to be simulated by touch, the direction of the analog signal is the position of the user's mouth.

[0107] Specifically, the electronic device can determine the difference between the target face and the user face distance sensor based on the feature value difference, obtain the distance difference, calculate the analog signal strength based on the distance difference to obtain the first difference, determine the second difference corresponding to the analog signal direction of the target face and the user face based on the feature value difference, and then correct the tactile simulation parameters based on the first difference and the second difference to obtain the target tactile simulation parameters.

[0108] Taking VR headsets as an example, different users have different facial sizes, and the corresponding facial feature values ​​under the preset sensor coordinate system are also different. For example, the mouth of a user with a smaller face is farther away from the preset sensor in the VR headset. In the same target simulation scene, to achieve the same tactile simulation effect as a user with a larger face, the required simulation signal strength is larger. Therefore, it is necessary to determine the difference in simulation signal strength, i.e., the first difference, based on the difference in distance between the mouth of the target face and the user's face and the preset sensor. Similarly, since the mouth position corresponding to different facial features will also be different, in order to ensure the accuracy of the tactile simulation effect in the same target simulation scene, it is necessary to adjust the direction of the simulation signal. Therefore, it is necessary to determine the difference in the direction of the simulation signal, i.e., the second difference, based on the difference in mouth position. Then, the tactile simulation parameters are corrected based on the first difference and the second difference to obtain the target tactile simulation parameters. It should be noted that the example here is only for better understanding of the technical solution of this application and does not limit the technical solution of this application.

[0109] S360: Based on the target tactile simulation parameters, control the preset sensors to perform tactile simulation of the target simulation scene.

[0110] In this embodiment, S360 is similar to S140 in the above embodiment, and will not be described in detail here.

[0111] In this embodiment of the disclosure, the electronic device can correct the tactile simulation parameters of the target simulation scene based on the target facial features and the user's facial features corresponding to the tactile simulation parameters of the target simulation scene, thereby obtaining the target tactile simulation parameters. Then, based on the target tactile simulation parameters, the device controls a preset sensor to perform tactile simulation of the target simulation scene. Thus, while adapting to different users and realizing tactile simulation for different users in different virtual reality simulation scenes and reducing the latency of tactile simulation, the device further improves the accuracy of tactile simulation.

[0112] Figure 4 This is a schematic diagram of the structure of a tactile simulation device provided in an embodiment of this disclosure.

[0113] In this embodiment, the tactile simulation device can be housed within an electronic device and is understood as a functional module within the aforementioned electronic device. Specifically, the electronic device can be a VR headset or similar device, or any device capable of processing tactile simulations in a target simulated scene; no limitation is imposed herein.

[0114] like Figure 4 As shown, the tactile simulation device 400 may include a scene acquisition module 410, a feature acquisition module 420, a parameter correction module 430, and a parameter control module 440.

[0115] The scene acquisition module 410 can be used to acquire the target simulation scene.

[0116] The feature acquisition module 420 can be used to acquire the user's facial image, extract features from the user's facial image, and obtain the user's facial features.

[0117] The parameter correction module 430 can be used to correct the tactile simulation parameters of the target simulation scene based on the target simulation scene and the user's facial features, so as to obtain the target tactile simulation parameters.

[0118] The parameter control module 440 can be used to control a preset sensor to perform tactile simulation of a target simulation scene based on the target tactile simulation parameters.

[0119] In this embodiment, a target simulation scene can be acquired, and a user's facial image can be acquired. Feature extraction is performed on the user's facial image to obtain the user's facial features. Then, based on the target simulation scene and the user's facial features, the tactile simulation parameters of the target simulation scene are corrected to obtain target tactile simulation parameters. Based on the target tactile simulation parameters, a preset sensor is controlled to perform tactile simulation of the target simulation scene. Thus, the tactile simulation parameters of the target simulation scene can be corrected according to the facial images of different users to obtain target tactile simulation parameters, and then the preset sensor is controlled to perform tactile simulation of the target simulation scene. This adapts to different users, realizes tactile simulation for different users in different virtual reality simulation scenes, and reduces the latency of tactile simulation. Through multi-dimensional simulation of vision, hearing, and touch, a more realistic feeling is brought to the user.

[0120] In some embodiments of this disclosure, the scene acquisition module 410 may be specifically used to acquire the target simulation scene in response to the selection operation of the target simulation scene.

[0121] In some embodiments of this disclosure, the scene acquisition module 410 may include an action acquisition unit 4101, a position determination unit 4102, and a scene determination unit 4103.

[0122] The action acquisition unit 4101 can be used to acquire the user's hand movements.

[0123] The position determination unit 4102 can be used to determine the position of the virtual display screen corresponding to the hand movement based on the hand movement.

[0124] The scene determination unit 4103 can be used to determine the simulated scene corresponding to the position of the virtual display screen as the target simulated scene.

[0125] In some embodiments of this disclosure, the selection of a target simulation scene includes manual selection and / or voice selection.

[0126] In some embodiments of this disclosure, the parameter correction module 430 may include a feature acquisition unit 4301 and a parameter correction unit 4302.

[0127] The feature acquisition unit 4301 can be used to acquire the target facial features corresponding to the tactile simulation parameters of the target simulation scene.

[0128] The parameter correction unit 4302 can be used to correct the tactile simulation parameters of the target simulation scene based on the target facial features and the user's facial features, so as to obtain the target tactile simulation parameters.

[0129] In some embodiments of this disclosure, the parameter correction unit 4302 may include a feature value comparison subunit and a parameter correction subunit.

[0130] This feature value comparison subunit can be used to compare the feature values ​​corresponding to the target facial features and the feature values ​​corresponding to the user's facial features to obtain the feature value difference between the target facial features and the user's facial features.

[0131] This parameter correction subunit can be used to correct the tactile simulation parameters of the target simulation scene based on the feature value difference, so as to obtain the target tactile simulation parameters.

[0132] In some embodiments of this disclosure, the tactile simulation parameters include analog signal strength and analog signal direction.

[0133] In some embodiments of this disclosure, the parameter correction subunit may include a difference determination subunit and a parameter acquisition subunit.

[0134] This difference determination subunit can be used to determine the first difference corresponding to the analog signal strength and the second difference corresponding to the analog signal direction based on the eigenvalue difference.

[0135] The parameter acquisition sub-unit can be used to correct the tactile simulation parameters based on the first difference and the second difference to obtain the target tactile simulation parameters.

[0136] It should be noted that, Figure 4 The tactile simulation device 400 shown can perform the various steps in the above method embodiments and realize the various processes and effects in the above method embodiments, which will not be elaborated here.

[0137] Figure 5 This is a schematic diagram of the structure of an electronic device provided in an embodiment of this disclosure.

[0138] In this embodiment of the disclosure, Figure 5 The electronic device shown can be a VR headset or any device capable of processing tactile simulation in the target simulation scene; there are no restrictions on this.

[0139] like Figure 5 As shown, the electronic device may include a processor 510 and a memory 520 storing computer program instructions.

[0140] Specifically, the processor 510 may include a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this disclosure.

[0141] Memory 520 may include a large-capacity storage for information or instructions. For example, and not limitingly, memory 520 may include a hard disk drive (HDD), a floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or a Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 520 may include removable or non-removable (or fixed) media. Where appropriate, memory 520 may be internal or external to the integrated gateway device. In a particular embodiment, memory 520 is a non-volatile solid-state memory. In a particular embodiment, memory 520 includes read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (Electrically Programmable ROM, EPROM), an electrically erasable programmable PROM (EEPROM), an electrically alterable ROM (EAROM), or flash memory, or a combination of two or more of these.

[0142] The processor 510 reads and executes computer program instructions stored in the memory 520 to perform the steps of the tactile simulation method provided in the embodiments of this disclosure.

[0143] In one example, the electronic device may also include a transceiver 530 and a bus 540. Wherein, as... Figure 5 As shown, the processor 510, memory 520 and transceiver 530 are connected via bus 540 and communicate with each other.

[0144] Bus 540 may include hardware, software, or both. For example, and not limited to, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industrial Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses, or a combination of two or more of these. Where appropriate, bus 540 may include one or more buses.

[0145] This disclosure also provides a computer-readable storage medium that can store a computer program that, when executed by a processor, causes the processor to implement the tactile simulation method provided in this disclosure.

[0146] The aforementioned storage medium may include, for example, a memory 520 containing computer program instructions, which can be executed by a processor 510 of an electronic device to perform the tactile simulation method provided in the embodiments of this disclosure. Optionally, the storage medium may be a non-transitory computer-readable storage medium, such as a ROM, random access memory (RAM), compact disc ROM (CD-ROM), magnetic tape, floppy disk, and optical data storage device.

[0147] The above description is merely a specific embodiment of this disclosure, enabling those skilled in the art to understand or implement it. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this disclosure. Therefore, this disclosure is not to be limited to the embodiments described herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A tactile simulation method, characterized in that, include: Obtain the target simulation scene; Acquire a user's facial image, extract features from the user's facial image, and obtain the user's facial features; Based on the target simulation scene and the user's facial features, the tactile simulation parameters of the target simulation scene are corrected to obtain the target tactile simulation parameters; Based on the target tactile simulation parameters, a preset sensor is controlled to perform tactile simulation of the target simulation scene. The preset sensor is a sensor that emits energy particles of different intensities according to the target tactile simulation parameters to achieve tactile simulation. The tactile simulation parameters include simulation signal intensity and simulation signal direction. The simulation signal direction is the direction corresponding to the energy particles emitted by the preset sensor. The step of correcting the tactile simulation parameters of the target simulation scene based on the target simulation scene and the user's facial features to obtain the target tactile simulation parameters includes: Obtain the target facial features corresponding to the tactile simulation parameters of the target simulation scene; The feature value corresponding to the target facial feature is compared with the feature value corresponding to the user's facial feature to obtain the feature value difference between the target facial feature and the user's facial feature; The tactile simulation parameters of the target simulation scene are corrected based on the feature value difference to obtain the target tactile simulation parameters.

2. The method according to claim 1, characterized in that, The acquisition of the target simulation scene includes: In response to the selection operation of the target simulation scene, the target simulation scene is obtained.

3. The method according to claim 2, characterized in that, The step of obtaining the target simulation scene in response to the selection operation of the target simulation scene includes: Acquire the user's hand movements; Based on the hand gesture, determine the position of the virtual display screen corresponding to the hand gesture; The simulated scene corresponding to the position of the virtual display screen is determined as the target simulated scene.

4. The method according to claim 2, characterized in that, The selection of the target simulation scene includes manual selection and / or voice selection.

5. The method according to claim 1, characterized in that, The step of correcting the tactile simulation parameters of the target simulated scene based on the feature value difference to obtain the target tactile simulation parameters includes: Based on the feature value difference, a first difference corresponding to the analog signal strength and a second difference corresponding to the analog signal direction are determined; The tactile simulation parameters are corrected based on the first difference and the second difference to obtain the target tactile simulation parameters.

6. A tactile simulation device, characterized in that, include: The scene acquisition module is used to acquire the target simulation scene; The feature acquisition module is used to acquire a user's facial image, extract features from the user's facial image, and obtain the user's facial features. The parameter correction module is used to correct the tactile simulation parameters of the target simulation scene based on the target simulation scene and the user's facial features, so as to obtain the target tactile simulation parameters; The parameter control module is used to control a preset sensor to perform tactile simulation of the target simulation scene based on the target tactile simulation parameters. The preset sensor is a sensor that emits energy particles of different intensities according to the target tactile simulation parameters to achieve tactile simulation. The tactile simulation parameters include simulation signal intensity and simulation signal direction. The simulation signal direction is the direction corresponding to the energy particles emitted by the preset sensor. The parameter correction module includes a feature acquisition unit and a parameter correction unit; The feature acquisition unit is used to acquire the target facial features corresponding to the tactile simulation parameters of the target simulation scene; The parameter correction unit includes an eigenvalue comparison subunit and a parameter correction subunit; The feature value comparison subunit is used to compare the feature value corresponding to the target facial feature and the feature value corresponding to the user's facial feature to obtain the feature value difference between the target facial feature and the user's facial feature; The parameter correction subunit is used to correct the tactile simulation parameters of the target simulation scene based on the feature value difference, so as to obtain the target tactile simulation parameters.

7. An electronic device, characterized in that, include: processor; Memory, used to store executable instructions; The processor is configured to read the executable instructions from the memory and execute the executable instructions to implement the tactile simulation method according to any one of claims 1-5.

8. A computer-readable storage medium, characterized in that, The storage medium stores a computer program that, when executed by a processor, causes the processor to implement the tactile simulation method according to any one of claims 1-5.

Images