Method for providing mid-air haptics

By setting up multiple ultrasonic transmitters on the air-distancing tactile device of the wearable part of the device and driving the unblocked target transmitter, the problem of inaccurate tactile feedback caused by the occlusion of the ultrasonic transmitter is solved, and the accurate air-distancing tactile sensation at a critical position is achieved.

WO2025055841A1PCT designated stage expired Publication Date: 2025-03-20VIVO MOBILE COMM CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/117659
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-15
Filing Date
2024-09-09
Publication Date
2025-03-20

AI Technical Summary

Technical Problem

The existing air-distance tactile technology is blocked by ultrasonic transmitters, which makes it impossible for users to obtain accurate tactile feedback in the palm of their hands, bent finger abdomen, etc.

Method used

By providing a plurality of inconsistent ultrasonic transmitters on the air-displacement tactile device of the wearable part of the device, and providing a air-displacement tactile sensation to the preset position by driving an unblocked target ultrasonic transmitter.

Benefits of technology

It achieves accurate air-touching in the palm of the user's palm, bent finger abdomen, etc., enhancing the immersion of the user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024117659_20032025_PF_FP_ABST
    Figure CN2024117659_20032025_PF_FP_ABST
Patent Text Reader

Abstract

The present application discloses a method for providing mid-air haptics. The method comprises: acquiring an action and position of a device wearing part of an operator, a mid-air haptics device being worn on the device wearing part, the mid-air haptics device comprising a flexible printed circuit, a power supply, and a wearable band body which are connected in sequence, and a plurality of ultrasonic transmitters having different orientations being provided at intervals on a side surface of the wearable band body; and when the action of the device wearing part meets a preset condition, providing mid-air haptics for a preset position by means of driving a target ultrasonic transmitter, the target ultrasonic transmitter comprising one or more ultrasonic transmitters among the plurality of ultrasonic transmitters provided on the wearable band body.
Need to check novelty before this filing date? Find Prior Art

Description

Method for providing teletactile sensation

[0001] Cross-references

[0002] This application claims priority to a Chinese patent application filed with the China Patent Office on September 15, 2023, with application number 202311197440.6 and invention name “Method for Providing Intermediate Touch Sensing”. The entire contents of the application are incorporated by reference into this application. Technical Field

[0003] The present application belongs to the field of virtual reality technology, and specifically relates to a method for providing a sense of touch through air. Background Art

[0004] Teletouch is a virtual reality (VR) technology that uses specialized equipment and algorithms to enable users to experience tactile feedback without actually touching an object. This technology can be applied to many fields, such as gaming, education, and healthcare, providing users with a more immersive experience. There are two main ways to implement teletouch: one uses technologies like ultrasound and lasers to create tactile feedback in the air, while the other uses technologies like electrical stimulation to simulate touch directly on the user's skin. Both methods require specialized equipment and algorithms to achieve high-precision tactile feedback.

[0005] However, current air touch technology is affected by the position and angle of the ultrasonic transmitter. In scenarios such as air stroking, handshaking, and high-fiving, fingers may bend. Due to occlusion, the ultrasonic transmitter cannot reach the palm of the hand or the belly of the bent finger. Therefore, users cannot get the desired touch on the palm or belly of the bent finger, and can only feel the touch on the back of the hand and fingers, resulting in users being unable to obtain accurate air touch.

[0006] Summary of the Invention

[0007] The embodiments of the present application provide a method for providing a sense of touch through air, which can solve the problem that a user cannot obtain an accurate sense of touch through air due to the obstruction of an ultrasonic transmitter.

[0008] In the first aspect, an embodiment of the present application provides a method for providing air touch, the method comprising: obtaining the movement and position of a device wearable part of an operator, wherein the device wearable part is worn with an air touch device, the air touch device comprising a flexible circuit board, a power supply and a wearable belt connected in sequence, and a plurality of ultrasonic emitters with inconsistent directions are arranged at intervals on the side surface of the wearable belt; when the movement of the device wearable part meets a preset condition, the air touch is provided to a preset position by driving a target ultrasonic emitter; wherein the target ultrasonic emitter includes one or more ultrasonic emitters among the plurality of ultrasonic emitters arranged on the wearable belt.

[0009] In an embodiment of the present application, when the operator wears the above-mentioned air touch device on the device wearing part and makes an action, the action of the operator's device wearing part and the position of the device wearing part are obtained, and then the obtained action of the device wearing part is judged. When the action of the device wearing part meets the preset conditions, the target ultrasonic emitter can be driven. The target ultrasonic emitter includes one or more ultrasonic emitters among the multiple ultrasonic emitters set on the wearing band to provide air touch to the preset position. Since the positions blocked by different actions are also different, the target ultrasonic emitter set on the wearing band of the air touch device that is not blocked is selected to drive, so as to provide accurate air touch for the operator's device wearing part. BRIEF DESCRIPTION OF THE DRAWINGS

[0010] FIG1 is a schematic flow chart of a method for providing a sense of touch through air according to an embodiment of the present application;

[0011] FIG2 is a schematic structural diagram of a teletouch device provided in an embodiment of the present application;

[0012] FIG3 is a schematic structural diagram of a flexible circuit board of a teletouch device provided in an embodiment of the present application;

[0013] FIG4 is a schematic diagram of an application of a teletouch device provided in an embodiment of the present application;

[0014] FIG5 is a schematic structural diagram of another teletouch device provided in an embodiment of the present application;

[0015] FIG6 is a schematic diagram of a scenario of a method for providing a sense of touch through air provided in an embodiment of the present application;

[0016] FIG7 is a flow chart of a method for providing a sense of touch through air provided in an embodiment of the present application;

[0017] FIG8 is a schematic diagram of an angle between two planes provided in an embodiment of the present application.

[0018] FIG9 is a schematic diagram of another method for providing a sense of touch through air provided in an embodiment of the present application;

[0019] FIG10 is a schematic diagram of detecting a position offset provided by an embodiment of the present application;

[0020] FIG11 is a schematic diagram of another scenario of a method for providing a sense of touch through air provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0022] The terms "first," "second," and the like in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or precedence. It should be understood that the terms used in this manner are interchangeable where appropriate, so that the embodiments of this application can be implemented in an order other than that illustrated or described herein, and that the objects distinguished by "first," "second," and the like are generally of the same type, and do not limit the number of objects; for example, the first object can be one or more. In addition, the term "and / or" in the specification and claims refers to at least one of the connected objects, and the character " / " generally indicates that the objects connected are in an "or" relationship.

[0023] The method for providing a sense of touch through air provided by the embodiment of the present application is described in detail below with reference to the accompanying drawings through specific embodiments and their application scenarios.

[0024] FIG1 shows a flow chart of a method for providing a sense of touch through air provided by an embodiment of the present application. The method can be performed by an electronic device, which may include: a virtual reality device, a terminal device, wherein the terminal device may be, for example, a vehicle-mounted terminal or a mobile phone terminal. Referring to FIG1 , the method may include the following steps:

[0025] Step 102: Acquiring the operator's movement and position of a device wearing portion, wherein the device wearing portion is equipped with a teletactile device, the teletactile device comprising a flexible circuit board, a power supply, and a wearable belt connected in sequence, wherein a plurality of ultrasonic transmitters with inconsistent orientations are spaced apart on a side surface of the wearable belt;

[0026] Among them, Figure 2 shows a structural schematic diagram of a remote touch device provided by an embodiment of the present application. As shown in Figure 2, the remote touch device includes a flexible circuit board 21, a power supply 22 and a wearable belt 23 connected in sequence; wherein, the side surface of the wearable belt 23 is spaced apart with multiple ultrasonic emitters 24 with inconsistent directions.

[0027] Optionally, the shape and structure of the wearing belt can be adjusted according to the structural form of the wearing part of the device, so that the wearing belt can be in good contact and fit with the wearing part of the device.

[0028] Step 104: When the movement of the wearable portion of the device satisfies a preset condition, driving the target ultrasonic transmitter to provide a tactile sensation to a preset position;

[0029] Among them, the target ultrasonic transmitter includes one or more ultrasonic transmitters among the multiple ultrasonic transmitters arranged on the wearable belt; the preset position includes but is not limited to the operator's device wearing part, the finger pointing point, and the gesture waving point, that is, the target ultrasonic transmitter can provide a sense of touch through the air to the device wearing part and the spatial position outside the device wearing part.

[0030] In an embodiment of the present application, when the operator wears the above-mentioned air touch device on the device wearing part and makes an action, the action of the operator's device wearing part and the position of the device wearing part are obtained, and then the obtained action of the device wearing part is judged. When the action of the device wearing part meets the preset conditions, the target ultrasonic emitter can be driven. The target ultrasonic emitter includes one or more ultrasonic emitters among the multiple ultrasonic emitters set on the wearing band to provide air touch to the preset position. Since the positions blocked by different actions are also different, the target ultrasonic emitter set on the wearing band of the air touch device that is not blocked is selected to drive, so as to provide accurate air touch for the operator's device wearing part.

[0031] For example, the teletouch device can be a wristband that can be worn from the base of the finger to the palm. The operator does not need to hold it. When the fingers are bent, the ultrasonic transmitters of the virtual reality device and the terminal device will be blocked and cannot act on the fingertips, palms and other parts. The ultrasonic transmitter on the teletouch device can emit ultrasonic waves to the fingertips, palms and other parts to provide the operator with teletouch.

[0032] In addition, FIG3 shows a schematic structural diagram of a flexible circuit board of a teletactile device provided in an embodiment of the present application. As shown in FIG3 , the flexible circuit board 30 is provided with a power module 31, a gyroscope 32, a processor 33, a sensor 34, a wireless LAN / Bluetooth module 35, and an ultrasonic drive module 36. Among them, the power module 31 is used to connect to the power supply of the teletactile device; the gyroscope 32 and the sensor 34 are used to detect the movement intensity of the wearable device when the operator's wearable device moves, such as speed, acceleration, and direction; the processor 33 is used to process the detected movement intensity of the wearable device to obtain information that can indicate the operation of the ultrasonic drive module 36; the wireless LAN / Bluetooth module 25 is used to communicate with virtual reality devices and terminal devices; and the ultrasonic drive module 26 is used to drive the ultrasonic transmitter to emit ultrasonic waves.

[0033] In one implementation, the action of obtaining the device worn by the operator in step 102 may include the following steps:

[0034] Step 1021: Decomposing the motion of the wearable device portion by a processor to obtain an inscribed plane and / or a circumscribed plane of the wearable device portion in the motion;

[0035] For example, when shaking hands in the air, the fingertips will bend toward the palm. At this time, the inscribed plane includes the plane where the fingertips of each section and the palm are located, and the circumscribed plane includes the plane where the backs of each section of the fingers and the back of the hand are located.

[0036] Step 1022: Calculate the angle between the inscribed plane and / or the circumscribed plane and the plane where the negative horizontal axis of the display of the terminal device is located.

[0037] The processor is arranged in at least one of the following: a flexible circuit board of the teletactile device, a virtual reality device, and the terminal device. The virtual reality device may include virtual reality (VR) glasses and a head-mounted virtual reality device.

[0038] In an embodiment of the present application, the various inscribed planes and / or circumscribed planes are obtained by the processor by decomposing the movement of the wearable part of the device. The processor can be set in the flexible circuit board, virtual reality device, and terminal device of the air touch device. That is to say, the processor suitable for the current situation can be selected to decompose the movement of the wearable part of the device according to the actual usage situation, and then the angle between these tangent planes and the plane where the negative horizontal axis of the display of the terminal device is located is calculated, so as to measure the relationship between the movement of the wearable part of the device and the display of the terminal device through the angle, and then the ultrasonic transmitter can be instructed to emit ultrasonic waves by judging whether the angle meets the preset conditions to provide air touch for the wearable part of the device.

[0039] In one implementation, the target ultrasonic transmitter further includes one or more ultrasonic transmitters among the plurality of ultrasonic transmitters provided on the terminal device, and further includes one or more ultrasonic transmitters among the plurality of ultrasonic transmitters provided on the virtual reality device; then step 104 may include:

[0040] (1) When the angle between the inscribed plane and the plane on which the negative horizontal axis of the display of the terminal device is located is greater than a preset threshold, the ultrasonic transmitter of the air touch device is driven to provide air touch to the preset position;

[0041] For example, in an air handshake action, the fingertips will bend toward the palm, and the threshold is set to 90 degrees. When the angle between the inscribed plane of the hand and the plane where the negative horizontal axis of the display of the terminal device is located is greater than 90 degrees, the inscribed plane where the fingertips and the palm are located is in a position that cannot be affected by the ultrasonic transmitter of the terminal device, while the ultrasonic transmitter of the air touch device worn on the wearable part of the device can be affected. Therefore, the ultrasonic transmitter of the air touch device is driven to provide air touch for the wearable part of the device.

[0042] (2) When the angle between the inscribed plane and the plane where the negative horizontal axis of the display of the terminal device is located is less than or equal to the preset threshold, the ultrasonic transmitter of the terminal device is driven to provide a tactile sensation to the preset position.

[0043] For example, for a high-five action, the threshold is set to 90 degrees. At this time, the palm of the hand faces the display of the terminal device, and the angle between the inscribed plane of the palm of the hand and the plane of the negative horizontal axis of the display of the terminal device is less than or equal to 90 degrees. The ultrasonic transmitter of the terminal device can act on the palm of the hand, so the ultrasonic transmitter of the terminal device is driven to provide a sense of touch in the air for the wearable part of the device.

[0044] (3) when the angle between the circumscribed plane and the plane on which the negative horizontal axis of the display of the terminal device is located is greater than the preset threshold, driving the ultrasonic transmitter of the terminal device to provide a tactile sensation to the preset position;

[0045] For example, for an air handshake action, the threshold is set to 90 degrees. When the angle between the circumscribed plane where the back of the hand is located and the plane where the negative horizontal axis of the terminal device's display is located is greater than 90 degrees, the back of the hand is facing the display of the terminal device. The ultrasonic transmitter of the terminal device can act on the back of the hand, thereby driving the ultrasonic transmitter of the terminal device to provide air touch for the wearable part of the device.

[0046] (4) When the angle between the circumscribed plane and the plane where the negative horizontal axis of the display of the terminal device is located is less than or equal to the preset threshold, the ultrasonic transmitter of the virtual reality device is driven to provide a sense of touch through air to the preset position.

[0047] For example, when massaging fingers through air, the threshold is set to 90 degrees. When the fingertips face the display of the terminal device and the backs of the fingers face the relative directions of the display of the terminal device, when the virtual hand massages the fingers, if the angle between the circumscribed plane where the backs of the fingers are located and the plane where the negative horizontal axis of the display of the terminal device is located is less than or equal to 90 degrees, the ultrasonic transmitter of the terminal device cannot act on the backs of the fingers, so the ultrasonic transmitter driving the virtual reality device provides the wearable part of the device with a sense of touch through air.

[0048] In an embodiment of the present application, the target device for providing the wearable part of the device with the sense of touch through air is determined by judging whether the angle between the decomposed inscribed plane and / or circumscribed plane of the action of the wearable part of the device and the plane where the negative horizontal axis of the display of the terminal device is located satisfies the preset conditions, and the sense of touch through air is provided to the wearable part of the device by driving the target ultrasonic transmitter provided on the target device.

[0049] In one implementation, when the movement of the wearable part of the above-mentioned device meets the preset conditions, before providing the air touch to the preset position by driving the target ultrasonic transmitter, the above-mentioned method of providing the air touch may also include: determining the part of the wearable part of the device for providing the air touch according to the movement of the wearable part of the device; wherein the part includes the inscribed plane and / or the circumscribed plane.

[0050] In an embodiment of the present application, due to the different movements of the wearable part of the device, it is necessary to determine whether it is necessary to provide air touch to all parts of the wearable part of the device. Before judging whether the movement of the wearable part of the device meets the preset conditions to provide air touch to the wearable part of the device at the said position by driving the ultrasonic transmitter, the part of the wearable part of the device for providing air touch can be determined first.

[0051] For example, when high-fiving through the air, only the inner tangent plane where the opponent's palm is located needs to provide the sense of touch through the air; when shaking hands through the air, the outer tangent plane where the back of the opponent's fingers and the back of the hand are located, as well as the inner tangent plane where the fingertips and the palm of the opponent's hand are located need to provide the sense of touch through the air. Among them, it is also necessary to make timely adjustments according to the different degrees of handshakes.

[0052] In one implementation, the above-mentioned providing of air touch to the preset position by driving the target ultrasonic transmitter may include: driving the target ultrasonic transmitter to transmit an ultrasonic signal to the preset position through an ultrasonic driving module, wherein the ultrasonic driving module is arranged in at least one of the following: the flexible circuit board of the air touch device, the virtual reality device, and the terminal device, so as to provide the air touch to the preset position through the target ultrasonic transmitter.

[0053] In one implementation, referring to FIG3 , a gyroscope and a sensor are provided in the flexible circuit board; before providing the inter-air touch sensation to the preset position by driving the target ultrasonic transmitter, the method may further include the following steps:

[0054] Step 1041: obtaining the motion acceleration of the wearable portion of the device through the sensor and gyroscope provided on the flexible circuit board;

[0055] The energy intensity of the ultrasonic signal is controlled by the motion acceleration of the device wearable part.

[0056] Step 1042: Determine the energy intensity of the ultrasonic signal according to the corresponding relationship between the motion acceleration and the energy intensity of the ultrasonic signal by the processor.

[0057] The corresponding relationship between the motion acceleration and the energy intensity of the ultrasonic signal can be: when the acceleration is a, the energy intensity of the ultrasonic signal is 1s; when the acceleration is 2a, the energy intensity of the ultrasonic signal is 1.5s.

[0058] In an embodiment of the present application, after determining the part that provides the sense of touch through air for the wearable part of the device and the device that provides the sense of touch through air for the wearable part of the device, the energy intensity of the ultrasonic signal emitted by the wearable part of the device is determined through the correspondence between the acceleration of the movement of the wearable part of the device and the energy intensity of the ultrasonic signal, thereby enhancing the perception effect of the sense of touch through air.

[0059] In one implementation, the air touch device is worn on the wearable portion of the device, and in a preset position of the wearable portion of the device, the three side surfaces of the air touch device are in contact with the wearable portion of the device. Referring to Figure 4, Figure 4 shows an application schematic diagram of an air touch device provided by an embodiment of the present application; the air touch device can be set as a wristband, which can be worn between the base of the fingers and the palm of the hand, and the shape of the wristband is set as a triangular prism with rounded corners, which can fit the fingers and palm well through the three sides. Among them, the left side of the figure is a schematic diagram of the front of the palm wearing the wristband, and the right side is a schematic diagram of the front of the back of the hand wearing the wristband.

[0060] Figure 5 shows a structural schematic diagram of another inter-air touch device provided in an embodiment of the present application in one implementation. As shown in Figure 5, the inter-air touch device may further include a fixing member 15, wherein the fixing member 15 is wrapped around the outside of the flexible circuit board 11 and the micro battery 12, and the two ends of the fixing member 15 are respectively connected to the two bottom surfaces of the wearable belt 13.

[0061] In the teletactile device of the embodiment of the present application, the flexible circuit board 11 and the power supply 12 are wrapped by the fixing member 15, and the two ends of the fixing member 15 are respectively connected to the two bottom surfaces of the wearable belt 13, which can not only ensure the performance of the teletactile device, but also protect the flexible circuit board 11 and the power supply 12.

[0062] Optionally, the flexible circuit board 11 and the wearable belt 13 may be connected via a communication bus, and the power supply 12 and the wearable belt 13 may be connected via a communication bus.

[0063] Figure 6 shows a scenario diagram of a method for providing a sense of touch through air provided by an embodiment of the present application; an operator is in a VR video call or conference with a customer, and greets them politely by shaking hands through air, while the operator is wearing VR glasses and a wristband. Figure 7 is a flow diagram of a method for providing a sense of touch through air provided by an embodiment of the present application, which is applied to VR glasses, a wristband, and a mobile phone, and includes the following steps:

[0064] Step 701: The VR glasses establish communication connections with the wristband and the mobile phone via wireless LAN / Bluetooth.

[0065] Step 702: The VR glasses capture the operator's hand movements and positions through a camera; the camera may be a time of flight (ToF) camera; the operator's movements include the postures of the palm, fingertips, back of the hand, and back of the fingers.

[0066] Step 703: Calculate the angle between the inscribed plane and the plane where the -x axis of the mobile phone screen is located; wherein the plane where the palm and fingertips are located is the inscribed plane. Figure 8 shows a schematic diagram of the angle between planes provided in an embodiment of the present application.

[0067] Step 704: Determine whether the angle is greater than 90 degrees; if so, execute step 7041; if not, execute step 7042.

[0068] Step 7041: The VR glasses notify the wristband and determine the intensity of the ultrasonic signal emitted by the wristband based on the correspondence between the motion acceleration of the action and the energy intensity of the ultrasonic signal, and drive the ultrasonic transmitter to emit the ultrasonic signal.

[0069] Step 7042: The VR glasses notify the mobile phone and determine the intensity of the ultrasonic signal transmitted by the mobile phone based on the correspondence between the motion acceleration of the action and the energy intensity of the ultrasonic signal, and drive the ultrasonic transmitter to transmit the ultrasonic signal.

[0070] The wristband or mobile phone drives the ultrasonic transmitter to transmit ultrasonic signals to the palm of the hand and the fingertips.

[0071] Step 705: Determine whether the back of the hand or finger needs to provide a sense of touch; if so, proceed to step 706; if not, end. This step can also be performed before step 703.

[0072] Step 706: Calculate the angle between the circumscribed plane and the plane where the -x axis of the mobile phone screen is located; wherein the plane where the back of the hand and the back of the fingers are located is the circumscribed plane.

[0073] Step 707: Determine whether the angle is greater than 90 degrees; if so, execute step 7071; if not, execute step 7072.

[0074] Step 7071: The VR glasses notify the mobile phone and determine the intensity of the ultrasonic signal transmitted by the mobile phone based on the correspondence between the motion acceleration of the action and the energy intensity of the ultrasonic signal, and drive the ultrasonic transmitter to transmit the ultrasonic signal.

[0075] Step 7072: The VR glasses determine the intensity of the transmitted ultrasonic signal based on the correspondence between the motion acceleration of the action and the energy intensity of the ultrasonic signal and drive the ultrasonic transmitter to transmit the ultrasonic signal.

[0076] Among them, the mobile phone or VR glasses drives the ultrasonic transmitter to transmit ultrasonic signals to the back of the hand and the back of the fingers.

[0077] Figure 9 shows a scenario diagram of another method for providing air touch provided by an embodiment of the present application; the operator is making a video call with a friend and high-fiving each other through the air, and the operator is wearing VR glasses and a wristband.

[0078] In an embodiment of the present application, when the operator raises his hand to clap, if the angle between the inner plane of the palm and the fingertips and the plane of the -x axis of the mobile phone screen is close to 0 degrees, it can be determined that the ultrasonic transmitter of the mobile phone is not blocked, and ultrasonic signals can be transmitted to the palm and the fingertips, thereby providing a sense of touch through the air. At the same time, it can be determined whether it is necessary to provide a sense of touch through the air to the back of the hand and the back of the fingers. If it is necessary to provide a sense of touch through the air to them, the angle between the outer plane of the back of the hand and the back of the fingers and the plane of the -x axis of the mobile phone screen is close to 0 degrees, then it can be determined that the ultrasonic transmitter of the mobile phone is blocked, and ultrasonic signals can be transmitted to the back of the hand and the back of the fingers through the VR glasses.

[0079] In addition, during the operator's high-five process, the operator's hand moves forward, the sensor of the hand strap detects the movement acceleration of the operator's hand and feeds it back to the processor of the hand strap, and the gyroscope of the hand strap detects the position offset of the operator's hand. Figure 10 shows a schematic diagram of position offset detection provided by an embodiment of the present application. The changes in the x, y, and z coordinates of the inscribed plane and / or circumscribed plane of the hand can be calculated and fed back to the processor of the hand strap. The processor determines the energy intensity of the ultrasonic signal corresponding to different intensities of the air touch based on the above information, and instructs the ultrasonic drive module to drive the ultrasonic transmitter to emit an ultrasonic signal to provide the operator with the air touch feeling of high-five.

[0080] Figure 11 shows a scenario diagram of another method for providing inter-air touch provided by an embodiment of the present application; the operator is having a video call with a child or a pet, and the operator is wearing VR glasses and a wristband.

[0081] In an embodiment of the present application, when the operator strokes the virtual pet, the hand is in a semi-bent state. When the angle between the inner tangential plane of the palm and the fingertips and the plane of the -x axis of the terminal device display is greater than 90 degrees, the ultrasonic transmitter of the terminal device is blocked, and the ultrasonic transmitter of the wristband is used to transmit ultrasonic signals to the palm and the fingertips to provide a sense of touch through the air; when the angle between the outer tangential plane of the back of the finger and the plane of the -x axis of the terminal device display is greater than 90 degrees, the ultrasonic transmitter of the mobile phone is not blocked, and an ultrasonic signal can be transmitted to the back of the finger through the terminal device to provide a sense of touch through the air; when the angle between the outer tangential plane of the back of the hand and the plane of the -x axis of the terminal display is less than 90 degrees, the ultrasonic transmitter of the terminal device is blocked, and the ultrasonic transmitter of the VR glasses is used to transmit ultrasonic signals to the back of the hand to provide a sense of touch through the air.

[0082] Through the embodiments of the present application, the angle between the inscribed plane and the circumscribed plane of the hand and the plane where the -x axis of the terminal device display is located is judged, the thin part providing the air touch is determined, the device providing the air touch for different parts of the hand is determined, and the intensity of the air touch provided to different parts of the hand is determined, thereby providing the operator with accurate air touch.

[0083] It should be noted that, in this article, the terms "comprise", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the statement "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device comprising the element. In addition, it should be noted that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in the opposite order according to the functions involved. For example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0084] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus the necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, computer, server, air conditioner, or network device, etc.) to execute the methods described in each embodiment of the present application.

[0085] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of this application, ordinary technicians in this field can also make many forms without departing from the purpose of this application and the scope of protection of the claims, all of which are within the protection of this application.

Claims

1. A method for providing a sense of touch through air, comprising: Acquiring the movement and position of the wearable device of the operator, wherein the wearable device is equipped with a teletactile device, the teletactile device comprising a flexible circuit board, a power supply, and a wearable belt connected in sequence, and a plurality of ultrasonic transmitters with inconsistent directions are arranged at intervals on the side surface of the wearable belt; When the movement of the wearable part of the device meets the preset conditions, the target ultrasonic transmitter is driven to provide a sense of touch through air to a preset position; Wherein, the target ultrasonic transmitter includes one or more ultrasonic transmitters among a plurality of ultrasonic transmitters arranged on the wearable belt.

2. The method according to claim 1, wherein: The action of obtaining the device worn by the operator includes: Decomposing the motion of the wearable part of the device by a processor to obtain an intangible plane and / or an circumtangential plane of the wearable part of the device in the motion; Calculating the angle between the intangential plane and / or the circumtangential plane and the plane where the negative horizontal axis of the display of the terminal device is located; Wherein, the processor is arranged in at least one of the following: a flexible circuit board of the inter-air tactile device, a virtual reality device, and the terminal device.

3. The method according to claim 2, wherein: The target ultrasonic transmitter also includes one or more ultrasonic transmitters among the plurality of ultrasonic transmitters provided on the terminal device; when the action of the wearable part of the device satisfies a preset condition, the target ultrasonic transmitter is driven to provide a tactile sensation to a preset position, including: The distance between the inner tangent plane and the plane where the negative horizontal axis of the display of the terminal device is located When the angle is greater than a preset threshold, the ultrasonic transmitter of the remote touch device is driven to provide the remote touch to the preset position; When the angle between the inner tangent plane and the plane where the negative horizontal axis of the display of the terminal device is located is less than or equal to the preset threshold, the ultrasonic transmitter of the terminal device is driven to provide a remote touch sensation to the preset position.

4. The method according to claim 3, wherein: The target ultrasonic transmitter also includes one or more ultrasonic transmitters among a plurality of ultrasonic transmitters provided on the virtual reality device; When the movement of the wearable part of the device meets the preset conditions, the target ultrasonic transmitter is driven to provide a sense of touch through air to the preset position, including: When the angle between the circumscribed plane and the plane where the negative horizontal axis of the display of the terminal device is located is greater than the preset threshold, the ultrasonic transmitter of the terminal device is driven to provide a tactile sensation to the preset position; When the angle between the circumscribed plane and the plane where the negative horizontal axis of the display of the terminal device is located is less than or equal to the preset threshold, the ultrasonic transmitter of the virtual reality device is driven to provide a sense of touch to a preset position.

5. The method according to any one of claims 1 to 4, wherein: When the movement of the wearable part of the device satisfies a preset condition, before providing the inter-air touch sensation to the preset position by driving the target ultrasonic transmitter, the method further includes: According to the movement of the wearable part of the device, determining a part of the wearable part of the device that provides a sense of touch through air; Wherein, the part includes the internal cutting plane and / or the external cutting plane.

6. The method according to any one of claims 1 to 4, wherein: Providing the inter-air touch sensation to the preset position by driving the target ultrasonic transmitter includes: Drive the target ultrasonic transmitter to transmit an ultrasonic signal to the preset position through an ultrasonic driving module; Wherein, the ultrasonic driving module is arranged in at least one of the following: a flexible circuit board of the inter-air tactile device, the virtual reality device, and the terminal device.

7. The method according to claim 6, wherein: The flexible circuit board is provided with a gyroscope and a sensor; before the ultrasonic driving module drives the target ultrasonic transmitter to provide the air touch to the preset position, the method further includes: Acquiring the motion acceleration of the wearable part of the device through the gyroscope and the sensor provided on the flexible circuit board; The processor determines the energy intensity of the ultrasonic signal according to the corresponding relationship between the motion acceleration and the energy intensity of the ultrasonic signal.

8. The method according to claim 1, wherein: The teletactile device is worn on the device wearing part, and in a preset posture of the device wearing part, the three side surfaces of the teletactile device are in contact with the device wearing part.

9. The method according to claim 7, wherein: The flexible circuit board is provided with a power module and a wireless local area network / bluetooth module.

10. The method according to claim 1, wherein: The teletactile device further includes: a fixing member; wherein, The fixing member is wrapped around the flexible circuit board and the outside of the power source, and two ends of the fixing member are respectively connected to two bottom surfaces of the wearable belt body.

Citation Information

Patent Citations

  • Unmanned aerial vehicle control system and method based on air gesture and ultrasonic tactile feedback

    CN109634300A

  • Method of providing touch over air

    CN117075738A

  • Wearable ultrasonic probe and ultrasonic diagnosticapparatus comprising the same

    KR1020070109293A

  • System and method for user interaction

    KR1020130114367A

  • A method for interlocking wearable 3D input devices with external devices

    KR1020160111880A