Information interaction device for visually impaired people and use method of information interaction device

Abstract

The invention discloses an information interaction device for visually impaired people and a use method thereof, and relates to the technical field of auxiliary instruments for visually impaired people, and the method comprises an intelligent handle system and a voice interaction system; the intelligent handle system is of a pull ring quadrilateral structure and comprises a main switch, a safety switch, a voice input, a Bluetooth module and a vibration exciter. The main switch controls the equipment to start and stop, the safety switch is used for stopping the automatic obstacle avoidance equipment from advancing after detecting that a hand leaves, and the vibration exciter is used for reminding a user of a walking direction and listening to voice prompt through a vibration behavior; the voice interaction system is used for broadcasting the road condition information and the walking direction to a user and receiving a verbal command issued by the user. According to the invention, a vibration-voice combined human-computer interaction mode is adopted, so that the interaction quality between the visually impaired person and the automatic obstacle avoidance equipment can be improved.

Description

Technical Field

[0001] The present application relates to the technical field of assistive devices for the visually impaired, and in particular to an information interaction device for the visually impaired and a method of using the device. Background Art

[0002] There are three main types of personal travel assistance devices commonly used for the visually impaired: the first type is blind assistance software, which is software installed in mobile devices to identify obstacles and remind users to avoid them, or use the mobile phone's positioning system and online maps to provide voice navigation for the visually impaired; the second type is equipment developed based on guide sticks, which are equipped with various devices to guide the visually impaired; the third type is wearable devices, which provide visually impaired people with obstacle avoidance, object identification and other assistance through specially developed wearable devices.

[0003] Research on existing assistive devices for the visually impaired has shown that current travel assistive devices for the visually impaired can only guide the visually impaired to walk through vibrations of different frequencies and times, or simple voice broadcasts. Therefore, when the visually impaired use the devices, the guidance information is easily misunderstood and ignored, making it difficult for users to communicate with the devices. Summary of the invention

[0004] The purpose of this application is to provide an information interaction device for visually impaired people and a method of using the same, which can improve the quality of human-computer interaction for users of guide equipment for the blind.

[0005] To achieve the above objectives, this application provides the following solutions:

[0006] In a first aspect, the present application provides an information interaction device for visually impaired persons, which is used for information interaction with automatic obstacle avoidance equipment, and the information interaction device includes: an intelligent handle system and a voice interaction system.

[0007] The structure of the intelligent handle system is a quadrilateral structure in a pull ring state, in which a main switch of the device, a safety switch, a voice input module, a Bluetooth module and a plurality of exciters are arranged.

[0008] The main switch of the equipment is used to turn on and off the information interaction device.

[0009] The safety switch is used to control the automatic obstacle avoidance device to stop moving forward when it is detected that the user's hand leaves the intelligent handle system.

[0010] The voice input module is used to convert the user's voice into voice commands and input the voice commands into the Bluetooth module.

[0011] The Bluetooth module is used to input the voice command to the automatic obstacle avoidance device host and receive a feedback signal from the automatic obstacle avoidance device host.

[0012] The vibrator is used to remind the user of the walking direction through vibration and to listen to voice reminders.

[0013] The voice interaction system is composed of a Bluetooth headset, and the voice interaction system is used to broadcast road condition information and walking direction to the user and receive oral commands issued by the user.

[0014] Optionally, in the quadrilateral structure adopted by the intelligent handle system, the first side, the second side and the fourth side are cylindrical structures, one end of the first side is connected to one end of the second side by an elbow structure; the other end of the first side is connected to one end of the fourth side by an elbow structure; the third side is a rectangular structure, and the two ends of the third side are respectively embedded in the other end of the second side and the other end of the fourth side.

[0015] Optionally, the intelligent handle system includes a first exciter, a second exciter and a third exciter.

[0016] The first vibrator is used to remind the user through vibration that the automatic obstacle avoidance device is about to turn left.

[0017] The second vibrator is used to remind the user to listen to the voice through vibration.

[0018] The third vibrator is used to remind the user through vibration that the automatic obstacle avoidance device is about to turn right.

[0019] Optionally, in the quadrilateral structure adopted by the intelligent handle system, a connecting structure is provided at the midpoint of the first side; the connecting structure is perpendicular to the first side and is used for connecting to the automatic obstacle avoidance device.

[0020] A first exciter is arranged on the second edge.

[0021] A device charging port, a voice input module, a safety switch and a device main switch are arranged in sequence on one face of the rectangular parallelepiped in the third side; a Bluetooth module is arranged on one face of the rectangular parallelepiped in the third side; and a second exciter is arranged on one face of the rectangular parallelepiped in the third side.

[0022] A third exciter is arranged on the fourth side of the quadrilateral structure.

[0023] Optionally, the voice interaction system is used to receive voice commands through a Bluetooth headset when the user operates the voice input module.

[0024] Optionally, Braille is provided on the main switch of the device, the safety switch, the voice input module and some of the exciters; and is used to distinguish between various devices.

[0025] Optionally, the Bluetooth headset used in the voice interaction system is a bone conduction Bluetooth headset.

[0026] Optionally, the smart handle system uses a pressure sensor as a safety switch.

[0027] In a second aspect, the present application provides a method for using an information interaction device for visually impaired persons, comprising:

[0028] Receive the user's operation instruction to the voice input module and start the language input function.

[0029] Convert user's voice into voice commands.

[0030] The voice command is transmitted to a host of the automatic obstacle avoidance device.

[0031] Based on Bluetooth headset, receive feedback information from the host of automatic obstacle avoidance equipment.

[0032] Optionally, the feedback information includes road condition information and walking direction.

[0033] According to the specific embodiments provided in this application, this application discloses the following technical effects:

[0034] The present application provides an information interaction device for the visually impaired and a method of using the same. The information interaction device integrates an intelligent handle and a voice interaction system to ensure communication with the automatic obstacle avoidance device. The intelligent handle with a quadrilateral pull ring design is not only easy to hold, but also equipped with multiple function keys, such as a main switch, a safety switch, etc., to ensure safe operation. Through voice input and the Bluetooth module, users can easily send instructions and receive feedback. The built-in vibrator and Bluetooth headset provide visually impaired users with accurate walking instructions and road condition reports through touch and hearing, respectively, significantly improving their travel convenience and safety. The present application adopts a human-computer interaction method that combines vibration and voice, which improves the efficiency and accuracy of human-computer interaction between the device and the user. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0036] Figure 1A schematic diagram of the structure of an information interaction device for the visually impaired provided in Example 1 of the present application.

[0037] Figure 2 This is a flow chart of voice input and feedback provided in Example 2 of the present application.

[0038] Explanation of symbols:

[0039] Smart handle system—1; device charging port—2; voice input module—3; safety switch—4; device main switch—5; first vibrator—6; second vibrator—7; third vibrator—8; Bluetooth module—9; voice interaction system—10; Bluetooth headset—11. DETAILED DESCRIPTION

[0040] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0041] The purpose of this application is to provide an information interaction device for visually impaired people and a method of using the same, which can improve the quality of human-computer interaction for users of guide equipment for the blind.

[0042] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0043] Embodiment 1

[0044] like Figure 1 As shown, this embodiment provides an information interaction device for visually impaired persons, which is used for information interaction with automatic obstacle avoidance equipment. The information interaction device includes: an intelligent handle system 1 and a voice interaction system 10.

[0045] The structure of the smart handle system 1 is a quadrilateral structure in a pull ring state, in which a main device switch 5, a safety switch 4, a voice input module 3, a Bluetooth module 9 and a plurality of exciters are arranged.

[0046] The main switch 5 of the device is used to turn on and off the information interaction device.

[0047] The safety switch 4 is used to control the automatic obstacle avoidance device to stop moving forward when it is detected that the user's hand leaves the intelligent handle system 1.

[0048] The voice input module 3 is used to convert the user's voice into voice commands and input the voice commands into the Bluetooth module 9 .

[0049] The Bluetooth module 9 is used to input the voice command to the automatic obstacle avoidance device host and receive feedback signals from the automatic obstacle avoidance device host.

[0050] The vibrator is used to remind the user of the walking direction through vibration and to listen to voice reminders.

[0051] The voice interaction system 10 is composed of a Bluetooth headset 11, and the voice interaction system 10 is used to broadcast road condition information and walking direction to the user and receive oral commands issued by the user.

[0052] Among them, Figure 1 As shown, in the quadrilateral structure adopted by the intelligent handle system 1, the first side, the second side and the fourth side are cylindrical structures, one end of the first side is connected to one end of the second side by an elbow structure; the other end of the first side is connected to one end of the fourth side by an elbow structure; the third side is a rectangular structure, and the two ends of the third side are respectively embedded in the other end of the second side and the other end of the fourth side.

[0053] Among them, the intelligent handle system 1, in the quadrilateral structure it adopts, is provided with a connecting structure at the midpoint of the first side; the connecting structure is perpendicular to the first side and is used to connect with the automatic obstacle avoidance device.

[0054] A first vibration exciter 6 is arranged on the second side.

[0055] A device charging port 2, a voice input module 3, a safety switch 4 and a device main switch 5 are sequentially arranged on one face of the cuboid in the third side; a Bluetooth module 9 is arranged on one face of the cuboid in the third side; and a second exciter 7 is arranged on one face of the cuboid in the third side. The third side is also called a crossbar handrail, which facilitates the user to feel the vibration from the left, middle and right, as well as the torque generated when the automatic obstacle avoidance device turns.

[0056] A third exciter 8 is arranged on the fourth side of the quadrilateral structure.

[0057] The first vibrator 6 is used to remind the user through vibration that the automatic obstacle avoidance device is about to turn left.

[0058] The second vibrator 7 is used to remind the user to listen to the voice through vibration.

[0059] The third vibrator 8 is used to remind the user through vibration that the automatic obstacle avoidance device is about to turn right.

[0060] Among them, the three vibrators in the intelligent handle system 1 are respectively placed at three key positions on the left, middle and right sides of the handle. The operation of these vibrators is precisely controlled by the host inside the automatic obstacle avoidance device. When the automatic obstacle avoidance device is about to perform a left turn, the first vibrator 6 located on the left side of the handle will send out a vibration signal to remind the user to turn left to change the walking direction; similarly, when the device is about to turn right, the third vibrator 8 located on the right side of the handle will vibrate to prompt the user to turn right. The second vibrator 7 located in the middle of the handle has a different task. It will vibrate when the automatic obstacle avoidance device issues other instructions other than left turn and right turn through its voice interaction system 10, such as reminding the user to pay attention to obstacles ahead, slow down or stop, etc., thereby guiding the user to listen to and follow the voice prompts to ensure safe and smooth use of the device. This design enables users to obtain intuitive and timely feedback during operation, greatly improving the user experience and safety.

[0061] Among them, a pressure sensor is provided in the safety switch 4 in the smart handle system 1. When it is detected that the user's hand leaves the smart handle system 1, the sensor detects that the pressure decreases, and the safety switch 4 sends a signal to stop the automatic obstacle avoidance device from moving forward and complete the emergency stop.

[0062] The voice input module 3 and the voice interaction system 10 in the smart handle system 1 work in collaboration. When the user operates the voice input module 3, it starts to receive voice commands. After receiving the user's voice commands, the Bluetooth signal is transmitted to the Bluetooth module 9. The Bluetooth module 9 converts the signal into an electrical signal and transmits it to the automatic obstacle avoidance device host for processing. Then, the feedback electrical signal from the automatic obstacle avoidance device host is received, and converted into a Bluetooth signal and transmitted to the voice interaction system 10, which is then fed back to the user in the form of sound playback.

[0063] The Bluetooth headset 11 used in the voice interaction system 10 is a bone conduction Bluetooth headset 11.

[0064] The voice interaction system 10 can also receive the voice command issued by the user through the Bluetooth headset 11 to control the communication device so that the user can quickly call the guardian. Specifically, the emergency call function takes effect after the safety switch detects that the user's hand leaves the handle, and enables the emergency call through the Bluetooth headset.

[0065] The voice interaction system 10 can also add voiceprint unlocking to replace the voice command button to improve the device's anti-interference ability of voice input in complex situations.

[0066] In the smart handle system 1, Braille is provided on the main switch 5 of the device, the safety switch 4, the voice input module 3 and some of the exciters; the Braille is used to distinguish each device.

[0067] In addition, the device also includes a positioning module for obtaining positioning information, and then feeding back the positioning data in real time to the Internet. The host of the automatic obstacle avoidance device searches for the current positioning environment information and introduces the surrounding environment to the user through the voice interaction module.

[0068] Embodiment 2

[0069] like Figure 2 As shown, this embodiment provides a method for using an information interaction device for visually impaired persons, including:

[0070] Receive the user's operation instruction to the voice input module 3 and start the language input function.

[0071] Convert user's voice into voice commands.

[0072] The voice command is transmitted to a host of the automatic obstacle avoidance device.

[0073] Based on the Bluetooth headset 11, feedback information from the host of the automatic obstacle avoidance device is received.

[0074] The feedback information includes road condition information and walking direction.

[0075] In summary, this application has the following technical effects:

[0076] In the information interaction device based on automatic obstacle avoidance equipment for visually impaired people provided by the present application, the intelligent handle system 1 reduces the possibility of users ignoring information broadcasts through the vibration of the exciters located at different positions and the voice interaction system 10 prompting the user with road information and walking direction. The voice interaction module has the functions of "environmental broadcast" and "emergency contact guardian", which expands the functions of the automatic obstacle avoidance equipment and improves the user's experience when using the automatic obstacle avoidance equipment; the voice input function of the voice interaction system 10 can only be activated when the user presses the voice input module 3, which effectively reduces the interference of external noise; the safety switch 4 stops the operation of the automatic obstacle avoidance equipment when the user releases the handrail, enhancing the safety of the user when traveling.

[0077] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0078] This article uses specific examples to illustrate the principles and implementation methods of this application. The description of the above embodiments is only used to help understand the method and core ideas of this application. At the same time, for those skilled in the art, according to the ideas of this application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting this application.

Claims

1. An information interaction device for visually impaired persons, used for information interaction with automatic obstacle avoidance equipment, characterized in that: The information interaction device includes: an intelligent handle system and a voice interaction system; The structure of the smart handle system is a quadrilateral structure in a pull ring state, in which a main switch of the device, a safety switch, a voice input module, a Bluetooth module and several exciters are arranged; The main switch of the device is used to turn on and off the information interaction device; The safety switch is used to control the automatic obstacle avoidance device to stop moving forward when it detects that the user's hand leaves the intelligent handle system; The voice input module is used to convert the user's voice into a voice command and input the voice command into the Bluetooth module; The Bluetooth module is used to input the voice command to the automatic obstacle avoidance device host and receive a feedback signal from the automatic obstacle avoidance device host; The vibrator is used to remind the user of the walking direction and listen to the voice reminder through vibration behavior; The voice interaction system is composed of a Bluetooth headset, and the voice interaction system is used to broadcast road condition information and walking direction to the user and receive oral commands issued by the user.

2. The information interaction device for visually impaired persons according to claim 1, characterized in that: The smart handle system, in the quadrilateral structure adopted by it, has a first side, a second side and a fourth side that are cylindrical structures, one end of the first side is connected to one end of the second side by an elbow structure; the other end of the first side is connected to one end of the fourth side by an elbow structure; The third side is a rectangular parallelepiped structure, and two ends of the third side are respectively embedded in the other end of the second side and the other end of the fourth side.

3. The information interaction device for visually impaired persons according to claim 2, characterized in that: The intelligent handle system includes a first vibration exciter, a second vibration exciter and a third vibration exciter; The first vibrator is used to remind the user through vibration that the automatic obstacle avoidance device is about to turn left; The second vibrator is used to remind the user to listen to the voice through vibration; The third vibrator is used to remind the user through vibration that the automatic obstacle avoidance device is about to turn right.

4. The information interaction device for visually impaired persons according to claim 3, characterized in that: The intelligent handle system, in the quadrilateral structure adopted by it, is provided with a connection structure at the midpoint of the first side; the connection structure is perpendicular to the first side and is used to connect with the automatic obstacle avoidance device; A first exciter is disposed on the second edge; A device charging port, a voice input module, a safety switch and a device main switch are sequentially arranged on one surface of the rectangular parallelepiped in the third side; a Bluetooth module is arranged on one surface of the rectangular parallelepiped in the third side; a second exciter is arranged on one surface of the rectangular parallelepiped in the third side; A third exciter is arranged on the fourth side of the quadrilateral structure.

5. The information interaction device for visually impaired persons according to claim 4, characterized in that: The voice interaction system is used to receive voice instructions through a Bluetooth headset when the user operates the voice input module.

6. The information interaction device for visually impaired persons according to claim 5, characterized in that: Braille is provided on the main switch of the device, the safety switch, the voice input module and some of the exciters; the Braille is used to distinguish between various devices.

7. The information interaction device for visually impaired persons according to claim 1, characterized in that: The Bluetooth headset used in the voice interaction system is a bone conduction Bluetooth headset.

8. The information interaction device for visually impaired persons according to claim 1, characterized in that: The intelligent handle system adopts a pressure sensor as a safety switch.

9. A method for using an information interaction device for visually impaired persons, characterized in that: include: Receive the user's operation instruction on the voice input module and start the voice input function; Convert the user's voice into voice commands; Transmitting the voice command to a host of the automatic obstacle avoidance device; Based on Bluetooth headset, receive feedback information from the host of automatic obstacle avoidance equipment.

10. The information interaction device for visually impaired persons according to claim 9, characterized in that: The feedback information includes road condition information and walking direction.

Images