PORTABLE SYSTEM AND METHOD FOR NAVIGATION

Abstract

Methods for guiding the movement of a user (12), comprising: Receiving a destination request by a computer device, wherein the destination request contains a destination, the computer device contains a device controller (34), and the device controller (34) contains a processor (44) and a non-transitory computer-readable medium (46) in communication with the processor (44); Receiving sensor data from a first portable device (20) by the computer device, wherein the first portable device (20) comprises a camera (26) and a distance sensor, wherein the sensor data includes image data captured by the camera (26); Establishing communication between the computer device and a remote system (50) in response to receiving the destination request; and Transmission of sensor data by the computer device to the remote system (50) in response to the establishment of communication between the computer device and the remote system (50); characterized by Receiving navigation instructions to the destination from the remote system (50) by the computer device; and Output of the navigation instructions by a second portable device (40) in the form of a first finger ring (42) and a third portable device (60) in the form of a second finger ring (62), wherein both the first ring (42) and the second ring (62) are configured to generate haptic feedback that forms the navigation instructions; and wherein the first portable device (20) comprises an electronic pendant (24) attached to a lanyard (22) worn by the user (12) around his neck, and which contains the camera (26), the distance sensor and a speaker (18) through which the navigation instructions are also given.

Description

INTRODUCTION

[0001] The present invention relates to a method for user movement guidance according to the preamble of claim 1, as is known essentially from DE 10 2019 122 842 A1.

[0002] Further state of the art can also be found in publications US 11 626 001 B1, WO 2023 / 151 351 A1 and US 2021 / 0 089 126 A1.

[0003] Sometimes it is difficult for visually impaired people to find their way on pedestrian paths without external orientation aids. Some navigation technologies rely on displays that show the correct route to a desired destination. It is therefore desirable to develop a navigation method that does not depend on visual indicators or displays. SUMMARY

[0004] According to the invention, a method for guiding the movement of users is presented, which is characterized by the features of claim 1.

[0005] The method comprises the reception of a target request by a mobile device. The target request includes a target. The mobile device includes a device controller. The device controller includes a processor and a non-transient, computer-readable medium that communicates with the processor. The method also comprises the reception of sensor data from a wearable device by the mobile device. The wearable device includes a tether and an electronic tag attached to the tether. The electronic tag includes a camera and / or a LiDAR sensor or other suitable distance sensor. Both the camera and the LiDAR sensor are configured to generate sensor data. The sensor data includes image data captured by the camera. The sensor data includes LiDAR data captured by the LiDAR sensor.The method further includes establishing communication between the mobile device and a remote system in response to receiving the destination request. The method further includes transmitting sensor data from the mobile device to the remote system in response to the establishment of communication between the mobile device and the remote system. The method further includes receiving navigation instructions to the destination from the remote system via the mobile device. The method described in this section improves mobility technology by enabling a visually impaired user to receive navigation instructions via at least one portable device without the need for displays.

[0006] Furthermore, a system for guiding a user's movements is described. The system comprises a first wearable device with a tether and an electronic tag attached to the tether. The electronic tag contains a camera and a LiDAR sensor. Both the camera and the LiDAR sensor are configured to generate sensor data. This sensor data includes image data captured by the camera and LiDAR data captured by the LiDAR sensor. The system also includes a second wearable device, a first ring. The system also includes a third wearable device, a second ring. Both the first and second rings are sized to fit snugly around a human finger and are configured to provide haptic feedback.The system also includes a mobile device with a device controller. The device controller comprises a processor and a non-transient, computer-readable medium that communicates with the processor. The device controller is programmed to execute the procedure described above.

[0007] Further applications of the present invention will become apparent from the detailed description given below. It is understood that the detailed description and the specific examples serve only for illustrative purposes.

[0008] The above features and advantages, as well as further features and advantages of the system and method disclosed herein, are readily apparent from the following detailed description, including the claims and exemplary embodiments, in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] The present invention will become more fully apparent from the detailed description and the accompanying drawings, whereby the following applies: Fig. Figure 1 is a schematic representation of a system for guiding the movement of a user. Fig. 2 is a front view of a user holding the first portable device of the system. Fig. 1 carries. Fig. Figure 3 is a front view of a user who has a second portable device and a third portable device of the system. Fig. 1 carries. Fig. 4 is a method for guiding the user's movements using the system of Fig. 1. DETAILED DESCRIPTION

[0010] Reference is now made in detail to several examples of the invention, which are illustrated in the accompanying drawings. Whenever possible, the same or similar reference numerals are used in the drawings and the description to refer to identical or similar parts or steps.

[0011] With reference to Fig. 1-3 A system 10 can be used for user guidance for visually impaired users 12. The system comprises a mobile device 14 (or other computing device). In the present invention, the term "mobile device" means a portable electronic device that can be connected to the Internet, in particular a smartphone or a tablet computer. The mobile device 14 comprises a device controller 34 with at least one processor 44 and at least one non-transient computer-readable storage device or medium 46. The processor 44 can be a custom processor, a central processing unit (CPU), a graphics processing unit (GPU), an auxiliary processor among several processors connected to the controller 34, a semiconductor-based microprocessor (in the form of a microchip or chipset), a macroprocessor, a combination thereof, or generally an instruction-executing device.The computer-readable storage devices or media 46 can include volatile and non-volatile memory, e.g., read-only memory (ROM), random-access memory (RAM), and keep-alive memory (KAM). KAM is a persistent or non-volatile memory that can be used to store various operating variables while the processor 44 is powered off. The computer-readable storage device or medium of the controller 34 can be implemented using a variety of storage devices such as PROMs (programmable read-only memory), EPROMs (electrical PROMs), EEPROMs (electrically erasable PROMs), flash memory, or other electrical, magnetic, optical, or combined storage devices capable of storing data, some of which represent executable instructions.As mentioned previously, the mobile device 14 can be replaced or supplemented by any other computing device that includes at least one processor 44 and at least one non-transitory computer-readable storage device or medium 46. As mentioned previously, the system 10 can include another computing device instead of (or in addition to) the mobile device 14. The computing device includes one or more device controllers 34, each of which in turn includes at least one processor 44 and at least one non-transitory computer-readable storage device or medium 46. The computing device could, for example, be an in-vehicle interface.

[0012] The mobile device 14 also includes one or more vehicle transceivers 36 that communicate with the device controller 34. Each of the vehicle transceivers 36 is configured to wirelessly communicate information to and from other units, for example, using one or more wireless communication technologies. Wireless communication technologies include, for example, near-field communication (NFC), ultra-wideband (UWB), Bluetooth, Wi-Fi, and a cellular network. For example, the transceivers 36 can send and / or receive information to one or more remote systems 50 in a remote call center (e.g., GENERAL MOTORS' ON-STAR) and / or personal electronic devices, such as a mobile phone. The remote system 50 can be operated by an operator 52 (i.e., a person) referred to as an "off-board advisor."In certain embodiments, the transceivers 36 can be configured to communicate via a wireless local area network (WLAN) according to the IEEE 802.11 standard or via cellular data communication. However, additional or alternative communication methods are also considered within the scope of the present invention.

[0013] The mobile device 14 contains one or more GNSS (Global Navigation Satellite System) transceivers 16 and / or receivers (e.g., Global Positioning System transceivers and / or receivers) that communicate with the device controller 34. The GNSS transceivers 16 receive location data from the GNSS (e.g., GPS). Furthermore, the mobile device 14 has one or more speakers 18 configured to generate acoustic signals, such as navigation commands. The speaker 18 is connected to the device controller 34. Accordingly, the device controller 34 can command the speaker 18 to generate an audible sound.

[0014] System 10 also includes a first wearable device 20 that communicates wirelessly or via a wired connection with the mobile device 14 (or other computing device). The first wearable includes a lanyard 22 and an electronic tag 24 attached to the lanyard 22. Instead of a lanyard 22, the electronic tag can also be attached magnetically or with a pin to clothing. The visually impaired user 12 can wear the first wearable device 20 around their neck. The electronic tag 22 includes one or more cameras 26, one or more LiDAR sensors 24 (or another distance sensor such as ultrasonic sensors that calculate the distance from a stereographic camera pair, etc.), an inertial measurement unit (IMU) 26, and possibly other types of sensors. These sensors (e.g.,Cameras 26, LiDAR sensors 24, and IMUs 26 generate sensor data and transmit it wirelessly to the device controller 34. The sensor data includes at least the image data acquired by the camera 26 and the LiDAR data acquired by the LiDAR sensor 24. The first portable device 20 also includes one or more loudspeakers 18 for generating audible sounds and one or more gimbal stabilizers 30 to keep the electronic pendant 24 in an upright position, thus maximizing the quality of the sensor measurements.

[0015] System 10 also includes a second wearable device 40 and a third wearable device 60, each wirelessly connected to the mobile device 14. The second wearable device 40 is a first ring 42, and the third wearable device 60 is a second ring 62. Both the first ring 42 and the second ring 42 are sized to fit around a human finger 11. For example, the first ring 42 can be worn on a left finger 11 and the second ring 62 on a right finger 11 to provide directional instructions to a destination. Both the first wearable device 40 and the second wearable device 60 have one or more speakers for outputting acoustic signals, such as navigation instructions. Both the first wearable device 40 and the second wearable device 60 contain one or more haptic actuators 17 (e.g.,Actuators with eccentric rotating masses) to generate the haptic feedback. The haptic feedback generated by the first portable device 40 and the second portable device 60 represents directional instructions. For example, haptic feedback generated by the first ring 42 indicates a right turn, while haptic feedback generated by the second ring 62 indicates a left turn. The first portable device 20, the second portable device 40, and the third portable device 60 can each have one or more computing devices comprising at least one processor 44 and at least one non-transient computer-readable storage device or medium 46.

[0016] Fig.Figure 4 shows a procedure 100 for guiding or navigating the user. The device controller 34 is programmed to execute the procedure 100. The procedure 100 begins in block 102. In block 102, the visually impaired user 12 enters a destination or makes a destination request via the mobile device 14, the first portable device 20, the second portable device 40, and / or the third portable device 60. The destination request includes a destination. The system 11 (e.g., the device controller 34) then determines the route to reach the destination. The procedure 100 then continues with block 106. In block 106, the system 11 (e.g., the device controller 34) receives the sensor data from the first portable device 20. As mentioned earlier, the sensor data can include, among other things, the image data captured by the camera 26 and the LIDAR data captured by the LIDAR sensor 24. The procedure 100 is then continued with block 108.

[0017] In block 108, the device controller 34 attempts to establish wireless communication with the remote system 50. If no communication is established between the remote system 50 and the mobile device 14, the procedure 100 continues with block 110. In block 110, the device controller 34 determines the appropriate path to follow the previously defined route to the destination. The procedure 100 then continues with block 112. In block 112, the device controller 34 determines the navigation instructions to reach the destination. These navigation instructions may be pedestrian instructions (e.g., instructions to walk) to reach the destination. Next, the procedure 100 proceeds to block 114.

[0018] In block 114, the device controller 34 commands the first portable device 20, the second portable device 40, the third portable device 60, and / or the speaker 18 of the mobile device 14 to issue the navigation instructions to reach the destination. The navigation instructions to reach the destination can be made audible via the speakers 18 of the first portable device 20, the second portable device 40, and the third portable device 60. Alternatively or additionally, haptic feedback can be provided via the second portable device 40 and / or the third portable device 60 as part of the navigation instructions. The navigation instructions can also be provided via the electronic tag 24 of the first portable device 20. The procedure 100 then continues with block 116.

[0019] In block 116, the device controller 34 determines whether the visually impaired user 12 has reached their destination. If the visually impaired user 12 has not reached their destination, the procedure 100 returns to block 106. If the visually impaired user 12 has reached their destination, the procedure 100 continues with block 118. The procedure 100 ends in block 118.

[0020] Once wireless communication is established between the remote system 50 and the mobile device 14, procedure 100 returns to block 108 and continues with block 120. In block 120, the device controller 34 sends the sensor data to the remote system 50. Procedure 100 then continues with block 122. The remote system 50, for example, issues navigation instructions along the route via an operator 52. The navigation instructions are given orally by the operator 52 of the remote system 50 and relayed to the visually impaired user 12. Procedure 100 then continues with block 124. The system 11 (e.g., device controller 34) receives the navigation instructions. Procedure 100 then continues with block 114.

Claims

[1] Method for guiding the movement of a user (12), comprising: Receiving a destination request by a computer device, wherein the destination request contains a destination, the computer device contains a device controller (34), and the device controller (34) contains a processor (44) and a non-transitory computer-readable medium (46) in communication with the processor (44); Receiving sensor data from a first portable device (20) by the computer device, wherein the first portable device (20) comprises a camera (26) and a distance sensor, wherein the sensor data includes image data captured by the camera (26); Establishing communication between the computer device and a remote system (50) in response to receiving the destination request; and Transmission of sensor data by the computer device to the remote system (50) in response to the establishment of communication between the computer device and the remote system (50); characterized by Receiving navigation instructions to the destination from the remote system (50) by the computer device; and Output of the navigation instructions by a second portable device (40) in the form of a first finger ring (42) and a third portable device (60) in the form of a second finger ring (62), wherein both the first ring (42) and the second ring (62) are configured to generate haptic feedback that forms the navigation instructions; and wherein the first portable device (20) comprises an electronic pendant (24) attached to a lanyard (22) worn by the user (12) around his neck, and which contains the camera (26), the distance sensor and a speaker (18) through which the navigation instructions are also given. [2] Method according to claim 1, wherein the computing device is a mobile device (14) and / or a vehicle-internal interface, the distance sensor is a LIDAR sensor (24), the sensor data includes LIDAR data collected by the LIDAR sensor (24), and the method further comprises outputting the navigation instructions via a loudspeaker (18) of the mobile device (14). [3] Method according to claim 1, wherein both the first finger ring and the second finger ring contain an actuator with an eccentric rotating mass to generate haptic feedback. [4] Method according to claim 2, wherein the navigation instructions are given orally by an operator (52) of the remote system (50). [5] Method according to claim 3, wherein the electronic tag (24) of the first portable device (20) is configured to output the navigation instructions. [6] The method of claim 5, further comprising: Determine that communication between the mobile device (14) and the remote system (50) has not been established; and Determining the navigation instructions to reach the destination by the mobile device (14) in response to the finding that communication between the mobile device (14) and the remote system (50) has not been established.

Images