Navigation method, navigation device, and computer readable storage medium
By acquiring information from visually impaired individuals and guide dogs, navigation prompts are generated and output, solving the problem that guide dogs cannot judge dangerous areas and enabling safe navigation and rescue assistance for visually impaired individuals in complex environments.
Patent Information
- Application Number
- CN202111582615.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-22
- Publication Date
- 2025-11-25
- Estimated Expiration
- 2041-12-22
AI Technical Summary
Existing guide dogs are unable to effectively identify and avoid potentially dangerous areas caused by natural or official factors when navigating visually impaired individuals. This means that navigation devices cannot completely replace the work of guide dogs, increasing the risks for visually impaired individuals when traveling.
A navigation method and apparatus are provided, which acquires the biodiversity information, location information and movement information of visually impaired persons and guide dogs, respectively, and generates and outputs navigation prompts, including voice and commands, to coordinate navigation to avoid dangerous areas and seek rescue.
It improves the safety and independence of visually impaired people when traveling, reduces the risk of accidents, enhances the assistance effect of guide dogs, and ensures the safety and health of visually impaired people in complex environments.
Smart Images

Figure CN116327569B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application belongs to the field of navigation technology, in particular to a navigation method, a navigation device and a computer readable storage medium. BACKGROUND
[0002] In daily life, people train guide dogs to serve the visually impaired. Guide dogs can be trained to stop and remind the owner to pay attention in time when the visually impaired person faces a crosswalk / step / turn or encounters an unexpected situation, ensuring the safety of the owner and improving the travel speed and quality of life of the owner.
[0003] However, in the actual working environment of guide dogs, guide dogs can only obtain information about the road ahead through their senses, and are not good at judging potential dangers or temporary situations on the road ahead, such as potential landslides after heavy rain, blocked areas such as epidemics or radiation, or areas that cannot be entered due to temporary road closures or changes in official factors. In the face of these situations, guide dogs usually cannot judge the situation according to traffic signs on the spot. Although there are smart devices such as canes in the prior art to guide the visually impaired on the road, the cane and other devices cannot restrict the actions of the visually impaired. Guide dogs will interfere with / prevent dangerous actions of the visually impaired, so the cane and other devices in the prior art cannot completely replace the work of guide dogs. Therefore, how to enable guide dogs to also obtain corresponding navigation information to better serve the visually impaired is a problem that needs to be considered by those skilled in the art.
[0004] For the above problems, those skilled in the art have been seeking solutions.
[0005] The foregoing narrative is to provide general background information and does not necessarily constitute the prior art. SUMMARY
[0006] The technical problem solved by the present application is that there are few navigation methods suitable for the visually impaired in current navigation methods, not to mention the case with guide dogs. Based on the technical problem of how to output navigation information to the user and the guide dog at the same time, a navigation method, a navigation device and a computer readable storage medium are provided, which can generate and output navigation information according to the differences between the visually impaired and the guide dog, so that the visually impaired and the guide dog can both receive the navigation information. The visually impaired can not only be guided by the navigation method itself when traveling, but also be assisted by the guide dog, which can make the visually impaired travel more safely and conveniently, reduce the risk and danger of accidents, and increase the independence of the visually impaired in traveling, ensuring the personal safety and health of the visually impaired.
[0007] The technical problem solved by the present application is solved by the following technical solution:
[0008] The application provides a navigation method, comprising the following steps: obtaining user information, the user information comprising biological species information, position information and movement information; matching corresponding navigation prompt information according to the user information; and outputting the navigation prompt information.
[0009] The application also provides a navigation device comprising a processor and a memory, wherein the processor is configured to execute a computer program stored in the memory to implement the steps of the navigation method as described above.
[0010] The application also provides a computer readable storage medium storing a computer program, wherein the computer program is configured to implement the steps of the navigation method as described above when executed by a processor.
[0011] The application also provides a navigation method, a navigation device and a computer readable storage medium. The navigation method comprises the following steps: obtaining user information, the user information comprising biological species information, position information and movement information; matching corresponding navigation prompt information according to the user information; and outputting the navigation prompt information. Therefore, the application can generate navigation information and output the navigation information correspondingly according to the differences between the visually impaired and the guide dogs, so that the visually impaired and the guide dogs can both receive the navigation information, the visually impaired can be guided not only by the navigation method itself but also by the guide dogs when going out, and the visually impaired can go out more safely and conveniently, the risk and danger of accidents are reduced, the independence of the visually impaired in going out is increased, and the personal safety and health of the visually impaired are ensured. In addition, the navigation method provided by an embodiment of the application can also identify dangerous areas, such as epidemic blockade areas, that the visually impaired cannot understand through vision, prevent the visually impaired from entering such dangerous areas, and ensure the health and safety of the visually impaired. At the same time, the related positions of the visually impaired are monitored in real time, and rescue is sought immediately when the visually impaired walk out of the care area or an accident occurs, etc., so that the health and safety of the user are ensured, the operation of the user is reduced, the convenience of the user is increased, and the use experience of the user is improved.
[0012] The above description is only a summary of the technical solutions of the application. In order to make the technical means of the application more clearly understood and implemented according to the content of the specification, and in order to make the above and other purposes, characteristics and advantages of the application more obvious and easy to understand, the following preferred embodiments are described in detail, and the accompanying drawings are referred to. BRIEF DESCRIPTION OF DRAWINGS
[0013] In order to make the technical solutions of the embodiments of the present application or the prior art clearer, the accompanying drawings needed in the embodiments or prior art description will be briefly introduced. Obviously, the accompanying drawings in the following description are only some embodiments of the present application, and all other drawings obtained by those of ordinary skill in the art without creative effort based on these drawings belong to the protection scope of the present application.
[0014] Figure 1 The flowchart of the navigation method provided by the first embodiment of the present application is shown in the figure.
[0015] Figure 2 The flowchart of the navigation method provided by the second embodiment of the present application is shown in the figure.
[0016] Figure 3 The flowchart of the navigation method provided by the third embodiment of the present application is shown in the figure.
[0017] Figure 4 The structural diagram of the navigation device provided by the fourth embodiment of the present application is shown in the figure.
[0018] Figure 5 The installation position diagram of the navigation device provided by the fourth embodiment of the present application is shown in the figure. DETAILED DESCRIPTION
[0019] In order to make the technical solutions of the embodiments of the present application or the prior art clearer, the accompanying drawings needed in the embodiments or prior art description will be briefly introduced. Obviously, the accompanying drawings in the following description are only some embodiments of the present application, and all other drawings obtained by those of ordinary skill in the art without creative effort based on these drawings belong to the protection scope of the present application.
[0020] The embodiments of the present application will be further described in detail below with reference to the accompanying drawings.
[0021] First Embodiment
[0022] Figure 1 The flowchart of the navigation method provided by the first embodiment of the present application is shown in the figure. In order to clearly describe the navigation method provided by the first embodiment of the present application, please refer to Figure 1 .
[0023] The first embodiment of the present application provides a navigation method, which can be used for the navigation method of visually impaired people, preferably for visually impaired people carrying guide dogs, and according to the different biological species information and biological feature information of the visually impaired people and the guide dogs, the navigation prompt information is matched and output correspondingly, so as to ensure the travel safety of the visually impaired people and improve the travel speed and life quality of the visually impaired people. Therefore, preferably, the implementation scene of the navigation method needs the visually impaired people to carry the guide dogs, and specifically can include the following steps:
[0024] Step S1: obtaining user information, the user information including biological species information, position information and movement information.
[0025] In an embodiment, the biological species information mainly plays two roles: 1, determining whether the user carries a guide dog; 2, distinguishing the user and the guide dog. Therefore, for the biological species information, it can be distinguished by height information, temperature information, body shape information, etc., for example, below a certain height threshold, the temperature meets the corresponding threshold range, and the body shape is non-human, which is a guide dog, and the subsequent generated and output navigation prompt information will be different. In addition, the acquisition of position information and movement information is more existing, so it will not be expanded in detail. However, it is worth noting that the movement information can include speed information, acceleration information, direction information, etc., which will be used as an identification factor in the following text, and will be described in detail in the following text. Here, only a simple example is given.
[0026] Step S2: matching the corresponding navigation prompt information according to the user information.
[0027] In an embodiment, in step S1, the user information can be used to determine whether the user carries a guide dog and distinguish the visually impaired person and the guide dog, and in step S2, the navigation prompt information is matched. Specifically, it can also be the current navigation technology: according to the starting point and destination input by the user, the navigation route obtained is planned, and the navigation output is performed in real time during the travel of the visually impaired person.
[0028] In an embodiment, the navigation prompt information includes at least one of navigation prompt content and / or navigation prompt instruction, and in step S2: matching the corresponding navigation prompt information according to the user information, it includes: judging whether the biological feature information belongs to a natural person condition: if yes, matching the navigation prompt content corresponding to the natural person; if not, matching the navigation prompt instruction corresponding to the non-natural person.
[0029] In an embodiment, it can be understood that the above is an explanation of the content of the navigation prompt information, but since the navigation method provided by the present application outputs to both the visually impaired person and the guide dog, the process of matching the content of the navigation prompt information is matched with the corresponding output form. Specifically, it can include at least one of the navigation prompt content and / or the navigation prompt instruction. Among them, the navigation prompt content is preferably output to the visually impaired person, and in view of the inconvenience of the visual impairment of the visually impaired person, the navigation prompt content is specifically preferably in the form of voice content; and the navigation prompt instruction is output to the guide dog. For the guide dog, it is a guide dog trained in the guide dog base, which can respond to the corresponding navigation instruction to make corresponding actions to assist the visually impaired person in guiding and navigating, therefore, the preferred navigation prompt is specifically the corresponding instruction content, such as simple "sit", "wait", "walk", "turn left", "turn right", etc.; It can also be a vibration with a frequency, for example, three long vibrations are "walk", three long vibrations are "stop", etc., and the specific implementation is not limited, which does not affect the overall implementation of the technical scheme in the embodiment of the present application, and can be regarded as equivalent replacement or derivation of the technical scheme claimed in the embodiment of the present application.
[0030] In an embodiment, in the step S2 of matching the corresponding navigation prompt information according to the user information, it includes: obtaining the navigation path information according to the user information; when the navigation path information includes the associated area, matching the navigation prompt information including the area navigation information according to the associated area.
[0031] In an embodiment, the navigation path information can include two possibilities: the first is to plan the navigation path, that is, to obtain the planned navigation path according to the existing navigation method by outputting the starting point and the ending point; the second is to determine the travel path that the user is likely to proceed according to the position information and the movement information. When any of the paths passes through the associated area, the navigation prompt information including the area navigation information can be matched when approaching the associated area. The specific inclusion form of the associated area will be explained in detail later, and the navigation prompt information of the area navigation information is a limitation on the content, not a limitation on the form, that is, in the output process, it is output to both the visually impaired person and the guide dog.
[0032] In an embodiment, the associated area includes a traffic intersection area, a no-entry area, a care area, and the navigation prompt information includes at least one of the forward prompt information, the waiting prompt information, and the detour prompt information. In the above step of matching the corresponding navigation prompt information according to the associated area, it includes: matching the forward prompt information and / or the waiting prompt information according to the traffic intersection area; matching the detour prompt information according to the no-entry area; and matching the detour prompt information and / or the waiting prompt information according to the care area.
[0033] In an embodiment, the associated area includes at least one of a traffic intersection area, a dangerous no-entry area, and a care area. The traffic intersection area can include, but is not limited to, an intersection area, a public transportation stop area, or a downtown area, i.e., a situation that a visually impaired person can encounter in normal traffic, wherein the intersection area can be, for example, a red light intersection; the public transportation stop area can include, in addition to conventional buses and subways, a ride-hailing service; and the downtown area can correspond to a general bustling commercial street, a market, etc. It can be understood that in the actual working environment of a guide dog, the guide dog can only obtain information about the road ahead through sensory organs, and the potential danger of the road ahead cannot be determined. Therefore, the no-entry area is mainly for potential dangerous areas that are invisible to visually impaired people and unknown to guide dogs, which can include, but is not limited to, dangerous areas that cannot be entered due to natural disasters, such as epidemic lockdown areas, radiation virus pollution areas, potential landslides after heavy rain, etc. It can also include some man-made road closures caused by reasons other than natural disasters, which can include, but are not limited to, temporary no-entry road sections designated by the government: temporary road repair, marathon road closure, accident road section, etc. Further, the care area can be an electronic fence area set by a caregiver or guardian of a visually impaired person, i.e., a restricted virtual area range set to ensure the safety of a visually impaired person, such as a range set for a visually impaired person to move within a community. It can be understood that the above are general examples of the meaning and specific forms of the associated area, and the actual situation is complex and diverse and cannot be exhaustively listed. Therefore, the above are descriptions of the technology, not limitations of the technology.
[0034] In an embodiment, the navigation prompt information comprises at least one of the advance prompt information, the waiting prompt information, and the detour prompt information. This corresponds to the specific content of the navigation prompt information, and because it is a content restriction, it can be output to both the visually impaired person and the guide dog at the same time. The specific matching process can include: matching the advance prompt information and / or the waiting prompt information according to the traffic intersection area; matching the detour prompt information according to the no-entry area; and matching the detour prompt information and / or the waiting prompt information according to the care area. Specifically, for the traffic intersection area, that is, in general traffic conditions, there is no detour or no-entry situation, and generally there is advance prompt information that can continue to advance or waiting prompt information that needs to wait until the road conditions can advance. For example, at the intersection, when the front is a red light, the waiting prompt information is matched; and when it becomes a green light, the advance prompt information is matched. Similarly, in the no-entry area, it is not allowed to enter, and the detour prompt information is matched, and the visually impaired person detours, with the assistance of the guide dog. Finally, for the care area, the detour prompt information and / or the waiting prompt information is matched. Generally, it is preferred that the visually impaired person can only move within the care area and cannot leave the care area at will, so the detour prompt information needs to be matched; and in special cases, such as entering or leaving an epidemic blockade area, assistance from relevant personnel is required, and the visually impaired person and the guide dog need to output the waiting prompt information to inform them to wait for assistance. At the same time, assistance is broadcasted externally, which will be described in detail later.
[0035] In an embodiment, in the step S2 of matching the corresponding navigation prompt information according to the user information, it includes: judging whether the user information meets the assistance condition; if yes, generating and outputting the assistance information; and if no, matching the corresponding navigation prompt information according to the user information.
[0036] In an embodiment, it can be understood that, due to the inconvenience of the visually impaired person's vision, assistance is needed during navigation. For example, when the visually impaired person needs to leave or enter the care area, certain assistance is needed. Specifically, for example, when leaving an epidemic area, nucleic acid testing is needed, although there may be signs indicating the location, but due to the inconvenience of the visually impaired person, the guide dog cannot recognize and guide, and the existing navigation method cannot completely guide the visually impaired person to move, and human assistance is needed to guide them to the testing area. In another embodiment, due to the inconvenience of the visually impaired person, it is possible that the visually impaired person will stumble and fall during the journey, and in the case of possible injury, assistance information can be broadcasted externally in a timely manner, or assistance information can be sent to the guardian or caregiver. At the same time, since the guide dog is accompanied, the guide dog can also be instructed to seek help in a timely manner to find help for the visually impaired person.
[0037] In an embodiment, the movement information includes movement speed, and the position information includes current position, and the step of judging whether the user information meets the help condition includes: the movement speed exceeds a speed threshold; and / or, the current position is not located in the care area.
[0038] In an embodiment, for the movement information, preferably, it includes movement speed information, and specifically, it can further include direction information of the speed, acceleration information, etc., and the recorded is not simply discrete numerical points, but dynamic vectors, which can well understand the state of the visually impaired person. Correspondingly, the help condition includes: the movement speed exceeds a speed threshold; and / or, the current position is not located in the care area. For the current position not being located in the care area, it is easy to understand in combination with the foregoing description of the care area, that is, the visually impaired person has left the prescribed activity range, and the behavior of the visually impaired person needs to be confirmed to determine whether help is needed. In addition, for the movement speed exceeding a speed threshold, specifically, it can include, but is not limited to, for example, abnormal up-down movement, abnormal acceleration change, and abnormal speed. It can be understood that, in general, for the visually impaired person walking, the speed direction is horizontal, and the device worn on the body will not have a large direction change, and if there is an abnormal up-down speed change, it is possible to correspond to a falling situation; similarly, the same is true for acceleration and speed. In normal circumstances, the speed direction, value and change are relatively stable, and if an abnormality occurs, especially exceeding a certain threshold and being in a wrong direction, it is possible to correspond to an accident situation, and then the help information can be generated and output.
[0039] Step S3: outputting the navigation prompt information.
[0040] In an embodiment, in addition to the content and form of the navigation prompt information described above, the output navigation prompt information can further include the output mode and the output frequency.
[0041] In an embodiment, in the step S3 of outputting the navigation prompt information, it includes: outputting the navigation prompt information including the navigation prompt content to the user through the associated mobile terminal, and outputting the navigation prompt information including the navigation prompt instruction through the associated blind guiding device.
[0042] In an embodiment, the output form is also distinguished. Since the navigation method provided by the present application is preferably for a visually impaired person with a guide dog, in the output process, the output is preferably to both the visually impaired person and the guide dog, or to either one of them. Specifically, the navigation prompt content can be output to the visually impaired person through a mobile terminal, which can be, but is not limited to, a mobile phone, a tablet computer, a personal digital assistant (PDA), a mobile Internet device (MID), a wearable device (such as a smart watch), and the like. Further, it can also be combined with the visually impaired person's tool, such as a walking stick, or a smart earphone, and the like. Further, for the navigation prompt content, the voice content is preferably for the physiological condition of the visually impaired person. Similarly, the navigation prompt instruction can be output to the guide dog through a guide dog device, which can be a device installed on the guide dog's leash or collar, and the like. Since the guide dog is generally trained through voice instructions, the guide dog device that outputs the navigation prompt instruction to the guide dog can be specifically a small loudspeaker, a portable sound device, a vibrating bell, and the like.
[0043] In another embodiment, due to the development of bionics, the guide dog can also be an electronic guide dog, and the like. The previous steps are also applicable. Through the biological species information, the biological user of the visually impaired person and the non-biological electronic guide dog are distinguished. Then, when outputting the navigation prompt instruction, the world outputs an electronic instruction to the electronic guide dog to assist the visually impaired person in traveling.
[0044] In an embodiment, in the step S3 of outputting the navigation prompt information, it includes: when the relative distance between the position information and the associated area is less than the distance threshold, outputting the area navigation information.
[0045] In an embodiment, specifically, a certain threshold can be set or preset, and when the user approaches the associated area, the corresponding area navigation information is output. Further, the size of the relative distance can also be matched with the output frequency, and the lower the distance, the higher the frequency. In another embodiment, in the voice output mode, it can also be matched with the volume, for example, the lower the distance, the higher the volume. Thus, the navigation prompt information is timely and effectively output to the visually impaired person or the guide dog.
[0046] In an embodiment, in the above-mentioned steps of generating and outputting the help information and outputting, it includes: broadcasting the help information to the outside; and / or, outputting the help information including the rescue guidance instruction.
[0047] In an embodiment, in the case that the user needs help, help information can be broadcasted outward, for example, broadcasted outward through wireless communication technologies such as Bluetooth, WIFI, etc., and can also be directly broadcasted through a loudspeaker. At the same time, help information can also be sent to the guardian or caretaker of the visually impaired person to seek help. In addition, since there is a guide dog by the side, rescue guidance instructions can be output, and the guide dog can be instructed to seek help in a trained manner, for example, to find passers-by for help.
[0048] The navigation method provided by the first embodiment of the present application comprises the following steps: step S1: obtaining user information, the user information comprising biological species information, position information and movement information; step S2: matching corresponding navigation prompt information according to the user information; and step S3: outputting the navigation prompt information. Therefore, the present application can generate navigation information and output it correspondingly according to the differences between the visually impaired person and the guide dog, so that the visually impaired person and the guide dog can both receive the navigation information, the visually impaired person can travel more safely and conveniently when going out with the help of the guide dog, the risk and danger of accidents are reduced, the advantages and characteristics of the guide dog are combined, the independence of the visually impaired person in traveling is increased, and the personal safety and health of the visually impaired person are ensured. In addition, the navigation method provided by the embodiment of the present application can further identify dangerous areas that the visually impaired person cannot understand through vision, such as epidemic blockade areas, to prevent the visually impaired person from entering such dangerous areas and ensure the health and safety of the visually impaired person. At the same time, the position of the visually impaired person is monitored in real time, and rescue is immediately sought when the visually impaired person walks out of the care area or an accident occurs, etc., which also ensures the health and safety of the user, reduces the operation of the user, increases the convenience of the user, and improves the use experience of the user.
[0049] Second embodiment
[0050] Figure 2 The flowchart of the navigation method provided by the second embodiment of the present application is shown in the figure. In order to clearly describe the navigation method provided by the second embodiment of the present application, please refer to Figure 1 and Figure 2 .
[0051] The navigation method provided by the second embodiment of the present application is mainly for whether the visually impaired person will enter a dangerous area during the travel process, especially for some situations that the visually impaired person and the guide dog cannot know, which can include but are not limited to, for example, epidemic blockade areas, radiation virus pollution areas, potential landslides in heavy rain areas, and other dangerous areas that cannot be entered. Specifically, the following steps can be taken:
[0052] Step S21: obtaining user position information and movement information.
[0053] Step S22: judging whether entering a dangerous area or not:
[0054] If not, return to step S21, if yes, execute step S23: outputting navigation prompt information to the guide dog and the user.
[0055] Step S24: judging whether leaving the dangerous area or not: if not, return to step S23, if yes, return to step S21.
[0056] In an embodiment, it is worth noting that the movement information can include movement direction information. For judging whether entering a dangerous area or not, the path information of the visually impaired person can be used for judging. Specifically, the path information can include a navigation path and a travel path. The navigation path, i.e. according to the existing navigation method, is a planned path obtained by outputting a starting point and an ending point; the travel path is a travel path that the user is likely to proceed according to the position information and the movement direction information in the movement information, etc., combined with the user's habits, etc. Whether there is a coincidence between the path analysis and the dangerous area is judged to determine whether the dangerous area will be entered or not or whether it is located in the dangerous area. It can be understood that such an analysis process is equally applicable to step S22 or step S24.
[0057] In an embodiment, the navigation prompt information is output to the guide dog and the user in step S23. The navigation prompt information includes two aspects, namely, the output form and the output content. It can be understood that the output form is different because the two different subjects output the content in step S23. For the user, namely, the visually impaired person, the output form is preferably the voice content of the navigation prompt, which informs the user how to leave or move away from the dangerous area. For the guide dog, the output is the instruction information corresponding to the training content because the guide dog is trained. The guide dog is prompted to respond to the corresponding instruction to assist the visually impaired person to normally travel, leave or move away from the dangerous area. Furthermore, in another embodiment, the guide dog can also be an electronic guide dog. The output navigation prompt information is also corresponding electronic information, which makes the electronic guide dog also respond through the electronic instruction. In addition, the content of the navigation prompt information can be changed differently according to the position information of the visually impaired person. For example, for the visually impaired person outside the dangerous area, the visually impaired person can be informed to move away or bypass the dangerous area without approaching the dangerous area. If the visually impaired person enters the dangerous area, the corresponding navigation information can be output to guide the visually impaired person to leave the dangerous area. The waiting prompt and the broadcasted help information can also be output to wait for the relevant personnel to come to assist the visually impaired person to move away, especially for the variable situation that the visually impaired person and the guide dog cannot know, such as the dangerous area full of pits and bumps. It can be understood that the above is a simple description of the technology, not a limitation of the technology, and the navigation method provided in the first embodiment of the present application also has a more detailed description. Specifically, the related description in the foregoing can also be referred to.
[0058] The navigation method provided in the second embodiment of the present application includes the following steps: step S21, acquiring the position information and the movement information of the user; step S22, judging whether the user enters the dangerous area; if not, returning to step S21; if yes, executing step S23, outputting the navigation prompt information to the guide dog and the user; step S24, judging whether the user leaves the dangerous area; if not, returning to step S23; if yes, returning to step S21. Therefore, the present application can output the navigation prompt information to the visually impaired person and the guide dog at the same time when the visually impaired person is located in or close to the dangerous area. The guide dog can assist the visually impaired person to move away from the dangerous area in addition to the guidance of the present application, thereby ensuring that the visually impaired person travels more safely and conveniently, reducing the risk and danger of accidents, combining the advantages and characteristics of the guide dog, increasing the independence of the visually impaired person in traveling, and ensuring the personal safety and health of the visually impaired person.
[0059] Third embodiment
[0060] Figure 3A flowchart of the navigation method provided by the third embodiment of the present application is shown in FIG. 3. In order to clearly describe the navigation method provided by the third embodiment of the present application, please refer to FIG. 3. Figure 1 and Figure 3 .
[0061] Step S31: Obtain user information, which includes biological species information, position information, and movement information.
[0062] In an embodiment, the biological species information mainly plays two roles: 1. determining whether the user carries a guide dog; 2. distinguishing the user and the guide dog. Therefore, for the biological species information, it can be distinguished by height information, temperature information, body shape information, etc. For example, if the temperature is below a certain threshold, the temperature meets the corresponding threshold range, and the body shape is non-human, it is a guide dog. Therefore, the subsequent generated and output navigation prompt information will be different. In addition, the acquisition of position information and movement information is relatively existing, so it will not be expanded specifically. However, it is worth noting that the movement information can include speed information, acceleration information, direction information, etc., which will be used as a recognition factor in the following text. Specifically, it will be described in detail in the following text, and here is only a simple example.
[0063] Step S32: Determine whether the user meets the help condition according to the position information and / or movement information.
[0064] If yes, execute step S33: generate and output help information.
[0065] If no, execute step S34: generate and output navigation prompt information according to the user information.
[0066] In an embodiment, since the movement information can include speed information, acceleration information, direction information, etc., the recorded is no longer a simple discrete numerical point, but a dynamic vector, which can well understand the state of the visually impaired person. The corresponding help condition can be, for example, that the movement speed exceeds the speed threshold, and specifically can include but is not limited to, for example, abnormal up-down movement, abnormal acceleration change, and abnormal speed. It can be understood that, in general, for a visually impaired person walking, the speed direction is horizontal, and the device worn on the body will not have a large direction change. If there is an abnormal up-down speed change, it is likely to correspond to a falling situation; similarly, the same is true for acceleration and speed. In normal circumstances, the speed direction, value and change are relatively stable, and if an abnormality occurs, especially exceeding a certain threshold and in the wrong direction, it is likely to correspond to an accident situation, and help information can be generated and output. Further, since the judgment is made through numerical information, there may be false positives, so it is preferred to be trained by a large amount of big data. Furthermore, in order to prevent false touch, the user can be prompted before the help information is output, and if the visually impaired person does not respond or confirms that help is needed, the steps S33 are executed again.
[0067] In an embodiment, in the step of generating and outputting help information, the output help information approach can include three approaches: 1. sending confirmation information to the visually impaired person to confirm whether help is needed; 2. outputting help and rescue instructions to the guide dog; 3. outputting help information to the outside or to the rescue terminal. Specifically, for the first help information, i.e., the embodiment described above to prevent false touch and false start, it is preferred to be output before the second and third help information is output. If the visually impaired person does not respond within a certain time or confirms that help is needed, the second and third help information can be output. For the second help information, it is preferred to be instruction information output to the guide dog. It can be understood that the guide dog is a trained dog, and therefore can respond to the corresponding instructions. Similarly, when training the guide dog, help training can be added, so that when the second help information is received, the visually impaired person can get help, for example, which can include but is not limited to, barking loudly to attract the attention of passers-by, or directly seeking help from passers-by, etc.
[0068] In an embodiment, when outputting the help information, two forms can also be included, the first is to broadcast the help information outwardly; the second is to call for help to the rescue terminal. For the first, the rescue information can be sent to the surrounding through the short-range communication technology such as Bluetooth, WIFI, short message, etc., or can be broadcasted outwardly through the loudspeaker on the visual impaired person or the guide dog, etc. For the second, in the process of calling for help to the rescue terminal, the criticality or the criticality type of the visual impaired person can also be judged according to the process of judging whether the help condition is met before, for example, if the visual impaired person falls down and then gets up and continues to move forward, which does not cause much harm, then the help information can not be output to the rescue terminal; if the visual impaired person needs to be assisted to go to the nucleic acid detection as described above, then the help information can be directly broadcasted through the loudspeaker; if the abnormal speed of the visual impaired person is greater than a certain threshold, or the real-time position is not updated after the abnormal threshold, then the visual impaired person can be hit or fall down more seriously, so as to be unable to get up, then the help information needs to be output to the rescue terminal. The rescue terminal can include but is not limited to the terminal associated with the guardian or the caretaker of the visual impaired person, and can also be the rescue terminal associated with the hospital for calling for help. Specifically, the help information can include the time and location information of the last abnormality of the visual impaired person, and the possible injury, etc.
[0069] In another embodiment, the position information of the visual impaired person can also be used to judge, for example, the dangerous area described in the first embodiment or the second embodiment of the present application, etc. It can be understood that due to the inconvenience of the visual impaired person, help is needed in the navigation process, for example, when the visual impaired person needs to leave or enter the care area, certain help is needed. Specifically, when leaving the epidemic area, nucleic acid detection is needed, and due to the inconvenience of the visual impaired person, the simple navigation method cannot completely guide the visual impaired person to move, and human help is needed to guide the visual impaired person to the detection area, etc.
[0070] In an embodiment, the execution method of generating and outputting the navigation prompt information in step S34 has been described in detail in the navigation method provided in the first embodiment or the second embodiment, and can be referred to in the foregoing, which will not be repeated here.
[0071] The navigation method provided by the third embodiment of the present application comprises the following steps: step S31: obtaining user information, the user information comprising biological species information, position information and movement information; step S32: determining whether the user information meets a help-seeking condition according to the position information and / or the movement information; if yes, executing step S33: generating and outputting help-seeking information; if no, executing step S34: generating and outputting navigation prompt information according to the user information. Therefore, the present application can determine whether a visually impaired person needs help in addition to navigation, and output help-seeking information to the outside and a guide dog in correspondence, so as to timely seek help for the visually impaired person, and provide an additional layer of protection with the help of the guide dog, thereby ensuring safer and more convenient travel, reducing the risk and danger of accidents, combining the advantages and characteristics of the guide dog companion, increasing the independence of the visually impaired person in travel, and ensuring the personal safety and health of the visually impaired person.
[0072] Fourth embodiment
[0073] Figure 4 FIG. 1 is a first structural schematic diagram of a navigation device provided by the fourth embodiment of the present application; Figure 5 FIG. 2 is an installation position schematic diagram of the navigation device provided by the fourth embodiment of the present application. In order to clearly describe the navigation device 110 provided by the fourth embodiment of the present application, please refer to Figures 1 to 5 .
[0074] The navigation device 110 provided by the fourth embodiment of the present application comprises a processor A101 and a memory A201, wherein the processor A101 is configured to execute a computer program A6 stored in the memory A201 to realize the steps of the navigation method described in the first embodiment, the second embodiment or the third embodiment.
[0075] In an embodiment, the navigation device 110 provided by the present embodiment comprises at least one processor A101 and at least one memory A201. The at least one processor A101 can be referred to as a processing unit A1, and the at least one memory A201 can be referred to as a storage unit A2. Specifically, the storage unit A2 stores a computer program A6, and when the computer program A6 is executed by the processing unit A1, the navigation device 110 provided by the present embodiment realizes the steps of the navigation method described in the first embodiment, the second embodiment or the third embodiment. For example, Figure 1 the steps S1: obtaining user information, the user information comprising biological species information, position information and movement information; step S2: matching corresponding navigation prompt information according to the user information; and step S3: outputting the navigation prompt information. In an embodiment, the navigation device 110 provided by the present embodiment can comprise a plurality of memories A201 (referred to as storage units A2).
[0076] The storage unit A2 can be a volatile memory or a non-volatile memory, or both. The non-volatile memory can be a Read Only Memory (ROM), a Programmable Read-Only Memory (PROM), an Erasable Programmable Read-Only Memory (EPROM), an Electrically Erasable Programmable Read-Only Memory (EEPROM), a ferromagnetic random access memory (FRAM), a Flash Memory, a magnetic surface memory, an optical disk, or a Compact Disc Read-Only Memory (CD-ROM). The magnetic surface memory can be a disk memory or a tape memory. The volatile memory can be a Random Access Memory (RAM) used as an external cache. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory (DRAM), Synchronous Dynamic Random Access Memory (SDRAM), Double Data Rate Synchronous Dynamic Random Access Memory (DDR SDRAM), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM), SyncLink Dynamic Random Access Memory (SLDRAM), and Direct Rambus Random Access Memory (DRRAM).The storage unit A2 described in this embodiment of the invention is intended to include, but is not limited to, these and any other suitable types of memory.
[0077] In one embodiment, the navigation device 110 further includes a bus connecting different components (e.g., processor A101, memory A201, output device A3, etc.). The output device A3 is preferably a speaker capable of outputting voice navigation prompts to visually impaired individuals or guide dogs. It is understood that visually impaired individuals, due to their visual impairment, have relatively sensitive hearing; therefore, voice navigation prompts can be output through the speaker. Similarly, for guide dogs, navigation prompts are typically given through verbal commands during training, so a speaker can also be used to output navigation prompts to the guide dog. In another embodiment, the specific form of the output device A3 can be adjusted according to the guide dog's training method. For example, if the guide dog is trained using vibration, the corresponding output device A3 can be a vibrator. In another embodiment, if the guide dog is a non-biological form such as an electronic guide dog, the output device A3 can overlap with the I / O interface A4, directly outputting navigation prompts through electrical signals.
[0078] In one embodiment, the navigation device 110 in this embodiment may further include a communication interface (e.g., I / O interface A4) which can be used to communicate with external devices.
[0079] In one embodiment, the navigation device 110 provided in this embodiment may further include a communication device A5.
[0080] In one embodiment, the installation location of the navigation device 110 can be referenced. Figure 5 The two locations are shown. Location 1 is preferably mounted on the guide dog's leash or collar, near the dog's ears, to minimize external interference when outputting navigation cues, allowing the guide dog to receive the information more clearly. Location 2 is only illustrative and can specifically be a component in a user's mobile terminal, including but not limited to mobile phones, tablets, personal digital assistants (PDAs), mobile internet devices (MIDs), and wearable devices (such as smartwatches). Furthermore, it can be integrated with tools for the visually impaired, such as a cane or a component in headphones. In other words, location 2 has a broad scope and is difficult to exhaustively describe; therefore, the above is a simplified explanation of the technology, not a limitation.
[0081] The navigation device 110 provided by the fourth embodiment of the present application comprises the memory A101 and the processor A201, and the processor A101 is used to execute the computer program A6 stored in the memory A201 to realize the steps of the navigation method as described in the first embodiment, the second embodiment or the third embodiment. Therefore, the navigation device 110 provided by the present embodiment can generate navigation information and output the navigation information correspondingly according to the differences between the visually impaired person and the guide dog, so that the visually impaired person and the guide dog can both receive the navigation information, the visually impaired person can travel more safely and conveniently, the risk and danger of accidents are reduced, the advantages and characteristics of the guide dog are combined, the independence of the visually impaired person in traveling is increased, and the personal safety and health of the visually impaired person are ensured. In addition, the navigation method provided by an embodiment of the present application can further identify the dangerous area that the visually impaired person cannot understand through vision, such as an epidemic blockade area, prevent the visually impaired person from entering such dangerous area, and ensure the health and safety of the visually impaired person. At the same time, the related position of the visually impaired person is monitored in real time, and rescue is sought immediately when the visually impaired person walks out of the care area or an accident occurs, etc., so that the health and safety of the user are ensured, the operation of the user is reduced, the convenience of the user is increased, and the use experience of the user is improved.
[0082] The fourth embodiment of the present application further provides a computer readable storage medium, which stores the computer program A6. The computer program A6 is executed by the processor A101 to realize the steps of the navigation method as described in the first embodiment, the second embodiment or the third embodiment.
[0083] In an embodiment, the computer readable storage medium provided by the present embodiment can include any entity or device, recording medium capable of carrying computer program code, such as ROM, RAM, magnetic disk, optical disk, flash memory, etc.
[0084] The technical beneficial effects that can be realized by the computer program A6 stored in the computer readable storage medium provided by the fourth embodiment of the present application when executed by the processor A101 have been described in detail in the foregoing, and will not be described here again. Specifically, reference can be made to the foregoing.
[0085] The technical features of the above-described embodiments can be combined arbitrarily. In order to make the description simple, all possible combinations of the technical features in the above-described embodiments are not described, however, as long as the combinations of the technical features do not exist contradictory, it should be considered that the combinations are within the scope of the present application.
[0086] It should be noted that, in this article, the term "comprising", "including" or any other variant thereof is intended to cover a non-exclusive inclusion, such that processes, methods, articles or devices that comprise a list of elements do not include only those elements recited, but also other elements not expressly listed or inherent to such processes, methods, articles or devices. Without more limitations, the element defined by the statement "comprising a" does not exclude the presence of additional identical elements in the process, method, article or device including the element, and the components with the same name in different embodiments of the application may have the same meaning or different meanings, which should be determined according to its explanation in the specific embodiment or further combined with the context in the specific embodiment. In this article, the meaning of "a plurality of" or "several" is two or more, unless otherwise stated.
[0087] It should be understood that although each step in the flowchart in the embodiments of the present application is displayed in sequence according to the arrow, these steps are not necessarily executed in sequence according to the arrow. Unless otherwise stated in this article, the execution of these steps has no strict sequence limitation, and they can be executed in other order. Moreover, at least part of the steps in the figure can include multiple sub-steps or multiple stages, which are not necessarily executed at the same time, but can be executed at different times, and the execution order is not necessarily sequential, but can be alternately executed with other steps or sub-steps or stages of other steps.
[0088] Those skilled in the art can understand that all or part of the steps of the above-mentioned method embodiments can be completed by program instruction related hardware, and the aforementioned program can be stored in a computer readable storage medium, which executes the steps including the above-mentioned method embodiments when executed. The aforementioned storage medium includes ROM, RAM, magnetic disc or optical disc and various storage medium that can store program code.
[0089] The above is only a specific embodiment of the present application, but the protection scope of the present application is not limited thereto, and any skilled person in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A navigation method, comprising the steps of: obtaining user information, the user information comprising biological species information, location information, and movement information, wherein the biological species information is distinguished by at least one of height information, temperature information, and body shape information; matching corresponding navigation prompt information according to the user information; and outputting the navigation prompt information; wherein the navigation prompt information comprises at least one of navigation prompt content and / or navigation prompt instructions; wherein the step of matching corresponding navigation prompt information according to the user information comprises: determining whether the biological feature information belongs to a natural person; if yes, matching the navigation prompt content corresponding to a natural person; and if no, matching the navigation prompt instructions corresponding to a non-natural person. 2.The navigation method of claim 1, wherein the step of outputting the navigation prompt information comprises: outputting the navigation prompt information comprising the navigation prompt content to the user through an associated mobile terminal, and outputting the navigation prompt information comprising the navigation prompt instructions through an associated blind guiding device. 3.The navigation method of claim 1, wherein the step of matching corresponding navigation prompt information according to the user information comprises: obtaining navigation path information according to the user information; and when the navigation path information comprises an associated region, matching navigation prompt information comprising region navigation information according to the associated region. 4.The navigation method of claim 3, wherein the associated region comprises a traffic intersection region, a no-entry region, and a care region, and the navigation prompt information comprises at least one of forward prompt information, waiting prompt information, and detour prompt information; wherein the step of matching corresponding navigation prompt information according to the associated region comprises: matching the forward prompt information and / or the waiting prompt information according to the traffic intersection region; matching the detour prompt information according to the no-entry region; and matching the detour prompt information and / or the waiting prompt information according to the care region. 5.The navigation method of claim 3, wherein the step of outputting navigation prompt information comprises: when the location information is less than a distance threshold from the associated region, outputting the region navigation information. 6.The navigation method of claim 1, wherein the step of matching corresponding navigation prompt information according to the user information comprises: determining whether a help condition is met according to the user information; if yes, generating and outputting help information; and if no, matching corresponding navigation prompt information according to the user information. 7.The navigation method of claim 6, wherein the movement information comprises a movement speed, and the location information comprises a current location; wherein the step of determining whether a help condition is met according to the user information comprises: the movement speed exceeding a speed threshold; and / or the current location not being located in a care region. 8.The navigation method of claim 6, wherein the step of generating and outputting help information comprises: broadcasting the help information externally; and / or outputting the help information comprising rescue guidance instructions. 9. A navigation device characterized by comprising a processor and a memory: the processor is configured to execute a computer program stored in the memory to implement the navigation method steps of any one of claims 1 to 8.
10. A computer readable storage medium characterized by the computer readable storage medium stores a computer program which, when executed by a processor, implements the navigation method steps of any one of claims 1 to 8.
Citation Information
Patent Citations
Interactive intelligent auxiliary device and method for blinds
CN111317653A
KR20210084786A