Four-camera neck hanging type device for blind person navigation

Abstract

The invention relates to the technical field of photographic devices, and discloses a four-camera neck-hung device for blind navigation, comprising: a photographic device comprising a sling, a photographic shell, cameras and a USB hub, the sling is connected with the photographic shell, and the cameras comprise a front camera, a left camera, a right camera and a lower camera; the user side is connected with the USB hub, a navigation control system is arranged in the user side and comprises a receiving module, a processing module and a navigation module, the receiving module is used for receiving the collected environment image, the processing module is used for analyzing and processing the environment image to determine the current road condition, and the navigation module is used for generating a navigation plan according to the current road condition and sending the navigation plan to the user side. And the action of the user is guided. And the cloud center is used for controlling the opening and closing of the camera and the working frame rate according to the working instruction, and providing a way for assisting the user for workers. According to the invention, through four-camera layout and intelligent work control, omnibearing perception of the surrounding environment of the blind person is realized.

Description

Technical Field

[0001] This invention relates to the field of camera device technology, and in particular to a four-camera neckband device for navigation for the blind. Background Technology

[0002] Existing navigation methods for the blind mainly rely on guide dogs or conceptual solutions such as GPS navigation and infrared obstacle avoidance. However, these solutions have significant limitations in practical applications. For example, guide dogs can only function effectively in familiar areas; GPS navigation is unusable indoors or in areas without maps; and infrared obstacle avoidance is inaccurate in determining the distance to obstacles, has poor environmental perception, and struggles to provide intuitive and reliable navigation information.

[0003] In recent years, several assistive device solutions have been proposed to improve the autonomy of visually impaired individuals in their travels. For example, some solutions (CN201821097463.4) employ head-mounted devices with binocular stereo cameras installed in front to acquire environmental depth information. These devices can simulate the human binocular field of view, improving the ability to recognize obstacles directly in front. However, due to the limited field of view of the cameras, they can only cover what is in front of the user and cannot detect oncoming vehicles or obstacles from the sides. Other solutions propose installing a set of stereo cameras on each side of a wearable device to expand the range of environmental perception. This design can provide stereo vision from the left and right sides to some extent for obstacle avoidance and scene awareness. However, these devices also have shortcomings: the cameras mainly face forward, and the coverage of the left and right sides is still insufficient, and they usually lack dedicated monitoring of obstacles on the ground below.

[0004] Another approach is to use ultra-wide-angle or panoramic cameras to cover the surrounding environment. For example, one solution (CN201910770229.6) uses a 360° panoramic camera as a sensing unit to acquire all-around environmental images. While panoramic cameras offer an extremely wide field of view, these devices are often expensive, generate large amounts of data, and require high performance and communication bandwidth for continuous operation, making them unsuitable for long-term use in mobile wearable devices. Furthermore, panoramic cameras suffer from significant distortion at the edges and low pixel density, resulting in images that are difficult for algorithms to process and for backend personnel to view at the edges.

[0005] Therefore, existing technologies either have blind spots in terms of field of view or are insufficient in terms of device complexity and data cost, making it difficult to fully meet the needs of visually impaired individuals for wide-field perception and remote navigation assistance in scenarios such as crossing the street outdoors. To address these issues, it is necessary to provide a navigation assistance device for the blind that offers a wider field of view while also being practical. Summary of the Invention

[0006] The purpose of this invention is to provide a four-camera neckband device for navigation for the blind, aiming to solve one or more of the above-mentioned problems.

[0007] This invention provides a four-camera neckband device for navigation for the blind, comprising: A camera device includes a lanyard, a camera housing, a camera, and a USB hub. The lanyard is connected to the camera housing. The camera includes a front camera, a left camera, a right camera, and a bottom camera. The front camera, left camera, right camera, and bottom camera are respectively installed on the front, left, right, and bottom sides of the camera housing. The USB hub is connected to the signal of the camera. The user terminal is connected to the SUB interface of a USB hub via a USB OTG cable. The user terminal is equipped with a navigation control system, which includes a receiving module, a processing module, and a navigation module. The receiving module is used to receive environmental images captured by a camera. The processing module is used to analyze and process the environmental images to determine the current road conditions. The navigation module is used to generate a navigation plan based on the current road conditions to guide the user's actions. The cloud center is connected to the navigation control system. The navigation control system sends environmental images captured by the camera to the cloud center and assists users in their actions through staff. The cloud center is also configured to control the camera's on / off state and frame rate according to work instructions.

[0008] Preferably, the front camera is configured to capture environmental images in front of the user; the left camera is configured to capture environmental images to the left of the user; the right camera is configured to capture environmental images to the right of the user; and the lower camera is configured to capture environmental images in front of the user's feet.

[0009] Preferably, the camera device further includes a battery installed inside the camera housing, the battery being used to provide power to the camera and the USB hub.

[0010] Preferably, the camera is a USB Video Class standard camera.

[0011] Preferably, the four-camera neckband device is used as follows: In the initial state, the front camera is activated to capture images of the environment in front of the user in normal mode. The left camera, right camera and lower camera are in standby mode or low frame rate mode. The low frame rate mode is when the camera shoots at a first frame rate, and the normal mode is when the camera shoots at a second frame rate, wherein the first frame rate is less than the second frame rate. When the user walks in a straight line, the front camera, left camera, right camera, and bottom camera are in normal mode.

[0012] Preferably, the four-camera neckband device further includes, during use: The system obtains the user's location, determines the user's specific location based on the user's location, and determines whether the scene corresponding to the location requires a wide-angle environment. If a wide-angle environment is required, the system controls the left and right cameras to be in high frame rate mode. The high frame rate mode is when the cameras shoot at a third frame rate, which is greater than the second frame rate.

[0013] Preferably, the processing module analyzes and processes the environmental image to determine the current road conditions, including: The objects in the environmental image are analyzed and identified to determine the identification results. Based on the identification results, the types of objects are determined, including: obstacles, road signs, and special areas. And based on the recognition results, determine the relative position and distance between the object in the environmental image and the user; The current road conditions of the path the user is about to take are determined based on the type of object, the relative position of the object to the user, and the distance between the object and the user.

[0014] Preferably, the navigation module is used to generate a navigation plan based on the current traffic conditions to guide the user's actions, including: Assess the current road conditions and develop navigation plans based on the assessment results, specifically: If there are obstacles in the current road conditions, the navigation module plans a safe path that can avoid the obstacles based on the relative position and distance between the obstacles and the user; For road signs, the navigation module guides the user's actions based on their meaning; When special areas are involved, the navigation module provides corresponding navigation prompts based on the nature of the special area.

[0015] Preferably, the navigation control system further includes a voice module, which is used to provide voice prompts to the user according to the navigation plan.

[0016] Compared with the prior art, the beneficial effects of the present invention are as follows: 1. The system employs a four-camera layout (front, left, right, and bottom) to achieve over 180° horizontal field of view coverage and monitoring of the area directly in front and below. Especially in scenarios involving crossing the street, the left and right cameras can promptly detect vehicles or bicycles approaching from either side, avoiding the dangerous situation where only the front camera can detect vehicles coming from the side, thus improving the safety of visually impaired users when crossing the street.

[0017] 2. A specially designed downward-facing camera is used to monitor road conditions underfoot, such as steps, potholes, and curbs. This overcomes the limitation of traditional front cameras, which cannot observe nearby ground obstacles due to their limited field of view. It allows the navigation assistance system to detect road undulations in advance and promptly remind users to pay attention to their footing.

[0018] 3. The four cameras can selectively operate according to scene requirements. During normal straight-line driving, the front camera is mainly used for continuous data acquisition, while the left, right, and bottom cameras acquire data intermittently at a lower frequency or remain in standby mode. When wide-angle perception is detected (e.g., when a user is about to cross the road), the operating frequency of the side and bottom cameras is automatically increased or continuous video is activated. This on-demand start-stop operating mode effectively reduces data transmission bandwidth and power consumption, avoiding the high data volume and energy consumption problems caused by continuous operation of panoramic cameras.

[0019] 4. The device is worn around the neck in front of the chest, at a height similar to the shoulders, ensuring that the lines of view for the left and right cameras are not obstructed by the user's body. Compared to head-mounted devices, the neck-mounted design is simpler and more comfortable to wear, placing no extra burden on the head. It also utilizes the torso for stable support, reducing camera shake and ensuring image quality.

[0020] 5. The device uses an internal USB hub to aggregate the output from four cameras, connecting to external terminals via a standard USB interface. The camera modules comply with the UVC protocol, are plug-and-play, and are compatible with various devices such as smartphones and computers. This design eliminates the need for complex custom hardware, enabling image acquisition and remote transmission using existing mobile terminals, significantly improving the system's versatility and practicality. Attached Figure Description

[0021] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0022] Figure 1 This is a schematic diagram of the structure of a four-camera neck-mounted device for navigation for the blind, according to the present invention.

[0023] The camera consists of: 1. Front camera; 2. Left camera; 3. Right camera; 4. Bottom camera. Detailed Implementation

[0024] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0025] In the description of this application, it should be understood that the terms "center", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on this application.

[0026] The terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.

[0027] In the description of this application, it should be noted that, unless otherwise expressly specified and limited, the terms "installation," "connection," and "linking" should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral connection; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; and they can refer to the internal connection between two components. Those skilled in the art can understand the specific meaning of the above terms in this application based on the specific circumstances.

[0028] like Figure 1 As shown, the present invention provides a four-camera neckband device for navigation for the blind, comprising: A camera device includes a lanyard, a camera housing, a camera, and a USB hub. The lanyard is connected to the camera housing. The camera includes a front camera 1, a left camera 2, a right camera 3, and a bottom camera 4. The front camera 1, left camera 2, right camera 3, and bottom camera 4 are respectively installed on the front, left, right, and bottom sides of the camera housing. The USB hub is connected to the signal of the camera. The user terminal is connected to the SUB interface of a USB hub via a USB OTG cable. The user terminal is equipped with a navigation control system, which includes a receiving module, a processing module, and a navigation module. The receiving module is used to receive environmental images captured by a camera. The processing module is used to analyze and process the environmental images to determine the current road conditions. The navigation module is used to generate a navigation plan based on the current road conditions to guide the user's actions. The cloud center is connected to the navigation control system. The navigation control system sends environmental images captured by the camera to the cloud center and assists users in their actions through staff. The cloud center is also configured to control the camera's on / off state and frame rate according to work instructions.

[0029] This four-camera neckband device provides blind people with comprehensive environmental image capture capabilities. Four cameras in different directions capture all information about the blind person's surroundings, giving them a more complete understanding of their environment. Through the user-end navigation control system, the captured environmental images can be effectively analyzed and processed to accurately determine the current road conditions and generate a reasonable navigation plan. This greatly improves the safety and autonomy of blind people during travel, enabling them to walk more confidently in different environments and reducing their dependence on others. At the same time, the device's neckband design makes it easy to carry and does not place excessive burden on the blind person, making it highly practical and convenient.

[0030] In this embodiment, the camera device consists of a lanyard, a camera housing, cameras, and a USB hub. The lanyard connects to the camera housing, ensuring the entire device is easy to carry and secure. The camera section includes a front camera 1, a left camera 2, a right camera 3, and a bottom camera 4, which are respectively mounted on the front, left, right, and bottom sides of the camera housing to achieve omnidirectional field of view coverage and ensure complete image information of the surrounding environment. The USB hub connects to each camera via a signal connection, thereby enabling centralized management of data transmission.

[0031] The user terminal connects to the SUB interface of a USB hub via a USB OTG cable, forming a data exchange channel between devices. The user terminal contains a navigation control system, which consists of a receiving module, a processing module, and a navigation module. The receiving module acquires real-time environmental images from the camera, providing raw data for subsequent analysis. The processing module performs in-depth analysis and processing of the received environmental images, using algorithms to identify current road condition features, such as obstacle locations and road surface smoothness. Based on the road condition results obtained from the processing module, the navigation module generates a scientifically sound navigation plan, providing users with action guidance and ensuring they can complete their tasks efficiently and safely.

[0032] The cloud center, serving as the system's remote support component, maintains a real-time connection with the navigation and control system. The navigation and control system uploads environmental images captured by the cameras to the cloud center, enabling staff to remotely assist users in resolving complex situations or providing additional guidance. Furthermore, the cloud center also possesses camera control capabilities, sending work commands as needed to dynamically adjust camera on / off states and frame rates, thereby optimizing resource utilization and adapting to different usage scenarios. This not only enhances the system's flexibility but also strengthens user adaptability and operational convenience in various environments.

[0033] In this embodiment, the cloud center, as one of the core components of the entire system, is seamlessly connected to the navigation and control system. The navigation and control system transmits environmental images captured by the cameras to the cloud center in real time via its built-in communication module. The cloud center is equipped with a high-performance server cluster and storage devices, enabling it to efficiently receive, process, and store this image data. Simultaneously, the cloud center is equipped with a dedicated monitoring interface, allowing staff to view real-time environmental images around the user and provide remote assistance based on scenario requirements. In the specific implementation process, the cloud center first preprocesses the received image data, including image enhancement, noise reduction, and keyframe extraction, to ensure the accuracy of subsequent analysis. Subsequently, the cloud center dynamically adjusts the camera's operating status according to work instructions. For example, in low-risk or static conditions, the cloud center can reduce the camera's frame rate to save energy; while in highly dynamic or complex environments, the cloud center increases the frame rate to capture more details. Furthermore, the cloud center can remotely control the cameras to turn on or off according to staff instructions, thereby optimizing resource utilization. Staff, through a dedicated operating terminal, can not only view real-time images but also manually adjust camera parameters or provide other auxiliary support, further enhancing the system's flexibility and reliability.

[0034] In some embodiments of this application, the front camera is configured to capture environmental images in front of the user; the left camera is configured to capture environmental images to the left of the user; the right camera is configured to capture environmental images to the right of the user; and the lower camera is configured to capture environmental images in front of the user's feet.

[0035] In some embodiments of this application, the camera device further includes a battery installed within the camera housing, the battery being used to provide power to the camera and the USB hub.

[0036] In some embodiments of this application, the camera is a camera that conforms to the USB Video Class standard.

[0037] In this embodiment, the device adopts a neckband-style wearing structure, including a neckband (not shown) and a camera device installed at the lower end of the neckband. The camera device is shaped like a handheld handle, small and portable, and is positioned in the center of the user's chest when worn. The camera device is equipped with four cameras: a front camera, a left camera, a right camera, and a bottom camera. The front camera faces directly forward, the left and right cameras are installed on the sides of the device, facing slightly to the left and right front of the device, with their field of view slightly extended outward to cover the areas on both sides; the bottom camera is installed at the bottom or lower front of the device, facing slightly forward and directly downward to monitor the ground in front of the user's feet.

[0038] To ensure stable power supply and data transmission, a USB hub is integrated into the camera device. The signal cables from the four cameras (1–4) are connected to the input ports of the USB hub. The output of the USB hub is connected to external devices (i.e., the user end) via a single USB interface.

[0039] In this embodiment, the external device is a smartphone carried by the user, connected to the interface via a USB OTG cable. All cameras (1–4) use camera modules compliant with the USB Video Class (UVC) standard, so the smartphone can automatically identify multiple camera video sources after connecting to this device, and can call their video streams for processing or transmission without the need for a dedicated driver. The USB interface (6) can also power this device. Preferably, the USB bus power provided by the smartphone can drive all cameras; if a single USB power supply is insufficient, the device can also have a built-in small battery for auxiliary power supply to ensure stable operation of the cameras and hub.

[0040] In some embodiments of this application, when the four-camera neckband device is in use: in the initial state, the front camera is activated to capture environmental images in front of the user in normal mode, while the left, right, and lower cameras are in standby mode or low frame rate mode. The low frame rate mode is when the cameras capture images at a first frame rate, and the normal mode is when the cameras capture images at a second frame rate, wherein the first frame rate is less than the second frame rate; when the user walks in a straight line, the front, left, right, and lower cameras are in normal mode.

[0041] In some embodiments of this application, the four-camera neckband device further includes, when in use: obtaining user positioning, determining the user's specific location based on the user positioning, and determining whether the scene corresponding to the specific location requires a wide-angle environment based on the specific location. If a wide-angle environment is required, the left and right cameras are controlled to be in high frame rate mode. The high frame rate mode is that the cameras shoot at a third frame rate, which is greater than the second frame rate.

[0042] In this embodiment, the device is primarily used to provide the acquired environmental images to a navigation control system or remote assistance platform. In actual use, a navigation assistance application runs on a smartphone, which takes over the camera video stream from this device via a USB interface and transmits the video to a remote assistance service or local AI algorithm for processing as needed. Initially, the system typically keeps the forward-facing camera continuously active to acquire real-time video of the user's direction of travel, while the left, right, and bottom cameras are in standby or low frame rate mode to save bandwidth and energy. When the user is walking along a normal straight path, the forward-facing camera provides sufficient navigation visibility, while the side and bottom cameras capture a frame every few seconds for periodic environmental scanning. For example, the bottom camera can capture one frame of ground image per second to promptly detect steps or potholes within a 1-2 meter range ahead; the left and right cameras alternately capture images every few seconds to monitor for any approaching obstacles on either side.

[0043] When the system detects that a user is about to cross the street or perform other scenarios requiring wide-angle perception (which can be determined by the navigation application based on GPS location or user commands, or remotely switched by backend personnel), it will switch its operating mode to improve the environmental perception range. At this time, the left and right cameras switch to continuous video acquisition mode (or intermittent acquisition at a high frame rate) to continuously monitor the dynamics of vehicles coming from both sides of the road.

[0044] In some embodiments of this application, the processing module analyzes and processes the environmental image to determine the current road conditions, including: analyzing and identifying objects in the environmental image, determining the identification result, determining the type of object based on the identification result, the type including: obstacles, road signs and special areas; determining the relative position and distance between the object in the environmental image and the user based on the identification result; and determining the current road conditions of the road to be traveled by the user based on the type of object, the relative position and distance between the object and the user.

[0045] Understandably, this application enhances the safety and autonomy of blind people while walking. Through detailed analysis of environmental images, it can accurately identify key information such as obstacles, road signs, and special areas, allowing blind people to anticipate road conditions ahead. For example, when an obstacle is detected, the system can promptly inform the blind person, preventing collisions; the recognition of road signs helps blind people accurately determine their direction of travel and better follow traffic rules.

[0046] Simultaneously, determining the relative position and distance between objects and the user enables blind people to have a clearer spatial perception of their surroundings. This is like lighting a lamp for the blind in the dark, allowing them to walk more confidently and calmly on various roads. Even in complex urban environments, it effectively reduces the possibility of getting lost and encountering danger, providing reliable protection for the blind's travel. Moreover, this technology utilizes multiple cameras working collaboratively, intelligently switching working modes according to different walking scenarios. While ensuring effective environmental perception, it also reasonably saves bandwidth and energy, demonstrating high practicality and sustainability.

[0047] In some embodiments of this application, the navigation module is used to generate a navigation plan based on the current road conditions to guide the user's actions, including: assessing the current road conditions and formulating a navigation plan based on different road condition assessment results, specifically: if there are obstacles in the current road conditions, the navigation module plans a safe path that can avoid the obstacles based on the relative position and distance between the obstacles and the user; for road signs, the navigation module guides the user's actions based on their meaning; when special areas are involved, the navigation module provides corresponding navigation prompts based on the nature of the special areas.

[0048] In this embodiment, for example, when the obstacle is close to the user directly in front, the navigation module will guide the user to go around it to the left or right; if the obstacle is on the user's left and at a suitable distance, the navigation module may instruct the user to move slightly to the right.

[0049] For road signs, the navigation module guides the user's actions based on their meaning. If it detects a "No Entry" sign ahead, the navigation module will immediately plan an alternative route for the user; if it is a "Turn" sign, the navigation module will inform the user in advance where to make the turn.

[0050] When dealing with special areas, the navigation module will provide appropriate navigation prompts based on the nature of the area. If it is a construction area, the navigation module will guide the user away from the area and choose other relatively safe and unobstructed roads; if it is a public transportation stop, the navigation module will guide the user to the stop and inform them of the available transportation options.

[0051] Meanwhile, the navigation module also considers the user's movement speed and habits, adjusting the navigation plan in real time. If the user walks faster, the navigation module will provide navigation prompts for longer distances in advance to ensure the user has enough time to react; if the user has a particular walking style, such as preferring to walk along the side of the road, the navigation module will also take this factor into full consideration when planning the route, making the navigation plan more in line with the user's actual needs, thereby more effectively guiding the user's actions.

[0052] In this embodiment, objects in the environmental imagery are identified and classified, such as obstacles (e.g., utility poles, trash cans, pedestrians), road signs (e.g., zebra crossings, traffic lights), and special areas (e.g., tactile paving, bus stops). Image recognition technology and machine learning algorithms are used to determine the relative positions and distances of these objects to the user. Based on the distribution and distance information of the objects, the road conditions are analyzed, such as the presence of narrow passages or obstacles requiring detours. Simultaneously, image information from different cameras is combined to comprehensively assess the overall road conditions, considering the impact of environmental changes in different directions on the user's actions. Furthermore, the current time and weather conditions are determined based on features such as light and color in the environmental imagery, as these factors may affect road conditions and the user's safety.

[0053] Understandably, this application aims to provide blind people with more accurate and intelligent navigation services. Through detailed assessment and targeted planning of different road conditions, it significantly improves the safety of blind people's travel. Safe route planning that avoids obstacles effectively prevents blind people from colliding with obstacles while walking, reducing the risk of injury. Following road signs helps blind people adhere to traffic rules, better integrate into public transportation environments, and make their travel more standardized and orderly. Furthermore, the corresponding navigation prompts for special areas allow blind people to prepare mentally and take coping measures in advance, further enhancing their ability to cope with complex environments.

[0054] This navigation module design significantly enhances the autonomy and convenience of travel for the blind. Without relying on others, blind individuals can independently plan their routes and freely reach their destinations using only this device. This not only boosts their confidence and self-identity but also opens up more possibilities for their lives, enabling them to participate more actively in social activities. Furthermore, this technology is highly versatile and adaptable, suitable for various travel scenarios, providing effective navigation support for the blind in city streets, rural roads, and public transportation. It lowers the barrier to travel for the blind, allowing them to travel as easily as sighted people, truly improving their quality of life and possessing immense social value and promising application prospects.

[0055] In some embodiments of this application, the navigation control system further includes a voice module, which is used to provide voice prompts to the user according to the navigation plan.

[0056] In this embodiment, the navigation control system is also equipped with a voice module that provides clear and accurate voice prompts to the user based on the navigation planning results. This voice module not only has real-time response capabilities but also dynamically adjusts the prompts according to the user's current location, driving speed, and planned route, ensuring that the user can obtain key information in a timely manner. For example, at complex intersections or highway ramps, the voice module will issue clear turn or lane change prompts in advance, preventing the user from missing important points. Furthermore, the voice module supports multiple languages ​​and dialects to meet the needs of different users and can adjust the speech rate, volume, and tone according to the user's personalized settings, enhancing the user experience. By combining natural language processing technology, the module can also understand and respond to the user's voice commands, such as replanning the route or querying nearby facilities, thereby further enhancing the interactivity and convenience of the navigation system.

[0057] Understandably, the voice module is also connected to the cloud center, making it easier for back-end staff to provide voice guidance to users and assist them in their actions.

[0058] In this embodiment, the four video data streams are aggregated via a USB hub and then uploaded to the user's device or local AI for fusion analysis via a smartphone. The navigation control system then provides timely voice or vibration prompts to the visually impaired user and synchronizes the video feed with backend personnel to help them safely cross the street. After crossing the street, the system can resume normal mode, pausing the continuous transmission of lateral and downward video feeds.

[0059] The form and wearing method of this device are not limited to the above embodiments. The camera's viewing angle layout can be adjusted as needed. For example, the installation angle of the left and right cameras can be adjusted slightly to the rear to obtain a larger rearward field of view; the camera module can use a wide-angle lens to reduce blind spots; in other embodiments, a rear-facing camera can be added to monitor the environment behind the user. These modifications are all within the protection scope of this invention. Any equivalent changes and improvements made based on the above teachings without departing from the spirit of this invention fall within the protection scope of this invention.

[0060] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program goods. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program goods embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0061] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program goods according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0062] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0063] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0064] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention and not to limit it. Although the present invention has been described in detail with reference to the above embodiments, those skilled in the art should understand that modifications or equivalent substitutions can still be made to the specific implementation of the present invention. Any modifications or equivalent substitutions that do not depart from the spirit and scope of the present invention should be covered within the scope of protection of the claims of the present invention.

Claims

1. A four-camera neck-mounted device for navigation for the blind, characterized in that, include: A camera device includes a lanyard, a camera housing, a camera, and a USB hub. The lanyard is connected to the camera housing. The camera includes a front camera, a left camera, a right camera, and a bottom camera. The front camera, left camera, right camera, and bottom camera are respectively installed on the front, left, right, and bottom sides of the camera housing. The USB hub is connected to the signal of the camera. The user terminal is connected to the SUB interface of a USB hub via a USB OTG cable. The user terminal is equipped with a navigation control system, which includes a receiving module, a processing module, and a navigation module. The receiving module is used to receive environmental images captured by a camera. The processing module is used to analyze and process the environmental images to determine the current road conditions. The navigation module is used to generate a navigation plan based on the current road conditions to guide the user's actions. The cloud center is connected to the navigation control system. The navigation control system sends environmental images captured by the camera to the cloud center and assists users in their actions through staff. The cloud center is also configured to control the camera's on / off state and frame rate according to work instructions.

2. The four-camera neckband device for navigation for the blind according to claim 1, characterized in that, The front camera is configured to capture environmental images in front of the user; the left camera is configured to capture environmental images to the left of the user; the right camera is configured to capture environmental images to the right of the user; and the lower camera is configured to capture environmental images in front of the user's feet.

3. The four-camera neck-mounted device for navigation for the blind according to claim 1, characterized in that, The camera device also includes a battery installed inside the camera housing, the battery being used to provide power to the camera and the USB hub.

4. The four-camera neck-mounted device for navigation for the blind according to claim 1, characterized in that, The camera uses the USB Video Class standard.

5. The four-camera neck-mounted device for navigation for the blind according to claim 1, characterized in that, When using the four-camera neckband device: In the initial state, the front camera is activated to capture images of the environment in front of the user in normal mode. The left camera, right camera and lower camera are in standby mode or low frame rate mode. The low frame rate mode is when the camera shoots at a first frame rate, and the normal mode is when the camera shoots at a second frame rate, wherein the first frame rate is less than the second frame rate. When the user walks in a straight line, the front camera, left camera, right camera, and bottom camera are in normal mode.

6. The four-camera neckband device for navigation for the blind according to claim 5, characterized in that, The four-camera neckband device, when in use, also includes: The system obtains the user's location, determines the user's specific location based on the user's location, and determines whether the scene corresponding to the location requires a wide-angle environment. If a wide-angle environment is required, the system controls the left and right cameras to be in high frame rate mode. The high frame rate mode is when the cameras shoot at a third frame rate, which is greater than the second frame rate.

7. The four-camera neckband device for navigation for the blind according to claim 6, characterized in that, The processing module analyzes and processes the environmental image to determine the current road conditions, including: The objects in the environmental image are analyzed and identified to determine the identification results. Based on the identification results, the types of objects are determined, including: obstacles, road signs, and special areas. And based on the recognition results, determine the relative position and distance between the object in the environmental image and the user; The current road conditions of the path the user is about to take are determined based on the type of object, the object's relative position and distance to the user.

8. The four-camera neck-mounted device for navigation for the blind according to claim 7, characterized in that, The navigation module is used to generate a navigation plan based on the current traffic conditions to guide the user's actions, including: Assess the current road conditions and develop navigation plans based on the assessment results, specifically: If there are obstacles in the current road conditions, the navigation module plans a safe path to avoid the obstacles based on the relative position and distance between the obstacles and the user. For road signs, the navigation module guides the user's actions based on their meaning; When special areas are involved, the navigation module provides corresponding navigation prompts based on the nature of the special area.

9. The four-camera neck-mounted device for navigation for the blind according to claim 8, characterized in that, The navigation control system also includes a voice module, which is used to provide voice prompts to the user according to the navigation plan.

Images