AR helmet-based riding display method and AR helmet

Abstract

The invention provides a riding display method based on an AR helmet and the AR helmet, and is applied to the technical field of riding control, and the method comprises the steps: responding to the starting of the AR helmet, and determining whether a user has a steering demand or not according to the sight focus of the user; in response to determining that the user has the steering demand, acquiring image information of a user view blind area; and displaying the image information of the view blind area in a display screen according to the steering requirement. According to the invention, a rider can observe the condition of a road ahead and the condition of a view blind area while steering or changing a driving route, the rider is helped to observe the surrounding environment without turning the head, potential safety hazards caused by the view blind area are reduced, and more intelligent, safer and more convenient riding experience is provided for the rider.

Description

Technical Field

[0001] This application relates to the field of cycling control technology, and in particular, to a cycling display method and an AR helmet based on an AR helmet. Background Art

[0002] With the acceleration of the urbanization process and the enhancement of environmental protection awareness, cycling, as a green and convenient travel mode, is becoming increasingly popular among people. However, the safety problems during cycling are also becoming increasingly prominent. Especially when cyclists turn or change the driving route, they usually need to turn their heads to observe the situations behind and on the sides, which increases the risk of accidents and affects cycling safety. Summary of the Invention

[0003] In view of this, the purpose of this application is to propose a cycling display method and an AR helmet based on an AR helmet, so that users can observe the situations behind and on the sides without turning their heads, ensuring cycling safety.

[0004] Based on the above purpose, this application provides a cycling display method based on an AR helmet. The AR helmet includes a camera device and a display screen. The camera device is used to obtain image information of the user's visual blind area, and the display screen is arranged within the user's forward line of sight to display the image information to the user. The method includes:

[0005] In response to the startup of the AR helmet, determine whether the user has a turning requirement according to the user's line of sight focus;

[0006] In response to determining that the user has a turning requirement, obtain the image information of the user's visual blind area;

[0007] Display the image information of the visual blind area on the display screen according to the turning requirement.

[0008] Based on the same inventive concept, this application also provides an AR helmet, including:

[0009] A camera device configured to obtain image information of the user's visual blind area;

[0010] A display screen configured to display the image information to the user;

[0011] A control module configured to, in response to the startup of the AR helmet, determine whether the user has a turning requirement according to the user's line of sight focus, and in the case of determining that the user has a turning requirement, display the image information of the visual blind area on the display screen according to the turning requirement.

[0012] As can be seen from the above, a riding display method and an AR helmet provided by the present application, wherein the method includes: in response to the startup of the AR helmet, determining whether the user has a turning requirement according to the user's line of sight focus, and the user can express the turning requirement without turning the head or performing other operations, which is more convenient and safe; in response to determining that the user has a turning requirement, acquiring image information of the user's blind spot of vision, and displaying the image information of the blind spot of vision on a display screen arranged within the user's forward line of sight range according to the turning requirement; enabling the rider to observe the situation of the road ahead and the blind spot of vision simultaneously when turning or changing the driving route, helping the rider observe the surrounding environment without turning the head, reducing the safety hazards brought by the blind spot of vision, and providing a more intelligent, safe and convenient riding experience for the rider. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] In order to more clearly illustrate the technical solutions in the present application or related technologies, the following will briefly introduce the drawings required for use in the embodiments or related technology descriptions. Obviously, the drawings in the following descriptions are only the embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0014] Figure 1 It is a flowchart of the riding display method based on the AR helmet according to the embodiment of the present application;

[0015] Figure 2 It is a schematic diagram of the first preset area and the second preset area in the riding display method based on the AR helmet according to the embodiment of the present application;

[0016] Figure 3 It is a flowchart of the riding display method based on the AR helmet according to another embodiment of the present application;

[0017] Figure 4 It is a flowchart of the riding display method based on the AR helmet according to another embodiment of the present application;

[0018] Figure 5 It is a schematic diagram of the AR helmet according to the embodiment of the present application;

[0019] Figure 6 It is a schematic diagram of the riding display device based on the AR helmet according to the embodiment of the present application;

[0020] Figure 7 It is a schematic diagram of the hardware structure of an electronic device provided by the embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0021] To make the objectives, technical solutions and advantages of the present application clearer, the following further elaborates on the present application in detail with reference to specific embodiments and the accompanying drawings.

[0022] It should be noted that, unless otherwise defined, the technical terms or scientific terms used in the embodiments of this application should have the ordinary meanings understood by those with ordinary skills in the field to which this application belongs. The terms "first", "second" and similar words used in the embodiments of this application do not denote any order, quantity or importance, but are only used to distinguish different components. Words such as "including" or "comprising" mean that the elements or objects appearing before the word cover the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connected" or "linked" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right", etc. are only used to indicate relative position relationships. When the absolute position of the object being described changes, the relative position relationship may also change accordingly.

[0023] In the related art, with the acceleration of the urbanization process and the enhancement of environmental protection awareness, cycling, as a green and convenient way of traveling, has been increasingly favored by people. However, the safety problems existing during cycling are also becoming increasingly prominent. Especially in the complex urban traffic environment, cyclists face potential risks from multiple aspects such as motor vehicles, pedestrians, and road facilities. To improve the safety of cycling, traditional cycling helmets have become essential equipment for cyclists. However, the main functions of traditional cycling helmets are limited to physical protection and cannot provide real-time environmental perception and intelligent assistance functions, which to a certain extent limits their role in enhancing cycling safety.

[0024] Especially when a cyclist turns or changes the driving route, it is usually necessary to turn the head to observe the situations behind and on the sides. However, this behavior not only increases the operation complexity of the cyclist but also may lead to a temporary loss of the forward field of vision, increasing the risk of accidents. Especially on busy urban roads, the problem of the blind spot of vision is particularly prominent; moreover, traditional helmets cannot provide real-time environmental perception information, and cyclists can only rely on their own senses to make judgments, which greatly limits the safety perception ability of cyclists at night or under complex weather conditions. Although in recent years, the application of cutting-edge technologies such as augmented reality and sensor technology in cycling helmets has gradually matured, which can provide a more intelligent, safe and convenient cycling experience for cyclists. By integrating an AR display screen in the helmet, virtual information can be superimposed on the real field of vision of the cyclist, providing intuitive navigation, road condition reminder and other information, reducing the operation complexity of the cyclist and improving safety. However, for the scenario where a cyclist turns or changes the driving route, if the surrounding environment information is continuously displayed through the AR display screen, it will affect the field of vision of the cyclist during normal driving, and manually controlling the AR display screen to display the surrounding environment information when the cyclist turns or changes the driving route will further affect cycling safety.

[0025] Based on the above problems, the applicant found that: in response to the startup of the AR helmet, whether the user has a turning demand is determined based on the user's line of sight, and the user does not need to turn his head or perform other operations to express the turning demand, which is more convenient and safer; in response to determining that the user has a turning demand, the image information of the user's blind spot is obtained, and according to the turning demand, the image information of the blind spot is displayed on a display screen set within the user's front line of sight; it enables the rider to observe the road conditions ahead and the blind spot conditions at the same time when turning or changing the driving route, helping the rider to observe the surrounding environment without turning his head, reducing the safety hazards caused by blind spots, and providing riders with a more intelligent, safe and convenient riding experience.

[0026] The embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0027] This application provides a riding display method based on an AR helmet, such as Figure 1 As shown, in some embodiments, the method is executed by a data processor, the AR helmet includes a camera device and a display screen, the camera device is used to obtain image information of a user's blind spot, the display screen is set in the user's front sight range, and is used to display the image information to the user, and the method includes:

[0028] S101, in response to the AR helmet being started, determining whether the user has a need to turn according to the user's line of sight;

[0029] In specific implementation, when the AR helmet is started, it is determined whether the user has a need to turn based on the user's line of sight. When the user's line of sight moves to a specific area of ​​the display screen (such as an edge), it indicates that the user needs to check the traffic conditions on the side and rear, thereby identifying the need to turn.

[0030] S102, in response to determining that the user has a turning demand, obtaining image information of a blind spot in the user's field of vision;

[0031] In specific implementation, when it is determined that the user has a need to turn, that is, the user needs to check the traffic conditions on the side and rear, the camera device (which may include a group of cameras covering a 360-degree panoramic view) will be activated, especially the camera that can capture the user's current blind spot, and the image information of the user's blind spot is obtained through the camera device.

[0032] S103: displaying the image information of the blind area on a display screen according to the turning requirement.

[0033] In specific implementation, when it is detected that the user has a steering need, images captured by the camera in the corresponding direction are selected according to the user's specific needs (such as turning left or turning right), and the image information is transmitted to the display screen of the AR helmet in real time. The position where the image is displayed is usually a position that is easy for the user to observe. For example, it is a part of the user's front field of vision or on one side of the direction where the user is about to turn. In addition, the displayed image information needs to be updated in real time to match the user's movement and environmental changes. The image quality (such as clarity and contrast) is adjusted according to the ambient light and other visual factors to ensure that the user can clearly see the image under different lighting conditions; the image may undergo specific processing, such as edge enhancement, dynamic range adjustment, etc., to improve the visual effect and the readability of the information.

[0034] In this embodiment, by displaying the image information in the user's blind spot of vision on the display screen of the AR helmet in real time, the rider can observe the surrounding environment without turning their head. This enhanced visual perception significantly reduces the accident risk caused by the blind spot of vision, especially in the complex urban traffic environment. When the rider turns or changes the driving route, they often need to observe the traffic conditions behind and on the side. At this time, the temporary loss of the front field of vision may increase the risk of accidents. Through the display of the AR helmet, the rider can pay attention to the front road and the blind spot of vision at the same time, thereby greatly improving the safety of cycling. During traditional cycling, the rider needs to frequently turn their head to check the surrounding situation, which not only increases the operational complexity of cycling but also may cause distraction of attention. The AR helmet detects the steering need and displays the image information in the blind spot of vision, enabling the rider to focus more on control and navigation, thereby simplifying the operation and improving the cycling efficiency. The AR helmet can adjust the displayed image quality, such as clarity and contrast, according to different lighting and weather conditions to ensure that the rider can clearly see the displayed information even at night or in bad weather conditions, enabling the rider to maintain good environmental perception ability in various environments.

[0035] In some embodiments, determining whether the user has a steering need according to the user's line of sight focus includes:

[0036] Obtaining the position of the user's line of sight focus on the display screen;

[0037] In specific implementation, an integrated eye tracking sensor can be used to monitor the user's eye movement. The eye tracking sensor can accurately capture the position and line of sight direction of the eyeball, thereby calculating the position of the line of sight focus on the display screen; the captured line of sight data is sent to the processor, and the processor analyzes the line of sight data and determines the specific position of the line of sight focus on the display screen. The position information can be represented in coordinate form, such as the X and Y coordinates of the screen.

[0038] In response to determining that the user's line-of-sight focus is in the first preset area or the second preset area, it is determined that the user has a turning requirement;

[0039] Wherein, the first preset area is arranged close to the longitudinal edge of the display screen, and the second preset area is adjacent to the first preset area and away from the longitudinal edge of the display screen.

[0040] In specific implementation, as Figure 2 shown, the first preset area is close to the longitudinal edge of the display screen (the transverse edge of the display screen includes the upper edge and the lower edge, and the longitudinal edge includes the left edge and the right edge of the display). It can be the left or right edge of the screen. When the user's line-of-sight focus is in this area, the user may have a turning requirement. The second preset area is adjacent to the first preset area and away from the longitudinal edge of the display screen. It can be on the left or right side of the screen. When the user's line-of-sight focus is in the second preset area, the user may have a turning requirement.

[0041] In this embodiment, the function is triggered by using the movement of the user's line-of-sight focus. The user does not need to perform any additional physical actions (such as pressing a button or touching the screen). Only by looking at a specific area can the function of displaying the image of the blind spot of the field of view be activated, reducing the complexity of the operation and enabling the rider to focus more on the road and the surrounding environment. Significantly improves riding safety. The user can understand the traffic conditions behind the side without turning their head, which reduces the instability and potential collisions that may be caused by turning the head to check.

[0042] In some embodiments, as Figure 3 shown, the displaying the image information of the blind spot of the field of view in the display screen according to the turning requirement includes:

[0043] S301. Determine the type of the turning requirement according to the position of the user's line-of-sight focus on the display screen, and determine the display area of the image information according to the type of the turning requirement;

[0044] In specific implementation, the type of the turning requirement is judged by analyzing the position of the user's line-of-sight focus on the display screen. The position of the line-of-sight focus can reflect the direction of the user's attention and the potential operation intention to determine the direction of the side where the user is going to turn; the blind spot of the field of view refers to the area outside the user's current line of sight or field of view, that is, the area that the user cannot directly see at the current position and perspective. The image information comes from the camera device. When it is detected that the user has a specific turning requirement (such as a mild turning requirement or a severe turning requirement), displaying the relevant image information of the blind spot of the field of view in the display screen can enable the rider to observe the road conditions ahead and the conditions of the blind spot of the field of view at the same time when turning or changing the driving route.

[0045] S302A. In response to the duration that the user's line of sight focus stays in the first preset area of the display screen being greater than or equal to the preset duration, determine that the steering demand type is a severe steering demand, and display the image information in the first preset display area of the display screen;

[0046] In specific implementation, when the duration that the user's line of sight focus continuously stays in the first preset area of the display screen (usually near the longitudinal edge of the display screen) is greater than or equal to the preset duration (exemplarily, the preset duration is set to 1S), it is determined that the steering demand type is a severe steering demand, indicating that the user needs to make a large-angle turn, such as when the vehicle is about to make a sharp turn. At this time, a larger display area is required to help the user observe the blind spot of the field of view. Therefore, the image information is displayed in the first preset display area of the display screen.

[0047] S302B. In response to the duration that the user's line of sight focus stays in the second preset area of the display screen being greater than or equal to the preset duration, determine that the steering demand type is a mild steering demand, and display the image information in the second preset display area of the display screen; wherein, the first preset display area is larger than the second preset display area.

[0048] In specific implementation, when the duration that the user's line of sight focus continuously stays in the second preset area of the display screen (usually far from the longitudinal edge of the display screen) is greater than or equal to the preset duration (exemplarily, the preset duration is set to 1S), it is determined that the steering demand type is a mild steering demand, indicating that the user needs to make a small-angle turn. The turn in this case may be gradual or not urgent. For example, slightly adjusting the lane position. At this time, the user's demand to observe the blind spot of the field of view is smaller than that of a severe steering demand. It is necessary to observe the blind spot of the field of view while ensuring the normal front view. Therefore, the image information is displayed in the second preset display area of the display screen; wherein, the first preset display area is larger than the second preset display area.

[0049] In this embodiment, by providing the image information of the blind spot of the field of view, the user can obtain visual data of areas that are usually difficult to observe. For example, before making a severe steering operation, the user can see the situation behind the side of the vehicle, which can effectively avoid collisions with other vehicles or obstacles. The traditional way of turning the head to view the blind spot of the field of view not only requires physical actions but also may cause the attention to be temporarily shifted from the front road, increasing the risk of accidents. Adjusting the displayed information according to the user's specific needs (mild or severe steering demand) adaptively provides more personalized riding assistance, improving safety, efficiency, and user experience.

[0050] In some embodiments, the displaying the image information in the first preset display area of the display screen includes:

[0051] Obtain the image information of the blind area of the field of view on the side where the user is to turn based on the line of sight focus;

[0052] In specific implementation, an integrated eye tracking sensor can be used to monitor the user's eye movement. The eye tracking sensor can accurately capture the position and line of sight direction of the eyeball, so as to calculate the position of the line of sight focus on the display screen; obtain the image information of the blind area of the field of view on the side where the user is to turn. When the duration that the user's line of sight focus stays in the first preset area on the left side of the display screen is greater than or equal to the preset duration, obtain the image information of the blind area on the user's left side.

[0053] Display the image information on the first preset display area of the display screen with a preset transparency;

[0054] Wherein, the first preset display area is the display screen area corresponding to the side where the user is to turn.

[0055] In specific implementation, display the image information on the first preset display area of the display screen with a preset transparency. The first preset display area is the display screen area corresponding to the side where the user is to turn, and it is a relatively large area on the display screen, specifically used to display the image information when there is a strong turning requirement, so as to reduce the distance of the user's line of sight movement and quickly capture important information; the purpose of displaying the image information with a preset transparency (exemplarily, the preset transparency is set to 50%) is to enable the image information to be integrated with the actual field of view and provide an augmented reality visual effect. The setting of the transparency should ensure that the image is obvious without overly interfering with the driver's normal line of sight.

[0056] In some embodiments, the step of displaying the image information on the second preset display area of the display screen includes:

[0057] Obtain the image information of the blind area of the field of view on the side where the user is to turn based on the line of sight focus;

[0058] In specific implementation, an integrated eye tracking sensor can be used to monitor the user's eye movement. The eye tracking sensor can accurately capture the position and line of sight direction of the eyeball, so as to calculate the position of the line of sight focus on the display screen; obtain the image information of the blind area of the field of view on the side where the user is to turn. When the duration that the user's line of sight focus stays in the second preset area on the left side of the display screen is greater than or equal to the preset duration, obtain the image information of the blind area on the user's left side.

[0059] Display the image information on the second preset display area of the display screen with a preset transparency;

[0060] Wherein, the second preset display area is the display screen area corresponding to the side where the user is to turn.

[0061] In specific implementation, the image information is displayed on the second preset display area of the display screen with a preset transparency. The second preset display area is the area of the display screen corresponding to the side where the user is about to turn, and it is an area on the display screen smaller than the first preset display area, which is specifically used to display the image information when there is a slight turning requirement, so as to reduce the interference with the driver's normal vision. The image information is displayed with a preset transparency (exemplarily, the preset transparency is set to 50%) to enable the image information to be integrated with the actual vision and provide an augmented reality visual effect. The setting of the transparency should ensure that the image is obvious without overly disturbing the driver's normal line of sight.

[0062] In this embodiment, by displaying the image information of the blind spot of the field of view when necessary, the driver can understand the surrounding environment more comprehensively, which helps to reduce the accident risk caused by the existence of the blind spot of the field of view, such as hitting the vehicle in the side rear when changing lanes. According to different levels (severe or mild) of the turning requirement, the size of the display area of the displayed image can be adjusted to ensure that the most suitable visual support can be provided in different situations. For example, when there is a severe turning requirement, the image is provided in a larger display area so that the driver can quickly capture the key information; when there is a mild turning requirement, it is displayed in a smaller area to reduce the interference with the normal driving line of sight, making the riding experience smoother and more efficient, and greatly improving the riding efficiency and safety.

[0063] In some embodiments, as Figure 4 shown, the AR helmet further includes an environment perception module for detecting the spatial information of objects in the environment, and the method further includes:

[0064] S401. Perform target recognition on the vehicles in the image information;

[0065] In specific implementation, performing target recognition on the vehicles in the image information can analyze the image by using machine learning or deep learning algorithms to identify the vehicles in the image. For example, the YOLO algorithm can be used to identify the vehicles in the image information.

[0066] S402. In response to identifying that there is at least one vehicle, detect the relative motion information between the user and the vehicle through the environment perception module;

[0067] In specific implementation, once a vehicle is detected, the relative motion information between the user and the vehicle, such as the relative distance and relative speed between the user and the vehicle, is detected through the environment perception module. The environment perception module includes but is not limited to millimeter wave radar, lidar, etc.

[0068] S403. In response to determining that the user has a collision risk according to the relative motion information, send a danger prompt message to the user.

[0069] In specific implementation, the possibility of collision between the user and the vehicle is determined by using the data collected by the environmental perception module (such as the relative distance and relative speed between the user and the vehicle). Commonly used algorithms include Time-To-Collision (TTC) calculation, which evaluates the predicted time of collision between the user and the vehicle at the current speed and direction. Whether there is a collision risk can be judged according to the preset safety standards and thresholds. Once a collision risk is determined, a warning is immediately sent to the user. This can be achieved in various ways, such as visual (graphical warning on the display of the AR helmet), auditory (alarm sound or voice prompt), tactile (vibration warning), etc.

[0070] In this embodiment, the vehicle in the image information is subjected to target recognition, and the relative motion information between the user and the vehicle is detected by the environmental perception module. The potential collision risk is predicted according to the relative motion information, and a warning is sent to the user in advance to significantly reduce the occurrence of accidents, so that the driver has enough time to react and take measures to avoid collision, such as decelerating and changing lanes.

[0071] In some embodiments, the relative motion information includes the relative distance between the user and the vehicle. Determining that the user has a collision risk according to the relative motion information and sending a danger prompt message to the user includes:

[0072] In response to the relative distance between the user and at least one vehicle being less than the preset safety distance, it is determined that there is a collision risk between the user and the vehicle, and a danger prompt message is sent to the user.

[0073] In specific implementation, when the relative distance between the user and at least one vehicle is less than the preset safety distance (exemplarily, the preset safety distance is set to 20 meters), it indicates that the vehicle on the side where the user is about to turn is too close to the user and there is a collision risk, and a warning is immediately sent to the user; this can be achieved in various ways, such as visual (graphical warning on the display of the AR helmet), auditory (alarm sound or voice prompt), tactile (vibration warning), etc.

[0074] In this embodiment, by real-time monitoring the relative distance between the user and the vehicle and sending a warning when the distance is less than the preset safety distance, the user can be timely reminded before a dangerous situation occurs, greatly reducing the reaction time, effectively preventing the occurrence of accidents, and thus improving the overall road use safety. Through visual, auditory, and tactile warnings, it can be ensured that the user can receive the warning information in any case, which can attract the user's attention more than a single warning method, especially when cycling, the user may be distracted for various reasons.

[0075] In some embodiments, the relative motion information includes the relative speed between the user and the vehicle; determining that the user is at risk of collision based on the relative motion information and sending a danger prompt message to the user includes:

[0076] In response to the relative distance between the user and all vehicles being greater than or equal to a preset safety distance, determining the duration required for the vehicle to approach the user based on the relative distance and relative speed;

[0077] In specific implementation, when the relative distance between the user and at least one vehicle is greater than or equal to the preset safety distance (exemplarily, the preset safety distance is set to 20 meters), it indicates that the vehicle on the side where the user intends to turn is at a relatively far distance from the user. However, the risk of collision cannot be excluded and further judgment is needed. The time required for the vehicle to approach the user will be calculated based on the relative distance and relative speed, providing an accurate and reliable data basis for determining whether the user is at risk of collision.

[0078] In response to the duration required for at least one vehicle to approach the user being less than the preset safety duration, determining that the user is at risk of collision with the vehicle and sending a danger prompt message to the user.

[0079] In specific implementation, when the duration required for at least one vehicle to approach the user is less than the preset safety duration (exemplarily, the preset safety duration is set to 10 seconds), it indicates that the time required for the vehicle to approach the user is relatively short and the user does not have sufficient time to complete the turn. It is determined that the user is at risk of collision with the vehicle, and a danger prompt message is sent to the user, which can be achieved in various ways, such as visually (graphical warnings on the display of the AR helmet), auditorily (alarm sounds or voice prompts), tactilely (vibration warnings), etc.

[0080] In this embodiment, by considering both the relative distance and relative speed simultaneously, potential collision risks can be predicted more accurately. Even when the distance between the vehicle and the user is relatively large, if the vehicle speed is fast enough to approach the user in a short time, a warning is still issued to the user. Considering both distance and speed can give the user sufficient reaction time before a danger actually occurs. Through visual, auditory, and tactile warnings, it can be ensured that the user can receive the warning message in any situation, which is particularly crucial for ensuring the effective transmission of warnings in noisy urban environments or under adverse weather conditions, providing more comprehensive and timely safety protection, reducing the probability of traffic accidents, and enhancing the user's sense of security.

[0081] In some embodiments, sending a danger prompt message to the user includes:

[0082] Enhancing the image of the target vehicle in the image information displayed on the display screen with a preset transparency and flashing it at a preset frequency, where the target vehicle is the vehicle at risk of collision with the user;

[0083] In specific implementation, the image of the target vehicle in the image information displayed on the display screen with a preset transparency (exemplarily, the preset transparency is set to 50%) is enhanced, making it more prominent on the user's display screen. The image enhancement may include adjusting the contrast, brightness, or color of the image so that the user can quickly and clearly identify these vehicles, and it blinks at a preset frequency (exemplarily, the preset frequency is set to 1HZ) to attract the user's attention and alertness. The blinking frequency can be adjusted when necessary.

[0084] In response to determining that the relative distance decreases and / or the duration decreases, increase the preset frequency of the blinking.

[0085] In specific implementation, the decrease in the relative distance indicates that the distance between the user and the vehicle is shortening, and the decrease in the distance indicates that the risk of collision is increasing, especially in the case of high-speed driving. The decrease in the duration indicates that the time window for a possible collision is shortening, and the risk of collision is increasing; when any of the above situations is detected or both occur simultaneously, increase the blinking frequency of the target vehicle image, so that the user's visual attention is more focused on the potential threat and the occurrence of a collision is avoided.

[0086] In this embodiment, through the methods of image enhancement and blinking, the target vehicle can be made more conspicuous on the user's display device, thus quickly attracting the user's attention. Especially in a complex traffic environment, highlighting the vehicle with a collision risk to the user helps the user quickly identify potential threats, enhancing the visual effect and sense of urgency of the warning information. By adjusting the blinking frequency of the target vehicle image according to the decrease in the relative distance and time, the real-time change of the collision risk situation can be dynamically reflected. When the collision risk increases, the increase in the blinking frequency can convey a stronger warning signal, prompting the user to take more rapid risk avoidance measures, thus effectively avoiding or reducing the severity of a collision accident.

[0087] It should be noted that the method of the embodiment of the present application can be executed by a single device, such as a computer or a server, etc. The method of this embodiment can also be applied to a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only execute one or more steps of the method of the embodiment of the present application, and these multiple devices will interact with each other to complete the described method.

[0088] It should be noted that some embodiments of the present application have been described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recited in the claims may be performed in a different order than in the above embodiments and still achieve the desired results. Additionally, the processes depicted in the drawings do not necessarily require the specific order or sequential order shown to achieve the desired results. In certain embodiments, multitasking and parallel processing are also possible or may be advantageous.

[0089] Based on the same inventive concept, corresponding to any of the above-described method embodiments, the present application further provides an AR helmet.

[0090] Referring to Figure 5 , the AR helmet includes:

[0091] An imaging device configured to acquire image information of the user's field of view blind area;

[0092] A display screen configured to display the image information to the user;

[0093] A control module configured to, in response to the startup of the AR helmet, determine whether the user has a turning requirement based on the user's line-of-sight focus, and in the case of determining that the user has a turning requirement, display the image information of the field of view blind area on the display screen according to the turning requirement.

[0094] Based on the same inventive concept, corresponding to any of the above-described method embodiments, the present application further provides a cycling display device based on an AR helmet.

[0095] Referring to Figure 6 , the cycling display device based on an AR helmet includes:

[0096] An acquisition module 701 configured to, in response to the startup of the AR helmet, determine whether the user has a turning requirement based on the user's line-of-sight focus; in response to determining that the user has a turning requirement, acquire image information of the user's field of view blind area;

[0097] A display control module 702 configured to display the image information of the field of view blind area on the display screen according to the turning requirement.

[0098] Furthermore, the acquisition module 701 is specifically configured to:

[0099] Acquire the position of the user's line-of-sight focus on the display screen;

[0100] In response to determining that the user's line-of-sight focus is in a first preset area or a second preset area, determine that the user has a turning requirement;

[0101] Among them, the first preset area is arranged close to the longitudinal edge of the display screen, and the second preset area is adjacent to the first preset area and far from the longitudinal edge of the display screen.

[0102] Further, the display control module 702 is specifically configured to:

[0103] Determine the type of steering requirement according to the position of the user's line of sight focus on the display screen, and determine the display area of the image information according to the type of steering requirement;

[0104] In response to the duration that the user's line of sight focus stays in the first preset area of the display screen being greater than or equal to a preset duration, determine that the type of steering requirement is a severe steering requirement, and display the image information in the first preset display area of the display screen;

[0105] In response to the duration that the user's line of sight focus stays in the second preset area of the display screen being greater than or equal to a preset duration, determine that the type of steering requirement is a mild steering requirement, and display the image information in the second preset display area of the display screen;

[0106] Among them, the first preset display area is larger than the second preset display area.

[0107] Further, the display control module 702 is specifically further configured to:

[0108] Obtain the image information of the field of view blind area on the side where the user is about to turn based on the line of sight focus;

[0109] Display the image information on the first preset display area of the display screen with a preset transparency;

[0110] Among them, the first preset display area is the display screen area corresponding to the side where the user is about to turn.

[0111] Further, the display control module 702 is specifically further configured to:

[0112] Obtain the image information of the field of view blind area on the side where the user is about to turn based on the line of sight focus;

[0113] Display the image information on the second preset display area of the display screen with a preset transparency;

[0114] Among them, the second preset display area is the display screen area corresponding to the side where the user is about to turn.

[0115] Further, the display control module 702 is specifically further configured to:

[0116] Perform target recognition on the vehicle in the image information;

[0117] In response to recognizing that there is at least one vehicle, the relative motion information between the user and the vehicle is detected by the environmental perception module;

[0118] In response to determining that the user is at risk of collision according to the relative motion information, a danger prompt message is sent to the user.

[0119] Further, the display control module 702 is specifically further configured to:

[0120] In response to the relative distance between the user and at least one vehicle being less than a preset safety distance, it is determined that the user is at risk of collision with the vehicle, and a danger prompt message is sent to the user.

[0121] Further, the display control module 702 is specifically further configured to:

[0122] In response to the relative distance between the user and all vehicles being greater than or equal to the preset safety distance, the duration required for the vehicle to approach the user is determined based on the relative distance and relative speed;

[0123] In response to the duration required for at least one vehicle to approach the user being less than the preset safety duration, it is determined that the user is at risk of collision with the vehicle, and a danger prompt message is sent to the user.

[0124] Further, the display control module 702 is specifically further configured to:

[0125] Enhance the image of the target vehicle in the image information displayed on the display screen and flash it at a preset frequency, where the target vehicle is the vehicle at risk of collision with the user;

[0126] In response to determining that the relative distance decreases and / or the duration decreases, increase the preset frequency of the flashing.

[0127] For the convenience of description, when describing the above device, it is divided into various modules according to functions for separate description. Of course, when implementing the present application, the functions of each module can be implemented in the same or multiple software and / or hardware.

[0128] The device in the above embodiment is used to implement the corresponding riding display method based on the AR helmet in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0129] Based on the same inventive concept, corresponding to the method in any of the above embodiments, the present application further provides an electronic device, including a memory, a processor, and a computer program stored on the memory and executable on the processor, and when the processor executes the program, it implements the riding display method based on the AR helmet described in any of the above embodiments.

[0130] Figure 7FIG. 0 shows a more specific schematic diagram of the hardware structure of the electronic device provided in this embodiment. The device may include: a processor 1010, a memory 1020, an input / output interface 1030, a communication interface 1040, and a bus 1050. Among them, the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040 are communicatively connected to each other inside the device through the bus 1050.

[0131] The processor 1010 may be implemented in a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, etc., and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this specification.

[0132] The memory 1020 may be implemented in the form of a ROM (Read Only Memory), a RAM (Random Access Memory), a static storage device, a dynamic storage device, etc. The memory 1020 may store an operating system and other application programs. When implementing the technical solutions provided in the embodiments of this specification through software or firmware, the relevant program codes are stored in the memory 1020 and are called and executed by the processor 1010.

[0133] The input / output interface 1030 is used to connect to an input / output module to implement information input and output. The input / output module may be configured as a component in the device (not shown in the figure) or externally connected to the device to provide corresponding functions. Among them, the input device may include a keyboard, a mouse, a touch screen, a microphone, various sensors, etc., and the output device may include a display, a speaker, a vibrator, an indicator light, etc.

[0134] The communication interface 1040 is used to connect to a communication module (not shown in the figure) to implement communication interaction between this device and other devices. Among them, the communication module may implement communication in a wired manner (such as USB, network cable, etc.) or in a wireless manner (such as mobile network, WIFI, Bluetooth, etc.).

[0135] The bus 1050 includes a path for transmitting information between various components of the device (such as the processor 1010, the memory 1020, the input / output interface 1030, and the communication interface 1040).

[0136] It should be noted that although the above device only shows the processor 1010, the memory 1020, the input / output interface 1030, the communication interface 1040, and the bus 1050, in the specific implementation process, the device may also include other components necessary for normal operation. In addition, those skilled in the art can understand that the above device may also only include the components necessary to implement the solution of the embodiments of this specification, and does not necessarily include all the components shown in the figure.

[0137] The electronic device in the above embodiment is used to implement the corresponding riding display method based on the AR helmet in any of the foregoing embodiments, and has the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0138] Based on the same inventive concept, corresponding to the method in any of the above embodiments, the present application also provides a non-transitory computer-readable storage medium, which stores computer instructions for causing the computer to execute the riding display method based on the AR helmet as described in any of the foregoing embodiments.

[0139] The computer-readable medium in this embodiment includes permanent and non-permanent, removable and non-removable media, and information storage can be implemented by any method or technology. The information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, compact disc read-only memory (CD-ROM), digital versatile disc (DVD) or other optical storage, magnetic cassette tapes, magnetic disk storage or other magnetic storage devices, or any other non-transmission medium that can be used to store information accessible by a computing device.

[0140] The computer instructions stored in the storage medium in the above embodiment are used to cause the computer to execute the riding display method based on the AR helmet as described in any of the foregoing embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0141] Based on the same concept, corresponding to the method in any of the above embodiments, the present application also provides a computer program product, including computer program instructions, which when run on a computer, cause the computer to execute the method as described in any of the foregoing embodiments, and have the beneficial effects of the corresponding method embodiments, which will not be elaborated here.

[0142] It can be understood that before using the technical solutions of the various embodiments in the present disclosure, the types, usage scopes, usage scenarios, etc. of the personal information involved will be informed to the user in an appropriate manner, and the authorization of the user will be obtained.

[0143] For example, when responding to receiving an active request from the user, a prompt message is sent to the user to clearly prompt the user that the operation requested by the user will require obtaining and using the user's personal information. Thus, the user can autonomously choose whether to provide personal information to software or hardware such as an electronic device, an application program, a server, or a storage medium that executes the operations of the technical solutions of the present disclosure according to the prompt message.

[0144] As an optional but non-limiting implementation manner, the manner of sending a prompt message to the user in response to receiving an active request from the user can be, for example, in the form of a pop-up window. The prompt message can be presented in text in the pop-up window. In addition, the pop-up window can also carry a selection control for the user to choose "agree" or "disagree" to provide personal information to the electronic device.

[0145] It can be understood that the above process of notifying and obtaining the user's authorization is only illustrative and does not limit the implementation manner of the present disclosure. Other manners that comply with relevant laws and regulations can also be applied to the implementation manner of the present disclosure.

[0146] Those of ordinary skill in the art should understand that the discussion of any of the above embodiments is only exemplary and is not intended to imply that the scope of the present application is limited to these examples; under the concept of the present application, the technical features between the above embodiments or different embodiments can also be combined, the steps can be implemented in any order, and there are many other variations in different aspects of the embodiments of the present application as described above. For the sake of brevity, they are not provided in detail.

[0147] In addition, for the sake of simplifying the description and discussion, and in order not to make the embodiments of the present application difficult to understand, the well-known power / ground connections to integrated circuit (IC) chips and other components may or may not be shown in the provided drawings. In addition, the device can be shown in the form of a block diagram to avoid making the embodiments of the present application difficult to understand, and this also takes into account the fact that the details of the implementation manner of these block diagram devices highly depend on the platform on which the embodiments of the present application will be implemented (that is, these details should be completely within the understanding scope of those skilled in the art). In the case of elaborating specific details (such as circuits) to describe the exemplary embodiments of the present application, it is obvious to those skilled in the art that the embodiments of the present application can be implemented without these specific details or with changes to these specific details. Therefore, these descriptions should be considered illustrative rather than restrictive.

[0148] Although the present application has been described in connection with specific embodiments thereof, many alternatives, modifications, and variations of these embodiments will be apparent to those of ordinary skill in the art in light of the foregoing description. For example, other memory architectures (e.g., dynamic RAM (DRAM)) may be used with the embodiments discussed.

[0149] Embodiments of the present application are intended to cover all such alternatives, modifications, and variations that fall within the broad scope of the claims of the present application. Accordingly, any omissions, modifications, equivalent substitutions, improvements, etc. made within the spirit and principle of the embodiments of the present application shall be included within the protection scope of the present application.

Claims

1. A riding display method based on an AR helmet, characterized in that: The AR helmet includes a camera device and a display screen, wherein the camera device is used to obtain image information of a user's blind spot, and the display screen is arranged in the user's front sight range to display the image information to the user. The method includes: In response to the AR helmet being started, determining whether the user has a need to turn according to the user's line of sight; In response to determining that the user has a turning demand, acquiring image information of a blind spot in the user's field of vision; The image information of the blind area is displayed on a display screen according to the turning requirement.

2. The riding display method based on an AR helmet according to claim 1, characterized in that: The determining whether the user has a turning demand according to the user's sight focus includes: Get the position of the user's visual focus on the display screen; In response to determining that the user's sight focus is in the first preset area or the second preset area, determining that the user has a turning demand; The first preset area is arranged close to a longitudinal edge of the display screen, and the second preset area is adjacent to the first preset area and away from the longitudinal edge of the display screen.

3. The riding display method based on AR helmet according to claim 2, characterized in that: The step of displaying the image information of the blind area on a display screen according to the turning requirement includes: Determining the type of turning requirement according to the position of the user's sight focus on the display screen, and determining the display area of ​​the image information according to the type of turning requirement; In response to the user's visual focus staying in the first preset area of ​​the display screen for a duration greater than or equal to a preset duration, determining that the turning demand type is a severe turning demand, and displaying the image information in the first preset display area of ​​the display screen; In response to the user's visual focus staying on the second preset area of ​​the display screen for a duration greater than or equal to the preset duration, determining that the turning demand type is a mild turning demand, and displaying the image information in the second preset display area of ​​the display screen; The first preset display area is larger than the second preset display area.

4. The riding display method based on an AR helmet according to claim 3, characterized in that: The step of displaying the image information in a first preset display area of ​​the display screen includes: Acquire image information of the blind spot of the user's visual field to the side to be turned based on the sight focus; Displaying the image information in a first preset display area of ​​a display screen with a preset transparency; The first preset display area is the display screen area corresponding to the side to which the user is to turn.

5. The riding display method based on AR helmet according to claim 3, characterized in that: The step of displaying the image information in a second preset display area of ​​the display screen includes: Acquire image information of the blind spot of the user's visual field to the side to be turned based on the sight focus; Displaying the image information at a preset transparency in a second preset display area of ​​the display screen; The second preset display area is a display screen area corresponding to the side to which the user is to turn.

6. The riding display method based on AR helmet according to claim 1, characterized in that: The AR helmet also includes an environment perception module for detecting spatial information of objects in the environment; The method further comprises: Performing target recognition on the vehicle in the image information; In response to identifying the presence of at least one vehicle, detecting relative motion information between the user and the vehicle through an environment perception module; In response to determining that the user is at risk of collision according to the relative motion information, danger warning information is sent to the user.

7. The riding display method based on an AR helmet according to claim 6, characterized in that: The relative motion information includes the relative distance between the user and the vehicle; and determining that the user has a collision risk according to the relative motion information and sending a danger warning message to the user includes: In response to a relative distance between a user and at least one vehicle being less than a preset safety distance, it is determined that there is a risk of collision between the user and the vehicle, and a danger warning message is sent to the user.

8. The riding display method based on an AR helmet according to claim 7, characterized in that: The relative motion information includes the relative speed between the user and the vehicle; and determining that the user has a collision risk according to the relative motion information and sending a danger warning message to the user includes: In response to a relative distance between the user and all vehicles being greater than or equal to a preset safety distance, determining a time required for the vehicle to approach the user based on the relative distance and the relative speed; In response to the time required for at least one vehicle to approach the user being less than a preset safety time, it is determined that there is a risk of collision between the user and the vehicle, and a danger warning message is sent to the user.

9. The riding display method based on an AR helmet according to claim 8, characterized in that: The sending of danger warning information to the user includes: Performing image enhancement on an image of a target vehicle in the image information displayed on a display screen, and flashing the image at a preset frequency, wherein the target vehicle is a vehicle that has a risk of collision with the user; In response to determining that the relative distance decreases and / or the duration decreases, the preset frequency of the flashing is increased.

10. An AR helmet, characterized in that: include: A camera device configured to obtain image information of a blind spot in a user's field of vision; a display screen configured to display the image information to a user; The control module is configured to respond to the startup of the AR helmet and determine whether the user has a turning demand based on the user's line of sight. When it is determined that the user has a turning demand, the image information of the blind spot in the field of vision is displayed on the display screen according to the turning demand.

Images