Method, apparatus, device and storage medium for obtaining road information
By obtaining slope data and adjusting the camera's viewing angle, the problem of changing blind spots on complex roads is solved, and efficient and reasonable scene display and driving safety guarantees are achieved.
Patent Information
- Application Number
- CN202111581063.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-12-22
- Publication Date
- 2025-06-27
- Estimated Expiration
- 2041-12-22
AI Technical Summary
On roads with complex road conditions, especially on mountain roads with many ramps, the size and range of driver's blind spots of vision are constantly changing. It is difficult for the existing technology to provide efficient and reasonable views in blind spots of vision, affecting driving safety.
By obtaining the slope data of the current driving road surface and the slope data of the historical driving road surface, adjust the viewing angle of the camera to reasonably display the scene in the blind spot of the driver's field of vision, and judge whether the camera is turned on or off based on the slope changes, saving system resources.
It has achieved efficient and reasonable provision of blind spots for drivers under complex road conditions, enhanced driving safety guarantees, and saved system resources.
Smart Images

Figure CN116331218B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of vehicle safety, and particularly to a method, device, equipment and storage medium for obtaining road information. Background Art
[0002] A vision blind area refers to an area where the driver's line of sight is affected during driving and cannot be observed. The vision blind area poses a great potential hazard to vehicle driving safety and is one of the main factors causing traffic accidents, seriously threatening the driver's life safety. The vision blind area is inevitable during the driving of a vehicle. Especially when the vehicle is driving on a slope, the greater the slope of the slope, the larger the vision blind area of the driver. Moreover, if the driver handles it improperly on the slope, the vehicle may also slide down under the traction of gravity on the slope, making it more likely to occur safety accidents.
[0003] Currently, some vehicles can obtain the scene in the driver's vision blind area through a camera to avoid the safety hazards brought by the vision blind area. However, on roads with complex road conditions, especially on mountain roads with many slopes, the size and range of the driver's vision blind area are constantly changing. In this case, how to efficiently and reasonably provide the driver with the scene in the vision blind area is an urgent problem for those skilled in the art. Summary of the Invention
[0004] An object of this application is to provide a method, device, equipment and storage medium for obtaining road information, which has the advantage of being able to reasonably adjust the viewing angle of the camera according to the slope data of the driver's current driving road surface and the slope data of the historical driving road surface on roads with complex road conditions, especially on mountain roads with many slopes, so as to efficiently and reasonably provide the driver with the scene in the driver's vision blind area.
[0005] Another object of this application is to provide a method, device, equipment and storage medium for obtaining road information, which has the advantage of being able to first determine whether the slope value of the current road condition meets the preset conditions, accurately analyze the road condition environment where the vehicle is located, and thus more intelligently select the timing to turn on or off the vehicle's front camera, saving system resources while strengthening the vehicle's driving safety guarantee.
[0006] To achieve the above object, in a first aspect, an embodiment of the present application provides a method for obtaining road information. The method includes the following steps: obtaining first slope data and second slope data, where the first slope data includes a first slope value, and the second slope data includes a second slope value. The first slope value is the slope value of the road surface on which the vehicle travels at a first moment, and the second slope value is the slope value of the road surface on which the vehicle travels at a second moment; adjusting the viewing angle of the camera according to the difference between the first slope data and the second slope data; and presenting the road condition information captured by the camera to the user.
[0007] After comprehensively analyzing the two slope data, this method adjusts the viewing angle of the camera based on the analysis result and presents the image captured by the camera to the user in real time, which can efficiently and reasonably provide the driver with the scene in the driver's vision blind area and enhance the driving safety guarantee of the vehicle.
[0008] In addition, it should be understood that although the response speed of the ramp sensor is relatively sensitive, generally at the millisecond level, the response speed of the camera is relatively slow. For operations such as turning on, turning off, or changing the viewing angle, the camera generally takes several seconds to complete. Therefore, in the case of too fast a ramp change frequency, even if the slope sensor can detect the change in the slope value of the driving road surface in a timely manner, the camera cannot make corresponding adjustments immediately. In addition, since the user also needs a certain reaction time from receiving the information to reacting to the information, if the viewing angle of the camera is adjusted too frequently, the displayed images will also change frequently, which is likely to bring a greater visual information processing burden to the user.
[0009] Therefore, in this embodiment, when the difference between the first slope value and the second slope value is greater than the first threshold and the interval between the first timestamp and the second timestamp is greater than the second threshold, the viewing angle of the camera is controlled to change, saving system resources while avoiding frequent adjustment of the viewing angle of the camera, thus avoiding frequent image alternation and enhancing the driving safety guarantee of the vehicle.
[0010] It can be understood that when the slope value is less than a certain angle, the possible vision blind area in front of the vehicle is relatively small and is unlikely to affect the safe driving of the driver. Therefore, in this embodiment, when the slope value of the road surface on which the vehicle travels is greater than a certain threshold (i.e., the third threshold), the camera is activated and starts shooting, and the captured image is presented to the user. In this way, system resources can be further saved.
[0011] In a second aspect, an embodiment of the present application provides a road information acquisition device, including a slope sensor, a camera, a processor, a display, and a memory. The slope sensor is configured to detect the slope value of the road surface on which the vehicle is traveling; the camera is configured to capture the road condition information in front of the vehicle; the memory is configured to store the slope value detected by the slope sensor and the corresponding timestamp when the slope value is detected; the processor is configured to determine the viewing angle of the camera according to the slope value and the corresponding timestamp of the slope value, and control the camera to adjust to the viewing angle; the display is configured to output the road condition information captured by the camera.
[0012] In a third aspect, an embodiment of the present application provides an electronic device, including: a memory configured to store a program; a processor configured to execute the program stored in the memory. When the program is executed, the processor is configured to execute the method in the first aspect and any optional implementation manner of the first aspect.
[0013] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer program runs on one or more processors, it executes the method in the first aspect and any optional implementation manner of the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS
[0014] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the background art, the following will briefly introduce the drawings required to be used in the embodiments of the present application or the background art.
[0015] Figure 1 It is a schematic diagram of the corresponding relationship between the focal length and the field of view angle provided by an embodiment of the present application;
[0016] Figure 2 It is a schematic diagram of the vision situation of a user inside a vehicle provided by an embodiment of the present application;
[0017] Figure 3 It is a schematic diagram of the vision blind areas of a vehicle on a flat ground and a ramp provided by an embodiment of the present application;
[0018] Figure 4 It is a flowchart of a road information acquisition method provided by an embodiment of the present application;
[0019] Figure 5 It is a flowchart of a road information acquisition method provided by an embodiment of the present application;
[0020] Figure 6 It is a schematic diagram of the driving process of a vehicle on different driving road surfaces provided by an embodiment of the present application;
[0021] Figure 7Schematic diagram of a process for changing the viewing angle of a camera provided by an embodiment of the present application;
[0022] Figure 8 Flowchart of a process for a terminal device to control the operation of a camera provided by an embodiment of the present application;
[0023] Figure 9 Flowchart of a method for a camera to adjust the viewing angle provided by an embodiment of the present application;
[0024] Figure 10 Planar schematic diagram of the viewing direction of a camera provided by an embodiment of the present application;
[0025] Figure 11 Schematic diagram of the structure of a road information acquisition device provided by an embodiment of the present application;
[0026] Figure 12 Schematic diagram of the structure of an electronic device provided by an embodiment of the present application. Detailed implementation manners
[0027] In order to make the objectives, technical solutions and advantages of the present application clearer, the present application will be further described below with reference to the accompanying drawings.
[0028] Terms such as "first" and "second" in the specification, claims and drawings of the present application are only used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or device, etc. that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or devices, etc.
[0029] As used herein, the phrase "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment can be included in at least one embodiment of the present application. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art can explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.
[0030] In this application, "at least one (item)" means one or more, "a plurality" means two or more, "at least two (items)" means two, three or more, and "and / or" is used to describe the relationship between associated objects, indicating that there can be three relationships. For example, "A and / or B" can mean: only A exists, only B exists, and both A and B exist at the same time. Here, A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in an "or" relationship. "At least one (item) of the following" or a similar expression means any combination of these items. For example, at least one (item) of a, b, or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c".
[0031] The embodiments of this application provide a method, a system, a device, and a storage medium for obtaining a field of view. To describe the solution of the present invention more clearly, some knowledge related to the method, system, device, and storage medium for obtaining a field of view provided by the embodiments of this application will be introduced first.
[0032] (1) Gradient and gradient measurement
[0033] Gradient is used to represent the slope of a slope and is often used to mark the steepness of slopes of hills, roofs, and roads. Currently, with the improvement of the vehicle's hardware configuration, the vehicle's own computing power can already cover many complex scenarios. When the vehicle is driving on a slope, the current gradient can be calculated in real time based on the inertial acceleration sensor and the filtered acceleration difference between the front and rear wheels.
[0034] (2) Focal length and field of view angle: The focal length is the distance from the center point of the lens to the clear image formed on the focal plane and is a measure of the convergence or divergence of light in an optical system. The size of the focal length determines the size of the viewing angle. When the focal length value is small, the field of view angle is large, and the observed range is also large; when the focal length value is large, the field of view angle is small, and the observed range is small. According to whether the focal length can be adjusted, it can be divided into two categories: fixed-focus lenses and zoom lenses. When shooting the same subject at the same distance, the image formed by the lens with a longer focal length is larger, and the image formed by the lens with a shorter focal length is smaller. In an optical instrument, the angle formed by the two edges of the maximum range through which the image of the measured target can pass through the lens with the vertex of the lens of the optical instrument is called the field of view angle. The size of the field of view angle determines the field of view of the optical instrument. The larger the field of view angle, the larger the field of view, and the smaller the optical magnification. Generally speaking, the target object will not be captured within the lens beyond this angle. The focal length is inversely proportional to the field of view angle, that is, the larger the focal length, the smaller the field of view angle, and vice versa. Take Figure 1For example, during the shooting process, the camera can adjust the focal length of the camera, which provides six focal length gears: wide-angle focal length, 2×, 3×, 4×, 5×, and 6×. It is not difficult to understand that when the focal length is wide-angle, the field of view angle that the camera can capture is the largest, that is, 180° directly in front of the camera. When the focal length is adjusted to 2×, as Figure 1 shown, its field of view angle has become 84°; if the focal length is adjusted to 6×, as Figure 1 shown, its field of view angle is only 30° directly in front.
[0035] (3) Blind spot of vision
[0036] The blind spot of vision is the area outside the vehicle that the driver of the vehicle cannot directly see when sitting in the driver's cab due to the line of sight being blocked. This area has four parts: front, rear, left, and right, and the size of the area varies depending on the vehicle model. Obstacles, whether stationary or moving, in the blind spot of vision cannot be seen by the driver.
[0037] The blind spot of vision refers to the area where the driver's line of sight is affected during driving and cannot be observed. The blind spot of vision poses a great threat to the safety of vehicle driving and is one of the main factors causing traffic accidents, seriously threatening the driver's life safety.
[0038] The blind spot of vision is inevitable during the driving of the vehicle. Figure 2 This is a schematic diagram of the vision situation of a user inside the vehicle provided by the embodiment of the present application. As Figure 2 shown, the driver or passenger can obtain the vision in front of the vehicle through the window 201 during the driving of the vehicle. In this vision, it can be seen that there is a vehicle 212 approaching head-on in front of the vehicle, and there are also pedestrians 211 and 213 crossing the road in front. However, from Figure 2 it can be seen that due to the occlusion of the left frame 203, right frame 204 of the vehicle, and the front axle of the vehicle, there is a certain range of blind spots in the vision of the driver and passenger during the process of obtaining the vision in front of the vehicle. As Figure 2 shown, due to the occlusion of the right frame 204 and the front axle of the vehicle, the driver may not be able to obtain the full view of pedestrians 211 and 213 during driving, which will seriously threaten the safety of vehicle driving and the safety of other individuals on the road.
[0039] In addition, when the vehicle is driving on a slope, the range of the driver's blind spot of vision will be larger, and the threat of the blind spot of vision to the driver's driving safety is also more obvious on the slope. Figure 3 This is a schematic diagram of the blind spot of vision of a vehicle on flat ground and on a slope provided by the embodiment of the present application. As Figure 3As shown in (A) therein, when the driver is driving a vehicle, his line of sight is horizontal (as shown by the driver's line of sight 301a). On flat ground, the front axle 302a of the vehicle is below the driver's line of sight. Due to the occlusion of the front axle 302a of the vehicle, when the vehicle is driving on flat ground, the blind spot of the driver's field of vision is Figure 3 the blind spot of the field of vision 303a shown in (A) therein. However, in Figure 3 (B) therein, when the driver is driving on a slope, his line of sight is still horizontal (as shown by the driver's line of sight 301b). It can be understood that on a slope, due to the inclination of the slope to the vehicle, at this time the front axle 302a of the vehicle is above the driver's line of sight. Therefore, compared with on flat ground, the range of the blind spot of the driver's field of vision caused by the front axle of the vehicle is larger when the vehicle is on a slope. As Figure 3 shown in (B) therein, due to the occlusion of the front axle 302b of the vehicle, when the vehicle is driving on a slope, the blind spot of the driver's field of vision is Figure 3 the blind spot of the field of vision 303b shown in (B) therein. In addition, when the vehicle is about to drive out of the slope, due to the difference in the field of vision between the slope and the flat ground, the driver on the slope may not be able to obtain the field of vision of the flat ground above the slope at this time. As Figure 3 shown in (C) therein, when the vehicle is about to drive out of the slope, due to the occlusion of the front axle 302c of the vehicle, the blind spot of the driver's field of vision is Figure 3 the blind spot of the field of vision 303c shown in (C) therein. In addition, even if there are other vehicles coming head-on on the flat ground above the slope, the vehicle cannot obtain the field of vision of other vehicles, and traffic accidents are very likely to occur.
[0040] With the improvement of the vehicle's hardware configuration, the computing power of the vehicle itself can already cover many complex scenarios. To address the above problems, a camera can be installed at the front end of the vehicle. When the vehicle is driving on a slope, the in-vehicle device can calculate the current slope in real time according to the inertial acceleration sensor and the acceleration filtering difference between the front and rear wheels, and then adjust the viewing angle of the camera according to the current slope. After using the camera to capture the scene in the blind spot of the driver's field of vision, it is displayed to the driver, so as to eliminate the safety hazards brought by the blind spot of the driver's field of vision.
[0041] However, on roads with complex road conditions, especially on mountain roads with many slopes, the size and range of the driver's vision blind area are constantly changing. In this case, if the camera's viewing angle is adjusted only according to the magnitude of the slope value, it is very likely that the camera needs to be adjusted frequently. However, when the slope change is extremely small, for example, changing from 30° to 31°, although the slope sensor can detect that the slope value of the driving road surface has changed by 1°, the vision blind area corresponding to this 1° angle is very likely not to affect the safe driving of the driver; in addition, although the response speed of the slope sensor is relatively sensitive, the response speed of the camera is relatively slow. For operations such as turning on, turning off, or changing the viewing angle, the camera generally takes several seconds to complete. Therefore, in the case of too fast slope change frequency, even if the slope sensor can detect the change of the slope value of the driving road surface in time, the camera cannot make corresponding adjustments immediately. In addition, since it also takes a certain reaction time for the user to react after receiving the information, if the viewing angle of the camera is adjusted too frequently, the pictures presented to the user will also change frequently, which is very likely to bring a greater visual information processing burden to the user.
[0042] In view of the deficiencies in the above method, the embodiment of the present application provides a method for controlling a camera. This method can reasonably adjust the viewing angle of the camera according to the slope data of the current driving road surface and the slope data of the historical driving road surface of the driver on roads with complex road conditions, especially on mountain roads with many slopes, so as to efficiently and reasonably provide the driver with the scene in the driver's vision blind area, saving system resources while better ensuring the driving safety of the driver. For specific details, please refer to Figure 4 .
[0043] Figure 4 The flowchart of a method for obtaining road information provided by the embodiment of the present application. As Figure 4 shown, the method includes the following steps:
[0044] 401. Obtain the first slope data and the second slope data.
[0045] The terminal device obtains the first slope data and the second slope data.
[0046] Specifically, the terminal device may be a mobile phone, an in-vehicle device (OBU (On Board Unit, such as an in-vehicle unit)), a tablet computer, a computer with data transceiver function (such as a notebook computer, a palmtop computer, etc.), a mobile Internet device, a terminal in industrial control, a wireless terminal in driverless driving, a terminal in transportation safety, a terminal in a smart city, a terminal in a smart home, a terminal device in a 5G network, or a terminal device in a future evolved public land mobile communication network, etc. One or more cameras may also be provided on the terminal device; alternatively, the terminal device may be communicatively connected to one or more devices with camera functions, and the terminal device may obtain images captured by the camera or the devices with camera functions. In addition, in order to obtain a larger field of view, the cameras in the embodiments of the present application and subsequent embodiments may be cameras with a larger field of view, such as common wide-angle cameras, etc.
[0047] Optionally, when the terminal device is an in-vehicle device in a vehicle, the vehicle may be an ordinary vehicle, a special vehicle (including but not limited to a police car, a tractor, etc.) or a rescue vehicle (including but not limited to an ambulance, a fire truck, a rescue vehicle, etc.).
[0048] In addition, the terminal device may also be a device in an Internet of Things system. IoT (Internet of Things) is an important part of the future development of information technology. Its main technical feature is to connect objects to the network through communication technology, so as to realize an intelligent network of human-machine interconnection and object-object interconnection. Optionally, IoT technology can achieve massive connection, deep coverage, and power saving of terminals through, for example, narrowband technology. It can be understood that the specific form of the terminal device is not limited in this application. Any device that can communicate with a roadside device, a vehicle, or a vehicle management platform, etc., falls within the protection scope of the terminal device.
[0049] The first slope data includes a first slope value, and the second slope data includes a second slope value. The first slope value is the slope value of the road surface on which the vehicle travels at a first moment, and the second slope value is the slope value of the road surface on which the vehicle travels at a second moment. That is to say, the first slope data is slope data collected historically, and this data can be stored in the memory of the terminal device. The second slope data is slope data collected by the terminal device in real time. For example, each integrated component of the terminal device may include a slope sensor; or, the terminal device may be communicatively connected to a slope sensor. During the driving of the vehicle, the slope sensor can detect the slope value of the current driving road surface in real time and send the slope value to the terminal device. It can be understood that after the terminal device collects the second slope data, the terminal device can also store the second slope data in the memory so that the terminal device can obtain the second slope data as historical data for use in subsequent processes.
[0050] 402. Adjust the viewing angle of the camera according to the difference between the first slope data and the second slope data.
[0051] The camera can be arranged at the front end of the vehicle. For example, it can be below the license plate of the vehicle or at the front axle of the vehicle, or at other places of the vehicle. The embodiments of the present application do not limit this.
[0052] It can be understood that on a road with complex road conditions, especially on a mountain road with many slopes, the slope of the road surface on which the vehicle travels is constantly changing. During the process of the slope sensor collecting the road surface slope in real time, the collected slope value may change at a relatively fast rate. Generally speaking, the change of the slope value means that the size and range of the driver's visual blind area may also change. At this time, the viewing angle of the camera should be adjusted in time so that the viewing angle of the camera can include the field of view angle corresponding to the driver's visual blind area. However, when the slope change is extremely small, for example, changing from 30° to 31°, although the slope sensor can detect that the slope value of the driving road surface has changed by 1°, the visual blind area corresponding to this 1° angle is very likely not to affect the safe driving of the driver; that is to say, even if the camera still maintains the current viewing angle, the safety hazard brought by the visual blind area caused by a 31° slope can be eliminated.
[0053] Therefore, in this method, when the difference between the first slope value and the second slope value is greater than a first threshold, the terminal device can control the viewing angle of the camera to be adjusted from a first angle to a second angle. The first angle is the viewing angle of the camera at the first moment, and the second angle is the field of view angle corresponding to the visual blind area in front of the vehicle at the second moment.
[0054] In an optional embodiment, the difference between the first slope value and the second slope value is equal to the difference between the first angle value and the second angle value. In this way, the adjustment range of the camera can be minimized, system resources can be saved, and the transformation frequency of the images captured by the camera can be reduced.
[0055] 403. Display the road information captured by the camera to the user.
[0056] After obtaining the image of the camera, the terminal device can display the image containing the road information to the user.
[0057] Specifically, when the terminal device is a vehicle-mounted device, the device for displaying the road information can be a screen with a display function such as an instrument panel screen, a central control screen, and a HUD in the vehicle. The embodiments of the present application do not limit this.
[0058] To further illustrate the above method, the embodiments of the present application provide a more detailed flowchart of a road information acquisition method and a schematic diagram of the driving process of a vehicle on different driving roads. Specifically, please refer to Figure 5 and Figure 6 .
[0059] Figure 5 The flowchart of a road information acquisition method provided by the embodiments of the present application. As Figure 5 shown, the method includes the following steps:
[0060] 501. Detect slope data.
[0061] The terminal device detects slope data. The specific form of the terminal device can refer to the description of the terminal device in Figure 2 above, which will not be elaborated here. Specifically, the terminal device can be the terminal device in Figure 2 . A camera can be provided on the terminal device; or, the terminal device can be communicatively connected to a camera. The terminal device can obtain the images captured by the camera or the device with a camera function, and the terminal device can control the opening or closing of the camera.
[0062] The slope data may include the slope value of the vehicle driving road surface. Specifically, when the above terminal device is a vehicle-mounted terminal, a slope sensor may be included in each integrated component of the terminal device; or, the terminal device can be communicatively connected to a slope sensor. During the driving of the vehicle, the slope sensor can detect the slope value of the current driving road surface in real time according to the inertial acceleration sensor and the acceleration filtering difference between the front and rear wheels, and send the slope value to the terminal device.
[0063] 502. Determine whether the slope value is greater than the third threshold.
[0064] The above terminal device determines whether the slope value in the detected slope data is greater than the third threshold. It should be understood that when the slope value is less than a certain angle, the possible visual blind area in front of the vehicle is relatively small and is very likely not to affect the safe driving of the driver. Therefore, in this embodiment, when the slope value of the road surface on which the vehicle is traveling is greater than the third threshold, the camera is activated and starts shooting, and the captured image is displayed to the user. In this way, system resources can be saved.
[0065] Specifically, the third threshold can be set to a specific angle value, such as 15°, 20° or other degrees, and the present application does not limit its specific value. The above terminal device can control the opening or closing of the camera according to whether the slope value is greater than the third threshold. When the slope value is greater than the third threshold, step 503 is executed, that is, the camera is controlled to be turned on, and the road information captured by the camera is displayed to the user; when the slope value is less than or equal to the third threshold, step 501 is repeatedly executed, that is, the slope data is detected again.
[0066] Taking Figure 6 the shown scenario as an example, Figure 6 the in-vehicle terminal on the vehicle 601 can be the above terminal device. Here, it is assumed that the third threshold is θ, and 0° < θ < θ1 < θ2 < θ3 < θ4.
[0067] As Figure 6 shown in (A) of, at time t0, the vehicle 601 is traveling on flat ground and the camera is in the off state. It can be understood that at time t0, the terminal device detects the fifth slope data, and the slope value detected by the slope sensor on the vehicle 601 is 0°. Since 0° < θ, that is, the slope value collected at time t0 is less than the third threshold. At this time, the camera remains in the off state. It should be understood that on flat ground, the camera is always in the off state.
[0068] As Figure 6 shown in (B) of, at time t3, the vehicle 601 travels from the flat ground 602 to the ramp 603, and the camera was in the off state before this. At time t3, the terminal device detects the third slope data, and the slope value detected by the slope sensor on the vehicle 601 is θ1. Since θ < θ1, that is, the slope value collected at time t3 is greater than the third threshold. At this time, the camera is turned on. After that, the terminal device displays the road information captured by the camera to the user.
[0069] 503. Turn on the camera and display the road information captured by the camera to the user.
[0070] Specifically, the device for displaying the road information on the vehicle 601 may be a screen with a display function such as an instrument screen, a central control screen, and a HUD in the vehicle. The embodiments of the present application do not limit this.
[0071] Optionally, before performing step 503, the terminal device may further determine whether the vehicle is in a reverse state. If the vehicle is in a reverse state, the camera remains in the closed state; if the vehicle is not in a reverse state, the camera is turned on, and the road information captured by the camera is displayed to the user.
[0072] Optionally, after performing step 503, the terminal device may determine whether the camera is successfully turned on. If the camera fails to be successfully turned on, the terminal device may output a prompt message to remind the user that the device has a fault.
[0073] 504. Obtain the first slope data and the second slope data.
[0074] The first slope data is the slope data collected by the terminal device when the vehicle is driving on the road surface during historical driving, and the second slope data is the slope data collected by the device when the vehicle is driving on the current road surface. The first slope data includes a first slope value, and the second slope data includes a second slope value. The first slope value is the slope value of the road surface on which the vehicle is driving at the first moment, and the second slope value is the slope value of the road surface on which the vehicle is driving at the second moment. It can be understood that there must be differences in the collection time and slope value between these two slope data, and these differences also reflect to a certain extent the differences in the size and range of the blind area in the driver's field of vision during the vehicle's driving process. Therefore, after comprehensively analyzing the two slope data, the present method adjusts the viewing angle of the camera based on the analysis result and displays the image captured by the camera to the user in real time, which can efficiently and reasonably provide the driver with the scene in the driver's field of vision blind area and strengthen the vehicle's driving safety guarantee. It should be noted that the first slope data should be the latest slope data among the historically saved slope data.
[0075] Similarly, taking Figure 6 the scene shown as an example, as Figure 6 shown in (C) of, at time t1, the vehicle 601 travels from the ramp 603 to the ramp 604, and the camera is in the off state before this. At time t1, the slope data detected by the terminal device on the ramp 604 can be used as the second slope data, and the slope value at this time is θ2 (i.e., the second slope value); at time t3, the third slope data detected by the terminal device can be used as the first slope data, and the slope value at time t3 is θ1 (i.e., the first slope value).
[0076] Similarly, as Figure 6 shown in (D) of FIG. 2, at time t2, the vehicle 601 has traveled from the ramp 605 to the ramp 606. During the period from t1 to t2, the camera has been turned on. At time t2, the data detected by the terminal device on the ramp 606 can be used as the second slope data, and the slope value at this time is θ4 (i.e., the second slope value). At time t2, the second slope data detected by the terminal device can be used as the first slope data, and the slope value at time t2 is θ3 (i.e., the first slope value).
[0077] 505. Determine whether the difference between the first slope value and the second slope value is greater than a first threshold value.
[0078] It can be understood that on a road with complex road conditions, especially on a mountain road with many ramps, the slope of the road surface on which the vehicle travels is constantly changing. During the process of the slope sensor collecting the road surface slope in real time, the collected slope value may change at a relatively fast rate. Generally speaking, the change in the slope value means that the size and range of the driver's vision blind area may also change. At this time, the viewing angle of the camera should be adjusted in time so that the viewing angle of the camera can cover the field of view angle corresponding to the driver's vision blind area. However, when the slope change is extremely small, for example, changing from 30° to 31°, although the slope sensor can detect that the slope value of the driving road surface has changed by 1°, it is very likely that this 1° angle corresponding vision blind area will not affect the safe driving of the driver; that is to say, even if the camera still maintains the current viewing angle, it can eliminate the safety hazard brought by the vision blind area caused by the 31° slope. Therefore, in this method, when the change in the slope value is greater than a certain threshold value (i.e., the first threshold value), the viewing angle of the camera will be changed.
[0079] Specifically, the first threshold value can be set to a specific angle value, such as 2°, 3° or other degrees, and the present application does not limit its specific value. The above terminal device can control the turning on or off of the camera according to whether the slope value is greater than a third threshold value. When the slope value is greater than the third threshold value, step 503 is executed, that is, controlling the camera to turn on and displaying the road information captured by the camera to the user; when the slope value is less than or equal to the third threshold value, step 504 is repeatedly executed, that is, re-detecting the change of the slope data over time.
[0080] Combined with the foregoing description and Figure 6Taking the shown scenario as an example for illustration, it is assumed here that the difference between θ2 and θ1 is less than the first threshold, and the difference between θ4 and θ3 is greater than the first threshold. Then at time t1, that is, when the difference between the first slope value and the second slope value is less than the first threshold, the viewing angle of the camera remains unchanged. However, at time t2, that is, when the difference between the first slope value and the second slope value is greater than the first threshold, the terminal device will execute step 506. Otherwise, the terminal device will repeatedly execute step 504.
[0081] 506. Determine whether the interval between the first timestamp and the second timestamp is greater than the second threshold.
[0082] Specifically, the second threshold can be set to a time interval value, such as 100 ms, 500 ms, or other time interval values. The present application does not limit its specific value.
[0083] That is to say, the first slope data further includes a first timestamp, the second slope data further includes a second timestamp, the first timestamp is the timestamp corresponding to the first moment, and the second timestamp is the timestamp corresponding to the second moment.
[0084] It should be understood that although the response speed of the ramp sensor is relatively sensitive, generally at the millisecond level, the response speed of the camera is relatively slow. For operations such as turning on, turning off, or changing the viewing angle, the camera generally takes several seconds to complete. Therefore, in the case of too fast ramp change frequency, even if the slope sensor can detect the change of the slope value of the driving road surface in time, the camera cannot make corresponding adjustments in time. In addition, since the user also needs a certain reaction time from receiving information to reacting to the information, if the viewing angle of the camera is adjusted too frequently, the displayed images to the user will also change frequently, which is very likely to bring a greater visual information processing burden to the user.
[0085] Combined with the foregoing description and Figure 6 taking the shown scenario as an example for illustration, as Figure 6 shown in (D) of, when the difference between θ4 and θ3 is greater than the first threshold, further determine whether the time interval between time t1 and time t2 is greater than the second threshold. When the difference between θ3 and θ2 is greater than the first threshold and the interval between time t1 and time t2 is greater than the second threshold, the terminal device will execute step 507, that is, control the viewing angle of the camera to change. Otherwise, the terminal device will repeatedly execute step 504, that is, re-detect the change of the slope data over time.
[0086] 507. Adjust the viewing angle of the camera from the first angle to the second angle.
[0087] The first angle is the viewing angle of the camera at the first moment, and the second angle is the field of view angle corresponding to the blind area of vision in front of the vehicle at the second moment.
[0088] Optionally, the difference between the first slope value and the second slope value is equal to the difference between the first angle value and the second angle value.
[0089] 508. Detect slope data.
[0090] After that, the terminal device continues to detect slope data in real time to determine whether to adjust the viewing angle of the camera or turn off the camera.
[0091] 509. Determine whether the slope value is less than or equal to the third threshold.
[0092] During the continuous driving of the vehicle, the slope of the driving road surface is constantly changing. It can be understood that when the camera is in the on state, the terminal device will continuously determine whether the newly detected slope value is greater than the third threshold. If so, the terminal device will determine whether the difference between the newly detected slope value and the historically detected slope value is greater than the first threshold, and whether the time stamp corresponding to the newly detected slope value and the time stamp of the historically detected slope is greater than the second threshold. If so, the above terminal device will immediately adjust the viewing angle of the camera. Otherwise, the camera will execute step 510, that is, turn off the camera.
[0093] 510. Turn off the camera.
[0094] At a certain moment (such as the fourth moment), the slope value of the road surface on which the vehicle is traveling is less than the third threshold. When the terminal device determines whether the newly detected slope value is less than the third threshold, the terminal can control the camera to turn off.
[0095] Such as Figure 6 As shown in (E) of [], at time t4, the vehicle 601 travels from the ramp 606 to the flat ground 607, and the camera is in the on state before this. At time t4, the terminal device detects the fourth slope data, and the slope value detected by the slope sensor on the vehicle 601 is 0°. Since 0° < θ, that is, the slope value collected at time t4 is less than the third threshold. At this time, the terminal device controls the camera to turn off.
[0096] Optionally, after turning off the camera, the terminal device can control the viewing angle of the camera to be restored to the horizontal viewing angle so that the camera can be used normally during subsequent driving.
[0097] Based on Figure 5The provided method and Figure 6 In the driving scenario shown in Figure 7 as shown, Figure 7 The camera 701 shown in
[0098] As Figure 7 shown in (A) of Figure 6 which corresponds to when the vehicle 601 is traveling on the flat ground 602 in
[0099] As Figure 7 shown in (B) of Figure 6 which corresponds to when the vehicle 601 is traveling on the ramp 603 in
[0100] Here, it is also assumed that Figure 6 the difference between θ2 and θ1 in
[0101] corresponds to Figure 6 At time t1 in Figure 7 Since the difference between θ2 and θ1 is less than the first threshold, the viewing angle of the camera does not need to be adjusted. Therefore, at this time, the viewing angle of the camera remains α1 as shown in (B) of
[0102] corresponds to Figure 6 At time t2 in Figure 7 Since the difference between θ4 and θ3 is greater than the first threshold, the viewing angle of the camera needs to be adjusted. Therefore, at this time, the viewing angle of the camera is adjusted to α2 as shown in (C) of Figure 7 (not shown in
[0103] corresponds to Figure 6 At time t4 in Figure 7 the vehicle 601 travels from the ramp 606 to the flat ground 607. At this time, the slope value of the ground is 0°, that is, the slope value of the road surface on which the vehicle 601 travels is less than the third threshold, and the camera is turned off. Therefore, at this time, the viewing angle of the camera is adjusted to 0° as shown in (D) of
[0104] Optionally, the camera can establish an x-y axis coordinate system with the center point of the camera as the coordinate origin, and determine four basic orientations in which the camera can rotate using the four coordinate quadrants, namely up, right, down, and left. The four orientations are identified by hexadecimal constants, and the viewing angle direction of the camera supports direction synthesis, such as upper right, lower left, etc.
[0105] Based on the foregoing description, an embodiment of the present application provides a flowchart for a terminal device to control the operation of a camera. As Figure 8 shown, the process includes the following steps:
[0106] 801. Request a data frame and parse the data frame.
[0107] After receiving the request instruction data frame, the terminal device starts to parse the data. The terminal device may be the terminal device described in the foregoing description.
[0108] Specifically, the data frame may include an action code and additional data. Among them: the action code can be used to indicate what action the camera needs to complete. For example, the action code 001 can represent turn on, and the action code 002 represents turn off, etc. The additional data includes a series of identifiers, which can be used to determine the acquirer and transporter of the data generated in the process.
[0109] 802. Determine whether the data frame is valid.
[0110] If the data frame is invalid, such as an unrecognizable action code or unresolvable additional data, such as the request client identifier, display device identifier, etc., the process ends; otherwise, the terminal device executes step 803 to perform an action code judgment.
[0111] 803. Determine whether the action code is turn off.
[0112] If the action code is turn off, the terminal device continues to execute the subsequent step 804; otherwise, the terminal device continues to execute the subsequent step 810.
[0113] 804. Determine whether the camera is turned off.
[0114] In the case where the action code is turn off, the terminal device continues to judge the current operating state of the camera; if the camera is in the off state, it executes step 809 and the process ends. Otherwise, the terminal device then executes step 805.
[0115] 805. Turn off the camera.
[0116] In the case where the camera is not turned off, the terminal device controls the camera to turn off.
[0117] 806. Determine whether the turn off is abnormal.
[0118] If an abnormality occurs when the camera is turned off, step 808 is executed, that is, the terminal device records and reports the abnormality, and the process ends; otherwise, the terminal device executes step 807, that is, the terminal device sends a transmission interruption request to the corresponding display device module through the MCU according to the display device identifier parsed from the data frame, such as HUD, instrument panel, center control screen, etc., and the process ends.
[0119] 807. Send a transmission interruption signal to the display module.
[0120] The terminal device sends a transmission interruption request to the corresponding display device module through the MCU according to the display device identifier parsed from the data frame, such as HUD, instrument panel, center control screen, etc., and the process ends.
[0121] 808. Record and report the abnormality.
[0122] In the case where an abnormality occurs when the camera is turned off, the terminal device records and reports the abnormality, and the process ends.
[0123] 809. Execute the redundant instruction processing flow.
[0124] In the case where the action code is turn off and the camera has been turned off, the terminal device executes the redundant instruction processing flow, and the process ends.
[0125] 810. Determine whether the action code is turn on.
[0126] In the case where the action code is not turn off, step 811 is executed, that is, the terminal device determines whether the action code is turn on; otherwise, step 815 is executed, that is, the terminal device executes the default instruction flow.
[0127] 811. Determine whether the camera is turned on.
[0128] In the case where the action code is turn on, the terminal device determines whether the camera is in the on state. In the case where the camera is turned off, the terminal device executes step 812, that is, turns on the camera; otherwise, the terminal device executes step 809, that is, executes the redundant instruction processing flow, and the process ends.
[0129] 812. Turn on the camera.
[0130] In the case where the action code is turn on and the camera is turned off, the terminal device controls the camera to turn on.
[0131] 813. Determine whether an abnormality occurs during turning on.
[0132] If an abnormality occurs when the camera is turned on, the terminal device executes step 808, that is, the terminal device records and reports the abnormality, and the process ends; otherwise, the terminal device executes step 814, that is, the terminal device sends a connection request to the corresponding display device module through the MCU according to the display device identifier parsed from the data frame, such as HUD, instrument panel, center control screen, etc., and the process ends.
[0133] 814. Send a connection signal to the display module.
[0134] The terminal device sends a connection request to the corresponding display device module through the MCU according to the display device identifier parsed from the data frame, such as HUD, instrument panel, center control screen, etc., and the process ends.
[0135] 815. Execute the default instruction process.
[0136] When the action code is neither turn on nor turn off, for example, the action code may be to change the viewing angle of the camera, the terminal device controls the camera to execute the instruction process corresponding to the action code.
[0137] It can be understood that the complete steps sequentially executed by the terminal device from the start to the end of the work process may specifically include the following 7 situations, that is: step 801, step 802, step 803, step 804, step 805, step 806, and step 807, and the process ends; or step 801, step 802, step 803, step 804, step 805, step 806, and step 808, and the process ends; or step 801, step 802, step 803, step 804, step 809, and the process ends; or step 801, step 802, step 803, step 810, step 811, step 812, step 813, and step 808, and the process ends; or step 801, step 802, step 803, step 810, step 811, step 812, step 813, and step 814, and the process ends; or step 801, step 802, step 803, step 810, step 811, and step 809, and the process ends; or step 801, step 802, step 803, step 810, and step 815, and the process ends.
[0138] To further illustrate the specific data and operations received by the camera in the foregoing description, this embodiment provides a method flowchart for adjusting the viewing angle of the camera. The method can be applied to a road information acquisition system, such as Figure 9As shown, the road information acquisition system may include a camera control system 90, a driver 91, and a hardware controller 92. Optionally, the control system 90, the driver 91, and the hardware controller 92 may be integrated on the same electronic device, which may be the terminal device described above. The process includes the following steps:
[0139] 901: The camera control system 90 acquires instruction data.
[0140] Specifically, the instruction data includes two parameters, namely the azimuth and rotation angle of the camera rotation. The camera control system 90 receives the instruction data and starts to verify the instruction data.
[0141] In addition, the instruction data may also include an identifier for the opening action, an identifier for the ramp system request, an identifier for the display device, and so on. The identifier for the opening action is used to indicate that the system turns on the camera. The identifier for the ramp system request is used to specify the object that calls the system. The identifier for the display device is used to indicate on which display device the captured image will be displayed.
[0142] 902: The camera control system 90 verifies the instruction data.
[0143] The camera control system 90 verifies the instruction data. As Figure 10 shown, an x-y axis coordinate system can be established with the center point of the camera as the coordinate origin to determine the four basic azimuths where the camera can rotate: up (Top: 0x1), right (Right: 0x10), down (Bottom: 0x100), left (Left: 0x1000). The four azimuths are identified by hexadecimal constants. The azimuth of the camera rotation can be synthesized by azimuth parameters, such as the upper right. Note that the azimuth parameters only support the synthesis of adjacent directions and do not support the synthesis of non-adjacent directions. For example, up and down cannot be synthesized. The rotation angle is the angle at which the camera needs to tilt in the corresponding direction and is identified using international angle units. Therefore, the currently supported direction parameters can be listed by enumeration, namely up, down, left, right, upper right, lower right, upper left, lower left, and the initial azimuth (0x0). If the direction parameter is not these data, it is considered that the parameter is illegal, the verification fails, and the process ends. The valid range of the angle is [0, preset value A], and the preset value A is provided by the camera supplier, that is, the maximum angle at which the camera can rotate in a specific direction. If the preset value A is 60°, then when the angle parameter exceeds 60° or is less than 0°, it is considered that the parameter is illegal, the verification fails, and the process ends. Note that when the incoming parameter direction is 0 and the angle is 0°, the camera returns to the initial position. Otherwise, the instruction data verification passes.
[0144] 903: When the instruction data verification passes, send a control instruction to the driver 91.
[0145] When the instruction data verification passes, the camera control system 90 sends a control instruction to the camera software driver through the MCU, and the control instruction includes the orientation and rotation angle of the camera rotation.
[0146] 904: The driver 91 converts the control instruction into an electrical signal.
[0147] After the camera software driver receives the control request, it immediately starts to parse parameters such as the orientation and rotation angle of the camera rotation, and converts the parameters into electrical signals recognizable by the camera hardware controller according to the hardware protocol.
[0148] 905: The driver 91 sends the electrical signal to the hardware controller 92.
[0149] 906: The hardware controller 92 controls the rotating shaft to start working.
[0150] After receiving the electrical signal sent by the driver 91, the hardware controller 92 starts to control the rotating shaft to work according to the electrical signal, so as to adjust the viewing angle of the camera.
[0151] 907: In case of an abnormality, the hardware controller 92 sends a fault code to the driver 91.
[0152] After the hardware controller 92 fails to control the rotating shaft to work to adjust the viewing angle of the camera, the hardware controller 92 can send a fault code to the driver 91.
[0153] 908: The driver 91 records and feeds back the abnormal information to the upper layer.
[0154] The driver 91 receives the fault code sent by the hardware controller 92, records the fault and feeds back the abnormal information to the upper layer, and the process ends.
[0155] The following introduces the structural schematic diagram of a road information acquisition device provided by an embodiment of the present application. Please refer to Figure 11 . Figure 11 The road information acquisition device in Figure 4 or Figure 5 can execute the process of the road information acquisition method in Figure 11As shown in the figure, the device may include: a slope sensor 1101, a camera 1102, a processor 1103, a display 1104, and a memory 1105. The slope sensor 1101 is used to detect the slope value of the road surface on which the vehicle travels; the camera 1102 is used to capture the road condition information in front of the vehicle; the memory 1105 is used to store the slope value detected by the slope sensor 1101 and the corresponding timestamp when the slope value is detected; the processor 1103 is used to determine the viewing angle of the camera according to the slope value and the timestamp corresponding to the slope value, and control the camera 1102 to adjust to the viewing angle; the display 1104 is used to output the road condition information captured by the camera 1102.
[0156] It should be understood that the division of each element of the above road information acquisition device is only a logical function division. In actual implementation, it can be fully or partially integrated into a physical entity, or physically separated. For example, the above elements can be separately established processing elements, or integrated and implemented in the same chip. In addition, it can also be stored in the storage element of the controller in the form of program code, and the functions of the above elements are called and executed by a certain processing element of the processor. In addition, each element can be integrated together or independently implemented. Here, the processing element can be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the method or the above elements can be completed by the integrated logic circuit in the processor element or the instructions in software form. The processing element can be a general-purpose processor, such as a CPU, or can also be one or more integrated circuits configured to implement the above method, such as: one or more ASICs (application-specific integrated circuit, specific integrated circuit), or, one or more DSPs (digital signal processor, microprocessor), or, one or more FPGAs (field-programmable gate array, field programmable gate array), etc.
[0157] Figure 12 It is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As Figure 12 shown, the electronic device 120 includes a processor 1201, a memory 1202, a communication interface 1203, and a display; the processor 1201, the memory 1202, the communication interface 1203, and the display 1204 are interconnected through a bus. The electronic device can be the road information acquisition device described above.
[0158] The memory 1202 includes, but is not limited to, RAM (random access memory), ROM (read-only memory), EPROM (erasable programmable read only memory), or CDROM (compact disc read-only memory), and the memory 1202 is used for relevant instructions and data. The communication interface 1203 is used for receiving and sending data.
[0159] The processor 1201 can be one or more CPUs (central processing unit). When the processor 1201 is a single CPU, the CPU can be a single-core CPU or a multi-core CPU. The steps performed by the road information acquisition device in the above embodiments can be based on the Figure 12 structure of the electronic device shown. Specifically, the processor 1201 can implement Figure 11 the functions of the processor 1103 in
[0160] The display 1204 can be a screen with a display function such as an instrument screen, a center control screen, and a HUD in a vehicle. Specifically, the display 1204 can implement Figure 11 the functions of the display 1104 in
[0161] The processor 1201 in the electronic device 120 is used to read the program code stored in the memory 1202 and execute the road information acquisition method in the foregoing embodiments.
[0162] In an embodiment of the present application, another computer-readable storage medium is provided. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it realizes: data, the first slope data includes a first slope value, the second slope data includes a second slope value, the first slope value is the slope value of the road surface on which the vehicle travels at a first moment, and the second slope value is the slope value of the road surface on which the vehicle travels at a second moment; adjusting the viewing angle of the camera according to the difference between the first slope data and the second slope data; and presenting the road information captured by the camera to the user.
[0163] An embodiment of the present application also provides a computer program product containing instructions. When it runs on a computer, it causes the computer to execute the road information acquisition method provided in the foregoing embodiments.
[0164] Those skilled in the art should understand that the embodiments of the present invention can be provided as a method, apparatus, or computer program product. Therefore, the present invention can take the form of a complete hardware embodiment, a complete software embodiment, or an embodiment combining software and hardware aspects. Moreover, the present invention can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk memory, CD-ROM, optical memory, etc.) that contain computer-usable program code.
[0165] The present invention is described with reference to the flowcharts and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the present invention. It should be understood that each flow and / or block in the flowchart and / or block diagram, and the combination of flows and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing devices produce a means for implementing the functions specified in Figure 1 one or more of the flows Figure 1 or blocks or the combination of blocks.
[0166] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing device to work in a specific manner, such that the instructions stored in the computer-readable memory produce a manufactured article including an instruction means that implements the functions specified in Figure 1 one or more of the flows Figure 1 or blocks or the combination of blocks.
[0167] These computer program instructions can also be loaded onto a computer or other programmable data processing device, such that a series of operation steps are performed on the computer or other programmable device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in Figure 1 one or more of the flows Figure 1 or blocks or the combination of blocks.
[0168] As described above, the above are only specific embodiments of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed in the present application can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.
Claims
1. A method for obtaining road information, characterized in that, It includes the following steps: Obtain first slope data and second slope data. The first slope data includes a first slope value, and the second slope data includes a second slope value. The first slope value is the slope value of the road surface on which the vehicle travels at a first moment, and the second slope value is the slope value of the road surface on which the vehicle travels at a second moment. The first slope data further includes a first timestamp, and the second slope data further includes a second timestamp. The first timestamp is the timestamp corresponding to the first moment, and the second timestamp is the timestamp corresponding to the second moment; When the difference between the first slope value and the second slope value is greater than a first threshold, and the interval between the first timestamp and the second timestamp is greater than a second threshold, adjust the viewing angle of the camera from a first angle to a second angle. The first angle is the viewing angle of the camera at the first moment, and the second angle is the field of view angle corresponding to the visual blind area in front of the vehicle at the second moment; When the difference between the first slope value and the second slope value is less than or equal to the first threshold, or the interval between the first timestamp and the second timestamp is less than or equal to the second threshold, re-detect the change of the slope data; Display the road information captured by the camera to the user.
2. The method according to claim 1, wherein the difference between the first slope value and the second slope value is equal to the difference between a first angle value and a second angle value.
3. The method according to claim 1 or 2, before obtaining the first slope data and the second slope data, the method further includes: Detect third slope data at a third moment; The third slope data includes a third slope value, and the third slope value is the slope value of the road surface on which the vehicle travels at the third moment, and the third moment is earlier than the first moment; When the third slope value is greater than a third threshold, turn on the camera and display the road information captured by the camera to the user.
4. The method according to claim 3, the method includes: Detect fourth slope data at a fourth moment; The fourth slope data includes a fourth slope value, and the fourth slope value is the slope value of the road surface on which the vehicle travels at the fourth moment, and the fourth moment is later than the second moment; When the fourth slope value is less than or equal to the third threshold, turn off the camera.
5. A road information acquisition device, characterized in that, It includes a slope sensor, a camera, a processor, a display, and a memory, The slope sensor is used to obtain first slope data and second slope data. The first slope data includes a first slope value, and the second slope data includes a second slope value. The first slope value is the slope value of the road surface on which the vehicle travels at a first moment, and the second slope value is the slope value of the road surface on which the vehicle travels at a second moment. The first slope data further includes a first timestamp, and the second slope data further includes a second timestamp. The first timestamp is the timestamp corresponding to the first moment, and the second timestamp is the timestamp corresponding to the second moment; The camera is used to capture the road condition information in front of the vehicle; The memory is used to store the slope value detected by the slope sensor and the corresponding timestamp when the slope value is detected; The processor is configured to adjust the viewing angle of the camera from a first angle to a second angle when the difference between the first slope value and the second slope value is greater than a first threshold and the interval between the first timestamp and the second timestamp is greater than a second threshold. The first angle is the viewing angle of the camera at the first moment, and the second angle is the field of view angle corresponding to the visual blind area in front of the vehicle at the second moment; And is configured to control the slope sensor to re-detect the change of slope data when the difference between the first slope value and the second slope value is less than or equal to the first threshold, or the interval between the first timestamp and the second timestamp is less than or equal to the second threshold; The display is used to output the road condition information captured by the camera.
6. An electronic device, characterized in that, Comprising: A memory for storing a program; A processor for executing the program stored in the memory. When the program is executed, the processor is used to execute the method according to any one of claims 1 to 4.
7. A computer-readable storage medium, characterized in that, A computer program is stored in the computer-readable storage medium. When the computer program runs on one or more processors, it executes the method according to any one of claims 1 to 4.
Citation Information
Patent Citations
Multi-purpose shaver
CN102975218A
Slope driving auxiliary monitoring method, device, medium, control terminal, and automobile
CN110450718A