Environmental information detection methods, devices, storage media, and vehicles

Abstract

This application discloses an environmental information detection method, device, storage medium, and vehicle. In response to a fault signal from an electronic exterior rearview mirror system, the method determines the fault source of the fault signal; determines the corresponding parking detection device and displayable screen based on the fault source; receives the side and rear environmental information collected by the parking detection device; and displays the corresponding display content on the displayable screen. Since the parking detection device installed on the vehicle body can detect objects and their distances in the side and rear environment of the vehicle, when a fault signal from the electronic exterior rearview mirror system occurs, the required parking detection device can be determined based on the fault source to detect the environmental information in the side and rear of the vehicle. Thus, based on the side and rear environmental information collected by the parking detection device and the corresponding display content, the user can be shown the side and rear environmental information, improving the reliability and safety of the vehicle's rearview system.

Description

Technical Field

[0001] This application relates to the field of vehicle technology, and in particular to an environmental information detection method, device, storage medium, and vehicle. Background Technology

[0002] With the development of industrial technology in the automotive industry, vehicle functionality is gradually trending towards intelligent services. While exterior rearview mirrors provide drivers with information about people, vehicles, and roads behind and to the sides of the vehicle, electronic exterior rearview mirror systems are increasingly replacing traditional ones. These systems use onboard cameras to collect information about the environment behind the vehicle and display it on a connected electronic screen. However, when these systems malfunction, drivers cannot clearly see what's behind them. Therefore, an environmental information detection method is needed to accurately detect the environment behind the vehicle, ensuring driver safety. Summary of the Invention

[0003] This application provides an environmental information detection method, device, storage medium, and vehicle, which can solve the technical problem in the related art that the vehicle condition and environmental information cannot be obtained after the electronic rearview mirror malfunctions, causing driving safety hazards.

[0004] In a first aspect, embodiments of this application provide an environmental information detection method, the method comprising:

[0005] In response to a fault signal from the electronic exterior rearview mirror system, determine the fault source of the fault signal from the electronic exterior rearview mirror system;

[0006] Based on the source of the fault, determine the corresponding parking detection equipment and the display screen;

[0007] The system receives the side and rear environmental information collected by the parking detection device and displays the corresponding content on the displayable screen.

[0008] Secondly, embodiments of this application provide an environmental information detection device, the device comprising:

[0009] The fault determination module is used to determine the fault source of the electronic exterior rearview mirror system fault signal in response to the fault signal of the electronic exterior rearview mirror system.

[0010] The device activation module is used to determine the corresponding parking detection device and display screen based on the fault source;

[0011] The environmental detection module is used to receive the side and rear environmental information collected by the parking detection device, and to display the corresponding display content of the side and rear environmental information on the displayable screen.

[0012] Thirdly, embodiments of this application provide a computer storage medium storing a plurality of instructions adapted for loading by a processor and executing the steps of the method described above.

[0013] Fourthly, embodiments of this application provide a vehicle including a memory, a processor, and a computer program stored in the memory and executable on the processor, the computer program being adapted to be loaded by the processor and to execute the steps of the method described above.

[0014] The beneficial effects of the technical solutions provided in some embodiments of this application include at least the following:

[0015] This application provides an environmental information detection method. In response to a fault signal from an electronic rearview mirror system, the method determines the fault source of the fault signal; based on the fault source, it determines the corresponding parking detection device and a displayable screen; it receives the rear-side environmental information collected by the parking detection device and displays the corresponding content on the displayable screen. Since the parking detection device installed on the vehicle body can detect objects and their distances in the rear-side environment, when a fault signal from the electronic rearview mirror system occurs, the method can determine the parking detection device to be used based on the fault source to detect the rear-side environmental information. Based on the rear-side environmental information collected by the parking detection device, the corresponding content is further displayed on an available display screen. This allows for accurate rear-side environmental information to be shown to the user in rearview mirror failure scenarios, effectively assisting the user in safe vehicle control, improving the reliability and safety of the vehicle's rearview system, and ensuring user driving safety. Attached Figure Description

[0016] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 An exemplary system architecture diagram of an environmental information detection method provided in this application embodiment;

[0018] Figure 2 A flowchart illustrating an environmental information detection method provided in this application embodiment;

[0019] Figure 3 This is a schematic diagram of a control method for an electronic exterior rearview mirror provided in an embodiment of this application;

[0020] Figure 4A flowchart illustrating an environmental information detection method provided in this application embodiment;

[0021] Figure 5 This is a schematic diagram of the detection area of ​​an ultrasonic detection device provided in an embodiment of this application;

[0022] Figure 6 A logical schematic diagram of an environmental information detection method provided in an embodiment of this application;

[0023] Figure 7 A structural block diagram of an environmental information detection device provided in an embodiment of this application;

[0024] Figure 8 This is a schematic diagram of the structure of a terminal provided in an embodiment of this application. Detailed Implementation

[0025] To make the features and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0026] In the following description, when referring to the accompanying drawings, the same numbers in different drawings denote the same or similar elements unless otherwise indicated. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0027] With the integration and advancement of automotive R&D technology and artificial intelligence technology, intelligent vehicle services are becoming an increasingly important highlight and selling point for vehicles in diverse scenarios. Among these, electronic exterior rearview mirror systems are one of the key directions of intelligent vehicle services.

[0028] Traditional optical rearview mirrors, including interior and exterior mirrors, have a history of over a century. They provide drivers with information about pedestrians, vehicles, and roads behind and to the sides of the vehicle, and their importance to driving safety is widely recognized. However, traditional exterior mirrors have some drawbacks. First, they increase wind resistance. The higher the drag coefficient, the greater the wind resistance the vehicle has to overcome, resulting in higher fuel consumption. Currently, most vehicles have a drag coefficient of around 0.2 to 0.4, while exterior mirrors contribute 0.01 to 0.03 to the drag coefficient, a significant factor that can affect the vehicle's range. Second, the accuracy of the image reflected in traditional rearview mirrors is affected by actual conditions. For example, in heavy rain or darkness, the image reflected in the mirror often becomes blurry and unclear, severely impacting the user's observation and creating safety hazards for vehicle control and driving. Third, traditional rearview mirrors often have blind spots. Due to the size of the mirror and the adjustable angle, the information they can provide is relatively limited. In addition, passengers in other seats may also obstruct the driver's view, resulting in a lack of information reception and thus affecting driving safety.

[0029] Building upon this foundation, during the development of intelligent vehicle functions and services, an Electronic Rearview Mirror System (CMS) was developed. This system is a combination of a camera and a display, enhancing the driver's visual perception of the vehicle's surroundings and rear sides, further improving driving safety and comfort. Specifically, it uses an external camera to capture environmental images of the vehicle's surroundings and rear sides, processes the data, and displays the images on a screen inside the vehicle's cabin. It also integrates blind spot warning and obstacle detection functions. The electronic rearview mirror boasts advantages such as small size, retractability, low wind resistance, clear image quality, and a more technologically advanced feel. It allows drivers to perceive all-around road conditions without significantly altering their viewing angle, gradually replacing traditional rearview mirror systems in vehicles. Compared to traditional optical rearview mirrors, it offers advantages such as reduced vehicle weight, reduced drag and noise, and resolution of blind spot issues.

[0030] Because vehicles using electronic rearview systems are susceptible to malfunction, and given the significant impact of these systems on user safety, a malfunction in the rearview mirrors can cause users to lose awareness of the environment to the rear corners and sides of the vehicle, posing a significant threat to driving and vehicle control safety.

[0031] Therefore, this application provides an environmental information detection method that, in response to a fault signal from an electronic rearview mirror system, determines the fault source of the electronic rearview mirror system fault signal; determines the corresponding parking detection device and displayable screen based on the fault source; receives the side and rear environmental information collected by the parking detection device, and displays the corresponding display content on the displayable screen, so as to solve the technical problem that the vehicle condition and environmental information cannot be obtained after the electronic rearview mirror malfunctions, causing driving safety hazards.

[0032] Please see Figure 1 , Figure 1 This is an exemplary system architecture diagram of an environmental information detection method provided in an embodiment of this application.

[0033] like Figure 1 As shown, the system architecture may include vehicle 101, network 102, and server 103. Network 102 serves as the medium for providing a communication link between vehicle 101 and server 103. Network 102 may include various types of wired or wireless communication links, such as: wired communication links including fiber optic, twisted-pair, or coaxial cable; and wireless communication links including Bluetooth, Wireless-Fidelity (Wi-Fi), or microwave communication links, etc.

[0034] Vehicle 101 can interact with server 103 via network 102 to receive or send messages to server 103, or vehicle 101 can interact with server 103 via network 102 to receive messages or data sent to server 103 by other users. Vehicle 101 can be hardware or software. When vehicle 101 is hardware, it can be various electronic devices, including but not limited to smartwatches, smartphones, tablets, laptops, and desktop computers. When vehicle 101 is software, it can be installed in the aforementioned electronic devices, and can be implemented as multiple software programs or software modules (e.g., to provide distributed services) or as a single software program or software module; no specific limitation is made here.

[0035] In this embodiment, vehicle 101 responds to a fault signal from the electronic exterior rearview mirror system and determines the fault source of the fault signal. Further, vehicle 101 determines the corresponding parking detection device and displayable screen based on the fault source. At this time, vehicle 101 can receive the side and rear environmental information collected by the parking detection device and display the corresponding display content on the displayable screen.

[0036] Server 103 can be a business server providing various services. It should be noted that server 103 can be either hardware or software. When server 103 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or as a single server. When server 103 is software, it can be implemented as multiple software programs or software modules (e.g., used to provide distributed services), or as a single software program or software module; no specific limitations are made here.

[0037] Alternatively, the system architecture may not include server 103. In other words, server 103 may be an optional device in the embodiments of this specification. That is, the method provided in the embodiments of this specification can be applied to a system structure that only includes vehicle 101. The embodiments of this application do not limit this.

[0038] It should be understood that Figure 1 The number of vehicles, networks, and servers shown is only illustrative; the number can be any number depending on the implementation requirements.

[0039] Please see Figure 2 , Figure 2 This is a flowchart illustrating an environmental information detection method provided in an embodiment of this application. The executing entity in this embodiment can be a vehicle performing environmental information detection, a processor within the vehicle performing the environmental information detection method, or an environmental information detection service within the vehicle performing the environmental information detection method. For ease of description, the following example uses the electronic exterior rearview controller in the vehicle's electronic exterior rearview mirror system as the processor to illustrate the specific execution process of the environmental information detection method.

[0040] like Figure 2 As shown, environmental information detection methods can include at least:

[0041] S202. In response to the fault signal of the electronic exterior rearview mirror system, determine the fault source of the fault signal of the electronic exterior rearview mirror system.

[0042] Optionally, drivers need to use interior and exterior rearview mirrors to observe road and vehicle conditions to the sides and rear of the vehicle during driving, facilitating vehicle control. Therefore, exterior rearview mirrors are closely related to driving safety. In modern intelligent vehicles, electronic exterior rearview mirrors are an important component. They use high-quality cameras to capture environmental images, process these images digitally, and display them on a built-in electronic rearview display screen, providing users with a clear and accurate view of the rear environment. However, when electronic exterior rearview mirrors malfunction, users cannot see the side and rear environment of the vehicle, posing a significant safety hazard.

[0043] Optionally, to provide more accurate information about the surrounding environment to guide users when parking or reversing, vehicles are typically equipped with detection sensors capable of detecting obstacles and moving objects within a certain range around the vehicle. Therefore, to help users understand the rear view environment even when the electronic side mirrors malfunction, the vehicle's existing detection sensors can be used to detect the surrounding environment, replacing the currently missing rear view information and ensuring user safety while driving.

[0044] Specifically, parking detection devices, as pre-installed parking sensors in vehicles, are commonly installed on the left, right, left rear corner, and right rear corner to provide comprehensive environmental monitoring of the vehicle's surroundings. This ensures that users can accurately understand the environment around the vehicle when parallel parking or reversing into a parking space. When multiple parking detection devices are present in a vehicle, and the electronic exterior rearview mirror malfunctions, depending on the specific circumstances of the malfunction, one or more of the parking detection devices may be required. That is, when the electronic exterior rearview mirror malfunctions, the system first needs to respond to the fault signal emitted by the faulty component to perform a simple analysis and judgment of the rearview malfunction information, identifying the corresponding parking detection device. Furthermore, to provide environmental information to the user, a suitable display screen for displaying the environmental information collected by the rear corner detection device also needs to be identified. This process allows for the selection of effective parking detection devices and display screens from all available parking detection devices to address the lack of information about the vehicle's rear and side environment.

[0045] Further, please refer to Figure 3 , Figure 3 This is a schematic diagram illustrating a control method for an electronic exterior rearview mirror provided in an embodiment of this application. Figure 3 As shown, an electronic exterior rearview mirror system typically includes three components: an electronic exterior rearview camera, an electronic exterior rearview display screen, and an electronic exterior rearview controller. There is one electronic exterior rearview camera and one electronic exterior rearview display screen on each side. Common electronic exterior rearview mirror systems have two control schemes; for the first one, please refer to [link to relevant documentation]. Figure 3 (A) Two electronic exterior rearview cameras are connected to the same electronic exterior rearview controller via a coaxial cable, such as an LVDS harness. One electronic exterior rearview controller drives the left and right electronic exterior rearview displays to show images. For the second method, please refer to [link / reference]. Figure 3 (B) Two electronic rearview cameras are connected to two electronic rearview controllers via coaxial cables, such as LVDS harnesses. The two electronic rearview controllers drive the left and right electronic rearview displays to display images.

[0046] Optionally, the source of the fault is generally the electronic exterior rearview camera or the electronic exterior rearview display screen. Therefore, the fault source of the electronic exterior rearview mirror system fault signal is either a fault in the electronic exterior rearview camera or a fault in the electronic exterior rearview display screen. It should be noted that when the fault source is a fault in the electronic exterior rearview camera or the electronic exterior rearview display screen, the electronic exterior rearview controller responds to the electronic exterior rearview mirror system fault signal and executes subsequent steps. However, in practical applications, there may also be a situation where the electronic exterior rearview controller fails. If the electronic exterior rearview controller fails, other controllers in the vehicle, such as the vehicle controller, will directly control the vehicle based on the detection results of the rear corner detection device to ensure the user's driving safety.

[0047] Since the electronic exterior rearview mirror system consists of multiple components, different components will have different fault sources when they malfunction. It is easy to understand that different parking detection devices may be needed for different fault sources. For example, if the electronic exterior rearview camera malfunctions, other cameras may be needed to acquire images; if the electronic exterior rearview display screen malfunctions, other displays may be needed to display rearview information. This means that when selecting the parking detection device and display screen corresponding to the fault signal of the electronic exterior rearview mirror system, it is necessary to determine the fault source of the fault signal. Therefore, after responding to the fault signal of the electronic exterior rearview mirror system, the fault source of the fault signal can be determined first, which will facilitate the subsequent determination of the parking detection device and display screen.

[0048] S204. Determine the corresponding parking detection equipment and display screen based on the fault source.

[0049] Optionally, after determining the fault source of the electronic exterior rearview mirror system fault signal, the corresponding parking detection device and display screen can be further determined based on the fault source. This ensures that the effective parking detection device and display screen can provide the user with the side and rear environment information according to the function of each parking detection device.

[0050] S206. Receive the side and rear environmental information collected by the parking detection device, and display the corresponding display content on the displayable screen.

[0051] Optionally, the parking detection device can detect the rear-side environmental information in the surrounding environment of the vehicle. After collecting the rear-side environmental information, the parking detection device will transmit the rear-side environmental information to the controller. The controller receives the rear-side environmental information and performs information analysis and preprocessing to determine the corresponding display content. For example, if there is a moving object, the corresponding pattern or animation of the moving object will be displayed. If there is a fixed obstacle, the corresponding icon and warning reminder will be displayed. In other words, after receiving the rear-side environmental information, the corresponding display content can be displayed on the display screen so that the user can know the current vehicle status through the display screen, which is convenient for the user to control the vehicle and drive.

[0052] This application provides an environmental information detection method. In response to a fault signal from an electronic rearview mirror system, the method determines the fault source of the fault signal; determines the corresponding parking detection device and a displayable screen based on the fault source; receives the rear-side environmental information collected by the parking detection device; and displays the corresponding display content on the displayable screen. Since the parking detection device installed on the vehicle body can detect objects and their distances in the rear-side environment, when a fault signal from the electronic rearview mirror system occurs, the method can determine the parking detection device to be used based on the fault source to detect the rear-side environmental information. Based on the rear-side environmental information collected by the parking detection device, the corresponding display content is further displayed on an available display screen. This allows for accurate rear-side environmental information to be shown to the user in rearview mirror failure scenarios, effectively assisting the user in safe vehicle control, improving the reliability and safety of the vehicle's rearview system, and ensuring user driving safety.

[0053] Please see Figure 4 , Figure 4 This is a flowchart illustrating an environmental information detection method provided in an embodiment of this application.

[0054] like Figure 4 As shown, environmental information detection methods can include at least:

[0055] S402. In response to the fault signal of the electronic exterior rearview mirror system, determine the fault location corresponding to the fault signal of the electronic exterior rearview mirror system and the fault source of the fault signal of the electronic exterior rearview mirror system.

[0056] For details regarding step S402, please refer to the description in step S202; it will not be repeated here.

[0057] S404. Determine the fault location corresponding to the fault signal of the electronic exterior rearview mirror system based on the fault source.

[0058] Optionally, the lack of rear-view environmental information is also related to the location of the faulty exterior rearview mirror. When a fault signal appears in the electronic exterior rearview mirror system, it indicates that the system is malfunctioning. This malfunction results in a missing view of the rearview image, and the location of this missing view is the corresponding fault location of the electronic exterior rearview mirror system. For example, if the fault signal indicates a malfunction in the left-side electronic exterior rearview camera, then the left side of the vehicle is the fault location where the rearview image is missing. If the fault signal indicates a malfunction in the electronic exterior rearview controller, then both the left and right sides of the vehicle are fault locations where the rearview image is missing. This means that determining the parking detection equipment and display screen corresponding to the electronic exterior rearview mirror system fault signal also requires identifying the fault location. Therefore, the fault location can be determined first based on the fault source, facilitating the subsequent identification of the parking detection equipment and display screen.

[0059] S406. Determine the corresponding parking detection device based on the fault location and fault source, and determine the display screen based on the fault location.

[0060] Optionally, after determining the fault source and location, the corresponding parking detection equipment and the display screen are further determined based on the fault location and fault source. The fault source is generally the electronic exterior rearview camera or electronic exterior rearview display screen; therefore, the fault source of the electronic exterior rearview mirror system fault signal is either a fault in the electronic exterior rearview camera or a fault in the electronic exterior rearview display screen. It should be noted that when the fault source is a fault in the electronic exterior rearview camera or electronic exterior rearview display screen, the electronic exterior rearview controller responds to the electronic exterior rearview mirror system fault signal and executes subsequent steps. However, in practical applications, there may also be a situation where the electronic exterior rearview controller malfunctions. If the electronic exterior rearview controller malfunctions, other controllers in the vehicle, such as the vehicle controller, directly control the vehicle based on the detection results of the rear corner detection equipment to ensure user driving safety.

[0061] Furthermore, when selecting a target parking detection device from multiple preset parking detection devices based on the fault source and fault location, one can first determine the first target parking detection device corresponding to the fault source from the preset parking detection devices, and then further determine the second target parking detection device corresponding to the fault location from the first target parking detection devices. Alternatively, one can determine the device location of the first target parking detection device corresponding to the fault location from the preset parking detection devices, and then determine the second target parking detection device corresponding to the fault source from the first target parking detection devices based on the fault source. This application embodiment does not limit the order of determining the type and location of the parking detection devices.

[0062] Optionally, when determining the first target parking detection device corresponding to the fault source from the preset parking detection devices based on the fault source, specifically if the fault source is a fault in the electronic exterior rearview camera, then the preferred first parking detection device is a camera device with image acquisition function. Considering that there are surround view cameras in the preset parking detection devices that can acquire images and videos, and that surround view cameras are cameras installed close to the electronic exterior rearview camera with a viewing angle that tends to illuminate the ground, they are usually used in the parking detection module to acquire ground images and videos on both sides and behind the vehicle to assist users in reversing, parking and other vehicle control behaviors, then based on this, the surround view camera device can be determined as the first parking detection device corresponding to the fault source.

[0063] Furthermore, if the fault originates from the electronic exterior rearview camera, it's also necessary to consider that the surround-view cameras are installed on both sides of the vehicle. Therefore, to obtain a clearer picture of the environment behind the vehicle, ultrasonic detection equipment can also be considered as a primary parking detection device. Ultrasonic detection equipment, specifically ultrasonic radar, detects the presence and distance of objects in the environment by emitting ultrasonic waves and receiving reflected waves. Ultrasonic detection probes are typically installed on both sides of the front and rear bumpers of the vehicle for comprehensive detection of the surrounding environment. Please refer to [link / reference] for details. Figure 5 , Figure 5 This is a schematic diagram of the detection area of ​​an ultrasonic detection device provided in an embodiment of this application, as shown below. Figure 5 As shown, taking one side of the vehicle as an example, the shaded area represents the detection scanning area of ​​the front and rear corner probes. It should be noted that 3-4m is only illustrative. The specific ultrasonic detection device probes can be parking probes (with a longer detection distance of about 5 meters) and / or collision avoidance probes (with a shorter detection distance of about 3.5 meters). This application does not limit the specific type of ultrasonic detection device probe.

[0064] Optionally, if the fault source is a fault in the electronic exterior rearview display screen, it means that even if there is an image, it cannot be displayed normally. In this case, the ultrasonic detection device can be identified as the first parking detection device corresponding to the fault source.

[0065] Optionally, after determining the first target parking detection device, it is necessary to determine the second target parking detection device and the display screen corresponding to the fault location from the first target parking detection device. As can be seen from the above embodiment, the fault signal of the electronic exterior rearview mirror system is emitted by the faulty component. Therefore, after responding to the fault signal of the electronic exterior rearview mirror system, the electronic exterior rearview controller determines the fault location where the rearview image is missing based on the fault source of the fault signal.

[0066] Optionally, when using parking detection equipment for auxiliary detection, what is needed is the rear-view environment information on the same side of the vehicle as the fault. That is, after determining the fault location corresponding to the fault signal of the electronic exterior rearview mirror system, at least one second parking detection equipment located on the same side of the fault location in the vehicle needs to be determined from the first target parking detection equipment as a detection equipment for detecting the side and rear environment information.

[0067] Optionally, when determining the displayable screen, considering that the in-vehicle display screens include the electronic exterior rearview displays on both sides and the central control display screen, and that the electronic exterior rearview displays are normally only used to display the rear view on the corresponding side, while the central control display screen is used to display the in-vehicle terminal interface, in order to reduce the impact of the faulty side on the display of other display screens, it can be first determined whether the electronic exterior rearview display on the same side corresponding to the fault location is operating normally. If the electronic exterior rearview display on the same side is operating normally, for example, if the fault source of the electronic exterior rearview mirror system fault signal is a fault in the electronic exterior rearview camera, it means that the electronic exterior rearview display and the electronic exterior rearview controller are intact at this time. That is, the electronic exterior rearview controller can normally receive signals and send them to the electronic exterior rearview display for display. At this time, it can be determined that the electronic exterior rearview display on the same side is a displayable screen.

[0068] Optionally, if the same-side electronic rearview display screen cannot operate normally, for example, if the fault source of the electronic rearview mirror system fault signal is a fault in the electronic rearview display screen, it means that the electronic rearview display screen cannot display normally at this time. Then it is necessary to further determine whether the non-same-side electronic rearview display screen corresponding to the fault location is operating normally, that is, to determine whether the non-same-side electronic rearview display screen corresponding to the fault location can be used as a display screen.

[0069] Optionally, if the non-same-side electronic rearview display screen is operating normally, it can be determined as a displayable screen. When using the non-same-side electronic rearview display screen to display the content corresponding to the rearward environmental information of the faulty side, a portion of the display area can be partitioned off from the non-same-side electronic rearview display screen to display the content of the faulty side without affecting the original display content on the non-same-side electronic rearview display screen. Alternatively, if the non-same-side electronic rearview display screen is not operating normally, it can be further determined whether the central control display screen is operating normally. If the central control display screen is operating normally, it can be directly used as a displayable screen, and a portion of the central control display screen can be partitioned off to display the content corresponding to the rearward environmental information.

[0070] Based on this, please refer to Figure 6 , Figure 6 This is a logical schematic diagram of an environmental information detection method provided in an embodiment of this application. Figure 6As shown, taking an electronic rearview mirror system that controls two electronic rearview cameras and two electronic rearview displays through one electronic rearview controller as an example, the electronic rearview controller in the electronic rearview mirror system sends the working status information of the electronic rearview mirror system to the parking controller of the parking detection module corresponding to the parking detection device. The working status information specifically includes the status information of the electronic rearview cameras, the status information of the electronic rearview controller, and the status information of the electronic rearview displays. When a fault signal of the electronic rearview mirror system occurs, the parking controller determines the parking detection device and the display screen that needs to be controlled through the fault signal of the electronic rearview mirror system in the working status information. If the parking detection device includes a surround view camera, the parking controller receives the surround view video data collected by the surround view camera. If the parking detection device includes an ultrasonic detection device, the parking controller identifies the environmental information collected by the ultrasonic detection device and sends the side and rear environmental information detected by each parking detection device to the electronic rearview controller, so that the electronic rearview controller controls the display screen to display the content corresponding to the side and rear environmental information.

[0071] S408. Determine whether there is a risk of lane change based on the vehicle control signal triggered by the vehicle control device, wherein the vehicle control device includes at least one of the following: steering lever, steering wheel, and headlight lever.

[0072] Optionally, since the electronic exterior rearview mirror system will lack some information about the vehicle's rear corner environment when it malfunctions, potentially jeopardizing the user's lane-changing safety, a reminder or warning needs to be issued if the user intends to change lanes when the rearview mirror system fails. This means that the presence of a lane-changing risk is first determined by a vehicle control signal triggered by the vehicle control device, which refers to the equipment used by the user to operate the vehicle, such as turn signal levers, steering wheel, and headlight levers.

[0073] S410. If there is a risk of lane change, display the lane change alarm content on the display screen and issue a lane change alarm prompt.

[0074] Optionally, when a user operates the vehicle control device, if a lane change risk is detected based on the vehicle control signal triggered by the device, a lane change alarm message is displayed on the screen, and a lane change alarm notification is issued. Specifically, the lane change alarm message may be an animation, pattern, etc., related to the lane change action, and the lane change alarm notification may be an alarm ringtone, voice broadcast, etc., which are not limited in this embodiment.

[0075] S412, Receive side and rear environment information collected by parking detection equipment, and determine the target objects in the side and rear environment and the distance between the target objects and the vehicle based on the side and rear environment information, and determine the display content based on the target objects and the distance.

[0076] Optionally, the side and rear environment information received by the parking detection device includes the presence of objects in the side and rear environment and the distance between the objects and the vehicle. Since a displayable device has been identified through the aforementioned steps, the display content can be further determined based on the objects and distance. The content can be animations, patterns, etc., corresponding to the type of object, allowing the user to more clearly know the objects behind the vehicle and predict their speed and direction, thus facilitating safer vehicle control. It should be noted that the parking detection device is the second parking detection device identified from the preset parking detection devices in the above steps.

[0077] S414. Display the content on the displayable screen.

[0078] Optionally, after determining the display content, the display content shows the information of the target object and the distance information of the target object through patterns, animations, prompt sound effects, etc. At this time, the corresponding display content is displayed on the displayable screen, so that the user can observe the side and rear environment information of the vehicle through the displayable screen, so that the user can know the current vehicle condition through the display screen, which is convenient for the user to control the vehicle and drive.

[0079] This application provides an environmental information detection method. First, based on the fault source, the required rear-side environmental information is determined. Then, different first parking detection devices are determined for different fault occurrences. Based on the relationship and operating status of multiple in-vehicle display screens with the fault location, and minimizing the impact on other normally displayed content, a normally operating display screen is selected as the displayable screen and a second parking detection device. Furthermore, when the user shows a tendency to change lanes, a timely warning is issued regarding the user's current lane-changing safety, protecting the user's safety and reliability during lane-changing driving. The displayed content for target objects includes the type of target object and its distance from the vehicle, allowing the user to more clearly know the objects behind the vehicle and predict their speed and direction, facilitating safer vehicle control. The method displays accurate rear-side environmental conditions, effectively assisting the user in safe vehicle control, improving the reliability and safety of the vehicle's rearview system, and ensuring user driving safety.

[0080] Please see Figure 7 , Figure 7 This is a structural block diagram of an environmental information detection device provided in an embodiment of this application. Figure 7 As shown, the environmental information detection device 700 includes:

[0081] The fault determination module 710 is used to determine the fault source of the electronic exterior rearview mirror system fault signal in response to the electronic exterior rearview mirror system fault signal.

[0082] The device activation module 720 is used to determine the corresponding parking detection device and display screen based on the fault source;

[0083] The environmental detection module 730 is used to receive the side and rear environmental information collected by the parking detection device and to display the corresponding display content on the displayable screen.

[0084] Optionally, the device activation module 720 is also used to determine the fault location corresponding to the fault signal of the electronic exterior rearview mirror system based on the fault source; determine the corresponding parking detection device based on the fault location and the fault source; and determine the displayable screen based on the fault location.

[0085] Optionally, the device activation module 720 is further configured to determine the first target parking detection device corresponding to the fault source from the preset parking detection devices; and to determine the second target parking detection device corresponding to the fault location from the first target parking detection devices.

[0086] Optionally, the fault source of the electronic exterior rearview mirror system fault signal includes at least one of electronic exterior rearview camera fault and electronic exterior rearview display screen fault. The device activation module 720 is further configured to determine the surround view camera device and the ultrasonic detection device as the first parking detection device corresponding to the fault source if the fault source is electronic exterior rearview camera fault; and to determine the ultrasonic detection device as the first parking detection device corresponding to the fault source if the fault source is electronic exterior rearview display screen fault or electronic exterior rearview controller fault.

[0087] Optionally, the device activation module 720 is also used to determine whether the same-side electronic rearview display screen corresponding to the fault location is operating normally. If the same-side electronic rearview display screen is operating normally, then the same-side electronic rearview display screen is determined to be a displayable screen. If the same-side electronic rearview display screen cannot operate normally, then it is determined whether the non-same-side electronic rearview display screen corresponding to the fault location is operating normally. If the non-same-side electronic rearview display screen is operating normally, then the non-same-side electronic rearview display screen is determined to be a displayable screen.

[0088] Optionally, the environmental detection module 730 is also used to determine the target objects in the rear environment and the distance between the target objects and the vehicle based on the rear environment information, determine the display content based on the target objects and the distance, and display the display content on the displayable screen.

[0089] Optionally, the environmental information detection device 700 further includes: a lane change perception module, used to determine whether there is a lane change risk based on the vehicle control signal triggered by the vehicle control device, the vehicle control device including at least one of a steering lever, a steering wheel, and a headlight lever; if there is a lane change risk, the module displays lane change warning content on the display screen and issues a lane change warning prompt.

[0090] This application provides an environmental information detection device, comprising: a fault determination module for responding to a fault signal from an electronic rearview mirror system, identifying the fault source of the electronic rearview mirror system fault signal; a device activation module for determining the corresponding parking detection device and a displayable screen based on the fault source; and an environmental detection module for receiving side and rear environmental information collected by the parking detection device and displaying the corresponding display content on the displayable screen. Since the parking detection device installed on the vehicle body can detect objects and their distances in the surrounding environment to the side and rear of the vehicle, when a fault signal from the electronic rearview mirror system occurs, the required parking detection device can be determined based on the fault source to detect the environmental information to the side and rear of the vehicle. Based on the side and rear environmental information collected by the parking detection device, the corresponding display content is further displayed on an available display screen. This allows for accurate display of the vehicle's side and rear environmental information to the user in rearview mirror failure scenarios, effectively assisting the user in safe vehicle control, improving the reliability and safety of the vehicle's rearview system, and ensuring user driving safety.

[0091] This application also provides a computer storage medium that can store multiple instructions adapted for loading by a processor and executing the steps of any of the methods described in the above embodiments.

[0092] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of a vehicle provided in an embodiment of this application. Figure 8 As shown, vehicle 800 may include: at least one vehicle processor 801, at least one network interface 804, user interface 803, memory 805, and at least one communication bus 802.

[0093] The communication bus 802 is used to enable communication between these components.

[0094] The user interface 803 may include a display screen and a camera. Optionally, the user interface 803 may also include a standard wired interface and a wireless interface.

[0095] The network interface 804 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface).

[0096] The vehicle processor 801 may include one or more processing cores. The vehicle processor 801 connects to various parts within the vehicle 800 using various interfaces and lines. It executes various functions and processes data by running or executing instructions, programs, code sets, or instruction sets stored in the memory 805, and by calling data stored in the memory 805. Optionally, the vehicle processor 801 may be implemented using at least one of the following hardware forms: Digital Signal Processing (DSP), Field-Programmable Gate Array (FPGA), and Programmable Logic Array (PLA). The vehicle processor 801 may integrate one or more of the following: Central Processing Unit (CPU), Graphics Processing Unit (GPU), and modem. The CPU primarily handles the operating system, user interface, and applications; the GPU is responsible for rendering and drawing the content to be displayed on the screen; and the modem handles wireless communication. It is understood that the modem may also be implemented as a separate chip without being integrated into the vehicle processor 801.

[0097] The memory 805 may include random access memory (RAM) or read-only memory (ROM). Optionally, the memory 805 may include a non-transitory computer-readable storage medium. The memory 805 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 805 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the above-described method embodiments, etc.; the data storage area may store data involved in the above-described method embodiments, etc. Optionally, the memory 805 may also be at least one storage device located remotely from the aforementioned vehicle processor 801. Figure 8 As shown, the memory 805, which serves as a computer storage medium, may include an operating system, a network communication module, a user interface module, and an environmental information detection program.

[0098] exist Figure 8In the vehicle 800 shown, the user interface 803 is mainly used to provide an input interface for the user and to acquire user input data; while the vehicle processor 801 can be used to call the environmental information detection program stored in the memory 805 and specifically perform the following operations:

[0099] In response to a fault signal from the electronic exterior rearview mirror system, determine the source of the fault signal.

[0100] Based on the source of the fault, determine the corresponding parking detection equipment and the display screen;

[0101] It receives side and rear environmental information collected by parking detection equipment and displays the corresponding content on a displayable screen.

[0102] In some embodiments, when the vehicle processor 801 executes the steps of determining the corresponding parking detection device and displayable screen based on the fault source, it specifically performs the following steps: determining the fault location corresponding to the fault signal of the electronic exterior rearview mirror system based on the fault source; determining the corresponding parking detection device based on the fault location and the fault source; and determining the displayable screen based on the fault location.

[0103] In some embodiments, when the vehicle processor 801 determines the corresponding parking detection device based on the fault location and fault source, it specifically performs the following steps: determining a first target parking detection device corresponding to the fault source from a preset parking detection device; and determining at least one second target parking detection device located on the same side of the fault location in the vehicle from the first target parking detection device.

[0104] In some embodiments, the fault source of the electronic exterior rearview mirror system fault signal includes at least one of electronic exterior rearview camera fault and electronic exterior rearview display screen fault. When the vehicle processor 801 executes the step of determining the first target parking detection device corresponding to the fault source from the preset parking detection devices, it specifically performs the following steps: if the fault source is an electronic exterior rearview camera fault, then the surround view camera device and the ultrasonic detection device are determined as the first parking detection device corresponding to the fault source; if the fault source is an electronic exterior rearview display screen fault or an electronic exterior rearview controller fault, then the ultrasonic detection device is determined as the first parking detection device corresponding to the fault source.

[0105] In some embodiments, when the vehicle processor 801 determines a displayable screen based on the fault location, it specifically performs the following steps: determining whether the same-side electronic rearview display screen corresponding to the fault location is operating normally; if the same-side electronic rearview display screen is operating normally, then determining that the same-side electronic rearview display screen is a displayable screen; if the same-side electronic rearview display screen is not operating normally, then determining whether the non-same-side electronic rearview display screen corresponding to the fault location is operating normally; if the non-same-side electronic rearview display screen is operating normally, then determining that the non-same-side electronic rearview display screen is a displayable screen.

[0106] In some embodiments, when the vehicle processor 801 executes the following steps when displaying display content corresponding to the rear-side environment information on a displayable screen: determining the target objects in the rear-side environment and the distance between the target objects and the vehicle based on the rear-side environment information; determining the display content based on the target objects and the distance; and displaying the display content on the displayable screen.

[0107] In some embodiments, after the vehicle processor 801 determines the corresponding parking detection device and display screen based on the fault location and fault source, it further performs the following steps: determining whether there is a lane change risk based on the vehicle control signal triggered by the vehicle control device, which includes at least one of a steering lever, a steering wheel, and a headlight lever; if there is a lane change risk, displaying lane change warning content on the display screen and issuing a lane change warning prompt.

[0108] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0109] The modules described as separate components may or may not be physically separate. Similarly, the components shown as modules may or may not be physical modules; they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0110] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. The computer program product includes one or more computer instructions. When these computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this specification are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in or transmitted through a computer-readable storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, Digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium accessible to a computer or a data storage device such as a server or data center that integrates one or more available media. The aforementioned available media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., Digital Versatile Discs (DVDs)), or semiconductor media (e.g., Solid State Disks (SSDs)).

[0111] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0112] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0113] The above is a description of an environmental information detection method, device, storage medium, and vehicle provided in this application. For those skilled in the art, based on the ideas of the embodiments of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An environmental information detection method, characterized in that, Applied to vehicles including electronic exterior rearview controllers and parking controllers, the method includes: The electronic exterior rearview controller responds to the fault signal of the electronic exterior rearview mirror system and determines the fault source of the fault signal of the electronic exterior rearview mirror system. The electronic exterior rearview controller determines the corresponding parking detection device and display screen based on the fault source. The electronic exterior rearview controller sends a fault signal of the electronic exterior rearview mirror system to the parking controller, receives the side and rear environmental information collected by the parking controller through the parking detection device, and displays the corresponding display content of the side and rear environmental information on the displayable screen; The method for determining the corresponding parking detection device and display screen based on the fault source includes: Based on the fault source, the fault location corresponding to the fault signal of the electronic exterior rearview mirror system is determined, and the fault location is the location where the rearview image is missing. Based on the fault location and the fault source, a corresponding parking detection device is determined, and a displayable screen is determined based on the fault location.

2. The method according to claim 1, characterized in that, The parking detection device that determines the corresponding parking location based on the fault location and the fault source includes: The first target parking detection device corresponding to the fault source is determined from the preset parking detection devices; Identify at least one second target parking detection device located on the same side of the vehicle as the fault location from the first target parking detection device.

3. The method according to claim 2, characterized in that, The fault source of the electronic exterior rearview mirror system fault signal includes at least one of electronic exterior rearview camera fault and electronic exterior rearview display screen fault. The step of determining the first target parking detection device corresponding to the fault source from preset parking detection devices includes: If the source of the fault is the electronic exterior rearview camera, then the surround view camera and the ultrasonic detection device are identified as the first parking detection devices corresponding to the source of the fault. If the fault source is the electronic exterior rearview display screen, then the ultrasonic detection device is determined to be the first parking detection device corresponding to the fault source.

4. The method according to claim 1, characterized in that, The step of determining a displayable screen based on the fault location includes: Determine whether the same-side electronic rearview display screen corresponding to the fault location is operating normally. If the same-side electronic rearview display screen is operating normally, then determine that the same-side electronic rearview display screen is a displayable screen. If the same-side electronic rearview display screen cannot operate normally, then determine whether the non-same-side electronic rearview display screen corresponding to the fault location is operating normally; If the non-same-side electronic rearview display screen is operating normally, then the non-same-side electronic rearview display screen is determined to be a displayable screen.

5. The method according to claim 1, characterized in that, The step of displaying the display content corresponding to the side and rear environment information on the displayable screen includes: Based on the rear-side environment information, determine the target objects in the rear-side environment and the distance between the target objects and the vehicle, and determine the display content based on the target objects and the distance; The display content is displayed on the displayable screen.

6. The method according to claim 1, characterized in that, After determining the corresponding parking detection device and display screen based on the fault location and the fault source, the method further includes: The vehicle control device determines whether there is a risk of lane change based on the vehicle control signal triggered by the vehicle control device, which includes at least one of the following: a steering lever, a steering wheel, and a headlight lever; If the lane change risk exists, the lane change alarm content will be displayed on the displayable screen, and a lane change alarm prompt will be issued.

7. An environmental information detection device, characterized in that, Applied to vehicles including electronic exterior rearview controllers and parking controllers, the device includes: The fault determination module is used by the electronic exterior rearview controller to determine the fault source of the electronic exterior rearview mirror system fault signal in response to the electronic exterior rearview mirror system fault signal; The device activation module is used by the electronic exterior rearview controller to determine the corresponding parking detection device and display screen based on the fault source; An environmental detection module is used for the electronic exterior rearview controller to send a fault signal of the electronic exterior rearview mirror system to the parking controller, to receive the side and rear environmental information collected by the parking controller through the parking detection device, and to display the display content corresponding to the side and rear environmental information on the displayable screen. The device activation module is further configured to determine the fault location corresponding to the fault signal of the electronic exterior rearview mirror system based on the fault source, wherein the fault location is the location where the rearview image is missing; determine the corresponding parking detection device based on the fault location and the fault source; and determine the displayable screen based on the fault location.

8. A computer storage medium, characterized in that, The computer storage medium stores a plurality of instructions adapted for loading by a processor and executing the steps of the method as described in any one of claims 1 to 6.

9. A vehicle, characterized in that, The vehicle includes at least an electronic exterior rearview controller and a parking controller, and the vehicle is capable of performing the steps of the method as described in any one of claims 1 to 6.

Images