Early-warning system, driving device, early-warning method, electronic device, and medium

Abstract

An early-warning system, a driving device, an early-warning method, an electronic device, and a medium. The early-warning system comprises: switchable glass, an out-of-vehicle information collection system, an in-vehicle information collection system and a processing system, wherein the out-of-vehicle information collection system, the in-vehicle information collection system and the switchable glass are all connected to the processing system; the out-of-vehicle information collection system is configured to acquire ambient information of the environment where a driving device is located, and provide the ambient information to the processing system; the in-vehicle information collection system is configured to acquire movement information of an object inside the driving device, and provide the movement information to the processing system; and the processing system is configured to predict, on the basis of the ambient information and the movement information, whether a movement to be performed by the object is dangerous, and control the light transmittance of the switchable glass in response to said movement being dangerous, such that first prompt information is displayed by means of the switchable glass. The method can at least to some extent prevent the occurrence of dangerous accidents.

Description

Warning system, driving equipment, warning method, electronic equipment and medium Technical Field

[0001] Embodiments of the present disclosure relate to a warning system, a driving device, a warning method, an electronic device, and a medium. Background Art

[0002] Advances in science and technology have fueled the development of driving systems. For example, manual transmission cars are gradually becoming obsolete, replaced by automatic transmissions. Currently, driving systems are becoming increasingly intelligent.

[0003] Summary of the Invention

[0004] At least one embodiment of the present disclosure provides a warning system for a driving device, comprising: a display system, an external vehicle information collection system, an internal vehicle information collection system and a processing system, the display system comprising dimming glass, the dimming glass comprising multiple display areas, the external vehicle information collection system, the internal vehicle information collection system and the display system being coupled to the processing system respectively, the external vehicle information collection system being configured to obtain environmental information of an environment in which the driving device is located, and to provide the environmental information to the processing system; the internal vehicle information collection system being configured to obtain motion information of an object located inside the driving device, and to provide the motion information to the processing system; and the processing system being configured to predict whether an upcoming motion of the object is dangerous based on the environmental information and the motion information; and in response to the presence of danger in the upcoming motion, controlling the transmittance of the dimming glass to display first prompt information through the dimming glass, wherein the first prompt information comprises multiple parts, and each of the multiple display areas is used to display one of the multiple parts.

[0005] For example, in the warning system provided in one embodiment of the present disclosure, the dimming glass is the side window glass or the windshield of the driving device, wherein when the driving device is driving safely, the dimming glass is in a light-transmitting state.

[0006] For example, in the warning system provided in one embodiment of the present disclosure, the processing system is further configured to: during the driving of the driving device, predict whether there is danger in the driving of the driving device based on the driving state of the driving device and the environmental information; and in response to the presence of danger in the driving of the driving device, control the transmittance of the dimming glass to display a second prompt message through the dimming glass.

[0007] For example, in the early warning system provided in one embodiment of the present disclosure, the processing system is configured to: predict, based on the action information, whether the action to be taken includes opening the door of the driving device; and in response to the action to be taken including opening the door, predict, based on the environmental information, whether there is a danger in opening the door.

[0008] For example, in the early warning system provided in one embodiment of the present disclosure, the off-vehicle information collection system includes a speed sensor configured to obtain the speed of traffic participants in the environment, the off-vehicle information collection system includes a distance sensor configured to obtain the distance between the traffic participants in the environment and the vehicle door, and the processing system is configured to predict whether there is a danger in opening the vehicle door based on the distance and the speed.

[0009] For example, in the early warning system provided by an embodiment of the present disclosure, the in-vehicle information collection system includes: an in-vehicle camera, configured to collect image information of the object; and a pressure sensor, wherein the pressure sensor is located on the switch device of the vehicle door or the switch device of the seat belt, and the pressure sensor is configured to detect pressure information of the switch device of the vehicle door or the switch device of the seat belt, wherein the action information at least includes the image information and the pressure information, and the processing system is configured to: receive the image information and the pressure information provided by the in-vehicle information collection system; and predict whether the action to be taken includes opening the vehicle door based on the image information and the pressure information.

[0010] For example, in the warning system provided in one embodiment of the present disclosure, the multiple display areas include a first area, a second area, a third area and a fourth area, and the multiple parts include a real-time image of the environment, status information of traffic participants in the environment, a first warning information and a second warning information, the first warning information is used to prompt whether there is a safety hazard behind the vehicle door, and the second warning information is used to prompt whether there is a safety hazard in front of the vehicle door, the first area is configured to display the real-time image, the second area is configured to display the status information, the third area is configured to display the first warning information, and the fourth area is configured to display the second warning information.

[0011] For example, in the warning system provided in one embodiment of the present disclosure, the third area includes a first pixel unit, the fourth area includes a second pixel unit, the first warning information includes the flashing frequency or flashing color of the first pixel unit, and the second warning information includes the flashing frequency or flashing color of the second pixel unit.

[0012] For example, in the early warning system provided in one embodiment of the present disclosure, the processing system is further configured to: determine the urgency of the danger in response to the danger of the action to be taken; and determine the first early warning information and the second early warning information according to the urgency, wherein the higher the urgency, the higher the flashing frequency, or the higher the urgency, the darker the flashing color.

[0013] For example, in the early warning system provided in one embodiment of the present disclosure, the processing system is further configured to: determine the visual height of the object based on the action information; and adjust the layout of the first area, the second area, the third area and the fourth area in the dimming glass based on the visual height.

[0014] For example, in the early warning system provided in one embodiment of the present disclosure, when the visual height is lower than the height threshold, the third area and the fourth area are located below the second area; when the visual height is higher than or equal to the height threshold, the third area and the fourth area are located above the second area.

[0015] For example, in the early warning system provided in one embodiment of the present disclosure, the display system also includes a driving logic control module, and the processing system is configured to provide a control signal to the driving logic control module, wherein the control signal is used to control the transmittance of the dimming glass, and the driving logic control module is configured to generate a driving signal according to the control signal, and provide the driving signal to the dimming glass to drive the dimming glass to display the first prompt information.

[0016] For example, in the early warning system provided in one embodiment of the present disclosure, the early warning system also includes a door control system, and the processing system is further configured to provide a control instruction to the door control system when the danger meets a preset condition, and the door control system is configured to control the door according to the control instruction.

[0017] For example, in the early warning system provided in one embodiment of the present disclosure, the preset condition includes that the vehicle door is opened to a first angle, and the processing system is configured to: provide the first type of control instruction to the vehicle door control system, and the first type of control instruction is used to control the vehicle door to be locked or increase the resistance to opening the vehicle door, wherein the first angle is less than the preset angle.

[0018] For example, in the early warning system provided in one embodiment of the present disclosure, the preset conditions also include: the vehicle door is opened to a second angle, and the processing system is configured to provide the second type of control instructions to the vehicle door control system, the second type of control instructions being used to open the emergency mode of the vehicle door, and the second angle being greater than or equal to the preset angle.

[0019] For example, in the warning system provided in an embodiment of the present disclosure, the vehicle door control system is configured to pop out a buffer component on the vehicle door in the emergency mode.

[0020] For example, the warning system provided in one embodiment of the present disclosure further includes: a voice warning system, configured to receive a processing signal provided by the processing system, wherein the processing signal is used to indicate whether the action to be performed is dangerous; and play a voice prompt message in response to whether the action to be performed is dangerous.

[0021] At least one embodiment of the present disclosure provides a driving device, including the warning system provided by any embodiment of the present disclosure.

[0022] At least one embodiment of the present disclosure provides a warning method applied to a driving device, the warning system including dimming glass, the dimming glass including multiple display areas, the method including: obtaining environmental information of an environment in which the driving device is located; obtaining action information of an object located inside the driving device; predicting whether an upcoming action of the object is dangerous based on the environmental information and the action information; and in response to the presence of danger in the upcoming action, controlling the transmittance of the dimming glass to display first prompt information through the dimming glass, the first prompt information including multiple parts, each of the multiple display areas being used to display one of the multiple parts.

[0023] For example, the early warning method provided in an embodiment of the present disclosure further includes: in response to detecting that the driving device is in a parked state, predicting whether the action that the object is about to take is dangerous based on the environmental information and the action information.

[0024] For example, in the early warning method provided in an embodiment of the present disclosure, based on the environmental information and the action information, it is predicted whether the action that the object is about to take is dangerous, including: based on the action information, predicting whether the action that is about to take place includes opening the door of the driving device; and in response to the action that is about to take place including opening the door, predicting based on the environmental information whether it is dangerous to open the door.

[0025] At least one embodiment of the present disclosure provides an electronic device, comprising: dimming glass; a processor; a memory, comprising one or more computer program instructions; wherein the one or more computer program instructions are stored in the memory and, when executed by the processor, implement instructions of a warning method, the warning method comprising: obtaining environmental information of an environment in which the driving device is located; obtaining action information of an object located inside the driving device; predicting whether an action to be taken by the object is dangerous based on the environmental information and the action information; and in response to the presence of danger in the action to be taken, controlling the transmittance of the dimming glass to display a first prompt message through the dimming glass.

[0026] At least one embodiment of the present disclosure provides a computer-readable storage medium that non-temporarily stores computer-readable instructions, wherein when the computer-readable instructions are executed by a processor, the early warning method provided by any embodiment of the present disclosure is implemented.

[0027] At least one embodiment of the present disclosure provides a computer program product, including a computer program / instruction, which, when executed by a processor, implements the early warning method provided by any embodiment of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the drawings of the embodiments will be briefly introduced below. Obviously, the drawings in the following description only relate to some embodiments of the present disclosure, rather than limiting the present disclosure.

[0029] FIG1 shows a block diagram of an early warning system provided by at least one embodiment of the present disclosure;

[0030] FIG2A shows a schematic diagram of a switchable glass displaying first prompt information in different regions according to at least one embodiment of the present disclosure;

[0031] FIG2B shows a schematic diagram of another type of switchable glass displaying first prompt information in different regions according to at least one embodiment of the present disclosure;

[0032] FIG3 shows a schematic diagram of a drive logic control module provided by at least one embodiment of the present disclosure;

[0033] FIG4 shows a flowchart of an early warning method provided by at least one embodiment of the present disclosure;

[0034] FIG5 shows a flowchart of another early warning method provided by at least one embodiment of the present disclosure;

[0035] FIG6 shows a schematic block diagram of an early warning device provided by at least one embodiment of the present disclosure;

[0036] FIG7 shows a schematic block diagram of an electronic device provided by at least one embodiment of the present disclosure;

[0037] FIG8 shows a schematic block diagram of another electronic device provided by at least one embodiment of the present disclosure; and

[0038] FIG9 shows a schematic diagram of a computer-readable storage medium provided by at least one embodiment of the present disclosure. DETAILED DESCRIPTION

[0039] To make the purpose, technical solutions, and advantages of the embodiments of the present disclosure more clear, the technical solutions of the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present disclosure. Obviously, the described embodiments are part of the embodiments of the present disclosure, not all of the embodiments. Based on the described embodiments of the present disclosure, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present disclosure.

[0040] Unless otherwise defined, the technical or scientific terms used in this disclosure should have the usual meanings understood by people with ordinary skills in the field to which this disclosure belongs. The words "first", "second" and similar words used in this disclosure do not indicate any order, quantity or importance, but are only used to distinguish different components. Similarly, words such as "one", "an" or "the" do not indicate a quantity limitation, but rather indicate the existence of at least one. Words such as "include" or "comprise" mean that the elements or objects appearing before the word include the elements or objects listed after the word and their equivalents, without excluding other elements or objects. Words such as "connect" or "connected" are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. "Up", "down", "left", "right" and the like are only used to indicate relative positional relationships. When the absolute position of the object being described changes, the relative positional relationship may also change accordingly.

[0041] With the increasing prevalence of intelligent driving devices on the road, there are also increasing uncertainties, especially in complex road conditions and situations with a large number of people. There are potential risks associated with driving with a driving device. For example, when a passenger opens a door after the driving device stops, they cannot easily determine the status of vehicles or pedestrians behind the driving device. If a vehicle or pedestrian does not slow down and avoid the vehicle or pedestrian in time, the driving device's door can easily cause damage. Therefore, how to conveniently inform the driver or passenger of the driving device whether to open the door has become an indispensable function of driving devices now and in the future.

[0042] At least one embodiment of the present disclosure provides a warning system, a driving device, a warning method, an electronic device, and a medium. The warning system includes a display system, an external information collection system, an internal information collection system, and a processing system. The display system includes a dimming glass having multiple display areas. The external information collection system, the internal information collection system, and the display system are each coupled to the processing system. The external information collection system is configured to obtain environmental information about the driving device's environment and provide the environmental information to the processing system. The internal information collection system is configured to obtain motion information of an object located within the driving device and provide the motion information to the processing system. The processing system is configured to predict whether an impending motion of the object is dangerous based on the environmental information and motion information. In response to the impending motion being dangerous, the system controls the transmittance of the dimming glass to display a first prompt message through the dimming glass. The first prompt message includes multiple parts, and each of the multiple display areas is configured to display one of the multiple parts. The warning system obtains environmental information through the external information collection system and the internal information collection system, predicts the motion of a passenger or driver within a certain period of time, and when a risk is present, the dimming glass promptly changes to provide a warning to the driver and passengers, thereby avoiding traffic risks.

[0043] FIG1 shows a block diagram of an early warning system provided by at least one embodiment of the present disclosure.

[0044] As shown in FIG1 , the warning system 100 includes a display system 101 , an external vehicle information collection system 102 , an internal vehicle information collection system 103 and a processing system 104 .

[0045] The display system 101 includes a switchable glass, which includes a plurality of display areas.

[0046] The external vehicle information collection system 102 , the internal vehicle information collection system 103 and the display system 101 are respectively coupled to the processing system 104 .

[0047] The off-vehicle information collection system 102 is configured to obtain environmental information of the environment in which the driving device is located and provide the environmental information to the processing system 104;

[0048] The in-vehicle information collection system 103 is configured to obtain motion information of an object located inside the driving device and provide the motion information to the processing system 104; and

[0049] The processing system 104 is configured to predict whether the action that the object is about to take is dangerous based on environmental information and action information; and in response to the presence of danger in the action that is about to take place, control the transmittance of the dimming glass to display first prompt information through the dimming glass, where the first prompt information includes multiple parts, and each of the multiple display areas is used to display one of the multiple parts.

[0050] The early warning system can predict the behavior of people in the car and conduct real-time detection of the actual environment outside the car. It makes a comprehensive judgment through the processing system and warns the relevant parties involved in the behavior, thereby at least partially avoiding the occurrence of accidents.

[0051] In some embodiments of the present disclosure, the display system 101 includes, for example, a drive logic control module and vehicle windows, wherein the vehicle windows include dimming glass. For example, a driving device may include multiple windows, such as side windows, a front window (also known as a "front windshield"), a rear window (also known as a "rear windshield"), and a sunroof. In some embodiments of the present disclosure, at least one of the multiple windows includes dimming glass. For example, the side windows and rear windshield of the driving device are dimming glass.

[0052] When the driving device is driving safely, the switchable glass is in a light-transmitting state, wherein the light transmittance of the switchable glass in the light-transmitting state is higher than 70%, for example, and does not affect the viewing of the environment outside the driving device by the people in the driving device through the glass.

[0053] In some embodiments of the present disclosure, the side window glass of the driving device is dimming glass, which does not affect the driver's driving, and the line of sight is consistent with the direction of getting off the vehicle, making it easy to see the prompt information.

[0054] In some embodiments of the present disclosure, in addition to the side windows, the rear windshield is also dimming glass, so that prompt information can be displayed on the rear windshield, so that not only the people in the car can get the prompt, but the traffic participants behind the driving device can also see the prompt information.

[0055] The display system 101 is coupled to the processing system 104, for example, a driving logic control module is coupled to the processing system 104. For example, an input of the driving logic control module is coupled to the processing system 104 and configured to receive a control signal provided by the processing system 104. An output of the driving logic control module is coupled to the smart glass. The driving logic control module is configured to generate a driving signal based on the control signal and provide the driving signal to the smart glass to drive the smart glass to display prompt information.

[0056] In some embodiments of the present disclosure, for example, the switchable glass includes a plurality of pixel units, each pixel unit including a first substrate and a second substrate disposed opposite each other, and a liquid crystal layer disposed between the first substrate and the second substrate; the liquid crystal layer is configured to flip under the control of an electric field generated between the first substrate and the second substrate to control the transmittance of light. A drive signal is configured to apply an electric field to the first substrate and the second substrate, causing the liquid crystal layer to flip under the control of the electric field to control the transmittance of light. For an embodiment of the drive logic control module, please refer to the description of FIG. 3 below, which will not be repeated here.

[0057] In some other embodiments of the present disclosure, the processing system 104 may also control the transmittance of the smart glass by sending instructions to the smart glass, that is, controlling the transmittance of the smart glass by software.

[0058] In some embodiments of the present disclosure, the off-vehicle information collection system 102 includes, for example, at least one of a camera, a speed sensor, and an on-vehicle radar (e.g., a lidar, etc.) installed outside the vehicle. The camera, the speed sensor, and the on-vehicle radar can be coupled to the processing system 104 respectively to provide the collected environmental information outside the vehicle; or the collected environmental information outside the vehicle can be provided to the processing system 104 through the same interface. The camera and the on-vehicle radar can, for example, obtain images of the environment, and the on-vehicle radar can also, for example, obtain the distance between traffic participants in the environment and the driving device. The speed sensor is used, for example, to obtain the speed of traffic participants in the environment. The environmental information of the environment in which the driving device is located includes, for example: an image or video of the environment, the speed and distance of traffic participants, the type of traffic participants (e.g., pedestrians, vehicles, obstacles, etc.), etc.

[0059] In some embodiments of the present disclosure, traffic participants include, but are not limited to, pedestrians, vehicles, obstacles, etc. The vehicle-external information collection system 102 may also include devices other than cameras, speed sensors, and vehicle-mounted radars, such as infrared detectors, etc., and the present disclosure does not specifically limit the vehicle-external information collection system 102.

[0060] In some embodiments of the present disclosure, the object inside the driving device may refer to, for example, a person inside the driving device, and the person inside the vehicle may be a driver or a passenger.

[0061] In some embodiments of the present disclosure, for example, when environmental visibility is below a visibility threshold, environmental information is acquired via an onboard radar, and when visibility is greater than or equal to the visibility threshold, environmental information is acquired via an external camera. For example, in foggy weather with low visibility, LiDAR images can be combined; in clear weather with high visibility, camera images can be combined. This embodiment flexibly adjusts the method for acquiring environmental information based on environmental visibility, conserving resources while ensuring accurate environmental information.

[0062] The visibility threshold can be set by those skilled in the art. For example, the visibility threshold is 1 kilometer. If visibility is less than 1 kilometer, environmental information is acquired through the onboard radar. If visibility is greater than or equal to 1 kilometer, environmental information is acquired through the vehicle's external camera.

[0063] In some other embodiments of the present disclosure, the vehicle-mounted radar and the camera can work simultaneously to respectively obtain environmental information and provide it to the processing system 104. The processing system 104 combines the environmental information provided by the vehicle-mounted radar and the environmental information provided by the camera to predict whether there is danger.

[0064] In some embodiments of the present disclosure, in an example where the processing system 104 combines environmental information provided by an onboard radar and environmental information provided by a camera to determine whether a danger exists, the environmental information provided by the onboard radar and the environmental information provided by the camera have different reference weights. For example, when the visibility of the environment is lower than a visibility threshold, the reference weight of the environmental information provided by the onboard radar is higher than the reference weight of the environmental information provided by the camera; and when the visibility of the environment is higher than or equal to the visibility threshold, the reference weight of the environmental information provided by the external camera is higher than the reference weight of the environmental information provided by the onboard radar.

[0065] In some embodiments of the present disclosure, the in-vehicle information acquisition system 103 includes, for example, an in-vehicle camera and a pressure sensor installed in the vehicle. The in-vehicle camera is used to capture images or videos inside the vehicle, and the pressure sensor is used to detect pressure. For example, the motion information includes at least image information and pressure information, and the in-vehicle camera is configured to capture image information of the object; and the pressure sensor is located on the door switch device or the seat belt switch device, and the pressure sensor is configured to detect pressure information of the door switch device or the seat belt switch device. The combination of image information and pressure information can improve the accuracy of the prediction, and can determine the degree of the in-vehicle occupant's behavior of getting off the vehicle, thereby providing prompt information in a timely manner.

[0066] In other embodiments of the present disclosure, the in-vehicle information collection system 103 may also only include an in-vehicle camera or a pressure sensor.

[0067] The in-vehicle information collection system 103 primarily predicts the actions of vehicle occupants, including whether they intend to exit the vehicle and the extent of their exit. This information can be determined using in-vehicle cameras and by installing pressure sensors on the interior handles to determine the extent of their exit. This information is then transmitted to a processing system for processing.

[0068] For example, the processing system 104 may be a central processing unit.

[0069] For example, the processing system 104 predicts whether the action to be taken by the occupant of the vehicle includes opening the door of the driving device based on the action information, and in response to the action to be taken including opening the door, predicts whether opening the door is dangerous based on the environmental information.

[0070] For example, the processing system 104 receives the image information and pressure information provided by the in-vehicle information acquisition system 103; and based on the image information and pressure information, predicts whether the action to be performed includes opening the door. For example, when the driving device is in a stopped state, the processing system 104 is configured to predict whether the action to be performed by the subject is dangerous based on the environmental information and the action information. This embodiment predicts whether the subject is about to get off the vehicle when the driving device is detected to have stopped, thereby determining whether getting off the vehicle is dangerous. Predicting whether to get off the vehicle when the driving device is stopped can improve the accuracy of the prediction, reduce unnecessary predictions, and thus save resources.

[0071] For example, if the image information shows that the subject is organizing a backpack, extending his hand toward the car door, extending his hand toward the seat belt switch, etc., it is predicted that the subject is about to open the car door, and further, if the pressure information shows that the pressure of the switch on the car door increases, it means that the subject is about to open the car door.

[0072] In other embodiments of the present disclosure, the processing system 104 may also determine whether the object is about to open the door based solely on image information or pressure information.

[0073] When it is determined that the subject is about to open the vehicle door, the processing system can determine whether opening the vehicle door is dangerous based on environmental information. If so, the processing system can provide a control signal to the driving logic control module, which is configured to generate a driving signal based on the control signal and provide the driving signal to the smart glass. The smart glass adjusts its light transmittance based on the driving signal, thereby displaying a first prompt message on the smart glass.

[0074] For example, the driving signal causes the liquid crystal molecules in the switchable glass to rotate and reduce the transmittance, for example, the transmittance is adjusted from 70% to 10% or 0%.

[0075] In some embodiments of the present disclosure, for example, all four side windows of a driving device include dimming glass, with the four side windows being located near four seats. The processing system 104 controls the light transmittance of the dimming glass of the side window near the seat where the person about to perform a dangerous action is located, causing the dimming glass of that side window to display a prompt message. The light transmittance of the dimming glass of the remaining three side windows is adjusted to maintain a high level of light transmittance to allow for a clear view of the environment outside the window.

[0076] In other embodiments of the present disclosure, the processing system 104 controls the light transmittance of the switchable glass of all side windows and displays prompt information on each side window.

[0077] In some embodiments of the present disclosure, for example, environmental information includes the distance between a traffic object and a vehicle door, and the off-vehicle information collection system further includes a distance sensor configured to obtain the distance between the traffic object and the vehicle door. The processing system is configured to predict, based on the distance and speed, whether opening the vehicle door is dangerous. In some embodiments of the present disclosure, the distance sensor may be, for example, an ultrasonic ranging sensor, a laser ranging sensor, an infrared ranging sensor, or an on-vehicle radar.

[0078] For example, the rules for predicting safe door opening are as follows: Analysis is performed in two dimensions: close distance and long distance. If the closest distance from the vehicle door among multiple traffic participants is S, and the minimum speed of the multiple traffic participants is V, the CPU can determine that the vehicle door is safely opened when the distance S from the vehicle door is less than a first preset distance S1, and the speed V is less than a preset speed V1. The CPU can also determine that the vehicle door is safely opened when the distance S from the vehicle door is less than a second preset distance S2 but greater than the first preset distance S1, and the speed V is less than a second speed V2. For example, if the distance S from the vehicle door is less than the first preset distance S1, and the speed V is greater than or equal to the preset speed V1, the CPU can determine that the vehicle door is dangerous. For example, if the distance S from the vehicle door is less than the second preset distance S2 but greater than the first preset distance S1, and the speed V is greater than or equal to the second speed V2, the CPU can determine that the vehicle door is dangerous. V, S, V1, and V2 are all greater than or equal to 0, and V2 is greater than V1.

[0079] Those skilled in the art can set the corresponding values ​​of V, S, V1, and V2 according to needs or the type of driving equipment. For example, S1 = 60 m, V1 = 1.1 m / s, S2 = 600 m, and V2 = 10 m / s.

[0080] In some other embodiments of the present disclosure, for example, the speed and distance from the vehicle door of each of a plurality of traffic participants are obtained to calculate the minimum time for each traffic participant to reach the vehicle door, and it is determined whether the minimum value is less than a minimum time threshold. If the minimum value is less than the minimum time threshold, there is a danger of opening the vehicle door; if the minimum value is greater than the minimum time threshold, there is no danger.

[0081] Those skilled in the art may set appropriate rules or algorithms to determine whether a danger exists. The embodiments of the present disclosure do not limit the rules or algorithms for determining whether a danger exists.

[0082] In some embodiments of the present disclosure, in addition to being configured to display a first prompt message through the dimming glass when there is a danger in the action to be performed, the processing system 104 may also be configured to predict whether there is a danger in the driving of the driving device based on the driving status and environmental information of the driving device during the driving process of the driving device; and in response to the danger in the driving of the driving device, control the transmittance of the dimming glass to display a second prompt message through the dimming glass.

[0083] In this embodiment, the prompt information is not only used to indicate whether it is safe to open the door, but also to promptly provide prompts for dangerous situations during the driving process of the driving device, such as reminding the driver that there are vehicles around that are too close, thereby at least partially avoiding the occurrence of accidents during driving.

[0084] The second prompt information and the first prompt information may or may not be the same. For example, both the first prompt information and the second prompt information may be a flashing red light. For another example, the first prompt information may include the speed and distance of the traffic participant, while the second prompt information may include the specific cause of the danger, such as a close distance to the vehicle ahead or the danger of driving against traffic. Because the second prompt information and the first prompt information have the same display principles and functions, in the embodiments of the present disclosure, the term "prompt information" may be used to represent the first prompt information or the second prompt information.

[0085] For example, the driving state of the driving device may include driving speed, driving direction (straight ahead or turning light), and the environmental information may refer to the above description.

[0086] For example, if the vehicle is traveling at a high speed and the distance to the vehicle ahead is close, the vehicle is predicted to be in a dangerous situation. For another example, if the vehicle is turning right and the rear end of the vehicle is close to an obstacle on the left, the vehicle is predicted to be in a dangerous situation.

[0087] In this case, since the second prompt information is primarily used to alert the driver or front passenger, the dimming glass can be a small area near at least one of the four corners of the front windshield. Using a small area near at least one of the four corners of the front windshield as the dimming glass allows the prompt information to be displayed without obstructing the driver's view.

[0088] In some embodiments of the present disclosure, the switchable glass includes multiple display areas, the first prompt information includes multiple parts, and each display area is used to display one of the multiple parts.

[0089] For example, the switchable glass may include two, three, four, or five display areas. Each display area is used to display a different portion of the first prompt information. This embodiment displays different prompt information in different areas, allowing people inside the vehicle or traffic participants outside the vehicle to quickly, comprehensively, and clearly obtain the prompt information.

[0090] For example, real-time images outside the window, relevant traffic participants, and status information are displayed in different areas on the window glass, and based on the comprehensive judgment of the central processor, prominent prompts are given regarding the safety of opening the door.

[0091] For example, the multiple display areas include a first area, a second area, a third area, and a fourth area. The multiple parts include a real-time image of the environment, status information of traffic participants in the environment, a first warning message, and a second warning message. The first warning message is used to indicate whether there is a safety hazard behind the vehicle door, and the second warning message is used to indicate whether there is a safety hazard in front of the vehicle door. The first area is configured to display the real-time image, the second area is configured to display status information, the third area is configured to display the first warning message, and the fourth area is configured to display the second warning message. In this embodiment, the prompt information is divided into four areas for display. While providing more detailed information to the occupants of the vehicle, it is also convenient for the occupants to quickly locate the information they need to know, alleviating the difficulty of the occupants in locating the information they need to know in the more detailed information.

[0092] In some embodiments of the present disclosure, for example, the first area, the third area, and the fourth area are located above the second area, and the second area and the third area are located on both sides of the first area. For example, the third area is on the side close to the rear of the vehicle, and the second area is on the side close to the front of the vehicle, so that the first warning information is displayed on the part close to the rear of the vehicle, and the second warning information is displayed on the part close to the front of the vehicle. In this embodiment, the front side and the rear side of the door are distinguished, and corresponding prompts are given in the second area (for example, area B in Figure 2A) and the third area (for example, area C in Figure 2A) to prompt the occupants of the vehicle to the traffic participants in the corresponding directions.

[0093] FIG2A shows a schematic diagram of a switchable glass displaying first prompt information in different regions according to at least one embodiment of the present disclosure.

[0094] As shown in FIG2A , the switchable glass is divided into four display areas, namely area A, area B, area C, and area D. Area A is an example of the first area, area B is an example of the third area, area C is an example of the fourth area, and area D is an example of the second area.

[0095] Area A displays real-time images outside the vehicle window, such as those from an external camera or lidar. Area D displays status information, including, for example, the type of traffic participant, driving status, and statistics on the number of traffic participants. For example, this status information includes the number and speed of pedestrians, the number and speed of vehicles, and the location of obstacles. Areas B and C serve as warning zones, predicting accident behavior after the vehicle door is opened based on the processing system's determination. For example, if the processing system predicts that no accident will occur with the door opened, Areas B and C indicate that the door can be opened safely. If the processing system predicts the presence of a traffic participant requiring warning behind the door, Area B displays a first warning message, which can, for example, alert passengers and other traffic participants to the rear of the door. If the processing system predicts the presence of a traffic participant requiring warning in front of the door, Area C displays a second warning message, which simultaneously alerts both passengers and other traffic participants, reminding passengers to pay attention to the front of the door.

[0096] FIG2B shows a schematic diagram of another type of switchable glass displaying first prompt information in different regions according to at least one embodiment of the present disclosure.

[0097] As shown in FIG2B , the switchable glass is still divided into four display areas, namely area A, area B, area C, and area D. For areas A, B, C, and D, please refer to the description of FIG2A .

[0098] Regions A, B, C, and D are similar to the switchable glass shown in FIG. 2A except for their different distribution on the switchable glass.

[0099] In the example of FIG. 2A , the regions B and C are located above the region D, and in the example of FIG. 2B , the regions B and C are located below the region D.

[0100] For example, in the example in FIG. 2A , region A, region B, and region C are located above region D, and in the example in FIG. 2B , region A, region B, and region C are located below region D.

[0101] In some examples of the present disclosure, the layout shown in FIG. 2A and the layout shown in FIG. 2B can be flexibly switched to accommodate different visual heights.

[0102] For example, the processing system 104 is further configured to determine the visual height of the object according to the motion information; and adjust the layout of the first area, the second area, the third area, and the fourth area in the switchable glass according to the visual height.

[0103] For example, the motion information described above includes image information of a person in the vehicle collected by an in-vehicle camera or radar. Based on the image information, the height of the person in the vehicle is determined. Height reflects visual height; higher height indicates higher visual height. If the person is taller, the layout shown in FIG2A is used for display; if the person is shorter, the layout shown in FIG2B is used for display.

[0104] For example, when the visual altitude is lower than the altitude threshold, the third area and the fourth area are located below the second area; when the visual altitude is higher than or equal to the altitude threshold, the third area and the fourth area are located above the second area.

[0105] The positions of the first warning information and the second warning information are flexibly adjusted according to the visual height, which can facilitate people in the car to see the warning information in time.

[0106] In some embodiments of the present disclosure, the switchable glass includes multiple pixel units, for example, the third region includes a first pixel unit, and the fourth region includes a second pixel unit. The first warning information includes the flashing frequency or flashing color of the first pixel unit, and the second warning information includes the flashing frequency or flashing color of the second pixel unit. In this embodiment, the flashing of the pixel units serves as a warning message, allowing both occupants and traffic participants outside the vehicle to be alerted, further improving safety.

[0107] In some embodiments of the present disclosure, the processing system 104 is further configured to: determine the urgency of the danger in response to the danger of the action to be performed; and determine the first warning information and the second warning information according to the urgency, wherein the higher the urgency, the higher the flashing frequency, or the higher the urgency, the darker the flashing color.

[0108] For example, the shorter the minimum time it takes for a traffic participant to reach the vehicle door, the higher the urgency. For example, if the minimum time threshold is 2 minutes, the urgency is considered normal urgency; if the minimum time threshold is 1 minute, the urgency is considered medium urgency; and if the minimum time threshold is 30 seconds, the urgency is considered very urgent. For example, the flashing frequency during normal urgency is lower than that during medium urgency, which is lower than that during very urgent urgency. Furthermore, the flashing color during normal urgency is lighter than that during medium urgency, which is lighter than that during very urgent urgency.

[0109] In some embodiments of the present disclosure, vehicle occupants can also locally control the dimming glass, for example, by only enabling the third and fourth areas to display corresponding prompt information, while the first and second areas do not display prompt information and maintain high light transmittance. Vehicle occupants can flexibly adjust whether multiple display areas are used to display prompt information based on their needs.

[0110] As shown in Figure 1, the warning system 100 further includes a vehicle door control system 105. The processing system 104 is further configured to provide a control instruction to the vehicle door control system 105 when the danger meets a preset condition, and the vehicle door control system 105 is configured to control the vehicle door according to the control instruction.

[0111] For example, the danger meeting the preset condition may be that the urgency of the danger reaches a preset urgency level, such as medium urgency. For example, when the urgency level reaches medium urgency, the vehicle doors are locked.

[0112] This embodiment can intervene in the process of opening the vehicle door when necessary, and control the vehicle door in time to avoid dangerous accidents or reduce the severity of dangerous accidents.

[0113] In some embodiments of the present disclosure, the preset conditions include the vehicle door being opened to a first angle, and the processing system is configured to: provide a first type of control instruction to the vehicle door control system 105, the first type of control instruction being used to control the vehicle door to be locked or to increase the resistance to opening the vehicle door, and the first angle being less than the preset angle.

[0114] For example, the preset angle can be 45°, 30°, etc., and those skilled in the art can set the preset angle by themselves. In this embodiment, when the angle is small, the door can be directly braked to lock, or the resistance to the door opening can be increased to delay the door opening to prevent collision.

[0115] In some embodiments of the present disclosure, the preset condition also includes the vehicle door being opened to a second angle, and the processing system is configured to: provide a second type of control instruction to the vehicle door control system 105, the second type of control instruction is used to open the vehicle door in an emergency mode, and the second angle is greater than or equal to the preset angle.

[0116] The door control system is configured to deploy a cushioning component from the door in emergency mode. The cushioning component, for example, includes an airbag or a relatively soft material. In this embodiment, when the door is opened at a wide angle, which is prone to collision, the door control system 105 activates emergency mode, deploying an airbag or a relatively soft material to cover the metal in the door and provide additional impact cushioning.

[0117] This embodiment can handle emergencies in a timely manner. For example, when the car door is already opened and someone or an electric car suddenly approaches, when the car door is opened at a small angle, the car door can be directly braked and locked, or the resistance to the door opening can be increased to delay the door opening to prevent a collision. In addition, when the car door is opened at a large angle, a collision is likely to occur. At this time, the car door control system 105 turns on the emergency mode, and an airbag or softer material pops out from the metal position of the car door to cover the car door and increase impact cushioning.

[0118] In some embodiments of the present disclosure, the warning system 100 further includes a voice warning system 106 configured to receive a processed signal from the processing system 104, the processed signal indicating whether an impending action is dangerous; and to play a voice prompt message in response to whether the impending action is dangerous. The voice warning system 106 can use the vehicle's audio system to alert vehicle occupants of external environmental information based on the processing system's determination, and can assist the display system in providing further reminders to vehicle occupants.

[0119] Voice warning system 106, for example, includes a signal processing module configured to receive a processed signal from processing system 104, convert the processed signal into a voice signal, and play it through the audio system. The processed signal may be, for example, a digital signal including a determination of danger. Voice warning system 106 converts the digital signal into an analog signal, which is then converted into a voice signal.

[0120] FIG3 shows a schematic diagram of a driving logic control module provided by at least one embodiment of the present disclosure.

[0121] As shown in FIG3 , the input end of the driving logic control module 300 includes a video receiving unit 301 and a command receiving unit 302. The video receiving unit 301, the command receiving unit 302 and the output end of the processing system 104 are coupled.

[0122] The video receiving unit 301 is used to receive video images from a laser radar or camera sent by the processing system.

[0123] The command receiving unit 302 is used to receive command data sent by the processing system, including status information and prompt information (first prompt information or second prompt information) of traffic participants.

[0124] The drive logic control module 300 also includes a command parsing unit 303, a status information image generation unit 304, a warning information image generation unit 305, a write memory controller 306, a read memory controller 307, a bus arbiter 308, a memory unit 309, a video merging unit 310 and a video data sending unit 311.

[0125] The command parsing unit 303 is used to parse the status information and prompt information of the traffic participants.

[0126] The status information image generating unit 304 is configured to generate video information of area D.

[0127] The warning information image generating unit 305 is used to generate video information of area B or area C.

[0128] Write memory controller 306 controls the writing of video data into the memory unit. Write memory controller 306 includes, for example, write memory sub-controllers WDMA1, WDMA2, and WDMA3. WDMA1 controls the writing of video images into memory unit 309, WDMA2 controls the writing of video information from region D into memory unit 309, and WDMA3 controls the writing of video information from regions B or C into memory unit 309.

[0129] The read memory controller 307 controls the reading of video data from the memory unit. For example, the read memory controller 307 includes read memory sub-controllers RDMA1, RDMA2, and RDMA3. RDMA1 reads video images from the memory unit 309, RDMA2 reads video information from area D, and RDMA3 reads video information from area B or area C.

[0130] The bus arbiter 308 is used to control the read and write sequence of the memory cells.

[0131] The memory unit 309 is, for example, a Double Data Rate SDRAM (DDR).

[0132] The video merging unit 310 is used to merge the video information of region A, region B, region C, and region D into a complete video image.

[0133] The video data sending unit 311 is used to send a video signal to the dimming glass. In some embodiments of the present disclosure, the dimming glass can be used as a three-dimensional display screen to display the video signal in three dimensions, which can improve the viewing experience.

[0134] Another aspect of the present disclosure provides a driving device that includes the early warning system provided by any of the embodiments of the present disclosure. The driving device can acquire environmental information through an external and internal vehicle information collection system, predict the actions of passengers or the driver within a certain timeframe, and, when risks arise, promptly provide warnings to the driver and passengers through dimming glass, thereby avoiding traffic hazards. For details on the correspondence between the driving device and the various systems, modules, or units of the early warning system, please refer to the above description.

[0135] Another aspect of the present disclosure provides an early warning method for a driving device. FIG4 shows a flow chart of an early warning method provided by at least one embodiment of the present disclosure.

[0136] As shown in FIG4 , the early warning method includes steps S401 to S404 .

[0137] Step S401: Acquire motion information of an object located inside the driving device.

[0138] Step S402: Acquire environmental information of the environment in which the driving device is located.

[0139] Step S403: Predict whether the object's upcoming action is dangerous based on the environmental information and action information.

[0140] Step S404: In response to the danger of the action to be performed, the transmittance of the switchable glass is controlled to display a first prompt message through the switchable glass.

[0141] This early warning method can obtain surrounding environment information through the external information collection system and the internal information collection system of the vehicle, predict the actions of passengers or drivers within a certain period of time, and when there is a risk, timely change the dimming glass to give the car driver and passengers certain warnings to avoid traffic risks.

[0142] The warning method is applied to, for example, a driving device, which includes the warning system shown in FIG1 .

[0143] In step S401 , the motion information of the object located inside the driving device is obtained, for example, through the in-vehicle information collection system.

[0144] In step S402, for example, environmental information of the environment in which the driving device is located is obtained through an off-vehicle information collection system.

[0145] For steps S401 and S404, for example, the processing system predicts whether the object's upcoming action is dangerous based on environmental information and action information; and in response to the existence of danger in the upcoming action, controls the transmittance of the dimming glass to display the first prompt information through the dimming glass.

[0146] In the embodiment of the present disclosure, the execution order of step S401 and step S402 is not limited. Step S401 and step S402 can be executed simultaneously, or step S401 can be executed first and then step S402, or step S402 can be executed first and then step S401.

[0147] In some embodiments of the present disclosure, in response to detecting that the driving device is in a parked state, it is predicted whether the action that the object is about to take is dangerous based on the environmental information and the action information.

[0148] For example, the driving device detects the speed of the driving device through a speed sensor. If the speed of the driving device is 0, it indicates that the driving device is in a parked state.

[0149] In some embodiments of the present disclosure, predicting whether an object's upcoming action is dangerous based on environmental information and action information includes:

[0150] Based on the action information, step S403 includes: predicting whether the action to be taken includes opening the door of the driving device; and in response to the action to be taken including opening the door, predicting whether there is a danger in opening the door based on the environmental information.

[0151] FIG5 shows a flowchart of another early warning method provided by at least one embodiment of the present disclosure.

[0152] As shown in FIG5 , the early warning method includes steps S501 to S509 .

[0153] Step S501: Acquire the initial state of the driving device. For example, the processing system or the speed sensor detects whether the speed of the driving device is 0. If the speed of the driving device is 0, the driving device is in a parked state.

[0154] Step S502: Collecting information about people inside the vehicle. People inside the vehicle are those inside the driving device. For example, this information is collected using a camera. For example, this information may include information about the people's movements and the number of people inside. Step S502 is similar to step S401 in FIG. 4 .

[0155] Step S503: Determine whether the occupant intends to exit the vehicle. For example, a camera is used for behavior recognition to predict the passenger's intention to exit. Pressure sensors attached to the interior handles are used to detect whether the passenger has attempted to open the door. Ultimately, the passenger's intention to exit and the degree of their intention to exit are determined. If the occupant intends to exit, step S504 is executed. If not, the process returns to step S501.

[0156] Step S504: For example, the environment information outside the vehicle window is collected by a camera or a laser radar, and the environment information is sent to the processing system in real time. Step S504 is similar to step S402 in FIG4 .

[0157] Step S505: For example, the processing system determines whether a traffic participant exists in the environment based on the environmental information. If a traffic participant exists, steps S506 and S507 are further executed. If no traffic participant exists, the processing returns to step S504 to continuously monitor whether a traffic participant exists.

[0158] Step S506: Acquire the status information of the traffic participant objects.

[0159] Step S507: The processing system further predicts the behavior of the people in the car.

[0160] Step S508: Comprehensively determine the door opening risk based on the status information and behavior prediction results

[0161] Step S509: Displaying instruction information according to the determination result of the danger level.

[0162] In some embodiments of the present disclosure, for step S509, the instruction information includes, for example, third prompt information indicating that the vehicle door can be opened safely and first prompt information.

[0163] For example, if the processing system determines that there are no traffic participants on the vehicle door's open side, the third prompt message, such as in area D in Figure 2A or Figure 2B, will be displayed in the dimming glass, indicating that the door can be opened safely. The voice warning system will also prompt the user to open the door safely. For another example, if the processing system determines that there is a traffic participant on the vehicle door's open side and that the traffic participant is within a safe speed range, area D will display an indication message, such as one that flashes from slow to fast and changes color from light to dark based on the traffic participant's actual speed. Simultaneously, the voice warning system will activate, providing a notification about the type and status of the traffic participant on the vehicle's side and urging the user to open the door and observe carefully. For another example, if the processing system determines that there is a traffic participant on the vehicle door's open side and that the traffic participant is not within a safe speed range, area B or area C will display the first prompt message described above, flashing darkly and rapidly based on the traffic participant's actual speed, to alert the vehicle occupants and traffic participants. The voice warning system will also activate, providing a notification about the type and status of the traffic participant on the vehicle's side. The door control system will also be activated. When the door opening angle is small, you can directly brake to lock the door or increase the resistance to the door opening to delay the door opening and prevent collision. In addition, when the door opening angle is large, it is easy to cause a collision. At this time, the door warning system will turn on the emergency mode and pop out an airbag or softer material from the metal position of the door to cover the door and increase impact cushioning.

[0164] In some embodiments of the present disclosure, the above-mentioned driving device may be a family car, an unmanned vehicle, etc. The embodiments of the present disclosure do not specifically limit the type of driving device.

[0165] The steps of the warning method provided in the embodiments of the present disclosure correspond to the various systems, modules, or units of the aforementioned driving device. For details about the warning method, please refer to the relevant description of the driving device and will not be repeated here. The components and structure of the driving device 100 shown in Figure 1 are merely exemplary and non-limiting. The driving device 100 may also include other components and structures as needed.

[0166] FIG6 shows a schematic block diagram of an early warning device 600 provided by at least one embodiment of the present disclosure.

[0167] For example, as shown in FIG6 , the early warning device 600 includes a first acquisition unit 610 , a second acquisition unit 620 , a prediction unit 630 and a control unit 640 .

[0168] The first acquisition unit 610 is configured to acquire environmental information of the environment in which the driving device is located. The first acquisition unit 410 may, for example, execute step S401 described in FIG4 .

[0169] The second acquisition unit 620 is configured to acquire motion information of an object located inside the driving device. The second acquisition unit 620 may, for example, execute step S402 described in FIG. 4 .

[0170] The prediction unit 630 is configured to predict whether the object's upcoming action is dangerous based on the environment information and the action information. The prediction unit 630 may, for example, execute step S403 described in FIG4 .

[0171] The control unit 640 is configured to control the transmittance of the switchable glass in response to the danger of the impending action, so as to display the first prompt information through the switchable glass. The control unit 640 may, for example, execute step S404 described in FIG4 .

[0172] For example, the first acquisition unit 610, the second acquisition unit 620, the prediction unit 630, and the control unit 640 may be hardware, software, firmware, or any feasible combination thereof. For example, the first acquisition unit 610, the second acquisition unit 620, the prediction unit 630, and the control unit 640 may be dedicated or general-purpose circuits, chips, or devices, or may be a combination of a processor and memory. The embodiments of the present disclosure do not limit the specific implementation of each of the above-mentioned units.

[0173] It should be noted that in the embodiments of the present disclosure, the various units of the early warning device 600 correspond to the various steps of the aforementioned early warning method. For the specific functions of the early warning device 600, reference can be made to the relevant description of the early warning method, and no further details will be given here. The components and structure of the early warning device 600 shown in FIG6 are merely exemplary and non-limiting. The early warning device 600 may also include other components and structures as needed.

[0174] At least one embodiment of the present disclosure further provides an electronic device comprising switchable glass, a processor, and a memory, wherein the memory includes one or more computer program modules. The one or more computer program modules are stored in the memory and configured to be executed by the processor, and the one or more computer program modules include instructions for implementing the aforementioned early warning method. The electronic device is capable of at least partially preventing the occurrence of dangerous accidents.

[0175] Figure 7 is a schematic block diagram of an electronic device provided in some embodiments of the present disclosure. As shown in Figure 7, the electronic device 700 includes a processor 710 and a memory 720. The memory 720 is used to store non-transitory computer-readable instructions (e.g., one or more computer program modules). The processor 710 is used to run non-transitory computer-readable instructions, and when the non-transitory computer-readable instructions are run by the processor 710, one or more steps in the early warning method described above can be executed. The memory 720 and the processor 710 can be interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0176] For example, the processor 710 may be a central processing unit (CPU), a graphics processing unit (GPU), or other processing units having data processing capabilities and / or program execution capabilities. For example, the central processing unit (CPU) may be an X76 or ARM architecture. The processor 710 may be a general-purpose processor or a dedicated processor, and may control other components in the electronic device 700 to perform desired functions.

[0177] For example, the memory 720 may include any combination of one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), a hard disk, an erasable programmable read-only memory (EPROM), a portable compact disk read-only memory (CD-ROM), a USB memory, a flash memory, etc. One or more computer program modules may be stored on the computer-readable storage medium, and the processor 710 may execute one or more computer program modules to implement various functions of the electronic device 700. Various applications and various data, as well as various data used and / or generated by the applications, may also be stored in the computer-readable storage medium.

[0178] It should be noted that, in the embodiment of the present disclosure, the specific functions and technical effects of the electronic device 700 can be referred to the description of the early warning method above, and will not be repeated here.

[0179] Figure 8 is a schematic block diagram of another electronic device provided in some embodiments of the present disclosure. This electronic device 900 is suitable for implementing the early warning method provided in embodiments of the present disclosure, for example. The electronic device 800 may be a terminal device, etc. It should be noted that the electronic device 800 shown in Figure 8 is merely an example and does not impose any limitations on the functionality and scope of use of the embodiments of the present disclosure.

[0180] As shown in FIG8 , the electronic device 800 may include a processing device (e.g., a central processing unit, a graphics processing unit, etc.) 810, which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 820 or a program loaded from a storage device 880 into a random access memory (RAM) 830. Various programs and data required for the operation of the electronic device 800 are also stored in the RAM 830. The processing device 810, the ROM 820, and the RAM 830 are connected to each other via a bus 840. An input / output (I / O) interface 850 is also connected to the bus 840.

[0181] Typically, the following devices may be connected to the I / O interface 850: an input device 860 including, for example, a touch screen, a touchpad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; an output device 870 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; a storage device 880 including, for example, a magnetic tape, a hard disk, etc.; and a communication device 890. The communication device 890 may allow the electronic device 800 to communicate with other electronic devices wirelessly or by wire to exchange data. Although FIG8 shows the electronic device 800 with various devices, it should be understood that it is not required to implement or have all of the devices shown, and the electronic device 800 may alternatively implement or have more or fewer devices.

[0182] For example, according to an embodiment of the present disclosure, the above-mentioned early warning method can be implemented as a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program carried on a non-transitory computer-readable medium, and the computer program includes a program code for executing the above-mentioned early warning method. In such an embodiment, the computer program can be downloaded and installed from the network through the communication device 890, or installed from the storage device 880, or installed from the ROM 820. When the computer program is executed by the processing device 810, the functions defined in the early warning method provided in the embodiment of the present disclosure can be implemented.

[0183] At least one embodiment of the present disclosure further provides a computer-readable storage medium for storing non-transitory computer-readable instructions that, when executed by a computer, implement the aforementioned early warning method. This computer-readable storage medium can at least partially prevent the occurrence of dangerous accidents.

[0184] Figure 9 is a schematic diagram of a storage medium provided by some embodiments of the present disclosure. As shown in Figure 9, storage medium 900 is used to store non-transitory computer-readable instructions 910. For example, when non-transitory computer-readable instructions 910 are executed by a computer, one or more steps of the early warning method described above can be performed.

[0185] For example, the storage medium 900 can be applied to the electronic device 700 described above. For example, the storage medium 900 can be the memory 720 in the electronic device 700 shown in FIG7 . For example, the relevant description of the storage medium 900 can refer to the corresponding description of the memory 720 in the electronic device 700 shown in FIG7 , and will not be repeated here.

[0186] There are a few points to note:

[0187] (1) The drawings of the embodiments of the present disclosure only relate to the structures involved in the embodiments of the present disclosure. Other structures may refer to conventional designs.

[0188] (2) In the absence of conflict, the embodiments of the present disclosure and the features therein may be combined with each other to form new embodiments.

[0189] The above description is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. The protection scope of the present disclosure shall be based on the protection scope of the claims.

Claims

1. An early warning system for a driving device, comprising: A display system, an external vehicle information acquisition system, an internal vehicle information acquisition system, and a processing system, wherein the display system includes a dimming glass, the dimming glass includes a plurality of display areas, and the external vehicle information acquisition system, the internal vehicle information acquisition system, and the display system are respectively coupled to the processing system, the external vehicle information acquisition system is configured to acquire environmental information of the environment where the driving device is located and provide the environmental information to the processing system; the internal vehicle information acquisition system is configured to acquire motion information of an object located inside the driving device and provide the motion information to the processing system; and the processing system is configured to predict whether there is a danger in the motion that the object is about to perform based on the environmental information and the motion information; and in response to the motion that is about to occur being dangerous, control the light transmittance of the dimming glass to display a first prompt message through the dimming glass, wherein the first prompt message includes a plurality of parts, and each of the plurality of display areas is used to display one of the plurality of parts.

2. The warning system according to claim 1, wherein, The side window glass or the windshield of the driving device is the dimming glass, wherein, when the driving device is driving safely, the dimming glass is in a light-transmitting state.

3. The warning system according to claim 1 or 2, wherein The processing system is further configured to: During the driving of the driving device, predict whether there is a danger in the driving of the driving device based on the driving state of the driving device and the environmental information; and In response to the driving of the driving device being dangerous, control the light transmittance of the dimming glass to display a second prompt message through the dimming glass.

4. The warning system according to any one of claims 1 to 3, wherein the processing system is configured to: Predict whether the motion that is about to occur includes opening the door of the driving device based on the motion information; and In response to the motion that is about to occur including opening the door, predict whether there is a danger in opening the door based on the environmental information.

5. The warning system according to claim 4, wherein, The external vehicle information acquisition system includes a speed sensor configured to acquire the speed of traffic participants in the environment, and the external vehicle information acquisition system includes a distance sensor configured to acquire the distance between traffic participants in the environment and the door, The processing system is configured to: Predict whether there is a danger in opening the door based on the distance and the speed.

6. The warning system according to any one of claims 1 to 5, wherein, The internal vehicle information acquisition system includes: An in-vehicle camera configured to collect image information of the object; and A pressure sensor, wherein the pressure sensor is located on the door opening / closing device or the seat belt opening / closing device, and the pressure sensor is configured to detect pressure information of the door opening / closing device or the seat belt opening / closing device, wherein the motion information at least includes the image information and the pressure information, The processing system is configured to: Receive the image information and the pressure information provided by the internal vehicle information acquisition system; and Predict whether the motion that is about to occur includes opening the door based on the image information and the pressure information.

7. The warning system according to any one of claims 1 to 6, wherein, The multiple display areas include a first area, a second area, a third area, and a fourth area. The multiple parts include a real-time image of the environment, status information of traffic participating objects in the environment, a first warning message, and a second warning message. The first warning message is used to prompt whether there is a safety hazard behind the vehicle door, and the second warning message is used to prompt whether there is a safety hazard in front of the vehicle door. The first area is configured to display the real-time image, the second area is configured to display the status information, the third area is configured to display the first warning message, and the fourth area is configured to display the second warning message.

8. The warning system according to claim 7, wherein, The third area includes a first pixel unit, and the fourth area includes a second pixel unit. The first warning message includes the flashing frequency or flashing color of the first pixel unit. The second warning message includes the flashing frequency or flashing color of the second pixel unit.

9. The warning system according to claim 8, wherein, The processing system is further configured to: In response to the upcoming action being dangerous, determine the urgency of the danger; and determine the first warning message and the second warning message according to the urgency. Wherein, the higher the urgency, the higher the flashing frequency, or the higher the urgency, the darker the flashing color.

10. The warning system according to any one of claims 7 to 9, wherein, The processing system is further configured to: Determine the visual height of the object according to the action information; and Adjust the layout of the first area, the second area, the third area, and the fourth area in the dimming glass according to the visual height.

11. The warning system according to claim 10, wherein, When the visual height is lower than the height threshold, the third area and the fourth area are located below the second area. When the visual height is higher than or equal to the height threshold, the third area and the fourth area are located above the second area.

12. The warning system according to any one of claims 1 to 11, wherein, The display system further includes a driving logic control module. The processing system is configured to provide a control signal to the driving logic control module, wherein the control signal is used to control the light transmittance of the dimming glass. The driving logic control module is configured to generate a driving signal according to the control signal and provide the driving signal to the dimming glass to drive the dimming glass to display the first prompt message.

13. The warning system according to any one of claims 1 to 12, wherein, The warning system further includes a vehicle door control system. The processing system is further configured to provide a control instruction to the vehicle door control system when the danger meets a preset condition. The vehicle door control system is configured to: control the vehicle door according to the control instruction.

14. The warning system according to claim 13, wherein, The preset condition includes that the vehicle door is opened at a first angle. The processing system is configured to: Provide a first type of the control instruction to the vehicle door control system. The first type of the control instruction is used to control the vehicle door to lock or increase the resistance to opening the vehicle door, where the first angle is less than a preset angle.

15. The warning system according to claim 14, wherein, The preset condition further includes: the vehicle door is opened at a second angle. The processing system is configured to: Provide the second type of the control instruction to the door control system, where the second type of the control instruction is used to turn on the emergency mode of the door, and wherein the second angle is greater than or equal to the preset angle.

16. The warning system according to claim 15, wherein, The door control system is configured to pop out a buffer component of the door in the emergency mode.

17. The warning system according to any one of claims 1 to 16, further comprising: A voice warning system configured to receive a processing signal provided by the processing system, where the processing signal is used to indicate whether the upcoming action is dangerous; and in response to whether the upcoming action is dangerous, play a voice prompt message.

18. A driving device comprising the warning system according to any one of claims 1 to 17.

19. A warning method applied to a driving device, wherein, The warning system includes a dimming glass, the dimming glass includes a plurality of display areas, and the method includes: Obtain environmental information of the environment where the driving device is located; Obtain motion information of an object located inside the driving device; Predict whether the upcoming action of the object is dangerous according to the environmental information and the motion information; and In response to the upcoming action being dangerous, control the light transmittance of the dimming glass to display a first prompt message through the dimming glass, wherein the first prompt message includes a plurality of parts, and each of the plurality of display areas is used to display one of the plurality of parts.

20. The method according to claim 19, further comprising: In response to detecting that the driving device is in a parked state, predict whether the upcoming action of the object is dangerous according to the environmental information and the motion information.

21. The method according to claim 19 or 20, wherein Predicting whether the upcoming action of the object is dangerous according to the environmental information and the motion information includes: Predict whether the upcoming action includes opening the door of the driving device according to the motion information; and In response to the upcoming action including opening the door, predict whether there is danger in opening the door according to the environmental information.

22. An electronic device, comprising: A dimming glass; A processor; A memory including one or more computer program instructions; wherein the one or more computer program instructions are stored in the memory and, when executed by the processor, implement the instructions of a warning method, and the warning method includes: Obtain environmental information of the environment where the driving device is located; Obtain motion information of an object located inside the driving device; Predict whether the upcoming action of the object is dangerous according to the environmental information and the motion information; and In response to the upcoming action being dangerous, control the light transmittance of the dimming glass to display a first prompt message through the dimming glass.

23. A computer-readable storage medium that non-temporarily stores computer-readable instructions, wherein, When the computer-readable instructions are executed by the processor, the warning method according to any one of claims 19-21 is implemented.

24. A computer program product comprising computer program / instructions, where the computer program / instructions, when executed by a processor, implement the warning method according to any one of claims 19-21.

Images