Vehicle system and method for notifying vehicle occupant of nearby emergency vehicle
By using surrounding environment information detection sensors and processing circuits in the vehicle system, emergency vehicles are detected and notified vehicle occupants are solved, and the problem of difficult to notice emergency vehicles in busy traffic is achieved, achieving the effect of assisting vehicle occupants to drive safely.
Patent Information
- Application Number
- CN202380072411.9
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-10-17
- Filing Date
- 2023-10-13
- Publication Date
- 2025-05-23
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
In busy traffic conditions, it is difficult for vehicle occupants to notice the approaching emergency vehicles, resulting in possible dangerous situations.
A vehicle system is designed to obtain environmental information data around the vehicle and occupants through the surrounding environment information detection sensor, and analyze it using processing circuits to detect emergency vehicles and determine notification values. When the notification value is above a predefined threshold, the system notifies the vehicle occupant of an emergency vehicle.
Auxiliary vehicle occupants pay attention to nearby emergency vehicles to reduce the dangers caused by failure to detect emergency vehicles in time.
Smart Images

Figure CN120035852A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a method, vehicle system, and computer program product for notifying a vehicle occupant of a vehicle of a nearby emergency vehicle. Background Art
[0002] Emergency vehicles typically utilize flashing lights and sirens to enable vehicle occupants in surrounding vehicles to more easily detect the emergency vehicle so as to give way and space to the emergency vehicle at the appropriate time in a controlled and smooth manner.
[0003] However, it may sometimes be difficult to notice an approaching emergency vehicle, or to notice where an approaching emergency vehicle is and whether to leave room for it, such as in the presence of heavy traffic and other conditions in the vehicle occupants' surroundings.
[0004] Failure to promptly notice an approaching emergency vehicle, or failure to notice an approaching emergency vehicle at all, may result in an undesirable situation for both the vehicle occupants and the emergency vehicle.
[0005] Therefore, it is desirable to alert vehicle occupants of a vehicle to nearby emergency vehicles. Summary of the invention
[0006] An object of the present disclosure is to mitigate, alleviate or eliminate one or more of the above-mentioned deficiencies and disadvantages in the prior art, and to at least solve the above-mentioned problems.
[0007] According to a first aspect, a vehicle system for notifying a vehicle occupant of a vehicle of a nearby emergency vehicle is provided.
[0008] The system includes: a surrounding environment information detection sensor configured to acquire surrounding environment information data around the vehicle and the vehicle occupants.
[0009] The system also includes a processing circuit configured to acquire surrounding environment information data around the vehicle and the vehicle occupants.
[0010] The processing circuit is also configured to detect an emergency vehicle in the vicinity of the vehicle based on the acquired surrounding environment information data.
[0011] The processing circuit is further configured to determine a notification value based on the acquired surrounding information data, and to notify vehicle occupants of the emergency vehicle when the notification value is determined to be higher than a predefined threshold level.
[0012] An advantage of this first aspect is that when it is determined that the vehicle occupants need to be notified of the emergency vehicle, the vehicle system can be used to assist the vehicle occupants in being aware of the nearby emergency vehicle.
[0013] According to some embodiments, the surrounding environment information data is at least any one of sound data, image data, map data, traffic information data, population density data, road information data, emergency vehicle detection data, and weather information data.
[0014] An advantage of this embodiment is that different surrounding information data can be used to determine when to notify the vehicle occupants of an emergency vehicle.
[0015] According to some embodiments, the acquired surrounding information data indicates that the vehicle is in an urban environment and the notification value is set to a value higher than a predefined threshold level.
[0016] An advantage of this embodiment is that if the vehicle is in an urban environment, the vehicle occupants will be notified of the presence of an emergency vehicle.
[0017] According to some embodiments, the acquired surrounding information data indicates that the emergency vehicle is not visible to a vehicle occupant of the vehicle and the notification value is set to a value higher than a predefined threshold level.
[0018] An advantage of this embodiment is that when it is determined that the emergency vehicle cannot be observed by the vehicle occupants, the vehicle occupants will be notified of the presence of the emergency vehicle.
[0019] According to some embodiments, the notification value is associated with a cognitive load value, and wherein the processing circuit is further configured to determine a cognitive load value based on the acquired surrounding information data, wherein the cognitive (perceptual) load value indicates whether the acquired surrounding information data is determined to have an impact on the insight of the vehicle occupant, and when it is determined that the cognitive load value is higher than a predefined threshold level, the notification value is set to a value higher than the predefined threshold level.
[0020] An advantage of this embodiment is that when it is determined that the vehicle occupant's insight is impaired, the vehicle occupant will be notified of the emergency vehicle.
[0021] According to some embodiments, the cognitive load value is determined based on ambient information data about the exterior and / or interior of the vehicle.
[0022] An advantage of this embodiment is that ambient information data of the vehicle's external surroundings (eg, traffic jams, large numbers of pedestrians) and / or the vehicle's internal surroundings (eg, noise inside the vehicle) can be used to determine the cognitive load value.
[0023] According to some embodiments, the system further comprises: an output interface for notifying vehicle occupants of emergency vehicles near the vehicle, wherein the output interface is any one of the following interfaces: a display output interface, a sound output interface, a tactile output interface, a light output interface.
[0024] One advantage of this embodiment is that the vehicle occupants can see, feel and / or hear the notification.
[0025] According to some embodiments, the processing circuit is further configured to notify the vehicle occupants via a directional information notification indicating the direction of the emergency vehicle relative to the vehicle.
[0026] An advantage of this embodiment is that the vehicle occupants are assisted in determining the direction in which the emergency vehicle may be found.
[0027] According to a second aspect, a method for notifying a vehicle occupant of a nearby emergency vehicle is provided.
[0028] The method comprises the following steps: acquiring surrounding environment information data around the vehicle and the vehicle occupants.
[0029] The method further comprises the following steps: based on the acquired surrounding environment information data, detecting an emergency vehicle near the vehicle,
[0030] The method further includes the steps of determining a notification value based on the acquired surrounding information data, and notifying a vehicle occupant of the emergency vehicle when the notification value is determined to be higher than a predefined threshold level.
[0031] An advantage of this second aspect is that when it is determined that the vehicle occupants need to be notified of the emergency vehicle, the vehicle system can be used to assist the vehicle occupants in being aware of the nearby emergency vehicle.
[0032] According to some embodiments, the surrounding environment information data is at least any one of the following data: sound data, image data, map data, traffic information data, population density data, road information data and weather information data.
[0033] An advantage of this embodiment is that different surrounding information data can be used to determine when to notify the vehicle occupants of an emergency vehicle.
[0034] According to some embodiments, the acquired surrounding information data indicates that the vehicle is in an urban environment and the notification value is set to a value higher than a predefined threshold level.
[0035] An advantage of this embodiment is that if the vehicle is in an urban environment, the vehicle occupants will be notified of the presence of an emergency vehicle.
[0036] According to some embodiments, the acquired surrounding information data indicates that the emergency vehicle is not visible to a vehicle occupant of the vehicle and the notification value is set to a value higher than a predefined threshold level.
[0037] An advantage of this embodiment is that when it is determined that the emergency vehicle cannot be observed by the vehicle occupants, the vehicle occupants will be notified of the presence of the emergency vehicle.
[0038] According to some embodiments, the notification value is associated with a cognitive load value, and the method further includes: determining a cognitive load value based on the acquired surrounding information data, wherein the cognitive load value indicates whether the acquired surrounding information data is determined to have an impact on the insight of the vehicle occupant, and when it is determined that the cognitive load value is higher than a predefined threshold level, setting the notification value to a value higher than the predefined threshold level.
[0039] An advantage of this embodiment is that when it is determined that the vehicle occupant's insight is impaired, the vehicle occupant will be notified of the emergency vehicle.
[0040] According to some embodiments, the method further comprises notifying a vehicle occupant via a directional information notification indicating a direction of the emergency vehicle relative to the vehicle.
[0041] An advantage of this embodiment is that the vehicle occupants are assisted in determining the direction in which the emergency vehicle may be found.
[0042] According to a third aspect, there is provided a computer program product comprising a non-transitory computer-readable medium, on which is a computer program comprising program instructions, which can be loaded into a processing circuit and is configured to cause the method to be performed when the computer program is run by the processing circuit.
[0043] The effects and features of the second and third aspects are largely similar to those described above in connection with the first aspect. The embodiments mentioned in connection with the first aspect are widely compatible with the second and third aspects.
[0044] The present disclosure will become apparent from the detailed description given below. The detailed description and specific embodiments disclose preferred embodiments of the present disclosure only by way of example. According to the guidance in the detailed description, those skilled in the art will appreciate that changes and modifications can be made within the scope of the present disclosure.
[0045] Therefore, it should be understood that the disclosure disclosed herein is not limited to the specific components of the described device or the steps of the described method, because such devices and methods are changeable. It should also be understood that the terms used in this article are only for describing specific embodiments and are not intended to be limiting. It should be noted that when used in the specification and the appended claims, the articles "one", "an", "the" and "said" are intended to indicate the presence of one or more elements unless the context clearly stipulates otherwise. Therefore, for example, references to "a unit" or "the unit" can include several devices, etc. In addition, the words "comprise", "include", "contain" and similar words do not exclude other elements or steps. BRIEF DESCRIPTION OF THE DRAWINGS
[0046] The above and other objects, features, and advantages of the present disclosure will be more fully understood by referring to the following illustrative and non-limiting detailed description of exemplary embodiments of the present disclosure when taken in conjunction with the accompanying drawings.
[0047] Figure 1 An exemplary vehicle system for notifying vehicle occupants of a vehicle of a nearby emergency vehicle is shown in accordance with an embodiment of the present disclosure.
[0048] Figure 2a An example is shown in which the surrounding environment information detection sensor is a camera and the surrounding environment information data is image data.
[0049] Figure 2b An example is shown, in which the surrounding environment information detection sensor is a wireless communication interface and the surrounding environment information data is any one of the following data: map data, traffic information data, population density data, road information data, emergency vehicle detection data, and weather information data.
[0050] Figure 3 Flowchart showing method steps according to the second aspect of the present disclosure.
[0051] Figure 4 A computer program product according to a third aspect of the present disclosure is shown. DETAILED DESCRIPTION
[0052] The present disclosure will now be described with reference to the accompanying drawings, in which preferred exemplary embodiments of the present disclosure are shown. However, the present disclosure may be implemented in other forms and should not be construed as being limited to the embodiments disclosed herein. The disclosed embodiments are provided to fully convey the scope of the present disclosure to those skilled in the art.
[0053] Figure 1 An exemplary vehicle system for notifying vehicle occupants of a vehicle of a nearby emergency vehicle is shown in accordance with an embodiment of the present disclosure.
[0054] A first aspect of the present disclosure illustrates a vehicle system 100 for notifying a vehicle occupant 5 of a vehicle 1 of a nearby emergency vehicle 2 .
[0055] The system 100 includes surrounding environment information detection sensors 20a, 20b, 20c.
[0056] According to some embodiments, the surrounding environment information detection sensors 20a, 20b, 20c are at least any one of the following: camera sensors 20a, 20b, lidar sensors, radar sensors, sonar sensors, microphones, and wireless communication interfaces 20c.
[0057] Figure 1 An exemplary vehicle system 100 having multiple surrounding information detection sensors is shown. Figure 1 In the exemplary vehicle system 100 shown, the surrounding environment information detection sensors are an external camera sensor 20a, an internal camera sensor 20b, and a wireless communication interface 20c.
[0058] The surrounding environment information detection sensors 20 a , 20 b , 20 c are configured to be able to acquire surrounding environment information data around the vehicle 1 and the vehicle occupant 5 .
[0059] The system 100 includes processing circuits 102 a , 102 b , 102 c configured to acquire surrounding environment information data around the vehicle 1 and the vehicle occupant 5 .
[0060] The processing circuits 102a, 102b, 102c are further configured to detect an emergency vehicle 2 near the vehicle 1 based on the acquired surrounding environment information data.
[0061] According to some embodiments, the surrounding environment information detection sensors 20a, 20b, 20c are operably connected to the processing circuits 102a, 102b, 102c.
[0062] According to some embodiments, Figure 1 As shown, processing circuit 102a is the processing circuit of an onboard vehicle computer.
[0063] According to some embodiments, Figure 1 As shown, the processing circuits 102 b , 102 c are included in electronic devices 200 , 300 that can be connected to the vehicle system 100 via a wireless communication network 50 .
[0064] According to some embodiments, the vehicle system 100 further comprises a memory 101a, 101b, 101c configured to store data.
[0065] According to some embodiments, Figure 1As shown, the memory 101a is the memory of the vehicle computer on board. According to some embodiments, as Figure 1 As shown, the memories 101 b , 101 c are included in electronic devices 200 , 300 that can be connected to the vehicle system 100 via the wireless communication network 50 .
[0066] According to some embodiments, Figure 1 The wireless communication network 50 shown is a standard wireless wide area network, such as Global System for Mobile communications GSM, extended GSM, General Radio Packet Service GPRS, Enhanced Data Rates for GSM Evolution EDGE, Wideband Code Division Multiple Access WCDMA, Long Term Evolution LTE, narrowband IoT, 5G, Worldwide Interoperability for Microwave Access WiMAX or Ultra Mobile Broadband UMB, or similar networks.
[0067] According to some embodiments, the wireless communication network 50 is a standardized wireless local area network, such as wireless local area network, WLAN, Bluetooth TM , ZigBee, Ultra-Wideband, Radio Frequency Identification RFID, or similar networks.
[0068] According to some embodiments, the wireless communication network 50 may also be a combination of both a local area network and a wide area network.
[0069] According to some embodiments, the wireless communication network 50 is defined by the public Internet protocol.
[0070] According to some embodiments, the emergency vehicle 2 is detected by analyzing the acquired surrounding environment information data.
[0071] According to some embodiments, the emergency vehicle 2 is detected by performing sound analysis on the acquired sound data. According to some embodiments, the sound data is analyzed by comparing the acquired sound data with predetermined sound data of the emergency vehicle. In one example, a predetermined frequency of the siren sound of the emergency vehicle is used to detect the emergency vehicle 2.
[0072] According to some embodiments, the emergency vehicle 2 is detected by performing image analysis on the acquired image data. According to some embodiments, the image data is analyzed by comparing the acquired image data with predetermined image data of the emergency vehicle. In one example, a predetermined model and color of the emergency vehicle is pre-identified and used to detect the emergency vehicle 2.
[0073] According to some embodiments, the emergency vehicle 2 is detected by analyzing the acquired traffic information data.
[0074] According to some embodiments, the traffic information data is analyzed by determining the speed and driving mode of the vehicle in the acquired traffic information data to determine whether the vehicle is traveling at a faster speed and / or in a driving mode that is different from other vehicles. In one example, a vehicle that travels at a higher speed and changes lanes more frequently than other vehicles can be interpreted as an emergency vehicle 2.
[0075] According to some embodiments, the traffic information data is acquired via the wireless communication interface 20c.
[0076] According to some embodiments, the emergency vehicle 2 is detected by analyzing the acquired emergency vehicle detection data.
[0077] According to some embodiments, the emergency vehicle detection data includes: identification information of the emergency vehicle, the current geographic location and / or direction of the emergency vehicle 2, the destination of the emergency vehicle 2, the planned route of the emergency vehicle 2, alternative routes of the emergency vehicle 2, and at least any one of the speed of the emergency vehicle 2.
[0078] According to some embodiments, emergency vehicle detection data is acquired via the wireless communication interface 20c.
[0079] According to some embodiments, the wireless communication interface 20c communicates with a wireless communication network 50, which is connected to a communication system, such as a vehicle-to-vehicle (V2V) communication system, a vehicle-to-everything (V2X) communication system, or a vehicle-to-infrastructure (V2I) communication system.
[0080] According to some embodiments, the processing circuits 102a, 102b, 102c are further configured to detect a direction of the detected emergency vehicle 2 relative to the vehicle 1 based on the acquired surrounding environment information data.
[0081] According to some embodiments, the sound data is used to detect the direction of the detected emergency vehicle 2 relative to the vehicle 1. According to some embodiments, the surrounding information detection sensors 20a, 20b, 20c are sonar sensors configured to determine the direction of the acquired sound data.
[0082] According to some embodiments, the image data is used to detect the direction of the detected emergency vehicle 2 relative to the vehicle 1. According to some embodiments, the surrounding information detection sensors 20a, 20b, 20c are camera sensors configured to determine the direction of the acquired image data.
[0083] According to some embodiments, detecting the emergency vehicle 2 near the vehicle 1 further comprises: detecting a direction of the detected emergency vehicle 2 relative to the vehicle 1 .
[0084] The processing circuits 102a, 102b, 102c are further configured to determine a notification value based on the acquired surrounding information data and notify the vehicle occupant 5 of the emergency vehicle 2 when the notification value is determined to be higher than a predefined threshold level.
[0085] According to some embodiments, the notification value is based on a plurality of different ambient information data.
[0086] According to some embodiments, the notification value is a sum of a function equation that depends on a plurality of different ambient information data.
[0087] According to some embodiments, different ambient environment information data may be assigned different weights in a function equation that depends on a plurality of different ambient environment information data.
[0088] An advantage of this first aspect is that when it is determined that the vehicle occupants need to be notified of the emergency vehicle, the vehicle system can be used to assist the vehicle occupants in being aware of the nearby emergency vehicle.
[0089] According to some embodiments, the surrounding environment information data is at least any one of the following data: sound data, image data, map data, traffic information data, population density data, road information data, emergency vehicle detection data, and weather information data.
[0090] According to some embodiments, the notification value is the sum of a function equation that depends on multiple different surrounding environment information data, and the different surrounding environment information data are at least two of sound data, image data, map data, traffic information data, population density data, road information data, emergency vehicle detection data and weather information data.
[0091] In one example, the notification value is determined based on emergency vehicle detection data and weather information data.
[0092] In one example, the emergency vehicle detection data is used to detect that an emergency vehicle is on the same road as the vehicle 1, which generates a certain notification value, and further, the weather information data indicates heavy rain, which generates another specific notification value, and the notification value that is dependent on the sum of a functional equation of a plurality of different ambient information data is determined to be higher than a predefined threshold level. Thus, the vehicle occupants are notified by the system 100.
[0093] In one example, the emergency vehicle detection data is used to detect that the emergency vehicle is not on the same road as the vehicle 1, which generates a certain notification value, and the weather information data indicates that the sky is clear and sunny, which generates another specific notification value, and the notification value that depends on the sum of the functional equations of the plurality of different ambient information data is determined to be below a predefined threshold level. Therefore, the vehicle occupants are not notified by the system 100.
[0094] An advantage of this embodiment is that different surrounding information data can be used to determine when to notify vehicle occupants of an emergency vehicle.
[0095] According to some embodiments, the acquired surrounding information data indicates that the vehicle 1 is in an urban environment and the notification value is set to a value higher than a predefined threshold level.
[0096] According to some embodiments, the vehicle 1 is determined to be in an urban environment based on the acquired surrounding environment information data being at least one of map data and population density data. In one example, the vehicle 1 is determined to be at a geographical location within a city boundary.
[0097] According to some embodiments, it is determined that the vehicle 1 is in an urban environment based on the acquired surrounding environment information data being image data. In one example, image processing is used to determine that objects in the image data are indicative of urban objects.
[0098] In cities, vehicle occupants typically need to pay attention to more information in their surroundings than when they are in rural areas.
[0099] An advantage of this embodiment is that if the vehicle is in an urban environment, the vehicle occupants will be notified of the presence of an emergency vehicle.
[0100] According to some embodiments, the acquired surrounding information data indicates that the emergency vehicle 2 is not visible to the vehicle occupant 5 of the vehicle 1 and the notification value is set to a value higher than a predefined threshold level.
[0101] According to some embodiments, the surrounding environment information data is image data acquired by the camera 20a.
[0102] According to some embodiments, the camera 20 a is arranged at a predetermined position of the vehicle 1 .
[0103] According to some embodiments, the camera 20 a is arranged at a predetermined position of the vehicle 1 relative to the vehicle occupants in the vehicle 1 .
[0104] According to some embodiments, through processing of the image data it can be determined what a vehicle occupant might see and whether the emergency vehicle is considered to be invisible to a vehicle occupant of the vehicle 1 .
[0105] In an exemplary embodiment, the surrounding information detection sensor is a camera 20a, and by knowing the vertical distance between the camera 20a and the eye level of the vehicle occupant, the vehicle system can estimate whether the driver's field of view is blocked although the camera's field of view is not blocked.
[0106] Figure 2a An example is shown in which the surrounding environment information detection sensor is a camera and the surrounding environment information data is image data.
[0107] exist Figure 2a In the exemplary illustration in , the blocked vehicle 3 prevents the vehicle occupant 5 of the vehicle 1 from seeing the emergency vehicle 2. By knowing the vertical distance between the camera 20a and the eye level of the vehicle occupant 5, the vehicle system 100 can estimate whether the driver's field of view is blocked.
[0108] According to some embodiments, the surrounding environment information data is any one of map data, road information data, emergency vehicle detection data and weather information data and is capable of determining whether the emergency vehicle is considered to be invisible to vehicle occupants of the vehicle 1 .
[0109] Figure 2b An example is shown, in which the surrounding environment information detection sensor is a wireless communication interface, and the surrounding environment information data is at least any one of the following data: map data, traffic information data, population density data, road information data, emergency vehicle detection data, and weather information data.
[0110] Figure 2b An exemplary embodiment is shown in which vehicle 1 is in an urban environment and an emergency vehicle 2 is on a different road that intersects the road on which vehicle 1 is located, and by using emergency vehicle detection data and map data, it is determined that there are buildings in the line of sight between vehicle 1 and emergency vehicle 2, and it is determined that the emergency vehicle is considered to be invisible to vehicle occupants 5 of vehicle 1.
[0111] An advantage of this embodiment is that when it is determined that the emergency vehicle cannot be observed by the vehicle occupants 5, the vehicle occupants 5 will be notified of the presence of the emergency vehicle.
[0112] According to some embodiments, the notification value is associated with the cognitive load value, and the processing circuits 102a, 102b, 102c are further configured to determine the cognitive load value based on the acquired surrounding environment information data, wherein the cognitive load value indicates whether the acquired surrounding environment information data is determined to have an impact on the insight of the vehicle occupant 5, and when it is determined that the cognitive load value is higher than a predefined threshold level, the notification value is set to a value higher than the predefined threshold level.
[0113] An advantage of this embodiment is that when it is determined that the vehicle occupant's insight is impaired, the vehicle occupant will be notified of the emergency vehicle.
[0114] According to some embodiments, the cognitive load value is determined based on ambient information data about the exterior and / or interior surroundings of the vehicle 1 .
[0115] According to some embodiments, the cognitive load value is determined based on surrounding environment information data, which is at least any one of sound data, image data, traffic information data, and weather information data.
[0116] According to some embodiments, a cognitive load value is determined based on the sound data, and upon determining that the sound data indicates a sound level higher than a predetermined threshold, it is determined that vehicle occupants of vehicle 1 will likely not be able to hear emergency vehicle 2 and a cognitive load value higher than the predefined threshold level is determined.
[0117] In one example, the cognitive load value is determined based on sound data of the surrounding environment outside the vehicle 1 , and the sound level caused by traffic jams and road construction work is higher than a predetermined threshold.
[0118] In one example, the cognitive load value is determined based on sound data of the interior surroundings of the vehicle 1 , and the sound level caused by a screaming child is higher than a predetermined threshold.
[0119] According to some embodiments, a cognitive load value is determined based on the image data and a cognitive load value higher than a predefined threshold level is determined when it is determined that the image data indicates that a vehicle occupant 5 of the vehicle is looking (staring) in a direction different from the direction of the detected emergency vehicle 2 .
[0120] According to some embodiments, the surrounding environment information detection sensor is an eye tracking device, and the image data is acquired through the eye tracking device.
[0121] According to some embodiments, a cognitive load value is determined based on the image data and upon determining that the image data indicates a number of moving objects exceeding a predetermined number of moving objects, a cognitive load value higher than a predefined threshold level is determined.
[0122] In one example, the cognitive load value is determined based on image data of the surroundings outside the vehicle 1 , and the image data indicates a plurality of persons moving around the vehicle 1 .
[0123] According to some embodiments, a cognitive load value is determined based on image data, and when it is determined that the image data indicates that a vehicle occupant 5 of vehicle 1 has not been looking (staring) in the direction of an emergency vehicle 2 detected relative to vehicle 1 within a predetermined time, a cognitive load value higher than a predefined threshold level is determined.
[0124] According to some embodiments, a cognitive load value is determined based on the image data and is determined to be higher than a predefined threshold level when it is determined that the image data indicates that the vehicle occupant 5 of the vehicle 1 has gazed in a plurality of directions exceeding a predetermined number of directions within a predetermined time period.
[0125] According to some embodiments, a cognitive load value is determined based on the image data and upon determining that the image data indicates abnormal behavior of a vehicle occupant of the vehicle, a cognitive load value is determined to be higher than a predefined threshold level.
[0126] According to some embodiments, a cognitive load value is determined based on image data, and when it is determined that the image data indicates that a vehicle occupant of the vehicle has been looking (staring) in the direction of an emergency vehicle 2 detected relative to vehicle 1 for a predetermined time, the cognitive load value is determined to be below a predefined threshold level.
[0127] One advantage of this embodiment is that ambient information data of the vehicle's external surroundings (eg, traffic jams, large numbers of pedestrians) and / or the vehicle's internal surroundings (eg, noise inside the vehicle) can be used to determine the cognitive load value.
[0128] According to some embodiments, the system 100 further includes: an output interface 400a, 400b for notifying the vehicle occupants 5 of an emergency vehicle 2 near the vehicle 1, wherein the output interface is any one of the following interfaces: a display output interface, a sound output interface, a tactile output interface, a light output interface.
[0129] One advantage of this embodiment is that the vehicle occupants can see, feel and / or hear the notification.
[0130] According to some embodiments, the display output interface is any of a dashboard display, a head-up display, or a central user interface display.
[0131] According to some embodiments, the sound output interface is a vehicle entertainment speaker system.
[0132] According to some embodiments, the light output interface is a vehicle cabin light system.
[0133] According to some embodiments, the processing circuits 102a , 102b , 102c are further configured to be able to inform the vehicle occupant 5 via a directional information notification indicating the direction of the emergency vehicle 2 relative to the vehicle 1 .
[0134] According to some embodiments, the output interface 400a, 400b is used to notify a directional information notification to the vehicle occupant 5. According to some embodiments, the directional information notification is any one of a graphic indication, a light indication, a sound indication or a vibration indication.
[0135] In one example, the directional information notification is the sound of the emergency vehicle played back in the vehicle entertainment speaker system with a directional effect, which supports (assists) the vehicle 1 driver in detecting the emergency vehicle 2 in a specific direction. Figure 2a and 2b In the situation shown, the sound of the emergency vehicle comes from the front left of the vehicle.
[0136] In one example, the directional information notification is the lights of the emergency vehicle, such as flashing red and blue lights of the vehicle cabin lighting system with directional effect, which supports (assists) the vehicle 1 driver in detecting the emergency vehicle 2 in a certain direction.
[0137] In one example, for example, Figure 2a and 2b In the situation shown, the flashing red and blue lights are coming from the cabin lights of the vehicle in front on the left.
[0138] An advantage of this embodiment is that it provides assistance to vehicle occupants in determining the direction in which the emergency vehicle may be found.
[0139] A second aspect of the present disclosure illustrates a method for notifying a vehicle occupant 5 of a nearby emergency vehicle 2 .
[0140] Figure 3 Flowchart showing method steps according to the second aspect of the present disclosure.
[0141] The method includes the following steps: in step S1, obtaining surrounding environment information data around the vehicle 1 and the vehicle occupants 5; in step S2, detecting the emergency vehicle 2 near the vehicle 1 based on the obtained surrounding environment information data; in step S3, determining a notification value based on the obtained surrounding environment information data; and when it is determined that the notification value is higher than a predefined threshold level, in step S4, notifying the vehicle occupants 5 of the emergency vehicle 2.
[0142] An advantage of this second aspect is that when it is determined that the vehicle occupants need to be notified of the emergency vehicle, the vehicle system can be used to assist the vehicle occupants in being aware of the nearby emergency vehicle.
[0143] According to some embodiments, the surrounding environment information data is at least any one of the following data: sound data, image data, map data, traffic information data, population density data, road information data, and weather information data.
[0144] An advantage of this embodiment is that different surrounding information data can be used to determine when to notify vehicle occupants of an emergency vehicle.
[0145] According to some embodiments, the acquired surrounding information data indicates that the vehicle 1 is in an urban environment and the notification value is set to a value higher than a predefined threshold level.
[0146] In cities, vehicle occupants typically need to pay attention to more information in their surroundings than when they are in rural areas.
[0147] An advantage of this embodiment is that if the vehicle is in an urban environment, the vehicle occupants will be notified of the presence of an emergency vehicle.
[0148] According to some embodiments, the acquired surrounding information data indicates that the emergency vehicle 2 is not visible to the vehicle occupant 5 of the vehicle 1 and the notification value is set to a value higher than a predefined threshold level.
[0149] An advantage of this embodiment is that when it is determined that the emergency vehicle cannot be observed by the vehicle occupants, the vehicle occupants will be notified of the presence of the emergency vehicle.
[0150] According to some embodiments, the notification value is associated with the cognitive load value, and the method further comprises: determining a cognitive load value based on the acquired surrounding environment information data, wherein the cognitive load value indicates whether the acquired surrounding environment information data is determined to have an impact on the insight of the vehicle occupant 5, and when it is determined that the cognitive load value is higher than a predefined threshold level, setting the notification value to a value higher than the predefined threshold level.
[0151] An advantage of this embodiment is that when it is determined that the vehicle occupant's insight is impaired, the vehicle occupant will be notified of the emergency vehicle.
[0152] According to some embodiments, the method further comprises the step of notifying the vehicle occupant 5 by a directional information notification indicating the direction of the emergency vehicle 2 relative to the vehicle 1 in step S5 .
[0153] An advantage of this embodiment is that the vehicle occupants are assisted in determining the direction in which the emergency vehicle may be found.
[0154] A third aspect of the present invention shows a computer program product including the method of the second aspect, comprising a non-transitory computer-readable medium on which there is a computer program including program instructions, the computer program being capable of being loaded into a processing circuit 102a, 102b, 102c and being configured to cause the method to be performed when the computer program is run by the processing circuit 102a, 102b, 102c.
[0155] Those skilled in the art will recognize that the present disclosure is not limited to the preferred embodiments described above. Those skilled in the art will also recognize that modifications and variations are possible within the scope of the appended claims. In addition, by studying the drawings, the disclosure, and the appended claims, a skilled person implementing the disclosure claimed for protection can understand and implement variations of the embodiments of the disclosure.
Claims
1. A vehicle system (100) for notifying a vehicle occupant (5) of a vehicle (1) that an emergency vehicle (2) is nearby, the system (100) include: Surrounding environment information detection sensors (20a, 20b, 20c) configured to acquire surrounding environment information data around the vehicle (1) and the vehicle occupant (5); and Processing circuitry (102a, 102b, 102c) configured to: - obtaining environmental information data about the vehicle (1) and the vehicle occupant (5); - based on the acquired surrounding environment information data, detecting an emergency vehicle (2) near the vehicle (1); - determining a notification value based on the acquired surrounding environment information data, and when it is determined that the notification value is higher than a predefined threshold level, - Notifying the vehicle occupants (5) of the emergency vehicle (2).
2. The system (100) according to claim 1, in, The surrounding environment information data is at least any one of the following data: sound data, image data, map data, traffic information data, population density data, road information data, emergency vehicle detection data, and weather information data.
3. The system (100) according to claim 1 or 2, in, The acquired surrounding environment information data indicates that the vehicle (1) is in an urban environment, and the notification value is set to a value higher than the predefined threshold level.
4. The system (100) according to any one of the preceding claims, in, The acquired surrounding information data indicates that the emergency vehicle (2) is not visible to the vehicle occupant (5) of the vehicle (1), and the notification value is set to a value higher than the predefined threshold level.
5. The system (100) according to any one of the preceding claims, in, The notification value is associated with a cognitive load value, and wherein the processing circuit (102a, 102b, 102c) is further configured to: - determining a cognitive load value based on the acquired surrounding information data, wherein the cognitive load value indicates whether the acquired surrounding information data is determined to have an impact on the insight of the vehicle occupant (5), and when it is determined that the cognitive load value is higher than a predefined threshold level, - setting said notification value to a value higher than said predefined threshold level.
6. The system (100) according to claim 5, in, The cognitive load value is determined based on surrounding information data of the exterior and / or interior surroundings of the vehicle (1).
7. The system (100) according to any one of the preceding claims, further comprising: include: An output interface (400a, 400b) is used to notify the vehicle occupant (5) that the emergency vehicle (2) is near the vehicle (1), wherein the output interface is any one of the following interfaces: a display output interface, a sound output interface, a tactile output interface, and a light output interface.
8. The system (100) according to any one of the preceding claims, in, The processing circuit (102a, 102b, 102c) is further configured to: The vehicle occupant (5) is notified by a directional information notification indicating the direction of the emergency vehicle (2) relative to the vehicle (1).
9. A method for notifying a vehicle occupant (5) of a nearby emergency vehicle (2), the method include: -(S1) acquiring surrounding environment information data around the vehicle (1) and the vehicle occupant (5); - (S2) detecting an emergency vehicle (2) near the vehicle (1) based on the acquired surrounding environment information data; - (S3) determining a notification value based on the acquired surrounding environment information data, and when it is determined that the notification value is higher than a predefined threshold level, -(S4) notifying the vehicle occupants (5) of the presence of the emergency vehicle (2).
10. The method according to claim 9, in, The surrounding environment information data is at least any one of the following data: sound data, image data, map data, traffic information data, population density data, road information data, and weather information data.
11. The method according to claim 9 or 10, in, The acquired surrounding environment information data indicates that the vehicle (1) is in an urban environment, and the notification value is set to a value higher than the predefined threshold level.
12. The method according to claim 9 or 10, in, The acquired surrounding information data indicates that an emergency vehicle (2) is not visible to the vehicle occupant (5) of the vehicle (1), and the notification value is set to a value higher than the predefined threshold level.
13. The method according to any one of claims 9 to 12, in, The notification value is correlated with a cognitive load value, and the method further comprises: - determining a cognitive load value based on the acquired surrounding information data, wherein the cognitive load value indicates whether the acquired surrounding information data is determined to have an impact on the insight of the vehicle occupant (5), and when it is determined that the cognitive load value is higher than a predefined threshold level, setting the notification value to a value higher than the predefined threshold level.
14. The method according to any one of claims 8 to 13, further comprising: include: - (S5) notifying the vehicle occupant (5) by a directional information notification, the directional information notification indicating the direction of the emergency vehicle (2) relative to the vehicle (1).
15. A computer program product (500) comprising a non-transitory computer-readable medium, on which there is a computer program comprising program instructions, the computer program being loadable into a processing circuit (102a, 102b, 102c) and configured to cause the method according to any one of claims 9 to 14 to be performed when the computer program is run by the processing circuit (102a, 102b, 102c).