System and method for combining visual and audible spatial warning systems

Abstract

A driver alert system is configured to provide a combined visual and audible spatial warning. The system can include an object detection system providing a location of at least one object relative to a vehicle, an audible output system including a plurality of speaker units, and a display unit. A control unit of the system can determine the location of the object and generate a combined visual and audible spatial warning. The output of the combined visual and audible spatial warning can be controlled to output an audible alert indicative of the location of the object relative to a passenger of the vehicle, and the display unit is controlled to present a particle display output indicative of the location of the object relative to the passenger of the vehicle. The system can include a process for controlling the combined visual and audible spatial warning to account for changes in object position and vehicle heading.

Description

Technical Field

[0001] This disclosure relates to systems and methods for providing driver alerts and enhanced driver alerts in a vehicle through spatialized audio and visual elements. Background Technology

[0002] Vehicle systems provide driver feedback in various ways. Traditional vehicle configurations typically include a dashboard. These existing systems usually provide a single form of feedback, typically through the activation of luminous elements (e.g., checking engine lights) or text displays. These routine messages are generally limited to the operating conditions of the vehicle or vehicle components. While traditional configurations allow warnings to be displayed visually or through the activation of luminous elements, these warnings are limited to information provided to the driver and require the driver to see the warning lights. There is a need to detect and control outputs that provide additional information to the driver and vehicle passengers. Summary of the Invention

[0003] This document discloses and claims systems, methods, and configurations for combining visual and auditory spatial warnings. In one embodiment, a driver alert system includes an object detection system configured to provide the location of at least one object relative to a vehicle, an auditory output system including a plurality of speaker units, and a display unit. A control unit is coupled to the object detection system, the auditory output system, and the display unit, and is configured to determine the location of at least one object relative to the position of a vehicle passenger, and generate a combined visual and auditory spatial warning. The control unit is also configured to control the output of the combined visual and auditory spatial warning, wherein the auditory output system is controlled to output an auditory alarm indicating the location of the object relative to the vehicle passenger, and wherein the display unit is controlled to present a particle display output indicating the location of the object relative to the vehicle passenger.

[0004] In one embodiment, the position of at least one object relative to the vehicle passenger position is determined to identify the angular position and distance relative to the vehicle passenger position.

[0005] In one embodiment, the visual warning is a particle display, including a focal point presented to identify the location of an object and one or more particle elements determined for the object, the particle display being presented by a display unit.

[0006] In one embodiment, the visual warning includes adding particle display elements to the display elements presented by the display unit.

[0007] In one embodiment, the visual warning includes at least one of an illuminated display and an illuminated warning via a display element of a speaker unit of an auditory output system.

[0008] In one embodiment, the audio warning includes at least one of a sound and an alarm generated by a speaker unit associated with the location of the object.

[0009] In one embodiment, an audio warning is output by controlling the operation of at least one speaker unit to guide the sound output in coordination with the display of a visual warning.

[0010] In one embodiment, the combined visual and auditory spatial warnings are generated based on the object's category.

[0011] In one embodiment, the control unit is configured to update the output of combined visual and auditory spatial warnings based on changes in object position.

[0012] In one embodiment, the control unit is configured to update the output of a combined visual and auditory spatial warning based on changes in the vehicle’s orientation relative to an object.

[0013] Another embodiment relates to a method for combining visual and auditory spatial warnings by a driver alert system. The method includes determining the location of at least one object relative to the position of a vehicle passenger via a control unit, and generating a combined visual and auditory spatial warning via the control unit. The method also includes controlling the output of the combined visual and auditory spatial warnings by the control unit, wherein an auditory output system is controlled to output an auditory alarm indicating the location of the object relative to the vehicle passenger, and wherein a display unit is controlled to present a particle display output indicating the location of the object relative to the vehicle passenger.

[0014] Other aspects, features, and techniques will be apparent to those skilled in the art from the following detailed description of the embodiments. Attached Figure Description

[0015] The features, objects, and advantages of this disclosure will become more apparent as they are described in detail below in conjunction with the accompanying drawings, in which the same reference numerals are used throughout, and wherein:

[0016] Figure 1 A graphical representation of a vehicle configuration including a warning system according to one or more embodiments is depicted;

[0017] Figure 2 A process for a vehicle warning system according to one or more embodiments is described;

[0018] Figure 3 A graphical representation of a vehicle configuration according to one or more embodiments is depicted;

[0019] Figure 4 A graphical representation of a vehicle display according to one or more embodiments is depicted;

[0020] Figures 5A-5B A graphical representation of an exemplary particle animation according to one or more embodiments is depicted;

[0021] Figure 6 A graphical representation of an exemplary particle animation according to one or more embodiments is depicted; and

[0022] Figure 7A and Figure 7B A graphical representation of a display configuration according to one or more embodiments is depicted. Detailed Implementation

[0023] One aspect of this disclosure relates to providing enhanced vehicle alerts. This document describes systems and processes for configuring combined visual and audio alerts. In one embodiment, one or more vehicle components are controlled for spatial output for the alert. The spatial output may be associated with one or more indications via the vehicle components to convey the location of an object. Compared to an on or off illumination indicator, the spatial output can provide an indication of presence and an indication of the object's location relative to the vehicle. In one embodiment, the spatial output of the alert may include a combination of visual output (e.g., particle animation) and spatial audio output to provide indication for the vehicle alert. Spatialized audio and visual alerts can enable vehicle operators to react faster and more accurately.

[0024] According to one embodiment, audio and visual alerts are combined to provide reinforcement by incorporating multiple sensory perception modes. The combination of alerts may include controlling and updating the alerts based on the detection and tracking of vehicle-related objects and hazards. Compared to alert output that simply transitions from an off state to an on state, the alerts described herein are enhanced to provide spatial multidimensional warnings that indicate directional alerts to hazardous locations. In one embodiment, spatial particle animation is controlled by one or more vehicle elements to provide visual alerts and directional cues pointing to hazardous locations. The alerts can be configured to provide spatial indications, allowing the user to perceive at least one of directional (e.g., left / right, front / back, up / down) proximity and hazard type. As a result, responses and control commands can be made faster and more accurately.

[0025] As used herein, the term “a” or “an” shall mean one or more. The term “multiple” refers to two or more. The term “another” is defined as a second or more. The terms “comprising” and / or “having” are open-ended (e.g., including). As used herein, the term “or” shall be interpreted as inclusive or meaning any one or any combination thereof. Thus, “A, B, or C” means “any one of the following: A; B; C; A and B; A and C; B and C; A, B, and C.” Exceptions to this definition will only occur when a combination of elements, functions, steps, or actions is inherently mutually exclusive in some way.

[0026] References to "an embodiment," "some embodiments," "embodiment," or similar terms in this document mean that a particular feature, structure, or characteristic described in connection with that embodiment is included in at least one embodiment. Therefore, these phrases appearing in different places throughout the specification do not necessarily refer to the same embodiment. Furthermore, particular features, structures, or characteristics can be combined in any suitable manner in one or more embodiments without limitation.

[0027] Now refer to the attached diagram, Figure 1 A graphical representation of a system according to one or more embodiments is depicted. System 100 may relate to a vehicle configuration including a warning system according to one or more embodiments. In one embodiment, system 100 is configured to provide combined visual and auditory spatial warnings. In some embodiments, system 100 may be configured for use in a vehicle as a driver or passenger alarm system. System 100 includes one or more elements configured to provide the location of at least one object relative to vehicle 101.

[0028] System 100 includes a display unit 105 and multiple speaker units 110. 1-n The auditory output system, and the control unit shown as controller 106. In one embodiment, controller 106 is coupled to a system having multiple sensors (e.g., sensor 111). 1-n The system includes an object detection system, an auditory output system, and a display unit 105. The controller 106 can be configured to determine the location of at least one object relative to the vehicle passenger position 108 and generate a combined visual and auditory spatial warning.

[0029] According to one embodiment, system 100 is a vehicle system and is shown relative to the passenger compartment of vehicle 101. According to one embodiment, speaker unit 110... 1-n It can be associated with one or more passenger locations, such as the driver's side front, driver's side rear, passenger's side front, passenger's side rear, and rear center. Additionally, sensor 111 1-n It can be located in positions associated with the front, rear, driver's side, and passenger side of the vehicle. Figure 1 In this context, driver position 108 relates to an exemplary driver position for driving a vehicle on the left. According to one embodiment, one or more elements of system 100 and vehicle 101 can be controlled to provide indications of objects relative to the vehicle with respect to one or more locations. In some embodiments, elements can be controlled to provide indications of the position, orientation, distance, and type of an object relative to one or more locations within the vehicle. Therefore, passenger position 108 can serve as a reference point within vehicle 101.

[0030] According to one embodiment, object detection performed by controller 106 may include identifying one or more objects related to the vehicle, including other vehicles, pedestrians, obstacles, road elements, etc. In one embodiment, based on sensor 111 1-n An alarm is generated upon detection of an object. Sensor 111 1-n It can be configured to detect objects using one or more of optical imaging and proximity sensors (e.g., electromagnetic, ultrasonic sensing, etc.). Figure 1 As shown, sensor 111 1-n Each sensor can be associated with one or more components configured to image and detect objects relative to vehicle 101. Sensor 111 1-n One or more of the presence and imaging data can be output to controller 106. Controller 106 can be configured to detect one or more categories of objects, including vehicles, pedestrians, obstacles, hazards, and general objects relative to vehicle 101. According to another embodiment, controller 106 can receive location information of one or more objects from a network source (e.g., a server road communication unit) and / or other vehicles.

[0031] According to one embodiment, controller 106 can determine and / or receive the location of at least one object relative to vehicle passenger position 108. Controller 106 can also identify the angular position and distance relative to the vehicle passenger position. One or more of the object's distance, angular position, and approximate location can be used by system 100 to generate a combined alarm.

[0032] Speaker unit 110 1-n It can be controlled by controller 106. According to one embodiment, speaker unit 110 1-n The system includes one or more driver units that output sound, including, for example, a midrange speaker 115 and a woofer 120. According to one embodiment, an alarm can be output from one or more of the midrange speaker and woofer components of the speaker unit. Speaker unit 110 1-n It can be configured to output alarms in addition to the audio output (e.g., music, notifications, etc.) from the infotainment / media player of vehicle 101.

[0033] According to one embodiment, each speaker unit 110 1-n It can be configured to output sound and alarms in a directional manner. For example, speaker unit 110 1-n It may include a 3D tweeter configuration having one or more sound direction regions. According to an exemplary embodiment, speaker unit 110 1-nIt can be configured to include multiple and / or directional sound outputs. For example, speaker unit 1101 is shown as output area 112 and output area 113. According to one embodiment, when an object is located on a first side of vehicle 101 (e.g., driver's side or left side), speaker unit 1101 can be controlled to output an alarm to output area 112. Furthermore, when an object is located on a second side of vehicle 101 (e.g., passenger side or right side), speaker unit 1101 can be controlled to output an alarm to output area 113. According to another embodiment, controller 106 can be configured to control speaker unit 1101 to first output an alarm to output area 112, and then subsequently output another alarm to output area 113. According to another embodiment, controller 106 can be configured to control speaker unit 1101 to output an alarm to output area 112, and then output another alarm to output area 113. 1-n The output is used for multiple sound outputs for multiple reference positions. For example, the driver in the vehicle passenger position 108 can output one set of sounds, while a passenger in another position can receive sounds from the speaker unit 110. 1-n The output is a set of different sounds. As shown below, they will be combined... Figure 2 As described in more detail, the process for outputting an alarm may include updating control over the audible output of the alarm. Although speaker unit 1101 has been described with respect to speaker zones 112 and 113, it should be understood that each speaker unit of vehicle 101 may be configured with one or more speaker zones.

[0034] According to one embodiment, speaker unit 110 1-n Optionally, a display element 121 may be included. The optional display element 121 may include one or more light-emitting elements (e.g., LEDs, light strips, etc.) that can be controlled in addition to the speaker unit. In an exemplary embodiment, the controller 106 may be configured to output an audio alarm to the speaker unit and control the activation of one or more light-emitting elements of the activated speaker unit. The optional display element 121 may be controlled to display one or more of the following: color, illumination, and illumination sequences (e.g., a series of flashes, one or more predetermined lengths of activation, etc.). Activation of the optional display element 121 may be combined with an audio alarm from the speaker unit.

[0035] Display unit 105 can be configured to present one or more user interface features of vehicle 101. According to one embodiment, controller 106 can be configured to control the display elements presented by display unit 105 to provide one or more alerts. Controller 106 can be configured to modify and / or introduce display elements to provide alerts for objects. According to an exemplary embodiment, visual alerts may relate to particle display elements added to or incorporated into the display output.

[0036] Figure 1An exemplary embodiment is shown, including the display presentation of a navigation application by a display unit 105. Figure 1 In the middle, the display unit 105 displays vehicle symbols 125 and objects 130 on the road 126. 1-n The representation of . According to one embodiment, object 130 1-n It may be related to danger. According to another embodiment, object 130 1-n Points of interest may be included. The display also presents a background 135. According to one embodiment, the controller 106 can control the presentation of the display unit 105 to include adding elements such as vehicle symbols 125, roads 126, and objects 130. 1-n The alert is a visual warning consisting of one or more elements, which may be related to a point of interest, and background 135 provides the alert. According to one embodiment, the alert can provide an indication of the location of an object. For example, the alert can provide one or more of direction, distance, and threat level based on the object's location. Furthermore, the object's position relative to vehicle 101, such as angular position 132, can be determined and used by the controller to present the alert.

[0037] It should also be understood that the display unit 105 can be configured to present one or more visual alerts for other applications, generally including home screen configuration, media playback configuration, parking assistance, lane change assistance, and vehicle operation.

[0038] According to one embodiment, display unit 105 can be controlled to present particle display output indicating the location of an object relative to vehicle passengers. In the context of a navigation application, the particle display may include adding particle display elements to one or more portions of the display area, including activating the left-hand portion or left half of the screen for objects on the left side of vehicle 101. Similarly, the main portion or segment of display unit 105, such as the top, may be presented using particle animation for objects in front of the vehicle. In addition to the main area, visual alerts may be presented to indicate object location, wherein a portion of the main segment is presented with particle animation and the importance and / or distance of the object may be conveyed through size and / or particle display characteristics.

[0039] According to one embodiment, controller 106 is configured to control the output of a combined visual and auditory spatial warning. The combined visual and auditory warning may include speaker unit 110. 1-n The auditory output is used to indicate the location of an object relative to vehicle passengers (e.g., vehicle passenger position 108) via one or more auditory alarms. The auditory alarms can be integrated with a display 105 and / or include a speaker unit 110. 1-nThe system 100 (with optional display element 121) provides one or more visual warnings or alarms in a coordinated manner. In one embodiment, the combined visual and auditory spatial warnings are generated based on object categories. Object categories can typically include moving / mobile objects, such as pedestrians, other vehicles, and other movable objects. Another object category may relate to hazards or obstacles, such as walls, pillars, curbs, potholes, or fixed structures in general. Another object category may relate to map / navigation items, such as points of interest and intersections requiring action. For hazards requiring immediate attention, the auditory warnings and visual outputs may impart a degree of urgency, such as displaying red and increasing the volume of the auditory alarm. Warnings associated with the presence of other vehicles near vehicle 101 may be presented at an output level customized to indicate presence without generating a high-level alarm.

[0040] According to another embodiment, controller 106 is configured to update the output of combined visual and auditory spatial warnings based on changes in object position. Based on an object moving relative to the vehicle, and the vehicle changing its orientation, the warnings can be controlled to update the expected orientation of the object. In one embodiment, control unit is configured to update the output of combined visual and auditory spatial warnings based on changes in the vehicle's orientation relative to the object.

[0041] For example, an object detected in front of the vehicle now associated with the driver's side can cause controller 106 to update one or more speaker units 110. 1-n The output of the display 105 is used to activate the speaker and / or control the display elements to indicate changes in position.

[0042] Figure 2 A process of a vehicle warning system according to one or more embodiments is described. According to one or more embodiments, process 200 may be... Figure 1 System 100 employs combined visual and auditory spatial warnings. In some embodiments, process 200 may be executed by the control unit of the vehicle driver alert system.

[0043] Process 200 includes detecting objects at block 205. According to one embodiment, at least one object relative to the vehicle is detected. Object detection may include detection via vehicle sensors. In some embodiments, object detection may be based on information received from one or more other devices. The location of the object relative to the vehicle's passenger position is determined using angular position and distance relative to the passenger position to provide a spatial alert. Multiple objects may be detected at block 205. Furthermore, block 205 may include monitoring object positions to update the spatial alert based on vehicle position, heading, and operation.

[0044] In box 210, process 200 includes generating spatialized audio and visual alarms. Combined vehicle alarms can provide warnings of one or more hazards to the vehicle operator and can present spatial warnings to provide indications of one or more hazard types and hazard locations.

[0045] In one embodiment, the visual warning is a particle display, which includes a focal point presented to identify the location of an object and one or more particle elements identified for the object. The particle display may be presented as a portion of a display unit. For example, a control unit may add a particle display or animation to one or more already displayed elements, such as a vehicle's graphical user interface. In other embodiments, the particle display may be presented on a portion of a display element, such as the boundary of or as part of a light-emitting element associated with a speaker unit. In one embodiment, the visual warning includes adding particle display elements to display elements presented by the display unit. For example, in navigation or parking assistance applications, the particle display may be presented in an area of ​​captured or displayed image data to indicate a dangerous location.

[0046] In one embodiment, the visual warning includes at least one of an illuminated display by a display element of a speaker unit of an auditory output system and an illuminated warning. In some embodiments, portions of the illuminated element may be activated to provide an alert to an object.

[0047] In one embodiment, the audio warning includes at least one of a sound and an alarm generated by a speaker unit associated with the location of the object. The alarm may include a tone output. In one embodiment, the audio warning includes a tone output when an object is detected, wherein the tone is output by a speaker associated with the object's location. For example, during normal driving, the tone may be output by a speaker on the side of the vehicle associated with the object's location (e.g., front, left, right, or rear). Similarly, during lane assist or parking maneuvers, a sound may be output on a speaker on the side of the vehicle associated with the detected object. The output of the auditory alarm may include the output of a tone at time intervals. Thus, an object may be detected, and a tone may be generated every 3-5 seconds until the object is no longer dangerous or close to the vehicle. In some embodiments, the audio warning includes a pre-recorded voice to be output by a selected speaker unit. The pre-recorded voice may include object recognition, such as “vehicle approaching the driver’s side” or “approaching an obstacle,” while performing a parking maneuver. These voice commands are merely examples. The auditory alarm may also include a voice output followed by one or more tones presented at intervals during object detection.

[0048] In one embodiment, an audio warning is output by controlling the operation of at least one speaker unit to guide the sound output in coordination with the display of a visual warning. Coordination of auditory and visual alarms may include outputting an auditory alarm while presenting a visual alarm. At block 215, process 200 includes controlling the output of a combined visual and auditory spatial warning. The auditory output system may be controlled to output an auditory alarm indicating the location of an object relative to vehicle occupants, and the display unit may be controlled to present a particle display output indicating the location of an object relative to vehicle occupants.

[0049] In one embodiment, the combined visual and auditory spatial warnings are generated based on the object's category. For example, points of interest and / or navigation-related intersections can be presented using at least one tone and display feature. Approaching hazards or vehicles during driving can be presented using a second set of tone and display features. Alerts during stopping or lane changes may be output using a third set of tone and display features. In one embodiment, particle animation is overlaid onto one or more display units to provide object indication. Particle animation and changes to particle animation can be coordinated with auditory sound output, such that tone output is synchronized with display events including the addition or removal of a focus element, changes in the particle animation background, etc. In one embodiment, visual warnings include adding particle display elements to display elements presented by the display units.

[0050] In one embodiment, the visual warning includes at least one of an illuminated display of a display element via a speaker unit of an auditory output system and an illuminated warning. The illuminated display of the display element may include adding emphasis or lighting features to the display background of the application. In other embodiments, regardless of the displayed content, portions of the display screen may include graphic elements, such as an entire bar in the left or right corner.

[0051] In one embodiment, the audio warning includes at least one of sound and alarm generated by a speaker unit associated with the location of the object. The vehicle's speaker unit may be configured to output media (e.g., radio, music, mobile device media, etc.). Accordingly, the alarm may be mixed with the sound output. In some cases, the alarm may be mixed into the vehicle's sound output. In other embodiments, the alarm may cause the control unit to suspend media output for the purpose of the alarm.

[0052] In one embodiment, an audio warning is output by controlling the operation of at least one speaker unit to guide the sound output in coordination with the display of a visual warning. For example, the tone output may correspond to flashes or changes in particle animation on the display unit.

[0053] Process 200 may optionally include detecting object and / or alarm changes at block 220. The control unit may be configured to update the output of combined visual and auditory spatial warnings based on changes in object position, such that different speaker units and different portions of the display unit are controlled to present the alarm. The control unit may also be configured to update the output of combined visual and auditory spatial warnings based on changes in vehicle orientation. A hazard or object that persists during vehicle maneuvering may be the basis for a continuous alarm. In other embodiments, one or more of the auditory and visual alarms may be altered when the vehicle changes direction. For example, an obstacle appearing while the vehicle is moving or parked will alert the driver more strongly when the vehicle is reversing.

[0054] Figure 3 A graphical representation of a vehicle configuration according to one or more embodiments is depicted. Vehicle system 300 includes one or more elements configured for use in a vehicle. Vehicle system 300 may be configured to operate in conjunction with one or more components of the vehicle. According to one embodiment, vehicle system 300 includes a control unit 305, an object detection system 310, a vehicle display unit 320, and an auditory output system 325.

[0055] Control unit 205 may involve a processor or control module and may include memory (e.g., non-transitory memory) storing executable instructions to perform one or more processes described herein. Control unit 305 may include one or more software modules. Control unit 305 includes a space alarm module 315 configured to receive and transmit data from object detection system 310 to control the operation of vehicle components including vehicle display unit 320 and auditory output system 325.

[0056] The object detection system 310 may include a plurality of object sensing units 311, each comprising one or more sensors and imaging devices. In one embodiment, a combination of an optical imaging device and a near-field object sensor may be used to detect and classify objects relative to a vehicle. The object detection system 310 may also include a communication module with wireless network communication capabilities to receive data about objects relative to the vehicle via a wireless communication network based on the vehicle's position and heading. The object sensing units 311 and the communication module 312 may output data to a control unit 305 and a space alarm module for determining vehicle warnings and alerts.

[0057] The vehicle display unit 320 may relate to the display of the vehicle user interface. The control unit 305 may be configured to output one or more display parameters to the space warning module for visual warning. In some embodiments, when the speaker 330... 1-nWhen including a light-emitting display element, the space alarm module 315 can also output a visual warning to the auditory output system. The vehicle display unit 320 can be used to display one or more control features of the vehicle. In some embodiments, the vehicle display unit can be part of the vehicle control panel. In other embodiments, the vehicle display unit 320 can be separate from the vehicle's dashboard.

[0058] The space alarm module can be configured to output to the speaker 330 of the hearing output system 325. 1-n Outputs audible sound. As described herein, sound can be directed to one or more speakers 330. 1-n To give an object directionality.

[0059] Figure 4 A graphical representation of a vehicle display according to one or more embodiments is depicted. According to one embodiment, a visual alarm can be presented on the vehicle display. Figure 4 An exemplary display presentation 400 of a vehicle navigation system is depicted, including a vehicle representation 405, route instructions 410, points of interest 415, and roads 420. According to one embodiment, combined audio and video warnings may be presented to provide alerts. According to another embodiment, the visualization of the navigation system may include adding particle representations to one or more display elements of the display presentation 400. Figure 4 Graphical elements 425 representing visual warnings are depicted. According to one embodiment, graphic element 425 relates to visual elements added by a control unit to display presentation 400. The display position of graphic element 425 can be based on the location of a detected object relative to the vehicle. According to another embodiment, the control unit can control display characteristics to control the size and appearance of graphic element 425. In some embodiments, objects of higher importance will be presented at a larger size. Control of the display of graphic element 425 can also modify the position of graphic element 425 relative to the vehicle's heading and positional changes. According to another embodiment, one or more display elements or display areas can be presented using particle displays for the visual output of the warning.

[0060] Figures 5A-5B A graphical representation of exemplary particle animations according to one or more embodiments is depicted. According to one embodiment, display elements presented by a vehicle's display unit can be controlled to present a visual alarm. According to another embodiment, a vehicle's speaker unit may include one or more display features, such as luminescent areas. Figure 5AAn exemplary particle animation 500 is shown that can be rendered by a light display element of a vehicle display or speaker unit. According to one embodiment, the particle animation may include at least one of a focus element 505 and a background. The focus element 505 is shown as a circular element. According to one embodiment, the focus element can change position according to the instructions of a controlled person to indicate a change in object position. The focus element may include a particle shape that can change size. The focus element may be rendered to appear as an influence point element of the background 510. According to one embodiment, the rendering of the focus element 505 on the background 510 may indicate the location of an object. Object importance and / or distance may be reflected by one or more of the color and size of the focus element 505. The background of the particle animation may be related to an area or location relative to the vehicle.

[0061] Figure 5B An exemplary particle animation 550 is shown, which can be rendered by an optical display element of a vehicle display or speaker unit. According to one embodiment, the particle animation 550 may include a plurality of focal elements, including focal element 555 and focal element 560, and a background 565. Focal element 555 is rendered in an enlarged size relative to focal element 560 to indicate importance. Each focal element rendered in the particle animation 550 may be associated with an object detected and / or determined by a vehicle control unit.

[0062] It should be understood that one or more particle animations and configurations can be used. Figure 6 A graphical representation of an exemplary particle animation according to one or more other embodiments is depicted. Particle animation 600 may be a spatial particle animation including a display area 610 having multiple focus elements, such as focus elements 615 and 620. Display area 610 may relate to a display element of a speaker unit or a particle display area of ​​a display unit. According to one embodiment, focus elements 615 and 620 are presented to indicate object location. Furthermore, display parameters including one or more of size, color, and radiation design features may be presented based on one or more of object type, object importance, and hazard level. In addition to focus, particle animation 600 may include one or more animation flows 625 to provide indication of background and / or focus changes.

[0063] Figures 7A-7B A graphical representation of a display configuration according to one or more embodiments is depicted. According to one embodiment, at least one of the display units (e.g., display unit 105) or the display border and / or outer portion may include particle animation. Figure 7A It shows that in addition to the display area 710, there are multiple display areas 705. 1-nThe display area 700. According to one embodiment, the display area 710 is configured to display one or more vehicle features, including a user interface main screen, navigation application, media player, etc. According to another embodiment, the display area 705... 1-n Any part or all of it can be used to display particle animation.

[0064] Figure 7B A particle animation is shown, comprising a particle animation 715 with a focus element 720. According to one embodiment, the particle animation 715 is presented in display area 7051 to indicate an object associated with a direction corresponding to display area 7051. For example, display area 7051 may be associated with the left side of the vehicle, while display area 7053 may be associated with the right side. According to one embodiment, multiple display areas may include particle animations. Compared to particle animation 715, particle animation 725 may be associated with a detected object associated with the right side of the vehicle.

[0065] Although this disclosure has been specifically shown and described with reference to exemplary embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made therein without departing from the scope of the claimed embodiments.

Claims

1. A driver alarm system for combined visual and auditory spatial warnings, the driver alarm system comprising: An object detection system configured to provide the location of at least one object relative to a vehicle; An auditory output system, which includes multiple speaker units; Display unit; as well as The control unit, coupled to the object detection system, the auditory output system, and the display unit, is configured as follows: Determine the location of the at least one object relative to the vehicle passenger positions. Generate combined visual and auditory spatial warnings, and Control the output of the combined visual and auditory spatial warnings. The auditory output system is controlled to output an auditory alarm indicating the location of the object relative to the vehicle passengers, the auditory alarm including a tone output. The display unit is controlled to present a visual warning via particle display output, which indicates the location of the object relative to the vehicle passengers. The visual warning is a particle animation display, which is presented by the display unit on a display element located on a speaker unit of the auditory output system. The particle animation display includes one or more focal points presented to identify the object's location and one or more particle elements defined for the object. The display element located on the speaker unit includes one or more light-emitting elements. The control unit is further configured to synchronize the tone output with display events of the particle animation, the display events including at least one of the following: adding another focus or removing one of the one or more focuses, and The particle animation display includes a flow of particle animations that indicate changes in focus.

2. The driver alarm system according to claim 1, wherein, The location of the at least one object relative to the vehicle passenger position is determined to identify its angular position and distance relative to the vehicle passenger position.

3. The driver alarm system according to claim 1, wherein, Visual warnings include a light-emitting display via a display element located on the speaker unit of the auditory output system.

4. The driver alarm system according to claim 1, wherein, The auditory alarm includes a sound generated by the speaker unit associated with the location of the object.

5. The driver alarm system according to claim 1, wherein, The auditory alarm is output by controlling the operation of at least one speaker unit to guide the sound output in coordination with the display of the visual warning.

6. The driver alarm system according to claim 1, wherein, The combined visual and auditory spatial warnings are generated based on the object's category.

7. The driver warning system of claim 1, further comprising updating the output of the combined visual and auditory spatial warnings based on changes in the object's position.

8. The driver warning system of claim 1, further comprising updating the output of the combined visual and auditory spatial warning based on changes in the vehicle's orientation relative to an object.

9. A method for combining visual and auditory spatial warnings via a driver alert system, the method comprising: The control unit determines the location of at least one object relative to the positions of the vehicle passengers. The control unit generates combined visual and auditory spatial warnings, and The control unit controls the output of the combined visual and auditory spatial warnings. The auditory output system is controlled to output an auditory alarm, the auditory alarm indicating the location of the object relative to the vehicle passengers, the auditory alarm including tone output. The display unit is controlled to present a visual warning via particle display output, which indicates the location of the object relative to the vehicle passengers. The visual warning is a particle animation display, which is presented by the display unit on a display element located on a speaker unit of the auditory output system. The particle animation display includes one or more focal points presented to identify the object's location and one or more particle elements defined for the object. The display element located on the speaker unit includes one or more light-emitting elements. The control unit synchronizes the tone output with display events of the particle animation, the display events including at least one of the following: adding another focus or removing one of the one or more focuses, and The particle animation display includes an animation flow that indicates changes in focus.

10. The method according to claim 9, wherein, The location of the at least one object relative to the vehicle passenger position is determined to identify its angular position and distance relative to the vehicle passenger position.

11. The method according to claim 9, wherein, Visual warnings include a light-emitting display via a display element located on the speaker unit of the auditory output system.

12. The method according to claim 9, wherein, The auditory alarm includes a sound generated by the speaker unit associated with the location of the object.

13. The method according to claim 9, wherein, The auditory alarm is output by controlling the operation of at least one speaker unit to guide the sound output in coordination with the display of the visual warning.

14. The method according to claim 9, wherein, The combined visual and auditory spatial warnings are generated based on the object's category.

15. The method of claim 9, further comprising updating the output of the combined visual and auditory spatial warnings based on changes in object position.

16. The method of claim 9, further comprising updating the output of the combined visual and auditory spatial warning based on changes in the vehicle's orientation relative to the object.

Images