Vehicle-side traffic sign processing system

Abstract

Vehicle-mounted traffic sign processing system (1000), comprising: a traffic sign camera (1100) which is selectively provided on a vehicle and comprises an image acquisition module (1110) and an image processing module (1120), wherein the image acquisition module (1110) serves to record traffic images, and wherein the image processing module (1120) serves to subject the traffic image to traffic sign recognition in order to obtain traffic sign information; and a vehicle-side processing unit (1200) which is designed to receive traffic sign information from the traffic sign camera (1100) via one or more communication interfaces and to output multimodal traffic sign information based on the traffic sign information.

Description

Technical field

[0001] The present utility model relates to a vehicle-mounted traffic sign processing system. State of the art

[0002] Many drivers are currently choosing to install a traffic sign camera (TSC) on their vehicles. This device recognizes traffic signs and provides corresponding information. A conventional TSC is typically a removable, standalone module that can be mounted on a vehicle's windshield and operates independently of the vehicle's system. Such a device is capable of independently capturing traffic images, recognizing traffic signs, and providing audible alerts to the driver via an integrated speaker, thus fulfilling a traffic sign warning function.

[0003] However, due to the hardware limitations of the TSC, the type of warning usually depends solely on the speaker integrated into the TSC, through which a fixed acoustic signal is emitted, so that the type of warning is not very diverse and the driver's driving experience is impaired to some extent. Utility model content

[0004] Exemplary embodiments of the present utility model provide a vehicle-mounted traffic sign processing system that is suitable for solving the technical problems of a one-sided design of the traffic sign information and the low flexibility of conventional traffic sign cameras.

[0005] Exemplary embodiments of the present utility model provide a vehicle-mounted traffic sign processing system comprising a traffic sign camera selectively mounted on a vehicle and featuring an image acquisition module and an image processing module. The image acquisition module serves to capture a traffic image. The image processing module serves to subject the traffic image to traffic sign recognition in order to obtain traffic sign information. The vehicle-mounted traffic sign processing system further comprises a vehicle-mounted processing unit. The vehicle-mounted processing unit serves to receive the traffic sign information from the traffic sign camera via one or more communication interfaces and to output multimodal traffic sign information based on this information.

[0006] In exemplary embodiments of the present utility model, the traffic sign camera selectively mounted on a vehicle can be operated independently of the vehicle's processing equipment. The traffic sign camera outputs traffic sign information based on the traffic sign data.

[0007] In exemplary embodiments of the present utility model, the image acquisition module comprises at least one optical unit, an image sensor, and a lighting unit. The optical unit serves to focus and image incident light from a traffic scene. The image sensor serves to capture the light focused by the optical unit and to generate a traffic image. The lighting unit serves to provide supplementary illumination during image acquisition.

[0008] In exemplary embodiments of the present utility model, the image processing module comprises at least one image buffer unit and one traffic sign recognition unit. The image buffer unit serves to store the captured traffic image. The traffic sign recognition unit serves to subject the stored traffic image to traffic sign detection and recognition in order to generate traffic sign information.

[0009] In exemplary embodiments of the present utility model, the communication interface comprises at least one vehicle-side communication interface and / or one audio communication interface. The audio communication interface is implemented based on at least one of an automotive audio bus, an intelligent network interface controller network, a media-oriented systems transport, and an audio-video bridging interface over Ethernet. The vehicle-side communication interface is implemented based on at least one of a controller area network, a local interconnect network, a clock extension peripheral interface, Ethernet, and a flexible data rate bus.

[0010] In exemplary embodiments of the present utility model, the vehicle-side processing unit comprises at least one cockpit domain controller and / or one vehicle-side audio power amplifier. The cockpit domain controller and / or the vehicle-side audio power amplifier comprises at least one audio output control unit, a display output control unit, a light control unit, and a vibration control unit. This enables the vehicle to be controlled based on traffic sign information, allowing multimodal traffic sign warnings to be displayed.

[0011] In exemplary embodiments of the present utility model, the cockpit domain controller and / or the vehicle-side audio power amplifier further comprises a user experience control unit. The user experience control unit serves to adjust the type and / or intensity of the traffic sign warnings based on external environmental information.

[0012] In embodiments of the present utility model, the multimodal traffic sign indicators comprise a combination of one or more acoustic, visual, light-based, and vibration-based indicators. The acoustic, visual, light-based, and vibration-based indicators each relate to a traffic sign.

[0013] In exemplary embodiments of the present utility model, the vehicle-side traffic sign processing system further comprises a driver assistance control unit. The driver assistance control unit serves to receive traffic sign information via the communication interface and to execute driver assistance control based on this information.

[0014] In exemplary embodiments of the present utility model, the traffic sign information includes recognition information for one or more signs from a speed limit sign, a no-entry sign, a warning sign and a guidance sign. Description of the drawings

[0015] To more clearly explain the technical solutions of the embodiments of the present utility model or the prior art, the drawings used in the description of the embodiments or the prior art are briefly presented below. It is obvious that the drawings described below show some embodiments of the present utility model, and that those skilled in the field can derive further drawings from these drawings without any creative effort. Fig. Figure 1 is a schematic block diagram of a vehicle-mounted traffic sign processing system according to one or more embodiments of the present utility model; Fig. Figure 2 is a schematic block diagram of a traffic sign camera according to one or more embodiments of the present utility model; Fig. Figure 3 is a schematic block diagram of a vehicle-side processing device according to one or more embodiments of the present utility model; and Fig. Figure 4 is a schematic block diagram of a vehicle-mounted traffic sign processing system according to one or more embodiments of the present utility model. Detailed descriptions

[0016] Exemplary embodiments, illustrated in the drawings, are described in detail below. Unless otherwise stated in the following description, identical reference numerals in different drawings denote identical or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments corresponding to the present utility model. Rather, they are merely examples of devices that correspond to certain aspects of the present utility model, as further described in the accompanying claims.

[0017] A traffic sign camera typically has a modular structure, is detachably mounted on a vehicle, and operates independently of the vehicle's processing equipment. Specifically, the TSC is capable of independently capturing traffic images, recognizing traffic signs, and issuing corresponding traffic sign information based on the recognition results, without being connected to the vehicle's own processing equipment, audio and video systems, or similar components.

[0018] Due to the hardware limitations of the TSC, the warning function typically relies solely on an integrated speaker that emits a fixed acoustic signal. This makes the warning method relatively one-sided and unable to be adapted to driving scenarios or user needs. Furthermore, because of its structural independence from the vehicle, the TSC cannot exchange information with the vehicle's processing unit or with audio and video systems. It also cannot access the vehicle's existing audio and display resources to implement a variety of traffic sign warnings, thus limiting the warning method's flexibility.

[0019] For this purpose, one or more embodiments of the present utility model provide a vehicle-mounted traffic sign processing system which is capable of coupling a traffic sign camera, which is usually operated independently of the vehicle system, with the processing unit of the vehicle, audio and video systems, driver assistance systems or the like, and of realizing multimodal traffic sign information by accessing existing audio output, display or similar resources of the vehicle, thereby increasing the flexibility of the traffic sign information while simultaneously overcoming hardware-related limitations of the TSC.

[0020] The vehicle-mounted traffic sign processing system comprises a traffic sign camera and a vehicle-mounted processing unit. The traffic sign camera is selectively mounted on a vehicle and includes an image acquisition module and an image processing module. The image acquisition module captures an image of the traffic. The image processing module performs traffic sign recognition on the traffic image to generate traffic sign information. The vehicle-mounted processing unit receives the traffic sign information from the traffic sign camera via one or more communication interfaces and outputs multimodal traffic sign information based on this information.According to exemplary embodiments of the present utility model, after performing traffic sign recognition on the traffic image and receiving the traffic sign information, the traffic sign camera transmits this information via the communication interface to the vehicle's processing unit. Based on the received traffic sign information, the vehicle's processing unit accesses existing audio, display, lighting, or vibration systems to generate corresponding multimodal traffic sign information. This enables the system to output the traffic sign information to the driver in several perceptual forms, thereby increasing the flexibility of the traffic sign information and improving the driving experience.

[0021] Fig. Figure 1 shows a schematic block diagram of a vehicle-mounted traffic sign processing system according to one or more embodiments of the present utility model. As in Fig. Figure 1 shows that the vehicle-side traffic sign processing system 1000 includes, by way of example and without limitation, a traffic sign camera 1100 and a vehicle-side processing device 1200.

[0022] The 1100 traffic sign camera is designed for selective installation on a vehicle and comprises an image acquisition module 1110 and an image processing module 1120. The image acquisition module 1110 captures an image of the traffic. The image processing module 1120 processes the traffic image for traffic sign recognition to obtain traffic sign information.

[0023] The vehicle-side processing unit 1200 serves to receive traffic sign information from the traffic sign camera 1100 via one or more communication interfaces and to output multimodal traffic sign information based on the traffic sign information.

[0024] In one or more embodiments of the present utility model, the traffic image may comprise image data containing information about the road environment, wherein the image data may include traffic signs on the road as well as surrounding environmental information. The traffic signs may be arranged along the road or above the road and serve to indicate traffic rules, road conditions, restrictions on passage, or safety warnings, for example, speed limit signs, no-entry signs, warning signs, and information signs, or the like. Accordingly, the traffic sign information may relate to one or more of the aforementioned traffic signs. For example, the traffic sign information may include type information of the traffic signs, such as information on a speed limit sign, a no-entry sign, a warning sign, or an information sign.Furthermore, traffic sign information can include content information about the traffic signs, such as a speed limit sign (e.g., 30 km / h or 60 km / h) or a specific warning message (e.g., an upcoming curve, a speed bump, a pedestrian crossing). In addition, traffic sign information can include time information about the traffic signs to record the time the traffic image associated with the traffic sign information was captured. Finally, traffic sign information can include a continuous detection status or a validity indicator to show whether the traffic sign is in a continuous detection state, has become invalid, has been replaced by a new traffic sign, or similar.

[0025] In one or more embodiments of the present utility model, the traffic sign camera 1100, intended for recording traffic images, can be any device selectively mounted on a vehicle and comprising functions for recording traffic images and for traffic sign recognition. The installation position of the traffic sign camera on the vehicle is not restricted, as long as effective recording of the traffic image is possible. For example, depending on the vehicle type or structural arrangement requirements, the traffic sign camera can be positioned above the windshield, above the front hood, in the central area of ​​the vehicle roof, in the area of ​​the front grille, or in the area of ​​the vehicle emblem, or the like, to achieve a wider field of view or higher image sharpness.

[0026] In one or more embodiments of the present utility model, the traffic sign camera 1100 can have a modular structure and be detachably mounted on a vehicle, so that the traffic sign camera 1100 is operated as an independent module, separate from the vehicle-side processing unit 1200. The term "independent operation" used here means that the traffic sign camera 1100 is capable of independently recording traffic images, recognizing traffic signs, and outputting traffic sign information based on the traffic sign data, without dependence on the vehicle-side processing unit 1200.For example, if the vehicle-side processing unit 1200 is not running or experiences a communication error, the traffic sign camera 1100 can provide local alerts via its own sound output unit, such as a loudspeaker, to ensure the continuity and reliability of the traffic sign information. Conversely, if the vehicle-side processing unit 1200 is functioning correctly, the traffic sign camera 1100 can transmit the traffic sign information to the vehicle-side processing unit 1200 via the communication interface. The vehicle-side processing unit 1200 then activates existing audio, display, lighting, or vibration devices in the vehicle to generate multimodal traffic sign alerts corresponding to the traffic sign information, thereby increasing the flexibility of the traffic sign information and improving the driving experience.

[0027] Naturally, the 1100 traffic sign camera can also be configured without an audio output function and solely for recording traffic images and recognizing traffic signs. In this case, the vehicle's 1200 processing unit controls the output of the multimodal traffic sign information based on the received traffic sign data.

[0028] The embodiments of the present utility model do not restrict the internal structure of the traffic sign camera 1100, provided that the recording of the traffic image and the traffic sign recognition can be implemented, whereby the specific design can be configured according to different design requirements.

[0029] In an optional embodiment, the traffic sign camera 1100 can be used, as shown in Fig. Figure 2 shows that the system comprises at least one image acquisition module 1110 and one image processing module 1120. The image acquisition module 1110 can be used to capture the traffic image. The image processing module 1120 can be used to subject the traffic image to traffic sign recognition in order to generate traffic sign information.

[0030] Regarding the image acquisition module 1110, this can be any module suitable for capturing the traffic image. For example, the image acquisition module 1110 can comprise an optical unit 1110a, an image sensor 1110b, and an illumination unit 1110c. The optical unit 1110a can serve to focus and image incident light from a traffic scene. For example, the optical unit 1110a can comprise a lens assembly consisting of several lenses or the like. The image sensor 1110b can serve to capture the light focused by the optical unit in order to generate the traffic image. For example, the image sensor 1110b can be configured as a CMOS or CCD image sensor or the like. The illumination unit 1110c can serve to provide supplementary illumination during image acquisition. For example, the illumination unit 1110c can comprise an LED light arrangement, a laser-based auxiliary light source, or the like.

[0031] Regarding the image processing module 1120, this can be any module suitable for subjecting the traffic image to traffic sign recognition in order to generate traffic sign information. For example, the image processing module 1120 can comprise an image buffer unit 1120a and a traffic sign recognition unit 1120b. The image buffer unit 1120a can serve to store the captured traffic image, using, for example, a high-speed RAM, an on-chip buffer structure, or the like. The traffic sign recognition unit 1120b can serve to subject the stored traffic image to traffic sign detection and recognition in order to generate traffic sign information. The algorithms used by the traffic sign recognition unit to recognize the traffic image are not limited.For example, a deep learning-based convolutional neural network (CNN) model can be used for feature extraction and classification of traffic signs. Alternatively, classic image processing algorithms can be employed, such as color threshold segmentation, edge detection, shape matching, or template matching. Furthermore, multiple algorithms can be combined to achieve both high recognition accuracy and real-time performance.

[0032] It should be noted that the above description of the structure of the traffic sign camera 1100 is merely exemplary. In practical applications, the traffic sign camera may also include further functional modules. For example, a power supply module may be provided to supply a stable operating voltage for the optical unit 1110a, the image sensor 1110b, or the like. Likewise, an audio output module may be provided to directly output voice warning signals without relying on the vehicle-side processing unit 1200.

[0033] The following explains the workflow of the traffic sign camera 1100 according to exemplary embodiments of the present utility model.

[0034] First, the image acquisition module 1110 captures images of the traffic scene in front of the vehicle. The optical unit 1110a focuses and displays the light incident from the traffic scene. The image sensor 1110b receives the light focused by the optical unit 1110a and converts it into digital image signals, thus generating a traffic image. In insufficient ambient light conditions, the illumination unit 1110c can be activated to provide auxiliary lighting and thereby ensure image clarity and recognizability of the traffic image.

[0035] The captured traffic image is then transferred to the image processing module 1120. The image buffer unit 1120a temporarily stores the received traffic image to enable subsequent image analysis and recognition processing. The traffic sign recognition unit 1120b reads the image data from the image buffer unit 1120a and performs detection, localization, and classification of the traffic signs contained in the image. During the recognition process, the traffic sign recognition unit 1120b can analyze the characteristics of the traffic signs in the traffic image based on specific algorithms to generate traffic sign information.

[0036] After generating the recognition results, the image processing module 1120 can perform further data encapsulation or formatting of the results in order to transfer them to the vehicle-side processing unit via the communication interface.

[0037] In one or more embodiments of the present utility model, the communication interface can comprise a vehicle-side communication interface and / or an audio communication interface. The audio communication interface can be implemented based on at least one of an Automotive Audio Bus (A2B), an Intelligent Network Interface Controller Network (INICnet), a Media-Oriented Systems Transport (MOST), and an Audio-Video Bridging over Ethernet (Ethernet AVB). The vehicle-side communication interface can be implemented based on at least one of a Controller Area Network (CAN), a Local Interconnect Network (LIN), a Clock Extension Peripheral Interface (CXPI), Ethernet, and a Flexible Data Rate Bus (FlexRay).In one or more embodiments of the present utility model, a suitable type of communication interface can be selected depending on the practical requirements, whereby the type of communication used is determined, for example, on the basis of the type of data to be transmitted, the required bandwidth, the latency requirements, the system architecture, or the like.

[0038] In exemplary embodiments of the present utility model, the communication interface can transmit traffic sign information to the vehicle-side processing unit 1200, wherein the vehicle-side processing unit 1200 controls the output of multimodal traffic sign warnings based on the traffic sign information. For example, one or more warnings relating to a traffic sign can be output, consisting of an acoustic warning, a visual warning, a light-based warning, and a vibration-based warning.

[0039] Fig. Figure 3 is a schematic block diagram of a vehicle-side processing device provided according to one or more embodiments of the present utility model. As shown in Fig. As shown in Figure 3, the vehicle-side processing unit 1200 can, by way of example and without limitation, include a cockpit domain controller 1210 and / or a vehicle-side audio power amplifier 1220.

[0040] As in Fig. As shown in Figure 3, the vehicle-side processing unit 1200 can, in one or more embodiments of the present utility model, comprise a cockpit domain controller 1210. The cockpit domain controller 1210 can comprise at least one audio output control unit (Main Audio) 1210a, a display output control unit (Visual) 1210b, a light control unit (Lighting) 1210c, and a vibration control unit (Shaker) 1210d.

[0041] The audio output control unit 1210a can be used to control acoustic output components for the output of warning tones or voice announcements based on traffic sign information, for example, vehicle speakers or the like. The display output control unit 1210b can be used to control the display of corresponding traffic sign graphics or the like on display components based on traffic sign information, for example, on an instrument cluster display (instrument meter), a head-up display (HUD), an augmented reality head-up display (AR-HUD), or a windshield head-up display (W-HUD). The light control unit 1210c can be used to control interior or exterior lighting components for the output of light-based warnings based on traffic sign information, for example, ambient lights, warning lights, or the like.The 1210d vibration control unit can be used to control vibrating components based on traffic sign information to generate vibration feedback in order to implement a haptic guidance function, for example steering wheels, seats, pedals or the like.

[0042] In one or more embodiments of the present utility model, the cockpit domain controller 1210 may further comprise a user experience (UX) control unit 1210e. The UX control unit 1210e can be used to coordinate the output strategy of multimodal cues depending on one or more factors from the current vehicle operating state, the driving mode, the external environment, and the driver's attention. For example, if high driver attention is detected and the ambient noise level is low, the UX control unit can select softer voice outputs or visual cues with reduced brightness. Conversely, if driver distraction is detected or the external noise level is high, the intensity of the cues can be increased, for example, by increasing the volume, increasing the light intensity, or by superimposing vibration feedback.Alternatively, in nighttime driving scenarios, the 1210e user experience control unit can reduce display brightness or use non-flickering, light-based alerts to avoid visual glare. During high-speed driving or in Sport mode, clear, high-contrast alerts can be prioritized to enhance driving safety. The 1210e user experience control unit can also manage alert priorities for different types of traffic signs. For example, "No Entry" or "Hazard Warning" signs can trigger simultaneous voice, light, and vibration-based multimodal alerts. Conversely, "Speed ​​Limit" or "Advice" signs can trigger only visual alerts or voice alerts to minimize unnecessary distractions.According to the embodiments of the present utility model, the cognitive load of the driver and his interaction experience can be optimized simultaneously when the traffic sign recognition information is transmitted completely.

[0043] In one or more embodiments of the present utility model, the cockpit domain controller 1210 may further comprise an intelligent sound control unit (Intelligent Engine Sound System Audio, iESS Audio) 1210f. The intelligent sound control unit 1210f can be used to generate or adjust interior engine sound signals depending on the vehicle operating state, for example, vehicle speed, engine speed, acceleration, driving mode, or the like, and to interact with the audio output control unit 1210a to achieve a dynamic balance of the acoustic output.For example, upon detection of a traffic sign warning event, the intelligent sound control unit 1210f can temporarily reduce or adjust the volume of the vehicle's internal engine sound, or optimize the sound field to avoid acoustic interference between traffic sign warning tones and the engine sound, conversation noise, or other ambient noise. The embodiments of this utility model ensure the intelligibility of the traffic sign warning tones and thereby improve the overall driving experience.

[0044] In one or more embodiments of the present utility model, the vehicle-side processing device 1200, as shown in Fig. Figure 3 further comprises a vehicle-side audio power amplifier 1220. The vehicle-side audio power amplifier 1220 can comprise at least one audio output control unit (Main Audio) 1220a, a display output control unit (Visual) 1220b, a light control unit (Lighting) 1220c and a vibration control unit (Shaker) 1220d.

[0045] The 1220a audio output control unit can be used to control acoustic output components for the output of warning tones or voice announcements based on traffic sign information. The 1220b display output control unit can be used to control the display of corresponding traffic sign graphics or similar on display components based on traffic sign information. The 1220c light control unit can be used to control interior or exterior lighting components for the output of light-based warnings based on traffic sign information. The 1220d vibration control unit can be used to control vibrating components based on traffic sign information to generate vibration feedback and implement a haptic warning function.

[0046] In one or more embodiments of the present utility model, the vehicle-mounted audio power amplifier 1220 may further comprise a user experience (UX) control unit 1220e. The user experience control unit 1220e may serve to control the output strategy of the multimodal information in a coordinated manner depending on the current operating state of the vehicle, the driving mode, the external environment, the driver's attention, or the like.

[0047] In one or more embodiments of the present utility model, the vehicle-side audio power amplifier 1220 may further comprise an intelligent sound control unit (Intelligent Engine Sound System Audio, iESS Audio) 1220f. The intelligent sound control unit 1220f may serve to generate or adjust the vehicle's internal engine sound depending on the vehicle's operating state, for example, driving speed, engine speed, acceleration, or driving mode, or the like, and, in cooperation with the audio output control unit 1220a, to achieve a dynamic balance of the acoustic output.

[0048] Fig. Figure 4 is a schematic block diagram of a vehicle-mounted traffic sign processing system according to one or more embodiments of the present utility model. As shown in Fig.As shown in Figure 4, the vehicle-side traffic sign processing system 1000 can further comprise a driver assistance control unit 1300. The driver assistance control unit 1300 serves to receive traffic sign information via a communication interface and to execute driver assistance control based on this information. For example, the driver assistance control unit 1300 can generate control commands based on the traffic sign information in combination with current vehicle operating parameters, such as vehicle speed, acceleration, steering angle, or braking status, and output these commands to the vehicle's drive system, braking system, steering system, or a human-machine interaction system to implement corresponding assistance functions.

[0049] The following explains the workflow in which, in exemplary embodiments of the present utility model, after the traffic sign information has been captured by the traffic sign camera 1100, the vehicle-side processing unit 1200 outputs multimodal traffic sign information based on the traffic sign information.

[0050] For example, suppose that the vehicle-side processing unit 1200 comprises a cockpit domain controller 1210. The cockpit domain controller 1210 comprises an audio output control unit 1210a, a display output control unit 1210b, a light control unit 1210c, a vibration control unit 1210d, a user experience control unit 1210e, and an intelligent sound control unit (Intelligent Engine Sound System Audio, iESS Audio) 1210f.

[0051] First, the cockpit domain controller 1210 of the vehicle-side processing unit 1200 receives traffic sign information transmitted via the communication interface, for example, traffic sign information indicating a speed limit of 30 km / h. Based on this traffic sign information, in combination with the current operating state of the vehicle, the user experience control unit 1210e of the cockpit domain controller 1210 determines a strategy for the traffic sign warnings. For example, a multimodal warning strategy is defined, combining visual displays, audible outputs, vibration outputs, and light-based outputs.After the strategy for traffic sign guidance has been determined, the user experience control unit 1210e issues corresponding control commands to the audio output control unit 1210a, the display output control unit 1210b, the light control unit 1210c and the vibration control unit 1210d.

[0052] The respective output control units then each perform the following steps. After receiving the control commands, the audio output control unit 1210a generates corresponding audio control signals and controls the vehicle's speakers to output voice prompts, for example, to play the announcement "Current speed limit: 30 kilometers per hour." Simultaneously, the intelligent sound control unit 1210f can interact with the audio output control unit 1210a and dynamically adjust the engine sound or the volume of conversation sounds depending on the current acoustic conditions in the vehicle interior. For example, during the output of a voice prompt, the volume of a virtual engine sound or background music can be temporarily reduced to prevent the prompt from being masked and to ensure that the prompt is clearly audible.

[0053] Upon receiving the control commands, the 1210b display output control unit controls the vehicle's display components to output appropriate visual traffic sign information. For example, the 1210b display output control unit can control a windshield head-up display to project a traffic sign indicating "Speed ​​limit 30" in the driver's field of vision.

[0054] Upon receiving control commands, the 1210c lighting control unit controls lighting components inside or outside the vehicle to generate light-based cues. For example, the 1210c lighting control unit can briefly illuminate ambient lighting in the driver's area with a soft white light to alert the driver to the speed limit.

[0055] Upon receiving the control commands, the 1210d vibration control unit activates corresponding vibration-capable actuators to generate haptic feedback. For example, the 1210d vibration control unit can briefly activate a vibration module located in the steering wheel or under a seat to enhance the driver's perception of the feedback on a haptic level.

[0056] The driver then switches the vehicle to an automated driving mode. The driver assistance control unit 1300 receives the traffic sign information "Speed ​​limit 30" via the communication interface and automatically controls the vehicle's speed based on this information.

[0057] Furthermore, it should be noted that if the vehicle-side processing unit 1200 includes a vehicle-side audio power amplifier 1220, the workflow for outputting multimodal traffic sign information based on the traffic sign information via the vehicle-side audio power amplifier 1220 is similar to that of the cockpit domain controller 1210. Therefore, a repeated description is omitted here.

[0058] According to exemplary embodiments of the present utility model, after performing traffic sign recognition on the traffic image and receiving the traffic sign information, the traffic sign camera transmits this information via the communication interface to the vehicle's processing unit. Based on the received traffic sign information, the vehicle's processing unit accesses existing audio, display, lighting, or vibration systems to generate corresponding multimodal traffic sign information. This enables the system to output the traffic sign information to the driver in several perceptual forms, thereby increasing the flexibility of the traffic sign information and improving the driving experience.

[0059] It should be noted that the terms “one” and “several” used in the present utility model are to be understood as illustrative and not restrictive, and that those skilled in the art will recognize that, unless expressly stated otherwise in the context, these terms are to be understood as “one or more”.

[0060] The designations of messages or information exchanged between multiple entities in the embodiments of the present utility model serve only descriptive purposes and are not intended to limit the scope of such messages or information.

[0061] The foregoing description merely presents preferred embodiments of the present utility model and an explanation of the technical principles used therein. Those skilled in the art will recognize that the scope of disclosure of the present utility model is not limited to technical solutions formed by a specific combination of the aforementioned technical features, but also includes other technical solutions formed by any combination of these technical features or their equivalent features, provided they do not depart from the fundamental concept disclosed above. This includes, for example, technical solutions formed by a mutual exchange of the aforementioned features with, but not limited to, similarly functioning technical features disclosed in the present utility model.Although the foregoing description contains a number of specific implementation details, these are not to be interpreted as limiting the scope of the present utility model. Certain features described in the context of individual embodiments can also be combined and implemented in a single embodiment. Conversely, various features described in the context of a single embodiment can also be implemented individually or in any suitable combinations in several embodiments.

[0062] Although the subject matter has been described using language relating to structural features and / or methodical logical actions, it should be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above serve merely as exemplary embodiments for realizing the claims.

Claims

[1] Vehicle-mounted traffic sign processing system (1000), comprising: a traffic sign camera (1100) which is selectively provided on a vehicle and comprises an image acquisition module (1110) and an image processing module (1120), wherein the image acquisition module (1110) serves to record traffic images, and wherein the image processing module (1120) serves to subject the traffic image to traffic sign recognition in order to obtain traffic sign information; and a vehicle-side processing unit (1200) which is designed to receive traffic sign information from the traffic sign camera (1100) via one or more communication interfaces and to output multimodal traffic sign information based on the traffic sign information. [2] Vehicle-side traffic sign processing system (1000) according to claim 1, characterized by, that the traffic sign camera (1100) selectively provided on the vehicle can be operated independently of the vehicle's processing unit in order to output the traffic sign information on the basis of the traffic sign information. [3] Vehicle-side traffic sign processing system (1000) according to claim 1, characterized by , that the image acquisition module (1110) comprises at least one optical unit (1110a), one image sensor (1110b) and one illumination unit (1110c), wherein the optical unit (1110a) serves to focus and image incident light from a traffic scene, wherein the image sensor (1110b) serves to capture the light focused via the optical unit (1110a) in order to generate a traffic image, and wherein the lighting unit (1110c) serves to provide supplementary lighting during image capture. [4] Vehicle-side traffic sign processing system (1000) according to claim 1, characterized by , that the image processing module (1120) comprises at least one image buffer unit (1120a) and one traffic sign recognition unit (1120b), the image buffer unit (1120a) serves to store the recorded traffic image, and wherein the traffic sign recognition unit (1120b) serves to subject the stored traffic image to traffic sign detection and recognition in order to generate traffic sign information. [5] Vehicle-side traffic sign processing system (1000) according to claim 1, characterized by , that the communication interface includes at least one vehicle-side communication interface and / or one audio communication interface, where the audio communication interface is based on at least one of an automotive audio bus, an intelligent network interface controller network, a media-oriented systems transport and an audio-video bridging over Ethernet, and wherein the vehicle-side communication interface is based on at least one of a Controller Area Network, a Local Interconnect Network, a Clock Extension Peripheral Interface, Ethernet and a Flexible Data Rate Bus. [6] Vehicle-side traffic sign processing system (1000) according to claim 1, characterized by , that the vehicle-side processing unit (1200) includes at least one cockpit domain controller (1210) and / or one vehicle-side audio power amplifier (1220), wherein the cockpit domain controller (1210) and / or the vehicle audio power amplifier (1220) comprises at least one audio output control unit (1210a, 1220a), a display output control unit (1210b, 1220b), a light control unit (1210c, 1220c) and a vibration control unit (1210d, 1220d) to control the vehicle on the basis of the traffic sign information to output the multimodal traffic sign information. [7] Vehicle-side traffic sign processing system (1000) according to claim 6, characterized by , that the cockpit domain controller (1210) and / or the vehicle-side audio power amplifier (1220) further comprises a user experience control unit (1210e, 1220e), wherein the user experience control unit (1210e, 1220e) serves to adjust the type and / or intensity of traffic sign guidance based on external environmental information. [8] Vehicle-mounted traffic sign processing system (1000) according to any one of claims 1 to 7, characterized by that the multimodal traffic sign indications comprise a combination of one or more of an acoustic indication, a visual indication, a light-based indication and a vibration-based indication, wherein the acoustic indication, the visual indication, the light-based indication and the vibration-based indication relate to a traffic sign. [9] Vehicle-side traffic sign processing system (1000) according to claim 1, characterized by , that the vehicle-side traffic sign processing system (1000) further includes a driver assistance control unit (1300), wherein the driver assistance control unit (1300) serves to receive traffic sign information via the communication interface and to execute driver assistance control on the basis of the traffic sign information. [10] Vehicle-side traffic sign processing system (1000) according to claim 1, characterized by , that the traffic sign information includes recognition information for one or more signs from a speed limit sign, a no-entry sign, a warning sign and a guidance sign.

Images