Traffic signal display method, device and system and storage medium

Abstract

The invention discloses a traffic signal display method, device and system and a storage medium, and the method comprises the steps: obtaining a traffic signal in a vehicle driving region in a vehicle operation process; converting the traffic signal into information of a preset type which does not need to be recognized by means of color perception; displaying the information of the preset type in a skyline screen; and adaptively adjusting the recognizable degree of the preset type of information in the skyline screen. By adopting the scheme provided by the invention, the accuracy of identifying the traffic lights when people with color vision disorder drive the vehicle is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of assisted driving, in particular to a traffic signal display method, device, system and storage medium. BACKGROUND

[0002] In the prior art, traffic signal lights are mostly still distinguished by red, green and yellow three colors. In this case of distinguishing traffic signal lights by color, it is inconvenient for color vision impaired people to drive vehicles. Although there are color vision correction glasses and voice prompt systems to help color vision impaired people solve the problem of identifying traffic signal lights, since the color vision correction glasses can only improve part of the light, and the voice prompt system has significant delay, the problem of identifying traffic signal lights for color vision impaired people has not been effectively solved, and color vision impaired people still cannot drive vehicles because they cannot identify traffic signal lights.

[0003] Therefore, how to provide a traffic signal display method to assist color vision impaired people in accurately identifying traffic signal lights when driving vehicles has become a technical problem to be solved. SUMMARY

[0004] The present application provides a traffic signal display method, device, system and storage medium to assist color vision impaired people in accurately identifying traffic signal lights when driving vehicles.

[0005] The present application provides a traffic signal display method, comprising: acquiring a traffic signal in a vehicle driving area during vehicle operation; converting the traffic signal into information of a preset type which does not need to be identified by color perception; displaying the information of the preset type on a sky screen; adaptively adjusting the distinguishability of the information of the preset type in the sky screen.

[0006] The present application has the beneficial effect that by acquiring a traffic signal in a vehicle driving area during vehicle operation, and converting the traffic signal into information of a preset type which does not need to be identified by color perception, the information of the preset type is displayed on a sky screen, helping color vision impaired people to accurately identify traffic signal lights when driving vehicles. In addition, the present application can also adaptively adjust the distinguishability of the information of the preset type in the sky screen, further improving the accuracy of color vision impaired people in identifying traffic signal lights when driving vehicles.

[0007] In one embodiment, the acquiring a traffic signal in a vehicle driving area comprises: capturing an image in a vehicle driving area by a camera; When a candidate area for a traffic light is detected, the authenticity of the candidate area is verified by lidar. When the verification result indicates that the authenticity of the traffic light candidate area is greater than a preset authenticity threshold, the traffic signal of the traffic light candidate area is extracted.

[0008] In one embodiment, verifying the authenticity of the traffic light candidate area using lidar includes: The target in the traffic light candidate area is verified using at least one of the following verification methods: Geometric consistency verification, motion trajectory verification, spectral feature verification, and chromatographic feature verification; When the target in the traffic light candidate area passes the verification of all verification methods, the authenticity of the traffic light candidate area is determined to be greater than the preset authenticity threshold.

[0009] In one embodiment, converting the traffic signal into a preset type of information that does not require color recognition includes: The traffic signals are mapped to corresponding geometric shapes according to a preset formation relationship table; Generate semantic labels corresponding to the traffic signals represented by the geometry.

[0010] In one embodiment, converting the traffic signal into a preset type of information that does not require color recognition includes: Map traffic signals to international standard traffic symbol codes; The traffic symbol encoding is converted into natural semantic information according to the international standard.

[0011] In one embodiment, the method further includes: When the preset type of information is displayed on the sky screen, the voice prompt information corresponding to the preset type of information is played synchronously. The preset type of information is mapped to a vibration pattern sequence for tactile feedback.

[0012] In one embodiment, the adaptive adjustment of the recognizability of the preset type of information on the sky screen includes: The recognizability of the preset type of information on the sky screen is adaptively adjusted in the following ways: The position of the sunshade curtain is adaptively adjusted according to the intensity and direction of sunlight. The display contrast of the sky screen is adaptively adjusted according to the intensity and direction of sunlight. The transmittance of the sky screen is adaptively adjusted according to the intensity of sunlight. The display size of preset type information on the sky screen is adjusted according to the vehicle speed.

[0013] This application also provides a traffic signal display device, including: The acquisition module is used to acquire traffic signals in the vehicle's operating area during vehicle operation; A conversion module is used to convert the traffic signal into a preset type of information that does not require color perception for recognition; The display module is used to display the preset type of information on the sky screen; An adjustment module is used to adaptively adjust the recognizability of the preset type of information on the sky screen.

[0014] In one embodiment, the acquisition module includes: The acquisition submodule is used to acquire images of the vehicle's driving area via a camera; The verification submodule is used to verify the authenticity of the traffic light candidate area using lidar when a candidate area for a traffic light is detected. The extraction submodule is used to extract the traffic signal of the candidate traffic light region when the verification result indicates that the authenticity of the candidate traffic light region is greater than a preset authenticity threshold.

[0015] In one embodiment, the verification submodule is further configured to: The target in the traffic light candidate area is verified using at least one of the following verification methods: Geometric consistency verification, motion trajectory verification, spectral feature verification, and chromatographic feature verification; When the target in the traffic light candidate area passes the verification of all verification methods, the authenticity of the traffic light candidate area is determined to be greater than the preset authenticity threshold.

[0016] In one embodiment, the conversion module includes: The first mapping submodule is used to map the traffic signal into a corresponding geometric shape according to a preset formation relationship table; A generation submodule is used to generate semantic labels corresponding to the traffic signals represented by the geometry.

[0017] In one embodiment, the conversion module includes: The second mapping submodule is used to map traffic signals to international standard traffic symbol codes; The conversion submodule is used to convert traffic symbol encoding according to the international standard into natural semantic information.

[0018] In one embodiment, the apparatus further includes: The prompt module is used to simultaneously play voice prompts corresponding to the preset type of information when the preset type of information is displayed on the sky screen; The vibration module is used to map the preset type of information into a vibration pattern sequence for tactile feedback.

[0019] In one embodiment, the adjustment module is further configured to: The recognizability of the preset type of information on the sky screen is adaptively adjusted in the following ways: The position of the sunshade curtain is adaptively adjusted according to the intensity and direction of sunlight. The display contrast of the sky screen is adaptively adjusted according to the intensity and direction of sunlight. The transmittance of the sky screen is adaptively adjusted according to the intensity of sunlight. The display size of preset type information on the sky screen is adjusted according to the vehicle speed.

[0020] This application also provides a traffic signal display system, including: At least one processor; and, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to implement the traffic signal display method described in any of the above embodiments.

[0021] This application also provides a computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor corresponding to a traffic signal display system, enables the traffic signal display system to implement the traffic signal display method described in any of the above embodiments.

[0022] Other features and advantages of this application will be set forth in the description which follows, and will be apparent in part from the description, or may be learned by practicing the application. The objectives and other advantages of this application may be realized and obtained by means of the structures particularly pointed out in the written description, claims, and drawings.

[0023] The technical solution of this application will be further described in detail below with reference to the accompanying drawings and embodiments. Attached Figure Description

[0024] The accompanying drawings are provided to further illustrate the present application and form part of the specification. They are used together with the embodiments of the present application to explain the application and do not constitute a limitation thereof. In the drawings: Figure 1 This is a flowchart of a traffic signal display method according to an embodiment of this application; Figure 2This is a schematic diagram of the structure of a traffic signal display device according to one embodiment of this application; Figure 3 This is a schematic diagram of the hardware structure of a traffic signal display system according to an embodiment of this application. Detailed Implementation

[0025] The preferred embodiments of this application are described below with reference to the accompanying drawings. It should be understood that the preferred embodiments described herein are for illustration and explanation only and are not intended to limit this application.

[0026] Figure 1 This is a flowchart of a traffic signal display method according to an embodiment of this application, such as... Figure 1 As shown, the method can be implemented as follows: S101-S104: In step S101, during vehicle operation, traffic signals in the vehicle's driving area are acquired; In step S102, the traffic signal is converted into a preset type of information that does not require color perception for recognition; In step S103, the information of the preset type is displayed on the sky screen; In step S104, the recognizability of the preset type of information in the sky screen is adaptively adjusted.

[0027] During vehicle operation, traffic signals within the vehicle's driving area are acquired. In one embodiment, a forward-facing camera continuously captures images of the area in front of the vehicle, acquiring a real-time video stream containing traffic lights; a lidar scans the area around the vehicle, generating point cloud data; and a high-precision map positioning system determines the vehicle's precise location. The various sensors complement each other, and after time synchronization and spatial alignment, the data is verified and supplemented to form multi-source data. Based on this multi-source data, a target detection model extracts the traffic light region from the image sequence and performs spectral decoupling on the traffic light region, separating the traffic light source from environmental interference sources and extracting the spectrum corresponding to the traffic light, thereby improving traffic light recognition and avoiding interference from other light sources. In another embodiment, images of the vehicle's driving area are acquired by a camera; when a candidate traffic light region is detected, the authenticity of the candidate region is verified by lidar. In one embodiment, the system employs a multi-dimensional verification mechanism to confirm the authenticity of targets in the candidate traffic light region, specifically through at least one of geometric consistency, motion trajectory, spectral features, and chromatographic features. When a candidate target passes all verification methods, its authenticity is determined to exceed a preset threshold. The system employs several verification methods: Geometric consistency verification calculates the error by projecting the target size measured by LiDAR onto the pixel size of the camera image, requiring an error of less than 15% (based on camera intrinsic matrix transformation); Motion trajectory verification uses optical flow to track the target's motion path across five consecutive frames, classifying it as a static target when the angle between its velocity vector and the vehicle's velocity vector exceeds 75°; Spectral feature verification performs a Fourier transform on the red area captured by the camera to detect the presence of a typical traffic light flicker spectrum of 1Hz-3Hz; and Color spectrum feature verification uses color analysis to confirm whether the target displays one of the three colors: red, green, or yellow. In the comprehensive decision stage, the system requires the following conditions to be met simultaneously: geometric error less than 15%, reflection intensity higher than 80 cd / m², and spatial height between 2.5 meters and 6 meters, along with either a motion trajectory angle greater than 75° or the detection of a flicker spectrum. Once the verification results confirm the authenticity of the candidate area, the system extracts the traffic signal status for that area.

[0028] The traffic signal is converted into a preset type of information that does not require color perception for recognition, and the preset type of information is displayed on the sky screen.

[0029] In one embodiment, the traffic signal can be mapped to a corresponding geometric shape according to a preset traffic formation table. For example, the red / green / yellow light states can be mapped to the following geometric shapes: a red light is mapped to a solid triangle, which can vibrate at high frequency along the Y-axis to enhance the warning effect; a green light is mapped to a solid green circle, which can rotate slowly clockwise; and a yellow light is mapped to a solid yellow square, which can enhance the warning effect by flashing its edges. Then, semantic labels corresponding to the traffic signals represented by the geometric shapes are generated, such as Chinese prompts for "Stop," "Proceed," and "Slow Down." Furthermore, the geometric shapes and the semantic labels corresponding to the traffic signals represented by the geometric shapes can be displayed synchronously on the sky screen. Specifically, while displaying the geometric shapes, the semantic labels corresponding to the traffic signals represented by the geometric shapes can be displayed below the corresponding geometric shapes. For example, if the current traffic signal is red, a solid triangle is displayed in the center of the sky screen, and the semantic label "Stop" is displayed below the solid triangle.

[0030] In another embodiment, the system uses an international standard traffic symbol coding system to standardize the conversion of traffic signals, mapping a red circle to 0x01 (indicating no passage), a green right-turn arrow to 0x0A (indicating right turn permitted), and a yellow countdown number "5" to 0x15 (indicating the light will change in 5 seconds), and simultaneously generating corresponding natural language semantic information. This coded information and semantic text are displayed in conjunction with a sky screen to form a visual communication of traffic instructions.

[0031] In addition, this system has constructed a multimodal feedback mechanism: when the preset information is displayed, the voice broadcast function is triggered simultaneously, and different signal states are mapped to differentiated vibration modes. The red signal is warned by three short vibrations of 200ms followed by one long vibration of 1s, the green signal is indicated by a continuous long vibration of 1.5s, and the yellow signal is indicated by intermittent vibration at 500ms intervals for 3 seconds. Through the coordinated feedback of touch, hearing and vision, it is ensured that drivers can still accurately receive traffic instructions in complex environments.

[0032] In this application, to improve the accuracy of traffic signal recognition, the recognizability of the preset type of information on the skylight is adaptively adjusted. For example, the recognizability of the preset type of information on the skylight is adaptively adjusted in the following ways: the position of the sunshade is adaptively adjusted according to the sunlight intensity and direction; the display contrast of the skylight is adaptively adjusted according to the sunlight intensity and direction; the light transmittance of the skylight is adaptively adjusted according to the sunlight intensity; and the display size of the preset type of information on the skylight is adjusted according to vehicle speed. In one embodiment, recognizability is a comprehensive concept combining subjective perception and objective conditions, used to quantitatively describe the ease with which an observed object is clearly recognized by the human eye or device under specific conditions, or to quantitatively describe the ease with which a target object is accurately distinguished from its background or adjacent objects under specific conditions. Influenced by multiple factors such as clarity, contrast, resolution, environment, device, and target characteristics, recognizability can also be adjusted by changing these factors.

[0033] In addition, adaptive recognition can adjust the focus area of ​​the displayed content based on the driver's pupil tracking data; automatically enhance the glow effect of graphic edges in rainy or foggy weather; and increase the information flashing frequency based on driver fatigue detection results (such as the frequency of eye closure).

[0034] The beneficial effects of this application are as follows: by acquiring traffic signals in the vehicle's driving area during vehicle operation and converting the traffic signals into preset type information that does not require color perception for recognition, the preset type information is displayed on the sky screen, helping people with color vision impairments to accurately identify traffic lights while driving. In addition, this application can adaptively adjust the recognizability of the preset type information on the sky screen, further improving the accuracy of people with color vision impairments in identifying traffic lights while driving.

[0035] In one embodiment, step S101 above can be implemented as steps A1-A3 as follows: In step A1, images of the vehicle's driving area are captured using a camera; In step A2, when a candidate area for a traffic light is detected, the authenticity of the candidate area for the traffic light is verified by a lidar. In step A3, when the verification result indicates that the authenticity of the traffic light candidate area is greater than a preset authenticity threshold, the traffic signal of the traffic light candidate area is extracted.

[0036] In one embodiment, step A2 above can be implemented as follows: The target in the traffic light candidate area is verified using at least one of the following verification methods: Geometric consistency verification, motion trajectory verification, spectral feature verification, and chromatographic feature verification; When the target in the traffic light candidate area passes the verification of all verification methods, the authenticity of the traffic light candidate area is determined to be greater than the preset authenticity threshold.

[0037] In one embodiment, the geometric consistency verification involves projecting the target size measured by the lidar onto the pixel size of the target in the camera image, verifying whether the error between the two is less than 15% (calculated using the camera intrinsic parameter matrix); the motion trajectory verification involves tracking the target's motion trajectory in five consecutive frames using optical flow, calculating the angle between its velocity vector and the vehicle's velocity vector, and determining it as a static target (consistent with traffic light characteristics) if the angle is greater than 75°; the spectral feature verification involves performing a Fourier transform on the red area captured by the camera to detect the presence of a 1Hz-3Hz flickering spectral component (typical traffic light flickering frequency); and the chromatographic feature verification involves chromatographic analysis to determine that the target in the traffic light candidate area is a preset color (one of red, green, or yellow). Then, a comprehensive judgment is made, meaning the target is determined to be a real traffic light if and only if all of the following conditions are met: geometric consistency error < 15%, reflection intensity > 80 cd / m², and spatial height within the range of [2.5m, 6m]; motion trajectory angle > 75°, or a flickering spectral component is detected.

[0038] In one embodiment, step S102 above can be implemented as steps B1-B2 as follows: In step B1, the traffic signals are mapped to corresponding geometric shapes according to a preset formation relationship table; In step B2, semantic tags corresponding to the traffic signals represented by the geometry are generated.

[0039] In one embodiment, step B1 above can be implemented as follows: The red, green, and yellow states are mapped to the following geometric shapes: Red light: A solid triangle that can vibrate at high frequency along the Y-axis to enhance the warning effect; Green light: A solid green circle that can rotate slowly clockwise; Yellow light: A solid yellow square that can be flashed at the edges to enhance its warning effect; The semantic labels mentioned in step B2 above can be Chinese prompts such as "Stop", "Pass", and "Slow Down".

[0040] In one embodiment, step S103 can be implemented as follows: The geometric shapes and the corresponding semantic labels representing the traffic signals are simultaneously displayed on the sky screen. Specifically, while displaying the geometric shapes, the semantic labels corresponding to the traffic signals represented by the geometric shapes are displayed below the corresponding geometric shapes. For example, if the current traffic signal is red, a solid triangle is displayed in the center of the sky screen, and the semantic label "Stop" is displayed below the solid triangle.

[0041] In one embodiment, step S102 above can be implemented as steps C1-C2 as follows: In step C1, the traffic signals are mapped to international standard traffic symbol codes; In step C2, the traffic symbol is converted into natural semantic information according to the international standard traffic symbol encoding.

[0042] In one embodiment, step C1 above can be implemented as follows: Map the red circle to 0x01 code to indicate that passage is prohibited; Map the green right-turn arrow to 0x0A code to indicate that a right turn is allowed; The yellow countdown number "5" is mapped to the 0x15 code, indicating that the light will change after 5 seconds.

[0043] In one embodiment, step S103 can be implemented as follows: The international standard traffic symbol codes and natural semantic information are displayed simultaneously on the sky screen.

[0044] In one embodiment, the method may also be implemented as follows: steps D1-D2: In step D1, when the preset type of information is displayed on the sky screen, the voice prompt information corresponding to the preset type of information is played synchronously. In step D2, the information of the preset type is mapped to a vibration pattern sequence for tactile feedback.

[0045] In one embodiment, step D2 above can be implemented as follows: The semantic commands are mapped to vibration pattern sequences. Specifically, the red signal is mapped to three consecutive short vibrations (200ms interval) + one long vibration (1s); the green signal is mapped to a single long vibration (1.5s); and the yellow signal is mapped to intermittent vibration (500ms on / 500ms off, lasting 3s).

[0046] In one embodiment, step S104 above can be implemented as follows: The recognizability of the preset type of information on the sky screen is adaptively adjusted in the following ways: The position of the sunshade curtain is adaptively adjusted according to the intensity and direction of sunlight. The display contrast of the sky screen is adaptively adjusted according to the intensity and direction of sunlight. The transmittance of the sky screen is adaptively adjusted according to the intensity of sunlight. The display size of preset type information on the sky screen is adjusted according to the vehicle speed.

[0047] In one embodiment, discernibility is a comprehensive concept combining subjective perception and objective conditions. It is used to quantitatively describe how easily an observed object can be clearly identified by the human eye or equipment under specific conditions, or to quantitatively describe how easily a target object can be accurately distinguished from its background or adjacent objects under specific conditions. Discernibility is influenced by multiple factors such as sharpness, contrast, resolution, environment, equipment, and target characteristics, and can be adjusted by changing these factors.

[0048] In one embodiment, the method may also be implemented as follows: The traffic signal mapping table is updated in real time via the cloud.

[0049] In one embodiment, the method may also be implemented as follows: Optimize the display of geometric shapes and semantic labels based on user feedback.

[0050] Figure 2 This is a schematic diagram of the structure of a traffic signal display device according to an embodiment of this application, as shown below. Figure 2 As shown, the device includes: The acquisition module 201 is used to acquire traffic signals in the vehicle's driving area during vehicle operation; The conversion module 202 is used to convert the traffic signal into a preset type of information that does not require color perception for recognition; Display module 203 is used to display the preset type of information on the sky screen; The adjustment module 204 is used to adaptively adjust the recognizability of the preset type of information on the sky screen.

[0051] In one embodiment, the acquisition module includes: The acquisition submodule is used to acquire images of the vehicle's driving area via a camera; The verification submodule is used to verify the authenticity of the traffic light candidate area using lidar when a candidate area for a traffic light is detected. The extraction submodule is used to extract the traffic signal of the candidate traffic light region when the verification result indicates that the authenticity of the candidate traffic light region is greater than a preset authenticity threshold.

[0052] In one embodiment, the verification submodule is further configured to: The target in the traffic light candidate area is verified using at least one of the following verification methods: Geometric consistency verification, motion trajectory verification, spectral feature verification, and chromatographic feature verification; When the target in the traffic light candidate area passes the verification of all verification methods, the authenticity of the traffic light candidate area is determined to be greater than the preset authenticity threshold.

[0053] In one embodiment, the conversion module includes: The first mapping submodule is used to map the traffic signal into a corresponding geometric shape according to a preset formation relationship table; A generation submodule is used to generate semantic labels corresponding to the traffic signals represented by the geometry.

[0054] In one embodiment, the conversion module includes: The second mapping submodule is used to map traffic signals to international standard traffic symbol codes; The conversion submodule is used to convert traffic symbol encoding according to the international standard into natural semantic information.

[0055] In one embodiment, the apparatus further includes: The prompt module is used to simultaneously play voice prompts corresponding to the preset type of information when the preset type of information is displayed on the sky screen; The vibration module is used to map the preset type of information into a vibration pattern sequence for tactile feedback.

[0056] In one embodiment, the adjustment module is further configured to: The recognizability of the preset type of information on the sky screen is adaptively adjusted in the following ways: The position of the sunshade curtain is adaptively adjusted according to the intensity and direction of sunlight. The display contrast of the sky screen is adaptively adjusted according to the intensity and direction of sunlight. The transmittance of the sky screen is adaptively adjusted according to the intensity of sunlight. The display size of preset type information on the sky screen is adjusted according to the vehicle speed.

[0057] Figure 3 This is a schematic diagram of the hardware structure of a traffic signal display system according to an embodiment of this application, as shown below. Figure 3 As shown, the traffic signal display system includes: At least one processor 320; and, Memory 304 communicatively connected to the at least one processor 320; wherein, The memory 304 stores instructions that can be executed by the at least one processor 320 to implement the traffic signal display method described in any of the above embodiments.

[0058] Reference Figure 3 The traffic signal display system 300 may include one or more of the following components: processing component 302, memory 304, power supply component 306, multimedia component 308, audio component 310, input / output (I / O) interface 312, sensor component 314, and communication component 316.

[0059] Processing component 302 typically controls the overall operation of traffic signal display system 300. Processing component 302 may include one or more processors 320 to execute instructions to complete all or part of the steps of the method described above. Furthermore, processing component 302 may include one or more modules to facilitate interaction between processing component 302 and other components. For example, processing component 302 may include a multimedia module to facilitate interaction between multimedia component 308 and processing component 302.

[0060] Memory 304 is configured to store various types of data to support the operation of traffic signal display system 300. Examples of this data include instructions for any application or method operating on traffic signal display system 300, such as text, images, video, etc. Memory 304 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0061] Power supply component 306 provides power to various components of traffic signal display system 300. Power supply component 306 may include power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to vehicle control system 300.

[0062] Multimedia component 308 includes a screen that provides an output interface between traffic signal display system 300 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of touch or swipe actions but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 308 may also include a front-facing camera and / or a rear-facing camera. When the traffic signal display system 300 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0063] Audio component 310 is configured to output and / or input audio signals. For example, audio component 310 includes a microphone (MIC) configured to receive external audio signals when the traffic signal display system 300 is in an operating mode, such as alarm mode, recording mode, voice recognition mode, and voice output mode. The received audio signals may be further stored in memory 304 or transmitted via communication component 316. In some embodiments, audio component 310 also includes a speaker for outputting audio signals.

[0064] I / O interface 312 provides an interface between processing component 302 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, start buttons, and lock buttons.

[0065] Sensor assembly 314 includes one or more sensors for providing status assessments of various aspects of the traffic signal display system 300. For example, sensor assembly 314 may include a sound sensor. Additionally, sensor assembly 314 may detect the on / off state of the traffic signal display system 300, the relative positioning of components (e.g., the display and keypad of the traffic signal display system 300), and the operational status of the traffic signal display system 300 or one of its components, such as the operational status of the air distribution plate, structural status, the operational status of the discharge scraper, the orientation or acceleration / deceleration of the traffic signal display system 300, and temperature changes of the traffic signal display system 300. Sensor assembly 314 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 314 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 314 may also include an accelerometer, a gyroscope, a magnetometer, a pressure sensor, a material buildup thickness sensor, or a temperature sensor.

[0066] Communication component 316 is configured to enable traffic signal display system 300 to provide wired or wireless communication capabilities with other devices and cloud platforms. Traffic signal display system 300 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 316 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 316 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0067] In an exemplary embodiment, the traffic signal display system 300 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the traffic signal display method described in any of the above embodiments.

[0068] This application also provides a computer-readable storage medium, which, when the instructions in the storage medium are executed by a processor corresponding to a traffic signal display system, enables the traffic signal display system to implement the traffic signal display method described in any of the above embodiments.

[0069] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product implemented on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.

[0070] This application is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of this application. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart... Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0071] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0072] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.

[0073] Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of this application. Therefore, if such modifications and variations fall within the scope of the claims of this application and their equivalents, this application also intends to include such modifications and variations.

Claims

1. A traffic signal display method, characterized in that, include: During vehicle operation, traffic signals in the vehicle's operating area are acquired; The traffic signal is converted into a preset type of information that does not require color perception for recognition; Display the information of the preset type on the sky screen; The visibility of the preset type of information on the sky screen is adaptively adjusted.

2. The method as described in claim 1, characterized in that, The acquisition of traffic signals in the vehicle's driving area includes: Images of the vehicle's driving area are captured using cameras; When a candidate area for a traffic light is detected, the authenticity of the candidate area is verified by lidar. When the verification result indicates that the authenticity of the traffic light candidate area is greater than a preset authenticity threshold, the traffic signal of the traffic light candidate area is extracted.

3. The method as described in claim 2, characterized in that, The verification of the authenticity of the candidate traffic light area using lidar includes: The target in the traffic light candidate area is verified using at least one of the following verification methods: Geometric consistency verification, motion trajectory verification, spectral feature verification, and chromatographic feature verification; When the target in the traffic light candidate area passes the verification of all verification methods, the authenticity of the traffic light candidate area is determined to be greater than the preset authenticity threshold.

4. The method as described in claim 1, characterized in that, The process of converting the traffic signal into a preset type of information that does not require color recognition includes: The traffic signals are mapped to corresponding geometric shapes according to a preset formation relationship table; Generate semantic labels corresponding to the traffic signals represented by the geometry.

5. The method as described in claim 1, characterized in that, The process of converting the traffic signal into a preset type of information that does not require color recognition includes: Map traffic signals to international standard traffic symbol codes; The traffic symbol encoding is converted into natural semantic information according to the international standard.

6. The method as described in claim 1, characterized in that, The method further includes: When the preset type of information is displayed on the sky screen, the voice prompt information corresponding to the preset type of information is played synchronously. The preset type of information is mapped to a vibration pattern sequence for tactile feedback.

7. The method as described in claim 1, characterized in that, The adaptive adjustment of the recognizability of the preset type of information on the sky screen includes: The recognizability of the preset type of information on the sky screen is adaptively adjusted in the following ways: The position of the sunshade curtain is adaptively adjusted according to the intensity and direction of sunlight. The display contrast of the sky screen is adaptively adjusted according to the intensity and direction of sunlight. The transmittance of the sky screen is adaptively adjusted according to the intensity of sunlight. The display size of preset type information on the sky screen is adjusted according to the vehicle speed.

8. A traffic signal display device, characterized in that, include: The acquisition module is used to acquire traffic signals in the vehicle's operating area during vehicle operation; A conversion module is used to convert the traffic signal into a preset type of information that does not require color perception for recognition; The display module is used to display the preset type of information on the sky screen; An adjustment module is used to adaptively adjust the recognizability of the preset type of information on the sky screen.

9. A traffic signal display system, characterized in that, include: At least one processor; as well as, A memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor to implement the traffic signal display method as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor corresponding to the traffic signal display system, the traffic signal display system is able to implement the traffic signal display method as described in any one of claims 1-7.

Images