Vehicle Information Processing Method, Device, Computer Equipment, Vehicle and Storage Medium

By installing sound output devices and multiple visual display devices on the vehicle, it is determined that the target vehicle outputs auditory and visual reminder when the lights are not turned on, which solves the safety problems caused by the vehicle lights being turned off and improves driving safety.

CN114708563BActive Publication Date: 2025-05-27BEIJING BEYONCA INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202210289255.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-22
Publication Date
2025-05-27
Estimated Expiration
2042-03-22

AI Technical Summary

Technical Problem

In night or dim scenes, the vehicle lights may be turned off, which will affect the safety of itself and other vehicles, and the target vehicle needs to be effectively reminded.

Method used

By installing a sound output device on the vehicle and a plurality of visual display devices distributed around the vehicle body, it is determined that when the reminder event is triggered, an auditory reminder is output and a visual reminder is displayed on the corresponding visual display device.

Benefits of technology

Timely and accurate reminders for the target vehicle not turning on the lights has been achieved, improving driving safety.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114708563B_ABST
    Figure CN114708563B_ABST
Patent Text Reader

Abstract

A vehicle information processing method, apparatus, computer device, vehicle, and storage medium are provided. The vehicle includes a sound output device and a plurality of visual display devices distributed around the vehicle body. The method includes: determining that a reminder event is triggered, where the reminder event indicates that a target vehicle adjacent to the vehicle has not turned on its headlights; and in response to the reminder event being triggered, causing the sound output device to output an auditory reminder and causing the visual display device corresponding to the target vehicle among the plurality of visual display devices to display a visual reminder.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to vehicle information processing, and particularly to a vehicle information processing method, apparatus, computer device, vehicle, storage medium, and computer program product for reminding a target vehicle that its headlights are not turned on. Background Art

[0002] Whether the vehicle lighting system is turned on as required during driving has a great impact on traffic safety. During daily driving, especially at night or in dim scenarios, people may, for various reasons, such as novice drivers forgetting due to unfamiliar driving habits, or experienced drivers forgetting due to being in a hurry, leave the vehicle lights in the off state. When a vehicle with its lights off is driving on the road, it will have a greater impact on its own and other vehicles' safety. Measures are needed to effectively remind vehicles (i.e., target vehicles) with their headlights incorrectly in the off state. Summary of the Invention

[0003] Embodiments of the present disclosure provide a vehicle information processing method, apparatus, computer device, vehicle, storage medium, and computer program product for reminding a target vehicle that its headlights are not turned on, thus solving or at least alleviating the problems existing in the related art.

[0004] According to a first aspect of the present disclosure, there is provided a vehicle information processing method. The vehicle includes a sound output device and a plurality of visual display devices distributed around the vehicle body. The method includes: determining that a reminder event is triggered, the reminder event indicating that a target vehicle adjacent to the vehicle has its headlights not turned on; and in response to the reminder event being triggered, causing the sound output device to output an auditory reminder and causing the visual display device corresponding to the target vehicle among the plurality of visual display devices to display a visual reminder.

[0005] According to a second aspect of the present disclosure, there is provided a vehicle information processing apparatus. The vehicle includes a sound output device and a plurality of visual display devices distributed around the vehicle body. The apparatus includes: a determination module configured to determine that a reminder event is triggered, the reminder event indicating that a target vehicle adjacent to the vehicle has its headlights not turned on; and a reminder module configured to, in response to the reminder event being triggered, cause the sound output device to output an auditory reminder and cause the visual display device corresponding to the target vehicle among the plurality of visual display devices to display a visual reminder.

[0006] According to a third aspect of the present disclosure, there is provided a computer device. The computer device includes: at least one processor; and at least one memory having a computer program stored thereon. When the computer program is executed by the at least one processor, the at least one processor is caused to execute the method according to the embodiments of the present disclosure.

[0007] According to a fourth aspect of the present disclosure, a vehicle is provided. The vehicle includes a sound output device; a plurality of visual display devices distributed around the vehicle body; and a computer device according to an embodiment of the present disclosure.

[0008] According to a fifth aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the processor is caused to execute the method according to an embodiment of the present disclosure.

[0009] According to a sixth aspect of the present disclosure, a computer program product is provided, including a computer program. When the computer program is executed by a processor, the processor is caused to execute the method according to an embodiment of the present disclosure.

[0010] The present disclosure at least includes the following technical solutions:

[0011] Technical solution 1: A vehicle information processing method, the vehicle including a sound output device and a plurality of visual display devices distributed around the vehicle body, the method including:

[0012] Determining that a reminder event is triggered, the reminder event indicating that a target vehicle adjacent to the vehicle has not turned on its headlights; and

[0013] In response to the reminder event being triggered, causing the sound output device to output an auditory reminder and causing the visual display device corresponding to the target vehicle among the plurality of visual display devices to display a visual reminder.

[0014] Technical solution 2: The method according to technical solution 1, wherein determining that the reminder event is triggered includes:

[0015] Obtaining ambient light intensity data detected by at least one light sensor;

[0016] In response to the ambient light intensity data indicating that the ambient brightness is lower than a predetermined threshold, obtaining image data from at least one on-vehicle camera;

[0017] Preprocessing the image data;

[0018] Processing the preprocessed image data to determine whether the target vehicle has not turned on its headlights; and

[0019] In response to determining that the target vehicle has not turned on its headlights, determining that the reminder event is triggered.

[0020] Technical solution 3: The method according to technical solution 2, wherein the preprocessing includes:

[0021] Extracting image frames from the image data;

[0022] Crop out the central region of the image from the extracted image frames; and

[0023] Enhance the brightness of the central region of the image.

[0024] Technical solution 4: The method according to technical solution 2, wherein, the processing the preprocessed image data to determine whether the target vehicle has its headlights off includes: using at least one neural network model to determine whether the target vehicle has its headlights off from the preprocessed image data.

[0025] Technical solution 5: The method according to technical solution 4, wherein, the at least one neural network model includes:

[0026] At least one target detection model for detecting the target vehicle from the preprocessed image data;

[0027] At least one target segmentation model for segmenting out the vehicle contour region containing the detected target vehicle from the preprocessed image data; and

[0028] At least one target classification model for identifying whether the target vehicle has its headlights off from the segmented vehicle contour region.

[0029] Technical solution 6: The method according to technical solution 5, wherein, the at least one target detection model is trained to select the vehicle target closest to the vehicle as the target vehicle from the multiple vehicle targets when detecting multiple vehicle targets from the preprocessed image data.

[0030] Technical solution 7: The method according to technical solution 1, wherein, the determination that the reminder event is triggered includes:

[0031] Receiving a user input of the vehicle; and

[0032] In response to receiving the user input, determining that the reminder event is triggered.

[0033] Technical solution 8: The method according to any one of technical solutions 1-7, wherein, the multiple visual display devices include a front visual display device, a rear visual display device, a left visual display device, and a right visual display device respectively located around the vehicle body, and the display of the visual reminder includes:

[0034] In response to the target vehicle being in front of the vehicle, causing the front visual display device to display a visual reminder;

[0035] In response to the target vehicle being located behind the vehicle, cause the rear visual display device to display a visual reminder;

[0036] In response to the target vehicle being located to the left of the vehicle, cause the left visual display device to display a visual reminder; and

[0037] In response to the target vehicle being located to the right of the vehicle, cause the right visual display device to display a visual reminder.

[0038] Technical solution 9: The method according to any one of technical solutions 1-7, wherein the displaying of the visual reminder includes causing the visual display device corresponding to the target vehicle among the plurality of visual display devices to display text and / or a pattern indicating that the vehicle lights are not turned on.

[0039] Technical solution 10: The method according to any one of technical solutions 1-7, wherein the displaying of the visual reminder includes causing the visual reminder to flash at a certain frequency.

[0040] Technical solution 11: The method according to any one of technical solutions 1-7, wherein the sound output device includes an on-vehicle horn, and the outputting of the auditory reminder includes causing the on-vehicle horn to sound.

[0041] Technical solution 12: A vehicle information processing device, the vehicle including a sound output device and a plurality of visual display devices distributed around the vehicle body of the vehicle, the device including:

[0042] A determination module configured to determine that a reminder event is triggered, the reminder event indicating that a target vehicle adjacent to the vehicle has its vehicle lights not turned on; and

[0043] A reminder module configured to, in response to the reminder event being triggered, cause the sound output device to output an auditory reminder and cause the visual display device corresponding to the target vehicle among the plurality of visual display devices to display a visual reminder.

[0044] Technical solution 13: A computer device, including:

[0045] At least one processor; and

[0046] At least one memory having stored thereon a computer program,

[0047] wherein, when the computer program is executed by the at least one processor, the at least one processor executes the method according to any one of technical solutions 1-11.

[0048] Technical solution 14: A vehicle, including:

[0049] A sound output device;

[0050] Multiple visual display devices distributed around the body of the vehicle; and

[0051] The device according to Technical Solution 12 or the computer device according to Technical Solution 13.

[0052] Technical Solution 15: The vehicle according to Technical Solution 14, wherein at least one of the multiple visual display devices includes:

[0053] A thin film display screen covering the vehicle body; and

[0054] A transparent cover layer covering the thin film display screen.

[0055] Technical Solution 16: The vehicle according to Technical Solution 14, wherein the multiple visual display devices include:

[0056] A front visual display device disposed on the front side surface of the vehicle;

[0057] A rear visual display device disposed on the rear side surface of the vehicle;

[0058] A left visual display device disposed on the left side surface of the vehicle; and

[0059] A right visual display device disposed on the right side surface of the vehicle.

[0060] Technical Solution 17: A computer-readable storage medium having a computer program stored thereon, which when executed by a processor causes the processor to execute the method according to any one of Technical Solutions 1-11.

[0061] Technical Solution 18: A computer program product including a computer program, which when executed by a processor causes the processor to execute the method according to any one of Technical Solutions 1-11.

[0062] According to the embodiments described hereinafter, these and other aspects of the present disclosure will be apparent and will be elucidated with reference to the embodiments described hereinafter. Description of the Drawings

[0063] In the following description of the exemplary embodiments with reference to the drawings, more details, features and advantages of the present disclosure are disclosed. In the drawings:

[0064] Figure 1 A flowchart showing a vehicle information processing method according to an exemplary embodiment;

[0065] Figure 2 Is a flowchart showing a method for determining that a reminder event is triggered according to an exemplary embodiment;

[0066] Figure 3 is a flowchart showing a method for determining that a reminder event is triggered according to another exemplary embodiment;

[0067] Figure 4 is a schematic diagram showing the positions of a plurality of visual display devices;

[0068] Figure 5 is a schematic diagram showing the structure of a visual display device according to an exemplary embodiment;

[0069] Figure 6 is a schematic block diagram showing a vehicle information processing device according to an exemplary embodiment; and

[0070] Figure 7 is a block diagram showing an exemplary computer device that can be applied to an exemplary embodiment. Detailed Description of the Invention

[0071] In the present disclosure, unless otherwise specified, the terms "first", "second", etc. are used to describe various elements and are not intended to limit the positional relationship, timing relationship or importance relationship of these elements. Such terms are only used to distinguish one element from another. In some examples, the first element and the second element may refer to the same instance of the element, and in certain cases, based on the context description, they may also refer to different instances.

[0072] In the description of various examples in the present disclosure, the terms used are only for the purpose of describing specific examples and are not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, the element may be one or more. As used herein, the term "plurality" means two or more, and the term "based on" should be interpreted as "at least partially based on". In addition, the terms "and / or" and "at least one of..." cover any one of the listed items and all possible combinations.

[0073] During daily driving, especially at night or in a dim scene, it is generally required that the vehicle lights be turned on according to regulations. If the vehicle lights are wrongly turned off, the vehicle driving on the road will have a greater impact on its own and other vehicles' safety. In actual situations, when encountering a vehicle with its lights not properly turned on (i.e., the target vehicle), one can only drive to the left, right, front or rear of the target vehicle and the driver manually honks to give a reminder. However, this method generally cannot enable the driver of the target vehicle to timely and accurately know that the other party is reminding them that their vehicle lights are not on.

[0074] The embodiments of the present disclosure provide a vehicle information processing method so as to at least be able to effectively remind a vehicle whose vehicle lights are wrongly turned off.

[0075] The exemplary embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[0076] Figure 1 The flowchart of a vehicle information processing method 100 according to an exemplary embodiment is shown. The vehicle implementing this vehicle information processing method includes at least a sound output device and a plurality of visual display devices distributed around the vehicle body.

[0077] Referring to Figure 1 , the vehicle information processing method 100 includes step 110 and step 120. In step 110, first, it is confirmed whether the target vehicle adjacent to the vehicle has not turned on the headlights correctly. If it is determined that the target vehicle has not turned on the headlights correctly, a reminder event is triggered. In step 120, in response to the reminder event being triggered, an auditory reminder is output using the vehicle's sound output device and a visual reminder is displayed using the vehicle's plurality of visual display devices. In order for the target vehicle to see the visual reminder, the visual display device corresponding to the target vehicle among the plurality of visual display devices distributed around the vehicle body is used to display the visual reminder. The method 100 triggers a reminder event based on the fact that the adjacent target vehicle has not turned on the headlights correctly, and by generating an auditory reminder and a visual reminder, enables the driver of the target vehicle to timely and accurately know that they have not turned on the headlights.

[0078] Regarding step 110, the present disclosure can trigger the reminder event in an automatic manner and a manual manner. Figure 2 The flowchart of a method 200 for determining that a reminder event is triggered according to an exemplary embodiment is shown. In Figure 2 this method, the reminder event is triggered in an automatic manner.

[0079] Referring to Figure 2 , the method 200 for determining that a reminder event is triggered includes the following steps. First, environmental light intensity data detected by at least one light sensor is obtained (step 210). Detecting the environmental light intensity data is to evaluate whether the vehicle needs to turn on the headlights in the current environment. If the environmental light intensity data detected by at least one light sensor indicates that the environmental brightness is lower than a predetermined threshold, it means that the headlights need to be turned on. If the target vehicle has not turned on the headlights, the target vehicle needs to be reminded to turn on the headlights. On the contrary, it means that the headlights do not need to be turned on in the current environment, and there is no need to remind the target vehicle to turn on the headlights. In some embodiments, the headlights need to be turned on when it is night or the light dimness is equivalent to night, otherwise the headlights do not need to be turned on.

[0080] After obtaining the environmental light intensity data, in response to the environmental light intensity data indicating that the environmental brightness is lower than a predetermined threshold, image data from at least one in-vehicle camera is obtained (step 220). Among them, the image data of at least one in-vehicle camera obtained in step 220 will be used to determine whether the target vehicle has turned on the headlights.

[0081] After obtaining the image data of at least one vehicle-mounted camera, preprocess the image data. In some embodiments, the preprocessing includes extracting image frames from the image data, i.e., frame extraction operation (step 230). For the image frames after frame extraction, crop the central region of the image (step 240). In some embodiments, first perform regional cropping of the central region to exclude other vehicles in other lanes and other interferences such as roadside lights, and only process the image region within a short distance in front of or behind the same lane. By cropping the image frames, the subsequent detection region will be compressed. For example, it is compressed to only contain 1 or 2 vehicles in front or behind, and exclude farther vehicles from entering the subsequent detection region. It should be understood that the central region cropping can be performed on the images obtained by each camera. Excluding other vehicles in other lanes, roadside lights, and the light ranges of farther vehicles in front and behind reduces the detection range and thus improves the detection accuracy. After cropping, enhance the brightness of the central region of the image (step 250). It can be understood that if the vehicles in the image region to be processed do not turn on their lights, the overall brightness of the image region will be relatively dark and the distribution range will be narrow, with low distinguishability. Therefore, introducing the image brightness enhancement step 250 will increase the overall brightness and distinguishability to optimize the quality of the subsequent detection algorithm.

[0082] After the preprocessing step, process the preprocessed image data to determine whether the target vehicle has its lights off (step 260). In some embodiments, step 260 includes using at least one neural network model to determine whether the target vehicle has its lights off from the preprocessed image data. The at least one neural network model includes: at least one target detection model for detecting the target vehicle from the preprocessed image data; at least one target segmentation model for segmenting the vehicle contour region containing the detected target vehicle from the preprocessed image data; and at least one target classification model for identifying whether the target vehicle has its lights off from the segmented vehicle contour region. In some embodiments, for the four directions of front, rear, left, and right, one target detection model, one target segmentation model, and one target classification model are respectively provided.

[0083] Based on the above three neural network models, method 200 further includes the following three steps 270-290. Step 270 is based on at least one object detection model. The at least one object detection model is trained to select the vehicle target closest to the vehicle as the target vehicle from multiple vehicle targets when multiple vehicle targets are detected from the preprocessed image data. Step 280 is based on at least one object segmentation model to segment out the vehicle contour area containing the detected target vehicle from the preprocessed image data. This step is to increase the accuracy of detecting whether the lights are on. By this step, instead of directly detecting the unlit vehicle target through a deep neural network on the original image according to the method of the present disclosure, the image is first semantically segmented by a pre-trained semantic segmentation deep neural network, and the image area part of the closest vehicle is extracted, thereby excluding the interference factors of other light source noises outside the vehicle contour. Step 290 is based on at least one object classification model to identify whether the target vehicle has its lights off from the segmented vehicle contour area.

[0084] In addition to Figure 2 triggering the reminder event in an automatic manner as shown, the present disclosure can also trigger the reminder event manually. Figure 3 The flowchart of the manual method 300 for determining that the reminder event is triggered according to an exemplary embodiment is shown.

[0085] Referring to Figure 3 , method 300 includes step 310 and step 320. In step 310, a user input of the vehicle is received. In some embodiments, the user input includes the user pressing a touch screen button or a physical button. The touch screen or the physical button is designed to be able to distinguish 4 directions, corresponding to the reminders in the front, rear, left, and right 4 directions respectively. The physical button is placed at a position convenient for the driver to use, such as on the steering wheel. It should be understood that the appearance design of the user input component can have diversity as long as it can distinguish at least 4 input areas to correspond to the front, rear, left, and right 4 directions respectively. In step 320, in response to receiving the user input, it is determined that the reminder event is triggered. In some embodiments, the user presses the button corresponding to the reminders in the front, rear, left, and right 4 directions. In response to the user's pressing, the reminder event in the corresponding direction is triggered.

[0086] Figure 4A schematic diagram further shows the positions of a plurality of visual display devices. In some embodiments, the plurality of visual display devices include a front visual display device 401, a rear visual display device 402, a left visual display device 403, and a right visual display device 404 that are respectively located around the vehicle body. In response to a target vehicle being in front of the vehicle, the front visual display device 401 is caused to display a visual reminder. In response to the target vehicle being behind the vehicle, the rear visual display device 402 is caused to display a visual reminder. In response to the target vehicle being on the left side of the vehicle, the left visual display device 403 is caused to display a visual reminder. In response to the target vehicle being on the right side of the vehicle, the right visual display device 404 is caused to display a visual reminder.

[0087] The specific positions of the front visual display device 401, the rear visual display device 402, the left visual display device 403, and the right visual display device 404 can be adjusted as needed, as long as they can be easily seen by the user of the target vehicle. In some embodiments, the front visual display device 401 can be located at the front grille part of the vehicle. The rear visual display device 402 can be located on the rear window. The left visual display device 403 and the right visual display device 404 can be respectively located on the outer sides of the driver's window and the co-driver's window, and on the outer sides of the left and right rearview mirrors. In another embodiment, the left visual display device 403 and the right visual display device 404 can be respectively located in the door areas below the driver's window and the co-driver's window glass.

[0088] It should be understood that each of the plurality of visual display devices can adopt any display device capable of displaying visual images. In some embodiments, the front visual display device 401 is an LED light array device. The rear visual display device 402, the left visual display device 403, and the right visual display device 404 can be transparent LED display films pasted on the inner or outer side of the window glass. When the left visual display device 403 and the right visual display device 404 are respectively located in the door areas below the driver's window and the co-driver's window glass, the left visual display device 403 and the right visual display device 404 can adopt a three-layer compression design. As Figure 5 shown, in the three-layer compression design, the bottom layer 501 is the normal vehicle body paint, the middle layer 502 is a transparent LED display film, and the top layer 503 is a hard transparent covering layer.

[0089] In some embodiments, displaying a visual reminder includes causing the visual display device corresponding to the target vehicle among the plurality of visual display devices to display text and / or patterns reminding that the vehicle lights are not turned on. The text reminding that the vehicle lights are not turned on is, for example, "Vehicle lights not turned on", "Please turn on vehicle lights", etc. The patterns reminding that the vehicle lights are not turned on include any pattern designs with a reminding meaning, for example, a pattern similar to the general vehicle light logo can be adopted. In some embodiments, displaying a visual reminder further includes causing the visual reminder to flash at a certain frequency.

[0090] Return to step 120. In addition to using multiple visual display devices of the vehicle to display visual reminders, an auditory reminder can also be output using the vehicle's sound output device. In some embodiments, the sound output device includes an on-vehicle horn. Outputting the auditory reminder includes sounding the on-vehicle horn. The horn is used to attract the attention of the driver of the target vehicle, and the visual reminder is used to display reminder content (such as words and / or patterns like "lights off", "please turn on the lights", etc.).

[0091] It should be understood that although the various operations are depicted in the drawings as occurring in a particular order, this should not be construed as requiring that the operations must be performed in the particular order shown or in a sequential order, nor should it be construed as requiring that all of the illustrated operations be performed to obtain the desired result.

[0092] Embodiments of the present disclosure also provide a vehicle information processing device. Figure 6 is a schematic block diagram illustrating a vehicle information processing device 600 according to an exemplary embodiment. Refer to Figure 6 , the vehicle information processing device 600 includes: a determination module 610 configured to determine that a reminder event is triggered, the reminder event indicating that a target vehicle adjacent to the vehicle has its lights off; and a reminder module 620 configured to, in response to the reminder event being triggered, cause the sound output device to output an auditory reminder and cause the visual display device corresponding to the target vehicle among the multiple visual display devices to display a visual reminder. The vehicle information processing device 600 according to the exemplary embodiment enables the driver of the target vehicle to timely and accurately know that their lights are off.

[0093] It should be understood that Figure 6 each module of the device 600 shown in Figure 1 can correspond to each step in the method 100 described with reference to

[0094] Accordingly, the operations, features, and advantages described above for the method 100 also apply to the device 600 and its included modules. For the sake of brevity, certain operations, features, and advantages are not repeated herein.

[0095] It should also be understood that the various technologies described herein can be described in the general context of software-hardware components or program modules. As described above regarding Figure 6 The various modules described can be implemented in hardware or in hardware in combination with software and / or firmware. For example, these modules can be implemented as computer program code / instructions configured to be executed in one or more processors and stored in a computer-readable storage medium. Alternatively, these modules can be implemented as hardware logic / circuits. For example, in some embodiments, one or more of the determination module 610 and the reminder module 620 can be implemented together in a system on chip (SoC). The SoC can include an integrated circuit chip (which includes one or more components such as a processor (e.g., a central processing unit (CPU), a microcontroller, a microprocessor, a digital signal processor (DSP), etc.), a memory, one or more communication interfaces, and / or other circuits), and can optionally execute the received program code and / or include embedded firmware to perform functions.

[0096] According to one aspect of the present disclosure, there is provided a computer device including at least one memory, at least one processor, and a computer program stored on the at least one memory. The at least one processor is configured to execute the computer program to implement the steps of any of the method embodiments described above.

[0097] According to one aspect of the present disclosure, there is provided a vehicle including the device or computer device as described above.

[0098] According to one aspect of the present disclosure, there is provided a non-transitory computer-readable storage medium having stored thereon a computer program, which when executed by a processor, implements the steps of any of the method embodiments described above.

[0099] According to one aspect of the present disclosure, there is provided a computer program product including a computer program, which when executed by a processor, implements the steps of any of the method embodiments described above.

[0100] Hereinafter, illustrative examples of such computer devices, non-transitory computer-readable storage media, and computer program products will be described in conjunction with Figure 7 Described are illustrative examples of such computer devices, non-transitory computer-readable storage media, and computer program products.

[0101] Figure 7 An example configuration of a computer device 1700 that can be used to implement the methods described herein is shown. The above automotive information processing device can also be implemented in whole or at least in part by the computer device 1700 or a similar device or system.

[0102] The computer device 1700 may include at least one processor 1702, a memory 1704, one or more communication interfaces 1706, a display device 1708, other input / output (I / O) devices 1710, and one or more mass storage devices 1712 that are capable of communicating with each other, such as via a system bus 1714 or other suitable connections.

[0103] The processor 1702 may be a single processing unit or multiple processing units, and all processing units may include a single or multiple computing units or multiple cores. The processor 1702 may be implemented as one or more microprocessors, microcomputers, microcontrollers, digital signal processors, central processing units, state machines, logic circuits, and / or any device that manipulates signals based on operational instructions. Among other capabilities, the processor 1702 may be configured to obtain and execute computer-readable instructions stored in the memory 1704, the mass storage device 1712, or other computer-readable media, such as program code of an operating system 1716, program code of an application 1718, program code of other programs 1720, etc.

[0104] The memory 1704 and the mass storage device 1712 are examples of computer-readable storage media for storing instructions that are executed by the processor 1702 to implement the various functions described above. For example, the memory 1704 generally may include both volatile and non-volatile memory (e.g., RAM, ROM, etc.). In addition, the mass storage device 1712 generally may include a hard disk drive, a solid-state drive, removable media, including external and removable drives, memory cards, flash memory, floppy disks, optical disks (e.g., CD, DVD), storage arrays, network-attached storage, storage area networks, etc. The memory 1704 and the mass storage device 1712 may both be collectively referred to herein as memory or computer-readable storage media and may be non-transitory media capable of storing computer-readable, processor-executable program instructions as computer program code that may be executed by the processor 1702 as a particular machine configured to implement the operations and functions described in the examples herein.

[0105] Multiple programs can be stored on the mass storage device 1712. These programs include an operating system 1716, one or more application programs 1718, other programs 1720, and program data 1722, and they can be loaded into the memory 1704 for execution. Examples of such application programs or program modules can include, for example, computer program logic (e.g., computer program code or instructions) for implementing the following components / functions: method 100, method 200, and / or method 300 (including any suitable steps of methods 100, 200, 300), and / or additional embodiments described herein.

[0106] Although illustrated as being stored in the memory 1704 of the computer device 1700 in Figure 7 , the modules 1716, 1718, 1720, and 1722 or portions thereof can be implemented using any form of computer-readable medium accessible by the computer device 1700. As used herein, "computer-readable medium" includes at least two types of computer-readable media, namely computer-readable storage media and communication media.

[0107] Computer-readable storage media includes volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules, or other data. Computer-readable storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disks (DVD), or other optical storage devices, magnetic cassettes, magnetic tape, magnetic disk storage devices or other magnetic storage devices, or any other non-transitory medium that can be used to store information accessible by a computer device. In contrast, communication media can embody computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism. Computer-readable storage media as defined herein does not include communication media.

[0108] One or more communication interfaces 1706 are used to exchange data with other devices, such as via a network, direct connection, etc. Such communication interfaces can be one or more of the following: any type of network interface (e.g., network interface card (NIC)), wired or wireless (such as IEEE 802.11 wireless LAN (WLAN)) wireless interface, Worldwide Interoperability for Microwave Access (Wi-MAX) interface, Ethernet interface, Universal Serial Bus (USB) interface, cellular network interface, Bluetooth TMCommunication interfaces such as interfaces, Near Field Communication (NFC) interfaces, etc. The communication interface 1706 can facilitate communication within a variety of network and protocol types, including wired networks (such as LAN, cables, etc.) and wireless networks (such as WLAN, cellular, satellite, etc.), the Internet, etc. The communication interface 1706 can also provide communication with external storage devices (not shown) such as those in storage arrays, network-attached storage, storage area networks, etc.

[0109] In some examples, a display device 1708 such as a monitor can be included for displaying information and images to a user. Other I / O devices 1710 can be devices that receive various inputs from a user and provide various outputs to the user, and can include touch input devices, gesture input devices, cameras, keyboards, remote controls, mice, printers, audio input / output devices, etc.

[0110] The techniques described herein can be supported by these various configurations of the computer device 1700 and are not limited to the specific examples of the techniques described herein. For example, the functionality can also be implemented in whole or in part on a "cloud" using a distributed system. The cloud includes and / or represents a platform for resources. The platform abstracts the underlying functionality of the hardware (e.g., servers) and software resources of the cloud. Resources can include applications and / or data that can be used when performing computational processing on servers remote from the computer device 1700. Resources can also include services provided over the Internet and / or over a subscriber network such as a cellular or Wi-Fi network. The platform can abstract the resources and functionality to connect the computer device 1700 with other computer devices. Thus, the implementation of the functionality described herein can be distributed throughout the cloud. For example, the functionality can be implemented partially on the computer device 1700 and partially through a platform that abstracts the functionality of the cloud.

[0111] Although the present disclosure has been illustrated and described in detail in the accompanying drawings and the foregoing description, such illustration and description shall be regarded as illustrative and schematic rather than restrictive; the present disclosure is not limited to the disclosed embodiments. By studying the drawings, the disclosure, and the appended claims, those skilled in the art can understand and implement variations of the disclosed embodiments when practicing the claimed subject matter. In the claims, the word "comprising" does not exclude other elements or steps not listed, the indefinite article "a" or "an" does not exclude a plurality, the term "plurality" means two or more, and the term "based on" should be interpreted as "at least partially based on". The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Claims

1. A vehicle information processing method, wherein the vehicle includes a sound output device and a plurality of visual display devices distributed around the vehicle body, and the method includes: determining that a reminder event is triggered, where the reminder event indicates that a target vehicle adjacent to the vehicle has its lights off; and in response to the reminder event being triggered, causing the sound output device to output an auditory reminder and causing the visual display device corresponding to the target vehicle among the plurality of visual display devices to display a visual reminder.

2. The method according to claim 1, wherein the determining that the reminder event is triggered includes: obtaining ambient light intensity data detected by at least one light sensor; in response to the ambient light intensity data indicating that the ambient brightness is lower than a predetermined threshold, obtaining image data from at least one on-vehicle camera; performing preprocessing on the image data; processing the preprocessed image data to determine whether the target vehicle has its lights off; and in response to determining that the target vehicle has its lights off, determining that the reminder event is triggered.

3. The method according to claim 2, wherein the preprocessing includes: extracting image frames from the image data; cropping out the image center region from the extracted image frames; and performing brightness enhancement on the image center region.

4. The method according to claim 2, wherein the processing the preprocessed image data to determine whether the target vehicle has its lights off includes: using at least one neural network model to determine whether the target vehicle has its lights off from the preprocessed image data.

5. The method according to claim 4, wherein the at least one neural network model includes: at least one target detection model for detecting the target vehicle from the preprocessed image data; at least one target segmentation model for segmenting out a vehicle contour region containing the detected target vehicle from the preprocessed image data; and at least one target classification model for identifying whether the target vehicle has its lights off from the segmented vehicle contour region.

6. The method according to claim 5, wherein the at least one target detection model is trained to, when detecting multiple vehicle targets from the preprocessed image data, select the vehicle target closest to the vehicle as the target vehicle from the multiple vehicle targets.

7. The method according to claim 1, wherein the determining that the reminder event is triggered includes: receiving a user input of the vehicle; and in response to receiving the user input, determining that the reminder event is triggered.

8. The method according to any one of claims 1-7, wherein the plurality of visual display devices include a front visual display device, a rear visual display device, a left visual display device, and a right visual display device respectively located around the vehicle body, and the displaying the visual reminder includes: in response to the target vehicle being in front of the vehicle, causing the front visual display device to display a visual reminder; in response to the target vehicle being behind the vehicle, causing the rear visual display device to display a visual reminder; In response to the target vehicle being located to the left of the vehicle, causing the left visual display device to display a visual reminder; and In response to the target vehicle being located to the right of the vehicle, causing the right visual display device to display a visual reminder.

9. The method according to any one of claims 1-7, wherein, the displaying of the visual reminder includes causing the visual display device corresponding to the target vehicle among the plurality of visual display devices to display text and / or a pattern reminding of the vehicle's lights being off.

10. The method according to any one of claims 1-7, wherein, the displaying of the visual reminder includes causing the visual reminder to flash at a certain frequency.

11. The method according to any one of claims 1-7, wherein, the sound output device includes an on-vehicle horn, and the outputting of the auditory reminder includes causing the on-vehicle horn to sound.

12. A vehicle information processing device, the vehicle including a sound output device and a plurality of visual display devices distributed around the vehicle body of the vehicle, the device comprising: a determination module configured to determine that a reminder event is triggered, the reminder event indicating that a target vehicle adjacent to the vehicle has its lights off; and a reminder module configured to, in response to the reminder event being triggered, cause the sound output device to output an auditory reminder and cause the visual display device corresponding to the target vehicle among the plurality of visual display devices to display a visual reminder.

13. A computer device, comprising: at least one processor; and at least one memory having a computer program stored thereon, wherein, when the computer program is executed by the at least one processor, the at least one processor executes the method according to any one of claims 1-11.

14. A vehicle, comprising: a sound output device; a plurality of visual display devices distributed around the vehicle body; and the device according to claim 12 or the computer device according to claim 13.

15. The vehicle according to claim 14, wherein, at least one of the plurality of visual display devices includes: a thin film display screen covering the vehicle body; and a transparent cover layer covering the thin film display screen.

16. The vehicle according to claim 14, wherein, the plurality of visual display devices include: a front visual display device provided on the front side surface of the vehicle; a rear visual display device provided on the rear side surface of the vehicle; a left visual display device provided on the left side surface of the vehicle; and a right visual display device provided on the right side surface of the vehicle.

17. A computer-readable storage medium having a computer program stored thereon, which when executed by a processor causes the processor to execute the method according to any one of claims 1-11.

18. A computer program product including a computer program, which when executed by a processor causes the processor to execute the method according to any one of claims 1-11.

Citation Information

Patent Citations

  • Automotive safe driving reminding system and method thereof

    CN103359122A

  • System and method for adjustable lighting based on occupant and object identification in a vehicle

    US10940790B1