Method and apparatus for displaying in-vehicle cockpit driving status, recording medium, and electronic device.

Abstract

This disclosure relates to the technology of intelligent cockpits and discloses methods, apparatus, and systems for displaying in-vehicle cockpit driving conditions. [Solution] The method first acquires characteristic information of the current vehicle's interior environment, determines characteristic information of passengers in the vehicle that includes at least one of gender and age based on the characteristic information of the interior environment, further determines that the passenger belongs to the target group based on the passenger's characteristic information, generates first presentation information to indicate that the target group is present in the vehicle, and displays the first presentation information in the vehicle. This solution does not require manual intervention by the user and is easier to implement. Furthermore, if the characteristic information of the vehicle's interior environment changes, the vehicle can generate the first presentation information based on the changed characteristic information, thus having the advantage of being highly time-sensitive.

Description

Technical Field

[0005] , ,

[0001] The present disclosure relates to the technical field of intelligent cockpits, and in particular, to a method, apparatus, system, recording medium, program, and electronic device for presenting the driving state of an in-vehicle cockpit.

Background Art

[0002] During the process of a vehicle running, the cockpit of the vehicle is a space that is enclosed and operates at high speed. Therefore, the driving state of the vehicle cockpit is a black box for surrounding vehicles. However, the driving state of the cockpit always plays an important role in driving safety. For example, when there is an infant in the vehicle or the driver is a novice driver, after the drivers of surrounding vehicles grasp this driving state of the cockpit, they generally give way to the vehicle in order to improve the driving safety of the vehicle.

[0003] In order to enable surrounding vehicles to grasp the driving state of the cockpit, currently, it is common for vehicle users to purchase vehicle stickers and manually paste them on the vehicle. The vehicle stickers contain characters for indicating the driving state of the cockpit (such as "Baby in Car", "There is a baby in the car, please be kind", or "I am a novice driver, please be kind", etc.).

[0004] However, the implementation form of this solution is relatively complicated. Also, when the driving state of the cockpit changes, the vehicle sticker cannot reflect the change in a timely manner, that is, the timeliness of this solution is relatively low.

Summary of the Invention

Problems to be Solved by the Invention

[0005] To solve the above problems, this disclosure provides a method, apparatus, and system for presenting the in-vehicle cockpit driving state, enabling the simple and convenient presentation of the in-vehicle cockpit driving state, and improving the timeliness of the presentation of the in-vehicle cockpit driving state. [Means for solving the problem]

[0006] A method for presenting an in-vehicle cockpit driving state according to a first aspect of the present disclosure includes the steps of: acquiring characteristic information of the current in-vehicle environment; determining characteristic information of a passenger in the vehicle based on the characteristic information of the in-vehicle environment; determining that the passenger belongs to a target object based on the characteristic information of the passenger, generating first presentation information to indicate that the target object is present in the vehicle, and causing the vehicle to display the first presentation information.

[0007] A second aspect of the present disclosure of an in-vehicle cockpit driving state presentation device includes: a first information acquisition module for acquiring characteristic information of the in-vehicle environment of a vehicle; a first information determination module for determining characteristic information of passengers in the vehicle based on the characteristic information of the in-vehicle environment acquired by the first information acquisition module; and a first information generation module for determining that the passengers belong to a target object based on the characteristic information of the passengers determined by the first information determination module, generating first presentation information to indicate that the target object is present in the vehicle, and causing the vehicle to display the first presentation information.

[0008] A computer-readable storage medium according to a third aspect of this disclosure stores a computer program for performing the in-vehicle cockpit driving state presentation method described in the first aspect.

[0009] An electronic device according to a fourth aspect of the present disclosure includes a second processor and a memory for storing instructions that the second processor can execute, wherein the second processor reads and executes the executable instructions from the memory to realize the in-vehicle cockpit driving state presentation method described in the first aspect.

[0010] When an instruction in a computer program product relating to the fifth aspect of this disclosure is executed by a processor, the in-vehicle cockpit driving state presentation method described in the first aspect of this disclosure is performed. [Effects of the Invention]

[0011] In this in-vehicle cockpit driving state presentation method, first, characteristic information of the current vehicle's in-vehicle environment is acquired, characteristic information of the passengers in the vehicle is determined based on the characteristic information of the in-vehicle environment, and further, based on the characteristic information of the passengers, it is determined that the passengers belong to a target object, and first presentation information is generated to indicate that the target object is present in the vehicle, and the first presentation information is displayed in the vehicle. In this disclosed method, by collecting characteristic information of the in-vehicle environment in real time and automatically generating and displaying the first presentation information, other vehicles around the current vehicle can easily become aware of the cockpit driving state in which a target object is present in the vehicle, which helps to avoid traffic accidents between other vehicles and the current vehicle, thereby improving driving safety. [Brief explanation of the drawing]

[0012] [Figure 1] This is a schematic diagram of the vehicle architecture to which this disclosure applies. [Figure 2] This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to one exemplary embodiment of the present disclosure. [Figure 3] This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to another exemplary embodiment of the present disclosure. [Figure 4]This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to another exemplary embodiment of the present disclosure. [Figure 5] This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to another exemplary embodiment of the present disclosure. [Figure 6] This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to another exemplary embodiment of the present disclosure. [Figure 7] This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to another exemplary embodiment of the present disclosure. [Figure 8] This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to another exemplary embodiment of the present disclosure. [Figure 9] This is a schematic flowchart of a method for presenting the in-vehicle cockpit driving state according to another exemplary embodiment of the present disclosure. [Figure 10] This is a schematic diagram of the structure of an in-vehicle cockpit driving state display device according to one exemplary embodiment of the present disclosure. [Figure 11] This is a schematic diagram of the structure of an in-vehicle cockpit driving state display device according to another exemplary embodiment of the present disclosure. [Figure 12] This is a schematic diagram of the structure of an in-vehicle cockpit driving state display device according to another exemplary embodiment of the present disclosure. [Figure 13] This is a structural diagram of an electronic device according to one exemplary embodiment of the present disclosure. [Modes for carrying out the invention]

[0013] To illustrate this disclosure, exemplary embodiments of this disclosure will be described in detail below with reference to the drawings. Clearly, the embodiments described are only a selection of embodiments of this disclosure, not all embodiments, and this disclosure is not limited to exemplary embodiments.

[0014] Unless otherwise specified, the relative arrangements, mathematical formulas, and numerical values of the components and steps described in these embodiments do not limit the scope of the present disclosure.

[0015] Summary of the Application During the process of a vehicle traveling, since the cockpit of the vehicle is an enclosed space, neither the passengers nor the drivers of the surrounding vehicles can know the driving state of the vehicle cockpit. The driving state of the vehicle cockpit is a black box for the passengers and drivers of the surrounding vehicles.

[0016] Here, in the present disclosure, the driving state of the vehicle cockpit may include various information. For example, the driving state of the vehicle cockpit can indicate whether there are infants or pregnant women among the passengers in the vehicle, or whether the driver of the vehicle is a novice driver lacking experience or a veteran driver with relatively rich experience.

[0017] The driving state of the vehicle cockpit always plays an important role in driving safety. For example, when there is an infant in the vehicle, after grasping this driving state of the vehicle cockpit, generally, in order to make the riding comfort of the infant comfortable, the driver of the surrounding vehicle will yield the vehicle to improve the stability of vehicle driving. Or, when the driver of the vehicle is a novice driver, after grasping this driving state of the vehicle cockpit, generally, in order to avoid a collision or contact accident with the vehicle, the driver of the surrounding vehicle will yield the vehicle to improve the driving safety of the vehicle.

[0018] At present, in order for surrounding vehicles to be able to grasp the cockpit - driving state, it is common for the user of the vehicle to purchase a vehicle sticker for indicating the cockpit - driving state and manually paste the vehicle sticker outside the vehicle. The vehicle sticker contains characters for indicating the cockpit - driving state. For example, when there is a baby in the vehicle, the vehicle sticker to be pasted generally contains characters such as "There is a baby on board" or "There is a baby in the vehicle, please be kind", and when the driver of the vehicle is a novice driver, the vehicle sticker may contain characters such as "I am a novice driver, please be kind".

[0019] However, in this solution, since it is necessary for the user of the vehicle to purchase and paste the vehicle sticker, the realization process is complicated.

[0020] Also, when the cockpit - driving state of the vehicle changes, the vehicle sticker cannot reflect the change in a timely manner, and the timeliness is relatively low.

[0021] For example, when the temporarily increased passengers in the vehicle are pregnant women or babies, the notice such as "There is a baby on board" on the vehicle sticker cannot be added in a timely manner, and the cockpit - driving state inside the vehicle cannot be notified to surrounding vehicles in real - time, thus reducing the timeliness of the cockpit - driving state.

[0022] In order to solve the problems existing in the conventional technology of presenting the cockpit - driving state by vehicle stickers, that is, the realization process is complicated and the timeliness is low, the present disclosure provides a method, an apparatus and a corresponding system for presenting the cockpit - driving state inside the vehicle. In the solution of the present disclosure, through the characteristic information of the current vehicle's interior environment, the first presentation information is automatically generated and displayed, so that it is easy for other vehicles around the current vehicle to know the cockpit - driving state that there is a target object inside the vehicle, which helps to avoid the occurrence of traffic accidents between other vehicles and the current vehicle, thereby improving driving safety.

[0023] Exemplary System Embodiments of this disclosure provide a method, apparatus, and corresponding system for presenting the in-vehicle cockpit driving state, thereby realizing the presentation of the in-vehicle cockpit driving state.

[0024] In one viable implementation, the method according to the embodiment of this disclosure can be applied to a vehicle. Referring to the schematic diagram of the vehicle architecture shown in Figure 1, the vehicle may include a sensor 10, a first processor 20, and a presentation device 30.

[0025] Among these, sensor 10 may include a first sensor 11, which is used to collect characteristic information of the vehicle's interior environment.

[0026] Typically, the first sensor 11 includes an image acquisition device and / or an audio acquisition device installed in the cockpit. The image acquisition device may include a cockpit camera, which is used to photograph the interior of the vehicle to collect images of the in-vehicle environment. Exemplarily, an intelligent cockpit is generally equipped with a Driver Monitoring System (DMS), which includes a camera that may be the first sensor 11 in this disclosure. Furthermore, an intelligent cockpit may be equipped with an Occupancy Monitoring System (OMS), which also includes a camera that may be the first sensor 11 in this disclosure.

[0027] Furthermore, the voice collection device may include a microphone array or the like, and is used to collect voice information of the in-vehicle environment. Accordingly, the characteristic information of the in-vehicle environment may include images of the in-vehicle environment and / or voice information of the in-vehicle environment.

[0028] The first processor 20 can acquire characteristic information of the current in-vehicle environment collected by the sensor 10. After acquiring the characteristic information of the in-vehicle environment, the first processor 20 determines the characteristic information of the passengers in the vehicle based on the characteristic information of the current in-vehicle environment, and further determines whether the passengers belong to the target object based on the passenger characteristic information, and generates first presentation information to indicate that the target object is present in the vehicle.

[0029] The presentation device 30 can acquire and display the first presentation information generated by the first processor 20 in order to perform its presentation function.

[0030] In one feasible implementation, the presentation device 30 may include a light-emitting device 31 installed outside the vehicle, and generally includes multiple such light-emitting devices 31. In such cases, the first presentation information can be used to indicate the switch state of each light-emitting device. After receiving the first presentation information, each light-emitting device 31 enters an on or off state according to the target switch state indicated by the first presentation information, thereby causing the presentation device 30 to display a target lighting effect to indicate the presence of a target object inside the vehicle, and thus fulfilling the function of indicating the in-vehicle cockpit driving state.

[0031] Alternatively, in another feasible implementation, the presentation device 30 may include a screen 32 installed outside the vehicle. In such a case, the first presentation information can be used to display a presentation screen on the screen. After receiving the first presentation information, the screen outside the vehicle can display a corresponding presentation screen, which is used to indicate that a target object is present inside the vehicle and serves to indicate the in-vehicle cockpit driving state.

[0032] Naturally, the display device 30 may include both the light-emitting device 31 and the screen 32 installed outside the vehicle, and this disclosure is not limited thereto.

[0033] The embodiment of this disclosure allows for the presentation of a cockpit driving state in which a target object is present inside the vehicle through first presented information.

[0034] Furthermore, the first processor 20 can exchange information with the vehicle's bus, which may include a CAN bus or the like. Alternatively, the first processor 20 can exchange information with the vehicle's brake device and running device (e.g., tires). Through information exchange with the bus, or with the brake device and running device, the first processor 20 can acquire information about the driver's driving behavior.

[0035] The first processor 20 can determine the driver's driving state in the first driving scene based on the driving behavior information, and if the driver's driving state is a target driving state, it generates second presentation information to indicate that the driver is in the target driving state and causes the vehicle to display the second presentation information. Here, the second presentation information may be displayed by a presentation device 30.

[0036] Here, the first processor 20 can determine whether the driver's driving state is a target driving state through various means. In one feasible implementation, the first processor 20 can determine whether the driver's driving state is a target driving state based solely on the driving behavior information.

[0037] In another feasible implementation, sensor 10 may further include a second sensor 12 used to collect characteristic information of the vehicle's external environment. The second sensor 12 may include at least one of an image acquisition device installed outside the cockpit (e.g., an external camera for capturing images of the vehicle's external environment), a radar (e.g., LiDAR), and an ultrasonic sensor. The second sensor 12 can also transmit the characteristic information of the external environment to the first processor 20 after collecting it.

[0038] Furthermore, the first processor 20 can operate an autonomous driving engine, and in the process of the vehicle driving, after the first processor 20 acquires characteristic information of the external environment transmitted from the second sensor 12, the autonomous driving engine can determine a corresponding driving command based on the characteristic information of the external environment, and in the first driving scene, the first processor 20 can determine whether the driver's driving state is in a target driving state based on the driving action information and driving command.

[0039] According to this plan, the cockpit driving state, indicating that the driver is in the target driving state, can be presented through the second set of presented information.

[0040] Exemplary Method Figure 2 is a schematic flowchart of an in-vehicle cockpit driving state presentation method according to one exemplary embodiment of the present disclosure. This embodiment can be applied to electronic devices which may include an in-vehicle chip, etc. As shown in Figure 2, the method includes the following steps S201 to S203.

[0041] In step S201, characteristic information about the current vehicle's interior environment is acquired.

[0042] In one executable implementation of the present disclosure, an electronic device performing an embodiment of the present disclosure can exchange information with a first sensor and acquire feature information collected by the first sensor.

[0043] Here, the first sensor may include an image acquisition device and / or an audio acquisition device. The image acquisition device may include a cockpit camera or the like for acquiring images of the in-vehicle environment. After acquiring images of the in-vehicle environment, the image acquisition device can transmit the images to electronic devices so that the electronic devices can acquire the images. Accordingly, the characteristic information of the in-vehicle environment of the vehicle now includes images of the in-vehicle environment.

[0044] Naturally, the image acquisition device may further include other devices capable of acquiring images of the in-vehicle environment, and this disclosure is not limited thereto.

[0045] Furthermore, the voice collection device may include a microphone array or the like for collecting voice information of the in-vehicle environment. After collecting voice information of the in-vehicle environment, the voice collection device can transmit the voice information to electronic devices so that the electronic devices can acquire the voice information. Accordingly, the characteristic information of the in-vehicle environment of the current vehicle includes the voice information of the in-vehicle environment.

[0046] Naturally, the voice collection device may further include other devices capable of collecting voice information of the in-vehicle environment, and this disclosure is not limited thereto.

[0047] Furthermore, the first sensor may simultaneously include an image acquisition device and an audio acquisition device, in which case the characteristic information of the current in-vehicle environment can include both image and audio information of the in-vehicle environment.

[0048] In step S202, the characteristic information of the passengers inside the vehicle is determined based on the characteristic information of the in-vehicle environment.

[0049] Here, the characteristic information may include at least one of the following: gender, age, and body shape information.

[0050] In step S203, based on the passenger's characteristic information, it is determined that the passenger belongs to the target object, first presentation information is generated to indicate that the target object is present inside the vehicle, and the first presentation information is displayed in the vehicle.

[0051] Here, the target population may include pregnant women and / or infants. Naturally, the target population may also include other types of subjects, and this disclosure is not limited thereto.

[0052] Embodiments of this disclosure provide a method for presenting the in-vehicle cockpit driving state, in which, first, characteristic information of the current in-vehicle environment is acquired, characteristic information of passengers in the vehicle is determined based on the characteristic information of the in-vehicle environment, further, based on the characteristic information of the passengers, it is determined that the passengers belong to a target object, first presentation information is generated to indicate that the target object is present in the vehicle, and the first presentation information is displayed in the vehicle.

[0053] The embodiment of the present disclosure can present a cockpit driving state in which a target object is present inside the vehicle through first presentation information. Furthermore, since the embodiment does not require manual intervention by the user, it has the advantage of being simple and convenient to implement. Moreover, since the first presentation information is generated based on the characteristic information of the current in-vehicle environment, if the characteristic information of the in-vehicle environment changes, the embodiment can generate the first presentation information based on the changed characteristic information. For this reason, the first presentation information can reflect the change in the in-vehicle cockpit driving state, and accordingly, the embodiment of the present disclosure has the further advantage of being relatively time-sensitive.

[0054] In the proposed solution disclosed herein, by collecting characteristic information of the in-vehicle environment in real time, the first presentation information is automatically generated and displayed, making it easier for other vehicles around the vehicle to know that a target object is present inside the vehicle, thus helping to avoid traffic accidents between other vehicles and the current vehicle, and thereby improving driving safety.

[0055] The driver of the vehicle may be a novice driver or a veteran driver with relatively extensive driving experience, and the driving conditions of different drivers will differ. In this situation, another embodiment of the present disclosure further includes the following steps S204 to S205 on the embodiment shown in Figure 2, with reference to the schematic flowchart shown in Figure 3.

[0056] In step S204, information on the driver's driving behavior in the first driving scene is acquired.

[0057] The driving scenarios include both autonomous driving and manual driving scenarios. In autonomous driving scenarios, electronic devices (e.g., on-board chips) can operate an autonomous driving engine, which can generate corresponding driving commands based on characteristic information of the vehicle's external environment, thereby instructing the vehicle to perform corresponding operations through these driving commands. In manual driving scenarios, the vehicle performs corresponding operations based on received driver action information.

[0058] In embodiments of this disclosure, the first driving scene may be a manual driving scene. Driving action information is used to indicate actions taken by the driver to operate the vehicle, such as accelerating, decelerating, or turning the vehicle.

[0059] Information from each device within the vehicle (e.g., engine, brake system, steering system, and chassis) can be transmitted to the vehicle's first processor via the vehicle's bus (e.g., CAN bus (Controller Area Network)) so that the first processor can control the vehicle based on the information received. Therefore, the vehicle's bus can transmit status information from each device within the vehicle to the vehicle's first processor, such as engine speed, brake pressure, steering wheel rotation angle, and accelerator pressure.

[0060] In one executable implementation of an embodiment of the present disclosure, the electronic device can acquire status information of each device in the vehicle transmitted by the bus through exchange of information with the bus, and further determine the driver's driving behavior information based on said status information.

[0061] In another feasible implementation, electronic devices can be connected to each device in the vehicle, thereby acquiring status information for each device, and further determining driver behavior information based on the acquired status information for each device.

[0062] Naturally, in embodiments of this disclosure, information on the driver's driving behavior in the first driving scene may be obtained by other means, and this disclosure is not limited thereto.

[0063] In step S205, based on the driving behavior information, it is determined that the driver's driving state is the target driving state, second presentation information is generated to indicate that the driver is in the target driving state, and the second presentation information is displayed on the vehicle.

[0064] In one feasible implementation of this disclosure, the target driving state is a novice driving state, and the second presentation information is information for indicating that the driver is in a novice driving state. In other words, in this implementation, when it is determined that the driver's driving state is a novice driving state, this is indicated through the second presentation information.

[0065] In this disclosure, based on the driver's driving behavior information in the first driving scene, it is determined whether the driver's driving state is in a target driving state. When the driver's driving state changes, the driver's driving behavior information also changes. Based on the changed driving behavior information, the change in the driver's driving state is determined in a timely manner, and if it changes, the second presentation information can be regenerated. Therefore, the embodiment of this disclosure has good timeliness. Furthermore, this embodiment does not require manual intervention by the user and is simple and convenient to implement.

[0066] As shown in Figure 4, step S205 may include the following steps S2051 and S2052.

[0067] In step S2051, based on the driving behavior information, the number of times the driver will perform a reverse operation within a first predetermined time, and the interval time between the execution of reverse operations are determined.

[0068] Driving behavior information may reflect operations performed by the driver, and such operations may include, but are not limited to, acceleration, deceleration, braking, straight driving, left turning, and right turning.

[0069] For example, the reverse operation of acceleration may include deceleration and braking operations, the reverse operation of deceleration may include acceleration operations, the reverse operation of braking may include acceleration operations, the reverse operation of straight driving may include left turning operations and right turning operations, the reverse operation of left turning operations may include straight driving and right turning operations, and the reverse operation of right turning operations may include straight driving and left turning operations.

[0070] In this step, the time at which driving activity information is acquired may be the time at which the driver performs the operations indicated by the driving activity information. In one executable implementation of an embodiment of the present disclosure, each operation to be performed by the driver can be determined based on the driving activity information, and if it is determined to perform a reverse operation, the interval between the execution of the reverse operations can be determined based on the time at which the driving activity information corresponding to the reverse operation is acquired.

[0071] In step S2052, in response to the fact that the number of operations is greater than or equal to a first preset threshold and the interval time between each reverse operation is less than or equal to a second preset threshold, it is determined that the driver's driving state is the target driving state.

[0072] In this step, the target driving state is that of a novice driver.

[0073] In embodiments of this disclosure, the first preset time is generally a relatively short time, such as one minute. If the number of times the driver performs reverse operations within the first preset time is greater than or equal to the first preset threshold, and the interval time between the driver's reverse operations is less than or equal to the second preset threshold, it is indicated that the driver consistently performs reverse driving operations within the first preset time, that the driver is unfamiliar with operating the vehicle, is constantly flustered, and is likely to be a novice driver. Accordingly, it can be determined that the driver is in a novice driving state.

[0074] The embodiment of the present disclosure can determine, based on driving behavior information, the number of times and interval time the driver performs reverse operations within a first preset time, and determine whether the driver's driving state is a target driving state based on a comparison of the number of times with a first preset threshold, and a comparison of the interval time between the driver's reverse operations with a second preset threshold.

[0075] In another embodiment, as shown in Figure 5, step S205 may include steps S2053 to S2055.

[0076] In step S2053, the driving command generated for the first driving scene is obtained.

[0077] In embodiments of this disclosure, the vehicle can support both autonomous driving and manual driving scenarios. In autonomous driving scenarios, the electronic equipment can operate an autonomous driving engine, which can generate corresponding driving commands based on characteristic information of the vehicle's external environment, thereby instructing the vehicle to perform corresponding operations through these driving commands. In manual driving scenarios, the vehicle performs corresponding operations based on received driver action information.

[0078] In this step, the first driving scene may be a manual driving scene, and in the first driving scene, the electronic device (e.g., an in-vehicle chip) can still operate the autonomous driving engine, thereby obtaining the driving commands generated by the autonomous driving engine.

[0079] In step S2054, the driving information determines a first operation that instructs the vehicle to perform, and the driving command determines a second operation that instructs the vehicle to perform.

[0080] In step S2055, the system determines that the driver's driving state is the target driving state, in response to the fact that the first operation and the second operation are inverse operations and the time interval between the time of acquisition of the driving command and the time of acquisition of the driving action information is within a second preset time.

[0081] In this step, the target driving state is that of a novice driver.

[0082] Here, the second preset time is generally a relatively short period, for example, one minute. The fact that the time interval between the time of obtaining the driving command and the time of obtaining the driving action information falls within the second preset time indicates that the time of obtaining the driving command and the time of obtaining the driving action information are relatively close, and that the first operation and the second operation are reverse operations indicates that within a short time, the driver performed a driving operation opposite to the driving command, that the driver is unfamiliar with operating the vehicle, and that there is a high probability that the driver is a novice driver, and accordingly, it can be determined that the driver is in a novice driving state.

[0083] The embodiment of the present disclosure can determine a first operation instructed by driving behavior information and a second operation instructed by a driving command generated for a first driving scene, and if the first and second operations are inverse operations, and the time interval between the time of acquisition of the driving command and the time of acquisition of the driving behavior information is within a second preset time, it is determined that the driver's driving state is a target driving state, thereby enabling a determination of whether or not the driver is in a target driving state based on the driving command and driving behavior information generated for the first driving scene.

[0084] In another embodiment, the passenger characteristic information includes at least one of gender, age, and body shape information, and in the embodiment shown in Figure 2, step S203 may include the following steps.

[0085] If, based on the gender information in the passenger's characteristics, it is determined that the passenger is female, and based on the body shape information in the passenger's characteristics, it is determined that the passenger is pregnant, then a first sub-presentation information is generated to indicate that there is a pregnant woman in the vehicle.

[0086] In embodiments of the present disclosure, passenger characteristic information includes the passenger's gender and body shape information. In embodiments of the present disclosure, after determining that the passenger is female, it is possible to further determine whether the passenger's body shape information matches that of a pregnant woman, and if it does, it is determined that the passenger is pregnant.

[0087] For example, some pregnant women have a swollen abdomen or a swollen face, and these can be considered body shape information that matches a pregnant woman. If a passenger is female and has a swollen abdomen or a swollen face, it can be determined that the passenger is pregnant.

[0088] Naturally, in embodiments of this disclosure, it is also possible to determine whether a female passenger is pregnant or not based on other body shape information, and this disclosure is not limited thereto.

[0089] Step S203 may also include the following steps:

[0090] If it is determined that the passenger is an infant based on the passenger's age in their characteristics information, a second sub-presentation is generated to indicate that there is an infant on board the vehicle.

[0091] The embodiment of this disclosure can determine whether a passenger is pregnant based on gender and body shape information in the passenger's characteristic information, and if it is determined that the passenger is pregnant, it generates first sub-presentation information. It can also determine whether a passenger is an infant based on age in the passenger's characteristic information, and if it is determined that the passenger is an infant, it generates second sub-presentation information. Therefore, the embodiment of this disclosure can provide information through the corresponding first presentation information when there is a pregnant woman or an infant among the passengers in the vehicle.

[0092] As shown in Figure 6, the characteristic information of the in-vehicle environment includes images of the in-vehicle environment, and in the embodiment shown in Figure 2, step S202 may include the following steps S2021 to S2023.

[0093] In step S2021, a region containing at least one facial feature in the image is determined based on the image of the in-vehicle environment.

[0094] In this step, face detection can be performed on an image of the in-vehicle environment using face detection technology. Based on the results of face detection, a region containing at least one facial feature in the image can be determined, and the location of this region can be represented by the coordinates of the region in the image. Here, the facial feature may include at least one of the five facial features, eyebrows, and hair.

[0095] For example, in this step, face detection can be achieved by machine learning methods, and of course, face detection may be achieved by other means, and this disclosure is not limited thereto.

[0096] In step S2022, it is determined that the person corresponding to the region containing at least one facial feature in the image is a passenger.

[0097] A vehicle typically has a driver and passengers. In this step, based on the camera's shooting angle and the area in the image that contains facial features, it is possible to determine whether the person corresponding to that area is a passenger or not. This distinguishes between the driver and passengers corresponding to the areas containing facial features in the image. Here, the person located in the non-driver's seat is the passenger.

[0098] In step S2023, passenger characteristic information is determined based on the image corresponding to the region.

[0099] In this step, facial attribute analysis is performed on the faces of passengers included in the image using facial attribute analysis technology, and characteristic information of the passengers can be determined based on the results of the analysis.

[0100] For example, in this step, facial attribute analysis can be achieved by machine learning methods, and of course, facial attribute analysis may be achieved by other means, and this disclosure is not limited thereto.

[0101] Here, the passenger's characteristic information may include at least one of the following: gender, age, and body type.

[0102] Through this embodiment, characteristic information of passengers inside the vehicle can be determined based on images of the in-vehicle environment.

[0103] In one feasible implementation, the characteristic information of the in-vehicle environment includes audio information of the in-vehicle environment. As shown in Figure 7, in the embodiment shown in Figure 2, step S202 may include the following steps S2024 to S2026.

[0104] In step S2024, the location and characteristics of the sound source of the audio information in the in-vehicle environment are determined.

[0105] Exemplary, embodiments of the present disclosure collect audio information of the in-vehicle environment using a microphone array. The microphone array consists of multiple microphones, each distributed at a different location. When a sound source emits audio information, the time it takes for the audio information to reach each microphone is always different. Therefore, the location of the sound source can be determined based on the difference in the time it takes for the audio information to reach each microphone and the distribution of each microphone.

[0106] Furthermore, the voice features are those that distinguish voice information emitted by passengers of different genders and / or different ages. Exemplarily, the voice features may include at least one of the Mel-frequency cepstrum coefficient, fundamental frequency, and tone frequency. Naturally, the voice features may include other features, and this disclosure is not limited thereto.

[0107] In step S2025, based on the location of the audio source, it is determined that the location of the audio source is that of a passenger.

[0108] In this step, if the location of the sound source of the audio information is not the driver's seat, it can be determined that the location of the sound source is a passenger.

[0109] In step S2026, passenger characteristic information is determined based on the recognition of voice features.

[0110] In this step, a voice detection model can recognize speech features, and based on the recognition results, passenger characteristic information can be determined.

[0111] Here, the voice detection model can be constructed by machine learning methods, and of course, the voice detection model may be constructed in other forms, and this disclosure is not limited thereto.

[0112] This embodiment allows for the determination of passenger characteristics within a vehicle based on audio information from the in-vehicle environment.

[0113] As shown in Figure 8, in the embodiment shown in Figure 2, step S203 may include the following steps S2031 to S2033.

[0114] In step S2031, based on the passenger's characteristic information, it is determined that the passenger belongs to the target group, and a target lighting effect is determined to indicate that the target group is present inside the vehicle.

[0115] In embodiments of this disclosure, if passengers belong to different target objects, the correspondence between different lighting effects can be stored in advance, and after determining that a passenger belongs to a target object, the target lighting effect can be determined based on that correspondence.

[0116] Here, the target lighting effect may be text or a figure to indicate that a target is present inside the vehicle. For example, if the target is a pregnant woman, the target lighting effect may include the text "There is a pregnant woman inside the vehicle, please be considerate" or a simplified figure of a pregnant woman. If the target is an infant, the target lighting effect may include the text "There is a baby on board" or "There is a baby inside the vehicle, please be considerate" or a simplified figure of an infant.

[0117] Naturally, the target writing effect may be any other form of writing effect, and this disclosure is not limited to such effects.

[0118] In step S2032, the target switch state of each light-emitting device corresponding to the display of the target lighting effect is determined based on the correspondence between different pre-stored lighting effects and the switch states of each external light-emitting device.

[0119] The system includes multiple light-emitting devices installed outside the vehicle, which may, for example, include multiple rows of light-emitting diodes installed side by side. By illuminating some of the multiple light-emitting devices and turning off others, the multiple light-emitting devices can exhibit different lighting effects. Here, the switch state of the light-emitting devices is used to indicate whether the light-emitting device is turned on and illuminated, or turned off.

[0120] In embodiments of this disclosure, a correspondence between different lighting effects and the switch states of each external light-emitting device can be stored in advance. For example, the switch states of each corresponding light-emitting device can be stored when it is necessary to display a lighting effect that includes the words "Baby in Car," and the switch states of each corresponding light-emitting device can be stored when it is necessary to display a lighting effect that includes a simplified image of a pregnant woman.

[0121] If a correspondence between different lighting effects and the switch states of each external light-emitting device is stored in advance, the target switch state of each light-emitting device corresponding to the display of the target lighting effect can be determined based on this correspondence and the target lighting effect determined in step S2031.

[0122] In step S2033, first presentation information is generated to instruct the light-emitting device to match the target switch state.

[0123] The first presented information allows the switch state of each external light-emitting device to be controlled to match the target switch state, thereby displaying the target lighting effect on each light-emitting device and achieving the objective of indicating the presence of a target object inside the vehicle through the target lighting effect.

[0124] In another executable implementation of the present disclosure, as shown in Figure 9, step S203 may include the following steps S2034 and S2035 in the embodiment shown in Figure 2.

[0125] In step S2034, based on the passenger's characteristic information, it is determined that the passenger belongs to the target object, and a presentation screen is generated to indicate that the target object is present inside the vehicle.

[0126] For example, if the target is a pregnant woman, the display screen may include a pregnant woman, and the screen may also display the words, "There is a pregnant woman in the car, please be considerate." If the target is an infant, the display screen may include an infant, and the screen may also display the words, "There is a baby in the car, please be considerate."

[0127] Naturally, the display screen may be of other forms, and this disclosure is not limited to such forms.

[0128] In step S2035, first presentation information is generated to display a presentation screen on an external screen of the vehicle.

[0129] The first presentation information allows the presentation screen to be displayed on an external screen, thereby achieving the objective of indicating the presence of a target object inside the vehicle.

[0130] In the above embodiment, a configuration is provided in which, based on the passenger's characteristic information, it is determined that the passenger belongs to the target object and a first presentation information is generated to indicate that the target object is present inside the vehicle. To realize the indication that the driver is in a target driving state, the embodiments of the present disclosure can also generate a second presentation information indicating that the driver is in a target driving state.

[0131] In one executable implementation of this disclosure, the operation of determining, based on driving behavior information, that the driver's driving state is a target driving state, and generating second presentation information to indicate that the driver is in a target driving state, can be implemented by the following steps:

[0132] First, based on driving behavior information, it is determined that the driver's driving state is a target driving state, and an intention writing effect is determined to indicate that the driver is in the target driving state. Here, the intention writing effect may be text indicating that the driver's driving state is a target driving state. For example, if the target driving state is a beginner state, the intention writing effect may include the text, "I'm a beginner driver, please be kind to me." Naturally, the intention writing effect may be other forms of writing effects, and this disclosure is not limited thereto.

[0133] Next, based on the correspondence between pre-stored different lighting effects and the switch states of each external light-emitting device, the corresponding switch state of each light-emitting device corresponding to the display of the desired lighting effect is determined. For example, when it is necessary to display a lighting effect that includes the words "I'm a novice driver, please be kind to me," the corresponding switch state of each light-emitting device can be stored. After determining the corresponding switch state of each light-emitting device corresponding to the display of the desired lighting effect, second prompting information is generated to instruct the light-emitting device to match the corresponding switch state.

[0134] Through the second presentation information generated by this implementation, the switch state of each external light-emitting device can be controlled to match the corresponding switch state, thereby displaying the intention lighting effect on each light-emitting device and indicating that the driver's driving state is the target driving state through the intention lighting effect.

[0135] In another feasible implementation of this disclosure, the operation of determining, based on driving behavior information, that the driver's driving state is a target driving state and generating second presentation information to indicate that the driver is in a target driving state can be implemented by the following steps:

[0136] First, based on driving behavior information, it is determined that the driver's driving state is a target driving state, and a presentation screen is generated to indicate that the driver is in the target driving state. For example, if the target driving state is a beginner state, the presentation screen may include a screen showing the driver operating the vehicle, and furthermore, the words "I'm a beginner driver, please be kind" are displayed around the driver on the screen. Naturally, the presentation screen may take the form of a screen, and this disclosure is not limited thereto.

[0137] Next, a second set of information is generated to display a screen on an external screen indicating that the driver is in the target driving state. This second set of information allows the screen to be displayed on the external screen, and this screen indicates that the driver is in the target driving state.

[0138] Exemplary device The following are embodiments of the apparatus of the Disclosure that can be used to carry out embodiments of the methods of the Disclosure. For details not disclosed in the embodiments of the apparatus of the Disclosure, please refer to the embodiments of the methods of the Disclosure.

[0139] Figure 10 is a structural diagram of an in-vehicle cockpit driving state display device according to one exemplary embodiment of the present disclosure. The device may include a first information acquisition module 201, a first information determination module 202, and a first information generation module 203.

[0140] Of these, the first information acquisition module 201 is currently used to acquire characteristic information about the in-vehicle environment.

[0141] The first information determination module 202 is used to determine the characteristics of passengers inside the vehicle based on the characteristics of the in-vehicle environment acquired by the first information acquisition module 201.

[0142] The first information generation module 203 is used to determine that a passenger belongs to the target object and to generate first presentation information to indicate that the target object is present inside the vehicle, based on the passenger characteristic information determined by the first information determination module 202.

[0143] Furthermore, referring to the schematic structural diagram shown in Figure 11, the in-vehicle cockpit driving state presentation device disclosed in another embodiment of the present disclosure further includes a second information acquisition module 204 and a second information generation module 205.

[0144] Of these, the second information acquisition module 204 is used to acquire information about the driver's driving behavior in the first driving scene.

[0145] The second information generation module 205 is used to determine, based on the driving behavior information acquired by the second information acquisition module 204, that the driver's driving state is a target driving state, generate second presentation information to indicate that the driver is in a target driving state, and display the second presentation information on the vehicle.

[0146] In one feasible implementation, referring to Figure 12, the second information generation module 205 includes a first decision unit 2051 and a second decision unit 2052.

[0147] Of these, the first decision unit 2051 is used to determine, based on driving behavior information, the number of times the driver will perform a reverse operation within a first predetermined time, and the interval time between the execution of reverse operations.

[0148] The second decision unit 2052 is used to determine that the driver's driving state is a target driving state in response to the fact that the number of times the first decision unit 2051 has made a determination is equal to or greater than a first preset threshold, and the interval time determined by the first decision unit 2051 is equal to or less than a second preset threshold.

[0149] In another feasible implementation, the second information generation module 205 includes an acquisition unit 2053, a third decision unit 2054, and a fourth decision unit 2055.

[0150] Of these, the acquisition unit 2053 is used to acquire the driving commands generated for the first driving scene.

[0151] The third decision unit 2054 is used to determine a first operation that driving information instructs the vehicle to perform, and a second operation that the driving command acquired by the acquisition unit 2053 instructs the vehicle to perform.

[0152] The fourth decision unit 2055 is used to determine that the driver's driving state is the target driving state in response to the fact that the first and second operations determined by the third decision unit 2054 are inverse operations, and that the time interval between the time of acquisition of the driving command and the time of acquisition of the driving action information is within a second preset time.

[0153] In another embodiment of the present disclosure, the first information generation module 203 includes a first generation unit 2031 and a second generation unit 2032.

[0154] Of these, the first generation unit 2031 is used to generate first sub-presentation information indicating that there is a pregnant woman in the vehicle, if it determines that the gender corresponding to the passenger is female based on the gender in the passenger's characteristic information, and if it determines that the passenger is pregnant based on the body shape information in the passenger's characteristic information.

[0155] The second generation unit 2032 is used to generate second sub-presentation information to indicate that there is an infant in the vehicle, if it is determined that the passenger is an infant based on the passenger's age in the passenger's characteristic information.

[0156] In another embodiment of the present disclosure, the in-vehicle environment feature information includes images of the in-vehicle environment, and the first information determination module 202 includes a region determination unit 2021, a first passenger determination unit 2022, and a first feature determination unit 2023.

[0157] Of these, the region determination unit 2021 is used to determine a region containing at least one facial feature in an image, based on an image of the in-vehicle environment.

[0158] The first passenger determination unit 2022 is used to determine that the personnel corresponding to the area determined by the area determination unit 2021 are passengers.

[0159] The first feature determination unit 2023 is used to determine the passenger feature information determined by the first passenger determination unit 2022, based on the image corresponding to the region determined by the region determination unit 2021.

[0160] In another embodiment of the present disclosure, the in-vehicle environment feature information includes in-vehicle environment audio information, and the first information determination module 202 includes an audio determination unit 2024, a second passenger determination unit 2025, and a second feature determination unit 2026.

[0161] Of these, the voice determination unit 2024 is used to determine the location and voice characteristics of the sound sources of voice information in the in-vehicle environment.

[0162] The second passenger determination unit 2025 is used to determine that the location of the sound source is that of a passenger, based on the location of the sound source of the audio information determined by the audio determination unit 2024.

[0163] The second feature determination unit 2026 is used to determine passenger feature information based on its recognition of the voice features determined by the voice determination unit 2024.

[0164] In another embodiment of the present disclosure, the first information generation module 203 may include an effect determination unit 2033, a state determination unit 2034, and a third generation unit 2035.

[0165] Of these, the effect determination unit 2033 is used to determine, based on passenger characteristic information, whether a passenger belongs to the target group and to determine the target lighting effect to indicate that the target group is present inside the vehicle.

[0166] The state determination unit 2034 is used to determine the target switch state of each light-emitting device corresponding to the display of the target lighting effect determined by the effect determination unit 2033, based on the correspondence between different lighting effects stored in advance and the switch states of each light-emitting device outside the vehicle.

[0167] The third generation unit 2035 is used to generate the first presentation information in order to instruct the light-emitting device to match the target switch state determined by the state determination unit 2034.

[0168] In another embodiment of the present disclosure, the first information generation module may include a screen generation unit and a fourth generation unit.

[0169] Of these, the screen generation unit is used to determine, based on the passenger's characteristic information, whether the passenger belongs to the target object, and to generate a display screen to indicate that the target object is present inside the vehicle.

[0170] The fourth generation unit is used to generate first presentation information for displaying a presentation screen on an external screen of the vehicle.

[0171] The apparatus according to the embodiment of this disclosure can present a cockpit driving state in which a target object is present inside the vehicle using first presentation information. Furthermore, since this solution does not require manual intervention by the user, it is easier to implement than conventional solutions that involve attaching stickers to the vehicle. In addition, since the first presentation information is generated based on the characteristic information of the current in-vehicle environment, if the characteristic information of the in-vehicle environment changes, the vehicle will generate the first presentation information based on the changed characteristic information. Therefore, the first presentation information can reflect changes in the in-vehicle cockpit driving state, and accordingly, the solution of this disclosure has the advantage of being highly time-sensitive.

[0172] Exemplary electronic device Figure 13 is a structural diagram of an electronic device including at least one second processor 111 and a memory 112 according to an embodiment of the present disclosure.

[0173] The second processor 111 may be a central processing unit (CPU) or another form of processing unit having data processing capability and / or instruction execution capability, and may further control other components in the electronic device 100 to perform a desired function.

[0174] Memory 112 may include one or more computer program products, the computer program products may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache). Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions can be stored in the computer-readable storage media, and the second processor 111 can execute one or more computer program instructions to realize the in-vehicle cockpit driving state presentation method and / or other desired functions of each embodiment of the present disclosure.

[0175] In one example, the electronic device 100 may include an input device 113 and an output device 114, and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0176] The input device 113 may include, for example, a keyboard or a mouse. Exemplarily, the input device 113 may include a sensor, which may include a sensor for collecting characteristic information of the in-vehicle environment, such as an in-vehicle image acquisition device and / or sound acquisition device. Furthermore, the sensor may include a sensor for collecting characteristic information of the in-vehicle environment outside the vehicle, such as at least one of an external image acquisition device, radar (e.g., lidar), and an ultrasonic sensor.

[0177] The output device 114 can output various types of information to the outside, and may include, for example, a display, speaker, printer, communication network and remote output equipment connected thereto. Exemplarily, the output device 114 may include a light-emitting device installed outside the vehicle, which can display lighting effects corresponding to the first and / or second information. Alternatively, the output device 114 may include a screen installed outside the vehicle, which can display a screen corresponding to the first and / or second information.

[0178] Naturally, for the sake of simplification, Figure 13 shows only some of the components of the electronic device 100 relevant to this disclosure, omitting components such as buses and input / output interfaces. In addition, depending on the specific application, the electronic device 100 may include any other appropriate components.

[0179] Exemplary computer program products and computer-readable storage media In addition to the methods and apparatus described above, embodiments of the present disclosure may further provide a computer program product that, when executed by a processor, causes the processor to perform steps in the in-vehicle cockpit driving state presentation methods of various embodiments of the present disclosure described in the “Exemplary Methods” portion.

[0180] Computer program products can be created using any combination of one or more programming languages ​​to produce program code for performing operations of embodiments of the present disclosure, and the programming languages ​​include object-oriented programming languages ​​such as Java and C++, and conventional procedural programming languages ​​such as the C language or similar programming languages. The program code may be executed entirely on the user's computing device, partially on the user's device, as separate software packages, partially on the user's computing device and partially on a remote computing device, or entirely on a remote computing device or a server.

[0181] Furthermore, embodiments of the present disclosure may also be computer-readable storage media that, when executed by a processor, store computer program instructions causing the processor to perform steps in the in-vehicle cockpit driving state presentation method of various embodiments of the present disclosure described in the “Exemplary Methods” portion above.

[0182] Computer-readable storage media can employ any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium includes, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatus, or devices, or any combination of more than these. More specific examples of readable storage media (non-exclusive list) include electrical connections with one or more leads, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the above.

[0183] While the basic principles of this disclosure have been explained above with reference to specific embodiments, the advantages, advantages, and effects mentioned herein are not limited to those mentioned above, but are merely illustrative, and these advantages, advantages, and effects are not necessarily present in every embodiment of this disclosure. Furthermore, the specific details disclosed herein are not limited to those mentioned above, but are merely illustrative and intended to facilitate understanding, and these details do not necessarily limit this disclosure to being realized by such specific details.

[0184] Those skilled in the art can make various modifications and alterations to this disclosure without departing from the spirit and scope of this disclosure. Thus, if such modifications and alterations of this disclosure fall within the scope of the claims of this disclosure and the equivalent art, this disclosure is intended to include such modifications and alterations.

Claims

1. Currently, the steps involve acquiring characteristic information about the vehicle's interior environment, The steps include determining the characteristics of passengers in the vehicle based on the characteristic information of the in-vehicle environment, The steps include determining, based on the passenger's characteristic information, that the passenger belongs to the target object, generating first presentation information to indicate that the target object is present inside the vehicle, and displaying the first presentation information in the vehicle; The first step is to acquire information about the driver's driving behavior in the driving scene, The steps include: determining, based on the aforementioned driving behavior information, that the driver's driving state is a target driving state; generating second presentation information to indicate that the driver is in the target driving state; and causing the vehicle to display the second presentation information. The step of determining that the driver's driving state is the target driving state based on the aforementioned driving behavior information is: Based on the aforementioned driving information, the steps include determining the number of times the driver will perform reverse operations within a first predetermined time and the interval time between the execution of the reverse operations, The procedure includes the step of determining that the driver's driving state is the target driving state in response to the fact that the number of times is equal to or greater than a first preset threshold and the interval time is equal to or less than a second preset threshold, or The steps include obtaining a driving command generated for the first driving scene, The steps include determining a first operation that the driving information instructs the vehicle to perform and a second operation that the driving command instructs the vehicle to perform, The process includes the step of determining that the driver's driving state is the target driving state in response to the fact that the first operation and the second operation are inverse operations, and that the time interval between the time of acquisition of the driving command and the time of acquisition of the driving activity information is within a second preset time, A method for displaying the in-vehicle cockpit driving status, realized by an in-vehicle cockpit driving status display device.

2. The driving information reflects the operations performed by the driver, the operations performed by the driver include acceleration, deceleration, braking, straight driving, left turning, and right turning, the reverse operation of the acceleration operation includes the deceleration operation and the braking operation, the reverse operation of the deceleration operation is the acceleration operation, the reverse operation of the braking operation is the acceleration operation, the reverse operation of the straight driving operation includes the left turning operation and the right turning operation, the reverse operation of the left turning operation includes the straight driving operation and the right turning operation, and the reverse operation of the right turning operation includes the straight driving operation and the left turning operation. The method for presenting the in-vehicle cockpit driving state according to claim 1.

3. The characteristic information of the in-vehicle environment includes an image of the in-vehicle environment, and the step of determining the characteristic information of the passengers in the vehicle based on the characteristic information of the in-vehicle environment is: The steps include determining a region in the image that includes at least one facial feature based on the image of the in-vehicle environment, A step of determining that the person corresponding to the area is the passenger, based on the area, The step of determining the passenger's characteristic information based on an image corresponding to the region, The method for presenting the in-vehicle cockpit driving state according to claim 1.

4. The characteristic information of the in-vehicle environment includes audio information of the in-vehicle environment, and the step of determining the characteristic information of the passengers in the vehicle based on the characteristic information of the in-vehicle environment is: The steps include determining the location and characteristics of the sound source of the audio information in the in-vehicle environment, A step of determining that the location of the sound source of the aforementioned audio information is the passenger, based on the location of the sound source of the aforementioned audio information, The step of determining the passenger's characteristic information based on the recognition of the aforementioned voice features, The method for presenting the in-vehicle cockpit driving state according to claim 1.

5. The step of determining that the passenger belongs to the target object based on the passenger's characteristic information and generating the first presentation information to indicate that the target object is present inside the vehicle is: The steps include determining, based on the passenger's characteristic information, that the passenger belongs to the target object, and determining a target lighting effect to indicate that the target object is present inside the vehicle, The steps include determining the target switch state of each light-emitting device corresponding to the display of the target lighting effect, based on the correspondence between different lighting effects stored in advance and the switch states of each light-emitting device outside the vehicle, The steps include generating the first presentation information to instruct the light-emitting device to match the target switch state, The method for presenting the in-vehicle cockpit driving state according to claim 1.

6. The step of determining that the passenger belongs to the target object based on the passenger's characteristic information and generating the first presentation information to indicate that the target object is present inside the vehicle is: The steps include determining, based on the passenger's characteristic information, that the passenger belongs to the target object, and generating a display screen to indicate that the target object is present inside the vehicle, The steps include generating the first presentation information for displaying the presentation screen on a screen outside the vehicle, The method for presenting the in-vehicle cockpit driving state according to claim 1.

7. Currently, a first information acquisition module for obtaining characteristic information about the in-vehicle environment, A first information determination module for determining passenger characteristics information in the vehicle based on the characteristic information of the in-vehicle environment acquired by the first information acquisition module, A first information generation module determines, based on the passenger characteristic information determined by the first information determination module, that the passenger belongs to the target object, generates first presentation information to indicate that the target object is present inside the vehicle, and causes the vehicle to display the first presentation information. A second information acquisition module for acquiring information on the driver's driving behavior in the first driving scene, Includes a second information generation module that determines, based on the aforementioned driving behavior information, that the driver's driving state is a target driving state, generates second presentation information to indicate that the driver is in the target driving state, and causes the vehicle to display the second presentation information, The aforementioned second information generation module is, Based on the aforementioned driving behavior information, the system is configured to determine the number of times the driver performs reverse operations within a first predetermined time and the interval time between such reverse operations, and in response to the number of operations being equal to or greater than a first predetermined threshold and the interval time being equal to or less than a second predetermined threshold, it is determined that the driver's driving state is the target driving state, or The system is configured to acquire a driving command generated for the first driving scene, determine a first operation that the driving action information instructs the vehicle to perform, and a second operation that the driving command instructs the vehicle to perform, and to determine that the driver's driving state is the target driving state in response to the fact that the first operation and the second operation are inverse operations and the time interval between the acquisition time of the driving command and the acquisition time of the driving action information is within a second preset time. In-car cockpit driving status display device.

8. A computer program used to perform the in-vehicle cockpit driving state presentation method described in any one of claims 1 to 6 is stored. A computer-readable storage medium.

9. The second processor, The second processor includes a memory for storing executable instructions, The second processor reads and executes the executable instructions from the memory and is used to realize the in-vehicle cockpit driving state presentation method described in any one of claims 1 to 6. electronic equipment.

Images