Vehicle operation display method, system, equipment and medium

Abstract

The invention provides a vehicle operation display method, system and device and a medium, and relates to the technical field of vehicle guidance, and the method comprises the steps: determining a vehicle owner type of a user at a current driving position; under the condition that the vehicle owner type is a non-default vehicle owner, acquiring a first point location sequence for guiding a basic operation behavior of the non-default vehicle owner; according to a point position sequence in the first point position sequence, controlling an omnibearing emitter to sequentially rotate to each point position of the first point position sequence, and emitting a visible light beam to an operation part corresponding to the current point position; and outputting guidance information corresponding to the current point location to guide the basic operation behavior of the non-default vehicle owner every time the vehicle owner rotates to one point location. The method aims at efficiently assisting a driver to be familiar with vehicle operation so as to improve the vehicle using experience of the driver.

Description

Technical Field

[0001] This application relates to the technical field of vehicle guidance, and specifically relates to a method, system, device, and medium for displaying vehicle operations. Background Art

[0002] Intelligent driving has gradually come into the public eye and is applied in automobile driving. As a result, various traditional switches have been updated, and there are more and more novel functions and hidden functions. For example, the traditional wiper combination switch, lighting combination switch, and gearshift switch are integrated into the steering column switch, and many hard switches are optimized and replaced by soft switches on the display screen. For drivers who are not familiar with the vehicle, it takes time to find the switches, which will lead to a poor driving experience for the drivers. Summary of the Invention

[0003] In view of this, this application provides a method, system, device, and medium for displaying vehicle operations, aiming to solve or partially solve the problems existing in the background art.

[0004] In the first aspect of this application, a method for displaying vehicle operations is provided. The method includes:

[0005] Determine the owner type of the user in the current driver's seat;

[0006] When the owner type is a non-default owner, obtain the first point sequence for guiding the basic operation behaviors of the non-default owner;

[0007] According to the point order in the first point sequence, control the omnidirectional emitter to rotate to each point in the first point sequence in turn, and emit a visible light beam towards the operation component corresponding to the current point;

[0008] When rotating to each point, output the guiding information corresponding to the current point to guide the basic operation behaviors of the non-default owner.

[0009] In the second aspect of this application, a system for displaying vehicle operations is provided. The system includes:

[0010] An owner type determination module, configured to determine the owner type of the user in the current driver's seat;

[0011] A point sequence acquisition module, configured to obtain the first point sequence for guiding the basic operation behaviors of the non-default owner when the owner type is a non-default owner;

[0012] A control module, configured to control the omnidirectional emitter to rotate to each point in the first point sequence in turn according to the point order in the first point sequence, and emit a visible light beam towards the operation component corresponding to the current point;

[0013] A guidance module, configured to output guidance information corresponding to the current position to guide the basic operation behavior of the non-default vehicle owner when rotating to each position.

[0014] The third aspect of the present application provides an electronic device, including: a processor, a memory, and a computer program stored on the memory and running on the processor. When the computer program is executed by the processor, the steps in a vehicle operation display method as described in the first aspect of the present application are implemented.

[0015] The fourth aspect of the present application provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in a vehicle operation display method as described in the first aspect of the present application are implemented.

[0016] The vehicle operation display method provided by the present application has the following advantages:

[0017] A vehicle operation display method provided by an embodiment of the present application first determines the vehicle owner type of the current driver's seat user; in the case that the vehicle owner type is a non-default vehicle owner, obtains a first position sequence for guiding the basic operation behavior of the non-default vehicle owner; controls the omnidirectional transmitter to rotate to each position in the first position sequence in sequence according to the position order in the first position sequence, and emits a visible light beam towards the operation component corresponding to the current position; and when rotating to each position, outputs guidance information corresponding to the current position to guide the basic operation behavior of the non-default vehicle owner.

[0018] This application first determines the owner type of the current driver's seat user. When it is determined that the driver is a non-default owner who does not use the vehicle for a long time and is very familiar with the relevant functions of the vehicle, after the vehicle is unlocked and powered on, a first point sequence for guiding the basic operation behaviors of the non-default owner is automatically obtained. The basic operation behaviors refer to the operation behaviors related to vehicle driving and safety to ensure that the non-default owner can at least correctly start and drive the vehicle and ensure safety during the driving process. For example, vehicle start operation behaviors, windshield wiper adjustment operation behaviors, lighting control operation behaviors, defogging control operation behaviors, and rearview mirror adjustment behaviors, etc. The first point sequence records at least the positions of each point to which the omnidirectional transmitter needs to be rotated, and the order in which the omnidirectional transmitter rotates to each point position in this sequence. According to the point order recorded in the first point sequence, control the omnidirectional transmitter to rotate to each point of the first point sequence in turn, and emit a visible light beam towards the operation component corresponding to the current point to guide the user to control the operation component. At the same time, when rotating to each point, output the guiding information corresponding to the current point to guide the non-default owner to correctly operate the operation component corresponding to the current point (such as pressing, rotating clockwise, rotating counterclockwise, pushing forward, pushing backward, etc.) in the form of voice and / or image, etc., so as to guide the basic operation behaviors of the non-default owner. In this way, intuitive explanations of basic functions can be provided to drivers who are not familiar with the vehicle and the drivers can be guided to control. In this way, not only the visible light beam points to a specific operation component, but also the corresponding guiding information is output, so as to guide the basic operation behaviors of the non-default owner in a more intuitive way, thereby effectively improving the driving experience of such drivers. Brief Description of the Drawings

[0019] To more clearly illustrate the technical solutions of the embodiments of this application, the following will briefly introduce the drawings required for the description of the embodiments of this application. Obviously, the drawings in the following description are only some embodiments of this application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0020] Figure 1 Flowchart of a vehicle operation display method shown in an embodiment of this application;

[0021] Figure 2 Flowchart of determining the occlusion situation of the visible light beam in a vehicle operation display method shown in an embodiment of this application;

[0022] Figure 3 Schematic diagram of virtual keys in a vehicle operation display method shown in an embodiment of this application;

[0023] Figure 4A guiding flowchart in a method for displaying vehicle operations shown in an embodiment of the present application;

[0024] Figure 5 A schematic diagram of components required for implementing a method for displaying vehicle operations shown in an embodiment of the present application;

[0025] Figure 6 Another flowchart of a method for displaying vehicle operations shown in an embodiment of the present application;

[0026] Figure 7 A schematic diagram of a system for displaying vehicle operations shown in an embodiment of the present application. Detailed implementation manners

[0027] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present application without creative efforts shall fall within the protection scope of the present application.

[0028] Refer to Figure 1 , Figure 1 which is a flowchart of a method for displaying vehicle operations shown in an embodiment of the present application. As Figure 1 shown, the method includes:

[0029] Step S1: Determine the owner type of the user in the current driver's seat.

[0030] In this embodiment, after the vehicle is unlocked and powered on, first determine the owner type of the user in the current driver's seat. Among them, the owner types in the present application include the default owner who is familiar with vehicle operations and the non-default owner who is not familiar with vehicle operations. An optional implementation manner is to collect the face image of the user through the image acquisition device of the driver's seat user, and then compare it with the pre-established default owner database to determine whether the owner type of the current driver's seat user is the default owner. If it is determined that the owner type of the current driver's seat user does not belong to the default owner, then the owner type of the current driver's seat user is the non-default owner. It should be understood that this is only an optional implementation manner, and the method for determining the owner type can also be other optional implementation manners, such as determining the owner type through the combination of voiceprint recognition and image.

[0031] Step S2: When the owner type is a non-default owner, obtain the first point sequence for guiding the basic operation behaviors of the non-default owner.

[0032] In this embodiment, the basic operation behaviors in the present application refer to the basic operation behaviors related to vehicle driving and safety, so as to ensure that at least a non-default vehicle owner can correctly start and drive the vehicle and confirm the safety during the driving process. For example, vehicle start operation behaviors, windshield wiper adjustment operation behaviors, lighting control operation behaviors, defogging control operation behaviors, rearview mirror adjustment operation behaviors, parking operation behaviors, etc. When it is determined that the vehicle owner is a non-default vehicle owner, a pre-established first point sequence for guiding the basic operation behaviors of the non-default vehicle owner is automatically obtained. The first point sequence records at least the positions of each point to which the omnidirectional transmitter needs to be rotated, and the order in which the omnidirectional transmitter rotates to each point position in the sequence.

[0033] In this embodiment, the omnidirectional transmitter realizes non-stop and omnidirectional (360-degree) dynamic visible light signal coverage on the horizontal plane by driving the directional visible light source to perform circular rotational motion. The omnidirectional transmitter is preferably integrated on the front ceiling lamp. The omnidirectional transmitter is used to emit visible light beams towards the corresponding operation components to provide corresponding vehicle usage guidance for the non-default vehicle owner. At the same time, the omnidirectional transmitter is also used to receive the control signals of the controller and automatically rotate by an angle corresponding to the received control signal to emit visible light beams pointing to the corresponding operation components into the cockpit. The controller for controlling the omnidirectional transmitter is preferably an intelligent cockpit controller. For the sake of understanding, the intelligent cockpit controller will be taken as an example for subsequent description. It should be understood that the controller for controlling the omnidirectional transmitter can also be other controllers. Among them, the operation components refer to the control components for controlling various functions of the vehicle, including at least virtual buttons, physical buttons, joysticks, and paddles, etc.

[0034] Step S3: According to the point order in the first point sequence, control the omnidirectional transmitter to rotate to each point in the first point sequence in turn, and emit visible light beams towards the operation component corresponding to the current point.

[0035] In this embodiment, after obtaining the first point sequence based on step S2, based on the positions of each point recorded in the first point sequence, determine the control signals that the intelligent cockpit controller needs to send out. One control signal corresponds to one point position among all the control signals that need to be sent out. At the same time, based on the sequence of each point position recorded in the first point sequence, determine the sequence of all control signals that the intelligent cockpit controller needs to send. Then, based on this sequence, sequentially send out each control signal among all the control signals to control the omnidirectional transmitter to rotate to each point in the first point sequence in turn, and emit visible light beams towards the operation component corresponding to the current point after rotating to each point.

[0036] Step S4: When rotating to each point position, output the guidance information corresponding to the current point position to guide the basic operation behavior of the non-default vehicle owner.

[0037] In this embodiment, a mapping relationship between the point position and the guidance information is pre-created. When the intelligent cockpit controller rotates to a point position and emits a visible light beam to point to the corresponding operation component, based on the mapping relationship between the point position and the guidance information, start to output the guidance information corresponding to the current point position to guide the basic operation behavior of the non-default vehicle owner. For example, when the visible light beam points to the operation component for controlling the rearview mirror adjustment, start to output the guidance information corresponding to guiding the non-default vehicle owner to adjust the rearview mirror. Among them, the output form of the guidance information includes voice output and / or text output. At the same time, the intelligent cockpit controller monitors the point position to which the omnidirectional transmitter rotates, and when it rotates to the point position that the intelligent cockpit controller needs to rotate to currently, controls the corresponding voice output device to output the corresponding guidance information, and / or controls the corresponding display screen to output the corresponding guidance information to guide the non-default vehicle owner in the basic operation behavior, so as to improve the vehicle use experience of the non-default vehicle owner.

[0038] A vehicle operation display method provided by an embodiment of the present application first determines the vehicle owner type of the current driver's seat user; in the case that the vehicle owner type is a non-default vehicle owner, obtains a first point position sequence for guiding the basic operation behavior of the non-default vehicle owner; according to the point order in the first point position sequence, controls the omnidirectional transmitter to rotate to each point position in the first point position sequence in turn, and emits a visible light beam to the operation component corresponding to the current point position; when rotating to each point position, output the guidance information corresponding to the current point position to guide the basic operation behavior of the non-default vehicle owner.

[0039] This application first determines the vehicle owner type of the current driver. When it is determined that the driver is a non-default vehicle owner who does not use the vehicle for a long time and is not very familiar with the relevant functions of the vehicle, after the vehicle is unlocked and powered on, it automatically obtains the first point sequence that guides the basic operation behaviors of the non-default vehicle owner. The basic operation behaviors refer to the operation behaviors related to vehicle driving and safety to ensure that the non-default vehicle owner can at least correctly start and drive the vehicle and ensure safety during the driving process. For example, vehicle start operation behaviors, windshield wiper adjustment operation behaviors, lighting control operation behaviors, defogging control operation behaviors, and rearview mirror adjustment behaviors, etc. The first point sequence records at least the positions of each point to which the omnidirectional emitter needs to be rotated, and the order in which the omnidirectional emitter rotates to each point position in this sequence. According to the point order recorded in the first point sequence, control the omnidirectional emitter to rotate to each point of the first point sequence in turn, and emit a visible light beam towards the operation component corresponding to the current point to guide the user to control the operation component. At the same time, when rotating to each point, output the guiding information corresponding to the current point to guide the non-default vehicle owner to correctly operate the operation component corresponding to the current point (such as pressing, rotating clockwise, rotating counterclockwise, pushing forward, pushing backward, etc.) in the form of voice and / or image, etc., so as to guide the basic operation behaviors of the non-default vehicle owner. After the guiding information is output for a preset duration, control the omnidirectional emitter to rotate to the next point of the current point in the first point sequence. In this way, it is possible to give an intuitive explanation of the basic functions to the drivers who are not familiar with the vehicle and guide the drivers to control. In this way, not only the visible light beam points to a specific operation component, but also the corresponding guiding information is output, so as to guide the basic operation behaviors of the non-default vehicle owner in a more intuitive way, enabling the drivers who are not familiar with this vehicle model to save time to find the corresponding function switch or function on / off, thereby effectively improving the driving experience of such drivers.

[0040] Combined with the above embodiments, in one implementation, the embodiment of this application also provides a method for displaying vehicle operations. In this method for displaying vehicle operations, the method further includes: determining whether a target control signal corresponding to the current point is received; when the target control signal is received, controlling the omnidirectional emitter to rotate to the next point of the current point in the first point sequence; when the target control signal is not received within a preset duration, controlling the omnidirectional emitter to switch to an enhanced mode to emit a visible light beam towards the operation component corresponding to the current point and output the guiding information corresponding to the current point again.

[0041] In this embodiment, for drivers with rich driving experience, such drivers can generally infer the specific operation behaviors of the relevant operating components of the current vehicle model based on the various operating components in a large number of vehicle models they have driven in the past. Therefore, such drivers are more concerned about the locations of the various operating components rather than very detailed guiding information for each operating component. To improve the driving experience of such drivers, the present application provides another implementation manner. In this implementation manner, after the omnidirectional emitter is rotated to a point position by the intelligent cockpit controller, if a non-default vehicle owner performs a corresponding control action on the operating component, the guidance for the operating component at this point position ends. At this time, based on the first point sequence, the intelligent cockpit controller controls the omnidirectional emitter to rotate to the next point position.

[0042] Specifically, when the omnidirectional emitter is rotated to the current point by the intelligent cockpit controller, a visible light beam is emitted towards the operating component corresponding to the current point, and at the same time, the corresponding guiding information is output. During the process of outputting the guiding information, it is determined whether a control signal is received by monitoring the information on the CAN bus. In the case of receiving a control signal, the operating component that issues the control signal is determined. If the operating component is corresponding to the current point, it is determined that the current non-default vehicle owner is relatively familiar with the operating component of this vehicle at this time. At this time, the guidance for the operating component corresponding to the current point ends, and the intelligent cockpit controller further controls the omnidirectional emitter to rotate to the next point of the current point in the first point sequence to guide the operating component corresponding to the next point. If no target control signal corresponding to the current point is received within the preset time period, it is determined that the non-default vehicle owner may not have found the operating component pointed to by the current visible light beam. At this time, the intelligent cockpit controller controls the omnidirectional emitter to switch to the enhanced mode to emit a visible light beam towards the operating component corresponding to the current point, and at the same time, outputs the guiding information corresponding to the current point again to enhance the guiding intensity for the non-default vehicle owner. Among them, the enhanced mode includes emitting a flashing visible light beam and / or increasing the brightness of the visible light beam.

[0043] Combined with the above embodiments, in one implementation manner, the embodiments of the present application further provide a method for displaying vehicle operations. In this method for displaying vehicle operations, guiding information corresponding to the current point is output to guide the basic operation behaviors of the non-default vehicle owner, including: determining the reflection distance of the visible light beam directed at the operation component corresponding to the current point; determining the deviation between the calibrated reflection distance corresponding to the current point and the reflection distance, where the calibrated reflection distance is the standard reflection distance when there is no occlusion on the path of the visible light beam directed at the operation component corresponding to the current point; and determining whether to output guiding information corresponding to the current point to guide the basic operation behaviors of the non-default vehicle owner according to the deviation.

[0044] In this embodiment, incorrect guidance is provided to the non-default vehicle owner, which poses a very serious safety risk. Therefore, in order to ensure correct guidance for the non-default vehicle owner, the present application also pre-calibrates the standard reflection distance corresponding to each point position respectively, and establishes a mapping relationship between each point position and its corresponding standard reflection distance. The standard reflection distance of each point position refers to the reflection distance of the visible light beam when the omnidirectional transmitter rotates to the corresponding point and there is no occlusion on the path of the visible light beam directed at the operation component corresponding to the point. This mapping relationship will be recorded in the point sequence, and the calibrated reflection distance corresponding to each point position will be obtained simultaneously when the point sequence is acquired. While the present application monitors whether the omnidirectional transmitter rotates to the corresponding point through the intelligent cockpit controller, the present application also obtains the standard reflection distance corresponding to the point based on this mapping relationship, and compares the standard reflection distance with the actual reflection distance of the visible light beam emitted when the omnidirectional transmitter rotates to this point position, so as to further determine whether the visible light beam output by the omnidirectional transmitter correctly points to the corresponding operation component and whether there is an occluder in the propagation path.

[0045] Specifically, the monitoring determines the actual reflection distance at which the visible light beam is directed at the operating component corresponding to the current position, and simultaneously obtains the calibrated reflection distance corresponding to the current position. The calibrated reflection distance is the standard reflection distance when there is no obstruction in the path of the visible light beam directed at the operating component corresponding to the current position. The two are compared to determine the deviation between the calibrated reflection distance corresponding to the current position and the actual reflection distance. When the deviation between the two is lower than the set threshold, it is determined that the visible light beam output by the omnidirectional transmitter points to the correct operating component and there is no obstruction in the propagation path. At this time, the guidance information corresponding to the current position is output to guide the basic operation behavior of non-default vehicle owners. Among them, the set threshold can be set according to the actual scenario and is not specifically limited here, such as 1 cm, 0.5 cm, etc. When the deviation between the two is greater than or equal to the set threshold, it is determined that there is a problem with the direction of the visible light beam output by the omnidirectional transmitter. At this time, the guidance information corresponding to the current position is not output, and the basic operation behavior of non-default vehicle owners is not guided.

[0046] Combined with the above embodiments, in one implementation, the embodiment of the present application also provides a method for displaying vehicle operations. In this method for displaying vehicle operations, the determining whether to output the guidance information corresponding to the current position to guide the basic operation behavior of the non-default vehicle owner according to the deviation includes: when the deviation satisfies the first condition, outputting a prompt message that the operating component corresponding to the current position is blocked; when the deviation satisfies the second condition, outputting the guidance information corresponding to the current position to guide the basic operation behavior of the non-default vehicle owner; when the deviation satisfies the third condition, determining that the omnidirectional transmitter points to the wrong operating component and terminating subsequent guidance.

[0047] In this embodiment, when the deviation obtained by comparing the actual reflection distance at which the visible light beam determined by the monitoring is directed at the operating component corresponding to the current position with the calibrated reflection distance corresponding to the current position satisfies the second condition, at this time, the deviation between the actual reflection distance and the calibrated reflection distance being compared is very small. It is determined that the visible light beam output by the omnidirectional transmitter points to the correct operating component and there is no obstruction in the propagation path. At this time, the guidance information corresponding to the current position is output to guide the basic operation behavior of non-default vehicle owners. Among them, the second condition is that the deviation between the calibrated reflection distance and the actual reflection distance being compared is lower than the set threshold. The set threshold can be set according to the actual scenario and is not specifically limited here, such as 1 cm, 0.5 cm, etc.

[0048] When the deviation between the two satisfies the first condition, at this time, the calibrated reflection distance being compared is greater than the actual reflection distance to a certain extent. It is determined that the visible light beam output by the omnidirectional transmitter may be pointing to the wrong operating component, or there may be an obstruction in the propagation path. At this time, a prompt message indicating that the operating component corresponding to the current position is blocked is output, and the corresponding guidance information is not output. Then, continue to monitor in real time the actual reflection distance of the visible light beam shooting at the operating component corresponding to the current position. If the actual reflection distance determined by real-time monitoring and the corresponding calibrated reflection distance still satisfy the first condition within a certain period of time, the subsequent guidance is terminated to prevent incorrect guidance to non-default vehicle owners. Among them, the first condition is that the calibrated emission distance being compared is greater than the actual reflection distance, and at the same time, the deviation between the two is greater than the first threshold. Here, the first threshold can be set according to the actual scenario and is not specifically limited here, such as 2 cm, 5 cm, etc. If the actual reflection distance determined by real-time monitoring and the corresponding calibrated reflection distance start to satisfy the second condition at a certain moment within a certain period of time, it is determined that there was an object blocking the propagation path before. At this time, the guidance information corresponding to the current position is output to guide the basic operation behavior of non-default vehicle owners.

[0049] When the deviation between the two satisfies the third condition, at this time, the actual reflection distance being compared is greater than the calibrated reflection distance to a certain extent, and this situation will not occur with an obstruction. Therefore, it is determined that the visible light beam output by the omnidirectional transmitter is pointing to the wrong operating component. At this time, the subsequent guidance is directly terminated to avoid incorrect vehicle use guidance to non-default vehicle owners. Among them, the third condition is that the actual reflection distance being compared is greater than the calibrated emission distance, and at the same time, the deviation between the two is greater than the second threshold. Here, the second threshold can be set according to the actual scenario and is not specifically limited here, such as 2 cm, 5 cm, etc.

[0050] Exemplarily, a mapping relationship between the point position A and the standard reflection distance L1 is established in advance, and a mapping relationship between the point position B and the standard reflection distance L2 is established in advance. The omnidirectional transmitter is controlled by the intelligent cockpit controller to rotate to the point position A, and the intelligent cockpit controller monitors whether the omnidirectional transmitter has rotated to the point position A. When it is monitored and determined that the omnidirectional transmitter has rotated to the point position A, here it is assumed that the omnidirectional transmitter has not actually rotated to the point position A but has rotated to the point position B. At this time, the actual reflection distance L0 of the visible light beam emitted from the point position B is compared with the standard reflection distance L1 corresponding to the point position A. Since the actual reflection distance L0 is actually the reflection distance rotated to the point position B, the actual reflection distance L0 will not be the same as the standard reflection distance L1. If the deviation between the actual reflection distance L0 and the standard reflection distance L1 satisfies the first condition, it is determined that either the visible light beam output by the omnidirectional transmitter does not correctly point to the corresponding operating component or there is an obstacle in the propagation path. If the deviation between the actual reflection distance L0 and the standard reflection distance L1 satisfies the third condition, it can be directly determined that the visible light beam output by the omnidirectional transmitter does not correctly point to the corresponding operating component.

[0051] In this embodiment, as Figure 2 shown, when the position of the operating component is blocked by the driver under the driver's seat, first determine the actual reflection distance of the emitted light beam pointing to the operating component, and feedback this distance to the intelligent cockpit controller. The intelligent cockpit controller compares the calibrated reflection distance corresponding to the operating component with the obtained actual reflection distance. When the calibrated emission distance corresponding to the operating component is greater than the actual reflection distance and the deviation between the two is greater than the first threshold, the intelligent cockpit controller determines that the operating component may be blocked. At this time, the intelligent cockpit controller 3 sends a CAN instruction to the seat controller through the gateway GW to perform the action of moving the driver's seat backward to avoid the object blocking the operating component.

[0052] Combined with the above embodiments, in one implementation, the embodiments of the present application further provide a method for displaying vehicle operations. In this method for displaying vehicle operations, step S1 may include: respectively matching the collected first face information of the current driver's seat user with each second face information in the first database; when there is second face information in the first database that matches the first face information, determining that the current driver's seat user is the default vehicle owner; when the first face information does not match any of the second face information in the first database, storing the first face information and the corresponding collection time in the second database, and respectively matching the first face information with each third face information in the second database to determine the number of third face information that matches the first face information within a preset past duration; when the number is less than the target threshold, determining that the current driver's seat user is a non-default vehicle owner.

[0053] In this embodiment, after the vehicle is unlocked and powered on, the face information of the current driver's seat user is collected by the DMS camera, and this face information is the first face information. Preferably, the DMS camera is placed on the steering wheel. Then, the first face information is transmitted to the intelligent cockpit controller through a coaxial cable, and the intelligent cockpit controller matches the first face information with each second face information stored in the first database. The first database records the face information of each default vehicle owner, and each default vehicle owner has a corresponding face information. The face information stored in the first database is called the second face information. When there is second face information in the first database that matches the first face information, it is determined that the current driver's seat user is the default vehicle owner, and based on the user identifier corresponding to the matched second face information, it is determined which specific default vehicle owner is in the current driver's seat. Then, based on the personalized settings pre-set corresponding to the user identifier, relevant seats, rearview mirrors, lights, music, etc. of the vehicle are configured. Among them, after the user enters the authorization password, a new first face information can be stored in the first database, thereby updating the default vehicle owner in the first database. When there is no second face information in the first database that can match the first face information, the first face information and the collection time of the first face information are stored in the second database. Then, the first face information is further matched with each third face information recorded in the second database from the current moment to the preset past duration. The preset past duration can be set according to the actual application scenario and is not specifically limited here, such as 1 month or 3 months from the current moment forward, and the preset past duration includes the current moment. For the convenience of description, after the corresponding first face information and the collection time of the first face information are stored in the second database, the first face information is then called the third face information.

[0054] In this embodiment, when there are multiple third-party face information that match the currently collected first-party face information among all the third-party face information in the second database within a preset duration in the past, the number of the mutually matching third-party face information is determined. When the number is lower than the target threshold, it is determined that the current driver in the driver's seat is not the default vehicle owner. At this time, a control instruction of function show = 0x1 is sent to the omnidirectional transmitter through the intelligent cockpit controller to control the omnidirectional transmitter to give guidance on basic operation behaviors. When the number is greater than or equal to the target threshold, the current driver in the driver's seat is determined as the temporary default vehicle owner. At this time, a control instruction of function show = 0x0 is sent to the omnidirectional transmitter through the intelligent cockpit controller to control the omnidirectional transmitter not to give guidance on basic operation behaviors. Among them, the target threshold can be set according to the actual application scenario and is not specifically limited here, such as being set to 3, 5, 10, etc. For the driver who is the temporary default vehicle owner, their face information will not be recorded in the first database. At the same time, when the driver who was previously the temporary default vehicle owner has not driven this vehicle for a long time, the number of third-party face information belonging to this driver and within the preset duration from the current time to the past will continuously decrease until they are no longer the temporary default vehicle owner. For the temporary default vehicle owner, this application will not give guidance on basic operation behaviors to them after the vehicle is unlocked and powered on. For example, the preset duration in the past is set to 1 month, the target threshold is 5, and user A is not the default vehicle owner. Then, when the number of times user A unlocks and powers on the vehicle within 1 month is less than 5 times, user A belongs to a non-default vehicle owner. When the number of times user A unlocks and powers on the vehicle within 1 month is greater than or equal to 5 times, user A belongs to the temporary default vehicle owner. At the same time, as time goes by, as long as the number of times user A unlocks and powers on the vehicle within the past one month is less than 5 times, then this user A will be determined as a non-default vehicle owner again.

[0055] Combined with the above embodiments, in one implementation, the embodiments of the present application further provide a method for displaying vehicle operations. In this method for displaying vehicle operations, the method further includes: closing the guidance function when the vehicle owner type is the default vehicle owner or a close instruction sent by the current vehicle owner is received; according to the closed state of the guidance function, controlling the omnidirectional transmitter to project virtual buttons to a specified area on the front-row instrument panel and project warning information corresponding to the warning signal through the received virtual button projection signal and warning signal; and performing a control action corresponding to the virtual button according to the interaction behavior of the user with the virtual button.

[0056] In this embodiment, when the owner is determined to be the default owner, the guidance function is turned off, and the default owner is not guided to automatically perform basic operation behaviors after the vehicle is unlocked and powered on. The default owner at this time includes a temporary default owner. When the owner is determined to be a non-default owner, in the process of guiding the automatic execution of basic operation behaviors after the vehicle is unlocked and powered on, based on the received shutdown instruction issued by the non-default owner of the current driving seat, the smart cockpit controller sends a function show=0x0 control instruction to the omnidirectional transmitter to immediately stop the current guidance process.

[0057] In this embodiment, when the guidance function is turned off, a virtual key projection signal and / or a warning signal are sent to the omnidirectional transmitter through the smart cockpit controller. Figure 3 As shown, Figure 3 Several common virtual buttons are shown. When the transmitted signal includes a virtual button projection signal, based on the virtual button projection signal, the omnidirectional transmitter is controlled to project a virtual button to a designated area of the front instrument panel. Based on the user's interactive behavior (such as a click operation) performed on a virtual button projected to the designated area, a corresponding control signal is returned to the vehicle bus, and the vehicle is controlled to perform a corresponding control action (such as turning on the trunk light) in response to the control signal. This method can simplify the driver's time to find a soft switch. When the transmitted signal includes a warning signal, based on the warning signal, the omnidirectional transmitter is controlled to project a warning message corresponding to the warning message (such as not fastening a seat belt, etc.) to an adjacent area of the designated area of the front instrument panel. The warning message flashes at a certain frequency and alarms once every certain period of time until the warning is lifted (such as the seat belt has been fastened). The warning function in the vehicle can be arranged according to the vehicle model function and functional safety level.

[0058] In this embodiment, the omnidirectional transmitter includes a visible beam transmitting module, a camera module and a laser module. The visible beam transmitting module can rotate and emit a visible beam to guide the owner to operate the vehicle. The virtual button (an infrared button) is implemented using a camera and a laser module. The laser module projects the virtual button and the camera collects coordinate information. The set virtual button is projected in a fixed area through the laser module. When the user clicks the virtual button, the specific virtual button clicked by the user is determined according to the coordinate information collected by the camera, and the corresponding control signal is returned to the vehicle bus through the omnidirectional transmitter. The vehicle performs the corresponding control action according to the current state and the control signal. For example, when the projected virtual button includes a trunk switch, the back door of the vehicle is currently closed. After pressing the trunk switch in the projection area, the back door opens. If the trunk is currently open, the closing action is performed after receiving the press switch signal, which is consistent with the back door switch logic of the vehicle. Here, the key signal definition Ox0 = unpress, Oxl = press.

[0059] In this embodiment, the user can also start and stop the guidance function by turning on or off the switch of "vehicle function display" on the display screen of the intelligent cockpit controller.

[0060] In this embodiment, Table 1 shows some signals defined in this application. For example, Figure 4 as shown, the user can also control the opening and closing of "vehicle function display" by issuing voice commands, and control the guidance of various operation behaviors by issuing voice commands. In addition to the above implementation manners, a simple alternative implementation manner is: preset the point sequences corresponding to various operation behaviors inside the omnidirectional transmitter in advance, and only need to send a control instruction corresponding to a certain operation behavior to it through the intelligent cockpit controller to control the omnidirectional transmitter to rotate to the corresponding points in sequence to guide the user for this operation behavior. For example, by sending a function show = 0x1 control instruction to the omnidirectional through the intelligent cockpit controller, controlling the omnidirectional transmitter to rotate to each point in the point sequence corresponding to the basic operation behavior in sequence, and performing corresponding voice guidance broadcasts. For example, when issuing a voice command of "show the operation of the shift switch", in response to this voice command, send a function show = 0x2 control instruction to the omnidirectional through the intelligent cockpit controller, control the omnidirectional transmitter to rotate to the point corresponding to the operation component of the shift switch, and emit a visible light beam pointing to the operation component of the shift switch, while performing a voice broadcast.

[0061] Table 1

[0062]

[0063]

[0064] Combined with the above embodiments, in one implementation manner, the embodiments of this application also provide a method for displaying vehicle operations. In this method for displaying vehicle operations, the method further includes: obtaining a second point sequence for guiding the target operation behavior of the current vehicle owner according to a guidance instruction for guiding the target operation behavior sent by the current vehicle owner received; controlling the omnidirectional transmitter to guide the target operation behavior of the current vehicle owner according to the second point sequence.

[0065] In this embodiment, the present application also creates a second point sequence corresponding to each of a variety of target operation behaviors. Each target operation behavior has a second point sequence corresponding to itself. The second point sequence records the point positions to which the omnidirectional emitter needs to be rotated, as well as the order in which the omnidirectional emitter rotates to each point position in the second point sequence, and the mapping relationship between each point position and its corresponding standard reflection distance. For example, the target operation behavior can be an operation behavior of heating the steering wheel, an operation behavior of adjusting the ambient light, an operation behavior of automatic parking, etc. Whether the owner of the current driver's seat is the default owner or a non-default owner, they can send a guidance instruction to the vehicle to request the vehicle to guide the target operation behavior. This guidance instruction can be determined by voice recognition of the user or sent through specific virtual or physical buttons. For example, the user issues a voice "Please explain how to turn on the automatic parking function". By recognizing this voice, it is determined that the user currently wants to connect to the automatic parking function. At this time, a guidance instruction corresponding to the operation behavior of automatic parking is issued, and based on this guidance instruction, the second point sequence corresponding to the operation behavior of automatic parking is obtained. Finally, the user's automatic parking operation behavior is guided based on this second point sequence.

[0066] In this embodiment, the guidance implementation method of the target operation behavior is the same as that of the basic operation behavior, except that the basic operation behavior starts to be executed automatically after the vehicle is unlocked and powered on, while the target operation behavior is actively initiated by the owner of the current driver's seat.

[0067] Combined with the above embodiments, in one implementation manner, the embodiments of the present application also provide a method for displaying vehicle operations. In this method for displaying vehicle operations, the method further includes: pre-calibrating the target mapping relationship between each operation component in the vehicle and the point position, and calibrating the calibration reflection distance corresponding to each point; determining the action sequence of guiding the user's operation behavior; determining the operation component sequence corresponding to the action sequence according to the action sequence; creating a point sequence for guiding the user's operation behavior according to the target mapping relationship and the operation component sequence, where the user's operation behavior includes basic operation behavior and target operation behavior; and recording the calibration reflection distance of each point in the point sequence.

[0068] In this embodiment, for the method for displaying vehicle operations provided by the present application, the information that needs to be pre-calibrated includes: calibrating the target mapping relationship between each operation component in the vehicle and the point position. In this target mapping relationship, one point position corresponds to one operation component. After the omnidirectional emitter rotates to a point position in this target mapping relationship, the visible light beam emitted by the omnidirectional emitter points to the operation component corresponding to this point position in this target mapping relationship.

[0069] Meanwhile, calibrate the calibration reflection distance corresponding to each point position, where one point position corresponds to one calibration reflection distance. After the omnidirectional emitter rotates to a point position in the target mapping relationship, the visible light beam emitted by the omnidirectional emitter points to the operating component corresponding to this point position in the target mapping relationship. At the same time, when there is no object blocking in the transmission path of the visible light beam emitted towards the operating component, the reflection distance of the visible light beam is the calibration reflection distance corresponding to this point position.

[0070] Meanwhile, calibrate the point sequence corresponding to the operation behavior. Since the calibration implementation methods of the point sequences corresponding to each operation behavior (including basic operation behaviors and target operation behaviors) are the same, here, one operation behavior is taken as an example for illustration: Determine the action sequence that guides the user's operation behavior, that is, in this operation behavior, the actions to be executed in sequence, such as when controlling a vehicle to drive, it is necessary to shift gears first, then release the handbrake, then release the footbrake, and then control the throttle output. Based on the determined action sequence, determine the operating components that need to be controlled and executed corresponding to each action in this action sequence, so as to obtain the operating component sequence corresponding to this action sequence, that is, the various operating components that need to be controlled in this operation behavior, and the order of controlling each operating component. In the obtained operating component sequence, based on the calibrated target mapping relationship and the determined operating component sequence, sequentially determine the point positions corresponding to each operating component in the operating component sequence from the target mapping relationship. Based on the determined point positions and order, create a point sequence corresponding to this operation behavior, and at the same time record the calibration reflection distance of each point in this point sequence. For example, if the operating component sequence is component a1, component a3, and component a4 in sequence, and the point positions corresponding to component a1 in the target mapping relationship are x1, the point position corresponding to component a3 is x3, and the point position corresponding to component a4 is x4, then the point sequence corresponding to this operating component sequence is determined to be point position x1, point position x3, and point position x4 in sequence.

[0071] In this embodiment, as Figure 5 shown, the components on which a vehicle operation display method provided by this application is based at least include a DMS camera, an intelligent cockpit controller, an omnidirectional emitter, and a gateway. As Figure 6As shown, first, the vehicle is unlocked and powered on. Then, it is determined whether the guidance function of the vehicle is enabled. If it is not enabled, the process directly ends without guiding the basic operation behavior. In the case where the guidance function is enabled, the facial information of the user in the current driver's seat is further collected to determine whether the user in the current driver's seat is the default vehicle owner or a non-default vehicle owner. If it is determined that the user in the current driver's seat is the default vehicle owner (including the temporary default vehicle owner), no guidance on the basic operation behavior is performed. In the case where it is determined that the user in the current driver's seat is a non-default vehicle owner, it is further determined whether there is a third facial information in the second database that matches the facial information of the user in the current driver's seat (i.e., the first facial information) from the current moment to the preset duration in the past. If not, it is determined that the user in the current driver's seat is a user who has not used the vehicle from the current moment to the preset duration in the past, and is determined as a non-default vehicle owner, and corresponding guidance on the basic operation behavior is provided to them, including controlling the omnidirectional emitter to rotate to the corresponding point and emitting a visible light beam to point to the corresponding operation component, and simultaneously synchronously performing corresponding voice broadcast guidance. In the case where there is a third facial information in the second database that matches the facial information of the user in the current driver's seat (i.e., the first facial information) from the current moment to the preset duration in the past, the number of matches is determined. If the number is greater than or equal to the target threshold, it is determined that the user in the current driver's seat is a temporary default vehicle owner, and no guidance on the basic operation behavior is performed. In the case where the number is less than the target threshold, it is determined that the user in the current driver's seat is a non-default vehicle owner, and corresponding guidance on the basic operation behavior is provided to them, including controlling the omnidirectional emitter to rotate to the corresponding point and emitting a visible light beam to point to the corresponding operation component, and simultaneously synchronously performing corresponding voice broadcast guidance.

[0072] Based on the same inventive concept, an embodiment of the present application provides a display system for vehicle operation, as Figure 7 shown. The system 700 includes:

[0073] A vehicle owner type determination module 701, configured to determine the vehicle owner type of the user in the current driver's seat;

[0074] A point sequence acquisition module 702, configured to obtain a first point sequence for guiding the basic operation behavior of a non-default vehicle owner when the vehicle owner type is a non-default vehicle owner;

[0075] A control module 703, configured to control the omnidirectional emitter to sequentially rotate to each point of the first point sequence according to the point order in the first point sequence, and emit a visible light beam to the operation component corresponding to the current point;

[0076] A guidance module 704, configured to output guidance information corresponding to the current point to guide the basic operation behavior of the non-default vehicle owner each time it rotates to a point.

[0077] Optionally, the display system 700 for vehicle operations further includes:

[0078] A target control signal determination module, configured to determine whether a target control signal corresponding to the current point is received;

[0079] A first control module, configured to control the omnidirectional emitter to rotate to the next point of the current point in the first point sequence when the target control signal is received;

[0080] A second control module, configured to control the omnidirectional emitter to switch to an enhanced mode to emit a visible light beam towards the operating component corresponding to the current point and output the guiding information corresponding to the current point again when the target control signal is not received within a preset time period.

[0081] Optionally, the guiding module 704 includes:

[0082] A reflection distance determination module, configured to determine the reflection distance of the visible light beam towards the operating component corresponding to the current point;

[0083] A deviation determination module, configured to determine the deviation between the calibrated reflection distance corresponding to the current point and the reflection distance, where the calibrated reflection distance is the standard reflection distance when there is no occlusion on the path of the visible light beam towards the operating component corresponding to the current point;

[0084] A guiding determination module, configured to determine whether to output the guiding information corresponding to the current point to guide the basic operation behavior of the non-default vehicle owner according to the deviation.

[0085] Optionally, the guiding determination module includes:

[0086] A prompt module, configured to output a prompt message that the operating component corresponding to the current point is occluded when the deviation meets the first condition;

[0087] A guiding sub-module, configured to output the guiding information corresponding to the current point to guide the basic operation behavior of the non-default vehicle owner when the deviation meets the second condition;

[0088] A termination guiding module, configured to determine that the omnidirectional emitter points to the wrong operating component and terminate subsequent guiding when the deviation meets the third condition.

[0089] Optionally, the vehicle owner type determination module 701 includes:

[0090] A first matching module, configured to respectively match the first face information of the current driver's seat user collected with each second face information in the first database;

[0091] The first vehicle owner determination module is configured to determine the current driver's seat user as the default vehicle owner when there is second face information matching the first face information in the first database;

[0092] The second matching module is configured to, when the first face information does not match any of the second face information in the first database, store the first face information and the corresponding acquisition time in the second database, and match the first face information with each third face information in the second database respectively, to determine the number of third face information that matches the first face information within a preset past duration;

[0093] The second vehicle owner determination module is configured to determine the current driver's seat user as a non-default vehicle owner when the number is less than the target threshold.

[0094] Optionally, the vehicle operation display system 700 further includes:

[0095] The guidance function off control module is configured to turn off the guidance function when the vehicle owner type is the default vehicle owner, or when a turn-off instruction sent by the current vehicle owner is received;

[0096] The projection module is configured to, according to the off state of the guidance function, control the omnidirectional transmitter to project virtual keys to a specified area of the front row instrument panel through the received virtual key projection signal and warning signal, and project warning information corresponding to the warning signal;

[0097] The action control module is configured to execute a control action corresponding to the virtual key according to the user's interaction behavior with the virtual key.

[0098] Optionally, the vehicle operation display system 700 further includes:

[0099] The second point sequence determination module is configured to obtain a second point sequence for guiding the target operation behavior of the current vehicle owner according to a guidance instruction received from the current vehicle owner for requesting guidance on the target operation behavior;

[0100] The target operation behavior guidance module is configured to control the omnidirectional transmitter to guide the target operation behavior of the current vehicle owner according to the second point sequence.

[0101] Optionally, the vehicle operation display system 700 further includes: a calibration module for pre-calibrating the target mapping relationship between each operation component in the vehicle and the point positions, and calibrating the calibration reflection distance corresponding to each point position; and, for determining an action sequence for guiding the user's operation behavior; and, for determining an operation component sequence corresponding to the action sequence according to the action sequence; and, for creating a point position sequence for guiding the user's operation behavior according to the target mapping relationship and the operation component sequence, where the user's operation behavior includes a basic operation behavior and a target operation behavior; and, for recording the calibration reflection distance of each point position in the point position sequence.

[0102] Based on the same inventive concept, an embodiment of the present application provides an electronic device, including: a processor, a memory, and a computer program stored on the memory and running on the processor, where the computer program, when executed by the processor, implements the steps in a vehicle operation display method as described in the first aspect of the present application.

[0103] Based on the same inventive concept, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored on the computer-readable storage medium, and the computer program, when executed by a processor, implements the steps in a vehicle operation display method as described in the first aspect of the present application.

[0104] For the system embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and for the relevant parts, refer to the partial description of the method embodiment.

[0105] It should be noted that for the method embodiment, for the sake of simple description, it is all expressed as a series of action combinations. However, those skilled in the art should know that the embodiments of the present application are not limited by the described action sequence, because according to the embodiments of the present application, some steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential for the embodiments of the present application.

[0106] Each embodiment in this specification is described in a progressive manner, and the key point of each embodiment is to illustrate the differences from other embodiments. For the same and similar parts among the embodiments, refer to each other.

[0107] Those skilled in the art should understand that the embodiments of the present application can be provided as methods, systems, or computer program products. Therefore, the embodiments of the present application can take the form of completely hardware embodiments, completely software embodiments, or embodiments combining software and hardware aspects. Moreover, the embodiments of the present application can take the form of a computer program product implemented on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.

[0108] The embodiments of the present application are described with reference to the flowcharts and / or block diagrams of methods, terminal devices (systems), and computer program products according to the embodiments of the present application. It should be understood that each process and / or block in the flowchart and / or block diagram, as well as the combination of processes and / or blocks in the flowchart and / or block diagram, can be implemented by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processor, or other programmable data processing terminal devices to generate a machine, such that the instructions executed by the processor of the computer or other programmable data processing terminal devices generate means for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0109] These computer program instructions can also be stored in a computer-readable memory that can direct a computer or other programmable data processing terminal device to work in a specific manner, such that the instructions stored in the computer-readable memory generate a manufactured article including instruction means that implement the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0110] These computer program instructions can also be loaded onto a computer or other programmable data processing terminal device, such that a series of operation steps are executed on the computer or other programmable terminal device to generate a computer-implemented process, and thus the instructions executed on the computer or other programmable terminal device provide steps for implementing the functions specified in Figure 1 one process or multiple processes and / or blocks Figure 1 one block or multiple blocks.

[0111] Although the preferred embodiments of the embodiments of the present application have been described, those skilled in the art can make additional changes and modifications to these embodiments once they know the basic creative concepts. Therefore, the appended claims are intended to be construed to include the preferred embodiments and all changes and modifications falling within the scope of the embodiments of the present application.

[0112] Finally, it should also be noted that in this text, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, such that a process, method, article or terminal device comprising a series of elements not only includes those elements but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or terminal device. Without further limitation, an element defined by the statement "comprising an..." does not exclude the presence of additional identical elements in the process, method, article or terminal device comprising the said element.

[0113] The above has introduced in detail a method, system, device and medium for displaying vehicle operations provided by the present application. Specific examples are used herein to elaborate on the principle and implementation manner of the present application. The description of the above embodiments is only for helping to understand the method and its core idea of the present application; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific implementation manner and application scope. In summary, the content of this specification should not be construed as a limitation to the present application.

Claims

1. A method for displaying vehicle operation, characterized in that, The method includes: Determine the owner type of the current driver; When the owner type is a non-default owner, obtain a first point sequence for guiding the basic operation behaviors of the non-default owner; According to the point order in the first point sequence, control the omnidirectional emitter to sequentially rotate to each point in the first point sequence, and emit a visible light beam towards the operation component corresponding to the current point; When rotating to each point, output guiding information corresponding to the current point to guide the basic operation behaviors of the non-default owner.

2. The display method of vehicle operation according to claim 1, characterized in that, The method further includes: Determine whether a target control signal corresponding to the current point is received; When the target control signal is received, control the omnidirectional emitter to rotate to the next point of the current point in the first point sequence; When the target control signal is not received within a preset time period, control the omnidirectional emitter to switch to an enhanced mode to emit a visible light beam towards the operation component corresponding to the current point and output the guiding information corresponding to the current point again.

3. The display method of vehicle operation according to claim 2, characterized in that, Outputting guiding information corresponding to the current point to guide the basic operation behaviors of the non-default owner includes: Determine the reflection distance of the visible light beam towards the operation component corresponding to the current point; Determine the deviation between the calibrated reflection distance corresponding to the current point and the reflection distance, where the calibrated reflection distance is the standard reflection distance when there is no occlusion on the path of the visible light beam towards the operation component corresponding to the current point; According to the deviation, determine whether to output guiding information corresponding to the current point to guide the basic operation behaviors of the non-default owner.

4. The display method of vehicle operation according to claim 3, characterized in that, The determining whether to output guiding information corresponding to the current point to guide the basic operation behaviors of the non-default owner according to the deviation includes: When the deviation meets the first condition, output a prompt message that the operation component corresponding to the current point is occluded; When the deviation meets the second condition, output guiding information corresponding to the current point to guide the basic operation behaviors of the non-default owner; When the deviation meets the third condition, determine that the omnidirectional emitter points to the wrong operation component and terminate subsequent guidance.

5. A method for displaying vehicle operation according to claim 1, characterized in that, Determining the owner type of the current driver includes: Match the first face information of the currently collected driver with each second face information in the first database respectively; When there is second face information in the first database that matches the first face information, determine that the current driver is the default owner; When the first face information does not match any of the second face information in the first database, store the first face information and the corresponding collection time in the second database, and match the first face information with each third face information in the second database respectively, and determine the number of third face information that matches the first face information within a past preset time period; When the number is less than the target threshold, determine that the current driver is a non-default owner.

6. The display method of vehicle operation according to claim 5, wherein The method further includes: When the vehicle owner type is the default vehicle owner or a shutdown instruction sent by the current vehicle owner is received, the guidance function is shut down; Based on the shutdown state of the guidance function, by receiving the virtual key projection signal and the warning signal, control the omnidirectional transmitter to project virtual keys to a specified area of the front-row instrument panel, and project warning information corresponding to the warning signal; Execute a control action corresponding to the virtual key according to the interaction behavior of the user with the virtual key.

7. A method for displaying vehicle operation according to claim 5, characterized in that, The method further includes: According to a guidance instruction received from the current vehicle owner requesting guidance for a target operation behavior, obtain a second point sequence for guiding the target operation behavior of the current vehicle owner; According to the second point sequence, control the omnidirectional transmitter to guide the target operation behavior of the current vehicle owner.

8. The display method of vehicle operation according to claim 7, wherein The method further includes: Pre-calibrate the target mapping relationship between each operation component in the vehicle and the point position, and calibrate the calibrated reflection distance corresponding to each point; Determine an action sequence for guiding the operation behavior of the user; According to the action sequence, determine an operation component sequence corresponding to the action sequence; According to the target mapping relationship and the operation component sequence, create a point sequence for guiding the operation behavior of the user, where the operation behavior of the user includes a basic operation behavior and a target operation behavior; Record the calibrated reflection distance of each point in the point sequence.

9. A display system for vehicle operation, characterized in that, The system includes: A vehicle owner type determination module for determining the vehicle owner type of the current driver seat user; A point sequence acquisition module for obtaining a first point sequence for guiding the basic operation behavior of a non-default vehicle owner when the vehicle owner type is a non-default vehicle owner; A control module for controlling the omnidirectional transmitter to sequentially rotate to each point of the first point sequence according to the point order in the first point sequence, and emit a visible light beam towards the operation component corresponding to the current point; A guidance module for outputting guidance information corresponding to the current point to guide the basic operation behavior of the non-default vehicle owner each time it rotates to a point.

10. An electronic device, characterized in that, Includes: A processor, a memory, and a computer program stored on the memory and running on the processor. When the computer program is executed by the processor, it implements the steps in a method for displaying vehicle operations according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that, A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, it implements the steps in a method for displaying vehicle operations according to any one of claims 1 to 8.

Images