Method, device, electronic device and readable storage medium for displaying vehicle moving information
The vehicle radar and camera are used to determine the need to move the vehicle, and the display mode of the on-board display screen is intelligently controlled, which solves the problem of low personal information security caused by the vehicle moving information sign and improves driving safety and information protection.
Patent Information
- Application Number
- CN202311277329.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-28
- Publication Date
- 2025-09-16
- Estimated Expiration
- 2043-09-28
AI Technical Summary
In the prior art, the display of a vehicle moving information sign results in low personal information security and poses a driving safety hazard.
The vehicle's radar detects whether there are people nearby, wakes up the external camera to capture images to determine the behavior intention, determines the information display mode of the on-board display screen, and controls the display of corresponding vehicle moving information, including directly displaying contact information, displaying contact information after interaction, or not displaying contact information and notifying the contact.
It realizes the intelligent display of vehicle moving information only when needed, protects the driver's personal information, increases the diversity of the ways of providing vehicle moving information, and reduces driving safety risks.
Smart Images

Figure CN117104130B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of automobile technology and provides a method, device, electronic device and readable storage medium for displaying vehicle maneuvering information. Background Art
[0002] During the use of the car, there are often temporary parking situations. In this case, in order to prevent the vehicle from blocking traffic, the driver will place a car moving phone sign so that others can contact the user in time in an emergency.
[0003] However, the telephone sign installed by the driver is placed on the dashboard, which poses a major safety hazard during driving. In addition, the vehicle moving information sign has been placed on the dashboard, and the driver's telephone information has been leaked for a long time, causing the driver to be frequently harassed by phone calls, and the security of personal information is relatively low.
[0004] It can be seen that the related art has a problem in that the display of the car moving information sign leads to low security of personal information. Summary of the Invention
[0005] In view of this, embodiments of the present application provide a method, device, electronic device, and readable storage medium for displaying vehicle moving information to solve the problem in the prior art that the display of vehicle moving information signs results in low security of personal information.
[0006] A first aspect of an embodiment of the present application provides a method for displaying vehicle moving information, comprising:
[0007] The radar installed on the vehicle detects whether there are people within a preset range outside the vehicle;
[0008] If a person is detected, the system will control the vehicle's exterior camera to wake up and use the image captured by the exterior camera to determine the behavior and intention of the person outside the vehicle;
[0009] When the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, determining a target information display mode for the vehicle display screen; wherein the vehicle display screen is disposed on the outside of the vehicle; and the target information display mode is: a first mode in which the contact information of the vehicle contact is directly displayed; a second mode in which the contact information of the vehicle contact is displayed after the need information is exchanged with the person outside the vehicle; or a third mode in which the contact information of the vehicle contact is not displayed after the need information is exchanged with the person outside the vehicle, and the vehicle contact is notified of the need to move the vehicle;
[0010] Control the vehicle display screen to display the vehicle moving information corresponding to the target information display mode.
[0011] A second aspect of an embodiment of the present application provides a device for displaying vehicle moving information, comprising:
[0012] A detection module is used to detect whether there are people within a preset range outside the vehicle through a radar installed on the vehicle;
[0013] The first control module is configured to control the vehicle's exterior camera to wake up if the presence of a person is detected, and determine the behavior intention of the person outside the vehicle through images captured by the exterior camera;
[0014] a determination module for determining a target information display mode for an on-board display screen when the behavioral intention indicates that a person outside the vehicle has a need to move the vehicle; wherein the on-board display screen is disposed on the exterior of the vehicle; and wherein the target information display mode is: a first mode for directly displaying contact information of a vehicle contact; a second mode for displaying the contact information of the vehicle contact after interacting with the person outside the vehicle regarding a need to move the vehicle; or a third mode for not displaying the contact information of the vehicle contact after interacting with the person outside the vehicle regarding a need to move the vehicle and notifying the vehicle contact of the need to move the vehicle;
[0015] The second control module is used to control the vehicle-mounted display screen to display the vehicle moving information corresponding to the target information display mode.
[0016] According to a third aspect of an embodiment of the present application, an electronic device is provided, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of the above method when executing the computer program.
[0017] According to a fourth aspect of an embodiment of the present application, a readable storage medium is provided, which stores a computer program. When the computer program is executed by a processor, the steps of the above method are implemented.
[0018] Compared with the prior art, the embodiments of the present application have the following beneficial effects:
[0019] The radar installed on the vehicle is used to determine whether there are people around the vehicle. If there are people, a control signal is transmitted to the vehicle's external camera to control the camera to capture the people moving around. The behavioral intentions of the people moving around are analyzed based on the captured images to determine whether they have the need to move the vehicle. After determining that there is a need to move the vehicle, the information display mode of the on-board display screen is determined, and the vehicle is controlled to display the corresponding moving vehicle information to the people outside the vehicle who need to move the vehicle through the external display screen according to the determined information display mode. This realizes the intelligent display of moving vehicle information only when needed, protects the driver's personal information as much as possible, and increases the diversity of the ways of providing moving vehicle information, solving the problem of low security of personal information caused by the display of moving vehicle information prompt signs in the existing technology. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0021] Figure 1 1 is a flow chart of a method for displaying vehicle moving information provided in an embodiment of the present application;
[0022] Figure 2 This is a schematic diagram of the interaction between components involved in the method for displaying vehicle moving information provided by an embodiment of the present application;
[0023] Figure 3 This is a schematic structural diagram of a device for displaying vehicle moving information provided by an embodiment of the present application;
[0024] Figure 4 This is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0025] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.
[0026] A method and device for displaying vehicle moving information provided by an embodiment of the present application will be described in detail below with reference to the accompanying drawings.
[0027] Figure 1 FIG. 1 is a flow chart of a method for displaying vehicle moving information provided by an embodiment of the present application. The method can be executed by a controller. Figure 1 As shown, the method for displaying the vehicle moving information includes:
[0028] Step 101: Using a radar installed on the vehicle to detect whether there is a person within a preset range outside the vehicle;
[0029] Specifically, the vehicle may be a variety of types of vehicles, including but not limited to sedans, off-road vehicles, etc.
[0030] The radar can be an ultrasonic radar or a millimeter-wave radar. The radar can detect whether there are objects approaching the vehicle, and judge the shape of the object and its distance from the vehicle in real time, so as to detect whether there are people within a preset range outside the vehicle.
[0031] The preset range refers to a small range around the vehicle. For example, the preset range may be 5 meters. The vehicle radar detects whether there are any active persons within a radius of 5 meters around the vehicle.
[0032] Step 102 : If the presence of a person is detected, the vehicle's exterior camera is controlled to be awakened, and the behavior intention of the person outside the vehicle is determined through the image captured by the exterior camera.
[0033] Specifically, the external camera refers to a camera device that can observe and provide information about the surrounding area of the vehicle, for example, a surround-view camera.
[0034] If a person is detected within a preset range outside the vehicle, the external camera can be woken up to determine the behavioral intentions of the person outside the vehicle.
[0035] The outsider's behavioral intention can include the intention to move the vehicle or the intention not to move the vehicle, which is used to determine whether the outsider needs to move the vehicle. For example, as an example, if the outsider makes a phone call, takes out a phone, or prepares to make a call, it can be confirmed that they have a need to move the vehicle.
[0036] When the vehicle-mounted radar detects the presence of people outside the vehicle, the vehicle is controlled to start the surround-view camera, and the behavioral intentions of the people outside the vehicle are determined through the images outside the vehicle captured by the surround-view camera. Due to the real-time nature of the captured images, the accuracy of the determined behavioral intentions is guaranteed.
[0037] Step 103 : When the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, a target information display mode of the vehicle display screen is determined.
[0038] The vehicle-mounted display screen is arranged on the outside of the vehicle.
[0039] The target information display mode is: the first mode of directly displaying the contact information of the vehicle contact, the second mode or the third mode of displaying the contact information of the vehicle contact after interacting with the person outside the vehicle for demand information, and the third mode is not displaying the contact information of the vehicle contact after interacting with the person outside the vehicle for demand information, and notifying the vehicle contact that there is a need to move the vehicle.
[0040] Specifically, the vehicle-mounted display screen is arranged on the outside of the vehicle, for example, it can be arranged on the B-pillar of the vehicle, or on the A-pillar of the vehicle, or on the trunk lid of the vehicle, which is not specifically limited in this embodiment.
[0041] The target information display mode refers to the mode in which the information is displayed to people outside the vehicle to interact with the vehicle's moving requirements. The driver can select the first mode, the second mode, or the third mode as the target information display mode according to their needs.
[0042] In the first mode, if the behavioral intention indicates that the person outside the vehicle needs to move the vehicle, the vehicle's contact information is directly displayed on the vehicle display, allowing the person outside the vehicle to see the contact information directly on the vehicle display and contact the vehicle contact. It should also be noted that in this first mode, explanations and reassurances can also be displayed. For example, explanations and reassurances can be displayed, such as "I need to stop for a short time due to an emergency" or "We are deeply sorry for the inconvenience caused to you."
[0043] In the second mode, if the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, the need information can be exchanged with the person outside the vehicle through the vehicle display first, and then the vehicle contact person can be displayed. For example, as an example, the vehicle display first displays "Do you need to move the vehicle? If so, please click the OK button on the vehicle display." After the person outside the vehicle clicks the OK button, the vehicle display can display the vehicle contact person, and of course, explanations and reassuring words can also be displayed. In this way, the contact information of the vehicle contact person is displayed after the need information is exchanged, avoiding the situation where the contact information is exposed after the behavioral intention of the person outside the vehicle is misidentified, and to a certain extent, protecting the personal information security of the vehicle contact person.
[0044] In the third mode, when the behavioral intention indicates that the person outside the vehicle has a need to move the car, the need information can be exchanged with the person outside the vehicle through the in-vehicle display screen first, and then the contact person can be directly notified to move the car, without displaying the contact information of the in-vehicle contact on the in-vehicle display screen. For example, as an example, the in-vehicle display screen first displays "Do you need to move the car? If so, please click the OK button on the in-vehicle display screen." After the person outside the vehicle clicks the OK button, the in-vehicle display screen sends a message to the vehicle contact person to notify the person to move the car. Of course, at this time, the in-vehicle display screen may display that the owner has been notified to move the car, please wait patiently. In this way, the contact information of the vehicle contact person is not displayed after the need information is exchanged, but the contact person is directly notified to move the car. When the vehicle contact person does not want to disclose the contact information to others, the contact person can be notified to move the car without leaking the contact information, thereby protecting the security of the personal information of the vehicle contact person to the greatest extent.
[0045] It should be noted that in the third mode, the vehicle can establish an information channel with the vehicle contact's terminal through a telematics service provider (TSP) or a telematics box (T-BOX), thereby sending notification information to the vehicle contact's terminal. After receiving the notification information, the vehicle contact's terminal can continue to issue reminders, and the reminders will not stop until the vehicle contact clicks the OK button, indicating that the vehicle contact has clearly received the information. At the same time, the images of people outside the vehicle captured by the vehicle's external camera will also be transmitted to the vehicle contact's terminal via the T-BOX and TSP, not only reminding the vehicle contact but also presenting the vehicle's surroundings to assist the vehicle contact in determining whether to move the vehicle.
[0046] By determining that someone outside the vehicle needs to move the vehicle, the system interacts with the person outside the vehicle through the on-board display screen and displays information according to the set target information display mode. In this way, the security of the vehicle contact's personal information is improved, the convenience of feedback on vehicle moving information is improved, the anxiety of people outside the vehicle is alleviated, and the problem of low personal information security caused by displaying vehicle moving information through prompt signs is avoided.
[0047] Step 104 : Control the vehicle display screen to display the vehicle moving information corresponding to the target information mode.
[0048] The vehicle moving information may include one or more of the following: contact information of a vehicle contact person, explanation or soothing words, feedback information after sending the vehicle moving information to the vehicle contact person, etc.
[0049] The vehicle display screen is controlled to display the vehicle moving information corresponding to the target information mode, so that the vehicle contacts can be informed of the need to move the vehicle, and the security of the vehicle contacts' personal information is improved, and the emotions of people outside the vehicle are stabilized.
[0050] According to the technical solution provided in the embodiment of the present application, the behavioral intention of the active person is analyzed based on the captured image to determine whether he or she has a need to move the car. After determining that there is a need to move the car, the information display mode of the on-board display screen is determined, and the vehicle is controlled to display the corresponding car moving information to the person outside the vehicle who has a need to move the car through the external display screen according to the determined information display mode. This realizes the intelligent display of car moving information only when needed, protects the driver's personal information as much as possible, and increases the diversity of the ways of providing car moving information, solving the problem of low security of personal information caused by the display of car moving information prompt signs in the existing technology.
[0051] In some embodiments, determining the behavioral intention of a person outside the vehicle through images captured by an external camera includes any of the following:
[0052] First, if it is detected through the image that the distance moved by the person outside the vehicle in the direction of the front bumper of the vehicle is greater than the preset distance, the behavioral intention is determined to be that the person outside the vehicle has a need to move the vehicle.
[0053] Specifically, the preset distance can be set according to actual needs, for example, it can be 1 / 2 of the vehicle width, or 3 / 4 of the vehicle width, etc.
[0054] If the distance moved by the outsider in the direction of the vehicle's front bumper exceeds this preset distance, that is, if the outsider circles the vehicle for more than half a circle, it is determined that the outsider needs to move the vehicle. It should be noted that a circle is from the vehicle's left front fender and front bumper to the right front fender, and half a circle refers to from the left front fender to the center of the front bumper, or from the right front fender to the center of the front bumper, or from the center of the bumper to the left front fender, or from the center of the bumper to the right front fender.
[0055] In this way, since the vehicle moving information sign is usually placed in the front of the vehicle, people outside the vehicle usually tend to check the front of the vehicle when they need to move the vehicle, that is, they may move along the front bumper to check. Based on this, by detecting whether the distance moved by the person outside the vehicle along the front bumper of the vehicle is greater than the preset distance, it is determined whether the person outside the vehicle has a need to move the vehicle, thereby ensuring the accuracy of the determined behavioral intention.
[0056] Secondly, if the image detects that the person outside the vehicle has a gesture of checking the windshield and detects that the person outside the vehicle has a tendency to make a phone call, then the behavioral intention is determined to be that the person outside the vehicle has a need to move the vehicle.
[0057] Specifically, since the vehicle's moving information sign is usually placed on the dashboard, and people outside the vehicle usually take out their phones when approaching the vehicle when they need to move the vehicle, if it is detected that the person outside the vehicle is checking the windshield and is making a phone call, it can be determined that the person outside the vehicle needs to move the vehicle, ensuring the accuracy of the determined behavioral intention.
[0058] According to the technical solution provided in the embodiment of the present application, any of the above methods is used to determine whether a person outside the vehicle has a need to move the vehicle. Since the above method conforms to the conventional operation of viewing vehicle moving information, the accuracy of the determination of the need to move the vehicle by a person outside the vehicle is guaranteed.
[0059] In some embodiments, when the behavioral intention indicates that the person outside the vehicle needs to move the vehicle, the following steps may also be performed:
[0060] Controlling the vehicle's exterior lights to flash continuously for a preset number of times; and,
[0061] The external speaker of the vehicle is controlled to send out a first prompt message, wherein the first prompt message is used to prompt people outside the vehicle to check the vehicle display screen.
[0062] Specifically, the exterior lights may be hazard warning lights. The preset number of times may be 2, 3, etc., which is not specifically limited herein.
[0063] By controlling the vehicle's exterior lights to flash continuously for a preset number of times, people outside the vehicle can clearly see that the vehicle has been informed of its need to move.
[0064] The first prompt message is used to prompt the person outside the vehicle to check the vehicle display screen. For example, the first prompt message may be "If you need to move the vehicle, please move to the left front door of the vehicle to check the information displayed on the vehicle display screen." The first prompt message is sent by voice, so that the person outside the vehicle knows how to contact the vehicle contact.
[0065] For example, when the surround-view camera identifies and determines that a person outside the vehicle needs to move the vehicle, the vehicle's hazard warning lights flash twice, and a voice prompt is issued from the external speaker: "If you need to move the vehicle, please move to the left front door of the vehicle to view the information displayed on the on-board display screen" to prompt the person outside the vehicle to interact with the on-board display screen for subsequent vehicle moving needs.
[0066] According to the technical solution provided in the embodiment of the present application, when the surround-view camera outside the vehicle determines that a person outside the vehicle needs to move the vehicle, the vehicle's hazard warning lights are controlled to flash as a reminder, and the outside speaker is controlled to voice remind the person outside the vehicle to go to the on-board display screen for subsequent interaction steps, thereby guiding the person outside the vehicle through a multi-sensory reminder method, and providing convenient conditions for the subsequent interaction process between the person outside the vehicle and the on-board display screen.
[0067] In some embodiments, when the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, after determining the target information display mode of the vehicle display screen, the method further includes:
[0068] When the target information display mode is the third mode, a vehicle moving notification and a real-time video captured by an external camera are sent to the user terminal of the vehicle contact, wherein the vehicle moving notification is used to notify the vehicle contact to move the vehicle;
[0069] If a response message confirming the vehicle moving is received from the user terminal based on the vehicle moving notification and the real-time video, the vehicle display screen is controlled to display a second prompt message; and if the driver arrives at the vehicle, the vehicle display screen is controlled to display a third prompt message;
[0070] The second prompt information is used to inform the driver of the arrival time, and the third prompt information is used to inform the driver that he has arrived;
[0071] The driver's arrival time is input into the user terminal by the vehicle contact and carried in the response information; alternatively, the driver's arrival time is calculated by the vehicle based on the user terminal and the vehicle's location.
[0072] Specifically, the vehicle moving notification is used to notify the vehicle contact that there is a need to move the vehicle. The form of the vehicle moving notification can be various, including but not limited to a terminal pop-up message, a text message, a vibration ring, or a voice reminder.
[0073] Real-time video refers to the real-time image of the vehicle's surroundings captured by the vehicle's surround-view camera. It is used to determine the behavioral intentions of people outside the vehicle and the vehicle's surrounding environment, such as whether people outside the vehicle are still waiting at the on-board display screen to move the vehicle, etc., providing auxiliary reference for vehicle contacts to determine whether the vehicle needs to be moved.
[0074] After receiving the vehicle moving notification and watching the real-time video, if the vehicle contact determines that the vehicle needs to be moved, he or she can click the button for indicating sending a response message. At this time, the user terminal sends a response message to the vehicle and controls the vehicle display screen to prompt the driver's arrival time.
[0075] In addition, the third prompt information is used to remind people outside the vehicle that the driver has arrived, so as to relieve the anxiety of people outside the vehicle.
[0076] For example, as an example, a vehicle establishes an information channel with a user terminal through T-BOX or TSP. After the vehicle sends a vehicle moving notification to the user terminal, the user terminal reminds that "the vehicle's parking location affects others and others ask you to move the vehicle." The reminder will continue until the vehicle contact clicks the OK button, indicating that the vehicle contact has clearly received this information. At the same time, the images of people outside the vehicle captured by the vehicle's surround-view camera will also be transmitted to the user terminal through T-BOX or TSP. While reminding the vehicle contact, it also presents the vehicle's surrounding environment to assist the vehicle contact in determining whether to move the vehicle.
[0077] When the vehicle contact clicks the "OK" button on the user terminal's reminder interface for moving the vehicle, the vehicle's display screen displays: "The contact has received the vehicle moving notification and is expected to arrive in 3 minutes. Please wait patiently, thank you." The vehicle's estimated arrival time is based on the positioning of the user terminal and the vehicle, combined with the contact's normal walking speed, to instantly calculate the time the vehicle contact will arrive at the vehicle; or the contact can directly fill in the time of his or her arrival at the vehicle on the user terminal. At this time, the user terminal carries the driver's arrival time in the response information and sends it to the vehicle, and the vehicle's display screen displays a countdown to the time.
[0078] When the vehicle contact approaches the vehicle, for example, when the vehicle detects the smart key or terminal Bluetooth key within 20 meters, the vehicle display screen will show "Driver has arrived" to remind the person waiting outside the vehicle to communicate directly with the contact for subsequent vehicle moving matters.
[0079] It should also be noted that when the vehicle detects an unlock command or the smart key automatically unlocks within the automatic unlocking range, the vehicle display screen is controlled to exit the vehicle maneuvering information display function. For example, as an example, when the vehicle detects the smart key or terminal Bluetooth key automatically unlocking within 10 meters, or the user manually unlocks the vehicle, the vehicle maneuvering information display function automatically exits.
[0080] According to the technical solution provided in the embodiments of the present application, in the third mode, the security of the vehicle contact's personal information is enhanced through the interaction between the vehicle contact and the vehicle, and by displaying the driver's arrival time on the vehicle display screen, the emotions of the people waiting outside the vehicle are stabilized, the possibility of disputes between the vehicle contact and the people outside the vehicle who need to move the vehicle is reduced, the process of moving the vehicle is simplified, and convenience is improved.
[0081] In some embodiments, before detecting whether there is a person within a preset range outside the vehicle by using a radar installed on the vehicle, the method further includes:
[0082] When it is detected that the vehicle is in a parking state, detecting whether there is a parking space line at the parking position of the vehicle and obtaining a detection result;
[0083] Interaction information is displayed in accordance with the interaction method corresponding to the detection result, and the interaction information is used to indicate to the driver whether to turn on the display function of the vehicle display screen.
[0084] Specifically, the parking state refers to a state in which the vehicle speed is zero, the gear is in the parking gear, and the engine is stopped.
[0085] Parking space lines refer to the markings that indicate the parking position of a vehicle, which are used to determine whether the vehicle is parked in an accurate and compliant area.
[0086] When detecting whether there are parking space lines at the parking position of the vehicle, the camera can be used to capture an overhead image within a preset range of the vehicle, and then the overhead image can be used to detect whether there are parking space lines within the preset range of the vehicle, and finally detect and analyze whether the parking position of the vehicle contains parking space lines.
[0087] After that, the corresponding subsequent interaction mode is determined according to the detection results. The interaction mode refers to providing different interaction information to the driver according to different detection results. The interaction information is used to guide the driver whether to turn on the display function of the vehicle display screen.
[0088] According to the technical solution provided in the embodiment of the present application, after the vehicle is parked, it is detected whether there is a parking space line at the parking position of the vehicle. The presence or absence of a parking space line corresponds to a different interaction method, and the display interaction information is determined according to the interaction method. The interaction information is used to determine whether the display function of the vehicle display needs to be turned on, which facilitates the user to set the display function of the vehicle display on and off, and improves the user experience.
[0089] In some embodiments, when the detection result indicates that there are no parking space lines at the parking location, interactive information is displayed in an interactive manner corresponding to the detection result, including:
[0090] Controlling the vehicle's central control screen to pop up a fourth prompt message, and controlling the voice assistant to issue a fourth prompt message, wherein the fourth prompt message is used to ask the driver whether to turn on the display function of the vehicle display screen;
[0091] If a driver input instruction to turn on the display function based on the fourth prompt information is received, controlling to turn on the display function of the vehicle display screen, and setting the parking position to turn on the display function of the vehicle display screen by default;
[0092] If a driver input indicating not to turn on the vehicle is received based on the fourth prompt information, a virtual button is displayed on the central control screen, wherein the virtual button is used to control the display function of the vehicle display screen;
[0093] If no information input by the driver based on the fourth prompt information is received within the preset time period, the display function of the vehicle display screen is controlled to be turned on.
[0094] Specifically, when there is no parking space line at the parking location, a fourth prompt message can be issued through a pop-up window and language on the central control screen to ask the driver whether to turn on the display function of the vehicle display screen.
[0095] If the driver inputs information indicating turning on the function, the control turns on the display function of the vehicle display screen, and sets the display function of the vehicle display screen to be turned on by default for the parking position, so that the display function of the vehicle display screen is automatically turned on when the vehicle is parked in the parking position again, simplifying the driver's operation.
[0096] If the driver inputs information indicating that the display function should not be turned on, a virtual button for controlling the display function of the vehicle display screen is displayed. It should be noted that the display time of the virtual button can be a preset time, such as 10 seconds, so that if the driver mistakenly inputs information indicating that the display function should not be turned on, the virtual button can be used to turn the display function of the vehicle display screen back on.
[0097] If the driver does not enter any information within a preset time period, the display function of the vehicle display can be turned on by default, so that others can contact the vehicle contact when they need to move the vehicle.
[0098] For example, when the vehicle speed returns to zero, the vehicle identifies the parking location. If the identification result is no parking space line, the central control screen pops up and the voice assistant prompts the fourth prompt message: "Do you want to turn on the display function of the vehicle display screen?" The pop-up message counts down for 10 seconds, and the camera records the parking environment at the same time;
[0099] If the driver chooses to confirm the start, the display function of the vehicle display screen is turned on. When the vehicle stops at this parking position again, the "display function of the vehicle display screen" is automatically turned on;
[0100] If the driver chooses to cancel the function, the display function of the vehicle display screen will not be turned on. When the vehicle is parked in the same parking position again, no reminder will be given. Only a "quick start button for the intelligent reminder of moving car information" will be provided on the central control screen for the driver to choose.
[0101] When the 10-second countdown of the pop-up message ends and the driver has not clicked to select or answered the voice assistant, the control will automatically turn on the "display function of the vehicle display screen", thereby enhancing the intelligence of the vehicle, simplifying the process of turning on the display function of the vehicle display screen, and improving the user experience of the switch control of the vehicle moving information prompt function.
[0102] In some embodiments, when the detection result indicates that the parking location has parking space lines, interactive information is displayed according to an interactive method corresponding to the detection result, including:
[0103] Displaying virtual buttons on the central control screen, where the virtual buttons are used to control the display function of the vehicle display screen;
[0104] If the driver inputs a confirmation operation for turning on the virtual button, the control turns on the display function of the vehicle display screen, and sets the display function of the vehicle display screen to be turned on by default in the parking position;
[0105] If the driver's confirmation input for the virtual button is not received, the central control screen will no longer display the virtual button by default when the parking position is set.
[0106] Specifically, when the detection result indicates that there is a parking space line at the parking position of the vehicle, the vehicle enables the scene interaction method corresponding to the parking space line. First, a virtual button is displayed on the central control screen so that the driver can choose whether to turn on the display function of the vehicle display screen.
[0107] When the driver's confirmation to start the operation is received, the display function of the on-board display screen is automatically turned on by default when the vehicle parks at this parking position again, and no confirmation inquiry is required, which simplifies the driver's operation process; when the driver's input to confirm the start operation is not received, the vehicle is instructed not to turn on the display function of the on-board display screen when the vehicle parks at this designated parking position again, and no confirmation inquiry is required, so there is no need to display the virtual button.
[0108] It should be noted that when the vehicle's on-board display screen turns on the display function, the vehicle will record the results and learn from them in combination with the parking scenario. At the same time, the Driver Monitoring System (DMS) and the Occupancy Monitoring System (OMS) will record the driver's facial expressions, analyze the driver's emotional response to automatic execution, and continuously learn to improve the accuracy of automatic execution.
[0109] In addition, it should be noted that the vehicle can also learn and memorize the parking space setting operations with parking space lines that the driver frequently parks in, gradually enriching the database and improving the ability of autonomous judgment.
[0110] For example, when parking is completed and the vehicle speed returns to zero, if the vehicle recognizes that there is a parking space line at the parking position, no pop-up window or voice prompt will be displayed, and only a virtual button will be provided on the central control screen for the driver to choose. At the same time, the surround-view camera will record the parking environment at this time; if the driver clicks the start button, when the vehicle is parked in this parking position again, the "display function of the on-board display screen" will be automatically turned on. If the driver does not click the start button, when the vehicle is parked in this parking position again, the virtual button will no longer be displayed on the central control screen, thereby improving the user experience, optimizing the operation process, and enhancing the accuracy of intelligent operation.
[0111] Figure 2 Schematic diagram of the interaction between components involved in the method for displaying vehicle moving information provided in the embodiment of the present application. Figure 2 As shown, the components involved in the method for displaying the vehicle moving information include:
[0112] Ultrasonic radar or millimeter-wave radar is used to determine whether there are any nearby participants approaching the vehicle, and to judge the form of the nearby participants and their distance from the vehicle in real time;
[0113] Surround-view cameras are used to identify nearby participants and determine whether they are human beings. They also analyze their behavior, such as identifying mobile phones and movements of people preparing to make calls, to determine whether they need to move the vehicle.
[0114] The external speaker is used to communicate with people outside the vehicle, notifying them that the vehicle display (in this embodiment, the B-pillar interactive screen is used as an example) is lit and they can go and view it;
[0115] The B-pillar interactive screen is used to display vehicle moving information and interact with people outside the vehicle;
[0116] Voice assistant, used to control the setting, opening and closing of the vehicle moving information prompt function;
[0117] The DMS and OMS systems are used to learn driver operations and feedback, feed back to optimize intelligent control, and continuously meet the driver's personalized needs;
[0118] TSP or T-BOX is used to establish an information and command channel between the vehicle and the owner's application software;
[0119] The car owner application software is set in the user terminal and is used to establish information connection and interactive control with the user;
[0120] Multimedia system, used for playing music and videos, as well as assisting driving, etc.
[0121] The cockpit domain controller (CDC) is used to analyze and process the information sensed by the ultrasonic radar, millimeter-wave radar and surround-view camera, and control the entire vehicle moving information prompt function.
[0122] According to the technical solution provided in the embodiment of the present application, the above components are interconnected. The vehicle can sense the distance and form of the participants around the vehicle through ultrasonic / millimeter wave radar, and distinguish the specific characteristics and behavioral actions of the surrounding participants through the surround-view camera. When it recognizes that someone is approaching and there is a need to move the car, communication and interaction are carried out through the external speakers. The driver can control the use and shutdown of the car moving information function through the multimedia screen. The vehicle exchanges information and operates with people outside the vehicle through the B-pillar interactive screen. The vehicle establishes an information channel with the owner's application software through TSP or T-BOX, transmits the vehicle information to the driver through the owner's application software, and establishes interaction. The vehicle records and learns the driver's decision on how to use the car moving information function in different parking environments through the DMS and OMS systems. The vehicle calculates and decides the above behaviors through CDC, thereby improving the accuracy of determining the need to move the car, enhancing the security of the owner's personal information, and increasing the diversity of ways to provide car moving information.
[0123] All of the above optional technical solutions can be combined in any way to form optional embodiments of the present application, and will not be described in detail here.
[0124] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.
[0125] Figure 3 Schematic diagram of the display device for vehicle moving information provided by the embodiment of the present application. Figure 3 As shown, the display device for the vehicle moving information includes:
[0126] The detection module 301 is configured to detect whether there is a person within a preset range outside the vehicle by using a radar installed on the vehicle;
[0127] The first control module 302 is configured to control the vehicle's exterior camera to wake up if a person is detected, and determine the behavior intention of the person outside the vehicle through images captured by the exterior camera;
[0128] Determination module 303 is configured to determine a target information display mode for an on-board display screen when the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle; the on-board display screen is disposed on the outside of the vehicle; and the target information display mode is: a first mode for directly displaying the contact information of the vehicle contact; a second mode for displaying the contact information of the vehicle contact after interacting with the person outside the vehicle to communicate a need; or a third mode for not displaying the contact information of the vehicle contact after interacting with the person outside the vehicle to communicate a need to move the vehicle, and notifying the vehicle contact of the need to move the vehicle.
[0129] The second control module 304 is used to control the vehicle display screen to display the vehicle moving information corresponding to the target information display mode.
[0130] In some embodiments, the first control module is specifically configured to perform any one of the following:
[0131] If it is detected through the image that the distance moved by the person outside the vehicle in the direction of the front bumper of the vehicle is greater than a preset distance, it is determined that the behavioral intention is that the person outside the vehicle has a need to move the vehicle;
[0132] If the image detects that the person outside the vehicle has a gesture of checking the windshield, and detects that the person outside the vehicle has a tendency to make a phone call, then it is determined that the behavioral intention is that the person outside the vehicle has a need to move the vehicle.
[0133] In some embodiments, when the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, the determination module is also used to control the vehicle's exterior lights to flash continuously for a preset number of times; and control the vehicle's exterior speakers to issue a first prompt message, wherein the first prompt message is used to prompt the person outside the vehicle to check the vehicle display screen.
[0134] In some embodiments, the determination module is also used to, when the target information display mode is the third mode, send a vehicle moving notification and a real-time video captured by the outside camera to the user terminal of the vehicle contact, wherein the vehicle moving notification is used to notify the vehicle contact to move the vehicle; if a response information confirming the vehicle moving is received from the user terminal based on the vehicle moving notification and the real-time video, the vehicle-mounted display screen is controlled to display a second prompt information; and, when it is detected that the driver has arrived at the vehicle, the vehicle-mounted display screen is controlled to display a third prompt information; wherein, the second prompt information is used to prompt the arrival time of the driver, and the third prompt information is used to prompt that the driver has arrived; the time of the driver's arrival is input by the vehicle contact into the user terminal and carried in the response information; or, the time of arrival of the driver of the outside person is calculated by the vehicle based on the position of the user terminal and the vehicle.
[0135] In some embodiments, the detection module is also used to, when it is detected that the vehicle is in a parked state, detect whether there is a parking space line at the parking position of the vehicle to obtain a detection result; and display interaction information in an interaction method corresponding to the detection result, wherein the interaction information is used to indicate whether the driver's operation turns on the display function of the vehicle-mounted display screen.
[0136] In some embodiments, when the detection result indicates that there is no parking space line at the parking location, the detection module is specifically used to control the central control screen of the vehicle to pop up a fourth prompt message, and control the voice assistant to issue the fourth prompt message, wherein the fourth prompt message is used to ask the driver whether to turn on the display function of the vehicle display screen; if the driver receives information indicating to turn on based on the fourth prompt message, the display function of the vehicle display screen is controlled to be turned on, and the display function of the vehicle display screen is set to be turned on by default at the parking location; if the driver receives information indicating not to turn on based on the fourth prompt message, a virtual button is displayed on the central control screen, wherein the virtual button is used to control the display function of the vehicle display screen to be turned on; if the driver does not receive information based on the fourth prompt message within a preset time period, the display function of the vehicle display screen is controlled to be turned on.
[0137] In some embodiments, when the detection result indicates that there is a parking space line at the parking position, the detection module is specifically used to display the virtual button on the central control screen, wherein the virtual button is used to control the activation of the display function of the vehicle display screen; if the driver's confirmation activation operation for the virtual button is received, the display function of the vehicle display screen is controlled to be activated, and the display function of the vehicle display screen is set to be activated by default at the parking position; if the driver's confirmation activation operation for the virtual button is not received, the central control screen is set to no longer display the virtual button by default at the parking position.
[0138] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0139] Figure 4 Schematic diagram of an electronic device provided in an embodiment of the present application. Figure 4 As shown, the electronic device of this embodiment includes: a processor 401, a memory 402, and a computer program 403 stored in the memory 402 and executable by the processor 401. When the processor 401 executes the computer program 403, the steps of the above-described method embodiments are implemented. Alternatively, when the processor 401 executes the computer program 403, the functions of the modules / units in the above-described device embodiments are implemented.
[0140] The electronic device may be a desktop computer, a notebook, a PDA, a cloud server, or other electronic device. The electronic device may include but is not limited to a processor 401 and a memory 402. Those skilled in the art will understand that Figure 4 The electronic device is merely an example and does not limit the electronic device. The electronic device may include more or fewer components than shown in the figure, or different components.
[0141] The processor 401 may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
[0142] Memory 402 can be an internal storage unit of the electronic device, such as a hard disk or memory of the electronic device. Memory 402 can also be an external storage device of the electronic device, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. Memory 402 can also include both an internal storage unit of the electronic device and an external storage device. Memory 402 is used to store computer programs and other programs and data required by the electronic device.
[0143] Those skilled in the art will clearly understand that for the sake of convenience and brevity of description, only the division of the above-mentioned functional units and modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional units and modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.
[0144] If the integrated module / unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium (such as a computer-readable storage medium). Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program can implement the steps of the above-mentioned various method embodiments when executed by the processor. The computer program may include computer program code, which may be in source code form, object code form, executable file or some intermediate form, etc. Computer-readable storage media may include: any entity or device capable of carrying computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium, etc.
[0145] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.
Claims
1. A method for displaying vehicle moving information, characterized in that: include: Detecting whether there is a person within a preset range outside the vehicle by using a radar installed on the vehicle; If the presence of a person is detected, the vehicle's exterior camera is controlled to be awakened, and the behavior intention of the person outside the vehicle is determined through the image captured by the exterior camera; When the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, determining a target information display mode for the vehicle display screen; The vehicle-mounted display screen is arranged on the outside of the vehicle; the target information display mode is: a first mode directly displaying the contact information of the vehicle contact; a second mode or a third mode in which the contact information of the vehicle contact is displayed after the demand information is exchanged with the person outside the vehicle; the third mode is not displaying the contact information of the vehicle contact after the demand information is exchanged with the person outside the vehicle, and notifying the vehicle contact of the need to move the vehicle; Controlling the vehicle-mounted display screen to display the vehicle moving information corresponding to the target information display mode; The image captured by the outside camera is used to determine the behavioral intention of the person outside the vehicle, including any one of the following: if it is detected through the image that the distance moved by the person outside the vehicle in the direction of the front bumper of the vehicle is greater than a preset distance, then the behavioral intention is determined to be that the person outside the vehicle has a need to move the vehicle; if it is detected through the image that the person outside the vehicle has a posture of checking the windshield, and it is detected that the person outside the vehicle has a tendency to make a phone call, then the behavioral intention is determined to be that the person outside the vehicle has a need to move the vehicle.
2. The method for displaying vehicle moving information according to claim 1, characterized in that: In the case where the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, the method further includes: controlling the exterior lights of the vehicle to flash continuously for a preset number of times; and, The external speaker of the vehicle is controlled to send out a first prompt message, wherein the first prompt message is used to prompt the person outside the vehicle to check the vehicle display screen.
3. The method for displaying vehicle moving information according to claim 1, characterized in that: When the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, after determining the target information display mode of the vehicle display screen, the method further includes: When the target information display mode is the third mode, a vehicle moving notification and a real-time video captured by the vehicle exterior camera are sent to the user terminal of the vehicle contact, wherein the vehicle moving notification is used to notify the vehicle contact to move the vehicle; If a response message confirming the vehicle moving is received from the user terminal based on the vehicle moving notification and the real-time video, the vehicle-mounted display screen is controlled to display a second prompt message; and if it is detected that the driver has arrived at the vehicle, the vehicle-mounted display screen is controlled to display a third prompt message; The second prompt information is used to prompt the driver's arrival time, and the third prompt information is used to prompt the driver that he has arrived; The driver's arrival time is input into the user terminal by the vehicle contact and carried in the response information; or, the driver's arrival time is calculated by the vehicle based on the user terminal and the location of the vehicle.
4. The method for displaying vehicle moving information according to claim 1, characterized in that: Before detecting whether there is a person within a preset range outside the vehicle by using a radar installed on the vehicle, the method further includes: When it is detected that the vehicle is in a parking state, detecting whether there is a parking space line at the parking position of the vehicle and obtaining a detection result; Interaction information is displayed according to an interaction method corresponding to the detection result, and the interaction information is used to indicate whether the driver operates to turn on the display function of the vehicle-mounted display screen.
5. The method for displaying vehicle moving information according to claim 4, characterized in that: When the detection result indicates that there is no parking space line at the parking location, The displaying of interaction information according to an interaction mode corresponding to the detection result includes: Controlling the central control screen of the vehicle to display a fourth prompt message in a pop-up window, and controlling the voice assistant to issue the fourth prompt message, wherein the fourth prompt message is used to ask the driver whether to turn on the display function of the vehicle display screen; If information indicating turning on the vehicle is received from the driver based on the fourth prompt information, controlling turning on the display function of the vehicle display screen, and setting the parking position to have the display function of the vehicle display screen turned on by default; If information indicating not to turn on the vehicle display screen is input by the driver based on the fourth prompt information, a virtual button is displayed on the central control screen, wherein the virtual button is used to control the turning on of a display function of the vehicle display screen; If no information input by the driver based on the fourth prompt information is received within a preset time period, the display function of the vehicle-mounted display screen is controlled to be turned on.
6. The method for displaying vehicle moving information according to claim 4, characterized in that: If the detection result indicates that there is a parking space line at the parking location, The displaying of interaction information according to an interaction mode corresponding to the detection result includes: Displaying a virtual button on the central control screen, wherein the virtual button is used to control the display function of the vehicle display screen; If a confirmation operation of the driver inputting the virtual key is received, the display function of the vehicle display screen is controlled to be turned on, and the display function of the vehicle display screen is set to be turned on by default in the parking position; If the driver's confirmation operation for turning on the virtual button is not received, it is set that the central control screen no longer displays the virtual button by default when in the parking position.
7. A display device for vehicle moving information, characterized in that: include: A detection module, configured to detect whether there is a person within a preset range outside the vehicle using a radar installed on the vehicle; A first control module is configured to control waking up an external camera of the vehicle if the presence of a person is detected, and to determine the behavior intention of the person outside the vehicle through images captured by the external camera; Determining the behavioral intention of the person outside the vehicle through the image captured by the external camera includes any of the following: if it is detected through the image that the distance moved by the person outside the vehicle in the direction of the front bumper of the vehicle is greater than a preset distance, then determining that the behavioral intention is that the person outside the vehicle has a need to move the vehicle; if it is detected through the image that the person outside the vehicle has a gesture of checking the front windshield and has a tendency to make a phone call, then determining that the behavioral intention is that the person outside the vehicle has a need to move the vehicle; a determination module, configured to determine, when the behavioral intention indicates that the person outside the vehicle has a need to move the vehicle, a target information display mode of an on-board display screen; wherein the on-board display screen is disposed on the outside of the vehicle; and wherein the target information display mode is: a first mode of directly displaying contact information of a vehicle contact; a second mode of displaying the contact information of the vehicle contact after interacting with the person outside the vehicle regarding a need to move the vehicle; or a third mode of not displaying the contact information of the vehicle contact after interacting with the person outside the vehicle regarding a need to move the vehicle and notifying the vehicle contact of a need to move the vehicle; The second control module is used to control the vehicle-mounted display screen to display the vehicle moving information corresponding to the target information display mode.
8. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.
9. A readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.
Citation Information
Patent Citations
Information processing method and device, storage medium and electronic equipment
CN115145390A
Car moving notification method and device based on car networking system
CN116156067A