Vehicle and display method thereof

Abstract

The present application discloses a vehicle and a display method thereof, which relates to intelligent driving technology. The method can obtain at least one candidate object located in the sight area of ​​the target driver and passenger and outside the vehicle, and project the introduction information of each candidate object onto the target glass pointed to by the sight direction of the target driver and passenger in the vehicle, so that the target driver and passenger can know the relevant information of each candidate object. In this way, the intelligence of the vehicle's cockpit is effectively improved, and the driving experience of the driver and passenger is improved.

Description

Technical Field

[0001] The present application relates to the field of intelligent driving technology, and in particular to a vehicle and a display method thereof. Background Art

[0002] The cockpit of a vehicle is usually equipped with air conditioning and audio, etc. Although the current vehicles support automatic adjustment of seats, air conditioning and audio according to the habits and preferences of the target drivers and passengers, the intelligence of the current vehicle cockpit is still relatively low. Summary of the invention

[0003] The present application provides a vehicle and a display method thereof, which can improve the intelligence of the vehicle's cockpit. The technical solution is as follows:

[0004] In one aspect, a vehicle display method is provided, the method comprising:

[0005] Acquire at least one candidate object that is located within the sight area of ​​the target driver and outside the vehicle;

[0006] The introduction information of each candidate object is projected and displayed on a target glass of the vehicle, where the target glass is the glass to which the sight line of the target driver or passenger in the vehicle points.

[0007] On the other hand, a controller is provided, comprising: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the vehicle display method as described in the above aspects when executing the computer program.

[0008] On the other hand, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the vehicle display method as described in the above aspects is implemented.

[0009] On the other hand, a vehicle is provided, comprising the controller as described in the above aspect.

[0010] The beneficial effects brought about by the technical solution provided by this application may at least include:

[0011] The present application provides a vehicle and a display method thereof, which can obtain at least one candidate object located in the sight area of ​​a target driver and passenger and outside the vehicle, and project the introduction information of each candidate object onto the target glass in the vehicle pointed by the sight direction of the target driver and passenger, so that the target driver and passenger can know the relevant information of each candidate object. In this way, the intelligence of the vehicle's cockpit is effectively improved, and the driving experience of the driver and passenger is improved.

[0012] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a flow chart of a vehicle display method provided in an embodiment of the present application;

[0014] Figure 2 is a flow chart of another vehicle display method provided in an embodiment of the present application;

[0015] Figure 3 is a schematic diagram of a candidate object within the sight area of ​​a target driver or passenger provided in an embodiment of the present application;

[0016] Figure 4 is a schematic diagram of an object of interest of a target driver or passenger provided in an embodiment of the present application;

[0017] Figure 5 is a schematic diagram of a question-and-answer interaction between a vehicle and a target driver and passenger provided in an embodiment of the present application;

[0018] Figure 6 is a schematic diagram of another question-and-answer interaction between a vehicle and a target driver and passenger provided in an embodiment of the present application;

[0019] Figure 7 It is a schematic diagram of projecting and displaying a navigation path on a passenger car window glass provided by an embodiment of the present application;

[0020] Figure 8 It is a structural schematic diagram of a controller provided in an embodiment of the present application. DETAILED DESCRIPTION

[0021] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present application, and should not be construed as limiting the present application.

[0022] The present application embodiment provides a vehicle display method, which is applied to a vehicle, such as a vehicle controller. Figure 1 , the method comprising:

[0023] Step 101: Acquire at least one candidate object that is within the sight area of ​​the target driver and outside the vehicle.

[0024] The visual area refers to the three-dimensional space area that the target driver and passenger can see when the target driver and passenger looks outside the vehicle. The target driver and passenger can be the driver, front passenger, left rear passenger or right rear passenger of the vehicle.

[0025] Each candidate object is an object that the target driver and passengers may see, and each candidate object can be a landmark building, educational facility (such as schools, libraries and gymnasiums, etc.), medical facility (such as hospitals and clinics, etc.), residence (such as residential quarters), commercial facility (such as shopping malls, office buildings, parking lots and banks, etc.), energy facility (such as gas stations, gas stations or charging stations, etc.), transportation facility (such as bridges, airports, bus stops and subway stations, etc.), public activity facility (such as parks), or scenic spot, etc.

[0026] Step 102: Project and display the introduction information of each candidate object on the target glass of the vehicle.

[0027] The vehicle may adopt a head up display (HUD) technology to project and display the introduction information of each candidate object in at least one candidate object on the target glass so that the target driver and passenger can understand the candidate object. The target glass is the glass in the vehicle that the line of sight of the target driver and passenger points to. The introduction information of each candidate object is used to introduce the specific situation of the candidate object.

[0028] In summary, the embodiment of the present application provides a vehicle display method, which can obtain at least one candidate object located in the sight area of ​​the target driver and passenger and outside the vehicle, and project the introduction information of each candidate object onto the target glass in the vehicle pointed by the sight direction of the target driver and passenger, so that the target driver and passenger can know the relevant information of each candidate object. In this way, the intelligence of the vehicle's cockpit is effectively improved, and the driving experience of the driver and passenger is improved.

[0029] Figure 2 Another vehicle display method provided by the embodiment of the present application can be applied to a vehicle. Figure 2 As shown, the method may include:

[0030] Step 201: Acquire at least one candidate object that is within the sight area of ​​the target driver and outside the vehicle.

[0031] After the vehicle is started, at least one candidate object located in the sight area of ​​the target driver and outside the vehicle can be obtained. The sight area refers to the three-dimensional space area that the target driver can see when the target driver looks outside the vehicle. The target driver can be the driver, front passenger, left rear passenger or right rear passenger of the vehicle.

[0032] Each candidate object can be a landmark building, educational facility (such as schools, libraries and gymnasiums), medical facility (such as hospitals and clinics), residence (such as residential areas), commercial facility (such as shopping malls, office buildings, parking lots and banks), energy facility (such as gas stations, gas stations or charging stations), transportation facility (such as bridges, airports, bus stations and subway stations), public activity facility (such as parks), or scenic spot.

[0033] In an embodiment of the present application, the vehicle can determine multiple objects around the vehicle based on an electronic map and the position of the vehicle. Then, the vehicle can determine at least one candidate object located within the line of sight of the target driver and passenger from the multiple objects. The electronic map can be an ordinary map or a high definition map (HD MAP), and the coordinate system of the electronic map is a geodetic coordinate system. The position of the vehicle can be the coordinates of the vehicle in the geodetic coordinate system (i.e., longitude and latitude). The multiple objects around the vehicle can refer to: objects located within a circular area with the vehicle's position as the center and a first target length as the radius. The first target length can be pre-stored by the vehicle.

[0034] It is understandable that before the vehicle determines the candidate object from multiple objects, it can obtain the position of the sight area of ​​the target driver and passenger. Among them, the position of the sight area can be characterized by the sight angle of the target driver and passenger, the visual angle of the target driver and passenger (also known as the viewing angle), and the target position. The sight angle refers to: the angle between the sight direction of the target driver and passenger (i.e., the direction of the sight) and the reference direction. The sight direction is the direction in which the eyes of the target driver and passenger are looking. The reference direction can be parallel to the X-axis of the geodetic coordinate system, and the X-axis can be parallel to the north-south direction of the earth. The visual angle can reflect the size of the spatial range that the target driver and passenger can observe when looking outside the vehicle, and is generally expressed in degrees. The target position is the position of the vehicle or the position of the eyes of the target driver and passenger, for example, it can be the position of the eyes of the target driver and passenger. In this way, the accuracy of the position of the obtained sight area can be ensured to be high, thereby ensuring the accuracy of obtaining at least one candidate object to be high.

[0035] It can also be understood that the position of the target driver's eye can be the position of the center of the target driver's eye in the geodetic coordinate system. The position of the eye in the geodetic coordinate system can be determined by the vehicle based on the position of the center of the eye in the vehicle coordinate system and the conversion relationship between the vehicle coordinate system and the geodetic coordinate system.

[0036] In an optional implementation, the vehicle may obtain the head deflection angle of the target driver and passenger, the attitude angle of the vehicle, and the speed of the vehicle. Then, the vehicle may determine the sight angle of the target driver and passenger based on the head deflection angle and the attitude angle of the vehicle, and may determine the visual angle of the target driver and passenger based on the vehicle speed. The visual angle is negatively correlated with the vehicle speed. Afterwards, the vehicle may obtain the position of the sight area of ​​the target driver and passenger based on the sight angle, the visual angle, and the target position.

[0037] The head deflection angle of the target occupant refers to the rotation range of the head of the target occupant relative to the reference position, and can be used to indicate the orientation of the face of the target occupant. The reference position may be the position of the head when the target occupant is in a relaxed and upright sitting position. The reference position may be pre-stored in the vehicle. The attitude angles of the vehicle may include: pitch angle, roll angle and yaw angle.

[0038] Optionally, the vehicle may pre-store a correspondence between speed and angle. Then, the vehicle may determine the angle corresponding to the vehicle speed in the correspondence as the visual angle of the target driver or passenger.

[0039] Assuming that the target position is the position of the eyes of the target driver and passenger, in another optional implementation, a sight area acquisition model is pre-stored in the vehicle. The vehicle can input the state data of the target driver and passenger and the state data of the vehicle into the sight area acquisition model to obtain the position of the sight area of ​​the target driver and passenger output by the sight area acquisition model.

[0040] The driver's status data may include: the head deflection angle and the position of the target driver's eyes, and the vehicle's status data may include: the vehicle's attitude angle and vehicle speed.

[0041] It should be understood that before the state data of the target driver and the state data of the vehicle are combined, the vehicle can obtain multiple training data and perform model training on the multiple training data to obtain a line of sight area acquisition model. Each training data may include: sample state data of the vehicle, sample state data of the target driver and the sample position of the line of sight area of ​​the target driver under the sample state data of the vehicle and the sample state data of the target driver.

[0042] In an embodiment of the present application, the vehicle may include: a camera and a body sensor. The vehicle may obtain the head deflection angle of the target driver or occupant through the camera. Furthermore, the vehicle may identify the face of the target driver or occupant through the camera, and then obtain the position of the center of the eyes of the target driver or occupant in the vehicle coordinate system, and obtain the position of the eyes of the target driver or occupant in the geodetic coordinate system based on the conversion relationship between the vehicle coordinate system and the geodetic coordinate system. The vehicle may obtain the vehicle speed and the attitude angle of the vehicle through the body sensor. Among them, the origin O of the vehicle coordinate system may be a point of the vehicle (such as the center point), the positive direction of the X-axis may be parallel to the length direction of the vehicle, the positive direction of the Y-axis may be parallel to the width direction of the vehicle, and the Z-axis is perpendicular to the XOY plane.

[0043] In an embodiment of the present application, the process of the vehicle determining at least one candidate object located in the sight area of ​​the target driver or passenger from multiple objects may include: the vehicle directly determines each object located in the sight area from the multiple objects as a candidate object; or, the vehicle first obtains multiple initial objects located in the sight area from the multiple objects, and then selects at least one candidate object from the multiple initial objects. The number of at least one candidate object may be less than or equal to a preset value, which is less than the total number of the multiple initial objects. The preset value may be pre-stored before the vehicle leaves the factory, or may be customized by the driver or passenger.

[0044] Optionally, the vehicle can randomly select at least one candidate object from multiple initial objects. Alternatively, the vehicle can use each of the preset value initial objects with higher probability among the multiple initial objects as a candidate object. The probability is the probability that the initial object is a reference object, and the reference object is the object where the line of sight of the target driver and passenger falls. For example, the vehicle can obtain the distance from each initial object to the line of sight of the target driver and passenger, and determine the probability that the initial object is a reference object based on the distance. Afterwards, the vehicle can determine each of the initial objects among the preset threshold initial objects with higher probability among the multiple initial objects as a candidate object.

[0045] The probability is negatively correlated with the distance. That is, the greater the distance, the smaller the probability that the candidate object is the reference object. The smaller the distance, the greater the probability that the candidate object is the reference object.

[0046] It should be understood that the method of first acquiring multiple initial objects and then selecting at least one candidate object from the multiple initial objects can be applicable to scenarios where the number of initial objects is large and the area of ​​the target glass used to display the introduction information of the candidate objects is limited.

[0047] Optionally, the vehicle has a tracking projection function. After the vehicle is started, it can detect whether the tracking projection function is enabled. If the vehicle determines that the tracking projection function is enabled, the above step 201 can be performed. If the vehicle determines that the tracking projection function is enabled, it can continue to detect whether the tracking projection function is enabled.

[0048] It is understandable that if the target driver or passenger requires the vehicle to project the introduction information of the candidate object on the vehicle glass, the vehicle can be controlled to turn on the tracking projection function. Afterwards, if the target driver or passenger does not need the vehicle to project the introduction information of the candidate object on the target glass, the vehicle can be controlled to turn off the tracking projection function.

[0049] It is understandable that the number of the target driver and passenger may be one or more. When the number of the target driver and passenger is multiple, for each target driver and passenger, the vehicle may obtain a candidate object that is within the sight area of ​​the target driver and passenger.

[0050] Step 202: Project and display the introduction information of each candidate object on the target glass of the vehicle.

[0051] In an embodiment of the present application, the vehicle may use HUD technology to display the introduction information of each alternative object in at least one alternative object on the target glass so that the target driver and passenger can understand the alternative object. Among them, the target glass is the glass to which the line of sight of the target driver and passenger in the vehicle is directed. For example, if the target driver and passenger is a front passenger passenger, and the front passenger passenger looks out of the vehicle from the front passenger window glass, the target glass is the front passenger window glass to which the line of sight of the front passenger passenger is directed. If the target driver and passenger is a left rear passenger, and the target driver and passenger looks out of the vehicle from the left rear window glass, the target glass is the left rear window glass to which the line of sight of the left rear passenger is directed. If the target driver and passenger is a driver, and the driver looks out of the vehicle from the front windshield, the target glass is the front windshield.

[0052] The introduction information of each candidate object is used to introduce the specific situation of the candidate object. The introduction information may include: basic information and operation information of the candidate object. The basic information may at least include: the icon and name of the candidate object. The operation information may at least include: operation time. For example, if the candidate object is a landmark building, scenic spot or park, the introduction information may also include: the historical background, cultural background and characteristics of the candidate object. If the candidate object involves consumption, the operation information of the candidate object may also include: some related consumption information and traffic information. Such as the ticket price and traffic volume of scenic spots and parks, the current oil price of gas stations, and parking lot charges, etc.

[0053] Optionally, the icon of the candidate object may be a two-dimensional image or a three-dimensional image of the candidate object. The two-dimensional image may be a photo of the candidate object. The three-dimensional image may be a three-dimensional outline model of the candidate object.

[0054] In an embodiment of the present application, the vehicle may project and display the introduction information of each candidate object in the entire area of ​​the target glass. Alternatively, the vehicle may project and display the introduction information of each candidate object in the projection area of ​​the target glass. The area of ​​the projection area is smaller than the area of ​​the target glass. The center point of the projection area may be the intersection of the sight line direction of the target driver and the target glass.

[0055] Optionally, the projection area may be a rectangular area, a polygonal area or a circular area. For example, the projection area may be a circular area with the intersection as the center and the second target length as the radius. The second target length may be pre-stored by the vehicle.

[0056] In an embodiment of the present application, when there are multiple candidate objects, the introduction information of the multiple candidate objects displayed in the target glass can be arranged in order. For example, the introduction information of the multiple candidate objects can be arranged in order of the probability of the multiple candidate objects. For example, the introduction information of the multiple candidate objects can be arranged in order from large to small according to the probability of the multiple candidate objects. In this way, the driving experience of the target driver and passenger can be effectively improved.

[0057] The probability of each candidate object refers to the probability that the candidate object is the reference object.

[0058] Step 203: If a selection operation for introduction information of a target object among multiple candidate objects is received, the target object is determined as an object of interest to the target driver or passenger.

[0059] In the case where there are multiple candidate objects, the target driver or passenger can select an object of interest from the multiple candidate objects displayed on the target glass according to his or her own intention. Accordingly, the vehicle can determine the target object as the target driver or passenger's object of interest in response to the target driver or passenger's selection operation on the introduction information of the target object among the multiple candidate objects. That is, the vehicle can select the target driver or passenger's object of interest based on the target driver or passenger's selection operation.

[0060] Optionally, the selection operation may be a voice selection operation, such as "select the first one". In this case, a sound collection device may be installed in the vehicle. Alternatively, the selection operation may be a touch operation for the introduction information of the target object. In this case, a touch film layer may be provided in the target glass. The embodiment of the present application does not limit the type of the selection operation.

[0061] In the embodiment of the present application, if the vehicle receives a selection operation for the introduction information of a target object among multiple candidate objects before the display time of the introduction information of each candidate object reaches the target time, the target object can be determined as an object of interest. If the vehicle has not received a selection operation for the target object among multiple candidate objects after the display time reaches the target time, step 201 can be re-executed. The target time can be pre-stored by the vehicle, for example, 10 seconds (s).

[0062] It should be understood that if the number of at least one candidate object is one, and the target object is an object of interest to the target driver or passenger, the target driver or passenger may directly select the candidate object.

[0063] Step 204: In response to the voice interaction request for the object of interest, the response data of the voice interaction request is switched and displayed in the target glass.

[0064] After selecting the object of interest, the target driver and passenger can interact with the vehicle based on their own intentions to obtain detailed information about the object of interest. Specifically, the target driver and passenger can issue a voice interaction request. The vehicle can collect the voice interaction request through the sound collection component, and in response to the voice interaction request, switch to display the response data of the voice interaction request in the target glass.

[0065] The voice interaction request is used to request to obtain the detail information of interest, and the response data is the detail information. Switching to display the response data of the voice interaction request means: displaying the response data and canceling the content displayed before displaying the response data.

[0066] In an embodiment of the present application, the cockpit of the vehicle may include: multiple sound zones, each sound zone corresponding to a physical space in the cockpit. The multiple sound zones may include: a main driver's sound zone, a co-driver's sound zone, a first rear row sound zone (also referred to as a left rear row sound zone) and a second rear row sound zone (also referred to as a right rear row sound zone). Moreover, for the target glass pointed to by the line of sight of the target driver or passenger, the vehicle generally updates the content displayed on the target glass based on the voice interaction request issued by the target driver or passenger, and does not update the content displayed on the target glass based on the voice interaction request issued by the non-target driver or passenger. In this way, it can be avoided that the response data displayed on the target glass is not the data that the target driver or passenger expects to obtain, thereby effectively improving the driving experience of the target driver or passenger.

[0067] Based on this, after receiving a voice interaction request for an object of interest, the vehicle can locate the sound source position of the voice interaction request to determine the sound zone where the sound source position is located. Then, if the vehicle determines that the sound zone is the sound zone where the target driver and passenger are located, it can be determined that the voice interaction request is issued by the target driver and passenger, and then the voice interaction request can be responded to to switch and display the response data of the voice interaction request on the target glass. If the vehicle determines that the sound zone is not the sound zone where the target driver and passenger are located, it can be determined that the voice interaction request is not issued by the target driver and passenger, and then it can be determined that there is no need to update the content displayed on the target glass based on the voice interaction request.

[0068] It can be seen that the vehicle provided in the embodiment of the present application can use sound source localization technology based on the intelligent voice zoning (i.e., sound zone) of the cockpit to determine the sound zone where the driver or passenger who issues a voice interaction request is located, and then determine whether the driver or passenger is the target driver or passenger based on the sound zone.

[0069] It is understandable that the vehicle is also equipped with a speaker and can support intelligent voice Q&A. After the vehicle receives a voice interaction request for an object of interest, it can also confirm and respond to the target through intelligent voice intelligent Q&A. Specifically, the vehicle can confirm the type of object of interest (such as a park, gas station or bank, etc.) and inform the target driver and passengers that the relevant detailed information has been projected on the target vehicle glass.

[0070] Step 205: In response to the navigation instruction for the object of interest, generate a navigation path to the location of the object of interest.

[0071] If the target driver needs to go to the location of the object of interest, a navigation instruction for the object of interest can be issued. Correspondingly, after receiving the navigation instruction, the vehicle can generate a navigation path to the location of the object of interest in response to the navigation instruction.

[0072] Optionally, the navigation instruction may be a voice instruction. Alternatively, a navigation control may be displayed on the target glass. The navigation instruction may be triggered by a touch operation on the navigation control.

[0073] Step 206: Project and display the navigation path on the target glass.

[0074] After the vehicle generates a navigation path to the location of the object of interest, it can also project and display the navigation path on the target glass for the target driver and passengers to view.

[0075] In addition, if the vehicle is an autonomous vehicle, after the navigation path is generated, the vehicle can automatically drive to the location of the object of interest according to the navigation path. If the vehicle is not an autonomous vehicle, after the navigation path is generated, the vehicle can display the navigation path (such as displaying the navigation path on the central control screen) and broadcast the navigation guidance voice based on the navigation path, so that the driver can control the vehicle to drive to the location of the object of interest based on the navigation guidance voice.

[0076] The following is an exemplary description of the method provided in the embodiment of the present application with reference to the accompanying drawings:

[0077] During the driving process of the vehicle, the driver and passengers will often pay attention to some objects (such as iconic buildings), and their sight will stay on the objects they are interested in. At this time, the vehicle can identify the driver's head deflection angle, combined with the vehicle's attitude angle and speed to determine the driver's sight area. Then, based on the current position of the vehicle, the vehicle can use the high-precision map to finely locate the environment around the vehicle to obtain at least one candidate object that appears in the driver's sight area.

[0078] For example, see Figure 3 and Figure 4 The sight area of ​​the left rear passenger of the vehicle is area S1, and at least one candidate object in area S1 includes: a parking lot and a gas station. The sight area of ​​the front passenger of the vehicle is area S2, and at least one candidate object in area S2 includes: a parking lot and a park.

[0079] from Figure 4 It can be seen that the left rear passenger's head is leaning towards the left rear window glass, and looking out of the vehicle through the left rear window glass. The front passenger's head is leaning towards the front passenger's window glass, and looking out of the vehicle through the front passenger's window glass. Therefore, the vehicle can project and display the introduction information of at least one candidate object in area S1 in the projection area of ​​the left rear window glass, and project and display the introduction information of at least one candidate object in area S2 in the projection area of ​​the front passenger's window glass.

[0080] In addition, see Figure 3 , the sight direction of the left rear passenger (i.e. the direction of the arrow in area S1) points to the gas station (i.e. the left rear passenger looks at the gas station), and the sight direction of the front passenger (i.e. the direction of the arrow in area S2) points to the parking lot. Therefore, if the introduction information of the candidate objects is displayed in descending order of probability, the introduction information of the gas station can be displayed above the introduction information of the parking lot in the left rear window glass, that is, the introduction information of the gas station is displayed on the side close to the roof, and the introduction information of the parking lot is displayed on the side away from the roof. Similarly, on the front passenger window glass, the introduction information of the parking lot can be displayed above the introduction information of the park.

[0081] After that, suppose the vehicle determines that the object of interest of the left rear passenger is the gas station based on the selection operation of the left rear passenger, and determines that the object of interest of the front passenger is the park based on the selection operation of the front passenger. Suppose the left rear passenger sends a voice interaction request for the gas station, "Hello, Xiaodi, is this a gas station ahead? How much is the gas price?", then refer to Figure 5 , the vehicle (such as the vehicle's computer) can feedback the following information to the left rear passenger: "Hello, left rear passenger, the xx gas station is in front. The specific oil price information of the gas station has been projected onto the left rear window glass for you, please refer to it."

[0082] Assume that the passenger in the front passenger seat issues a voice interaction request for the park, "Hello, Xiaodi, what attraction is ahead?" Figure 6 , the vehicle can feedback the following information to the front passenger: "Hello, front passenger, there is xx Park in front. The free opening hours of the park are xxx. The relevant information has been projected onto the front passenger window for you, please refer to it."

[0083] Assuming the passenger wants to go to xx Park, please continue to refer to Figure 6 , the front passenger can issue a voice navigation command "Navigate to the park ahead". At this time, the vehicle can reply to the front passenger "Received, the best route has been planned for you". Also, please refer to Figure 7 The vehicle can also project the navigation route D to xx Park on the passenger seat window.

[0084] According to the above description, the method provided in the embodiment of the present application can be applied to the following scenarios:

[0085] Scenario 1: During the driving of the vehicle, the driver and passengers need to obtain introduction information about the objects they can see nearby to meet their sightseeing needs.

[0086] Scenario 2: During driving, for buildings that the driver and passengers temporarily see and want to go to, it is impossible to quickly determine the relevant information of the building and navigate. For example, while driving, the driver sees a charging station in front of him. Because the vehicle is running out of power, it needs to be charged. At this time, the driver looks at the charging station and says, "Is this a charging station? Is it open now?" The vehicle can respond with "Is it a charging station? Is it open?" and other information, and can project price information onto the front windshield. After that, if the driver says "Navigate here", the vehicle can generate a navigation path and display the navigation path on the central control screen.

[0087] It is understandable that the order of the steps of the vehicle display method provided in the embodiment of the present application can be appropriately adjusted, and the steps can also be increased or decreased accordingly according to the situation. For example, step 204 can be deleted according to the situation; or, step 205 and step 206 can be deleted according to the situation; or, step 203 to step 206 can be deleted according to the situation. Any technician familiar with the technical field can easily think of a method of change within the technical scope disclosed in this application, which should be covered within the scope of protection of this application, so it will not be repeated.

[0088] In summary, the embodiment of the present application provides a vehicle display method, which can obtain at least one candidate object located in the sight area of ​​the target driver and passenger and outside the vehicle, and project the introduction information of each candidate object onto the target glass in the vehicle pointed by the sight direction of the target driver and passenger, so that the target driver and passenger can know the relevant information of each candidate object. In this way, the intelligence of the vehicle's cockpit is effectively improved, and the driving experience of the driver and passenger is improved.

[0089] The present application embodiment provides a controller, see Figure 8 , the controller 300 may include: a processor 301. The processor 301 is used to:

[0090] Acquire at least one candidate object that is located within the sight area of ​​the target driver and outside the vehicle;

[0091] The introduction information of each candidate object is projected and displayed on the target glass of the vehicle, and the target glass is the glass pointed to by the sight direction of the target driver and passenger in the vehicle.

[0092] Optionally, the processor 301 may be configured to:

[0093] Determine multiple objects around the vehicle based on the electronic map and the location of the vehicle;

[0094] At least one candidate object located in the sight area of ​​the target driver or passenger is determined from the plurality of objects.

[0095] Optionally, the processor 301 may also be used for:

[0096] Before determining at least one candidate object located in the sight area of ​​the target driver from among the multiple objects, obtaining a head deflection angle of the target driver, a posture angle of the vehicle, and a vehicle speed of the vehicle;

[0097] Based on the head deflection angle and posture angle, the sight angle of the target driver and passenger is determined, and the visual angle of the target driver and passenger is determined based on the vehicle speed. The visual angle is negatively correlated with the vehicle speed.

[0098] Based on the sight angle, the visual angle and the target position, the position of the sight area is obtained;

[0099] The target position is the position of the vehicle, or the position of the eyes of the target driver or passenger.

[0100] Optionally, when there are multiple candidate objects, information of the multiple candidate objects displayed on the target glass is arranged in order of probability of the multiple candidate objects;

[0101] The probability of each candidate object refers to the probability that the candidate object is a reference object, which is the object where the sight line of the target driver and passenger is located.

[0102] Optionally, the processor 301 may also be used for:

[0103] After the introduction information of each candidate object is projected and displayed on the target glass of the vehicle, if there are multiple candidate objects, and a selection instruction for the introduction information of a target object among the multiple candidate objects is received, the target object is determined as the object of interest to the target driver or passenger.

[0104] Optionally, the processor 301 may be configured to:

[0105] If a selection instruction for introduction information of a target object among the candidate objects is received before the display duration of introduction information of each candidate object reaches the target duration, the target object is determined as an object of interest to the target driver or passenger.

[0106] Optionally, the processor 301 may also be used for:

[0107] In response to the voice interaction request for the object of interest, the response data of the voice interaction request is switched and displayed in the target glass.

[0108] Optionally, the processor 301 may also be used for:

[0109] If a navigation instruction for the object of interest is received, a navigation path to the location of the object of interest is generated;

[0110] The navigation path is projected onto the target glass.

[0111] Optionally, the processor 301 may also be used for:

[0112] If the sight-tracking projection function of the vehicle is enabled, at least one candidate object located within the sight area of ​​the target driver and passenger and outside the vehicle is obtained.

[0113] In summary, the embodiment of the present application provides a controller that can obtain at least one candidate object that is located in the sight area of ​​the target driver and passenger and outside the vehicle, and project the introduction information of each candidate object onto the target glass in the vehicle that the target driver and passenger's sight direction points to, so that the target driver and passenger can learn about the relevant information of each candidate object. In this way, the intelligence of the vehicle's cockpit is effectively improved, and the driving experience of the driver and passenger is improved.

[0114] Please continue to see Figure 8 The controller 300 includes a memory 303 . The processor 301 and the memory 303 are connected, for example, via a bus 302 .

[0115] The processor 301 may be a CPU (Central Processing Unit), a general-purpose processor, a DSP (Digital Signal Processor), an ASIC (Application Specific Integrated Circuit), an FPGA (Field Programmable Gate Array) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It may implement or execute various exemplary logic blocks, modules and circuits described in conjunction with the disclosure of this application. The processor 301 may also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc.

[0116] The bus 302 may include a path to transmit information between the above components. The bus 302 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The bus 302 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one thick line is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0117] The memory 303 is used to store a computer program corresponding to the vehicle display method of the above embodiment of the present application, and the computer program is controlled and executed by the processor 301. The processor 301 is used to execute the computer program stored in the memory 303 to implement the content shown in the above method embodiment.

[0118] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the vehicle display method provided in the above method embodiment is implemented.

[0119] An embodiment of the present application provides a vehicle, which includes a controller provided by the above-mentioned device embodiment.

[0120] It should be noted that the logic and / or steps represented in the flowchart or described in other ways herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or equipment (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or equipment and execute instructions), or in combination with these instruction execution systems, devices or equipment. For the purpose of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or equipment, or in combination with these instruction execution systems, devices or equipment. More specific examples (non-exhaustive list) of computer-readable media include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and editable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0121] It should be understood that the various parts of the present application can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0122] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0123] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0124] In this application, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0125] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A vehicle display method, characterized in that: The method comprises: Acquire at least one candidate object that is located within the sight area of ​​the target driver and outside the vehicle; Projecting and displaying the introduction information of each candidate object on a target glass of the vehicle, the target glass being the glass in the vehicle to which the sight line of the target driver or passenger is directed; Acquiring at least one candidate object located in a sight area of ​​a target driver and passenger and outside the vehicle, comprising: Determining a plurality of objects around the vehicle based on the electronic map and the position of the vehicle; Determining at least one candidate object located within the sight area of ​​the target driver and passenger from the plurality of objects; Before determining at least one candidate object located in the sight area of ​​the target driver or passenger from the plurality of objects, the method further includes: Acquiring the head deflection angle of the target driver, the attitude angle of the vehicle, and the speed of the vehicle; Determining a sight line angle of the target driver and passenger based on the head deflection angle and the posture angle, and determining a visual angle of the target driver and passenger based on the vehicle speed, wherein the visual angle is negatively correlated with the vehicle speed; Based on the sight line angle, the visual angle and the target position, obtaining the position of the sight line area; Wherein, the target position is the position of the vehicle, or the position of the eyes of the target driver or passenger; In the case where there are multiple candidate objects, the distance between each candidate object and the sight line of the target driver and passenger is obtained, and the probability that the candidate object is the reference object is determined based on the distance, and the probability is negatively correlated with the distance; the information of the multiple candidate objects displayed on the target glass is arranged in the order of the probability of the multiple candidate objects; The probability of each candidate object refers to the probability that the candidate object is a reference object, where the reference object is the object where the sight line of the target driver and passenger is located; After projecting and displaying the introduction information of each candidate object on the target glass of the vehicle, the method further includes: In the case where there are multiple candidate objects, if a selection instruction for introduction information of a target object among the multiple candidate objects is received, the target object is determined as an object of interest to the target driver or passenger; The method also includes: in response to a voice interaction request for the object of interest, switching and displaying response data of the voice interaction request in the target glass, including: receiving a voice interaction request for the object of interest, locating the sound source position of the voice interaction request to determine the sound zone where the sound source position is located, and if it is determined that the sound zone is the sound zone where the target driver and passenger are located, switching and displaying the response data of the voice interaction request on the target glass; if it is determined that the sound zone is not the sound zone where the target driver and passenger are located, there is no need to update the content displayed on the target glass based on the voice interaction request.

2. The method according to claim 1, characterized in that If a selection instruction for introduction information of a target object among the candidate objects is received, determining the target object as an object of interest to the target driver or passenger includes: If a selection instruction for introduction information of a target object among the candidate objects is received before the display duration of introduction information of each candidate object reaches the target duration, the target object is determined as an object of interest to the target driver or passenger.

3. The method according to claim 1, characterized in that The method further comprises: If a navigation instruction for the object of interest is received, generating a navigation path to the location of the object of interest; The navigation path is projected and displayed on the target glass.

4. The method according to claim 1, characterized in that: Acquiring at least one candidate object located in a sight area of ​​a target driver and passenger and outside the vehicle, comprising: If the sight-tracking projection function of the vehicle is enabled, at least one candidate object located within the sight area of ​​the target driver and passenger and outside the vehicle is acquired.

5. A controller, characterized in that: The controller comprises: a memory, a processor and a computer program stored in the memory and executable on the processor, and the processor implements the method according to any one of claims 1 to 4 when executing the computer program.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 4 is implemented.

7. A vehicle, characterized in that: The vehicle comprises a controller as claimed in claim 5.

Images