Information display method, device, medium and program product for unmanned vehicle

Abstract

The present disclosure provides a method, device, medium, and program product for displaying information on an unmanned vehicle, relating to the fields of intelligent transportation technology and unmanned driving technology. One embodiment of the method includes: obtaining information to be displayed on the unmanned vehicle; determining display information for a display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle; the display information includes: a display area, the display area being used to represent the display area of ​​the information to be displayed on the interface and the illuminated area of ​​the light strip; and displaying the information to be displayed using the display area and the illuminated area of ​​the interface, respectively.

Description

Technical Field

[0001] The present disclosure relates to the field of computers, specifically to the fields of intelligent transportation technology and unmanned driving technology, and in particular to a method, device, medium, and program product for displaying information of an unmanned vehicle. Background Art

[0002] Currently, the information display on driverless vehicles is at the research stage, and the traditional text display on the passenger interface cannot meet the needs. Summary of the Invention

[0003] The embodiments of the present disclosure provide a method, device, medium, and program product for displaying information of an unmanned vehicle.

[0004] In the first aspect, an embodiment of the present disclosure proposes a method for displaying information of an unmanned vehicle, including: obtaining information to be displayed of the unmanned vehicle; determining display information of a display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle, and the display information includes: a display area, the display area is used to represent the display area of ​​the information to be displayed in the interface and the lit area in the light strip respectively; the information to be displayed is displayed respectively through the display area and the lit area in the interface.

[0005] In the second aspect, an embodiment of the present disclosure proposes an information display device for an unmanned vehicle, comprising: an information acquisition module, configured to acquire information to be displayed of the unmanned vehicle; an information determination module, configured to determine display information of a display device based on the information to be displayed, wherein the display device comprises: an interface of the unmanned vehicle and a light strip of the unmanned vehicle, and the display information comprises: a display area, the display area being used to represent the display area of ​​the information to be displayed in the interface and the lit area in the light strip, respectively; the information display module being configured to display the information to be displayed through the display area and the lit area in the interface, respectively.

[0006] In a third aspect, an embodiment of the present disclosure proposes an electronic device comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to execute the method described in the first aspect.

[0007] In a fourth aspect, an embodiment of the present disclosure proposes a non-transitory computer-readable storage medium storing computer instructions, where the computer instructions are used to enable a computer to execute the method described in the first aspect.

[0008] In a fifth aspect, an embodiment of the present disclosure proposes a computer program product, including a computer program, which implements the method described in the first aspect when executed by a processor.

[0009] In a sixth aspect, an embodiment of the present disclosure proposes an unmanned vehicle, including the unmanned vehicle described in the third aspect.

[0010] The information display method, device, medium and program product for an unmanned vehicle provided by the embodiments of the present disclosure determine the display information of the display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle, and the display information includes: a display area, and the display area is used to represent the display area of ​​the information to be displayed in the interface and the lit area in the light strip respectively; then the information to be displayed is displayed respectively through the display area and the lit area in the interface, and the information to be displayed can be displayed in the cockpit of a fully unmanned automatic driving vehicle through the lit area of ​​the light strip and / or the display area in the interface of the unmanned vehicle, which can solve the problem that the text display prompts on the traditional screen interface are not intuitive and vivid, and the prompt information is too single, and at the same time, it brings certainty and a sense of security to the passengers.

[0011] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Other features, objects, and advantages of the present disclosure will become more apparent upon reading the detailed description of the non-limiting embodiments made with reference to the following drawings. The drawings are provided for a better understanding of the present disclosure and do not constitute a limitation of the present disclosure. Among them:

[0013] Figure 1 is an exemplary system architecture diagram in which the present disclosure may be applied;

[0014] Figure 2 is a flow chart of an embodiment of a method for displaying information of an unmanned vehicle according to the present disclosure;

[0015] Figure 3 This is a schematic diagram of the light strip;

[0016] Figure 4 It is a schematic diagram of the interface showing the information to be displayed;

[0017] Figure 5 This is the lit area of ​​the light strip that displays the itinerary information.

[0018] Figure 6 This is the lighting area corresponding to the vehicle control information displayed on the light strip;

[0019] Figure 7 This is the lighting area corresponding to the recommended information displayed on the light strip;

[0020] Figure 8is a schematic diagram of an embodiment of an information display device for an unmanned vehicle according to the present disclosure;

[0021] Figure 9 is a block diagram of an electronic device for implementing an embodiment of the present disclosure. DETAILED DESCRIPTION

[0022] The following description of exemplary embodiments of the present disclosure is made in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding. These details should be considered as merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0023] It should be noted that, in the absence of conflict, the embodiments and features of the embodiments in the present disclosure may be combined with each other. The present disclosure will be described in detail below with reference to the accompanying drawings and in combination with the embodiments.

[0024] Figure 1 An exemplary system architecture 100 is shown to which an embodiment of the method and apparatus for displaying information of an unmanned vehicle of the present disclosure may be applied.

[0025] like Figure 1 As shown, the system architecture 100 may include an onboard terminal 101 corresponding to the unmanned vehicle, a network 102 and a server 103. Figure 1 In the example, a vehicle terminal corresponding to an unmanned vehicle is used. Network 102 is used to provide a communication link between the vehicle terminal 101 corresponding to the unmanned vehicle and server 103. Network 102 can include various connection types, such as wired or wireless communication links or fiber optic cables.

[0026] The vehicle-mounted terminal 101 corresponding to the unmanned vehicle can be hardware or software. When the vehicle-mounted terminal 101 corresponding to the unmanned vehicle is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the vehicle-mounted terminal 101 corresponding to the unmanned vehicle is software, it can be implemented as multiple software or software modules (for example, for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0027] Server 103 can provide various services. For example, server 103 can obtain information to be displayed on the unmanned vehicle; determine display information for a display device based on the information to be displayed, where the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle; and display information includes: a display area, which is used to represent the display area of ​​the interface and the illuminated area of ​​the light strip for the information to be displayed; and display the information to be displayed using the display area and the illuminated area of ​​the interface.

[0028] It should be noted that the server 103 can be hardware or software. When the server 103 is hardware, it can be implemented as a distributed server cluster consisting of multiple servers, or it can be implemented as a single server. When the server 103 is software, it can be implemented as multiple software or software modules (for example, for providing distributed services), or it can be implemented as a single software or software module. No specific limitation is made here.

[0029] It should be noted that the information display method of the unmanned vehicle provided in the embodiment of the present disclosure is generally executed by the server 103 , and accordingly, the information display device of the unmanned vehicle is generally set in the server 103 .

[0030] It should be understood that Figure 1 The number of servers, vehicle-mounted terminals corresponding to unmanned vehicles, and networks in the embodiment is merely illustrative. Any number of servers, vehicle-mounted terminals corresponding to unmanned vehicles, and networks may be used as needed.

[0031] Continue to refer Figure 2 , which shows a process 200 of an embodiment of a method for displaying information of an unmanned vehicle according to the present disclosure. The method for displaying information of an unmanned vehicle may include the following steps:

[0032] Step 201: Obtain information to be displayed about the unmanned vehicle.

[0033] In this embodiment, the execution subject of the information display method of the unmanned vehicle (for example Figure 1 The server 103 shown) can be accessed through a network (e.g. Figure 1 The network 102 shown in FIG. 102) obtains the vehicle terminal corresponding to the unmanned vehicle (eg Figure 1 The information to be displayed of the vehicle terminal 101 corresponding to the unmanned vehicle shown in FIG. 1 ; or the execution subject of the information display method of the unmanned vehicle (eg Figure 1The vehicle-mounted terminal 101 corresponding to the unmanned vehicle shown can obtain the information to be displayed through various sensors and / or information collection devices, and the information collection device can be an image and / or video collection device, for example, a camera. The above-mentioned information to be displayed can be information related to the operation of the unmanned vehicle, for example, itinerary information, recommended information related to the itinerary, information related to the passengers (for example, physiological characteristic parameters of the passengers, such as body temperature, respiratory parameters, fatigue and other parameters), etc. The type of the above-mentioned information to be displayed can be determined according to actual needs. For example, with the help of vehicle-mounted sensor devices such as cameras, global positioning systems, inertial measurement units, millimeter wave radars, lidars, etc., the driving environment status can be obtained, such as weather data, traffic lights, traffic topology information, the location of autonomous driving vehicles and other traffic participants, the operating status and other information.

[0034] In the technical solutions disclosed herein, the collection, storage, use, processing, transmission, provision and disclosure of the information to be displayed are in compliance with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0035] Step 202: Determine the display information of the display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle, and the display information includes: a display area, which is used to represent the display area of ​​the information to be displayed in the interface and the lit area in the light strip.

[0036] In this embodiment, the execution entity may determine display information of the display device based on the information to be displayed. The display information may be used to display the information to be displayed via the display device. The display information may include display-related information, such as display area, color information, text size information, image size information, image format information, etc.

[0037] Here, the display device can be used to display information to be displayed through its display information, such as the interface of the unmanned vehicle and the light strip of the unmanned vehicle. The light strip of the unmanned vehicle can be set at any position inside the unmanned vehicle, for example, around the top of the vehicle or around the middle of the vehicle near the handle.

[0038] It should be noted that the information to be displayed can also be displayed through the display information of other devices in the unmanned vehicle, for example, the playback device on the unmanned vehicle, which can display the information to be displayed through voice playback; for example, through a passenger device that is communicatively connected to the unmanned vehicle, the passenger device can display the information to be displayed through voice playback.

[0039] Here, the display area can be used to represent the display area of ​​the information to be displayed on the display device. The display area can include: the display area in the interface of the unmanned vehicle and the illuminated area in the light strip. The display area in the interface can be any display area in the interface, for example, the display area in a certain direction. The illuminated area in the light strip can be the illuminated area formed by the illuminated lights in the light strip at a certain moment.

[0040] Step 203: Display the information to be displayed through the display area and the lighted area in the interface respectively.

[0041] In this embodiment, the above-mentioned execution entity can respectively display the information to be displayed through the display area on the interface of the unmanned vehicle and the lighting area corresponding to the light strip of the unmanned vehicle.

[0042] It should be noted that the above-mentioned execution entities (such as Figure 1 The server 103 shown in FIG. 103 may instruct the vehicle terminal (eg Figure 1 The vehicle terminal 101 corresponding to the unmanned vehicle shown in the figure displays the information to be displayed through the display area and the light area in its interface; or the above-mentioned execution subject (for example Figure 1 The vehicle-mounted terminal 101 corresponding to the unmanned vehicle shown can display the information to be displayed through the display area on the interface of the unmanned vehicle and the lighting area corresponding to the light strip of the unmanned vehicle.

[0043] The information display method for an unmanned vehicle provided by the embodiment of the present disclosure determines the display information of a display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle, and the display information includes: a display area, and the display area is used to represent the display area of ​​the information to be displayed in the interface and the lit area in the light strip respectively; then the information to be displayed is displayed respectively through the display area and the lit area in the interface, and the information to be displayed can be displayed in the cockpit of a fully unmanned automatic driving vehicle through the lit area of ​​the light strip and / or the display area in the interface of the unmanned vehicle, which can solve the problems that the text display prompts of the traditional screen interface are not intuitive and vivid, and the prompt information is too single, and at the same time, it brings certainty and a sense of security to the passengers.

[0044] In some optional implementations of this embodiment, if there are multiple display areas; and based on the information to be displayed, determining the display information of the display device, including: obtaining the display weights of the multiple display areas in the display device, wherein the display weights are determined by the positions and / or numbers of the multiple display areas in the display device; obtaining the information weights of the information to be displayed, wherein the information weights are used to indicate the passenger's preference for the displayed information; determining the areas to be displayed among the multiple display areas based on the display weights and the information weights, and using the areas to be displayed as the display areas and lit areas in the interface.

[0045] In this implementation, the execution entity may first obtain the display weights of multiple display areas on the display device, where the display weights are determined by the location and / or number of the multiple display areas on the display device; then, obtain the information weight of the information to be displayed, where the information weight is used to indicate the passenger's preference for the displayed information; then, based on the display weights and information weights, determine the area to be displayed among the multiple display areas, and use the area to be displayed as the display area and the illuminated area in the interface. The multiple display areas may correspond to display area identifiers to identify the location of the display area on the display device.

[0046] It should be noted that the steps of obtaining the display weight and the information weight can be performed simultaneously or separately. For example, the step of obtaining the information weight can be performed first, and then the step of obtaining the display weight can be performed.

[0047] In one example, obtaining display weights of multiple display areas in a display device may include: determining a display weight corresponding to each display area based on a passenger's viewing angle, for example, the display weight of a display area directly in front of the passenger (i.e., viewing angle) is greater than the display weight of a display area directly behind the passenger (i.e., viewing angle), and the display weight of a display area corresponding to the left or right side of the passenger (i.e., viewing angle) is less than the display weight of a display area directly in front, etc. The passenger is seated in the driverless vehicle in a correct sitting posture.

[0048] It should be noted that corresponding weights can also be set according to passenger preferences. For example, if a passenger prefers to use the display area on the left or right side, the display weight of the display area on the left or right side can be set higher than the display weight of the display area directly in front and directly behind.

[0049] Correspondingly, in this example, the presentation weight is determined by the positions and / or quantities of the multiple display areas in the display device.

[0050] It should be noted that the display weight can be used to represent the importance of the information to be displayed to the passenger.

[0051] In one example, obtaining the information weight of the information to be displayed, where the information weight is used to indicate the passenger's preference for the displayed information, may include:

[0052] Extract core words from the information to be displayed; match the core words with the passenger's preferred information. When the matching degree meets the preset matching degree threshold, the core words that meet the preset matching degree threshold are used as the passenger's preferred core words, and the corresponding information weight is set based on the matching degree.

[0053] Correspondingly, in this example, core words can be extracted from the information to be displayed through a preset core word extraction model or core word matching method.

[0054] It should be noted that the above passenger preference information can be obtained from the passenger's historical operation data. For example, if a passenger recently subscribes to classical music, classical music can be used as the passenger preference information.

[0055] Here, the information weight is used to indicate the passenger's preference for the information to be displayed. The preference can be used to measure the passenger's eagerness to understand the information to be displayed.

[0056] It should be noted that the information weight can be set based on the matching degree, or can be set by the passenger according to his or her preference.

[0057] It should be noted that the above-mentioned execution entity can also pre-set the correspondence between the information to be displayed and the display information of the display device. For example, according to the type of information to be displayed, the corresponding display area is set. For example, the display area of ​​the itinerary information included in the information to be displayed is the middle area of ​​the screen.

[0058] In this implementation, the area to be displayed among the multiple display areas can be determined based on the display weights of the multiple display areas in the display device and the information weight of the information to be displayed, so that the area to be displayed can be used as the display area and the lighting area in the interface, thereby realizing the display of the information to be displayed through the display area and the lighting area in the interface.

[0059] In some optional implementations of this embodiment, the area to be displayed among the multiple display areas is determined based on the display weight and the information weight, including: determining the display area that meets the information weight among the multiple display areas as the area to be displayed.

[0060] In this implementation, the execution entity may compare the display weights of the multiple display areas with the information weights, and determine the display area whose display weights satisfy the information weights as the area to be displayed. The satisfaction may be that the display weight is less than or equal to the information weight.

[0061] In this implementation, the area to be displayed among the multiple display areas may be determined based on the display weight and the information weight.

[0062] In some optional implementations of this embodiment, the display information further includes: color information, wherein the color information is used to represent the display color of the information to be displayed in the interface and the lighting color of the light strip.

[0063] In this implementation, the display information may also include color information, which is used to represent the display color of the information to be displayed in the interface and the lighting color of the light strip. The lighting color may be the color displayed by the light in the light strip, for example, a light that displays red light.

[0064] In this implementation, the information to be displayed may also be displayed through color information, thereby enriching the display form of the information to be displayed.

[0065] In some optional implementations of this embodiment, the display area in the interface may include: a display area corresponding to a preset direction of the interface, wherein the preset direction is a direction corresponding to the type of information to be displayed.

[0066] In this implementation, the information to be displayed can be displayed through the display area corresponding to the preset direction of the interface of the unmanned vehicle.

[0067] Here, the preset direction may be a method corresponding to the type of information to be displayed.

[0068] It should be noted that the information to be displayed can be displayed on the interface of the unmanned vehicle in a preset manner. The preset manner can be pre-set for the passenger or displayed in the corresponding display area on the interface of the unmanned vehicle according to the type of information to be displayed.

[0069] In some optional implementations of this embodiment, the lighting area includes: an area formed by the lit lamps in the light strip, and the operating parameter information of the lit lamps is determined by the information to be displayed.

[0070] In this implementation, the light strip can be set inside the unmanned vehicle, the lighting area can be any area in the light strip, and the operating parameter information can be information related to the operation of the light, such as operating frequency, operating time, etc.

[0071] Here, the operating parameter information of the illuminated lamp can be set based on the information weight of the information to be displayed or customized by the user. For example, the information to be displayed with high information weight can be set to have more illuminated areas and set to be illuminated for a longer time.

[0072] It should be noted that the position and number of the illuminated areas can reflect the information weight of the information to be displayed. For example, multiple illuminated areas close to the front of the passenger and with a long lighting time can indicate that the information weight of the information to be displayed is higher.

[0073] In one example, the light strips surrounding the driverless vehicle can be continuous light strips or light strips arranged at intervals. Figure 3 In the figure, '1-L' is the driver's seat, '1-R' is the front passenger seat; '2-L' is the rear left, '2-R' is the rear right; '0' is the center of the rear seat; '0-L' is the left rear seat; '0-R' is the right rear seat; and '3' is the area between the two rear seats. The above '1-L', '1-R', '2-L', '2-R', '0', '0-L', '0-R', '3', '0-L', and '0-R' are merely illustrations of the light strips surrounding the driverless vehicle. '1-L', '1-R', '2-L', '2-R', '0', '0-L', '0-R', '3', '0-L', and '0-R' can be set continuously or intermittently. The lengths of the light strips of '1-L', '1-R', '2-L', '2-R', '0', '0-L', '0-R', '3', '0-L', and '0-R' can be set based on the interior dimensions of the autonomous vehicle and / or passenger preferences.

[0074] It should be noted that the screen of the autonomous vehicle (i.e., interface, see Figure 3 The center screen (below the center center) is divided into sections to display information. This information will be displayed across control and ecosystem screens, roof screens, instrument panels, vehicle control auxiliary screens, and non-traditional screen-based interactive media such as light strips. During the journey, passengers can more effectively understand the various intelligent behaviors and judgments of the unmanned autonomous vehicle through these screens, light strips, smart surfaces, and other media. Furthermore, for the safety of autonomous driving, feedback on autonomous driving behaviors, predictions, human-vehicle and vehicle-to-vehicle interactions, vehicle-road interactions, orders, voice commands, proactive ecosystem recommendations, and vehicle control must be efficiently, accurately, and naturally communicated to passengers for effective communication.

[0075] In this implementation, the information to be displayed can be displayed by the number of light strips surrounding the unmanned vehicle and the operating parameter information corresponding to the light strips.

[0076] In some optional implementations of this embodiment, the information to be displayed includes at least one of the following: travel information, recommendation information, and vehicle control information.

[0077] In this implementation, the information to be displayed may be classified according to the purpose or generation method of the information to be displayed.

[0078] Here, the travel information may be information related to the travel of the unmanned vehicle, such as the departure destination.

[0079] Recommendation information can be suggestions for the autonomous vehicle and / or passengers, for example, recommending food and tourist attractions for passengers' travel; recommending music based on passengers' preferences, etc.

[0080] Vehicle control information can be used to refer to information for controlling unmanned vehicles, such as welcome information, departure information, arrival warning information, etc.

[0081] In one example, Figure 4 In the vehicle control information, the screen (see Figure 4 The screen is located in the middle of the center, and trip information is displayed from the top and bottom of the screen; recommended information is displayed from both sides of the screen; vehicle control information, trip information and recommended information are displayed interactively with the lit areas of the driverless vehicle's internal light strips.

[0082] exist Figure 5 In the example of itinerary information, the process of interactive display of itinerary information and light strip is as follows: (1) Press the start button: "Start" is clicked; (2) The small ball or element representing the itinerary on the screen flies to the top of the screen; (3) The small ball or element representing the itinerary is adsorbed on the top of the screen and lights up the IP front-end interactive light strip at the same time or after a delay of several milliseconds; (4) The light strip then works in different areas in the form of the same dynamic effect as the itinerary.

[0083] exist Figure 6 In the example of vehicle control information, the process of the interaction between vehicle control information and the light strip to display the information to be displayed is as follows: (1) The temperature in the car is adjusted by voice input. The vehicle control information is input from both sides of the screen to call out the temperature adjustment window and adjust it to the temperature required by the passenger; (2) After the temperature is adjusted to the temperature required by the passenger, the "3" light at the bottom of the screen lights up.

[0084] exist Figure 7 In the example of recommendation information, the interactive display process of recommendation information and light strips is as follows: (1) In the parking scene, the automatic driving system will identify whether the vehicle is safe outside the door and actively recommend information from both sides of the screen. At the same time, the light strip on the right side of the door turns red, indicating that it is unsafe for passengers to get off the vehicle. (2) After confirming safety, the screen displays the prompt "It is safe to get off the vehicle now" and the light strip on the side where the passenger is safe to get off turns green.

[0085] In some optional implementations of this embodiment, the vehicle control information is determined based on the following steps: obtaining operating parameter information and surrounding environment information of the unmanned vehicle; and determining the vehicle control information of the unmanned vehicle based on the operating parameter information and surrounding environment information.

[0086] In this implementation, the above-mentioned execution entity can determine the vehicle control information of the unmanned vehicle based on the operating parameter information and surrounding environment information of the unmanned vehicle.

[0087] In one example, the execution entity may pre-establish a correspondence between the operating parameter information, the surrounding environment information, and the vehicle control information, so as to determine the corresponding vehicle control information when determining the operating parameter information and the surrounding environment information.

[0088] In one example, the above-mentioned execution entity can identify operating parameter information and surrounding environment information through a behavior prediction model to determine the possible behavior of the unmanned vehicle and generate corresponding vehicle control information based on the possible behavior.

[0089] It should be noted that the aforementioned execution entity may use the operating parameter information and surrounding environment information as training samples for the behavior prediction model to iteratively adjust the parameters of the behavior prediction model until a preset iteration cutoff condition is met, thereby obtaining a trained behavior prediction model. The aforementioned iteration cutoff condition may be set by the passenger or based on the behavior prediction accuracy of the trained behavior prediction model.

[0090] In some optional implementations of this embodiment, the surrounding environment information includes: operating parameter information of traffic lights and / or operating parameter information of other transportation vehicles.

[0091] In this implementation, the surrounding environment information may include information related to the unmanned vehicle outside the unmanned vehicle, such as operating parameter information of traffic lights and / or operating parameter information of other vehicles. Optionally, the type of surrounding environment information can be determined according to actual needs. For example, the driving environment status can be obtained with the help of on-board sensor devices such as cameras, global positioning systems, inertial measurement units, millimeter wave radars, lidars, etc., such as weather data, traffic lights, traffic topology information, the location and operating status of autonomous vehicles and other traffic participants. The original surrounding environment information such as direct raw image data obtained by the camera can be directly used as the surrounding environment information. The depth map and semantic segmentation map obtained by processing the original surrounding environment information through models such as RefineNet can also be used as the surrounding environment information. The above-mentioned operating parameter information can be information related to the operating parameters of the unmanned vehicle during its driving on the driving path information, such as the operating speed, operating acceleration, etc.

[0092] It should be noted that the above-mentioned surrounding environment information may be information inside the unmanned vehicle, such as the passenger's body temperature, fatigue level, etc.

[0093] Further references Figure 8 As an implementation of the methods shown in the above figures, the present disclosure provides an embodiment of an information display device for an unmanned vehicle. Figure 2 Corresponding to the method embodiment shown, the device can be specifically applied to various electronic devices.

[0094] like Figure 8 As shown, the information display device 800 for an unmanned vehicle of this embodiment may include: an information acquisition module 801, an information determination module 802, and an information display module 803. The information acquisition module 801 is configured to acquire information to be displayed of the unmanned vehicle; the information determination module 802 is configured to determine display information of a display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle; the display information includes: a display area, which is used to represent the display area of ​​the interface and the illuminated area of ​​the light strip for the information to be displayed; and the information display module 803 is configured to display the information to be displayed through the display area and the illuminated area, respectively.

[0095] In this embodiment, in the information display device 800 for an unmanned vehicle, the specific processing of the information acquisition module 801, the information determination module 802 and the information display module 803 and the technical effects thereof can be referred to in the respective Figure 2 The relevant descriptions of steps 201-203 in the corresponding embodiment are not repeated here.

[0096] In some optional implementations of this embodiment, if there are multiple display areas; and the information determination module 802 includes: a first acquisition unit, configured to obtain the display weights of the multiple display areas in the display device, wherein the display weights are determined by the positions and / or numbers of the multiple display areas in the display device; a second acquisition unit, configured to obtain the information weight of the information to be displayed, wherein the information weight is used to indicate the passenger's preference for the displayed information; an area determination unit, configured to determine the area to be displayed in the multiple display areas based on the display weight and the information weight, and use the area to be displayed as the display area and the lit area in the interface.

[0097] In some optional implementations of this embodiment, the region determining unit is further configured to: determine a display region satisfying the information weight among the display weights of the multiple display regions as the region to be displayed.

[0098] In some optional implementations of this embodiment, the display information further includes: color information, wherein the color information is used to represent the display color of the information to be displayed in the interface and the lighting color of the light strip.

[0099] In some optional implementations of this embodiment, the display area in the interface includes: a display area corresponding to a preset direction of the interface, wherein the preset direction is a direction corresponding to the type of information to be displayed.

[0100] In some optional implementations of this embodiment, the information to be displayed includes at least one of the following: travel information, recommendation information, and vehicle control information.

[0101] In some optional implementations of this embodiment, the information acquisition module 801 is further configured to obtain operating parameter information and surrounding environment information of the unmanned vehicle; the information determination module 802 is further configured to determine vehicle control information of the unmanned vehicle based on the operating parameter information and surrounding environment information.

[0102] In some optional implementations of this embodiment, the surrounding environment information includes: operating parameter information of traffic lights and / or operating parameter information of other transportation vehicles.

[0103] According to an embodiment of the present disclosure, the present disclosure also provides an electronic device, a readable storage medium, and a computer program product.

[0104] According to an embodiment of the present disclosure, the present disclosure also provides an unmanned vehicle, which may include the above-mentioned electronic device.

[0105] Figure 9 A schematic block diagram of an example electronic device 900 that can be used to implement embodiments of the present disclosure is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital assistants, cellular phones, smartphones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and / or claimed herein.

[0106] like Figure 9As shown, the device 900 includes a computing unit 901, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 902 or a computer program loaded from a storage unit 908 into a random access memory (RAM) 903. Various programs and data required for the operation of the device 900 can also be stored in the RAM 903. The computing unit 901, the ROM 902, and the RAM 903 are connected to each other via a bus 904. An input / output (I / O) interface 905 is also connected to the bus 904.

[0107] Various components in the device 900 are connected to the I / O interface 905, including an input unit 906, such as a keyboard, a mouse, etc.; an output unit 907, such as various types of displays, speakers, etc.; a storage unit 908, such as a magnetic disk, an optical disk, etc.; and a communication unit 909, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 909 allows the device 900 to exchange information / data with other devices via a computer network such as the Internet and / or various telecommunication networks.

[0108] The computing unit 901 can be a variety of general-purpose and / or specialized processing components with processing and computing capabilities. Some examples of the computing unit 901 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units that run machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The computing unit 901 performs the various methods and processes described above, such as the information display method for an unmanned vehicle. For example, in some embodiments, the information display method for an unmanned vehicle can be implemented as a computer software program that is tangibly contained in a machine-readable medium, such as a storage unit 908. In some embodiments, part or all of the computer program can be loaded and / or installed on the device 900 via the ROM 902 and / or the communication unit 909. When the computer program is loaded into the RAM 903 and executed by the computing unit 901, one or more steps of the information display method for an unmanned vehicle described above can be performed. Alternatively, in other embodiments, the computing unit 901 can be configured to perform the information display method for an unmanned vehicle by any other appropriate means (e.g., by means of firmware).

[0109] Various embodiments of the systems and techniques described herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), system-on-chip systems (SOCs), programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various embodiments can include being implemented in one or more computer programs that are executable and / or interpreted on a programmable system that includes at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0110] The program code for implementing the method of the present disclosure can be written in any combination of one or more programming languages. These program codes can be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device so that when the program code is executed by the processor or controller, the functions / operations specified in the flow chart and / or block diagram are implemented. The program code can be executed entirely on the machine, partially on the machine, as a stand-alone software package, partially on the machine and partially on a remote machine, or entirely on a remote machine or server.

[0111] In the context of the present disclosure, a machine-readable medium can be a tangible medium that can contain or store a program for use by or in conjunction with an instruction execution system, device or equipment. A machine-readable medium can be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium can include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium can include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0112] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0113] The systems and techniques described herein can be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer having a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system can be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), and the Internet.

[0114] A computer system may include a client and a server. The client and server are generally remote from each other and typically interact through a communication network. The client-server relationship arises through computer programs running on the respective computers and having a client-server relationship with each other. The server may be a cloud server, a server in a distributed system, or a server integrated with a blockchain.

[0115] Artificial intelligence (AI) is the study of computers to simulate certain human thought processes and intelligent behaviors (such as learning, reasoning, thinking, and planning). It encompasses both hardware and software technologies. AI hardware technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, and big data processing. AI software technologies primarily encompass computer vision, speech recognition, natural language processing, machine learning / deep learning, big data processing, and knowledge graphs.

[0116] It should be understood that the various forms of the processes shown above can be used to reorder, add, or delete steps. For example, the steps described in this disclosure can be performed in parallel, sequentially, or in a different order, as long as the desired results of the technical solutions described in this disclosure can be achieved. This is not a limitation herein.

[0117] The above specific embodiments do not constitute a limitation on the scope of protection of this disclosure. Those skilled in the art will appreciate that various modifications, combinations, sub-combinations, and substitutions may be made based on design requirements and other factors. Any modifications, equivalent substitutions, and improvements made within the spirit and principles of this disclosure shall be included within the scope of protection of this disclosure.

Claims

1. A method for displaying information of an unmanned vehicle, comprising: Acquiring information to be displayed of the unmanned vehicle, wherein the information to be displayed includes: vehicle control information and / or passenger-related information; Determining display information for a display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle, and the display information includes: a display area, wherein the display area is used to represent a display area of ​​the information to be displayed in the interface and a lit area in the light strip, respectively; the lit area includes: an area formed by lit lights in the light strip, and operating parameter information of the lit lights is determined by the information to be displayed; Display the information to be displayed respectively through the display area and the lighted area in the interface; The method further comprises: Obtaining operating parameter information and surrounding environment information of the unmanned vehicle; Using a pre-trained behavior prediction model to identify operating parameter information and surrounding environment information of the unmanned vehicle, and determine the behavior of the unmanned vehicle; Generate corresponding vehicle control information according to the behavior; If there are multiple display areas; and The determining, based on the information to be displayed, display information of the display device includes: Obtaining display weights of the plurality of display areas in the display device, wherein the display weights are determined by positions and / or quantities of the plurality of display areas in the display device; Obtaining an information weight of the information to be displayed, wherein the information weight is used to indicate a passenger's preference for the information to be displayed; According to the display weight and the information weight, a to-be-displayed area among the multiple display areas is determined, and the to-be-displayed area is used as the display area and the light-up area in the interface.

2. The method according to claim 1, wherein The determining, according to the display weight and the information weight, an area to be displayed in the plurality of display areas includes: A display area that satisfies the information weight among the display weights of the plurality of display areas is determined as the area to be displayed.

3. The method according to claim 1, wherein The display information further includes: color information, wherein the color information is used to represent the display color of the information to be displayed in the interface and the lighting color of the light strip.

4. The method according to claim 1, wherein The display area in the interface includes: A display area corresponding to a preset direction of the interface, wherein the preset direction is a direction corresponding to the type of information to be displayed.

5. The method according to any one of claims 1 to 4, wherein: The information to be displayed includes at least one of the following: itinerary information and recommendation information.

6. The method according to claim 1, wherein The surrounding environment information includes: operating parameter information of traffic lights and / or operating parameter information of other transportation vehicles.

7. An information display device for an unmanned vehicle, comprising: An information acquisition module is configured to acquire information to be displayed of the unmanned vehicle, wherein the information to be displayed includes: vehicle control information and / or passenger-related information; an information determination module configured to determine display information for a display device based on the information to be displayed, wherein the display device includes: an interface of the unmanned vehicle and a light strip of the unmanned vehicle; the display information includes: a display area, the display area being used to represent a display area of ​​the information to be displayed in the interface and a lit area in the light strip, respectively; the lit area including: an area formed by lit lights in the light strip, operating parameter information of the lit lights being determined by the information to be displayed; an information display module, configured to display the information to be displayed through the display area and the lighted area in the interface respectively; The device further includes a vehicle control information generation module, which is configured to: Obtaining operating parameter information and surrounding environment information of the unmanned vehicle; Using a pre-trained behavior prediction model to identify operating parameter information and surrounding environment information of the unmanned vehicle, and determine the behavior of the unmanned vehicle; Generate corresponding vehicle control information according to the behavior; If there are multiple display areas; and The information determination module includes: a first acquiring unit configured to acquire display weights of the plurality of display areas in the display device, wherein the display weights are determined by positions and / or quantities of the plurality of display areas in the display device; a second acquiring unit configured to acquire an information weight of the information to be displayed, wherein the information weight is used to indicate a passenger's preference for the information to be displayed; The area determination unit is configured to determine the to-be-displayed area in the plurality of display areas according to the display weight and the information weight, and use the to-be-displayed area as the display area and the light-up area in the interface.

8. The device according to claim 7, wherein The region determining unit is further configured to determine, among the display weights of the plurality of display regions, a display region that satisfies the information weight as the to-be-displayed region.

9. The device according to claim 7, wherein The display information further includes: color information, wherein the color information is used to represent the display color of the information to be displayed in the interface and the lighting color of the light strip.

10. The device according to claim 7, wherein The display area in the interface includes: A display area corresponding to a preset direction of the interface, wherein the preset direction is a direction corresponding to the type of information to be displayed.

11. The device according to any one of claims 7 to 10, wherein: The information to be displayed includes at least one of the following: itinerary information and recommendation information.

12. The device according to claim 7, wherein The surrounding environment information includes: operating parameter information of traffic lights and / or operating parameter information of other transportation vehicles.

13. An electronic device comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 6.

14. A non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are configured to cause the computer to execute the method according to any one of claims 1 to 6.

15. A computer program product comprising a computer program, which, when executed by a processor, implements the method according to any one of claims 1 to 6.

16. An unmanned vehicle comprising the electronic device according to claim 13.

Images