Information processing method and device
By obtaining vehicle status and environmental information to generate intent information and displaying it to users, the problem of users lacking awareness of vehicle behavior in vehicle-assisted driving is solved, and interactivity and user trust is improved.
Patent Information
- Application Number
- CN202310636168.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-05-31
- Publication Date
- 2024-12-03
AI Technical Summary
During the vehicle-assisted driving process, users lack awareness of vehicle driving behavior, resulting in insufficient interaction between cars and users.
By obtaining the status information and environmental information of the vehicle, intent information is generated and displayed to the user so that the user can understand the reasons for the driving behavior of the vehicle and improve interactivity.
It enhances users' understanding and trust in vehicles, and improves information communication and interactivity between cars and users.
Smart Images

Figure CN119058737A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of autonomous driving technology, and in particular to information processing methods and devices. Background Art
[0002] With the rapid development of artificial intelligence technology combined with automotive applications, cars equipped with assisted driving and autonomous driving technologies are gradually entering the market, and cars are gradually shifting from traditional full manual driving to cars equipped with assisted driving. For cars equipped with assisted driving, the car system can make decisions based on the various sensors on the car, and generate various commands based on these decisions to control various systems of the car system (such as the braking system, fragrance system, air conditioning system, etc.).
[0003] However, the decision on vehicle behavior during vehicle-assisted driving is made automatically by the vehicle computer, and users lack a way to recognize the driving behavior of the vehicle with vehicle-assisted driving, which creates obstacles to "communication" between the car and the user.
[0004] Therefore, how to improve the interactivity between the car and the user is one of the problems that those skilled in the art need to solve urgently. Summary of the invention
[0005] The embodiments of the present application provide an information processing method and device, which can improve the interactivity between the car and the user. To achieve the above purpose, the embodiments of the present application adopt the following technical solutions:
[0006] In the first aspect, the embodiment of the present application provides an information processing method, the method comprising: obtaining target information of a vehicle; generating intention information according to the target information. The target information comprises at least one of state information and environment information, the state information is used to indicate the running status of the vehicle, the environment information is used to indicate the surrounding environment of the vehicle, and the intention information is used to indicate the basis of the driving behavior of the vehicle.
[0007] In the related art, when making decisions, the vehicle tells the user the result of the vehicle's command execution, but does not tell the reason. The user still cannot know why the vehicle performs these actions through the information provided by the vehicle computer, and needs to actively observe the external environment to judge, which leads to a lack of interactivity between the car and the user. In the method provided in the embodiment of the present application, the intention information used by the vehicle to indicate the basis of the vehicle's driving behavior can be determined based on the vehicle's state information and environmental information, so that the user can understand the reason why the vehicle performs the action through the intention information, thereby improving the interactivity between the car and the user.
[0008] In a possible implementation, scene information may be generated based on the target information, where the scene information is used to indicate a driving scene of the vehicle; and the intention information may be determined based on the scene information.
[0009] It can be seen that in the method provided in the embodiment of the present application, the driving scene of the vehicle can be determined based on the vehicle's status information and environmental information, and then the vehicle's intention information used to indicate the basis for the vehicle's driving behavior can be determined through the scene information, so that the user can understand the reason why the vehicle performs the action through the intention information, thereby improving the interactivity between the car and the user.
[0010] For example, when a vehicle passes through a traffic light intersection, the traffic light can actively communicate with the vehicle or the vehicle can actively communicate with the traffic light, or the vehicle can receive the broadcast sent by the traffic light to obtain environmental information, and then parse the environmental information to directly obtain that the traffic light is in a red light state, and determine that the vehicle is in / is about to pass through a red light intersection.
[0011] For another example, by analyzing the images captured by the vehicle image sensor and the environmental information obtained by the distance sensor, infrared sensor / lidar, it can be determined that there is a sidewalk ahead and there are pedestrians on the sidewalk / at both ends of the sidewalk, thereby determining that the vehicle is in or is about to be in a pedestrian-yielding scenario.
[0012] In a possible implementation, the above scene information can also be used to indicate road scenes (such as highways, urban intersections, general urban roads, mountainous areas), time scenes (such as morning, noon, evening and night, etc.) or weather scenes (such as sunny days, rainy days, snowy days, foggy days or sandstorms). Accordingly, corresponding intent information can also be generated according to the road scene, time scene or weather scene.
[0013] For example, when the scene information indicates that the current time scene is evening, the corresponding generated intention information may be "it is evening, turn on the lights inside the car."
[0014] For another example, when the scene information indicates that the current weather scene is rainy, the corresponding generated intention information may be "It is raining, turn on the wipers."
[0015] In a possible implementation, the above-mentioned intention information may also be sent or displayed.
[0016] It can be understood that in the method provided in the embodiment of the present application, the intention information used by the vehicle to indicate the basis for the vehicle's driving behavior can be determined based on the vehicle's status information and environmental information, and the intention information can be directly displayed or sent to other electronic devices, so that users can understand the reasons why the vehicle performs actions through the intention information, thereby improving the interactivity between the car and the user.
[0017] The above-mentioned display may be in the form of text, pictures, videos, audio or other forms of display.
[0018] For example, the vehicle's intention information can be sent to electronic devices such as mobile phones, tablet computers, speakers or lighting equipment through a wireless communication system, so that users can understand the reason why the vehicle performs an action through electronic devices such as mobile phones, tablet computers, speakers or lighting equipment. After the vehicle obtains the intention information, it will notify the user of the intention information. In this way, after the user obtains the intention information, he can interpret the intention information in combination with the action currently being performed or about to be performed by the vehicle, and understand the action being performed or about to be performed by the vehicle through the interpretation of the intention information. In this way, by providing intention information, information communication between the user and the vehicle is achieved, which is more conducive to enhancing the user's understanding of the vehicle.
[0019] For example, a plurality of color lights corresponding to a plurality of intention information may be set. When the lighting device receives the intention information of the vehicle, the corresponding color lights may be displayed.
[0020] As another example, the intention information can be displayed to the user on the central control screen / instrument screen so that the user can understand the reason why the vehicle performs the action.
[0021] For example, a unified interface can be set on the central control screen / instrument screen of the vehicle to display intent information. For example, the interface can be set in the vehicle panoramic view and displayed floating above the vehicle. On the one hand, the vehicle panoramic view is an area that users view more frequently. On the other hand, when placed in this position, the user can understand the intent information in combination with various information on the panoramic view when obtaining intent information. The interface can always be displayed on the central control screen / instrument screen, so that the user knows to obtain intent information from this fixed position. It can also be activated in a specific mode, such as when the central control screen displays a panoramic image, the interface is displayed together.
[0022] In a possible implementation, behavior information may be generated based on the target information, where the behavior information is used to indicate vehicle driving behavior; and the vehicle may be controlled based on the behavior information.
[0023] For example, the scene information can be determined based on the above target information. After the scene information is obtained, the scene information can be used as input according to the preset judgment logic to output an execution instruction, which is used to control the vehicle to produce an action to match the current scene of the vehicle. For example, if a red light is recognized, the vehicle will stop; if a pedestrian-giving scene is recognized, the vehicle will decelerate to a stop.
[0024] Specifically, after determining the driving intention, the vehicle needs to determine the corresponding execution strategy to achieve the driving intention. Based on the determined execution strategy, the vehicle generates corresponding execution instructions, which control the vehicle to generate a series of behavioral actions, such as deceleration, braking, and turning on / off a specific driving mode.
[0025] In a possible implementation, intention information may be generated according to the target information, and behavior information may be determined according to the generated intention information.
[0026] It can be seen that the method provided in the embodiment of the present application can generate behavior information for indicating the driving behavior of the vehicle based on the vehicle's state information and environmental information, and control the vehicle behavior based on the generated behavior information.
[0027] For example, behavior information can be generated based on the above-mentioned target information, and the vehicle can be controlled to generate corresponding execution instructions based on the generated behavior information. The vehicle can be controlled by the execution instructions to generate a series of behavioral actions, such as deceleration, braking, turning on / off a specific driving mode, etc.
[0028] In one possible implementation, the above intention information is also used to indicate the driving behavior that the vehicle is performing or is about to perform.
[0029] It can be seen that in the method provided in the embodiment of the present application, the basis for the vehicle to indicate the vehicle's driving behavior and the intention information of the driving behavior that the vehicle is currently performing or is about to perform can be determined based on the vehicle's status information and environmental information, so that the user can understand the reason why the vehicle performs the action through the intention information, thereby improving the interactivity between the car and the user.
[0030] In a possible implementation manner, the method may further include: sending or displaying permanent information, where the permanent information includes at least one of the status information, navigation information or time information.
[0031] It is understandable that the intent information has a certain timeliness and becomes invalid after the driving behavior is completed. If the last intent information is displayed, when the vehicle does not have relevant braking, the intent information may provide wrong information to the user, thereby reducing the user's trust in the autonomous driving system. To this end, the invalid intent information can be replaced by displaying the resident information after the intent information expires.
[0032] Therefore, the intent information displayed in the interface can no longer be displayed when the vehicle leaves the current driving scene (determining whether it is always in the same driving scene through the collected target information), or only delay the demonstration for a preset time. If the interface is directly "black screen" during the time when the intent information is not displayed, it will be abrupt when displayed in the panoramic view because the interface has a certain area. For this reason, after the intent information becomes invalid, the resident information can be displayed to replace the invalid intent information to improve the user experience.
[0033] For example, the vehicle's intention information and driving mode can be switched and displayed through the panoramic view of the vehicle. The intention information is invalidated after the driving behavior is completed, and the vehicle's driving mode is displayed instead of the vehicle's intention information, so as to avoid users browsing the invalid intention information and reducing their trust in the autonomous driving system.
[0034] As another example, the vehicle's intention information and current time can be switched and displayed through the panoramic view of the vehicle. The intention information is invalidated after the driving behavior is completed, and the current time is displayed instead of the vehicle's intention information to avoid users browsing the invalid intention information and reducing their trust in the autonomous driving system.
[0035] As another example, the vehicle's intention information and navigation information can be displayed by switching through the vehicle's panoramic view. The intention information is invalidated after the driving behavior is completed, and the vehicle's intention information is replaced by the navigation information, so as to avoid the user browsing the invalid intention information and reducing the trust in the autonomous driving system.
[0036] Optionally, the above environmental information includes at least one of road information, traffic light information, traffic sign information, other vehicle information, pedestrian information or obstacle information.
[0037] In one possible implementation, the above environmental information can also be used to indicate road environments (such as highways, urban intersections, general urban roads, mountainous areas), time environments (such as morning, noon, evening and night, etc.) or weather environments (such as sunny days, rainy days, snowy days, foggy days or sandstorms).
[0038] Optionally, the above-mentioned status information includes at least one of vehicle speed, vehicle image, vehicle sound, vehicle temperature, vehicle tire pressure, driving mode, vehicle energy amount or in-vehicle air quality.
[0039] In a second aspect, the present application implements an information processing device, which includes: a transceiver unit and a processing unit. The transceiver unit is used to obtain target information of the vehicle, and the target information includes at least one of state information and environmental information. The state information is used to indicate the operating status of the vehicle, and the environmental information is used to indicate the environmental status of the vehicle. The processing unit is used to generate intention information based on the target information, and the intention information is used to indicate the basis of the vehicle's driving behavior.
[0040] In a possible implementation, the processing unit is specifically used to: generate scene information based on the target information, where the scene information is used to indicate a driving scene of the vehicle; and determine the intention information based on the scene information.
[0041] In a possible implementation, the transceiver unit is further used to: send or display the intention information.
[0042] In a possible implementation, the transceiver unit is further used to: generate behavior information according to the target information, the behavior information being used to indicate vehicle driving behavior; and control the vehicle according to the behavior information.
[0043] In one possible implementation, the above intention information is also used to indicate the driving behavior that the vehicle is performing or is about to perform.
[0044] In a possible implementation, the transceiver unit is further used to send or display resident information, where the resident information includes at least one of the status information, navigation information or time information.
[0045] Optionally, the above environmental information includes at least one of road information, traffic light information, traffic sign information, other vehicle information, pedestrian information or obstacle information.
[0046] Optionally, the above-mentioned status information includes at least one of vehicle speed, vehicle image, vehicle sound, vehicle temperature, vehicle tire pressure, driving mode, vehicle energy amount or in-vehicle air quality.
[0047] In a third aspect, an embodiment of the present application further provides an information processing device, which includes: at least one processor, when the at least one processor executes program code or instructions, it implements the method described in the above first aspect or any possible implementation method thereof.
[0048] Optionally, the information processing device may further include at least one memory, and the at least one memory is used to store the program code or instruction.
[0049] In a fourth aspect, an embodiment of the present application further provides a chip, comprising: an input interface, an output interface, and at least one processor. Optionally, the chip further comprises a memory. The at least one processor is used to execute the code in the memory, and when the at least one processor executes the code, the chip implements the method described in the first aspect or any possible implementation thereof.
[0050] Optionally, the above chip may also be an integrated circuit.
[0051] In a fifth aspect, an embodiment of the present application further provides a computer-readable storage medium for storing a computer program, wherein the computer program includes methods for implementing the method described in the above-mentioned first aspect or any possible implementation thereof.
[0052] In a sixth aspect, an embodiment of the present application further provides a computer program product comprising instructions, which, when executed on a computer, enables the computer to implement the method described in the first aspect or any possible implementation thereof.
[0053] The information processing device, computer storage medium, computer program product and chip provided in this embodiment are all used to execute the method provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the method provided above and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS
[0054] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.
[0055] Figure 1 A functional block diagram of a vehicle provided in an embodiment of the present application;
[0056] Figure 2 A flowchart of an information processing method provided in an embodiment of the present application;
[0057] Figure 3 A panoramic view of a vehicle provided in an embodiment of the present application;
[0058] Figure 4 A panoramic view of another vehicle provided in an embodiment of the present application;
[0059] Figure 5 A panoramic view of another vehicle provided in an embodiment of the present application;
[0060] Figure 6 A panoramic view of another vehicle provided in an embodiment of the present application;
[0061] Figure 7 A panoramic view of another vehicle provided in an embodiment of the present application;
[0062] Figure 8 A panoramic view of another vehicle provided in an embodiment of the present application;
[0063] Fig. 9 A schematic diagram of the structure of an information processing device provided in an embodiment of the present application;
[0064] Fig.10 A schematic diagram of the structure of a chip provided in an embodiment of the present application;
[0065] Fig.11 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application;
[0066] Fig.12 A schematic diagram of the structure of another information processing device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0067] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the embodiments of the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the embodiments of the present application.
[0068] The term "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.
[0069] The terms "first" and "second" and the like in the description and drawings of the embodiments of the present application are used to distinguish different objects, or to distinguish different processing of the same object, rather than to describe a specific order of objects.
[0070] In addition, the terms "including" and "having" and any variations thereof mentioned in the description of the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device including a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units that are not listed, or may optionally include other steps or units inherent to these processes, methods, products or devices.
[0071] It should be noted that in the description of the embodiments of the present application, words such as "exemplarily" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as having priority or advantage over other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.
[0072] First, some terms involved in the embodiments of the present application are explained.
[0073] Navigation Cruise Assist (NCA) is an intelligent autonomous driving technology. In areas where the function is allowed, the driver can activate the function with one click. The vehicle can set the route according to the navigation, flexibly adjust the speed and driving route according to the real-time traffic conditions on the actual road, and automatically reach the destination.
[0074] Automated parking assist (APA) is an intelligent autonomous driving technology. When the car is cruising at low speed, APA technology can use vehicle sensors (such as ultrasonic radar, camera, etc.) to perceive the surrounding environment, help the driver find an empty parking space of suitable size, and automatically drive the vehicle to the empty parking space found.
[0075] Automated valet parking (AVP) is a smart autonomous driving technology. With AVP technology, vehicles can enter completely unfamiliar parking lots on their own and complete all parking actions without first learning, and the driver is not required to be in the car. AVP technology can replace traditional manual parking services, help users save a lot of parking time, and solve the pain point of queuing for parking during peak hours.
[0076] Lane centering control (LCC) is an intelligent autonomous driving technology that can monitor the relative position of the vehicle and the lane edge in real time, and continuously and automatically control the lateral movement of the vehicle to keep the vehicle in the center of the lane.
[0077] For smart cars equipped with assisted driving, the vehicle computer system can make decisions based on the various sensors installed in the car, and generate various instructions based on these decisions to control the various systems of the vehicle computer (such as the braking system, fragrance system, air conditioning system, etc.).
[0078] The decision on vehicle behavior during vehicle-assisted driving is made automatically by the vehicle computer. Users lack a way to recognize the driving behavior of vehicle-assisted driving vehicles, which creates obstacles to "communication" between the car and the user.
[0079] To this end, an embodiment of the present application provides an information processing method, which can be applied to a vehicle. Figure 1 1 is a functional block diagram of a vehicle 100 provided in an embodiment of the present application. Figure 1 The vehicle 100 shown may include various subsystems, such as an infotainment system 110, a perception system 120, a decision control system 130, a drive system 140, and a computing platform 150. Optionally, the vehicle 100 may include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and component of the vehicle 100 may be interconnected by wire or wirelessly.
[0080] In some embodiments, the infotainment system 110 may include a communication system 111 , an entertainment system 112 , and a navigation system 113 .
[0081] The communication system 111 may include a wireless communication system that can communicate wirelessly with one or more devices directly or via a communication network. For example, the wireless communication system may use 3G cellular communications, such as CDMA, EVDO, GSM / GPRS, or 4G cellular communications, such as LTE. Or 5G cellular communications. The wireless communication system may communicate with a wireless local area network (WLAN) using WiFi. In some embodiments, the wireless communication system may communicate directly with the device using an infrared link, Bluetooth, or ZigBee. Other wireless protocols, such as various vehicle communication systems, for example, the wireless communication system may include one or more dedicated short range communications (DSRC) devices, which may include public and / or private data communications between vehicles and / or roadside stations.
[0082] The entertainment system 112 may include a display device, a microphone and speakers. Users can listen to the radio and play music in the car based on the entertainment system; or connect the mobile phone to the vehicle and project the mobile phone's screen on the display device. The display device may be touch-screen, and users can operate by touching the screen.
[0083] Optionally, the display device may be an actual display device, such as a central control screen, or a display device formed by projection technology onto an object, for example, by projection on the front windshield of the vehicle through holographic projection or head-up display (HUD) technology, with the projection area on the front windshield serving as the display device. This application does not limit the type of display device.
[0084] In some cases, the user's voice signal can be obtained through a microphone, and based on the analysis of the user's voice signal, the user can control certain aspects of the vehicle 100, such as adjusting the temperature inside the vehicle, etc. In other cases, music can be played to the user through a speaker.
[0085] The navigation system 113 may include a map service provided by a map provider, thereby providing navigation of the driving route for the vehicle 100. The navigation system 113 may be used in conjunction with the vehicle's global positioning system 121 and inertial measurement unit 122. The map service provided by the map provider may be a two-dimensional map or a high-precision map.
[0086] The perception system 120 may include several sensors that sense information about the environment around the vehicle 100. For example, the perception system 120 may include a global positioning system 121 (the global positioning system may be a GPS system, or a Beidou system or other positioning systems), an inertial measurement unit (IMU) 122, a laser radar 123, a millimeter wave radar 124, an ultrasonic radar 125, and a camera 126. The perception system 120 may also include sensors of the internal systems of the monitored vehicle 100 (for example, an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect objects and their corresponding characteristics (position, shape, direction, speed, etc.). Such detection and recognition are key functions for the safe operation of the vehicle 100.
[0087] The global positioning system 121 may be used to estimate the geographic location of the vehicle 100 .
[0088] The inertial measurement unit 122 is used to sense the position and orientation changes of the vehicle 100 based on inertial acceleration. In some embodiments, the inertial measurement unit 122 may be a combination of an accelerometer and a gyroscope.
[0089] The LiDAR 123 may utilize laser light to sense objects in the environment in which the vehicle 100 is located. In some embodiments, the LiDAR 123 may include one or more laser sources, a laser scanner, and one or more detectors, among other system components.
[0090] The millimeter wave radar 124 may utilize radio signals to sense objects in the surrounding environment of the vehicle 100. In some embodiments, in addition to sensing objects, the millimeter wave radar 124 may also be used to sense the speed and / or heading of the objects.
[0091] The ultrasonic radar 125 may sense objects around the vehicle 100 using ultrasonic signals.
[0092] The camera device 126 may be used to capture image information of the surrounding environment of the vehicle 100. The camera device 126 may include a monocular camera, a binocular camera, a structured light camera, a panoramic camera, etc. The image information acquired by the camera device 126 may include a static image or video stream information.
[0093] The decision control system 130 includes a computing system 131 for analyzing and making decisions based on the information obtained by the perception system 120. The decision control system 130 also includes a vehicle controller 132 for controlling the power system of the vehicle 100, and a steering system 133, a throttle 134 and a braking system 135 for controlling the vehicle 100.
[0094] The computing system 131 can be operated to process and analyze various information obtained by the perception system 120 in order to identify targets, objects and / or features in the environment surrounding the vehicle 100. Targets may include pedestrians or animals, and objects and / or features may include traffic signals, road boundaries and obstacles. The computing system 131 may use object recognition algorithms, Structure from Motion (SFM) algorithms, video tracking and other technologies. In some embodiments, the computing system 131 can be used to map the environment, track objects, estimate the speed of objects, and so on. The computing system 131 can analyze the various information obtained and derive a control strategy for the vehicle.
[0095] The vehicle controller 132 can be used to coordinate and control the vehicle's power battery and engine 141 to improve the power performance of the vehicle 100.
[0096] The steering system 133 is operable to adjust the forward direction of the vehicle 100. For example, in one embodiment, it may be a steering wheel system.
[0097] The throttle 134 is used to control the operating speed of the engine 141 and thus the speed of the vehicle 100 .
[0098] The braking system 135 is used to control the deceleration of the vehicle 100. The braking system 135 can use friction to slow down the wheels 144. In some embodiments, the braking system 135 can convert the kinetic energy of the wheels 144 into electric current. The braking system 135 can also take other forms to slow down the rotation speed of the wheels 144 to control the speed of the vehicle 100.
[0099] The drive system 140 may include components that provide power movement for the vehicle 100. In one embodiment, the drive system 140 may include an engine 141, an energy source 142, a transmission system 143, and wheels 144. The engine 141 may be an internal combustion engine, an electric motor, an air compression engine, or a combination of other types of engines, such as a hybrid engine consisting of a gasoline engine and an electric motor, or a hybrid engine consisting of an internal combustion engine and an air compression engine. The engine 141 converts the energy source 142 into mechanical energy.
[0100] Examples of energy source 142 include gasoline, diesel, other petroleum-based fuels, propane, other compressed gas-based fuels, ethanol, solar panels, batteries, and other sources of electricity. Energy source 142 may also provide energy to other systems of vehicle 100.
[0101] The transmission system 143 can transmit mechanical power from the engine 141 to the wheels 144. The transmission system 143 may include a gearbox, a differential, and a drive shaft. In one embodiment, the transmission system 143 may also include other devices, such as a clutch. Among them, the drive shaft may include one or more shafts that can be coupled to one or more wheels 144.
[0102] Some or all functions of the vehicle 100 are controlled by a computing platform 150. The computing platform 150 may include at least one processor 151 that may execute instructions 153 stored in a non-transitory computer-readable medium such as a memory 152. In some embodiments, the computing platform 150 may also be a plurality of computing devices that control individual components or subsystems of the vehicle 100 in a distributed manner.
[0103] The processor 151 may be any conventional processor, such as a commercially available CPU. Alternatively, the processor 151 may also include a graphics processor (Graphic Process Unit: GPU), a field programmable gate array (Field Programmable Gate Array: FPGA), a system on chip (System on Chip: SOC), an application specific integrated circuit (Application Specific Integrated Circuit: ASIC) or a combination thereof. Figure 1 The processor, memory, and other elements of the computer 110 in the same block are functionally illustrated, but it will be appreciated by those of ordinary skill in the art that the processor, computer, or memory may actually include multiple processors, computers, or memories that may or may not be stored in the same physical housing. For example, the memory may be a hard drive or other storage medium located in a housing different from the computer 110. Therefore, references to a processor or computer will be understood to include references to a collection of processors or computers or memories that may or may not operate in parallel. Different from using a single processor to perform the steps described herein, some components such as the steering assembly and the deceleration assembly may each have their own processor that performs only calculations related to the functions specific to the component.
[0104] In various aspects described herein, the processor may be located remote from the vehicle and in wireless communication with the vehicle. In other aspects, some of the processes described herein are performed on a processor disposed within the vehicle and others are performed by a remote processor, including taking the necessary steps to perform a single maneuver.
[0105] In some embodiments, the memory 152 may include instructions 153 (e.g., program logic) that may be executed by the processor 151 to perform various functions of the vehicle 100. The memory 152 may also include additional instructions, including instructions to send data to, receive data from, interact with, and / or control one or more of the infotainment system 110, the perception system 120, the decision control system 130, and the drive system 140.
[0106] In addition to instructions 153, memory 152 may also store data such as road maps, route information, the vehicle's location, direction, speed, and other such vehicle data, as well as other information. Such information may be used by vehicle 100 and computing platform 150 during operation of vehicle 100 in autonomous, semi-autonomous, and / or manual modes.
[0107] The computing platform 150 may control functions of the vehicle 100 based on input received from various subsystems, such as the drive system 140, the perception system 120, and the decision control system 130. For example, the computing platform 150 may utilize input from the decision control system 130 in order to control the steering system 133 to avoid an obstacle detected by the perception system 120. In some embodiments, the computing platform 150 may be operable to provide control over many aspects of the vehicle 100 and its subsystems.
[0108] Alternatively, one or more of the above-mentioned components may be installed or associated separately from the vehicle 100. For example, the memory 152 may exist partially or completely separately from the vehicle 100. The above-mentioned components may be communicatively coupled together in a wired and / or wireless manner.
[0109] Optionally, the above components are only examples. In actual applications, the components in the above modules may be added or deleted according to actual needs. Figure 1 It should not be understood as limiting the embodiments of the present invention.
[0110] An autonomous vehicle traveling on a road, such as vehicle 100 above, can identify objects in its surroundings to determine adjustments to the current speed. Objects can be other vehicles, traffic control devices, or other types of objects. In some examples, each identified object can be considered independently, and based on the object's respective characteristics, such as its current speed, acceleration, spacing from the vehicle, etc., can be used to determine the speed to be adjusted by the autonomous vehicle.
[0111] Optionally, the vehicle 100 or a sensing and computing device associated with the vehicle 100 (e.g., computing system 131, computing platform 150) can predict the behavior of the identified objects based on the characteristics of the identified objects and the state of the surrounding environment (e.g., traffic, rain, ice on the road, etc.). Optionally, each of the identified objects depends on the behavior of each other, so all of the identified objects can also be considered together to predict the behavior of a single identified object. The vehicle 100 can adjust its speed based on the predicted behavior of the identified objects. In other words, the autonomous vehicle can determine what stable state the vehicle will need to adjust to (e.g., accelerate, decelerate, or stop) based on the predicted behavior of the objects. In this process, other factors can also be considered to determine the speed of the vehicle 100, such as the lateral position of the vehicle 100 in the road it is traveling on, the curvature of the road, the proximity of static and dynamic objects, and the like.
[0112] In addition to providing instructions to adjust the speed of the autonomous vehicle, the computing device may also provide instructions to modify the steering angle of vehicle 100 so that the autonomous vehicle follows a given trajectory and / or maintains a safe lateral and longitudinal distance from objects near the autonomous vehicle (e.g., cars in adjacent lanes on the road).
[0113] The vehicle 100 may be a car, a truck, a motorcycle, a bus, a ship, an airplane, a helicopter, a lawn mower, an amusement vehicle, an amusement park vehicle, construction equipment, a tram, a golf cart, a train, etc., and the embodiment of the present invention does not make any particular limitation.
[0114] Figure 2 An information processing method provided by an embodiment of the present application is shown, the method comprising:
[0115] S201, obtaining target information of the vehicle
[0116] The target information includes at least one of status information and environment information. The status information is used to indicate the running status of the vehicle, and the environment information is used to indicate the surrounding environment of the vehicle.
[0117] Exemplarily, target information may be collected by various sensors installed on the vehicle, such as raw data such as traffic signs, traffic lights, lane lines, surrounding vehicles, pedestrians, and obstacle information. In the embodiment of the present application, the above-mentioned various sensors may include laser radar, millimeter wave radar, ultrasonic radar, monocular or binocular camera, etc. The above-mentioned target information may indicate the upper speed limit of the road, the lower speed limit, the vehicle stops ahead, whether it is possible to stop, turn left or right, the direction of the vehicle, the turning radius, the direction of the lanes on both sides, whether lane change is allowed, the position of the obstacle relative to the vehicle, the relative speed, and other information.
[0118] As another example, environmental information such as external pictures taken by the vehicle through a camera, point cloud data obtained by a lidar, obstacle / pedestrian data obtained by a distance sensor (range finder) can be obtained; status information such as the cabin temperature collected by a temperature sensor, the cabin image collected by an in-vehicle image sensor, traffic light data received through communication with traffic lights, other vehicle data obtained through communication with other vehicles, and the vehicle's own brake / tire pressure data can be obtained.
[0119] Optionally, the above environmental information includes at least one of road information, traffic light information, traffic sign information, other vehicle information, pedestrian information or obstacle information.
[0120] Exemplarily, the vehicle 100 can obtain various environmental information as shown in Table 1 through the sensor system 120. As can be seen from Table 1, various environmental information generated by traffic lights, traffic signs, other vehicles, pedestrians, road information and other obstacles can be collected through various sensors installed on the vehicle.
[0121] Table 1
[0122]
[0123]
[0124] In one possible implementation, the above environmental information can also be used to indicate road environments (such as highways, urban intersections, general urban roads, mountainous areas), time environments (such as morning, noon, evening and night, etc.) or weather environments (such as sunny days, rainy days, snowy days, foggy days or sandstorms).
[0125] Optionally, the above-mentioned status information includes at least one of vehicle speed, vehicle image, vehicle sound, vehicle temperature, vehicle tire pressure, driving mode, vehicle energy amount or in-vehicle air quality.
[0126] Exemplarily, the tire pressures of the four wheels of the vehicle can be obtained as 2.6 bar, 2.6 bar, 2.0 bar, and 2.6 bar, respectively, the total mileage is 168,633 kilometers (km), the motor speed is 13,568 revolutions per minute (rpm), the battery voltage is 336 volts (V), the remaining power is 86 kilowatts (kw), the battery power is 566 amperes (A), and the vehicle speed is 80 km / h.
[0127] S202: Generate intention information based on the above target information.
[0128] Among them, the above intention information is used to indicate the basis of the vehicle driving behavior.
[0129] For example, as shown in Table 2, the vehicle can determine the intention information corresponding to the basis for indicating the vehicle's driving behavior based on various types of target information. For example, if the target information obtained by the camera indicates that the traffic light is red or the countdown is about to end and turn red, the intention information generated based on the target information can be "red light has been recognized, and the vehicle is about to stop." That is, the basis for the vehicle's driving behavior of stopping is because the red light has been recognized.
[0130] Table 2
[0131]
[0132]
[0133] In a possible implementation, scene information may be generated based on the target information, where the scene information is used to indicate a driving scene of the vehicle; and the intention information may be determined based on the scene information.
[0134] For example, when a vehicle passes through a traffic light intersection, the traffic light can actively communicate with the vehicle or the vehicle can actively communicate with the traffic light, or the vehicle receives a broadcast from the traffic light. The vehicle analyzes the information received by the communication module and directly obtains that the traffic light is in the red light state, and determines the driving scenario that the vehicle is in / about to pass through the red light intersection. Then, based on the driving scenario information, the vehicle generates the intention information that the red light has been recognized and the vehicle is about to stop.
[0135] For another example, by analyzing the images captured by the external image sensor of the vehicle and combining the information from the distance sensor and infrared sensor / lidar, if there is a sidewalk ahead and pedestrians on / at both ends of the sidewalk, it is determined that the vehicle is in or is about to be in a driving scenario where it gives way to pedestrians. Then, based on the driving scenario information, information about the intention to slow down and give way to pedestrians is generated.
[0136] In a possible implementation, the above scene information can also be used to indicate road scenes (such as highways, urban intersections, general urban roads, mountainous areas), time scenes (such as morning, noon, evening and night, etc.) or weather scenes (such as sunny days, rainy days, snowy days, foggy days or sandstorms). Accordingly, corresponding intent information can also be generated according to the road scene, time scene or weather scene.
[0137] For example, when the scene information indicates that the current time scene is evening, the corresponding generated intention information may be "it is evening, turn on the lights inside the car."
[0138] For another example, when the scene information indicates that the current weather scene is rainy, the corresponding generated intention information may be "It is raining, turn on the wipers."
[0139] In one possible implementation, the above intention information is also used to indicate the driving behavior that the vehicle is performing or is about to perform.
[0140] Among them, the driving behavior that the vehicle is performing or is about to perform can be determined based on the instructions sent or executed by the vehicle. For example, the behavioral action corresponding to the deceleration instruction sent by the vehicle is deceleration, and the behavioral action corresponding to the brake stop instruction is stopping. Accordingly, the description of the behavioral action can be "about to decelerate", "slowing down", "about to stop", or "stopping".
[0141] It can be seen that in the method provided in the embodiment of the present application, the basis for the vehicle to indicate the vehicle's driving behavior and the intention information of the driving behavior that the vehicle is currently performing or is about to perform can be determined based on the vehicle's status information and environmental information, so that the user can understand the reason why the vehicle performs the action through the intention information, thereby improving the interactivity between the car and the user.
[0142] In related technologies, when making decisions, the vehicle tells the user the results of the vehicle's command execution but does not tell the reason. The user still cannot know why the vehicle performs these actions through the information provided by the vehicle computer and needs to actively observe the external environment to make a judgment, which leads to a lack of interactivity between the car and the user.
[0143] In the method provided in the embodiment of the present application, the intention information used by the vehicle to indicate the basis for the vehicle's driving behavior can be determined based on the vehicle's status information and environmental information, so that the user can understand the reason why the vehicle performs the action through the intention information, thereby improving the interactivity between the car and the user.
[0144] Optionally, the method provided in the embodiment of the present application may further include:
[0145] In a possible implementation, the intent information includes at least scene description information, and the scene description information can be generated based on the collected information.
[0146] The vehicle can determine the scene in which the vehicle is located based on the information collected by various sensor data, and then obtain the scene description information; the scene description information can also be a simple description of the collected information. Taking the pedestrian courtesy scene as an example, when the vehicle recognizes the pedestrian courtesy sign and there are pedestrians crossing the road sideways, the scene description information "the pedestrian courtesy sign is recognized" can be generated accordingly. Or, when there is no pedestrian courtesy sign, but a zebra crossing is recognized and there are pedestrians on the zebra crossing, the vehicle automatically recognizes it as a pedestrian courtesy scene based on the zebra crossing + the recognition of pedestrians, and the scene description information generated based on this can be "in the pedestrian courtesy scene". In other words, the scene description information is not unique in a scene, it only needs to be able to describe the scene that the vehicle is currently in.
[0147] At the same time, the vehicle can be in multiple scenarios at the same time, of which only one scenario related to the vehicle's execution of actions is what the user needs to know. Therefore, when generating intent information based on the scenario in which the vehicle is located, the target scenario can be determined in combination with the driving strategy to be executed, and then the intent information can be generated based on the target scenario. Because driving strategies are often associated with scenarios, specific driving strategies are executed in specific scenarios, and the execution of driving strategies is reflected in the vehicle's behavioral actions, therefore, the target scenario can be determined based on the driving strategy. Then generate scene description information for the target scene. For example, after determining that the target scene is a courteous pedestrian scene, the scene description information "in a courteous pedestrian scene" is generated, or further determining the information collected by the vehicle related to the courteous pedestrian scene, wherein the scene description information "recognized the courteous pedestrian sign" is generated based on the image recognition result "courteous pedestrian sign".
[0148] The intention information may also include a description of the driving strategy being executed. The driving strategy can be automatically determined based on the information collected by the vehicle. For example, in a pedestrian-friendly scenario, the strategy being executed is to give way to pedestrians, then the intention information may be "in a pedestrian-friendly scenario, giving way to pedestrians" or "identified the pedestrian-friendly sign, giving way to pedestrians", where "giving way to pedestrians" is the description of the driving strategy being executed. Regarding the determination of the driving strategy, reference may be made to the existing method for determining the driving strategy based on information collected by the vehicle, which is not the core point of the present invention.
[0149] The intention information may also include a description of the action that the vehicle is about to perform or is currently performing. The action that is about to be performed or is currently performing can be determined based on the instructions issued by the vehicle system. For example, the action corresponding to the deceleration instruction is deceleration, and the action corresponding to the brake stop instruction is parking. Accordingly, the description of the action may be "about to decelerate", "decelerating", "about to stop", "stopping".
[0150] Intent information can also include a description of driving intentions. After clarifying the scenario in which the vehicle is located, the vehicle can determine a driving intention based on the scenario in which it is located / the problem it faces. The driving intention is used to indicate the intention / purpose that the vehicle will achieve in the next period of time. For example, if the vehicle is about to be in a pedestrian-giving scenario, then according to the preset logic of the vehicle, it must give way to pedestrians. Therefore, the vehicle will implement a pedestrian-giving strategy in the next period of time and needs to stop and give way. The driving intention is to stop and give way. Similarly, when a vehicle passes a red light intersection, it will stop for the next period of time and wait for the red light to turn green. Therefore, the driving intention of the vehicle is to stop and wait for the red light to turn green.
[0151] S203: Send or display intention information.
[0152] The above-mentioned display may be in the form of text, pictures, videos, audio or other forms of display.
[0153] For example, the vehicle's intention information can be sent to electronic devices such as mobile phones, tablet computers, speakers or lighting equipment through a wireless communication system, so that users can understand the reason why the vehicle performs an action through electronic devices such as mobile phones, tablet computers, speakers or lighting equipment. After the vehicle obtains the intention information, it will notify the user of the intention information. In this way, after the user obtains the intention information, he can interpret the intention information in combination with the action currently being performed or about to be performed by the vehicle, and understand the action being performed or about to be performed by the vehicle through the interpretation of the intention information. In this way, by providing intention information, information communication between the user and the vehicle is achieved, which is more conducive to enhancing the user's understanding of the vehicle.
[0154] For example, a plurality of color lights corresponding to a plurality of intention information may be set. When the lighting device receives the intention information of the vehicle, the corresponding color lights may be displayed.
[0155] As another example, the intention information can be displayed to the user on the central control screen / instrument screen so that the user can understand the reason why the vehicle performs the action.
[0156] For example, a unified interface can be set up on the vehicle's central control screen / instrument screen to display intent information. For example, the interface can be set in the area where the vehicle's panoramic view is located, and displayed floating above the vehicle. On the one hand, the vehicle's panoramic view is an area that users view more frequently. On the other hand, when placed in this position, the user can understand the intent information in combination with various information on the panoramic view when obtaining intent information. The interface can always be displayed on the central control screen / instrument screen, so that the user knows to obtain intent information from this fixed location. It can also be activated in a specific mode, such as when the central control screen displays a panoramic image, the interface is displayed together.
[0157] Figure 3 The panoramic view of the vehicle is shown in the figure, which shows a panoramic simulated image of the surroundings of the vehicle and presents at least part of the environmental information in the panoramic view, such as traffic lights, zebra crossings, pedestrians / obstacles in close distance, etc. On the panoramic view, an interface is displayed in the floating display, and the current intention information is displayed in the interface as "Red light recognized, will stop", indicating that the vehicle will pass a red light intersection next and needs to slow down and stop to wait for the green light to pass. Therefore, the vehicle can provide the user with intention information before / during the execution of the action, and after the user captures the intention information, he can understand the action that the vehicle is performing / about to perform.
[0158] In addition to displaying the intention information to the user, the panoramic view of the vehicle can also display other information to the user. This embodiment of the present application does not limit this.
[0159] like Figure 3 As shown, the panoramic view of the vehicle can also display a search box and a navigation bar to the user. The search box can receive a location input by the user and query the location of the location and the route or travel plan from the current location to the location. The navigation bar can display the navigation route from the current location of the vehicle to the destination. The navigation bar can also display an image of the area near the current location of the vehicle (such as a two-dimensional plan view, a three-dimensional top view, a satellite view, or a panoramic view).
[0160] It should be noted that the generation of intention information can also be carried out in specific scenarios. For example, driving intentions are classified according to certain rules, and priority / importance can be configured for each category. For driving intentions with higher priority / importance or preset categories, intention information corresponding to the driving intention is generated, and those with lower priority / importance are not fed back. For example, the importance level of the driving intention to control the vehicle for braking is level 1, and the driving intention to control the fragrance, air conditioning and other systems in the car is level 2. For level 1 driving intentions, the intention information corresponding to the driving intention can be generated and presented to the user, while for level 2 driving intentions, no prompts are required. In this way, driving intention information with higher priority / importance can be fed back to the user, rather than the vehicle feeding back intention information every time it executes a driving intention.
[0161] S204: Send or display permanent information.
[0162] The above-mentioned permanent information includes at least one of the above-mentioned status information, navigation information or time information.
[0163] It is understandable that the intent information has a certain timeliness, and the intent information becomes invalid after the driving behavior is completed. If the last intent information is displayed, the intent information may provide wrong information to the user when the vehicle does not have relevant braking, thereby reducing the user's trust in the autonomous driving system. Therefore, the intent information displayed in the interface can no longer be displayed when the vehicle leaves the current driving scene (determined by the collected target information whether it is always in the same driving scene), or only delayed for a preset time. If the interface is directly "black screen" during the time when the intent information is not displayed, it will be more abrupt when displayed on the panoramic view because the interface has a certain area. To this end, the invalid intent information can be replaced by displaying permanent information after the intent information expires to improve the user experience.
[0164] For example, Figure 4As shown, the vehicle's intention information and driving mode can be switched through the vehicle's panoramic view. The intention information is invalidated after the driving behavior is completed, and the vehicle's driving mode (such as automatic parking, valet parking, smart driving navigation or lane cruising) is displayed to replace the vehicle's intention information, so as to avoid users browsing invalid intention information and reducing their trust in the autonomous driving system.
[0165] As another example, Figure 5 As shown, the vehicle's intention information and current time can be switched through the vehicle's panoramic view. The intention information is invalidated after the driving behavior is completed. The current time is displayed instead of the vehicle's intention information to avoid users browsing invalid intention information and reducing their trust in the autonomous driving system.
[0166] As another example, Figure 6 As shown, the vehicle's intention information and navigation information can be switched through the vehicle's panoramic view. The intention information is invalidated after the driving behavior is completed, and the vehicle's intention information is replaced by the navigation information to avoid users browsing the invalid intention information and reducing their trust in the autonomous driving system.
[0167] In some designs, the resident information can also change. For example, the displayed resident information changes with the interface of the central control screen. For example, when the central control screen displays the main screen, the resident information can be time information. When entering the panoramic mode, the resident information is displayed as the driving mode. Through this variable design of resident information, the interface can be displayed without being bound to the panoramic view, so it can also be resident on the main screen interface.
[0168] As the resident information and intent information change, the shape / position of the interface may also change. The change of resident information is usually a change of information type, that is, switching the type of resident information displayed among the above-mentioned multiple information. The change of intent information is mainly the change of quantity that causes the shape of the interface to change.
[0169] For example, when on the home screen, the permanent information is time information, which is presented using a time card / widget group. When entering the panoramic view interface, the permanent information is the driving mode, which is presented using a long strip interface. Figure 7 As shown in the figure, on the main screen, the interface is a time card, and the permanent information displayed is time information. When entering the panoramic view interface, the permanent information changes to driving mode. The change in the interface causes the position and shape of the intent information display interface to change.
[0170] For another example, the display carrier of the intent information and the resident information can change with the changes of the central control screen interface. The intent information and the resident information can dynamically determine the display carrier on the changed interface. If there is a control / interface that supports being a carrier on the changed interface, the content display of the control / interface will be temporarily changed.
[0171] In the same scenario, multiple intent messages may be generated. For example, when passing through a narrow road and passing a pedestrian-yielding intersection, two intent messages will exist at the same time: "Narrow road ahead, slow down" and "Yielding pedestrians". At this time, if the information is displayed in a carousel, the user can only see one intent message when looking at it. Therefore, the interface can be split into two parts, each part displays an intent message. The display methods of the two intent messages can be the same or different. For example, the intent message generated earlier only displays an icon (used to indicate the current scenario of the vehicle), and the latest intent message displays the icon and text information in full; or, both display the icon and text information in full.
[0172] Please refer to Figure 8 , Figure 8 The interface content presentation when two types of intention information are presented at the same time is shown respectively. It is assumed that the intention information presented before is "narrow road ahead, slow down and pass", which is presented in the form of icon plus text. Figure 8 In the example, when a new intent message is generated, the interface is first enlarged / lengthened, and the previous intent message is reduced to an icon, and the space occupied is reduced to a small area; the new intent message is presented using icons + text, occupying a larger area. Then the two intent messages alternately use the display methods of "icon only" and "icon + text", that is, at the same time, one intent message occupies a smaller area and only displays an icon to represent the intent information, and the other intent message occupies a larger area and displays the intent information completely through icons + text.
[0173] S205: Generate behavior information according to the above target information.
[0174] Among them, the above-mentioned behavior information is used to indicate the vehicle driving behavior.
[0175] For example, the scene information can be determined based on the above target information. After the scene information is obtained, the scene information can be used as input according to the preset judgment logic to output an execution instruction, which is used to control the vehicle to produce an action to match the current scene of the vehicle. For example, if a red light is recognized, the vehicle will stop; if a pedestrian-giving scene is recognized, the vehicle will decelerate to a stop.
[0176] Specifically, after determining the driving intention, the vehicle needs to determine the corresponding execution strategy to achieve the driving intention. Based on the determined execution strategy, the vehicle generates corresponding execution instructions, which control the vehicle to generate a series of behavioral actions, such as deceleration, braking, and turning on / off a specific driving mode.
[0177] It should be noted that the generation of behavior information and intention information can be synchronous, that is, the intention information can be generated according to the above target information while the behavior information is generated according to the above target information.
[0178] In a possible implementation, the behavior information may be directly generated according to the above target information.
[0179] In another possible implementation, the intention information may be generated according to the target information, and the behavior information may be determined according to the generated intention information.
[0180] Exemplarily, as shown in Table 3, corresponding behavior information indicating vehicle driving behavior may be determined based on various types of generated intention information. For example, behavior information indicating vehicle deceleration may be generated based on the intention information of "narrow road ahead, slow down and pass".
[0181] Table 3
[0182]
[0183]
[0184] S206: Control the vehicle according to the behavior information.
[0185] It should be noted that the specific implementation method of controlling the vehicle according to the behavior information can be any method that can be thought of by a person skilled in the art, and the embodiments of the present application do not limit this. For example, an execution instruction can be generated according to the behavior information, and after the execution instruction is generated, the vehicle generates a corresponding photoelectric signal according to the execution instruction, and transmits the photoelectric signal to various vehicle components to achieve behavioral actions such as deceleration and braking.
[0186] The following will be combined Fig. 9 An information processing device for executing the above information processing method is introduced.
[0187] It is understandable that, in order to realize the above functions, the information processing device includes hardware and / or software modules corresponding to the execution of each function. In combination with the algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application in combination with the embodiments, but such implementation should not be considered to exceed the scope of the embodiments of the present application.
[0188] The embodiment of the present application can divide the functional modules of the information processing device according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware. It should be noted that the division of modules in this embodiment is schematic and is only a logical function division. There may be other division methods in actual implementation.
[0189] In the case of dividing each functional module into corresponding functional modules, Fig. 9 A possible schematic diagram of the composition of the information processing device involved in the above embodiment is shown. Fig. 9 As shown, the information processing device 900 may include: a transceiver unit 901 and a processing unit 902 .
[0190] The transceiver unit 901 is used to obtain target information of the vehicle, and the target information includes at least one of state information and environmental information. The state information is used to indicate the operating status of the vehicle, and the environmental information is used to indicate the environmental status of the vehicle's surroundings.
[0191] The processing unit 902 is used to generate intention information according to the target information, and the intention information is used to indicate the basis of the vehicle driving behavior.
[0192] In a possible implementation, the processing unit 902 is specifically used to: generate scene information according to the target information, where the scene information is used to indicate the driving scene of the vehicle; and determine the intention information according to the scene information.
[0193] In a possible implementation, the transceiver unit 901 is further configured to send or display the intention information.
[0194] In a possible implementation, the transceiver unit 901 is further used to: generate behavior information according to the target information, the behavior information is used to indicate the driving behavior of the vehicle; and control the vehicle according to the behavior information.
[0195] In one possible implementation, the above intention information is also used to indicate the driving behavior that the vehicle is performing or is about to perform.
[0196] In a possible implementation, the transceiver unit 901 is further configured to send or display resident information, where the resident information includes at least one of the status information, navigation information, or time information.
[0197] Optionally, the above environmental information includes at least one of road information, traffic light information, traffic sign information, other vehicle information, pedestrian information or obstacle information.
[0198] Optionally, the above-mentioned status information includes at least one of vehicle speed, vehicle image, vehicle sound, vehicle temperature, vehicle tire pressure, driving mode, vehicle energy amount or in-vehicle air quality.
[0199] The embodiment of the present application also provides a chip. Fig.10 1 shows a schematic diagram of the structure of a chip 1000. The chip 1000 includes one or more processors 1001 and an interface circuit 1002. Optionally, the chip 1000 may also include a bus 1003.
[0200] The processor 1001 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above information processing method may be completed by an integrated logic circuit of hardware in the processor 1001 or by instructions in the form of software.
[0201] Optionally, the processor 1001 may be a general purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components. The methods and steps disclosed in the embodiments of the present application may be implemented or executed. The general purpose processor may be a microprocessor or the processor may be any conventional processor, etc.
[0202] The interface circuit 1002 can be used to send or receive data, instructions or information. The processor 1001 can use the data, instructions or other information received by the interface circuit 1002 to process, and can send the processing completion information through the interface circuit 1002.
[0203] Optionally, the chip also includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include a non-volatile random access memory (NVRAM).
[0204] Optionally, the memory stores executable software modules or data structures, and the processor can perform corresponding operations by calling operation instructions stored in the memory (the operation instructions can be stored in the operating system).
[0205] Optionally, the chip can be used in the information processing device involved in the embodiment of the present application. Optionally, the interface circuit 1002 can be used to output the execution result of the processor 1001. The information processing method provided by one or more embodiments of the embodiment of the present application can refer to the aforementioned embodiments, which will not be repeated here.
[0206] It should be noted that the corresponding functions of the processor 1001 and the interface circuit 1002 can be implemented through hardware design, software design, or a combination of hardware and software, and there is no limitation here.
[0207] Fig.11 1 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. The electronic device 1100 may be a processor or a chip or a functional module in a processor. Fig.11 As shown, the electronic device 1100 includes a processor 1101 , a transceiver 1102 and a communication line 1103 .
[0208] Among them, the processor 1101 is used to execute any step in the information processing method provided in the embodiment of the present application, and in the process of executing any step in the information processing method provided in the embodiment of the present application, the transceiver 1102 and the communication line 1103 can be selectively called to complete the corresponding operation.
[0209] Furthermore, the electronic device 1100 may also include a memory 1104. The processor 1101, the memory 1104 and the transceiver 1102 may be connected via a communication line 1103.
[0210] The processor 1101 is a processor, a general-purpose processor, a network processor (NP), a digital signal processor (DSP), a microprocessor, a microcontroller, a programmable logic device (PLD), or any combination thereof. The processor 1101 may also be other devices with processing functions, such as circuits, devices, or software modules, without limitation.
[0211] The transceiver 1102 is used to communicate with other devices or other communication networks, and other communication networks may be Ethernet, radio access network (RAN), wireless local area network (WLAN), etc. The transceiver 1102 may be a module, a circuit, a transceiver or any device capable of achieving communication.
[0212] The transceiver 1102 is mainly used for sending and receiving commands and information, etc., and may include a transmitter and a receiver, which respectively send and receive commands and information, etc.; operations other than sending and receiving commands and information, etc. are implemented by the processor.
[0213] The communication line 1103 is used to transmit information between the components included in the electronic device 1100.
[0214] In one design, the processor may be considered as the logic circuit and the transceiver may be considered as the interface circuit.
[0215] The memory 1104 is used to store instructions, where the instructions may be computer programs.
[0216] The memory 1104 may be a volatile memory or a nonvolatile memory, or may include both volatile and nonvolatile memories. The nonvolatile memory may be a read-only memory (ROM), a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable programmable ROM (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of RAM are available, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLD RAM), and direct rambus RAM (DRRAM). The memory 1104 may also be a compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compact disc, laser disc, optical disc, digital versatile disc, Blu-ray disc, etc.), magnetic disk storage media or other magnetic storage devices, etc. It should be noted that the memory of the systems and methods described herein is intended to include, but is not limited to, these and any other suitable types of memory.
[0217] It should be noted that the memory 1104 can exist independently of the processor 1101, or can be integrated with the processor 1101. The memory 1104 can be used to store instructions or program codes or some data, etc. The memory 1104 can be located inside the electronic device 1100, or outside the electronic device 1100, without limitation. The processor 1101 is used to execute the instructions stored in the memory 1104 to implement the method provided in the above embodiment of the present application.
[0218] In one example, the processor 1101 may include one or more processors, such as Fig.11 Processor 0 and processor 1 in.
[0219] As an optional implementation, the electronic device 1100 includes multiple processors, for example, Fig.11 In addition to the processor 1101, a processor 1107 may also be included.
[0220] As an optional implementation, the electronic device 1100 further includes an output device 1105 and an input device 1106. Exemplarily, the input device 1106 is a keyboard, a mouse, a microphone, a joystick, and the like, and the output device 1105 is a display screen, a speaker, and the like.
[0221] It should be noted that the electronic device 1100 may be a chip system or a Fig.11 Devices with similar structures in the chip system. Among them, the chip system can be composed of chips, or it can include chips and other discrete devices. The actions, terms, etc. involved in the various embodiments of this application can refer to each other without limitation. The message name or parameter name in the message exchanged between the various devices in the embodiment of this application is only an example, and other names can also be used in the specific implementation without limitation. In addition, Fig.11 The components shown in the figure do not constitute a limitation on the electronic device 1100. Fig.11 In addition to the components shown, the electronic device 1100 may include Fig.11 More or fewer components may be shown, or certain components may be combined, or the components may be arranged differently.
[0222] The processor and transceiver described in the present application can be implemented in an integrated circuit (IC), an analog IC, a radio frequency integrated circuit, a mixed signal IC, an application specific integrated circuit (ASIC), a printed circuit board (PCB), an electronic device, etc. The processor and transceiver can also be manufactured using various IC process technologies, such as complementary metal oxide semiconductor (CMOS), N-type metal oxide semiconductor (NMOS), P-type metal oxide semiconductor (positive channel metal oxide semiconductor, PMOS), bipolar junction transistor (BJT), bipolar CMOS (BiCMOS), silicon germanium (Si Ge), gallium arsenide (GaAs), etc.
[0223] Fig.12 This is a schematic diagram of the structure of an information processing device provided in an embodiment of the present application. The information processing device can be applied to the scenario shown in the above method embodiment. For the convenience of explanation, Fig.12 Only the main components of the information processing device are shown, including a processor 1201, a memory 1202, a control circuit 1203, and an input-output device 1204. The processor 1201 is mainly used to process the communication protocol and communication data, execute the software program, and process the data of the software program. The memory 1202 is mainly used to store the software program and data. The control circuit 1203 is mainly used for power supply and transmission of various electrical signals. The input-output device 1204 is mainly used to receive data input by the user and output data to the user.
[0224] When the information processing device is a processor 1201, the control circuit 1203 can be a mainboard, the memory 1202 includes a hard disk, RAM, ROM and other media with storage functions, the processor 1201 can include a baseband processor 1201 and a central processing unit, the baseband processor is mainly used to process the communication protocol and communication data, the central processing unit is mainly used to control the entire information processing device, execute software programs, and process the data of the software programs, and the input and output device 1204 includes a display screen, a keyboard and a mouse, etc.; the control circuit 1203 can further include or connect a transceiver circuit or a transceiver, such as: a network cable interface, etc., for sending or receiving data or signals, such as data transmission and communication with other devices. Further, it can also include an antenna for sending and receiving wireless signals, and for data / signal transmission with other devices.
[0225] An embodiment of the present application also provides an information processing device, which includes: at least one processor, when the at least one processor executes program code or instructions, the above-mentioned related method steps are implemented to implement the information processing method in the above-mentioned embodiment.
[0226] Optionally, the device may further include at least one memory, and the at least one memory is used to store the program code or instruction.
[0227] An embodiment of the present application also provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on an information processing device, the information processing device executes the above-mentioned related method steps to implement the information processing method in the above-mentioned embodiment.
[0228] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer is caused to execute the above-mentioned related steps to implement the information processing method in the above-mentioned embodiment.
[0229] The embodiment of the present application also provides an information processing device, which may be a chip, an integrated circuit, a component or a module. Specifically, the device may include a connected processor and a memory for storing instructions, or the device includes at least one processor for obtaining instructions from an external memory. When the device is running, the processor may execute instructions so that the chip executes the information processing method in each of the above method embodiments.
[0230] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.
[0231] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.
[0232] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0233] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0234] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, and may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0235] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.
[0236] If the above functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the above methods in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.
[0237] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.
Claims
1. An information processing method, characterized in that: The method comprises: Acquire target information of the vehicle, the target information including at least one of state information and environment information, the state information is used to indicate the running status of the vehicle, and the environment information is used to indicate the surrounding environment of the vehicle; Intention information is generated based on the target information, and the intention information is used to indicate the basis of the vehicle driving behavior.
2. The method according to claim 1, characterized in that The generating the intention information according to the target information includes: generating scene information according to the target information, wherein the scene information is used to indicate a driving scene of the vehicle; The intention information is determined based on the scene information.
3. The method according to claim 1 or 2, characterized in that: The method further comprises: Send or display the intent information.
4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: generating behavior information according to the target information, wherein the behavior information is used to indicate the driving behavior of the vehicle; The vehicle is controlled according to the behavior information.
5. The method according to any one of claims 1 to 4, characterized in that The intention information is also used to indicate the driving behavior that the vehicle is currently performing or is about to perform.
6. The method according to any one of claims 1 to 5, characterized in that The method further comprises: Send or display permanent information, where the permanent information includes at least one of the status information, navigation information or time information.
7. The method according to any one of claims 1 to 6, characterized in that The environmental information includes at least one of road information, traffic light information, traffic sign information, other vehicle information, pedestrian information or obstacle information.
8. The method according to any one of claims 1 to 7, characterized in that The status information includes at least one of vehicle speed, vehicle image, vehicle sound, vehicle temperature, vehicle tire pressure, driving mode, vehicle energy amount or in-vehicle air quality.
9. An information processing device, characterized in that: The device comprises a transceiver unit and a processing unit; The transceiver unit is used to obtain target information of the vehicle, wherein the target information includes at least one of state information and environmental information, wherein the state information is used to indicate the running status of the vehicle, and the environmental information is used to indicate the surrounding environment of the vehicle; The processing unit is used to generate intention information based on the target information, and the intention information is used to indicate the basis of the vehicle driving behavior.
10. The device according to claim 9, characterized in that The processing unit is specifically used for: generating scene information according to the target information, wherein the scene information is used to indicate a driving scene of the vehicle; The intention information is determined based on the scene information.
11. The device according to claim 9 or 10, characterized in that The transceiver unit is also used for: Send or display the intent information.
12. The device according to any one of claims 9 to 11, characterized in that The transceiver unit is also used for: generating behavior information according to the target information, wherein the behavior information is used to indicate the driving behavior of the vehicle; The vehicle is controlled according to the behavior information.
13. The device according to any one of claims 9 to 12, characterized in that The intention information is also used to indicate the driving behavior that the vehicle is currently performing or is about to perform.
14. The device according to any one of claims 9 to 13, characterized in that The transceiver unit is also used for: Send or display permanent information, where the permanent information includes at least one of the status information, navigation information or time information.
15. The device according to any one of claims 9 to 14, characterized in that The environmental information includes at least one of road information, traffic light information, traffic sign information, other vehicle information, pedestrian information or obstacle information.
16. The device according to any one of claims 9 to 15, characterized in that The status information includes at least one of vehicle speed, vehicle image, vehicle sound, vehicle temperature, vehicle tire pressure, driving mode, vehicle energy amount or in-vehicle air quality.
17. An information processing device, comprising at least one processor and a memory, characterized in that: The at least one processor executes a program or instruction stored in the memory, so that the information processing device implements the method according to any one of claims 1 to 8.
18. A computer-readable storage medium for storing a computer program, characterized in that: When the computer program is executed on a computer or a processor, the computer or the processor is enabled to implement the method according to any one of claims 1 to 8.
19. A computer program product, comprising instructions, characterized in that: When the instructions are executed on a computer or a processor, the computer or the processor is enabled to implement the method according to any one of claims 1 to 8.
20. A chip comprising at least one processor and a memory, characterized in that: The at least one processor executes a program or instruction stored in the memory, so that the information processing device implements the method according to any one of claims 1 to 8.
21. A vehicle, characterized in that: The device comprises the information processing device according to any one of claims 9 to 16.
Citation Information
Patent Citations
Travel control device, onboard display device, and travel control system
CN106103232A
Information prompting system and method for unmanned vehicle and unmanned vehicle
CN110930745A
Information prompting system and method for automatic driving vehicle
CN112721797A
Generation and presentation of interpretations related to behavior of automation control system
CN114815676A
Driving support system and guide voice output method
JP2008097501A
Cited By
Interaction method and apparatus, and vehicle
WO2026170442A1
