Information processing method and device and vehicle
By obtaining and analyzing the guidance information of the target user in the car, and combining the vehicle's driving environment information, driving guidance information is determined and output, the problem of difficult-to-understand opinions in the car is solved, and driving safety and passenger satisfaction are improved.
Patent Information
- Application Number
- CN202411721672.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2025-03-18
AI Technical Summary
During the vehicle's driving, the guidance of the personnel in the vehicle is difficult to correctly understand by the driver or the unmanned driving system.
By obtaining the guidance information output by the target user in the target vehicle, and combining the driving environment information in which the vehicle is located, the driving guidance information is determined and output. The method includes obtaining guidance information, obtaining driving environment information, determining driving guidance information and outputting.
It effectively solves the problem that the opinions of people in the car are difficult to understand, improves the understanding and implementation of passenger opinions by drivers or autonomous driving systems, improves passengers' sense of participation and satisfaction, and reduces potential safety risks caused by misunderstandings.
Smart Images
Figure CN119642834A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of information processing technology, and in particular to an information processing method, device and vehicle. Background Art
[0002] While the vehicle is driving, people in the vehicle will express their opinions on the driving or operation of the vehicle based on their own behavior. However, these opinions are difficult for the driver or the unmanned driving system to understand correctly. Summary of the invention
[0003] The present disclosure provides an information processing method, device and vehicle to at least solve the above technical problems existing in the prior art.
[0004] According to a first aspect of the present disclosure, there is provided an information processing method, the method comprising:
[0005] Obtaining guidance information output by a target user in a target vehicle;
[0006] Obtaining target information corresponding to the driving environment of the target vehicle;
[0007] determining driving guidance information according to the guidance information and the target information;
[0008] The driving guidance information is outputted.
[0009] In one possible implementation manner, the obtaining of target information corresponding to the driving environment of the target vehicle includes:
[0010] The target information is obtained by collecting the external environment of the target vehicle through the information collection device of the target vehicle.
[0011] In one possible implementation manner, the guidance information includes pointing action information; and determining the driving guidance information according to the guidance information and the target information includes:
[0012] Determining the pointing direction corresponding to the pointing action information;
[0013] Determining a target pointing position from an external environment of the target vehicle according to the target information;
[0014] The driving guidance information is determined according to the target pointing position.
[0015] In one possible implementation manner, the target user is a non-driver user, and the outputting the driving guidance information includes:
[0016] Obtaining a target eye position corresponding to the driver's eye position;
[0017] The driving guidance information is displayed on a head-up display device according to the target eye position and the target pointing position.
[0018] In one possible implementation manner, the guidance information includes voice guidance information, and the target information includes environmental image information; and determining the driving guidance information according to the guidance information and the target information includes:
[0019] Analyzing the voice guidance information to determine a first object in the voice guidance information;
[0020] determining a second object corresponding to the first object from the target image information;
[0021] The driving guidance information is determined according to the second object.
[0022] In one possible implementation manner, the guidance information includes touch information on a target screen, and the target information includes environmental image information; and determining the driving guidance information according to the guidance information and the target information includes:
[0023] Displaying the environmental image information on the target screen;
[0024] determining a target object from the environmental image information according to the touch information;
[0025] The driving guidance information is determined according to the target object.
[0026] In one possible implementation, the outputting the driving guidance information includes at least one of the following:
[0027] Outputting the driving guidance information on a map navigation interface;
[0028] broadcasting the driving guidance information by voice;
[0029] Displaying the driving guidance information on a head-up display device;
[0030] The driving guidance information is sent to the automatic driving control unit.
[0031] In one possible implementation manner, the target information is map information, the guidance information is voice guidance information, and the determining of driving guidance information according to the guidance information and the target information includes:
[0032] determining navigation information according to the voice guidance information and the map information;
[0033] The outputting the driving guidance information comprises:
[0034] The navigation information is displayed on the map navigation interface.
[0035] According to a second aspect of the present disclosure, there is provided an information processing device, the device comprising:
[0036] A first acquisition module is used to acquire guidance information output by a target user in a target vehicle;
[0037] A second acquisition module is used to obtain target information corresponding to the driving environment of the target vehicle;
[0038] A determination module, configured to determine driving guidance information according to the guidance information and the target information;
[0039] An output module outputs the driving guidance information.
[0040] According to a third aspect of the present disclosure, there is provided a vehicle, comprising:
[0041] at least one processor; and
[0042] a memory communicatively connected to the at least one processor; wherein,
[0043] The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method described in the present disclosure.
[0044] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing computer instructions is provided, wherein the computer instructions are used to cause the computer to execute the method described in the present disclosure.
[0045] The present invention discloses an information processing method, device and vehicle, the method comprising: obtaining guidance information output by a target user in a target vehicle; obtaining target information corresponding to a driving environment in which the target vehicle is located; determining driving guidance information according to the guidance information and the target information; and outputting the driving guidance information.
[0046] It should be understood that the content described in this section is not intended to identify the key or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0047] The above and other objects, features and advantages of the exemplary embodiments of the present disclosure will become readily understood by reading the detailed description below with reference to the accompanying drawings. In the accompanying drawings, several embodiments of the present disclosure are shown in an exemplary and non-limiting manner, in which:
[0048] In the drawings, the same or corresponding reference numerals represent the same or corresponding parts.
[0049] Figure 1 A schematic diagram of the implementation process of the information processing method according to the embodiment of the present disclosure is shown;
[0050] Figure 2 The schematic diagram of the implementation process of determining driving guidance information in the embodiment of the present disclosure is shown. Figure 1 ;
[0051] Figure 3 A schematic diagram of the implementation process of outputting driving guidance information according to an embodiment of the present disclosure is shown;
[0052] Figure 4 The schematic diagram of the implementation process of determining driving guidance information in the embodiment of the present disclosure is shown. Figure 2 ;
[0053] Figure 5 The schematic diagram of the implementation process of determining driving guidance information in the embodiment of the present disclosure is shown. Figure 3 ;
[0054] Figure 6 A schematic diagram showing the structure of an information processing device according to an embodiment of the present disclosure is shown;
[0055] Figure 7 A schematic diagram of the structure of a vehicle according to an embodiment of the present disclosure is shown. DETAILED DESCRIPTION
[0056] In order to make the purpose, features, and advantages of the present disclosure more obvious and easy to understand, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the drawings in the embodiments of the present disclosure. Obviously, the described embodiments are only part of the embodiments of the present disclosure, not all of the embodiments. Based on the embodiments in the present disclosure, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present disclosure.
[0057] The present disclosure provides an information processing method, such as Figure 1 As shown, the method includes:
[0058] Step 101: Obtain guidance information output by a target user in a target vehicle.
[0059] In this example, in the target vehicle, the guidance information provided by the target user in the vehicle is obtained in real time. The target user can be a non-driving passenger, including at least one of the following: a passenger sitting in the co-pilot seat or the back seat, a passenger sitting in the driver's seat in the automatic driving state. The guidance information provided by the target user refers to an instruction or request to the driver or the automatic driving system, such as the destination the user wants to go to, the driving operation he wants to perform (such as steering, parking, etc.) or other specific needs related to driving. The guidance information can be a single type of information output by the target user, or it can be multiple types of information output by the target user at the same time.
[0060] Step 102: Obtain target information corresponding to the driving environment of the target vehicle.
[0061] In this example, data related to the driving environment in which the target vehicle is currently located is collected and acquired in real time to obtain target information. The target information may include real-time image data, radar data, etc. of the driving environment in which the target vehicle is located, and may also include map navigation information of the target vehicle, etc.
[0062] Step 103: Determine driving guidance information according to the guidance information and the target information.
[0063] In this example, based on the guidance information provided by the target user in the above steps and the collected target information, driving guidance information suitable for the current driving condition of the target vehicle is generated. The driving guidance information can be a navigation instruction (such as the destination the target user wants to go to) or a driving operation instruction (such as a steering instruction, an acceleration instruction), etc.
[0064] Step 104: Output driving guidance information.
[0065] In this example, the generated driving guidance information is output to ensure that the driver or the automatic driving control unit can receive the information clearly and in a timely manner, so as to make appropriate driving decisions based on the driving guidance information to meet the needs of the target users.
[0066] The present disclosure provides an information processing method, which includes: obtaining guidance information output by a target user in a target vehicle; obtaining target information corresponding to a driving environment in which the target vehicle is located; determining driving guidance information according to the guidance information and the target information; and outputting the driving guidance information.
[0067] By obtaining driving suggestions from non-driving passengers and combining them with the vehicle's environmental information, the driver or the autonomous driving control unit can make safer driving decisions and reduce potential safety risks caused by misunderstanding of passenger opinions. At the same time, passengers can participate more effectively in the driving process, and their opinions can be correctly understood and implemented, which improves passenger participation and satisfaction.
[0068] In one example, obtaining target information corresponding to the driving environment of the target vehicle includes: collecting the external environment of the target vehicle through an information collection device of the target vehicle to obtain the target information.
[0069] In this example, a special information collection device is provided on the target vehicle to collect the real external environment data of the target vehicle in real time, such as a camera, radar, sensor, etc. The information collection device can monitor and collect the environmental data of the target vehicle in real time, such as image data, radar data, sensor detection data, etc., to obtain target information.
[0070] In one example, the guidance information includes pointing action information; the driving guidance information is determined according to the guidance information and the target information, such as Figure 2 As shown, including:
[0071] Step 201: Determine the pointing direction corresponding to the pointing action information.
[0072] In this example, the guidance information of the target user may include pointing action information. When the target user points his finger in a certain direction, the gesture action and action trajectory of the target user are acquired through an image acquisition device (such as a camera or an infrared sensor) provided in the vehicle to obtain the pointing action information of the target user. The pointing direction corresponding to the pointing action information is determined by analyzing the gesture action and action trajectory of the target user. The pointing direction includes the direction of the finger (such as up, down, left, right, etc.) and the angle of the finger.
[0073] For example, the camera captures the image data of the target user's gesture movements and movement trajectories in real time to obtain the target user's pointing movement information, and then performs image recognition and gesture analysis to determine that the finger pointing direction corresponding to the pointing movement information is "right" and the finger pointing angle.
[0074] Step 202: Determine the target pointing position from the external environment of the target vehicle according to the target information.
[0075] In this example, based on the target information of the target vehicle collected by the information collection device, a three-dimensional space scene of the internal environment and the external environment of the target vehicle is constructed, and combined with the pointing direction corresponding to the pointing action information of the target user in the above steps, the target pointing position corresponding to the pointing direction is determined in the external environment of the target vehicle. The target pointing position can be a specified object or person, or a specified area.
[0076] Continuing from the previous example, the real-time image data of the target vehicle inside and outside the vehicle is obtained through the cameras installed inside and outside the vehicle, and a three-dimensional space scene of the internal and external environment of the target vehicle is constructed. Combined with the pointing direction ("right" and the angle of the finger pointing) in the target user's pointing action information, the finger is used as the starting point to determine the pointing target position from the constructed three-dimensional space scene, such as determining that the pointing target position is a large tree on the roadside to the right of the vehicle.
[0077] Step 203: Determine driving guidance information according to the target pointing position.
[0078] In this example, the driving guidance information is determined according to the target pointing position and output in an appropriate manner. The driver or the automatic driving control unit drives the vehicle according to the driving guidance information to meet the needs of the target user.
[0079] In some embodiments, the guidance information includes pointing action information and voice guidance information, and determining the driving guidance information according to the target pointing position includes: determining the driving guidance information according to the target pointing position and the voice guidance information.
[0080] In one example, the target user is a non-driver user, and the non-driver user is a user sitting in the front passenger seat or the back seat. The implementation process of outputting driving guidance information is as follows: Figure 3 As shown, including:
[0081] Step 301: Acquire a target eye position corresponding to the driver's eye position.
[0082] In this example, the driver's facial image is captured in real time by an image acquisition device installed inside the vehicle, and the target eye position corresponding to the driver's eye position is accurately identified by eye tracking technology.
[0083] In addition, the driver's eye position can be estimated by simulating the movement of the driver's eye position in the driving scene, thereby directly obtaining the preset target eye position.
[0084] Step 302: Display driving guidance information on a head-up display device according to the target eye position and the target pointing position.
[0085] In this example, the driving guidance information is displayed on a head-up display (HUD) according to the target pointing position and the target eye position of the driver. For example, the driving guidance information is projected onto the head-up display in the form of a virtual image, so that the driving guidance information is displayed at an appropriate position in front of the driver's line of sight, realizing intuitive display of the driving guidance information.
[0086] In one example, the guidance information includes voice guidance information, and the target information includes environmental image information; the implementation process of the driving guidance information is determined according to the guidance information and the target information, such as Figure 4 As shown, including:
[0087] Step 401: Analyze the voice guidance information to determine the first object in the voice guidance information.
[0088] In this example, the guidance information of the target user may also include voice guidance information. A voice collection device (such as a microphone) inside the target vehicle collects the voice of the target user in real time to obtain voice guidance information. The first object in the voice guidance information is determined by analyzing the text content of the voice guidance information.
[0089] For example, the target user's voice is collected through a microphone, and the text content of the voice guidance information is obtained as "Stop at the intersection ahead". By analyzing the text content, it is determined that the first object in the voice guidance information is "the intersection ahead".
[0090] Step 402: Determine a second object corresponding to the first object from the target image information.
[0091] In this example, the target information includes real-time environmental image information outside the vehicle. In response to determining a first object in the voice guidance information of the target user, target recognition is performed on the environmental image information outside the vehicle to determine a second object corresponding to the first object.
[0092] Step 403: Determine driving guidance information according to the second object.
[0093] In this example, if the second object can be found in the environmental image information, the driving guidance information is determined based on the second object and output in an appropriate manner, and the driver or the automatic driving control unit drives the vehicle according to the driving guidance information to meet the needs of the target user.
[0094] In one example, the guidance information includes touch information on the target screen, and the target information includes environmental image information; the implementation process of the driving guidance information is determined according to the guidance information and the target information, such as Figure 5 As shown, including:
[0095] Step 501: Displaying environmental image information on a target screen.
[0096] In this example, the target screen refers to a display device in the vehicle that can display image information, such as a central control display screen, a mobile phone, a tablet computer, etc. The information collection device outside the target vehicle can display the real-time environment image information outside the vehicle on the target screen, and show the target user the current surrounding environment image outside the vehicle.
[0097] Step 502: Determine a target object from the environmental image information according to the touch information.
[0098] In this example, the target user determines the target object from the environmental image information displayed on the target screen by performing touch operations on the target screen, such as clicking, sliding, etc. The target object is an object corresponding to the image area determined by the target user through touch on the target screen, and may be a certain intersection, building, traffic sign, person, etc. displayed in the environmental image information.
[0099] Step 503: Determine driving guidance information according to the target object.
[0100] In this example, based on the target object, driving guidance information is determined and output in an appropriate manner. For example, according to the location, image and other information of the target object, corresponding driving guidance information is generated, and the driver or the automatic driving control unit drives the vehicle according to the driving guidance information to meet the needs of the target user.
[0101] In one example, outputting driving guidance information includes at least one of the following: outputting driving guidance information on a map navigation interface; broadcasting driving guidance information by voice; displaying driving guidance information on a head-up display device; and sending driving guidance information to an automatic driving control unit.
[0102] In this example, there are multiple ways to output driving guidance information, suitable for different driving scenarios:
[0103] The first output method is to output driving guidance information in a map navigation interface. The navigation path or driving suggestions of the target object are displayed on the map navigation interface of the navigation screen in the car. According to the content presented on the map navigation interface, the driver drives the vehicle to the target object or changes the driving strategy according to the driving suggestions.
[0104] For example, according to the touch information of the target user on the target screen, after confirming the target object from the environmental image information displayed on the target screen, the location information of the target object is obtained and a navigation path is generated to obtain driving guidance information. The driving guidance information is output on the map navigation interface, and the driver drives the vehicle to the target object according to the navigation path in the map navigation interface.
[0105] The second output method is to output driving guidance information by voice broadcast. The navigation path or driving suggestions of the target object are broadcasted by the voice output device in the car. According to the driving guidance information broadcasted by voice, the driver drives the vehicle to the target object or changes the driving strategy according to the driving suggestions.
[0106] For example, after determining the target pointing position from the target information according to the pointing action information of the target user, the driving suggestion is determined according to the target pointing position to obtain the driving guidance information. Subsequently, the driving suggestion is outputted in the form of voice broadcast, so that the driver can drive the vehicle according to the driving suggestion.
[0107] The third output method is to display driving guidance information on a head-up display device. The navigation path or driving suggestions of the target object are displayed on the head-up display device in the vehicle. According to the driving guidance information displayed on the head-up display device, the driver drives the vehicle to the target object or changes the driving strategy according to the driving suggestions.
[0108] For example, according to the touch information of the target user on the target screen, after confirming the target object from the environmental image information displayed on the target screen, the image data of the target object is obtained, the driving guidance information is obtained and displayed on the head-up display device. The driver finds the target object according to the image data of the target object in the head-up display device and drives the vehicle to the target object.
[0109] The fourth output method is to send the obtained driving guidance information to the automatic driving control unit. In the unmanned driving scenario, the driving guidance information is determined based on the guidance information of the non-driving seat passenger and the target information of the target vehicle and output to the automatic driving control unit, which then controls the vehicle to drive automatically based on the driving guidance information.
[0110] For example, the text content of the target user's voice guidance information is analyzed to determine the first object, and the environmental image information outside the vehicle is subjected to target recognition to determine the second object corresponding to the first object. Navigation information is generated based on the position or image of the second object and driving guidance information is obtained. The driving guidance information is sent to the automatic driving control unit so that the automatic driving control unit drives to the second object according to the navigation information.
[0111] In one example, the target information is map information, the guidance information is voice guidance information, and driving guidance information is determined based on the guidance information and the target information; including: determining navigation information based on the voice guidance information and the map information; outputting driving guidance information, including: displaying navigation information on a map navigation interface.
[0112] In this example, the target information is the map information of the target vehicle currently traveling, and the guidance information is the voice guidance information collected from the target user. The voice guidance information is analyzed to determine the target object from the map information. Corresponding navigation information is generated based on the relevant information of the target object and the map information of the target vehicle to obtain driving guidance information. Subsequently, the navigation information is displayed on the map navigation interface, so that the driver can drive and control the target vehicle according to the driving guidance information.
[0113] For example, the target user's voice is collected through a microphone, and the text content of the voice guidance information is "turn left at the traffic light intersection ahead". By analyzing the text content, it is determined that the target object in the voice guidance information is "traffic light intersection". According to the map information, the corresponding "traffic light intersection" is determined from the map information, and according to the target user's intention of "turning left", the navigation information of turning left at the traffic light intersection is generated to obtain the driving guidance information. By displaying the navigation information on the map navigation interface, the driver drives the target vehicle to turn left at the traffic light intersection.
[0114] In one example, the guidance information includes at least one or more of voice guidance information, touch information, or pointing action information. In addition to the above-mentioned scenario where the guidance information is one type of information, there is also a situation where two or more types of information are obtained at the same time. After obtaining multiple types of guidance information, each guidance information is analyzed, combined with the target information of the target vehicle, and the driving guidance information is determined and output after comprehensive analysis.
[0115] In a specific example, the voice guidance information and pointing action information of the target user are obtained at the same time, the first object is determined by analyzing the text content of the voice guidance information, the pointing direction is determined by analyzing the pointing action information, the target pointing position is determined from the vehicle's external environment according to the target information of the target vehicle, the first object is matched with the target pointing position, and driving guidance information is generated and output if the match is successful. By analyzing the multiple guidance information obtained at the same time, it is helpful to improve the accuracy of the driving guidance information.
[0116] For example, the voice acquisition device in the car collects the target user's voice guidance information "Stop at the intersection with a big tree on the right 100 meters ahead", and the image acquisition device in the car captures the target user's pointing action information pointing to the right. By analyzing the first object in the voice guidance information "the intersection with a big tree on the right 100 meters ahead", and according to the pointing action information, the target pointing position is determined from the three-dimensional space scene constructed by the target information. The first object is matched with the target pointing position, and after the match is successful, a screenshot of the area is taken, and then the image of the area is displayed on the HUD screen, so that the driver can understand and identify the driving direction more easily.
[0117] In one example, the method further includes outputting prompt information when the driving guidance information cannot be determined.
[0118] By analyzing the obtained guidance information, if the target pointing position, the second object or the target object cannot be matched from the target information of the target vehicle, prompt information is output to prompt the target user to re-enter the guidance information.
[0119] For example, after the first object is determined in the voice guidance information, if the second object cannot be matched from the target information outside the vehicle, prompt information is output to prompt the target user. For example, the target object is identified as "big tree" by the voice guidance information of the target user, but no relevant image of "big tree" can be matched from the environmental image data outside the vehicle. At this time, it is determined that the guidance information is wrong, and prompt information needs to be output to the target user.
[0120] In addition, in the case of multiple types of guidance information, if the multiple types of guidance information cannot match each other, a prompt message will also be output to prompt the target user to re-enter the guidance information.
[0121] For example, the voice guidance information collected from the target user is "turn on the right", but after analyzing the acquired pointing action information, the pointing direction is "left". Since the two guidance information do not match, the driving guidance information cannot be determined. At this time, it is also determined that the guidance information is incorrect, and a prompt message needs to be output to the target user.
[0122] The present disclosure also provides an information processing device, such as Figure 6 As shown, the device comprises:
[0123] The first acquisition module 601 is used to acquire the guidance information output by the target user in the target vehicle;
[0124] The second acquisition module 602 is used to obtain target information corresponding to the driving environment of the target vehicle;
[0125] A determination module 603 is used to determine driving guidance information according to the guidance information and the target information;
[0126] The output module 604 outputs driving guidance information.
[0127] In one example, the second acquisition module 602 is specifically used to collect the external environment of the target vehicle through the information collection device of the target vehicle to obtain the target information.
[0128] In one example, when the guidance information includes pointing action information, the determination module 603 is specifically used to: determine the pointing direction corresponding to the pointing action information; determine the target pointing position from the external environment of the target vehicle according to the target information; and determine the driving guidance information according to the target pointing position.
[0129] In one example, the target user is a non-driver user, and the output module 604 is specifically used to: obtain a target eye position corresponding to the driver's eye position; and display driving guidance information on the head-up display device according to the target eye position and the target pointing position.
[0130] In one example, when the guidance information includes voice guidance information and the target information includes environmental image information, the determination module 603 is specifically used to: analyze the voice guidance information to determine the first object in the voice guidance information; determine the second object corresponding to the first object from the target image information; and determine the driving guidance information based on the second object.
[0131] In one example, when the guidance information includes touch information on the target screen and the target information includes environmental image information, the determination module 603 is specifically used to: display the environmental image information on the target screen; determine the target object from the environmental image information based on the touch information; and determine the driving guidance information based on the target object.
[0132] In one example, the output module 604 outputs driving guidance information in at least one of the following ways: outputting driving guidance information on a map navigation interface; broadcasting driving guidance information by voice; displaying driving guidance information on a head-up display device; and sending driving guidance information to an automatic driving control unit.
[0133] In one example, when the target information is map information and the guidance information is voice guidance information, the determination module 603 is specifically used to: determine navigation information according to the voice guidance information and the map information; output driving guidance information, including: display navigation information on the map navigation interface.
[0134] According to an embodiment of the present disclosure, the present disclosure also provides a vehicle and a readable storage medium.
[0135] Figure 7 A schematic block diagram of an example vehicle that can be used to implement an embodiment of the present disclosure is shown. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit implementations of the present disclosure described and / or claimed herein.
[0136] like Figure 7 As shown, the vehicle 700 includes a computing unit 701, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 702 or a computer program loaded from a storage unit 708 into a random access memory (RAM) 703. In the RAM 703, various programs and data required for the operation of the device 700 can also be stored. The computing unit 701, the ROM 702, and the RAM 703 are connected to each other via a bus 704. An input / output (I / O) interface 705 is also connected to the bus 704.
[0137] Multiple components in the device 700 are connected to the I / O interface 705, including: an information acquisition unit 706, such as a camera, a microphone, etc.; an output unit 707, such as various types of displays, speakers, etc.; a storage unit 708, such as a disk, an optical disk, etc.; and a communication unit 709, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 709 allows the device 700 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.
[0138] The computing unit 701 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the computing unit 701 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 701 performs the various methods and processes described above, such as information processing methods. For example, in some embodiments, the information processing method may be implemented as a computer software program, which is tangibly contained in a machine-readable medium, such as a storage unit 708. In some embodiments, part or all of the computer program may be loaded and / or installed on the device 700 via ROM 702 and / or communication unit 709. When the computer program is loaded into RAM 703 and executed by the computing unit 701, one or more steps of the information processing method described above may be performed. Alternatively, in other embodiments, the computing unit 701 may be configured to perform the information processing method in any other appropriate manner (e.g., by means of firmware).
[0139] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
[0140] The program code for implementing the method of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that the program code, when executed by the processor or controller, enables the functions / operations specified in the flow chart and / or block diagram to be implemented. The program code may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
[0141] In the context of the present disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. A machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. A machine-readable medium may include, but is not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device, or equipment, or any suitable combination of the foregoing. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.
[0142] To provide interaction with a user, the systems and techniques described herein can be implemented on a computer having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the computer. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).
[0143] The systems and techniques described herein may be implemented in a computing system that includes back-end components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes front-end components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such back-end components, middleware components, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), and the Internet.
[0144] A computer system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The relationship of client and server is generated by computer programs running on respective computers and having a client-server relationship with each other. The server may be a cloud server, a server of a distributed system, or a server combined with a blockchain.
[0145] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this disclosure can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solutions disclosed in this disclosure can be achieved, and this document does not limit this.
[0146] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.
[0147] The above is only a specific embodiment of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person skilled in the art who is familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure, which should be included in the protection scope of the present disclosure. Therefore, the protection scope of the present disclosure should be based on the protection scope of the claims.
Claims
1. An information processing method, the method comprising: Obtaining guidance information output by a target user in a target vehicle; Obtaining target information corresponding to the driving environment of the target vehicle; determining driving guidance information according to the guidance information and the target information; The driving guidance information is outputted.
2. According to the method of claim 1, the step of obtaining target information corresponding to the driving environment of the target vehicle comprises: The target information is obtained by collecting the external environment of the target vehicle through the information collection device of the target vehicle.
3. The method according to claim 2, wherein the guidance information includes pointing action information; and determining the driving guidance information according to the guidance information and the target information comprises: Determining the pointing direction corresponding to the pointing action information; Determining a target pointing position from an external environment of the target vehicle according to the target information; The driving guidance information is determined according to the target pointing position.
4. The method according to claim 3, wherein the target user is a non-driver user, and the outputting of the driving guidance information comprises: Obtaining a target eye position corresponding to the driver's eye position; The driving guidance information is displayed on a head-up display device according to the target eye position and the target pointing position.
5. The method according to claim 2, wherein the guidance information includes voice guidance information, and the target information includes environmental image information; and determining the driving guidance information according to the guidance information and the target information comprises: Analyzing the voice guidance information to determine a first object in the voice guidance information; determining a second object corresponding to the first object from the target image information; The driving guidance information is determined according to the second object.
6. The method according to claim 2, wherein the guidance information includes touch information on a target screen, and the target information includes environmental image information; and determining the driving guidance information according to the guidance information and the target information comprises: Displaying the environmental image information on the target screen; determining a target object from the environmental image information according to the touch information; The driving guidance information is determined according to the target object.
7. The method according to claim 1, wherein the outputting of the driving guidance information comprises at least one of the following: Outputting the driving guidance information on a map navigation interface; broadcasting the driving guidance information by voice; Displaying the driving guidance information on a head-up display device; The driving guidance information is sent to the automatic driving control unit.
8. The method according to claim 1, wherein the target information is map information, the guidance information is voice guidance information, and the determining of driving guidance information according to the guidance information and the target information comprises: determining navigation information according to the voice guidance information and the map information; The outputting the driving guidance information comprises: The navigation information is displayed on the map navigation interface.
9. An information processing device, comprising: A first acquisition module is used to acquire guidance information output by a target user in a target vehicle; A second acquisition module is used to obtain target information corresponding to the driving environment of the target vehicle; A determination module, configured to determine driving guidance information according to the guidance information and the target information; An output module outputs the driving guidance information.
10. A vehicle comprising: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 8.