Information interaction display method, electronic equipment and computer storage medium

Abstract

The invention provides an information interaction display method, electronic equipment and a computer storage medium. The method comprises the following steps: receiving an output text; displaying the output text to a target object through the display device, wherein the target object is located on the outer side of the vehicle; performing text analysis on the output text to obtain an expression intention of the output text; detecting whether the target object executes an action matched with the expression intention or not; and if it is detected that the target object does not execute the action matched with the expression intention, sending an acousto-optic prompt to the target object. According to the invention, the convenience and accuracy of information interaction between vehicles or between people and vehicles can be improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to an information interaction display method, an electronic device and a computer storage medium. Background Art

[0002] With the continuous development of vehicle technology, more and more vehicles are appearing on the road. When users are driving, they often encounter traffic jams, slow driving, lane changes, etc. In such scenarios, users often want to interact with the outside of the car.

[0003] However, current vehicles can only exchange simple information with other vehicles or pedestrians through lights or horns. This method has problems such as complex communication and easy errors in information transmission. Summary of the invention

[0004] In view of the above, an embodiment of the present application provides an information interaction display method, an electronic device and a computer storage medium, which can display the information of users in a vehicle to other vehicles or pedestrians, thereby facilitating information interaction between vehicles or between people and vehicles.

[0005] An embodiment of the present application provides an information interaction display method, which is applied to a vehicle, wherein the vehicle is provided with a display device; the method comprises: receiving an output text; displaying the output text to a target object through the display device, wherein the target object is located outside the vehicle; performing text analysis on the output text to obtain an expression intent of the output text; detecting whether the target object performs an action matching the expression intent; and if it is detected that the target object does not perform an action matching the expression intent, issuing an audible and visual reminder to the target object.

[0006] The information interaction display method of the embodiment of the present application displays the output text to the target object to perform the first interaction reminder to the target object. Then, it is detected whether the target object performs an action that matches the expression intention of the output text. If it is detected that the target object does not perform an action that matches the expression intention of the output text, a second interaction reminder is performed to the target object. Thereby, the convenience and accuracy of the interaction between vehicles or between people and vehicles are improved.

[0007] In some embodiments, if it is detected that the target object has not performed an action matching the expression intention, issuing a sound and light reminder to the target object includes: if it is detected that the target object has not performed an action matching the expression intention, generating a sound and light reminder confirmation message; issuing a sound and light reminder to the target object includes: in response to a first operation of the sound and light reminder confirmation message, issuing a sound and light reminder to the target object, wherein the first operation represents confirmation of issuing a sound and light reminder to the target object.

[0008] In some embodiments, the method further includes: if it is detected that the target object performs an action matching the expression intention, generating a thank you text matching the output text, wherein the thank you text is an interactive text expressing gratitude to the target object; and displaying the thank you text to the target object via the display device.

[0009] In some embodiments, after displaying the output text to the target object through the display device, it also includes: collecting a target image of the target object; performing face detection on the target image to obtain age data of one or more persons in the target image; determining target age data based on one or more of the age data; if it is detected that the target object does not perform an action matching the expression intention, issuing an audio-visual reminder to the target object, including: if it is detected that the target object does not perform an action matching the expression intention, detecting whether the target age data is greater than a preset age threshold; if it is detected that the target age data is greater than the preset age threshold, issuing an audio-visual reminder to the target object.

[0010] In some embodiments, the display device is used to display in multiple directions; after receiving the output text, it also includes: performing text analysis on the output text to determine the display direction; before displaying the output text to the target object through the display device, it also includes: controlling the display direction of the display device to be the same as the display direction.

[0011] In some embodiments, before receiving the output text, it includes: obtaining the current position of the vehicle; detecting whether there is a special vehicle within a preset range of the current position behind the vehicle's driving direction, wherein the special vehicle is a vehicle with an emergency mission; receiving the output text includes: if it is detected that the special vehicle exists within the preset range of the current position, receiving the output text, wherein the output text is used to avoid the special vehicle.

[0012] In some embodiments, the output text includes an indication icon; displaying the output text to the target object through the display device includes: obtaining road information on which the vehicle is located; detecting whether there is a zebra crossing road ahead of the vehicle's driving direction based on the road information; if the zebra crossing road is detected ahead of the vehicle's driving direction, detecting whether there is the target object on the zebra crossing road; if the target object is detected on the zebra crossing road, obtaining the target object's traveling direction; and displaying the indication icon matching the traveling direction to the target object through the display device.

[0013] In some embodiments, displaying the output text to the target object through the display device includes: detecting whether the target object is moving in a direction close to the vehicle; if it is detected that the target object is moving in a direction close to the vehicle, calculating the distance between the target object and the vehicle; detecting whether the distance between the target object and the vehicle is less than a preset distance threshold; if it is detected that the distance between the target object and the vehicle is less than the preset distance threshold, displaying the output text to the target object through the display device, wherein the output text is used to remind the target object to maintain a safe distance.

[0014] An embodiment of the present application also provides an electronic device, which includes a processor and a memory, wherein the memory is used to store instructions, and the processor is used to call the instructions in the memory so that the electronic device executes the above-mentioned information interaction display method.

[0015] An embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes the above-mentioned information interaction display method.

[0016] The above-mentioned electronic device and computer-readable storage medium correspond to the above-mentioned information interaction display method and information interaction display method. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 The present invention is a flowchart of a method for interactively displaying information provided according to an embodiment of the present application.

[0018] Figure 2 Another step flow chart of the information interactive display method provided according to an embodiment of the present application.

[0019] Figure 3 The present invention is another step flow chart of the information interactive display method provided according to an embodiment of the present application.

[0020] Figure 4 A schematic diagram of the structure of an electronic device provided in one embodiment of the present application. DETAILED DESCRIPTION

[0021] In order to more clearly understand the above-mentioned purposes, features and advantages of the present application, the present application is described in detail below in conjunction with the accompanying drawings and specific implementation methods. It should be noted that the implementation methods of the present application and the features in the implementation methods can be combined with each other without conflict.

[0022] In the following description, many specific details are set forth to facilitate a full understanding of the present application. The described implementations are only part of the implementations of the present application, rather than all the implementations.

[0023] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application.

[0024] It should be further noted that, in this article, the terms "comprises", "includes" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the presence of other identical elements in the process, method, article or device including the element.

[0025] In this application, "at least one" means one or more, and "more" means two or more than two. "And / or" describes the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural.

[0026] In the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific way.

[0027] The embodiments of the present application provide an information interaction display method, an electronic device, and a computer-readable storage medium. The vehicle may be a new energy vehicle, a fuel vehicle, an engineering vehicle, etc. The vehicle is provided with a display device, and the display device is used to display in multiple directions. The present application does not limit the specific type of vehicle.

[0028] Figure 1 This is a flowchart of the steps of an embodiment of the information interactive display method of the present application. According to different requirements, the order of the steps in the flowchart can be changed, and some steps can be omitted.

[0029] See also Figure 1 As shown, the information interactive display method may include the following steps.

[0030] Step 101, receiving output text.

[0031] In some embodiments, the output text may be a preset text. For example, there are multiple preset texts in a text database. One text is selected from the multiple preset texts as the output text. Any preset text may be added, reduced or modified according to actual interaction needs. It may also be a text obtained after processing the voice input by the user. For example, a voice device is provided in the vehicle. The user may input the voice into the voice device. In this embodiment, the voice device may be a microphone.

[0032] It should be noted that the user can be inside or outside the vehicle. For example, when the vehicle is in motion, the user is inside the vehicle. When the vehicle is stuck on the road and the vehicle is stopped on the road, the user can be inside or outside the vehicle. When the user is outside the vehicle and needs the vehicle to interact with the outside world, it is sufficient as long as the voice device can receive the voice input by the user.

[0033] In some embodiments, it can be set that when the voice device receives the wake-up word, after the voice device is activated, the voice device receives the voice input by the user as the target voice information. Among them, the wake-up word can be changed and set according to actual design requirements. For example, the wake-up word can be "Xiao A Xiao A". When the user speaks a voice, the voice device receives the wake-up word and activates the voice device. The voice device uses the voice after the wake-up word in the voice spoken by the user as the target voice information. For example, the user says "Xiao A Xiao A", and the voice device receives the wake-up word "Xiao A Xiao A", activates the voice device, and continues to receive the voice spoken by the user "Please tell the vehicle behind to turn off the high beam, I can't see the road ahead clearly". At this time, the target voice information is "Please tell the vehicle behind to turn off the high beam, I can't see the road ahead clearly".

[0034] Then, the target voice information is processed using speech recognition technology (Automatic Speech Recognition, ASR) and natural language processing technology (Natural Language Processing, NLP) to obtain output text. For example, after using ASR technology and NLP technology to process "Please tell the vehicles behind to turn off the high beams, I can't see the road ahead clearly", the output text obtained is "Tell the vehicles behind to turn off the high beams". Among them, the processing process of the target voice information by ASR technology and NLP technology is both existing technology, and this application will not repeat it.

[0035] In other embodiments, the diffusion model can also be used to process the target voice information or the text processed by the ASR technology and the NLP technology. The target voice information processed by the diffusion model is used as the output text. For example, the target voice information is forward denoised so that the diffusion model learns the expression intention and contextual relationship in the target voice information. Then, the target voice information is subjected to backward denoising to generate the output text with the same expression intention as the target voice information.

[0036] In this embodiment, the output text may include text and / or patterns. When the output text includes patterns, the diffusion model may select one or more patterns that are close to the expression intent of the target voice information from the preset pattern library as patterns in the output text. The preset pattern library may be a local pattern included when the vehicle leaves the factory, or a personalized pattern obtained from the cloud or the user end online, or a pattern that is custom generated according to user requirements. This application does not limit this.

[0037] For example, when the target voice information is "Can you please stop honking the horn? There is a traffic jam ahead and I want to move but I can't", after the diffusion model performs forward noise addition and backward denoising on the target voice information, the output text obtained is "Brother, there is a traffic jam and I can't move".

[0038] On the one hand, the diffusion model generates samples by gradually eliminating noise. This method allows the model to first create a rough image structure and then gradually add details to generate high-quality output, giving the diffusion model the advantage of high-fidelity samples. On the other hand, the diffusion model is also able to capture all patterns in the training data set, thereby generating diverse samples. On the other hand, the diffusion model is usually trained using likelihood loss, which makes the training process relatively simple and stable. This makes it faster to use the diffusion model to perform forward denoising on the target speech information and backward denoising on the denoised text.

[0039] Step 102: Output text to a target object via a display device, where the target object is located outside the vehicle.

[0040] In some embodiments, the vehicle is provided with one or more display devices, and the one or more display devices can be set in multiple different positions of the vehicle. A display device refers to a device that can display output text to exchange information with other vehicles or pedestrians. For example, when the vehicle is provided with multiple display devices, one display device can be set within the range of the area where the front of the vehicle is located. Another display device can be set within the range of the area where the taillights are located. Another display device can be set within the range of the area where the sunroof of the vehicle is located. The setting position of one or more display devices can be set according to actual display requirements.

[0041] The display device may be a display screen, a car light, or a projection device, etc. The present application does not limit the location and type of the display device.

[0042] In other embodiments, the display device may also display the output text on one or more windows of the vehicle by utilizing augmented reality (AR) technology.

[0043] In one embodiment, text analysis is performed on the output text to determine the display direction. The display direction of the display device is controlled to be the same as the display direction. The output text is then displayed to the target object through the display device. For example, the output text is "Remind the vehicle behind to turn off the high beam." After text analysis is performed on the output text, it is determined that the display direction is the rear of the vehicle. Therefore, the display device located at the rear of the vehicle is controlled to display the output text. Alternatively, if the display device is a projection device, the projection direction of the projection device is controlled to be the rear of the vehicle.

[0044] It should be noted that if the display orientation cannot be determined after performing text analysis on the output text, the location of the target object can be obtained by collecting an image of the target object and performing image analysis on the collected image. For example, if the output text is "Send a reminder to that car to turn off the high beam", the location of the target object that turns on the high beam can be determined by analyzing the collected image of the target object, thereby determining the display orientation.

[0045] Alternatively, when the target object is displayed with output text in the hope that the target object does not honk, the audio information of the vehicle's location can be collected by the sound collection device. Based on the analysis of the audio information, the location of the target object is determined, thereby determining the display direction.

[0046] In another embodiment, there is a zebra crossing ahead of the vehicle in the direction of travel, and the vehicle gives way to vulnerable road users. In order to further improve the interaction efficiency between the vehicle and vulnerable road users and increase the emotional interaction, the road information on which the vehicle is located is obtained. Among them, an image of the road on which the vehicle is located can be collected, and the road information can be obtained after image processing of the road image. According to the road information, it is detected whether there is a zebra crossing road ahead of the vehicle in the direction of travel. If it is detected that there is a zebra crossing road ahead of the vehicle in the direction of travel, it is detected whether there is a target object on the zebra crossing road. If it is detected that there is a target object on the zebra crossing road, the direction of travel of the target object is obtained. An indicator icon matching the direction of travel is displayed to the target object.

[0047] When the output text has a pattern, the pattern may also be an indicator icon, for example, the indicator icon is “—>” or “<—”.

[0048] For example, there are pedestrians crossing the zebra crossing, and the pedestrians are crossing from the left side of the vehicle to the right side of the vehicle. Therefore, the indicator icon is “—>”.

[0049] In another embodiment, it is detected whether the target object moves in a direction close to the vehicle. If it is detected that the target object moves in a direction close to the vehicle, the distance between the target object and the vehicle is calculated. It is detected whether the distance between the target object and the vehicle is less than a preset distance threshold. If it is detected that the distance between the target object and the vehicle is less than the preset distance threshold, an output text is displayed to the target object. At this time, the output text is used to remind the target object to maintain a safe distance. The preset distance threshold can be set according to actual needs. For example, the preset distance threshold can be set to 5 meters or 10 meters.

[0050] For example, to avoid traffic accidents caused by the target not seeing the vehicle in time due to low visibility or other reasons, it is possible to detect whether the target is moving towards the vehicle. When the target is moving towards the vehicle and the distance between the target and the vehicle is less than a preset distance threshold, an output text can be displayed to the target in time. The output text may be "Please keep a safe distance, thank you".

[0051] Or, the vehicle breaks down during driving and cannot move. In this case, when it is detected that the target is moving towards the vehicle and the distance between the target and the vehicle is less than a preset distance threshold, an output text may be displayed to the target. The output text may be "The vehicle breaks down and cannot move, please take a detour."

[0052] It should also be noted that the display attributes of the output text can also be set according to the actual information interaction requirements. Among them, the display attributes include text size, text color, text display time and text display dynamics. Since the types of multiple display devices may be different, the display effects may also be different. Therefore, different display attributes can be set according to the type of display device.

[0053] For example, when the display area of ​​a display device is small, the text size value is set to be small. When the display area of ​​another display device is large, the text size value is set to be large. Alternatively, according to the display requirements, the output text is continuously scrolled back and forth to serve as a constant reminder. Alternatively, the time for displaying the output text is set to 1 minute or 2 minutes, etc.

[0054] Step 103: Perform text analysis on the output text to obtain the expression intention of the output text.

[0055] In this embodiment, semantic analysis is performed on the output text to obtain the expression intention of the output text. The semantic analysis of the output text belongs to the prior art and will not be described in detail in this application.

[0056] Step 104 , detecting whether the target object performs an action that matches the expression intention of the output text.

[0057] In this embodiment, when the duration of displaying the output text to the target object is longer than the preset duration, it can be detected whether the target object performs an action that matches the expression intention of the output text. The preset duration can be set according to actual interaction needs, for example, the preset time is set to 30s.

[0058] Step 105: If it is detected that the target object does not perform an action that matches the expression intention of the output text, an audio and visual reminder is issued to the target object.

[0059] For example, when the target object is a rear vehicle, and the output text expresses the intention of requiring the rear vehicle to turn off the high beam, it is detected whether the rear vehicle turns off the high beam.

[0060] If it is detected that the rear vehicle has not turned off the high beam, there may be a situation where the rear vehicle does not notice the output text displayed by the vehicle to itself. In this case, an audible and visual reminder can be issued to the rear vehicle.

[0061] Specifically, if it is detected that the target object does not perform an action matching the expression intention of the output text, an audio-visual reminder confirmation message is generated. In response to the first operation of the audio-visual reminder confirmation message, an audio-visual reminder is issued to the target object, wherein the first operation indicates confirmation of issuing an audio-visual reminder to the target object.

[0062] Assuming that the driver of the vehicle behind is in a bad mood, in order to avoid using sound and light reminders to remind the driver of the vehicle behind to turn off the high beam, which will make the driver of the vehicle behind even more upset and cause conflicts, when it is detected that the vehicle behind has not turned off the high beam, sound and light reminder confirmation information can be generated to the passengers in the vehicle to allow the passengers in the vehicle to confirm whether to send a sound and light reminder to the vehicle behind. If the passenger confirms the instruction to send a sound and light reminder to the vehicle behind, a sound and light reminder is sent to the vehicle behind. Otherwise, no sound and light reminder is sent to the vehicle behind.

[0063] For example, a pop-up window with confirmation information of sound and light reminder is displayed on the vehicle display screen. The content of the pop-up window is "Do you want to send sound and light reminder to the target object? If yes, please click to confirm; if not, please click to cancel." After the passengers see the content of the pop-up window, they click to confirm. The vehicle receives the instruction from the passengers to confirm the sending of sound and light reminder to the target object and sends the sound and light reminder to the target object.

[0064] In this embodiment, an acoustic and optical reminder device such as a speaker and a flash light may be provided on the vehicle. In order to facilitate the use of the acoustic and optical reminder device to remind the vehicle behind, the acoustic and optical reminder device may be provided on the periphery of the display device that outputs the text for display. When the vehicle behind does not turn off the high beam, the acoustic and optical reminder device may be used to make an acoustic and optical reminder, and the vehicle behind notices the content of the output text after the acoustic and optical reminder. The vehicle behind turns off the high beam, thereby improving the driving safety of the vehicle.

[0065] In some embodiments, if it is detected that the target object performs an action matching the expression intention of the output text, a thank you text matching the output text is generated, and the thank you text is an interactive text expressing gratitude to the target object. The thank you text is displayed to the target object through a display device.

[0066] For example, if it is detected that the rear vehicle has turned off the high beam, a thank you text is displayed to the rear vehicle. For example, the thank you text is "Thank you for turning off the high beam, I wish you a safe journey." Thereby, the emotion between the vehicle and other vehicles and pedestrians can be increased.

[0067] It should be noted that before using the diffusion model to perform forward noise addition processing and backward denoising processing on the target voice information, the sentiment analysis model can be used to detect the initial sentiment type of the target voice information. Detect whether the initial sentiment type is a negative sentiment. If the initial sentiment type is detected to be a negative sentiment, convert the initial sentiment type to a positive sentiment. When the diffusion model processes the target voice information, an output text matching the positive sentiment is generated. Among them, positive emotions are mainly emotions that make people feel happy. Negative emotions are mainly emotions that make people feel depressed or low.

[0068] Compared with the prior art, this embodiment has at least the following advantages: When the user needs to interact with other vehicles or pedestrians, on the one hand, the output text is determined directly from the preset text library, or the target voice information is forward denoised and backward denoised using a diffusion model, so that the diffusion model learns the expression intent of the target voice information and obtains an output text that matches the expression intent of the target voice information. The output text is displayed to the target object to remind the target object for the first interaction. On the other hand, it is detected whether the target object performs an action that matches the expression intent of the output text. If it is detected that the target object does not perform an action that matches the expression intent of the output text, a second interaction reminder is given to the target object. If it is detected that the target object performs an action that matches the expression intent of the output text, a thank you text is displayed to the target object. Thereby, the convenience and accuracy of information interaction between vehicles or between humans and machines can be improved, and the emotion during interaction can be increased.

[0069] refer to Figure 2 As shown, another information interaction display method provided by an embodiment of the present application. The information interaction display method may include: Step 201, receiving output text.

[0070] Step 202: Output text to a target object via a display device, where the target object is located outside the vehicle.

[0071] Step 201 and step 202 are the same as step 101 and step 102, and will not be described again here to avoid repetition.

[0072] Step 203: Acquire a target image of the target object.

[0073] In some embodiments, a collection device may be provided on the vehicle to collect the target image of the target object, wherein the collection device may be a video camera, a camera, etc.

[0074] Step 204: perform face detection on the target image to obtain age data of one or more persons in the target image.

[0075] Performing face detection and analysis on an image to obtain age data of one or more persons in the target image belongs to the prior art. The specific detection and analysis process will not be described in detail.

[0076] Step 205: Determine target age data based on one or more age data.

[0077] In this embodiment, if there are multiple persons in the target image, each person corresponds to an age data. The data with the largest age data is used as the target age data. If there is only one person in the target image, the age data corresponding to this person is used as the target age data.

[0078] In other embodiments, the average of one or more age data may be calculated and used as the target age data. Alternatively, the smallest age data among the multiple age data may be used as the target age data. The present application does not limit the specific method for determining the target age data.

[0079] Step 206: Perform text analysis on the output text to obtain the expression intention of the output text.

[0080] Step 207 , detecting whether the target object performs an action that matches the expression intention of the output text.

[0081] The specific contents of step 206 and step 207 are the same as those of step 103 and step 104, and will not be described again here to avoid repetition.

[0082] Step 208: If it is detected that the target object does not perform an action that matches the expression intention of the output text, it is detected whether the target age data is greater than a preset age threshold.

[0083] The preset age threshold may be set to 70 or 75. The preset age threshold may be changed or set according to actual needs.

[0084] Step 209: If it is detected that the target age data is greater than a preset age threshold, an audio and visual reminder is sent to the target object through a display device.

[0085] When there are older pedestrians or passengers, in order to avoid the situation where they fail to pay attention to the output text in time due to reasons such as vision loss, an audible and visual reminder can be issued to the target object when the age data is detected to be greater than the preset age threshold.

[0086] It should be noted that, in other embodiments, before receiving the output text, a target image of the target object may be first collected, face detection may be performed on the target image, and age data of one or more persons in the target image may be determined. Based on the one or more age data, the target age data is determined. Then, when a preset text is selected from a text database as the output text, the output text matching the target age data is obtained. Alternatively, when the text input by the user's voice is processed using a diffusion model, the output text matching the target age data is obtained. The output text matching the target age data is a text having different text emotion types.

[0087] Specifically, since the ages of different pedestrians or passengers in other vehicles are different, the target age data to be determined is also different. For example, when all pedestrians are teenagers, the output text may be a text with a playful tone. When all pedestrians are middle-aged people, the output text may be a text with a more peaceful tone.

[0088] Compared with the prior art, this embodiment has at least the following advantages: By detecting the target image, in order to avoid the situation where pedestrians or vehicle passengers fail to pay attention to the output text in time due to reasons such as vision loss due to old age, sound and light reminders can be used to remind pedestrians or vehicle passengers again to improve the interaction efficiency between the vehicle and pedestrians or vehicle passengers.

[0089] refer to Figure 3 As shown, another information interaction display method provided in an embodiment of the present application is provided. The information interaction display method may include: Step 301, obtaining the current position of the vehicle.

[0090] For example, a GPS may be provided in the vehicle, and the current location of the vehicle may be acquired through the GPS.

[0091] Step 302, behind the vehicle's driving direction, detect whether there is a special vehicle within a preset range of the current position.

[0092] In this embodiment, the special vehicle is a vehicle with an emergency mission, such as a rescue vehicle, an ambulance, etc. In other embodiments, the special vehicle may also be a vehicle with special functions, such as an engineering vehicle, a truck, etc. Alternatively, the special vehicle may also be a vehicle with an automatic driving function turned on.

[0093] At the same time, the preset range can be set to 5 meters to 10 meters. According to the actual detection needs, the endpoint values ​​of the preset range can be adjusted.

[0094] Step 303: if it is detected that a special vehicle exists within a preset range of the current position, an output text is received.

[0095] In this embodiment, the output text is used to avoid special vehicles. For example, the output text is "There is a special vehicle behind performing an emergency task, please pay attention to avoid it."

[0096] When a special vehicle is detected within the preset range of the current position, the vehicle occupants can be reminded whether they need to be reminded of the target object. If the vehicle occupants confirm that they need to be reminded of the target object, the output text is received.

[0097] Step 304: Output text to a target object via a display device, where the target object is located outside the vehicle.

[0098] Step 305: Perform text analysis on the output text to obtain the expression intention of the output text.

[0099] Step 306 , detecting whether the target object performs an action that matches the expression intention of the output text.

[0100] Step 307: If it is detected that the target object does not perform an action that matches the expression intention of the output text, an audio and visual reminder is issued to the target object.

[0101] Step 304 to step 307 are the same as step 102 to step 105, and will not be described again here to avoid repetition.

[0102] When the special vehicle is a vehicle with an emergency mission, since ambulances, rescue vehicles and other special vehicles all have emergency missions, in order to avoid traffic congestion caused by special vehicles being unable to reach the destination in time, and the casualties and property caused by emergency missions, the vehicle needs to remind the target object to avoid the special vehicle.

[0103] In other embodiments, when the special vehicle is an engineering vehicle, a truck or a vehicle with an automatic driving function, since the blind spots of engineering vehicles and trucks are large and the related technologies of automatic driving functions are not yet mature, in order to reduce the incidence of traffic accidents, the vehicle needs to remind the target object to avoid the engineering vehicle, truck or vehicle with automatic driving function to improve driving safety.

[0104] Compared with the prior art, this embodiment has at least the following advantages: By detecting whether there is a special vehicle behind the vehicle in the direction of travel, when there is a special vehicle behind the vehicle in the direction of travel, the output text for avoiding the special vehicle is displayed to the target object, so that the vehicle and the target object can avoid the special vehicle in time. This avoids the situation where the special vehicle cannot complete its mission in time due to the failure of the vehicle and the target object to avoid the special vehicle in time, resulting in casualties of people and property. Or, the incidence of traffic accidents is increased.

[0105] Please refer to Figure 4 , is a schematic diagram of the hardware structure of the electronic device 1000 provided in the embodiment of the present application. Figure 4 As shown, the electronic device 1000 may include a processor 1001 and a memory 1002. The memory 1002 is used to store one or more computer programs 1003. The one or more computer programs 1003 are configured to be executed by the processor 1001. The one or more computer programs 1003 include instructions, and the above instructions can be used to implement the above method in the electronic device 1000.

[0106] It is understandable that the structure shown in this embodiment does not constitute a specific limitation on the electronic device 1000. In other embodiments, the electronic device 1000 may include more or fewer components than shown, or combine or separate some components, or arrange the components differently.

[0107] The processor 1001 may include one or more processing units, for example, the processor 1001 may include an application processor (AP), a modem, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0108] The processor 1001 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 1001 is a cache memory. The memory may store instructions or data that the processor 1001 has just used or circulated. If the processor 1001 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 1001, and thus improves the efficiency of the system.

[0109] In some embodiments, the processor 1001 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a SIM interface, and / or a USB interface, etc.

[0110] In some embodiments, processor 1001 is used to execute acceleration schemes such as single instruction multiple data (SIMD) and very long instruction word (VLIW).

[0111] In some embodiments, memory 1002 may include high-speed random access memory and may also include non-volatile memory, such as a hard disk, a memory, a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) card, a flash card (Flash Card), at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0112] This embodiment further provides a storage medium, in which computer instructions are stored. When the instructions are executed on an electronic device, the electronic device executes the above-mentioned related method steps to implement the method in the above-mentioned embodiment.

[0113] Among them, the electronic device and storage medium provided in this embodiment are used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0114] In practical applications, the above functions can be distributed to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0115] In several embodiments provided in the present application, the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are schematic. For example, the division of the modules or units is a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0116] The unit described as a separate component may or may not be physically separated, and the component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.

[0117] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0118] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.

[0119] The above description is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application.

Claims

1. An information interactive display method, characterized in that: Applied to a vehicle, the vehicle is provided with a display device; the method comprises: Receive output text; displaying the output text to a target object through the display device, the target object being located outside the vehicle; Performing text analysis on the output text to obtain the expression intention of the output text; Detecting whether the target object performs an action matching the expression intention; If it is detected that the target object does not perform an action matching the expression intention, an audible and visual reminder is issued to the target object.

2. The information interactive display method according to claim 1, characterized in that: Before sending the sound and light reminder to the target object, the method further includes: If it is detected that the target object does not perform an action matching the expression intention, generating an audio-visual reminder confirmation message; The sending of sound and light reminders to the target object comprises: In response to a first operation of the sound and light reminder confirmation message, a sound and light reminder is issued to the target object, wherein the first operation represents confirmation of issuing the sound and light reminder to the target object.

3. The information interactive display method according to claim 1, characterized in that: The method further comprises: If it is detected that the target object performs an action matching the expression intention, a thank you text matching the output text is generated, where the thank you text is an interactive text expressing gratitude to the target object; The thank-you text is displayed to the target object through the display device.

4. The information interactive display method according to claim 1, characterized in that: After displaying the output text to the target object through the display device, the method further includes: Acquiring a target image of the target object; Performing face detection on the target image to obtain age data of one or more persons in the target image; determining target age data based on one or more of the age data; If it is detected that the target object does not perform an action matching the expression intention, sending an audio and visual reminder to the target object includes: If it is detected that the target object does not perform an action matching the expression intention, detecting whether the target age data is greater than a preset age threshold; If it is detected that the target age data is greater than the preset age threshold, an audible and visual reminder is issued to the target object.

5. The information interactive display method according to claim 1, characterized in that: The display device is used for displaying in multiple directions; After receiving the output text, the method further includes: Performing text analysis on the output text to determine a display orientation; Before displaying the output text to the target object through the display device, the method further includes: The display direction of the display device is controlled to be the same as the display orientation.

6. The information interactive display method according to claim 1, characterized in that: Before receiving the output text, the method includes: Obtaining the current position of the vehicle; Behind the vehicle in the driving direction, detecting whether there is a special vehicle within a preset range of the current position, the special vehicle being a vehicle with an emergency mission; The receiving output text comprises: If it is detected that the special vehicle exists within the preset range of the current position, the output text is received, wherein the output text is used to avoid the special vehicle.

7. The information interactive display method according to claim 1, characterized in that: The output text includes an indication icon; and displaying the output text to a target object through the display device includes: Acquiring road information on which the vehicle is located; Detecting, based on the road information, whether there is a zebra crossing road ahead of the vehicle in the driving direction; If it is detected that there is a zebra crossing road ahead of the vehicle in the driving direction, detecting whether there is the target object on the zebra crossing road; If the target object is detected on the zebra crossing road, obtaining the moving direction of the target object; The indication icon matching the traveling direction is displayed to the target object through the display device.

8. The information interactive display method according to claim 1, characterized in that: The step of displaying the output text to the target object through the display device includes: detecting whether the target object moves toward the direction approaching the vehicle; If it is detected that the target object moves towards the vehicle, calculating the distance between the target object and the vehicle; Detecting whether the distance between the target object and the vehicle is less than a preset distance threshold; If it is detected that the distance between the target object and the vehicle is less than the preset distance threshold, the output text is displayed to the target object through the display device, wherein the output text is used to remind the target object to maintain a safe distance.

9. An electronic device, comprising a processor and a memory, characterized in that: The memory is used to store instructions, and the processor is used to call the instructions in the memory, so that the electronic device executes the information interaction display method according to any one of claims 1 to 8.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are executed on an electronic device, the electronic device executes the information interaction display method according to any one of claims 1 to 8.

Images