Apology information display method, device, electronic device and readable medium

Abstract

An embodiment of the present invention provides an apology message display method, device, electronic device and readable medium. When there are at least a first user and a second user in a vehicle, the method obtains the conversation content and facial expression information of the first user and the second user; when it is determined that the first user and the second user are in a dispute state based on the conversation content and the facial expression information, an apology request message is generated for the first user; the apology request message is displayed to the first user through the multimedia device; when an affirmative reply message to the apology request message sent by the first user is received, an apology message is generated; and the apology message is displayed to the second user through the multimedia device, thereby enabling the vehicle-mounted terminal to actively soothe the emotionally agitated user, improving the humanization of the vehicle-mounted terminal, and thereby improving the user's driving experience.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle video playback, and in particular to an apology message display method, an apology message display device, a vehicle, an electronic device, and a computer-readable medium. Background Art

[0002] With the development of technology, vehicles are becoming more and more intelligent. In-vehicle terminals can handle various types of affairs for users, such as wireless communication, online navigation, road condition information, travel guides, online shopping, entertainment and audio and video playback, etc.

[0003] However, in the existing technology, the vehicle-mounted terminal cannot perceive the user's emotional state, and is even unable to provide corresponding strategies to calm the user's emotions when the user is emotionally agitated, for example, when multiple users have a dispute while using the vehicle. This results in a poor user experience when the user uses the vehicle. Summary of the Invention

[0004] The embodiments of the present invention provide an apology message display method, device, vehicle, electronic device and computer-readable storage medium to solve the problem that existing vehicle-mounted terminals are unable to propose corresponding strategies to calm users when they are emotionally excited.

[0005] An embodiment of the present invention discloses a method for displaying an apology message, which is applied to a vehicle-mounted terminal having a corresponding multimedia device. The method may include:

[0006] When the vehicle includes at least a first user and a second user, acquiring conversation content and facial expression information of the first user and the second user;

[0007] When it is determined based on the conversation content and the facial expression information that the first user and the second user are in a dispute, generating an apology request message for the first user;

[0008] displaying the apology request information to the first user through the multimedia device;

[0009] generating an apology message when receiving a positive reply message to the apology request message sent by the first user;

[0010] The apology message is displayed to the second user through the multimedia device.

[0011] Optionally, the vehicle-mounted terminal has a corresponding image acquisition device, and the multimedia device is a head-up display. The step of displaying the apology request information to the first user through the multimedia device may include:

[0012] determining first user location information of the first user by the image acquisition device;

[0013] determining a first display area for the first user according to the first user location information;

[0014] The apology request information is displayed to the first user in the first display area.

[0015] Optionally, the step of displaying the apology message to the second user through the multimedia device may include:

[0016] determining second user location information of the second user by the image acquisition device;

[0017] determining a second display area for the second user according to the second user location information;

[0018] The apology message is displayed to the second user in the second display area.

[0019] Optionally, the step of generating an apology message may include:

[0020] Obtaining text information entered by the first user;

[0021] Converting the text information into voice information;

[0022] Acquiring a user portrait of the first user using the image acquisition device;

[0023] generating a virtual image based on the user's avatar;

[0024] An apology message is synthesized using the voice information and the virtual image; the apology message is a video message.

[0025] Optionally, the step of displaying the apology message to the second user through the multimedia device may further include:

[0026] When the second user is a vehicle driver, determining whether the speed of the vehicle exceeds a preset threshold;

[0027] If not, the apology message is displayed to the second user via the multimedia device.

[0028] The embodiment of the present invention further discloses an apology message display device, which is applied to a vehicle-mounted terminal having a corresponding multimedia device. The device may include:

[0029] A conversation content and facial expression information acquisition module, configured to acquire the conversation content and facial expression information of the first user and the second user when the vehicle includes at least a first user and a second user;

[0030] an apology request information generating module, configured to generate an apology request information for the first user when it is determined based on the conversation content and the facial expression information that the first user and the second user are in a dispute state;

[0031] an apology request information display module, configured to display the apology request information to the first user via the multimedia device;

[0032] an apology message generating module, configured to generate an apology message upon receiving a positive reply message sent by the first user to the apology request message;

[0033] An apology message display module is used to display the apology message to the second user through the multimedia device.

[0034] Optionally, the vehicle-mounted terminal has a corresponding image acquisition device, the multimedia device is a head-up display, and the apology request information display module may include:

[0035] A first user location information determination submodule, configured to determine the first user location information of the first user through the image acquisition device;

[0036] a first display area determination submodule for a first user, configured to determine a first display area for the first user based on the first user location information;

[0037] The apology request information display submodule is used to display the apology request information to the first user in the first display area.

[0038] Optionally, the apology information display module may include:

[0039] A second user location information determination submodule, configured to determine the second user location information of the second user through the image acquisition device;

[0040] A second display area determination submodule, configured to determine a second display area for the second user according to the second user location information;

[0041] The first apology message display submodule is configured to display the apology message to the second user in the second display area.

[0042] Optionally, the apology message generation module may include:

[0043] A text information acquisition submodule, configured to acquire text information entered by the first user;

[0044] A voice information generation submodule, configured to convert the text information into voice information;

[0045] A user portrait acquisition submodule, configured to acquire the user portrait of the first user using the image acquisition device;

[0046] A virtual image generation submodule, configured to generate a virtual image based on the user's avatar;

[0047] The apology message generation submodule is used to synthesize an apology message using the voice information and the virtual image; the apology message is video information.

[0048] Optionally, the apology message display module may further include:

[0049] a speed determination submodule, configured to determine, when the second user is a vehicle driver, whether the speed of the vehicle exceeds a preset threshold; if not, calling a second apology message display submodule;

[0050] The second apology message display submodule is configured to display the apology message to the second user via the multimedia device.

[0051] An embodiment of the present invention further discloses an electronic device, comprising a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus;

[0052] The memory is used to store computer programs;

[0053] The processor is configured to implement the method described in the embodiment of the present invention when executing the program stored in the memory.

[0054] The embodiments of the present invention further disclose one or more computer-readable media having instructions stored thereon. When executed by one or more processors, the processors are enabled to perform the method according to the embodiments of the present invention.

[0055] An embodiment of the present invention further discloses a vehicle, which may include an onboard terminal. The onboard terminal is mechanically coupled and / or electrically connected to the vehicle, so that the vehicle including the onboard computer executes the method described in the embodiment of the present invention.

[0056] The embodiments of the present invention include the following advantages:

[0057] In an embodiment of the present invention, when there are at least a first user and a second user in a vehicle, the conversation content and facial expression information of the first user and the second user are obtained; when it is determined that the first user and the second user are in a dispute state based on the conversation content and the facial expression information, an apology request message is generated for the first user; the apology request message is displayed to the first user through the multimedia device; an apology message is generated when an affirmative reply message to the apology request message is received from the first user; and the apology message is displayed to the second user through the multimedia device, thereby enabling the vehicle-mounted terminal to actively soothe the emotionally agitated user, improving the humanization of the vehicle-mounted terminal, and further improving the user's driving experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 This is a flowchart of a method for displaying an apology message provided in an embodiment of the present invention;

[0059] Figure 2 This is a structural block diagram of an apology information display device provided in an embodiment of the present invention;

[0060] Figure 3 is a block diagram of an electronic device provided in an embodiment of the present invention;

[0061] Figure 4 is a schematic diagram of a computer-readable medium provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0062] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0063] Reference Figure 1 , shows a flowchart of a method for displaying an apology message provided in an embodiment of the present invention, which may specifically include the following steps:

[0064] Step 101, when there are at least a first user and a second user in the vehicle, obtaining conversation content and facial expression information of the first user and the second user;

[0065] Step 102: When it is determined based on the conversation content and the facial expression information that the first user and the second user are in a dispute, generating an apology request message for the first user;

[0066] Step 103: displaying the apology request information to the first user via the multimedia device;

[0067] Step 104: upon receiving a positive reply message to the apology request message sent by the first user, generating an apology message;

[0068] Step 105: Display the apology message to the second user via the multimedia device.

[0069] In actual applications, the in-vehicle terminal can handle various types of affairs for users, such as wireless communication, online navigation, traffic information, travel guides, online shopping, entertainment and audio-visual playback, etc. However, in general, the interaction between the in-vehicle terminal and the user is mostly in a passive state, that is, it is mainly the user who issues instructions to the in-vehicle terminal, and the in-vehicle terminal responds to the user's instructions to provide services to the user. Using this method to interact with users for data is obviously unable to meet the user's human needs. For example, when facing a dispute between users in the car, the in-vehicle terminal does not have a complete response strategy, and it is even more unable to soothe emotionally excited users. If the emotionally excited user is the driver of the vehicle, the inability of the in-vehicle terminal to soothe the emotionally excited user will not only lead to a poor driving experience for the user, but also directly lead to a lack of guarantee of the user's driving safety. Therefore, this The vehicle-mounted terminal of an embodiment of the invention can obtain the conversation content and facial expression information of the first user and the second user when there are at least a first user and a second user in the vehicle. When it is determined that the first user and the second user are in a dispute state based on the conversation content and facial expression information, an apology request message is generated and the apology request message is displayed to the first user through a multimedia device. The apology request message can be used to remind the first user to apologize to the second user on the one hand, and on the other hand, it can also be used to confirm with the first user whether to apologize to the second user. After receiving an affirmative response from the first user, the vehicle-mounted terminal can generate an apology message for the first user and display the apology message to the second user through a multimedia device to soothe the emotions of the second user, thereby enabling the vehicle-mounted terminal to actively soothe emotionally excited users, improving the humanization of the vehicle-mounted terminal, and thereby improving the user's driving experience.

[0070] In a specific implementation, the embodiment of the present invention may be applied to a vehicle-mounted terminal, and the vehicle-mounted terminal may have a corresponding multimedia device.

[0071] Optionally, the vehicle-mounted terminal in the embodiment of the present invention may be an intelligent vehicle machine.

[0072] In actual applications, smart car computers can use the location, speed, time and other information provided by the satellite positioning system, and cooperate with the route planning capabilities of high-precision navigation electronic maps to improve navigation functions for users; smart car computers can also help users accurately and in real time plan driving routes on electronic maps, and guide users to drive along the planned routes and reach their destinations. Its biggest feature is that when the vehicle driver enters the destination, the system will calculate the driving route in a very short time, and use voice prompts to indicate the correct driving direction to reach the destination. At the same time, the vehicle can display the location of its own vehicle and surrounding facilities on the display screen in real time during driving; in addition, the smart car computer also has powerful data computing capabilities, which can complete most of the data calculations about the vehicle for the vehicle.

[0073] In actual applications, the vehicle-mounted terminal of an embodiment of the present invention may have a corresponding sound pickup device, such as a wired microphone or a wireless microphone that can transmit data with the vehicle-mounted terminal, or a microphone on a user's mobile phone that is connected to the vehicle-mounted terminal via Bluetooth; the vehicle-mounted terminal may also have corresponding multimedia devices, such as vehicle-mounted audio, vehicle-mounted display, etc.; the vehicle-mounted terminal may also have a corresponding image acquisition device.

[0074] Optionally, the image acquisition device of the embodiment of the present invention may be a DMS module (driver monitoring system). The DMS module may be a system based on a deep neural network, which can detect unexpected situations such as the driver being distracted, tired or drowsy, or lacking the ability to drive, and can even determine whether the user is currently in an angry state based on the shape of the user's facial muscles.

[0075] In a specific implementation, the embodiment of the present invention is mainly applied to a multi-user scenario in a car, optionally including at least two users. The vehicle-mounted terminal can call a sound pickup device to pick up the user's conversation content, or call an image acquisition device to capture the user's facial expression information.

[0076] After the vehicle-mounted terminal obtains the conversation content and facial expression information of the first user and the second user, the embodiment of the present invention can determine whether the first user and the second user are in a dispute state based on the conversation content and facial expression information.

[0077] For example, after collecting facial expression information of the first user and the second user, the DMS module can directly determine whether the first user and the second user are in a dispute state based on the facial expression information, and directly inform the vehicle-mounted terminal of the determination result, or, use a camera to capture the user's screen and produce a video stream, use a microphone to capture the user's conversation content and produce an audio stream, and then send the video stream and audio stream to the vehicle-mounted terminal, which monitors and analyzes the video stream content, and monitors and analyzes the keywords in the audio stream, so as to determine whether the first user and the second user are in a dispute state.

[0078] In an embodiment of the present invention, when it is determined that the first user and the second user are in a dispute state, an apology request message can be generated for the first user, and the apology request message can be displayed to the first user through a multimedia device. Specifically, the apology request message can be a dialog box presented to the first user through multimedia. For example, a dialog box is displayed to the first user on the multimedia display screen, which includes a text statement asking the first user whether he needs to apologize to the second user. At the same time, the first user can be provided with affirmative response options of "yes" and "no" and negative response options.

[0079] In an embodiment of the present invention, when an affirmative reply message to an apology request message sent by the first user is received, an apology message is generated. Specifically, the user can reply to the apology request message with a positive reply message or a negative reply message. For example, the first user clicks the "Yes" option on the touch screen to indicate that the first user agrees to apologize to the second user, or the DMS module captures the first user's nodding action and can determine that the first user agrees to apologize to the second user. At this time, the vehicle-mounted terminal can generate an apology message for the first user and display the apology message to the second user through the multimedia device to soothe the second user's emotions.

[0080] In an embodiment of the present invention, when there are at least a first user and a second user in a vehicle, the conversation content and facial expression information of the first user and the second user are obtained; when it is determined that the first user and the second user are in a dispute state based on the conversation content and the facial expression information, an apology request message is generated for the first user; the apology request message is displayed to the first user through the multimedia device; an apology message is generated when an affirmative reply message to the apology request message is received from the first user; and the apology message is displayed to the second user through the multimedia device, thereby enabling the vehicle-mounted terminal to actively soothe the emotionally agitated user, improving the humanization of the vehicle-mounted terminal, and further improving the user's driving experience.

[0081] Based on the above embodiment, a modified embodiment of the above embodiment is proposed. It should be noted that, in order to simplify the description, only the differences from the above embodiment are described in the modified embodiment.

[0082] In an optional embodiment of the present invention, the vehicle-mounted terminal has a corresponding image acquisition device, the multimedia device is a head-up display, and the step of displaying the apology request information to the first user through the multimedia device includes:

[0083] determining first user location information of the first user by the image acquisition device;

[0084] determining a first display area for the first user according to the first user location information;

[0085] The apology request information is displayed to the first user in the first display area.

[0086] The multimedia device in the embodiment of the present invention may be a head-up display (HUD).

[0087] In practical applications, HUD was first used on aircraft. As a flight aid, it can project various aircraft parameters directly in front of the pilot's field of view, allowing the pilot to maintain a level view and improve flight safety. With the development of the automotive industry, HUD has also been applied to cars. HUD is divided into three categories according to different implementation methods: C-HUD (Combiner HUD), W-HUD (windshield HUD), and AR-HUD (Augmented Reality-HUD). C-HUD is a transparent resin glass placed above the instrument to project vehicle information. W-HUD directly uses the car's windshield as a display screen to project relevant information directly onto the windshield. AR-HUD still uses the windshield as a display screen, but will provide virtual images at a longer distance and present them in combination with the real scene. AR-HUD will inevitably continue to develop and become an indispensable system for automobiles.

[0088] In a specific implementation, the reason why the first user does not directly apologize to the second user is most likely because he is concerned about the current awkward atmosphere. Therefore, an embodiment of the present invention can determine the first user's location information of the first user through an image acquisition device, and then determine a first display area for the first user based on the first user's location information, and display an apology request information to the first user in the first display area. The first display area can be an area that cannot be seen or is not easily seen from the perspective of the second user.

[0089] For example, if the vehicle is a left-hand drive vehicle, that is, a vehicle with the steering wheel on the left side of the cab, and the vehicle uses the windshield as a head-up display, before displaying the apology request information through the head-up display, the DMS module can be used to locate the first user. If the first user is a passenger sitting in the front passenger seat and the second user is the driver sitting in the main driver's seat, generally, when the driver's attention is on driving the vehicle, the upper right corner area of the windshield will not appear in the driver's field of view. Therefore, a first display area can be generated in the upper right corner of the windshield in front of the first user based on the position of the first user, and the apology request information can be displayed to the first user in the first display area.

[0090] Of course, the above examples are only examples, and those skilled in the art may determine the first display area for the first user in other locations according to the first user location information according to actual needs. This is not limited by the embodiments of the present invention.

[0091] An embodiment of the present invention determines the first user location information of the first user through an image acquisition device, then determines a first display area for the first user based on the first user location information, and displays an apology request message to the first user in the first display area, thereby avoiding causing the first user to feel embarrassed when displaying the apology request message.

[0092] In an optional embodiment of the present invention, the step of displaying the apology message to the second user through the multimedia device includes:

[0093] determining second user location information of the second user by the image acquisition device;

[0094] determining a second display area for the second user according to the second user location information;

[0095] The apology message is displayed to the second user in the second display area.

[0096] In actual applications, the second user may be the driver, and the driver needs to pay attention to the driving environment around the vehicle at all times. Therefore, the embodiment of the present invention can also determine the second user position information of the second user through the image acquisition device when the vehicle-mounted terminal determines that the second user is the vehicle driver, and then determine the second display area for the second user based on the second user position information, and display an apology message to the second user in the second display area. The second display area can be an area that will not affect the driver's observation of the driving environment.

[0097] For example, if the vehicle is a left-hand drive vehicle, that is, a vehicle with the steering wheel on the left side of the cab, and the vehicle uses the windshield as a head-up display, before displaying the apology message through the head-up display, the DMS module can be used to locate the second user. If the second user is the driver sitting in the main driver's seat, generally, the upper left corner area of the windshield will not block the driver's observation of the road conditions while driving. Therefore, a second display area can be generated in the upper left corner of the windshield in front of the second user according to the position of the second user, and the apology message can be displayed to the second user in the second display area.

[0098] Of course, the above examples are only examples, and those skilled in the art may determine the second display area for the second user in other locations according to the second user location information according to actual needs. This is not limited by the embodiments of the present invention.

[0099] In an embodiment of the present invention, the second user location information of the second user is determined by the image acquisition device; a second display area for the second user is determined based on the second user location information; and the apology message is displayed to the second user in the second display area, so that the driver can see the apology message displayed in the second display area without the apology message blocking the driver's line of sight, thereby ensuring driving safety.

[0100] In an optional embodiment of the present invention, the step of displaying the apology message to the second user through the multimedia device further includes:

[0101] When the second user is a vehicle driver, determining whether the speed of the vehicle exceeds a preset threshold;

[0102] If not, the apology message is displayed to the second user via the multimedia device.

[0103] In actual applications, the second user may be a driver, and the driver needs to pay attention to the driving environment around the vehicle at all times. Therefore, the embodiment of the present invention can also determine whether the speed of the vehicle exceeds a preset threshold when the second user is the driver of the vehicle, and only display an apology message to the second user through the multimedia device when the speed of the vehicle does not exceed the preset threshold.

[0104] For example, if the vehicle-mounted terminal determines that the apology message is to be displayed to the vehicle driver, and it is pre-set that the apology message will only be displayed to the vehicle driver when the vehicle speed does not exceed 60km / h, it can be determined whether the current vehicle speed exceeds 60km / h. If so, the apology message will not be displayed temporarily. If the vehicle speed is lower than or equal to 60km / h, the apology message can be displayed to the second user through the multimedia device.

[0105] In an embodiment of the present invention, when the second user is a vehicle driver, it is determined whether the speed of the vehicle exceeds a preset threshold; if not, the apology message is displayed to the second user through the multimedia device, so that the driver can see the apology message while avoiding the apology message distracting the driver when the vehicle is driving at high speed, thereby ensuring driving safety.

[0106] In an optional embodiment of the present invention, the step of generating an apology message includes:

[0107] Obtaining text information entered by the first user;

[0108] Converting the text information into voice information;

[0109] Acquiring a user portrait of the first user using the image acquisition device;

[0110] generating a virtual image based on the user's avatar;

[0111] An apology message is synthesized using the voice information and the virtual image; the apology message is a video message.

[0112] In actual applications, users often have more humane demands for apology messages. Therefore, in an embodiment of the present invention, the user can enter text information, and after the vehicle-mounted terminal obtains the text information, the text information is converted into voice information, and an image acquisition device is used to obtain the user portrait of the first user, and a virtual image is generated based on the user portrait. The voice information and the virtual image are used to synthesize the apology message, and the apology message is a video message, thereby enabling the apology message to be dynamically played in the multimedia device.

[0113] For example, the first user can input text through a mobile phone or a head-up display. After the smart car computer obtains the text, it can convert the text into audio. At the same time, the car computer can call the camera to take the first user's portrait and generate a virtual image for the first user based on the portrait. The virtual image can be played to the second user in the head-up display. At the same time, the audio can be played in the car audio along with the preset actions of the virtual image.

[0114] The embodiment of the present invention obtains text information entered by the first user; converts the text information into voice information; uses the image acquisition device to obtain the user portrait of the first user; generates a virtual image based on the user portrait; uses the voice information and the virtual image to synthesize an apology message; the apology message is video information, thereby enabling the apology message to be dynamically played on a multimedia device, thereby improving the humanization level of the apology message and also improving the user experience of the user when viewing the apology message.

[0115] In another optional embodiment of the present invention, the apology message may be an audio message including only voice information, and when the apology message is presented to the second user via a multimedia device, the audio message may be played on a car audio system.

[0116] In another optional embodiment of the present invention, the apology message may include a voice message and a static picture. The static picture may be generated based on the user's avatar. When the apology message is displayed to the second user through a multimedia device, the voice message may be played in the car audio, and the static picture may be displayed in the head-up display.

[0117] In addition to generating apology messages in the form of dynamic virtual images, embodiments of the present invention can also generate apology messages in multiple forms such as pure audio, or audio plus static images, thereby enriching the methods of generating apology messages and improving user experience.

[0118] In order to enable those skilled in the art to better understand the embodiments of the present invention, a complete example is used below to illustrate the embodiments of the present invention.

[0119] For example, the intelligent vehicle computer uses a camera to capture video of users in the vehicle to generate a video stream specific to the users, and uses a microphone to pick up conversations between users in the vehicle. The video stream and conversation content are monitored and analyzed to determine whether an argument has occurred between the users. The camera records the positions of the driver and non-driver users respectively, and displays an apology request on the screen in front of the non-driver, prompting and asking the non-driver user whether to apologize. If the non-driver user responds affirmatively, the non-driver user's profile picture is collected, and text information entered by the non-driver user is obtained. The intelligent vehicle computer can convert the text information into corresponding audio information, and can generate a virtual image associated with the non-driver user based on the profile picture, and use the virtual image and audio information to synthesize video information. When the intelligent vehicle computer determines that the current vehicle speed is slower than a preset threshold, the intelligent vehicle computer can display an apology message on the screen in front of the driver, that is, display the virtual image on the screen in front of the driver, and the virtual image has corresponding preset actions. As the virtual image moves according to the preset actions, the audio information can be played on the vehicle audio system.

[0120] It should be noted that for the sake of simplicity, the method embodiments are described as a series of actions. However, those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in this specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0121] Reference Figure 2 , shows a structural block diagram of an apology message display device provided in an embodiment of the present invention, which may specifically include the following modules:

[0122] A conversation content and facial expression information acquisition module 201 is configured to acquire the conversation content and facial expression information of the first user and the second user when the vehicle includes at least a first user and a second user;

[0123] an apology request information generating module 202 for generating an apology request information for the first user when it is determined based on the conversation content and the facial expression information that the first user and the second user are in a dispute state;

[0124] an apology request information display module 203, configured to display the apology request information to the first user via the multimedia device;

[0125] an apology message generating module 204, configured to generate an apology message upon receiving a positive reply message to the apology request message sent by the first user;

[0126] The apology message display module 205 is configured to display the apology message to the second user via the multimedia device.

[0127] Optionally, the vehicle-mounted terminal has a corresponding image acquisition device, the multimedia device is a head-up display, and the apology request information display module may include:

[0128] A first user location information determination submodule, configured to determine the first user location information of the first user through the image acquisition device;

[0129] a first display area determination submodule for a first user, configured to determine a first display area for the first user based on the first user location information;

[0130] The apology request information display submodule is used to display the apology request information to the first user in the first display area.

[0131] Optionally, the apology information display module may include:

[0132] A second user location information determination submodule, configured to determine the second user location information of the second user through the image acquisition device;

[0133] A second display area determination submodule, configured to determine a second display area for the second user according to the second user location information;

[0134] The first apology message display submodule is configured to display the apology message to the second user in the second display area.

[0135] Optionally, the apology message generation module may include:

[0136] A text information acquisition submodule, configured to acquire text information entered by the first user;

[0137] A voice information generation submodule, configured to convert the text information into voice information;

[0138] A user portrait acquisition submodule, configured to acquire the user portrait of the first user using the image acquisition device;

[0139] A virtual image generation submodule, configured to generate a virtual image based on the user's avatar;

[0140] The apology message generation submodule is used to synthesize an apology message using the voice information and the virtual image; the apology message is video information.

[0141] Optionally, the apology message display module may further include:

[0142] a speed determination submodule, configured to determine, when the second user is a vehicle driver, whether the speed of the vehicle exceeds a preset threshold; if not, calling a second apology message display submodule;

[0143] The second apology message display submodule is configured to display the apology message to the second user via the multimedia device.

[0144] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0145] In addition, an embodiment of the present invention further provides an electronic device, such as Figure 3 As shown, it includes a processor 301, a communication interface 302, a memory 303 and a communication bus 304, wherein the processor 301, the communication interface 302, and the memory 303 communicate with each other through the communication bus 304.

[0146] Memory 303, for storing computer programs;

[0147] The processor 301 is configured to implement the apology information display method described in the above embodiment when executing the program stored in the memory 303 .

[0148] The communication bus mentioned in the terminal can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in the figure, but this does not mean that there is only one bus or only one type of bus.

[0149] The communication interface is used for communication between the above terminal and other devices.

[0150] The memory may include random access memory (RAM) or non-volatile memory, such as at least one disk storage. Alternatively, the memory may be at least one storage device located away from the processor.

[0151] The above-mentioned processor can be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it can also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, and discrete hardware components.

[0152] like Figure 4 As shown, in another embodiment provided by the present invention, a computer-readable storage medium 401 is further provided, in which instructions are stored. When the computer-readable storage medium 401 is run on a computer, the computer executes the apology information display method described in the above embodiment.

[0153] In another embodiment of the present invention, a computer program product including instructions is provided. When the computer program product is run on a computer, the computer executes the apology information display method described in the above embodiment.

[0154] In the above embodiments, all or part of the embodiments can be implemented by software, hardware, firmware, or any combination thereof. When implemented using software, all or part of the embodiments can be implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).

[0155] It should be noted that, in this document, relational terms such as first and second, etc., are used only to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply the existence of any such actual relationship or order between these entities or operations. Moreover, the terms "comprises," "comprising," or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article, or device comprising a series of elements includes not only those elements, but also other elements not explicitly listed, or elements inherent to such process, method, article, or device. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or device comprising the element.

[0156] Each embodiment in this specification is described in a related manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences between the other embodiments. In particular, the system embodiment is generally similar to the method embodiment, so the description is relatively simple. For related parts, refer to the description of the method embodiment.

[0157] The above description is only a preferred embodiment of the present invention and is not intended to limit the scope of protection of the present invention. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present invention are included in the scope of protection of the present invention.

Claims

1. A method for displaying an apology message, characterized in that: Applied to a vehicle-mounted terminal having a corresponding multimedia device, the method includes: When the vehicle includes at least a first user and a second user, acquiring conversation content and facial expression information of the first user and the second user; When it is determined based on the conversation content and the facial expression information that the first user and the second user are in a dispute, generating an apology request message for the first user; displaying the apology request information to the first user through the multimedia device; generating an apology message when receiving a positive reply message to the apology request message sent by the first user; displaying the apology message to the second user via the multimedia device; The vehicle-mounted terminal has a corresponding image acquisition device, the multimedia device is a head-up display, and the step of displaying the apology request information to the first user through the multimedia device includes: determining first user location information of the first user by the image acquisition device; determining a first display area for the first user according to the first user location information; displaying the apology request information to the first user in the first display area; The step of displaying the apology message to the second user through the multimedia device includes: determining second user location information of the second user by the image acquisition device; determining a second display area for the second user according to the second user location information; displaying the apology message to the second user in the second display area; The step of displaying the apology message to the second user via the multimedia device further comprises: When the second user is a vehicle driver, determining whether the speed of the vehicle exceeds a preset threshold; If not, the apology message is displayed to the second user via the multimedia device.

2. The method according to claim 1, characterized in that The step of generating an apology message includes: Obtaining text information entered by the first user; Converting the text information into voice information; Acquiring a user portrait of the first user using the image acquisition device; generating a virtual image based on the user's avatar; An apology message is synthesized using the voice information and the virtual image; the apology message is a video message.

3. An apology message display device, characterized in that: Applied to a vehicle-mounted terminal having a corresponding multimedia device, the apparatus includes: A conversation content and facial expression information acquisition module, configured to acquire the conversation content and facial expression information of the first user and the second user when the vehicle includes at least a first user and a second user; an apology request information generating module, configured to generate an apology request information for the first user when it is determined based on the conversation content and the facial expression information that the first user and the second user are in a dispute state; an apology request information display module, configured to display the apology request information to the first user via the multimedia device; an apology message generating module, configured to generate an apology message upon receiving a positive reply message sent by the first user to the apology request message; an apology message display module, configured to display the apology message to the second user via the multimedia device; The vehicle-mounted terminal has a corresponding image acquisition device, the multimedia device is a head-up display, and the apology request information display module includes: A first user location information determination submodule, configured to determine the first user location information of the first user through the image acquisition device; a first display area determination submodule for a first user, configured to determine a first display area for the first user based on the first user location information; an apology request information display submodule, configured to display the apology request information to the first user in the first display area; The apology information display module includes: A second user location information determination submodule, configured to determine the second user location information of the second user through the image acquisition device; A second display area determination submodule, configured to determine a second display area for the second user according to the second user location information; a first apology message display submodule, configured to display the apology message to the second user in the second display area; The apology information display module further includes: a speed determination submodule, configured to determine, when the second user is a vehicle driver, whether the speed of the vehicle exceeds a preset threshold; if not, calling a second apology message display submodule; The second apology message display submodule is configured to display the apology message to the second user via the multimedia device.

4. The device according to claim 3, characterized in that The apology message generation module includes: A text information acquisition submodule, configured to acquire text information entered by the first user; A voice information generation submodule, configured to convert the text information into voice information; A user portrait acquisition submodule, configured to acquire the user portrait of the first user using the image acquisition device; A virtual image generation submodule, configured to generate a virtual image based on the user's avatar; The apology message generation submodule is used to synthesize an apology message using the voice information and the virtual image; the apology message is video information.

5. An electronic device, characterized in that: comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus; The memory is used to store computer programs; The processor is configured to implement the method according to any one of claims 1 to 2 when executing a program stored in the memory.

6. One or more computer-readable media having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform the method according to any one of claims 1-2.

7. A vehicle, characterized in that: The vehicle is equipped with an on-board terminal, and the on-board terminal is mechanically coupled and / or electrically connected to the vehicle, so that the vehicle including the on-board terminal executes the method according to any one of claims 1-2.

Images