Information pushing method, device, equipment, system, medium and vehicle

Abstract

The invention relates to an information pushing method, device, equipment and system, a medium and a vehicle. The information pushing method comprises the following steps: acquiring first dialogue information of a user in a vehicle and a feature tag of the user; performing semantic analysis on the voice in the first dialogue information to obtain a semantic analysis result; acquiring current position information of the user; determining to-be-pushed display information according to the semantic analysis result, the feature tag of the user and the current position information of the user; the display information is fed back to a head-up display system of the vehicle, so that the head-up display system displays the display information to a user, according to the embodiment of the invention, the accuracy of the obtained to-be-pushed display information can be improved, and meanwhile, the user experience is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of vehicle electronic technology, and in particular to an information push method, device, equipment, system, medium and vehicle. Background Art

[0002] At present, with the continuous improvement of the intelligence level of vehicles, the vehicle's on-board system can obtain recognition results by recognizing the voice input by the user, match the recognition results with the pre-set voice library, obtain corresponding matching results, and then feed back the matching results to the user to realize voice interaction with the user and information push and other services.

[0003] However, the existing in-vehicle system realizes voice interaction with the user through a pre-set voice library. Since the information storage capacity of the pre-set voice library is limited and the in-vehicle system can only recognize the voice stored in the voice library to interact with the user, there is a problem of low accuracy of the information fed back to the user. At the same time, if the voice input by the user exceeds the range of the voice library, voice recognition and feedback cannot be performed, resulting in a poor user experience. Summary of the invention

[0004] In order to solve the above technical problems, the present disclosure provides an information push method, device, equipment, system, medium and vehicle.

[0005] A first aspect of an embodiment of the present disclosure provides an information push method, including:

[0006] Obtaining the first conversation information of the user in the car and the user's feature label;

[0007] Performing semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result;

[0008] Get the user's current location information;

[0009] Determine the display information to be pushed based on the semantic analysis results, the user's feature tags and the user's current location information;

[0010] The display information is fed back to a head-up display system of the vehicle so that the head-up display system displays the display information to the user.

[0011] A second aspect of the embodiments of the present disclosure provides an information push device, including:

[0012] An information acquisition module, used to acquire the first conversation information of the user in the car and the user's feature tag;

[0013] A semantic analysis module, used to perform semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result;

[0014] Location acquisition module, used to obtain the user's current location information;

[0015] An information determination module is used to determine the display information to be pushed based on the semantic analysis results, the user's feature tags and the user's current location information;

[0016] The information display module is used to feed back the display information to the head-up display system of the vehicle so that the head-up display system displays the display information to the user.

[0017] A third aspect of the embodiments of the present disclosure provides an electronic device, including:

[0018] processor;

[0019] A memory for storing executable instructions;

[0020] Among them, the processor is used to read executable instructions from the memory and execute the executable instructions to implement the information push method provided by the first aspect above.

[0021] A fourth aspect of the embodiments of the present disclosure provides an information push system, including:

[0022] An electronic device, used to obtain first conversation information of a user in a vehicle and a characteristic tag of the user; perform semantic analysis on the speech in the first conversation information to obtain a semantic analysis result; obtain the current location information of the user; determine the display information to be pushed according to the semantic analysis result, the characteristic tag of the user and the current location information of the user; feed the display information back to a head-up display system of the vehicle so that the head-up display system displays the display information to the user, the electronic device being the electronic device provided by the third aspect above;

[0023] The head-up display system is used to receive display information fed back by electronic devices and display the display information to users.

[0024] A fifth aspect of an embodiment of the present disclosure provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the processor implements the information push method provided by the first aspect above.

[0025] A sixth aspect of an embodiment of the present disclosure provides a vehicle, which includes the electronic device provided by the third aspect.

[0026] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0027] The information push method, apparatus, device, system, medium and vehicle provided by the embodiments of the present disclosure can obtain the first conversation information of the user in the vehicle and the user's feature tag, perform semantic analysis on the voice in the first conversation information to obtain the semantic analysis result, and obtain the user's current location information, determine the display information to be pushed according to the semantic analysis result, the user's feature tag and the user's current location information, and feed the display information back to the head-up display system of the vehicle so that the head-up display system displays the display information to the user. In this way, the display information to be pushed can be determined in combination with the user's first conversation information and the user's current location information, as well as the user's feature tag, thereby improving the accuracy of the acquired display information to be pushed and improving the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0029] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0030] Figure 1 is a flow chart of an information push method provided by an embodiment of the present disclosure;

[0031] Figure 2 is a flow chart of another information push method provided by an embodiment of the present disclosure;

[0032] Figure 3 is a flow chart of another information push method provided by an embodiment of the present disclosure;

[0033] Figure 4 It is a structural schematic diagram of an information push device provided by an embodiment of the present disclosure;

[0034] Figure 5 It is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0035] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0036] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0037] It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and / or in parallel. In addition, the method embodiments may include additional steps and / or omit the steps shown. The scope of the present disclosure is not limited in this respect.

[0038] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0039] It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

[0040] Typically, existing vehicle-mounted systems use a pre-set voice library to achieve voice interaction with users. Since the pre-set voice library has a limited amount of information storage, and the vehicle-mounted system can only recognize the voice stored in the voice library to interact with the user, there is a problem of low accuracy of information fed back to the user. At the same time, if the voice input by the user exceeds the range of the voice library, voice recognition and feedback cannot be performed, resulting in a poor user experience. To address this problem, the embodiments of the present disclosure provide an information push method, which is described below in conjunction with specific embodiments.

[0041] Figure 1 It is a flowchart of an information push method provided by an embodiment of the present disclosure. The method can be executed by an information push device. The information push device can be implemented in software and / or hardware. The information push device can be configured in an electronic device, such as a server or a terminal, wherein the terminal specifically includes a mobile phone, a computer or a tablet computer, etc.

[0042] like Figure 1As shown, the information push method provided in this embodiment includes the following steps:

[0043] S110: Acquire first conversation information of the user in the car and the user's feature tag.

[0044] In an embodiment of the present disclosure, the electronic device obtains the first conversation information of the user in the vehicle and the user's feature tag after the vehicle is started or while the vehicle is driving.

[0045] In the disclosed embodiment, the first dialogue information may be a voice message sent by a user in the vehicle.

[0046] The user's characteristic label can be a label determined based on the user's historical conversation information, habits and hobbies, etc.

[0047] The electronic device includes an intelligent voice system, wherein the intelligent voice system can be used to perform semantic analysis, recognition, matching and other processing on the user's first dialogue information.

[0048] The first dialogue information and the second dialogue information can both be natural language dialogues conducted by the user, and the user's voice is collected during the natural language dialogue process to obtain the first dialogue information and the second dialogue information. The intelligent voice system performs natural language processing on the voice in the first dialogue information and the second dialogue information to identify the user's semantics.

[0049] In some embodiments of the present disclosure, the electronic device can obtain the first conversation information of the user in the vehicle through the intelligent voice system or the preset voice acquisition system arranged in the electronic device, and extract the voiceprint information of the user based on the first conversation information of the user, identify the user's identity based on the matching of the user's voiceprint information with the voiceprint information stored in a preset database, determine the feature tag corresponding to the user, and obtain the feature tag of the user from the memory of the electronic device.

[0050] In some other embodiments of the present disclosure, the electronic device can obtain the first conversation information of the user in the vehicle through an intelligent voice system or a preset voice acquisition system set in the electronic device, and at the same time obtain the user's facial image through an image acquisition device set in the vehicle, perform feature extraction on the user's facial image, identify the user's identity based on matching the extracted features with facial features stored in a preset database, determine the feature tag corresponding to the user, and obtain the user's feature tag from the memory of the electronic device.

[0051] S120: Perform semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result.

[0052] In the embodiment of the present disclosure, after acquiring the first dialogue information, the electronic device performs semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result.

[0053] Specifically, after acquiring the first dialogue information, the electronic device may input the first dialogue information into a semantic analysis model, perform semantic analysis on the first dialogue information, and obtain a semantic analysis result.

[0054] S130: Obtain the user's current location information.

[0055] In an embodiment of the present disclosure, the electronic device may obtain the current location information of the user after obtaining the first conversation information of the user.

[0056] The current location information can be understood as information such as the user's current location coordinates.

[0057] Specifically, after obtaining the user's first conversation information, the electronic device can obtain the location of the vehicle based on the vehicle's positioning system and / or advanced driver assistance system (ADAS), and determine the location of the vehicle as the user's current location information, where the user's current location information can be updated in real time according to the location of the vehicle.

[0058] It should be noted that in the embodiment of the present disclosure, the execution order of S120 and S130 is not limited, and S120 and S130 may be executed simultaneously, or S130 may be executed before S120.

[0059] S140: Determine the display information to be pushed according to the semantic analysis result, the user's feature tag and the user's current location information.

[0060] In the disclosed embodiment, after acquiring the user's current location information and the semantic analysis result, the electronic device determines the display information to be pushed according to the semantic analysis result, the user's feature tag and the user's current location information.

[0061] Optionally, the display information to be pushed can be any information that is of interest to the user or meets the user's needs, such as point of interest information (i.e., information associated with points of interest (POI) in real-world scenes (that is, real environments) including restaurant information, sports venue information, shopping mall information, etc.), non-point of interest information (i.e., information not associated with points of interest in real-world scenes, such as news information, movie recommendations, stock information, travel information, etc.).

[0062] Specifically, the electronic device can search for information that matches the current location, the user's feature tag and the semantic analysis result based on the semantic analysis result, the user's feature tag and the user's current location information, and determine the information as the display information to be pushed.

[0063] S150: Feedback the display information to the head-up display system of the vehicle, so that the head-up display system displays the display information to the user.

[0064] In the disclosed embodiment, after acquiring the display information to be pushed, the electronic device feeds back the display information to the head-up display system of the vehicle, so that the head-up display system displays the display information to the user.

[0065] In some embodiments of the present disclosure, after acquiring the display information to be pushed, the electronic device feeds back the display information to the head-up display system of the vehicle. The head-up display system renders the display information and displays it to the user, or the head-up display system directly displays the display information to the user.

[0066] The head-up display system displays the display information to the user, for example, the head-up display system displays the display information in the virtual image it projects. Among them, when the display information has a corresponding object in the real world scene (such as a restaurant, a shop, and other points of interest), that is, when the display information is a point of interest POI information, the display information displayed in the virtual image is superimposed on the object (i.e., point of interest) in the real world scene, for example, the display information is fused and displayed with the object in the real world scene through augmented reality technology; when the display information is non-point of interest information, the display information is displayed in the virtual image in the form of a pop-up window. Since non-point of interest information does not need to be displayed in augmented reality with objects in the real world scene, the display information can be displayed in a pop-up window, or directly displayed in a non-augmented reality manner in the virtual image.

[0067] In some other embodiments of the present disclosure, the electronic device may also determine the identity of the user after acquiring the pushed display information, and when the user is a passenger, feed back the display information to the user in the form of information.

[0068] In the disclosed embodiment, it is possible to obtain the first conversation information of the user in the vehicle and the user's feature tag, perform semantic analysis on the voice in the first conversation information to obtain the semantic analysis result, and obtain the user's current location information, and determine the display information to be pushed based on the semantic analysis result, the user's feature tag and the user's current location information, and feed the display information back to the vehicle's head-up display system so that the head-up display system displays the display information to the user. As a result, there is no need to push the display information based on a fixed voice command input by the user, but the display information to be pushed can be determined in combination with the user's first conversation information and the user's current location information, as well as the user's feature tag, thereby improving the accuracy of the acquired display information to be pushed and improving the user experience.

[0069] Before obtaining the first conversation information and the user's feature tag in the car, the electronic device determines the driving state of the vehicle. If the driving state is manual driving, a prompt message is sent to the user so that the user can actively start the information push service based on the prompt message; if the driving state is automatic driving or assisted driving, the information push service is automatically started. The user can also set whether to start the information push service when the driving state is automatic driving or assisted driving.

[0070] Figure 2 FIG. 1 is a flow chart of another information push method provided by an embodiment of the present disclosure. Figure 2 As shown, the information push method includes the following steps:

[0071] S210: Obtain first conversation information of the user in the car and the user's feature tag.

[0072] S220: Perform semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result.

[0073] S230: Obtain the user's current location information.

[0074] In the embodiment of the present disclosure, the specific implementation of S210 - S230 is similar to the specific implementation of S110 - S130 and will not be described in detail here.

[0075] S240: Determine multimedia information corresponding to the current location information according to the current location information of the user.

[0076] In the embodiment of the present disclosure, after acquiring the current location information of the user, the electronic device determines the multimedia information corresponding to the current location information according to the current location information of the user.

[0077] Specifically, the electronic device can obtain the current location information through the positioning system, high-precision map, etc., and confirm the current real-world scene, and then obtain the multimedia information corresponding to the current location and nearby locations from the database based on the current location information, that is, the multimedia information corresponding to the current real-world scene.

[0078] The multimedia information may include point of interest information (such as store information, sports venue information, shopping mall information, etc.) and non-point of interest information (such as news information, movie recommendations, stock information, travel information, etc.).

[0079] Further, according to the semantic analysis result and the characteristic tag of the user, the display information to be pushed is determined from the multimedia information. Specifically, the display information to be pushed from the multimedia information may be determined in a manner of executing S250-S280.

[0080] S250: Determine a plurality of matching information in the multimedia information that matches the semantic analysis result and the user's feature tag.

[0081] In the embodiment of the present disclosure, after determining the multimedia information corresponding to the current location information, the electronic device determines a plurality of matching information in the multimedia information that matches the semantic analysis result and the feature tag of the user.

[0082] Specifically, after determining the multimedia information corresponding to the current location information, the electronic device extracts keywords from the multimedia information, and calculates the similarity between the semantic analysis results and the user's feature tags and the keywords corresponding to the multimedia information. When the similarity is less than a preset threshold, it is determined that the multimedia information corresponding to the keyword does not match the semantic analysis results and the user's feature tags. When the similarity is greater than or equal to the preset threshold, it is determined that the multimedia information corresponding to the keyword is matching information, thereby obtaining multiple matching information.

[0083] S260: Obtain the user's emotional state and / or current time information.

[0084] In the embodiment of the present disclosure, after determining a plurality of matching information, the electronic device obtains the user's emotional state and / or current time information.

[0085] Optionally, the user's emotional state may be a happy state, a sad state, a tired state, a nervous state, or the like.

[0086] Optionally, the current time information may be divided by day, such as morning, noon, afternoon, evening, day, night, etc., or may be divided by festivals corresponding to the date, such as today is Dragon Boat Festival, Mother's Day, etc.

[0087] Specifically, after determining multiple matching information, the electronic device obtains the user's image through the image acquisition device set on the vehicle, performs user expression analysis based on the user's image, and then obtains the user's emotional state. At the same time, the current time information is obtained through the clock of the electronic device.

[0088] S270: Filter out at least one display information to be pushed from multiple matching information according to the user's emotional state and / or current time information.

[0089] In the disclosed embodiment, after acquiring the user's emotional state and / or current time information, the electronic device filters out at least one display information to be pushed from multiple matching information according to the user's emotional state and / or current time information.

[0090] In some embodiments of the present disclosure, after acquiring the emotional state of the user, the electronic device filters out matching information that matches the user's current emotional state from multiple matching information based on the user's emotional state, as at least one display information to be pushed. For example, if the current user's emotional state is relatively happy, matching information related to the happy state can be matched.

[0091] In other embodiments of the present disclosure, after acquiring the current time information, the electronic device filters out matching information that matches the current time information from multiple matching information according to the current time information, as at least one display information to be pushed. For example, if the current time is morning, breakfast or coffee-related information is pushed; lunch-related information is pushed at noon; road traffic conditions-related information is pushed in the evening; shopping / entertainment-related information is pushed on weekends, etc.

[0092] In some other embodiments of the present disclosure, after obtaining the user's emotional state and current time information, the electronic device filters out matching information that matches the user's current emotional state and current time information from multiple matching information based on the user's emotional state and current time information, as at least one display information to be pushed.

[0093] Furthermore, when there are two or more users in the car, the electronic device can also determine the character relationship between the two or more users based on the users' conversation information, pre-stored user character relationships, etc., and push different information content based on the character relationship, where the character relationship can be a parent-child relationship, a friend relationship, a lover relationship, etc.

[0094] S280: Feedback the at least one display information to be pushed to the head-up display system, so that the head-up display system displays the at least one display information to be pushed to the user.

[0095] In an embodiment of the present disclosure, after the electronic device screens out at least one display information to be pushed from multiple matching information, it feeds back the at least one display information to be pushed to the head-up display system, so that the head-up display system displays the at least one display information to be pushed to the user.

[0096] In the disclosed embodiments, by obtaining at least one of the user's emotional state, current time information, and character relationships, at least one display information to be pushed can be filtered out from the multimedia information corresponding to the current location information, and the at least one display information to be pushed can be fed back to the head-up display system, so that the head-up display system displays the at least one display information to be pushed to the user. In this way, display information that is consistent with the real environment in which the user is located can be pushed, and messages can be pushed to the user in a targeted manner, thereby further improving the accuracy of information push and improving the user experience.

[0097] Further, on the basis of the above-mentioned embodiments of the present disclosure, at least one display information to be pushed is fed back to the head-up display system so that the head-up display system displays the at least one display information to be pushed to the user, which can specifically include: determining the priority of at least one display information to be pushed; sorting the at least one display information to be pushed according to the priority of the at least one display information to be pushed, and displaying the at least one display information to be pushed to the user through the head-up display system according to the sorting.

[0098] In an embodiment of the present disclosure, the electronic device can determine the priority of at least one display information to be pushed according to the degree of match between at least one display information to be pushed and the user's current location information, semantic analysis results, feature tags, and the user's emotional state and at least one of the current time information, wherein the higher the degree of match, the higher the priority. Then, according to the priority of the at least one display information to be pushed, the at least one display information to be pushed is sorted, and the at least one display information to be pushed is displayed to the user through the head-up display system according to the sorting. As a result, the user can give priority to seeing the at least one display information to be pushed with the highest degree of match, which is convenient for the user to filter and further improves the user's filtering efficiency and user experience.

[0099] Figure 3 is a flowchart of another information push method provided by an embodiment of the present disclosure, such as Figure 3 As shown, the information push method includes the following steps:

[0100] S310: Obtain first conversation information of the user in the car and the user's feature tag.

[0101] S320: Perform semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result.

[0102] S330: Obtain the user's current location information.

[0103] S340: Determine the display information to be pushed according to the semantic analysis result, the user's feature tag and the user's current location information.

[0104] S350: Feedback the display information to the head-up display system of the vehicle, so that the head-up display system displays the display information to the user.

[0105] In the embodiment of the present disclosure, the specific implementation of S310-S350 is similar to that of S110-S150 in the above embodiment, and will not be repeated here.

[0106] S360: Obtain in real time user feedback information on at least one display information displayed by the head-up display system.

[0107] In an embodiment of the present disclosure, after displaying the display information to the user, the electronic device obtains in real time feedback information from the user regarding at least one display information displayed by the head-up display system.

[0108] The feedback information includes at least one of the second dialogue information, gaze position, gaze duration, and gesture, and the second dialogue information is voice information.

[0109] The second dialogue information may be understood as voice information of the user's feedback on at least one piece of display information, such as information on satisfaction or dissatisfaction with the at least one piece of display information.

[0110] The gaze position may be understood as a position where at least one display information viewed or gazed by a user is located.

[0111] The gaze duration may be understood as the time a user gazes at one or more displayed information, and the user's interest in the one or more displayed information may be determined based on the gaze duration.

[0112] A gesture can be understood as a gesture of a user's feedback on at least one displayed information. For example, a thumbs-up, a heart and a Y-sign represent a like, indicating that the user is satisfied with at least one displayed information; a thumbs-down sign represents that the user is dissatisfied with at least one displayed information. The user can also use his or her fingers to score the feedback information.

[0113] Specifically, after displaying the display information to the user, the electronic device obtains in real time feedback information from the user regarding at least one display information displayed by the head-up display system, and determines whether to perform a specific operation according to the feedback information.

[0114] Furthermore, the specific execution operation may include updating the user's feature tag, specifically executing S370-S380; the specific execution operation may also include determining the content of the display information or the status of the display information according to the user's feedback information, specifically executing S390-S3010.

[0115] S370: Determine a target feature tag of the user according to at least one display information and corresponding feedback information.

[0116] In an embodiment of the present disclosure, after obtaining feedback information from the user, the electronic device determines a target feature tag of the user according to at least one display information and corresponding feedback information.

[0117] Specifically, based on the user's feedback information, the display information that the user is interested in is determined, and based on the display information that the user is interested in, the user's target feature tag is determined. For example, if the user is interested in one or more display information, keywords are extracted based on the display information that the user is interested in, and the user's target feature tag is generated.

[0118] S380: Update the user's feature tag according to the target feature tag.

[0119] In the disclosed embodiment, after determining the target feature tag of the user, the electronic device updates the feature tag of the user according to the target feature tag.

[0120] Specifically, after determining the target feature tag of the user, the electronic device performs operations such as adding, deleting, and correcting the feature tag of the user to ensure that the user's preference requirements are met.

[0121] S390: When it is determined according to the feedback information that the user is not interested in the first display information among the at least one display information, determine at least one second display information for replacing the first display information based on the second dialogue information of the user.

[0122] In an embodiment of the present disclosure, after obtaining feedback information from the user, the electronic device analyzes the feedback information, and when it is determined based on the feedback information that the user is not interested in a first display information among at least one display information, at least one second display information for replacing the first display information is determined based on the user's second conversation information.

[0123] Specifically, after obtaining the user's feedback information, the electronic device analyzes the feedback information. When it is determined based on the feedback information that the user is not interested in the first display information in the at least one display information, the electronic device performs semantic analysis on the user's second dialogue information to obtain a semantic analysis result corresponding to the second dialogue information, determines at least one second display information based on the semantic analysis result corresponding to the second dialogue information, and replaces the at least one first display information with the at least one second display information.

[0124] When it is determined according to the feedback information that the user is interested in the first display information among the at least one display information, the display of the at least one display information is maintained.

[0125] S3010: Feedback the second display information to the head-up display system, so that the head-up display system replaces the first display information displayed with the second display information; or, the head-up display system turns off display of the first display information.

[0126] In the disclosed embodiment, after obtaining the second display information, the electronic device feeds the second display information back to the head-up display system, so that the head-up display system replaces the first display information displayed with the second display information.

[0127] When the electronic device performs semantic analysis on the second dialogue information of the user and obtains that the semantic analysis result corresponding to the second dialogue information is to close the display information, the electronic device sends a command to close the display information to the head-up display system, so that the head-up display system closes the display of the first display information.

[0128] In the disclosed embodiment, the electronic device can determine the display information and the status of the display information in real time according to the user's feedback information, so that the display information meets the user's needs, further improving the user experience.

[0129] Based on the above embodiments of the present disclosure, the information push method may further include: the display information to be pushed includes interest point information, and the interest point information corresponds to a target object (ie, interest point) in a real environment.

[0130] In the embodiments of the present disclosure, the point of interest information can be understood as information associated with a location, such as a store, a bus stop, a coffee shop, etc. Specifically, the point of interest information can include the name, category, coordinates, classification and other information corresponding to the point of interest.

[0131] Furthermore, feeding back the display information to the head-up display system of the vehicle so that the head-up display system displays the display information to the user may specifically include: feeding back the display information to the head-up display system so that when the head-up display system determines that the real geographical location of the target object corresponding to the point of interest information is within the field of view of the head-up display system, the head-up display system displays the display information in a distant virtual image projected by the head-up display system in a manner of superimposing the display information with the corresponding target object; or, when the head-up display system determines that the real geographical location of the target object corresponding to the point of interest information is outside the field of view of the head-up display system, the head-up display system displays the display information in a near virtual image projected by the head-up display system, wherein the imaging distance of the near virtual image is smaller than the imaging distance of the distant virtual image.

[0132] For example, there is a coffee shop in the real environment corresponding to the user's current location information, and the coffee shop is on the third floor of a high-rise building in front of the left side of the vehicle. Then the point of interest information corresponds to the actual location of the coffee shop, that is, the display information corresponding to the point of interest is displayed on the display interface of the head-up display system at the third floor of the high-rise building in front of the left side of the vehicle, so that the user can intuitively see the location of the coffee shop.

[0133] In the disclosed embodiment, when the display information to be pushed is point of interest information, it is possible to determine whether the real geographical location of the target object corresponding to the point of interest information is within the field of view angle of the head-up display system or outside the field of view angle range, and then, execute a specific display method according to whether the real geographical location of the target object is within the field of view angle range of the head-up display system.

[0134] The display information is displayed in a far-layer virtual image projected by the head-up display system in a superimposed manner with the corresponding target object, that is, the display information and the target object are fused and displayed through augmented reality technology. When the display information is non-point of interest information, the display information is displayed in the near-layer virtual image. Since the non-point of interest information does not need to be augmented with the objects in the real environment, the display information can be displayed in the near-layer virtual image.

[0135] In the disclosed embodiment, the information push method may further include: obtaining the user's emotional state, current time information, in-car environment information, and out-car environment information; according to the semantic analysis result, at least one of the user's emotional state, current time information, in-car environment information, and out-car environment information, setting the display parameters of the vehicle system function and / or the head-up display system, wherein the setting of the vehicle system function includes turning on or off the in-car air conditioning, turning on or off the in-car atmosphere light, and setting the in-car temperature, and the display parameters include the virtual image brightness, virtual image height, and virtual image display mode projected by the head-up display system. The virtual image brightness, virtual image height, and virtual image display mode of all virtual images projected by the head-up display system may be set simultaneously, or the far-layer virtual image and the near-layer virtual image may be set separately.

[0136] In the embodiment of the present disclosure, the in-vehicle environmental information may include temperature, humidity, brightness information, etc. in the vehicle.

[0137] The external environment information may include the temperature, humidity, brightness, etc. outside the vehicle.

[0138] Among them, according to the semantic analysis results, the user's emotional state, the current time information, the in-vehicle environment information, and at least one of the outside-vehicle environment information, the display parameters of the vehicle system function and / or the head-up display system are set, which can specifically include: according to the semantic analysis results, the user's emotional state, the current time information, the in-vehicle environment information, and at least one of the outside-vehicle environment information, determine the first function trigger operation; based on the first function trigger operation, determine the setting parameters of the vehicle system function, and set the vehicle system function based on the setting parameters; and / or, according to the semantic analysis results, the user's emotional state, the current time information, the in-vehicle environment information, the outside-vehicle environment information, and at least one of the screen display height of the head-up display system, determine the second function trigger operation; based on the second function trigger operation, determine the display parameters of the head-up display system, and set the display parameters of the head-up display system.

[0139] Furthermore, based on the first function trigger operation and / or the second function trigger operation, an inquiry voice is issued to the user as to whether to execute the first function trigger operation and / or the second function trigger operation; a reply voice of the user to the inquiry voice is obtained; when it is determined that the semantic analysis result corresponding to the reply voice is to execute, the first function trigger operation and / or the second function trigger operation is executed; when it is determined that the semantic analysis result corresponding to the reply voice is not to execute, the first function trigger operation and / or the second function trigger operation is not executed.

[0140] In some examples, the need for a cooling operation and the specific execution parameters of the cooling operation are determined based on the user's emotional state, current time information, in-vehicle environment information, and out-vehicle environment information. After determining the need for a cooling operation and the specific execution parameters of the cooling operation, an inquiry voice such as "Do you want to lower the temperature?" or "Do you want to adjust the temperature to XX degrees" is sent to the user. The user replies "yes" or "yes" to the inquiry voice, and the electronic device performs the cooling operation based on the user's reply. The electronic device may also directly perform the cooling operation without sending an inquiry voice to the user.

[0141] In other examples, based on the semantic analysis results, the user's emotional state, the current time information, the in-vehicle environment information, the out-of-vehicle environment information, and at least one of the display height of the head-up display system, it is determined that an operation of raising the display screen height of the head-up display system and specific execution parameters need to be performed. After determining that the operation of raising the display screen height of the head-up display system needs to be performed, an inquiry voice such as "Do you want to raise the display screen of the head-up display system?" is issued to the user. The user replies "no" or "not needed" to the inquiry voice. The electronic device does not perform the operation of raising the display screen height of the head-up display system based on the user's reply. The electronic device may also not send an inquiry voice to the user and directly perform the operation of raising the display screen height of the head-up display system.

[0142] In the disclosed embodiments, the vehicle system functions and / or the display parameters of the head-up display system can be set according to the semantic analysis results, the user's emotional state, the current time information, the in-vehicle environment information, and at least one of the out-vehicle environment information. Thus, there is no need for the user to make direct adjustments or to make adjustments through passwords, etc., which is convenient for users, provides users with a comfortable environment, and improves the user experience.

[0143] In the disclosed embodiment, the information push method may further include: continuously optimizing and learning the intelligent voice system in the electronic device based on the user's first conversation information, thereby improving the intelligent voice system's recognition capability and accuracy of the first conversation information, and at the same time, enabling the intelligent voice system to accurately recognize the user's meaning according to the semantic context of the first conversation information.

[0144] Figure 4 It is a structural diagram of an information push device provided by an embodiment of the present disclosure.

[0145] In the embodiments of the present disclosure, the information push device can be set in an electronic device and is understood as a part of the functional modules in the above electronic device. Specifically, the electronic device can be a server or a terminal, wherein the terminal specifically includes a mobile phone, a computer or a tablet computer, etc., which is not limited here.

[0146] like Figure 4 As shown, the information pushing device 400 may include an information acquisition module 410 , a semantic analysis module 420 , a location acquisition module 430 , an information determination module 440 and an information display module 450 .

[0147] The information acquisition module 410 may be used to acquire the first conversation information of the user in the vehicle and the user's feature tag.

[0148] The semantic analysis module 420 may be used to perform semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result.

[0149] The location acquisition module 430 may be used to acquire the current location information of the user.

[0150] The information determination module 440 may be used to determine the display information to be pushed according to the semantic analysis result, the user's feature tag and the user's current location information.

[0151] The information display module 450 can be used to feed back the display information to the head-up display system of the vehicle so that the head-up display system displays the display information to the user.

[0152] In the disclosed embodiment, it is possible to obtain the first conversation information of the user in the vehicle and the user's feature tag, perform semantic analysis on the voice in the first conversation information to obtain the semantic analysis result, and obtain the user's current location information, and determine the display information to be pushed based on the semantic analysis result, the user's feature tag and the user's current location information, and feed the display information back to the vehicle's head-up display system so that the head-up display system displays the display information to the user. Thus, it is possible to determine the display information to be pushed in combination with the user's first conversation information and the user's current location information, as well as the user's feature tag, thereby improving the accuracy of the acquired display information to be pushed and improving the user experience.

[0153] In some embodiments of the present disclosure, the information determination module 440 may include a first determination unit 4401 and a second determination unit 4402 .

[0154] The first determining unit 4401 may be configured to determine multimedia information corresponding to the current location information according to the current location information of the user.

[0155] The second determining unit 4402 may be configured to determine the presentation information to be pushed from the multimedia information according to the semantic analysis result and the user's feature tag.

[0156] In some embodiments of the present disclosure, the second determination unit 4402 can be specifically used to determine multiple matching information in the multimedia information that matches the semantic analysis results and the user's feature tags; obtain the user's emotional state and / or current time information; and filter out at least one display information to be pushed from the multiple matching information based on the user's emotional state and / or current time information.

[0157] In some embodiments of the present disclosure, the information pushing device 400 may further include a first acquisition module 460 , a first determination module 470 and a label update module 480 .

[0158] The first acquisition module 460 can be used to obtain in real time user feedback information on at least one display information displayed by the head-up display system, wherein the feedback information includes at least one of second dialogue information, gaze position, gaze duration, and gesture, and the second dialogue information is voice information.

[0159] The first determination module 470 may be configured to determine a target feature tag of a user according to at least one display information and corresponding feedback information.

[0160] The label updating module 480 may be used to update the user's feature label according to the target feature label.

[0161] In some embodiments of the present disclosure, the information pushing device 400 may further include a second determination module 490 and an information replacement module 4010 .

[0162] The second determination module 490 may be configured to determine at least one second presentation information for replacing the first presentation information based on the user's second dialogue information when it is determined according to the feedback information that the user is not interested in the first presentation information among the at least one presentation information.

[0163] The information replacement module 4010 can be used to feed back the second display information to the head-up display system, so that the head-up display system replaces the displayed first display information with the second display information; or, the head-up display system turns off the display of the first display information.

[0164] In some embodiments of the present disclosure, the display information to be pushed includes interest point information, and the interest point information corresponds to a target object in a real environment.

[0165] The information display module 450 can be specifically used to feed back display information to the head-up display system, so that when the head-up display system determines that the real geographical location of the target object corresponding to the point of interest information is within the field of view of the head-up display system, the head-up display system displays the display information in a distant virtual image projected by the head-up display system in a manner of superimposing the display information with the corresponding target object; or, when the head-up display system determines that the real geographical location of the target object corresponding to the point of interest information is outside the field of view of the head-up display system, the head-up display system displays the display information in a near virtual image projected by the head-up display system, wherein the imaging distance of the near virtual image is smaller than the imaging distance of the distant virtual image.

[0166] In some embodiments of the present disclosure, the information pushing device 400 may further include a second acquisition module 4020 and a function setting module 4030 .

[0167] The second acquisition module 4020 can be used to obtain the user's emotional state, current time information, in-vehicle environment information, and out-vehicle environment information.

[0168] The function setting module 4030 can be used to set the display parameters of the vehicle system function and / or the head-up display system according to the semantic analysis results, the user's emotional state, the current time information, the in-vehicle environment information, and at least one of the out-vehicle environment information. The setting of the vehicle system function includes turning on or off the in-vehicle air conditioning, turning on or off the in-vehicle ambient light, and setting the in-vehicle temperature. The display parameters include the brightness of the virtual image projected by the head-up display system, the virtual image height, and the display mode of the virtual image.

[0169] It should be noted that Figure 4 The information push device 400 shown can execute each step in the above method embodiment and realize each process and effect in the above method embodiment, which will not be described in detail here.

[0170] Figure 5 It is a structural schematic diagram of an electronic device provided by an embodiment of the present disclosure.

[0171] In the disclosed embodiment, Figure 5 The electronic device shown may be a server or a terminal, wherein the terminal specifically includes a mobile phone, a computer or a tablet computer, etc., which is not limited here.

[0172] like Figure 5 As shown, the electronic device may include a processor 510 and a memory 520 storing computer program instructions.

[0173] Specifically, the processor 510 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present disclosure.

[0174] The memory 520 may include a large capacity memory for information or instructions. By way of example and not limitation, the memory 520 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a tape, or a universal serial bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory 520 may include a removable or non-removable (or fixed) medium. Where appropriate, the memory 520 may be inside or outside the integrated gateway device. In a particular embodiment, the memory 520 is a non-volatile solid-state memory. In a particular embodiment, the memory 520 includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (Electrically Erasable Programmable ROM, EEPROM), an electrically rewritable ROM (EAROM), or a flash memory, or a combination of two or more of these.

[0175] The processor 510 reads and executes the computer program instructions stored in the memory 520 to perform the steps of the information push method provided in the embodiment of the present disclosure.

[0176] In one example, the electronic device may further include a transceiver 530 and a bus 540. Figure 5 As shown, the processor 510, the memory 520 and the transceiver 530 are connected via a bus 540 and communicate with each other.

[0177] The bus 540 includes hardware, software, or both. For example, but not limitation, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Extended Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), a Hyper Transport (HT) interconnect, an Industrial Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a Memory bus, a MicroChannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses or a combination of two or more of these. Where appropriate, the bus 540 may include one or more buses.

[0178] A fourth aspect of the embodiments of the present disclosure provides an information push system, including:

[0179] An electronic device, used to obtain first conversation information of a user in a vehicle and the user's feature tag; perform semantic analysis on the voice in the first conversation information to obtain a semantic analysis result; obtain the user's current location information; determine the display information to be pushed based on the semantic analysis result, the user's feature tag and the user's current location information; feed the display information back to the vehicle's head-up display system so that the head-up display system displays the display information to the user, the electronic device is the electronic device provided by the third aspect above; the head-up display system is used to receive the display information fed back by the electronic device and display the display information to the user.

[0180] The embodiments of the present disclosure further provide a computer-readable storage medium, which may store a computer program. When the computer program is executed by a processor, the processor implements the information push method provided by the embodiments of the present disclosure.

[0181] The above-mentioned storage medium may, for example, include a memory 520 of computer program instructions, and the above-mentioned instructions may be executed by the processor 510 of the electronic device to complete the information push method provided in the embodiment of the present disclosure. Optionally, the storage medium may be a non-temporary computer-readable storage medium, for example, the non-temporary computer-readable storage medium may be a ROM, a random access memory (Random Access Memory, RAM), a compact disc read-only memory (Compact Disc ROM, CD-ROM), a magnetic tape, a floppy disk, and an optical data storage device, etc.

[0182] The embodiments of the present disclosure also provide a vehicle, which includes electronic equipment and can implement the various processes and effects in the above embodiments of the present disclosure, which will not be elaborated here.

[0183] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. An information push method, characterized in that: include: Acquire first conversation information of a user in the vehicle and a feature tag of the user; Performing semantic analysis on the speech in the first conversation information to obtain a semantic analysis result; Obtaining the current location information of the user; Determining the display information to be pushed according to the semantic analysis result, the feature tag of the user and the current location information of the user; The display information is fed back to a head-up display system of the vehicle so that the head-up display system displays the display information to the user.

2. The method according to claim 1, characterized in that The determining, according to the semantic analysis result, the feature tag of the user and the current location information of the user, the display information to be pushed includes: Determining multimedia information corresponding to the current location information according to the current location information of the user; The display information to be pushed is determined from the multimedia information according to the semantic analysis result and the characteristic tag of the user.

3. The method according to claim 2, characterized in that The step of determining the display information to be pushed from the multimedia information according to the semantic analysis result and the characteristic tag of the user includes: Determining a plurality of matching information in the multimedia information that matches the semantic analysis result and the feature tag of the user; Acquiring the user's emotional state and / or current time information; At least one display information to be pushed is screened out from a plurality of matching information according to the emotional state of the user and / or the current time information.

4. The method according to claim 1, characterized in that: The method further comprises: Acquiring in real time feedback information of the user on at least one display information displayed by the head-up display system, wherein the feedback information includes at least one of second dialogue information, gaze position, gaze duration, and gesture, and the second dialogue information is voice information; Determining a target feature tag of the user according to the at least one display information and the corresponding feedback information; The feature tag of the user is updated according to the target feature tag.

5. The method according to claim 4, characterized in that When it is determined according to the feedback information that the user is not interested in the first display information among the at least one display information, the method further includes: determining, based on the second conversation information of the user, at least one second presentation information for replacing the first presentation information; feeding back the second display information to the head-up display system, so that the head-up display system replaces the first display information displayed by the head-up display system with the second display information; or, The head-up display system is caused to close display of the first display information.

6. The method according to any one of claims 1 to 5, characterized in that: The display information to be pushed includes point of interest information, and the point of interest information corresponds to a target object in a real environment; Feeding back the display information to a head-up display system of a vehicle so that the head-up display system displays the display information to the user includes: The display information is fed back to the head-up display system, so that when the head-up display system determines that the real geographical location of the target object corresponding to the point of interest information is within the field of view of the head-up display system, the head-up display system displays the display information in a distant virtual image projected by the head-up display system in a superimposed manner with the corresponding target object; or, when the head-up display system determines that the real geographical location of the target object corresponding to the point of interest information is outside the field of view of the head-up display system, the head-up display system displays the display information in a near virtual image projected by the head-up display system, wherein an imaging distance of the near virtual image is smaller than an imaging distance of the distant virtual image.

7. The method according to claim 1, characterized in that The method further comprises: Acquiring the user's emotional state, current time information, in-vehicle environment information, and out-vehicle environment information; According to the semantic analysis result, at least one of the user's emotional state, current time information, in-vehicle environment information, and out-vehicle environment information, the vehicle system function and / or the display parameters of the head-up display system are set, wherein the setting of the vehicle system function includes turning on or off the in-vehicle air conditioning, turning on or off the in-vehicle ambient light, and setting the in-vehicle temperature, and the display parameters include the brightness, height, and display mode of the virtual image projected by the head-up display system.

8. An information push device, characterized in that: include: An information acquisition module, used to acquire first conversation information of a user in the vehicle and a feature tag of the user; A semantic analysis module, used to perform semantic analysis on the speech in the first dialogue information to obtain a semantic analysis result; A location acquisition module, used to acquire the current location information of the user; An information determination module, used to determine the display information to be pushed according to the semantic analysis result, the feature tag of the user and the current location information of the user; The information display module is used to feed back the display information to the head-up display system of the vehicle so that the head-up display system displays the display information to the user.

9. An electronic device, characterized in that: include: processor; A memory for storing executable instructions; The processor is used to read the executable instructions from the memory and execute the executable instructions to implement the method described in any one of claims 1 to 7.

10. An information push system, characterized in that: include: An electronic device, used to obtain first conversation information of a user in a vehicle and a characteristic tag of the user; Performing semantic analysis on the speech in the first conversation information to obtain a semantic analysis result; obtaining the current location information of the user; and determining the display information to be pushed according to the semantic analysis result, the feature tag of the user and the current location information of the user; feeding back the display information to a head-up display system of a vehicle so that the head-up display system displays the display information to the user, wherein the electronic device is the electronic device according to claim 9; A head-up display system is used to receive the display information fed back by the electronic device and display the display information to the user.

11. A computer-readable storage medium, characterized in that: The storage medium stores a computer program, and when the computer program is executed by a processor, the processor implements the method according to any one of claims 1 to 7.

12. A vehicle, characterized in that: Comprising the electronic device as claimed in claim 9.

Images