Vehicle information interaction method and device, computing equipment and computer program product
By combining the display unit and sound sensor in the vehicle, the interactive vehicle information introduction is realized using voice interactive controls, which solves the problem of inefficient and inaccurate information introduction caused by vehicle intelligence, and improves the accuracy of user experience and information communication.
Patent Information
- Application Number
- CN202410980845.5
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-19
- Publication Date
- 2024-11-12
AI Technical Summary
During the vehicle purchase process, due to the improvement of the vehicle's intelligence level and the vehicle's functions are numerous, resulting in low efficiency and inaccurate manual introduction, making it difficult to effectively convey vehicle information.
Provide a vehicle information interaction method, by combining a display unit and a sound sensor in the vehicle, it automatically evokes the vehicle information introduction application when a user enters the vehicle, and uses voice interaction controls to actively guide the user to understand the vehicle functions, and display the vehicle dynamically based on user feedback. Information, realizes interactive vehicle information introduction.
It improves the efficiency and accuracy of vehicle information introduction, provides more immersive user experience and emotional value, and enhances users' understanding and experience of vehicle functions.
Smart Images

Figure CN118939770A_ABST
Abstract
Description
Technical Field
[0001] The present specification relates to the field of computer application technology, specifically, to the vehicle information interaction technology under the field of computer application technology, and more specifically, to a vehicle information interaction method, device, computing equipment and computer program product. Background Art
[0002] With the continuous development of vehicle technology, the level of vehicle intelligence is getting higher and higher. In order to buy a vehicle that suits their needs, users need to understand and experience vehicle information in detail.
[0003] Currently, when users purchase a vehicle, they need vehicle sales staff to explain the vehicle functions to help them understand the vehicle. However, due to the improvement of vehicle intelligence, vehicles have many functions, and manual introduction is inefficient and may not be accurate. Summary of the invention
[0004] The embodiments of this specification provide a vehicle information interaction method, apparatus, computing device and computer program product to implement an interactive vehicle information introduction process and improve the efficiency and accuracy of vehicle information introduction.
[0005] To achieve the above technical objectives, the embodiments of this specification provide the following technical solutions:
[0006] In a first aspect, an embodiment of the present specification provides a vehicle information interaction method, comprising:
[0007] In response to the target object entering the vehicle, a vehicle information introduction application is invoked to display a vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application, wherein the vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the presentation of vehicle introduction content in the vehicle information introduction interface;
[0008] Acquire voice information sent by the target object, where the voice information is obtained based on the vehicle introduction content;
[0009] A function introduction page corresponding to the voice information is displayed in the vehicle information introduction interface, and based on the target function indicated by the function introduction page, the function firmware associated with the target function is controlled to perform operational interaction with the target object.
[0010] In a second aspect, an embodiment of the present specification provides a vehicle information interaction device, including: a display unit, a sound sensor, and a processing unit;
[0011] The processing unit is used to call up a vehicle information introduction application in response to a target object entering a vehicle, so as to control the display unit to display a vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application, wherein the vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the presentation of vehicle introduction content in the vehicle information introduction interface;
[0012] The sound sensor is used to obtain voice information emitted by the target object, wherein the voice information is obtained based on the vehicle introduction content;
[0013] The processing unit is also used to control the display unit to display a function introduction page corresponding to the voice information in the vehicle information introduction interface, and based on the target function indicated by the function introduction page, control the functional firmware associated with the target function to perform operational interaction with the target object.
[0014] In a third aspect, an embodiment of the present specification further provides a computing device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the vehicle information interaction method as described above when executing the computer program.
[0015] In a fourth aspect, an embodiment of the present specification further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the vehicle information interaction method as described above is implemented.
[0016] In a fifth aspect, an embodiment of the present specification provides a computer program product or a computer program, wherein the computer program product includes a computer program, and the computer program can be stored in a computer-readable storage medium or in the cloud; the processor of the computer device reads the computer program, and when the processor executes the computer program, the steps of the above-mentioned vehicle information interaction method are implemented.
[0017] In a sixth aspect, an embodiment of the present specification provides a vehicle, wherein the vehicle is configured to execute the vehicle information interaction method as described above.
[0018] It can be seen from the above technical scheme that the vehicle information interaction method provided in the embodiment of this specification calls up the vehicle information introduction application in response to the target object entering the vehicle, so as to display the vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application, and the vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the vehicle introduction content to be presented in the vehicle information introduction interface; then obtain the voice information sent by the target object, and the voice information is guided based on the vehicle introduction content; and then display the function introduction page corresponding to the voice information in the vehicle information introduction interface, and based on the target function indicated on the function introduction page, control the function firmware associated with the target function to interact with the target object. Thereby, an interactive vehicle information introduction process is realized, because the vehicle introduction content can be dynamically displayed on the vehicle information introduction interface, and the voice interaction control can actively guide the target object to interact with information, which improves the efficiency and accuracy of the vehicle information introduction. BRIEF DESCRIPTION OF THE DRAWINGS
[0019] In order to more clearly illustrate the embodiments of this specification or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this specification. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying creative work.
[0020] Figure 1 A schematic diagram of an application environment of a vehicle information interaction method provided in one embodiment of this specification;
[0021] Figure 2 A schematic flow chart of a vehicle information interaction method provided for one embodiment of this specification;
[0022] Figure 3 A schematic diagram of a scenario of a vehicle information interaction method provided for one embodiment of this specification;
[0023] Figure 4 A schematic diagram of another vehicle information interaction method provided for one embodiment of this specification;
[0024] Figure 5 A schematic diagram of another vehicle information interaction method provided for one embodiment of this specification;
[0025] Figure 6 A schematic diagram of functional modules of a vehicle information interaction device provided in one embodiment of this specification;
[0026] Figure 7 A schematic diagram of the structure of a computing device provided for one embodiment of the present specification. DETAILED DESCRIPTION
[0027] Unless otherwise defined, the technical terms or scientific terms used in the embodiments of this specification shall have the common meanings understood by persons with ordinary skills in the field to which this specification belongs. The words "first", "second" and similar words used in the embodiments of this specification do not indicate any order, quantity or importance, but are only used to avoid confusion of constituent elements.
[0028] Unless the context requires otherwise, throughout the specification, "plurality" means "at least two", and "including" is interpreted as an open, inclusive meaning, that is, "including, but not limited to". In the description of the specification, the terms "one embodiment", "some embodiments", "exemplary embodiments", "examples", "specific examples" or "some examples" are intended to indicate that a particular feature, structure, material or characteristic associated with the embodiment or example is included in at least one embodiment or example of the specification. The schematic representation of the above terms does not necessarily refer to the same embodiment or example.
[0029] The following will be combined with the drawings in the embodiments of this specification to clearly and completely describe the technical solutions in the embodiments of this specification. Obviously, the described embodiments are only part of the embodiments of this specification, not all of the embodiments. Based on the embodiments in this specification, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this specification.
[0030] With the continuous development of vehicle technology, the level of vehicle intelligence is getting higher and higher. In order to buy a vehicle that suits their needs, users need to understand and experience vehicle information in detail.
[0031] Currently, when users purchase a vehicle, they need vehicle sales staff to explain the vehicle functions to help them understand the vehicle. However, due to the improvement of vehicle intelligence, vehicles have many functions, and manual introduction is inefficient and may not be accurate.
[0032] To solve the above problems, the embodiments of this specification provide an interactive system for vehicle information, and the interactive method for vehicle information provided in the embodiments of this specification is applied to the interactive system for vehicle information. The interactive system generates different speech in the car according to different scenes and user feedback, providing users with a more immersive gaming experience and emotional value.
[0033] Specifically, the vehicle information interaction system may include: Figure 1The operating environment formed by the server 110 and the vehicle 120 in the embodiment. The vehicle 120 communicates with the server 110 through a network connection. The functions implemented in the vehicle 120 can be local processing by the vehicle 120, or the vehicle 120 receives information and uploads it to the server 110 in the cloud, and the server 110 in the cloud processes and sends it to the vehicle 120. Among them, the server 110 can be an electronic device with certain computing and processing capabilities. It can have a network communication module, a processor, and a memory, etc. Of course, the server 110 can also refer to the software running in the electronic device. The server 110 can also be a distributed server, which can be a system with multiple processors, memories, network communication modules, etc. operating in collaboration. Alternatively, the server 110 can also be a cluster formed by several servers 110. Alternatively, with the development of science and technology, the server 110 can also be a new technical means that can realize the corresponding functions of the implementation method of the specification. For example, it can be a new form of "server" based on quantum computing.
[0034] Specifically, when the above-mentioned interactive system is used to interact with information in the vehicle, after recognizing that the user is sitting in the vehicle, the vehicle computer automatically opens the vehicle information introduction application, and the voice interaction control appears on the vehicle information introduction application and actively guides the user to understand the functions that the user is interested in. Then, according to the user's reply, the voice interaction control dynamically identifies the corresponding introduction video and plays it; after the introduction of the highlight function, the user can directly open the introduced function through voice commands or screen touch to continue the experience, thereby realizing a dynamic vehicle information introduction process.
[0035] Based on the above concept, an embodiment of the present specification provides a method for interacting with vehicle information. The following will provide an exemplary description of the method for interacting with vehicle information provided in the embodiment of the present specification in conjunction with the accompanying drawings.
[0036] To be applied to Figure 1 Taking the vehicle in the example, some embodiments of this specification exemplarily illustrate the method for interacting with the vehicle information, and the method for interacting with the vehicle information includes:
[0037] 201. In response to the target object entering the vehicle, a vehicle information introduction application is invoked to display a vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application. The vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the vehicle introduction content to be presented in the vehicle information introduction interface.
[0038] In this embodiment, the vehicle information introduction application is a dedicated application for introducing vehicle information, specifically a vehicle model highlight introduction application (unique selling point, USP), in which the vehicle highlights can be introduced to users through video, pictures and voice; accordingly, the vehicle in this embodiment can be an exhibition vehicle, that is, it can be distinguished from general driving vehicles, and the vehicle control system of the exhibition vehicle can be disconnected from the power system, thereby realizing a two-way interaction process between the vehicle control system and the vehicle system.
[0039] In a possible scenario, the vehicle information introduction application is displayed as follows Figure 3 As shown, Figure 3 A scenario diagram of a vehicle information interaction method provided for an embodiment of the present specification; the figure shows that a vehicle information introduction application is displayed through a display screen in a vehicle, that is, the vehicle information introduction interface can occupy all or part of the display screen, and a voice interaction control is configured in the vehicle information introduction interface, which can specifically be a voice assistant or other dedicated voice recognition tool; wherein, the display screen in this embodiment can integrate functions such as instrument display and vehicle firmware control, and when the vehicle information introduction application is awakened, it can occupy the area where the above functions are displayed to achieve a full-screen immersive introduction, but when the relevant functions need to be displayed in the subsequent interaction process, the display of the corresponding parameter buttons or control buttons is restored; in addition, the vehicle information introduction application may not occupy the area where the above functions are displayed, and display related content in a specific area to reduce the overhead of processing resources.
[0040] It can be understood that the process of using the voice interaction control to actively trigger the presentation of vehicle introduction content in the vehicle information introduction interface is an information guidance process, that is, the vehicle introduction content is the highlight information associated with the vehicle, which can be specifically set through the vehicle’s recent promotional activities or technical configurations to achieve dynamic highlight display.
[0041] In one possible scenario, the process of determining whether a target object has entered the vehicle may be performed jointly by visual perception and seat sensing, that is, first, the visual perception image and / or seat sensing information inside the vehicle is obtained; then, based on the visual perception image and / or seat sensing information, it is determined that the target object has entered the vehicle, thereby avoiding the maintenance personnel from triggering the introduction process when inspecting the vehicle; then, the vehicle information introduction application is invoked, and the first-level introduction directory corresponding to the vehicle information introduction application is called; and the vehicle introduction content is determined according to the first-level introduction directory for display in the vehicle information introduction interface; for example, the in-vehicle visual perception and seat sensors are integrated to identify whether there is someone in the vehicle, and the cockpit is linked to trigger the vehicle welcome and open the USP application homepage, and call out the voice image of the voice interaction control.
[0042] Among them, the first-level introduction directory in USP is a directory used to introduce the overall dimensions of the vehicle, such as the vehicle's overall size, vehicle information overview, etc.; accordingly, USP is also configured with a second-level introduction directory and a third-level introduction directory. The second-level introduction directory is a directory based on the vehicle's functions, and the third-level introduction directory is a directory based on the interactive items in the vehicle's functions. That is, the USP application in this embodiment is compatible with voice, and dynamically adjusts the voice level when the USP application is opened to adapt to different content introduction scenarios.
[0043] In another possible scenario, when the user sits in the car, the car computer recognizes that there is someone in the car, triggers the in-car welcome function and opens the USP application homepage. At this time, the voice image corresponding to the voice interaction control appears, actively greets the user and asks the user about the points of interest in the vehicle function, thereby realizing the process of guiding interaction. Specifically, first respond to the target object entering the vehicle, obtain the voice broadcast content (such as TTS broadcast); then determine the control information and melody information that matches the voice broadcast content; then broadcast based on the voice broadcast content, and control the ambient light in the vehicle to display according to the control information (such as ambient light linkage), and control the sound effect equipment in the vehicle to play according to the melody information (such as sound effect playback).
[0044] Specifically, for the interaction process after the user enters the vehicle, such as Figure 4 As shown, Figure 4 A scenario diagram of another method for interacting with vehicle information provided for an embodiment of the present specification; since the USP application is compatible with voice and dynamically adjusts the voice level when the USP application is opened, the voice interaction control integrates perception and active voice capabilities, and the voice interaction control appears and actively interacts after recognizing that there are people in the car. In addition, a jump button is added to the USP application to support what you see is what you say and screen touch to jump directly to the function interface.
[0045] 202. Acquire voice information sent by the target object, where the voice information is guided based on the vehicle introduction content.
[0046] In this embodiment, the voice information is guided by the vehicle introduction content, that is, because the vehicle introduction content is a highlight of the vehicle information, it can attract the user's attention, thereby generating corresponding voice information, and then realizing that according to the user's voice reply, the voice interaction control opens the corresponding introduction page and plays the video. During this period, the user can use the voice function (such as broadcast control, map navigation, vehicle control, etc.) at will.
[0047] It is understandable that the display of vehicle introduction content can be integrated with the vehicle's recent promotional activities or latest technologies; it can also be combined with user attention information obtained through historical statistics to display targeted content.
[0048] 203. Display a function introduction page corresponding to the voice information in the vehicle information introduction interface, and based on the target function indicated by the function introduction page, control the function firmware associated with the target function to perform operation interaction with the target object.
[0049] In this embodiment, the function introduction page is a page used for media introduction of the corresponding function, and its media content can be in the form of text, pictures or videos. That is, according to the user's reply, the voice interaction control dynamically identifies the corresponding introduction video and plays it; after the introduction of the highlight function, the user can directly open the introduced function through voice commands or screen touch to continue the experience.
[0050] In addition, during the introduction process, the dynamic voice introduction can be extended to outside the car. The car computer dynamically identifies the user's location and links with the voice outside the car to introduce the highlights.
[0051] It is understandable that the process of determining the target function can be carried out through the hierarchically configured directory in step 201, that is, the secondary introduction directory; first determine the voice content corresponding to the voice information; then determine whether the voice content matches the preset voice instruction, where the preset voice instruction can identify the instruction of the corresponding content tag, and quickly perform content matching. If it matches, determine the content type (function introduction type and product field type) indicated by the voice content; and call the secondary introduction directory for project matching according to the content type to obtain the function introduction page corresponding to the voice information; and then based on the target function indicated by the function introduction page, control the function firmware associated with the target function to interact with the target object.
[0052] It can be understood that the function introduction type is a collection of vehicle highlight functions that can interact with users; while the product domain type is the execution of a single instruction, such as turning on the air conditioner, adjusting the seat, etc., thereby achieving a differentiated introduction, that is, targeted interactive introduction of complex functions.
[0053] Specifically, the process of operating and interacting the functional firmware associated with the target function with the target object can be based on the vehicle system and the vehicle control system, that is, a targeted interaction method configured in combination with the characteristic that the power system can be disconnected from the exhibition vehicle. Among them, the interaction based on the vehicle system and the vehicle control system can be realized through the following functional categories, and the actual interaction of the media-oriented function and the simulated interaction of the driving-oriented function can be set, which are explained separately below.
[0054] For somatosensory interaction functions, such as leisure cabins and camping modes, we can first determine that the target function indicated on the function introduction page is a somatosensory interaction function, and determine the functional firmware associated with the somatosensory interaction function; then obtain the somatosensory demand instruction input by the target object; and control the functional firmware associated with the somatosensory interaction function to adjust to the target somatosensory mode according to the somatosensory demand instruction, so as to interact with the target object. For example, the leisure cabin function is a function based on the cockpit firmware, which has built-in nap mode, games, karaoke and cinema, so the associated functional components include car computers, seats, projection equipment, etc., that is, when the video introduces the leisure cabin, it supports users to directly open the leisure cabin through manual or voice commands, that is, the actual interaction of media functions.
[0055] For driving interaction functions, such as virtual gear shifting and immersive navigation, the target function indicated on the function introduction page can be determined as a driving interaction function, and the functional firmware associated with the driving interaction function can be determined; then, based on the functional firmware associated with the driving interaction function, the virtual gear information established by the target object performing the driving operation is obtained, and the connection between the gear shift mechanism and the driving firmware is cancelled; and the display of the navigation interface is triggered according to the virtual gear information, so as to interact with the target object through the navigation interface, thereby realizing the driving-oriented functional simulation interaction process, that is, when the video introduces the human-machine co-driving map and high-level intelligent driving functions, it supports users to directly open the simulated navigation through manual or voice commands. And the gear is switched to the virtual D gear (virtual gear shift).
[0056] Among them, for the virtual gear shifting process, the cockpit domain controller (CDC) establishes a virtual gear signal, cancels the real connection between the touchpad gear shift mechanism (EGSM) and the underlying layer (driving firmware), and connects to the CDC virtual gear shift module to realize the function of virtual gear shifting through the screen and touchpad gear shift mechanism in the exhibition car mode.
[0057] Specifically, while shifting gears virtually, simulated navigation can also be performed, that is, first obtaining the control signal generated by the target object controlling the steering wheel; then performing driving simulation in the navigation interface based on the control information to update the navigation elements in the navigation interface. After the pre-recorded real simulated navigation data is imported into the vehicle computer, the screen 3D / 2D map can be reproduced in real time to achieve map perception, driving signals and intelligent driving information.
[0058] For media interaction functions, such as audio-visual mode, cinema, etc., the target function indicated on the function introduction page can be determined as a media interaction function, and the functional firmware associated with the media interaction function can be determined; then the media content request input by the target object can be obtained; and based on the media content request, the functional firmware associated with the media interaction function can be controlled to perform firmware linkage to interact with the target object. For example, when the video introduces the audio function, the ambient light rhythm and the speaker can be turned on to create the best audition atmosphere.
[0059] The hierarchical configuration of the above functions can link active voice interaction capabilities to support multiple rounds of user dialogue, and the directory of each highlight video supports cloud generalization. After the vehicle recognizes the voice command, it dynamically matches the cloud-generalized command and opens the corresponding video page.
[0060] Therefore, in another possible scenario, if the content type does not match the item in the secondary introduction catalog, the voice information is sent to the cloud; the voice information is recognized based on a pre-trained recognition model configured on the cloud to obtain a reply message, and the pre-trained recognition model is trained based on the product information associated with the vehicle.
[0061] In addition, voice can be connected to the product expert model (an AI model that can learn all the highlights of the car computer), combined with USP application videos and pictures, to support users to ask more questions and interactive experience.
[0062] It should be noted that after introducing the highlight functions in this embodiment, the user can directly open the introduced functions through voice commands or screen touch to continue the experience, that is, in response to the selection operation performed by the target object based on the vehicle information introduction interface, obtain the selected function; then jump to the function page corresponding to the selected function in the vehicle information introduction interface for display, and the execution thread corresponding to the selected function is different from that of the target function. That is, the jump button in the video page supports cloud configuration and is displayed in real time on the corresponding video page. Users can jump to the predefined function interface at any time through screen touch and voice commands while watching the video. After returning to the USP application, you can continue to browse the information without starting from scratch.
[0063] The present embodiment is described below in conjunction with a specific interaction process. Figure 5 As shown, Figure 5 A scenario diagram of another method for interacting with vehicle information provided for an embodiment of the present specification; the figure shows that when the user has not entered the vehicle, the vehicle enters the exhibition vehicle mode and the gear position = P gear; if there is no one in the vehicle for 15 seconds, the base map of the first-level directory of the application is displayed, that is, the full-screen wallpaper is automatically opened, which is a static waiting process.
[0064] After the user gets in the car, the driving demonstration button on the screen is removed to prevent the vehicle from moving, and the in-car welcome function is triggered: the sound effects + ambient light + TTS welcome message is retained, and the specific message is Hello, I am a voice interaction control. Do you need me to introduce the vehicle to you?
[0065] At the same time, the first-level directory of the application (first-level introduction directory) is opened in the vehicle information introduction interface. The display process can be pure video playback, that is, the video has its own voice interaction control original narration + background music, and the interaction is guided by the voice interaction control, such as playing "Let me introduce the body design and space layout."
[0066] The corresponding functions are displayed by obtaining voice feedback from the user. First, the preset vehicle control commands are matched. If a match is made, it is determined whether it is an introduction to the entire vehicle. If so, it returns to the first-level directory. If not, the functions of the second-level directory are matched, and the corresponding function item introduction of the third-level directory is executed. For example, by entering the leisure cabin (second-level directory) through voice and screen clicks, and then selecting function items such as KTV, cinema or camping (third-level directory) in the leisure cabin.
[0067] In addition, for content that is not a preset voice command, a reply can be made based on a large language model, such as some casual chat content or comparative information of other vehicles; and for content that is in the field of product experts, the corresponding steps and actions are executed for a quick response; further, for content that does not exist in the secondary directory, it is determined whether it is a high-frequency question and answer about buying a car, that is, questions about purchase items, such as price discounts, financial policies, etc. If it is not a high-frequency question and answer about buying a car, it is collected and input into the product expert model for annotation, and pre-trained based on other data to obtain a vehicle-specific question and answer model to improve the pertinence of the reply. By configuring active voice interaction capabilities, it can support multiple rounds of conversations with users, and each round of conversation supports cloud generalization to avoid situations where the answer cannot be given or is inaccurate.
[0068] In summary, this embodiment invokes the vehicle information introduction application in response to the target object entering the vehicle, and displays the vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application. The vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the vehicle introduction content to be presented in the vehicle information introduction interface; then obtain the voice information sent by the target object, and the voice information is guided based on the vehicle introduction content; then display the function introduction page corresponding to the voice information in the vehicle information introduction interface, and based on the target function indicated on the function introduction page, control the function firmware associated with the target function to interact with the target object. Thereby, an interactive vehicle information introduction process is realized. Since the vehicle introduction content can be dynamically displayed on the vehicle information introduction interface, and the voice interaction control can actively guide the target object to interact with information, the efficiency and accuracy of the vehicle information introduction are improved.
[0069] It should be noted that the multiple embodiments in this specification emphasize the parts that are different from other embodiments, and the various embodiments can be explained in comparison with each other. Any combination of the multiple embodiments in this specification by technicians in the relevant field based on general technical knowledge is included in the disclosure scope of this specification.
[0070] In an exemplary embodiment of the present specification, a vehicle information interaction device 600 is also provided, comprising:
[0071] Display unit 601, sound sensor 602 and processing unit 603;
[0072] The processing unit 603 is used to call up a vehicle information introduction application in response to the target object entering the vehicle, so as to control the display unit 601 to display a vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application, wherein the vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the vehicle introduction content to be presented in the vehicle information introduction interface;
[0073] The sound sensor 602 is used to obtain the voice information emitted by the target object, and the voice information is obtained based on the vehicle introduction content;
[0074] The processing unit 603 is also used to control the display unit 601 to display the function introduction page corresponding to the voice information in the vehicle information introduction interface, and based on the target function indicated by the function introduction page, control the functional firmware associated with the target function to perform operational interaction with the target object.
[0075] Optionally, in a possible scenario, the processing unit 603 is specifically used to obtain visual perception images and / or seat sensor information inside the vehicle;
[0076] The processing unit 603 is specifically used to determine that a target object enters the vehicle based on the visual perception image and / or the seat sensor information;
[0077] The processing unit 603 is specifically used to call up the vehicle information introduction application and call the first-level introduction directory corresponding to the vehicle information introduction application;
[0078] The processing unit 603 is specifically used to determine the vehicle introduction content according to the first-level introduction directory, and control the display unit 601 to display it in the vehicle information introduction interface.
[0079] Optionally, in a possible scenario, the processing unit 603 is specifically configured to obtain voice broadcast content in response to the target object entering the vehicle;
[0080] The processing unit 603 is specifically used to determine the control information and melody information that match the voice broadcast content;
[0081] The processing unit 603 is specifically used to broadcast based on the voice broadcast content, control the ambient light in the vehicle to display according to the control information, and control the sound effect equipment in the vehicle to play according to the melody information.
[0082] Optionally, in a possible scenario, the processing unit 603 is specifically configured to determine the voice content corresponding to the voice information acquired by the sound sensor 602;
[0083] The processing unit 603 is specifically used to determine whether the voice content matches the preset voice instruction;
[0084] The processing unit 603 is specifically configured to determine the content type indicated by the voice content if a match is found;
[0085] The processing unit 603 is specifically used to call the secondary introduction directory to perform item matching according to the content type to obtain the function introduction page corresponding to the voice information;
[0086] The processing unit 603 is specifically configured to control the functional firmware associated with the target function to perform operation interaction with the target object based on the target function indicated on the function introduction page.
[0087] Optionally, in a possible scenario, the processing unit 603 is specifically configured to determine that the target function indicated by the function introduction page is a somatosensory interaction function, and determine a functional firmware associated with the somatosensory interaction function;
[0088] The processing unit 603 is specifically used to obtain the somatosensory demand instruction input by the target object through the sound sensor 602;
[0089] The processing unit 603 is specifically used to control the functional firmware associated with the somatosensory interaction function to adjust to the target somatosensory mode according to the somatosensory demand instruction, so as to perform operation interaction with the target object.
[0090] Optionally, in a possible scenario, the processing unit 603 is specifically configured to determine that the target function indicated by the function introduction page is a driving interaction function, and determine a functional firmware associated with the driving interaction function;
[0091] The processing unit 603 is specifically used to obtain virtual gear information established by the target object performing the driving operation based on the functional firmware associated with the driving interaction function, and cancel the connection between the shift mechanism and the driving firmware;
[0092] The processing unit 603 is specifically configured to trigger the display unit 601 to display a navigation interface according to the virtual gear information, so as to perform operation interaction with the target object through the navigation interface.
[0093] Optionally, in a possible scenario, the processing unit 603 is specifically used to obtain a control signal generated by the target object controlling the steering wheel;
[0094] The processing unit 603 is specifically used to perform driving simulation in the navigation interface based on the control information to update the navigation elements in the navigation interface.
[0095] Optionally, in a possible scenario, the processing unit 603 is specifically configured to determine that the target function indicated by the function introduction page is a media interaction function, and determine a functional firmware associated with the media interaction function;
[0096] The sound sensor 602 is specifically used to obtain a media content request input by a target object through the sound sensor 602;
[0097] The processing unit 603 is specifically configured to control the functional firmware associated with the media interaction function to perform firmware linkage based on the media content request, so as to perform operation interaction with the target object.
[0098] Optionally, in a possible scenario, the processing unit 603 is specifically configured to send the voice information acquired by the sound sensor 602 to the cloud if the content type does not match the item in the secondary introduction directory;
[0099] The processing unit 603 is specifically used to recognize the voice information obtained by the sound sensor 602 based on the pre-trained recognition model configured in the cloud to obtain reply information, and the pre-trained recognition model is trained based on the product information associated with the vehicle.
[0100] Optionally, in a possible scenario, the processing unit 603 is specifically configured to obtain a selection function in response to a selection operation performed by the target object based on the vehicle information introduction interface displayed by the display unit 601;
[0101] The processing unit 603 is specifically used to jump to the function page corresponding to the selected function in the vehicle information introduction interface displayed by the display unit 601 for display, and the execution threads corresponding to the selected function and the target function are different.
[0102] The interactive device invokes the vehicle information introduction application in response to the target object entering the vehicle, and displays the vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application. The vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the vehicle introduction content to be presented in the vehicle information introduction interface; then obtains the voice information sent by the target object, and the voice information is guided based on the vehicle introduction content; then displays the function introduction page corresponding to the voice information in the vehicle information introduction interface, and based on the target function indicated on the function introduction page, controls the function firmware associated with the target function to interact with the target object. Thus, an interactive vehicle information introduction process is realized. Since the vehicle introduction content can be dynamically displayed on the vehicle information introduction interface, and the voice interaction control can actively guide the target object to interact with information, the efficiency and accuracy of the vehicle information introduction are improved.
[0103] Specifically, the processing unit and the interaction unit in this embodiment may correspond to physical components. For example, the processing unit may be a processing module such as a CPU, a GPU, or a FPGA, and the interaction unit may be an interaction module such as a screen, a speaker, or a projector. The specific physical components may be any components or combinations of components having the above functions. The specific method depends on the actual scenario and is not limited here.
[0104] The display device is connected in the vehicle by responding to the interactive process of the vehicle information, and obtains the sound effect data corresponding to the interactive process; then determines the interactive scene corresponding to the interactive process according to the sound effect data; and obtains the interactive feedback information corresponding to the interactive object associated with the interactive process when executing the interactive process; then performs content adaptation based on the interactive scene and interactive feedback information to obtain the target media content associated with the game application, and presents the target media content in the vehicle. Thus, a game process with intelligent interactive feedback is realized in the vehicle. Since different game scenes will generate corresponding media content, the presentation of the media content in the vehicle can provide users with an immersive information interaction experience in the vehicle, which improves the effectiveness of content push when information interaction is carried out in the vehicle.
[0105] The specific definition of the interactive device for vehicle information can be found in the definition of the interactive method for vehicle information above, which will not be repeated here. Each unit module in the above-mentioned interactive device for vehicle information can be implemented in whole or in part by software, hardware and a combination thereof. The above-mentioned modules can be embedded in or independent of the processor in the computer device in the form of hardware, or can be stored in the memory of the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.
[0106] Another embodiment of the present application further provides a computing device, see Figure 7As shown, an exemplary embodiment of the present specification also provides a computing device, including: a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, it executes the steps of the vehicle information interaction method according to various embodiments of the present specification described in the above embodiments of the present specification.
[0107] The internal structure of the computing device can be as follows Figure 7 As shown, the computing device includes a processor, a memory, a network interface and an input device connected through a system bus. Among them, the processor of the computing device is used to provide computing and control capabilities. The memory of the computing device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system and a computer program. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The network interface of the computing device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, the steps of the vehicle information interaction method according to various embodiments of the present specification described in the above embodiments of the present specification are performed.
[0108] The processor may include a main processor and may also include a baseband chip, a modem, etc.
[0109] The memory stores a program for executing the technical solution of the present invention, and may also store an operating system and other key services. Specifically, the program may include a program code, and the program code includes computer operation instructions. More specifically, the memory may include a read-only memory (ROM), other types of static storage devices that can store static information and instructions, a random access memory (RAM), other types of dynamic storage devices that can store information and instructions, a disk storage, a flash, and the like.
[0110] The processor may be a general-purpose processor, such as a general-purpose central processing unit (CPU), a microprocessor, etc., or an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the scheme of the present invention. It may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component.
[0111] The input device may include a device for receiving data and information input by a user, such as a keyboard, a mouse, a camera, a scanner, a light pen, a voice input device, a touch screen, a pedometer, or a gravity sensor.
[0112] Output devices may include means that allow information to be output to a user, such as display screens, printers, speakers, etc.
[0113] The communication interface may include using any transceiver or the like to communicate with other devices or communication networks, such as Ethernet, Radio Access Network (RAN), Wireless Local Area Network (WLAN), etc.
[0114] The processor executes the program stored in the memory and calls other devices, which can be used to implement each step of any vehicle information interaction method provided in the above embodiments of the present application.
[0115] The computing device may also include a display component and a voice component. The display component may be a liquid crystal display or an electronic ink display. The input device of the computing device may be a touch layer covered on the display component, or a button, trackball or touchpad provided on the housing of the computing device, or an external keyboard, touchpad or mouse.
[0116] Those skilled in the art will understand that Figure 7 The structure shown in the figure is only a block diagram of a part of the structure related to the scheme of this specification, and does not constitute a limitation on the computing device to which the scheme of this specification is applied. The specific computing device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.
[0117] In another exemplary embodiment of the present specification, a vehicle is provided, which is configured to execute the vehicle information interaction method as described above. Optionally, the vehicle may include the vehicle information interaction device 600 as described above, or the vehicle may include the vehicle information interaction device 600 as described above. Figure 7 The computing device.
[0118] In addition to the above-mentioned methods and devices, the vehicle information interaction method provided in the embodiments of this specification may also be a computer program product, which includes a computer program, which, when executed by a processor, enables the processor to execute the steps of the vehicle information interaction method according to various embodiments of this specification described in the above "Exemplary Method" section of this specification.
[0119] The computer program product may be written in any combination of one or more programming languages to write program code for performing the operations of the embodiments of the present specification, including object-oriented programming languages such as Java, C++, etc., and conventional procedural programming languages such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.
[0120] In addition, an embodiment of the present specification also provides a computer-readable storage medium on which a computer program is stored, and the computer program is executed by a processor to execute the steps of the vehicle information interaction method according to various embodiments of the present specification described in the above "Exemplary Method" section of the present specification.
[0121] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this specification can include non-volatile and / or volatile memory. Non-volatile memory can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory can include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).
[0122] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0123] The above-mentioned embodiments only express several implementation methods of this specification, and the descriptions are relatively specific and detailed, but they cannot be understood as limiting the scope of the solutions provided by the embodiments of this specification. It should be pointed out that for ordinary technicians in this field, several modifications and improvements can be made without departing from the concept of this specification, which all belong to the protection scope of this specification. Therefore, the protection scope of the patent of this specification shall be based on the attached claims.
Claims
1. A vehicle information interaction method, characterized in that: include: In response to the target object entering the vehicle, a vehicle information introduction application is invoked to display a vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application, wherein the vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the presentation of vehicle introduction content in the vehicle information introduction interface; Acquire voice information sent by the target object, where the voice information is obtained based on the vehicle introduction content; A function introduction page corresponding to the voice information is displayed in the vehicle information introduction interface, and based on the target function indicated by the function introduction page, the function firmware associated with the target function is controlled to perform operational interaction with the target object.
2. The method according to claim 1, characterized in that: The invoking a vehicle information introduction application in response to the target object entering the vehicle, so as to display a vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application, comprises: Acquiring visual perception images and / or seat sensor information of the interior of the vehicle; determining that the target object enters the vehicle based on the visual perception image and / or the seat sensor information; Invoke the vehicle information introduction application, and call the first-level introduction directory corresponding to the vehicle information introduction application; The vehicle introduction content is determined according to the first-level introduction directory to be displayed in the vehicle information introduction interface.
3. The method according to claim 2, characterized in that The method further comprises: In response to the target object entering the vehicle, acquiring voice broadcast content; Determining control information and melody information that match the voice broadcast content; The announcement is made based on the voice announcement content, and the ambient light in the vehicle is controlled to be displayed according to the control information, and the sound effect equipment in the vehicle is controlled to play according to the melody information.
4. The method according to claim 1, characterized in that: The method of displaying a function introduction page corresponding to the voice information in the vehicle information introduction interface, and controlling the function firmware associated with the target function to perform operation interaction with the target object based on the target function indicated by the function introduction page, includes: Determining the voice content corresponding to the voice information; Determining whether the voice content matches a preset voice instruction; If they match, determining the content type indicated by the voice content; Calling the secondary introduction directory to perform item matching according to the content type to obtain a function introduction page corresponding to the voice information; Based on the target function indicated by the function introduction page, the functional firmware associated with the target function is controlled to perform operational interaction with the target object.
5. The method according to claim 4, characterized in that The step of controlling the functional firmware associated with the target function to perform operation interaction with the target object based on the target function indicated by the function introduction page includes: Determining that the target function indicated by the function introduction page is a somatosensory interaction function, and determining functional firmware associated with the somatosensory interaction function; Obtaining a somatosensory demand instruction input by the target object; According to the somatosensory demand instruction, the functional firmware associated with the somatosensory interaction function is controlled to adjust to a target somatosensory mode so as to perform operational interaction with the target object.
6. The method according to claim 4, characterized in that The step of controlling the functional firmware associated with the target function to perform operation interaction with the target object based on the target function indicated by the function introduction page includes: Determining that the target function indicated by the function introduction page is a driving interaction function, and determining functional firmware associated with the driving interaction function; Based on the functional firmware associated with the driving interaction function, obtaining virtual gear information established by the target object performing the driving operation, and canceling the connection between the gear shift mechanism and the driving firmware; The display of a navigation interface is triggered according to the virtual gear information, so as to perform operational interaction with the target object through the navigation interface.
7. The method according to claim 6, characterized in that The method further comprises: Acquire a control signal generated by the target object controlling a steering wheel; A driving simulation is performed in the navigation interface based on the control information to update navigation elements in the navigation interface.
8. The method according to claim 4, characterized in that The step of controlling the functional firmware associated with the target function to perform operation interaction with the target object based on the target function indicated by the function introduction page includes: Determining that the target function indicated by the function introduction page is a media interaction function, and determining functional firmware associated with the media interaction function; Obtaining a media content request input by the target object; Based on the media content request, the functional firmware associated with the media interaction function is controlled to perform firmware linkage so as to perform operational interaction with the target object.
9. The method according to claim 4, characterized in that The method further comprises: If the content type does not match an item in the secondary introduction catalog, sending the voice message to the cloud; The voice information is recognized based on a pre-trained recognition model configured in the cloud to obtain the reply information, wherein the pre-trained recognition model is trained based on product information associated with the vehicle.
10. The method according to any one of claims 1 to 9, characterized in that: The method further comprises: In response to a selection operation performed by the target object based on the vehicle information introduction interface, obtaining a selection function; In the vehicle information introduction interface, jump to the function page corresponding to the selection function for display, and the execution thread corresponding to the selection function and the target function is different.
11. A vehicle information interaction device, characterized in that: include: display unit, sound sensor and processing unit; The processing unit is used to call up a vehicle information introduction application in response to a target object entering a vehicle, so as to control the display unit to display a vehicle information introduction interface corresponding to the vehicle based on the vehicle information introduction application, wherein the vehicle information introduction interface is associated with a voice interaction control, and the voice interaction control is used to actively trigger the presentation of vehicle introduction content in the vehicle information introduction interface; The sound sensor is used to obtain voice information emitted by the target object, wherein the voice information is obtained based on the vehicle introduction content; The processing unit is also used to control the display unit to display a function introduction page corresponding to the voice information in the vehicle information introduction interface, and based on the target function indicated by the function introduction page, control the functional firmware associated with the target function to perform operational interaction with the target object.
12. A vehicle, characterized in that: The vehicle is configured to execute the vehicle information interaction method according to any one of claims 1 to 10.
13. A computing device, characterized in that: The invention comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein the processor implements the vehicle information interaction method according to any one of claims 1 to 10 when executing the computer program.
14. A computer program product, characterized in that include: A computer program, wherein when the computer program is executed by a processor, the vehicle information interaction method according to any one of claims 1 to 10 is implemented.
Citation Information
Cited By
3D model interaction method and device and vehicle
CN119359974A
