Vehicle-mounted terminal voice control method and system, and vehicle

Abstract

The application discloses a vehicle terminal voice control method and system, electronic equipment, storage medium and vehicle, comprising generating user feature information based on acquired user voice and image; generating user portrait based on user feature information and user media history data; training a search model based on user portrait and user feature information, and the trained search model is used as a local search mode for searching; when receiving a user voice instruction, selecting a corresponding search result according to the confidence level of the network search mode and the local search mode search result. Through the above method, the network restriction on the vehicle terminal multimedia can be reduced, and the search result can still be returned at a relatively fast speed in the case of no network and weak network.

Description

Technical Field

[0001] This invention relates to the field of vehicle technology, and in particular to a vehicle-mounted terminal voice control method, system, electronic device, storage medium, and vehicle. Background Technology

[0002] With the development of in-vehicle systems, many cars now offer voice control functionality, allowing users to operate media applications on the in-vehicle terminal using voice commands and enjoy corresponding entertainment services.

[0003] The existing control method involves sending voice commands to the multimedia system. However, the multimedia system typically requires network requests, which takes a long time and is even slower in weak network conditions. This increases the response time and reduces the frequency of voice control per unit of time.

[0004] Therefore, how to improve the speed of response when using voice control for in-vehicle terminals is a technical problem that needs to be solved by those skilled in the art. Summary of the Invention

[0005] To address the technical problem that the response speed of in-vehicle terminal multimedia is slow due to network limitations, the present invention provides an in-vehicle terminal voice control method, system, electronic device, storage medium, and vehicle.

[0006] To achieve the objective of this invention, a vehicle-mounted terminal voice control method is provided, comprising: Based on the acquired user voice and images, generate user feature information; Generate user profiles based on user characteristic information and user media history data; The search model is trained based on user profiles and user feature information, and the trained search model is used as a local search mode for searching. When receiving a user's voice command, the system selects the corresponding search result based on the confidence level of the search results in the network search mode and the local search mode.

[0007] In some specific embodiments, when a user's voice command is received, the corresponding search result is selected based on the confidence level of the search results in the network search mode and the local search mode, specifically including: Get network status; When there is no network or a weak network, the local search mode is executed; When the network is in good condition, select the corresponding search result based on the confidence level of the search results in the network search mode and the local search mode.

[0008] In some specific embodiments, when the network condition is good, the corresponding search result is selected based on the confidence level of the search results in the network search mode and the local search mode, specifically including: Based on the speed at which the search results are returned; If the confidence level of the search result returned by one of the search modes is low, wait for the search result of the other search mode, and select the corresponding search result according to the confidence level of the two search results. If no search results for another search mode are received within the preset time period, the search results that have already been returned will be selected.

[0009] In some specific embodiments, when the vehicle terminal starts up, the previously used search model is updated using the trained search model.

[0010] In some specific embodiments, the user characteristic information specifically includes: User gender, age, mood, and voice characteristics.

[0011] In some specific embodiments, user media history data specifically includes: All voice data, video data, and search results data related to the in-vehicle terminal media functions.

[0012] Based on the same concept, the present invention also provides an in-vehicle terminal voice control system, comprising: The user feature information generation module is used to generate user feature information based on the acquired user voice and images; The user profile generation module is used to generate user profiles based on user characteristic information and user media history data; The local search module is used to train a search model based on user profiles and user feature information, and the trained search model is used as a local search mode for searching. The search result selection module is used to select the corresponding search result based on the confidence level of the search results in network search mode and local search mode when receiving user voice commands.

[0013] Based on the same concept, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the above-described vehicle terminal voice control method.

[0014] Based on the same concept, the present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the above-described vehicle terminal voice control method.

[0015] Based on the same concept, the present invention also provides a vehicle equipped with the in-vehicle terminal voice control system described above.

[0016] Compared with the prior art, the present invention has the following beneficial effects: This invention discloses a method, system, electronic device, storage medium, and vehicle for voice control of an in-vehicle terminal. The method includes generating user feature information based on acquired user voice and images; generating a user profile based on the user feature information and historical user media data; training a search model based on the user profile and user feature information, with the trained search model serving as a local search mode; and selecting the corresponding search result based on the confidence level of the search results from the network search mode and the local search mode when a user voice command is received. This method alleviates network limitations on in-vehicle terminal multimedia, allowing for faster return of search results even in the absence of or with weak network connectivity. Attached Figure Description

[0017] Figure 1 This is a schematic diagram of the structure of a vehicle terminal voice control method according to some specific embodiments of the present invention; Figure 2 This is a flowchart illustrating a vehicle-mounted terminal voice control method of the present invention in some applications; Figure 3 This is a schematic diagram of the structure of a vehicle-mounted terminal voice control system according to some specific embodiments of the present invention; Figure 4 This is a schematic diagram of the structure of an electronic device according to some specific embodiments of the present invention. Detailed Implementation

[0018] To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0019] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “said,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms, and “multiple” generally includes at least two unless the context clearly indicates otherwise.

[0020] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0021] It should be understood that although the terms first, second, third, etc., may be used in the embodiments of this application, these descriptions should not be limited to these terms. These terms are only used to distinguish the descriptions. For example, first may also be referred to as second without departing from the scope of the embodiments of this application, and similarly, second may also be referred to as first.

[0022] Depending on the context, the words “if” or “suppose” as used here can be interpreted as “when” or “in response to determination” or “in response to detection.” Similarly, depending on the context, the phrases “if determination” or “if detection (of the stated condition or event)” can be interpreted as “when determination” or “in response to determination” or “when detection (of the stated condition or event)” or “in response to detection (of the stated condition or event).”

[0023] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that an article or device that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such an article or device. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the article or device that includes said element.

[0024] It should be noted that any symbols and / or numbers present in the specification that are not marked in the accompanying drawings are not reference numerals.

[0025] Reference Figure 1 A method for voice control of an in-vehicle terminal, comprising: S101, Based on the acquired user voice and images, generate user feature information; Specifically, this step generates user feature information based on the acquired user voice and images; In some of these applications, user voice is collected by a voice acquisition device and user images are collected by an in-vehicle camera to generate user feature information; In some of these applications, user profile information includes the user's gender, age, mood, and voice characteristics.

[0026] S102, Generate a user profile based on user characteristic information and user media history data; Specifically, this step generates a user profile based on user characteristic information and user media history data; In some of these applications, user profiles are generated based on the acquired user gender, age, emotional and voice characteristics, as well as the user's media history data, which includes all voice data, video data, and search results data related to the in-vehicle terminal's media functions.

[0027] S103, The search model is trained based on user profile and user feature information, and the trained search model is used as a local search mode for searching; Specifically, this step trains the search model based on user profiles and user feature information; In some of these applications, the search model is trained based on the user's gender, age, mood, and voice characteristics, as well as all voice data, video data, and search result data related to the in-vehicle terminal's media functions. The search model is then used as a local search pattern.

[0028] S104: When receiving a user's voice command, select the corresponding search result based on the confidence level of the search results in the network search mode and the local search mode.

[0029] Specifically, when receiving a user's voice command, this step selects the corresponding search result based on the confidence level of the search results in the network search mode and the local search mode.

[0030] In some of these applications, the network status is obtained; when there is no network or a weak network, a local search mode is executed; when the network status is good, the corresponding search result is selected based on the confidence level of the search results from the network search mode and the local search mode.

[0031] In some applications, the search results are returned based on their speed. If the confidence level of the search results returned by one search mode is low, the search results of another search mode are waited for. The corresponding search result is selected according to the confidence level of the two search results. If the search results of another search mode are not received within a preset time period, the search results that have already been returned are selected.

[0032] In some specific embodiments of the present invention, in order to use the latest search model every time a user starts the in-vehicle system, the trained search model is used to update the previous search model when the in-vehicle terminal is started.

[0033] The following will be combined with Figure 2 to describe the embodiments of an in-vehicle terminal voice control method of the present invention in some applications, such as Figure 2 shown in the following: 1. After ASR (Automatic Speech Recognition) of the speech is performed, NLU (Natural Language Understanding) results are provided in combination with the ASR results, and the results include information such as ASR, user features, user instructions, and finer features (hereinafter referred to as slots) extracted from the instruction information; 2. Then the speech recognition service distributes the NLU results to the corresponding media services; the media services include in-vehicle music, radio stations, videos, radios, media news and other contents; 3. The user features in the NLU results include information such as gender, type labels (children, youth, middle-aged, etc.), emotion, and speaker voice feature values; For slot information, the information provided varies for different media contents and user instructions; For song categories, information such as song title, singer, band, singer gender, song genre, song region, and tags will be extracted from the user's semantics; For video categories, information such as video name, episode information, actor information, and video tags will be extracted from the semantics; for radio station categories, information such as programs, hosts, episode numbers, and tags will be extracted; For example: a young driver says "I want to listen to 'Blue and White Porcelain' by someone Zhou", the slot information of singer (someone Zhou), song title (Blue and White Porcelain) and media type (song) is extracted from this voice instruction, and at the same time, the current user's gender, youth identity tag, and current emotion are given according to the voice; From the instruction "Play the first episode of the TV drama 'The Knockout'", the slot information of TV drama name (The Knockout), episode (the first episode) and media type (video) is extracted; 4. After receiving the voice instruction, the media application classifies and processes the instruction, and directly executes the instruction of the opening / closing or playback control type within the application; 5. However, for instructions that require network search to be executed, the specified media content is obtained from both the local model and the network according to the instruction, user tag, and slot information in the NLU semantics, and then different strategies are formulated based on conditions such as network status, returned results, result confidence (the score indicating that the data meets the requirements, the higher the score, the higher the degree of conformity between the result and the instruction), and waiting time, to decide whether to use the local result or the network data result; Local search: Semantic instructions, user tags, and slot information are fed into the model, which generates feature values. Then, based on the slot information and feature values, data is retrieved from the media library. After retrieval, the model scores the data results and assesses the corresponding confidence level for results that meet the expected content. The overall results are then distributed to the adjudication module. Web search: The slot information and user tag information are sent to the server through the interface, and the data is returned to the client after the query is completed; Data result arbitration and impact. The decision on which result to use is based on network status, waiting time, and result confidence level. In weak or unavailable network conditions, local query results are prioritized. In good network conditions, based on the confidence level of the query results, the data with the highest confidence level (a threshold for trustworthy results needs to be defined) and the fastest return is prioritized. If the confidence level is low, the result from another query is waited for, and then the result with the higher confidence level is used. If no result is obtained within a certain waiting time, the already returned result is used, or the session is terminated. The final result is then returned to the media for execution. 6. Local Data and Model Training: Based on media type classifications such as music, video, radio, news, etc., output models and datasets for each type of media. For each model and local dataset, user profiles are generated by combining user feature values ​​(such as age, gender, occupation, etc.) and historical data of user media queries. This includes information such as the types, styles, artists, and regions of media resources that the user prefers. Then, based on the user profiles and media library resources, a localized data model that matches the user profile is generated. This data model is typically updated with new model data and cached locally when the vehicle's infotainment system starts up, for local querying.

[0034] For the purpose of simplicity, the method steps disclosed in the above embodiments are described as a series of actions. However, those skilled in the art should understand that the embodiments of the present invention are not limited to the described order of actions, because according to the embodiments of the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily essential to the embodiments of the present invention.

[0035] Any flowchart or other description of a process or method can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing a particular logical function or process. Furthermore, the scope of preferred embodiments of the invention includes additional implementations in which functions may be performed and implemented not in the order shown or discussed, including substantially simultaneously or in reverse order according to the functions involved, or by executing computer instructions and implementing corresponding functions according to program structures such as loops, branches, etc., as will naturally be understood by those skilled in the art when practicing embodiments of the invention.

[0036] like Figure 3 As shown, the present invention also provides a vehicle-mounted terminal voice control system, comprising: User feature information generation module 201 is used to generate user feature information based on the acquired user voice and images; User profile generation module 202 is used to generate user profiles based on user feature information and user media history data; The local search module 203 is used to train a search model based on user profiles and user feature information, and the trained search model is used as a local search mode for searching. The search result selection module 204 is used to select the corresponding search result based on the confidence level of the search results in the network search mode and the local search mode when receiving a user's voice command.

[0037] Specifically, the vehicle-mounted terminal voice control system provided in this embodiment includes a user feature information generation module 201, a user profile generation module 202, a local search module 203, and a search result selection module 204. The user feature information generation module 201 generates user feature information based on acquired user voice and images. The user profile generation module 202 generates a user profile based on the user feature information and historical user media data. The local search module 203 trains a search model based on the user profile and user feature information, and the trained search model is used as the local search mode for searching. The search result selection module 204 selects the corresponding search result based on the confidence level of the search results from the network search mode and the local search mode when a user voice command is received.

[0038] It is worth noting that although only some basic functional modules are disclosed in the embodiments of this invention, it does not mean that the composition of this system is limited to the above-mentioned basic functional modules. On the contrary, what this embodiment intends to express is that, based on the above-mentioned basic functional modules, those skilled in the art can arbitrarily add one or more functional modules in combination with existing technology to form an infinite number of embodiments or technical solutions. That is to say, this system is open rather than closed. The fact that this embodiment only discloses a few basic functional modules should not be considered as the scope of protection of the claims of this invention being limited to the disclosed basic functional modules. At the same time, for the convenience of description, the above device is described separately according to its functions as various units and modules. Of course, in implementing this invention, the functions of each unit and module can be implemented in one or more software and / or hardware.

[0039] The implementation methods of the system described above are merely illustrative. For example, the various functional modules, units, or subsystems within the system may or may not be physically separate, or they may or may not be physical units; that is, they may be located in the same place or distributed across multiple different systems and their subsystems or modules. Those skilled in the art can select some or all of the functional modules, units, or subsystems to achieve the objectives of the embodiments of the present invention according to actual needs. Those skilled in the art can understand and implement the above-described situations without any creative effort.

[0040] like Figure 4 As shown, the present invention also provides an electronic device, including: a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other through the communication bus; the memory stores a computer program, and when the computer program is executed by the processor, the processor performs the steps of the above-described vehicle terminal voice control method.

[0041] Specifically, Figure 4 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present invention. Figure 4 A block diagram is shown that is suitable for implementing embodiments of the present invention. Figure 4 The electronic device shown is merely an example and should not be construed as limiting the functionality or scope of the embodiments of the present invention. Figure 4As shown, electronic device 500 is represented in the form of a general-purpose computing device. Components of electronic device 500 may include, but are not limited to: one or more processing units or processors 516, memory 528, and a bus 518 connecting different system components (including memory 528 and processor 516). Bus 518 represents one or more of several bus architectures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor, or a local bus using any of the various bus architectures. For example, these architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnect (PCI) bus. Electronic device 500 typically includes various computer system readable media. These media can be any available media that can be accessed by electronic device 500, including volatile and non-volatile media, removable and non-removable media. Memory 528 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 530 and / or cache memory 532. Electronic device 500 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, storage system 534 may be used for reading and writing non-removable, non-volatile magnetic media (not shown, commonly referred to as a "hard disk drive"). Although not shown in the figures, storage system 534 may provide a disk drive for reading and writing to removable non-volatile disks (e.g., floppy disks, portable hard drives, hot-swappable storage media) and an optical disk drive for reading and writing to removable non-volatile optical discs (e.g., CD-ROMs, DVD-ROMs, or other optical media). In these cases, each drive may be connected to bus 518 via one or more data media interfaces. Memory 528 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of various embodiments of the present invention. A program / utility 540 having a set (at least one) of program modules 542 may be stored, for example, in memory 528. Such program modules 542 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data. Each or some combination of these examples may include an implementation of a network environment. Program modules 542 typically perform the functions and / or methods described in the embodiments of the present invention. Electronic device 500 may also communicate with one or more external devices 514 (e.g., keyboard, pointing device, display 524, etc.), and with one or more devices that enable a user to interact with the electronic device 500, and / or with any device that enables the electronic device 500 to communicate with one or more other computing devices (e.g., network interface card, modem, etc.).This communication can be performed via input / output (I / O) interface 522. Furthermore, electronic device 500 can also communicate with one or more networks (e.g., local area network (LAN), wide area network (WAN), and / or public networks, such as the Internet) via network adapter 520. Figure 4 As shown, network adapter 520 communicates with other modules of electronic device 500 via bus 518. It should be understood that, although not shown in the figures, those skilled in the art can use other hardware and / or software modules in conjunction with electronic device 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems. Processor 516 executes various functional applications and data processing by running programs stored in memory 528, such as implementing the methods provided in any one or more embodiments of the present invention.

[0042] The present invention also provides a computer-readable storage medium storing a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the above-described vehicle terminal voice control method.

[0043] Specifically, the computer storage medium in this embodiment of the invention can be any combination of one or more computer-readable media. The computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. For example, a computer-readable storage medium can be—but is not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of computer-readable storage media (a non-exhaustive list) include: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this embodiment, the computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device.

[0044] The present invention also provides a vehicle equipped with the vehicle-mounted terminal voice control system described above.

[0045] By applying the above technical solutions, a method, system, electronic device, storage medium, and vehicle for voice control of an in-vehicle terminal are provided. The method includes generating user feature information based on acquired user voice and images; generating a user profile based on the user feature information and historical user media data; training a search model based on the user profile and user feature information, with the trained search model serving as a local search mode; and selecting the corresponding search result based on the confidence level of the search results from the network search mode and the local search mode when a user voice command is received. This method alleviates network limitations on in-vehicle terminal multimedia, allowing for faster return of search results even in the absence of or with weak network connectivity.

[0046] The technical features of the above embodiments can be combined in any way. For the sake of brevity, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0047] Furthermore, those skilled in the art will understand that although some embodiments described herein include certain features but not others included in other embodiments, combinations of features from different embodiments are intended to be within the scope of the invention and form different embodiments. For example, any of the embodiments claimed in the claims can be used in any combination of embodiments of the invention.

[0048] In the description of this specification, references to terms such as "an embodiment," "example," "specific example," etc., indicate that a specific feature, structure, material, or characteristic described in connection with that embodiment or example is included in at least one embodiment or example of the invention. In this specification, illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples.

[0049] Furthermore, the technical solutions of the various embodiments of the present invention can be combined with each other, but only if they are feasible for those skilled in the art. If the combination of technical solutions is contradictory or cannot be implemented, it should be considered that such combination of technical solutions does not exist and is not within the scope of protection claimed by the present invention.

[0050] All features disclosed in this specification, or steps in all disclosed methods or processes, may be combined in any way, except for mutually exclusive features and / or steps. Any feature disclosed in this specification, unless specifically stated otherwise, may be replaced by other equivalent or similar features. That is, unless specifically stated otherwise, each feature is merely one example of a series of equivalent or similar features. Throughout this specification, the same reference numerals indicate the same elements.

[0051] Those skilled in the art will understand that modules in the device of the embodiments can be adaptively changed and placed in one or more devices different from that embodiment. Modules, units, or components in the embodiments can be combined into a single module, unit, or component, and further, they can be divided into multiple sub-modules, sub-units, or sub-components. Except where at least some of such features and / or processes or units are mutually exclusive, any combination can be used to combine all features disclosed in this specification (including the corresponding claims, abstract, and drawings) and all processes or units of any method or device so disclosed. Unless expressly stated otherwise, each feature disclosed in this specification (including the corresponding claims, abstract, and drawings) may be replaced by an alternative feature that serves the same, equivalent, or similar purpose.

[0052] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.

Claims

1. A voice control method for an in-vehicle terminal, characterized in that, include: Based on the acquired user voice and images, generate user feature information; Based on the user characteristic information and user media history data, a user profile is generated; The search model is trained based on the user profile and the user feature information, and the trained search model is used as the local search mode for searching. When receiving a user's voice command, the system selects the corresponding search result based on the confidence level of the search results in the network search mode and the local search mode. The step of selecting the corresponding search result based on the confidence level of the search results in the network search mode and the local search mode when receiving a user's voice command includes: The user's voice command is subjected to ASR recognition, and the NLU result is given in combination with the ASR result. The NLU result includes the ASR result, user features, user command, and information on the slot description extracted from the command information. The speech recognition service distributes the NLU results to the corresponding media services; For instructions requiring a search, the media application determines the media content based on the instructions, user tags, and slot information in the NLU semantics, using the local search mode and the network search mode. In the local search mode, semantic instructions, user tags, and slot information are fed into the local search model. The local search model generates feature values ​​and then retrieves data from the media library based on the slot information and feature values. After retrieval, the local search model scores the data results, assesses the corresponding confidence level for results that meet the expected content, and then distributes and adjudicates the overall results. In the network search mode, the slot information and the user tag information are sent to the server through the interface, and the data is returned to the client after the query is completed. The decision to use either the search result returned by the local search mode or the search result returned by the network search mode is based on network status, waiting time, and result confidence. In the event of a weak network or no available network, the local search result is used. In the event of a good network, the data with the highest confidence and returned fastest is used based on the confidence of the search result. If the confidence of the search result returned by one search mode is low, the search result of the other search mode is waited for, and the corresponding search result is selected based on the confidence of the two search results. If the search result of the other search mode is not received within a preset time period, the search result that has already been returned is selected.

2. The vehicle-mounted terminal voice control method according to claim 1, characterized in that, When the vehicle terminal starts up, the trained search model is used to update the previous search model.

3. The vehicle-mounted terminal voice control method according to claim 1, characterized in that, The user characteristic information specifically includes: User gender, age, mood, and voice characteristics.

4. The vehicle-mounted terminal voice control method according to claim 1, characterized in that, User media history data, specifically including: All voice data, video data, and search results data related to the in-vehicle terminal media functions.

5. A vehicle-mounted terminal voice control system, characterized in that, Used to perform the vehicle terminal voice control method according to any one of claims 1 to 4; The vehicle-mounted terminal voice control system includes: The user feature information generation module is used to generate user feature information based on the acquired user voice and images; The user profile generation module is used to generate user profiles based on the user feature information and user media history data. The local search module is used to train the search model based on the user profile and the user feature information, and the trained search model is used as the local search mode for searching. The search result selection module is used to select the corresponding search result based on the confidence level of the search results in network search mode and local search mode when receiving user voice commands.

6. An electronic device, characterized in that, include: The system includes a processor, a communication interface, a memory, and a communication bus, wherein the processor, the communication interface, and the memory communicate with each other via the communication bus; the memory stores a computer program, which, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1 to 4.

7. A computer-readable storage medium, characterized in that, It stores a computer program executable by an electronic device, which, when run on the electronic device, causes the electronic device to perform the steps of the method according to any one of claims 1 to 4.

8. A vehicle equipped with an in-vehicle terminal voice control system as described in claim 5.

Images