A method, device and vehicle for displaying fuzzy search terms for vehicle-mounted voice search
By fuzzy searching of entries in the car voice control system and displaying them on the screen close to the user's location, the problem of inaccurate voice recognition is solved, and the convenience and accuracy of user operations are improved, especially the search experience of back-row users.
Patent Information
- Application Number
- CN202311039330.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-08-17
- Publication Date
- 2025-08-26
- Estimated Expiration
- 2043-08-17
AI Technical Summary
In car voice control, voice commands issued by users may not be accurately recognized, resulting in the inability to play the songs the user wants. Especially for the back row users to operate the central control screen, it is difficult to obtain more search results.
By detecting whether the user responds to the search results within the preset time, if there is no response, a fuzzy search is performed to identify the user's location, and the blurred search results are displayed on an electronic screen close to the user's location.
It increases the probability that users can find target content, facilitates users to view and select related entries, especially back-row users, and enhances the convenience and accuracy of voice control.
Smart Images

Figure CN117021945B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of voice control technology, and in particular to a method, device, and vehicle for displaying fuzzy search terms for in-vehicle voice search. Background Art
[0002] Voice control technology allows users to control electronic devices through voice. For example, in a car that supports voice control, users can use voice to control the music app installed on the car computer to play music. However, this type of voice control can also have problems in actual use. For example, if a user wants to listen to a foreign song, due to differences in English accents or the system not including this term, voice recognition will be inaccurate, that is, the recognized search term or search result is not what the user wants, so the song the user wants cannot be played through voice control. In this case, the user in the car needs to manually search on the central control screen to find the song they want to play, which is very troublesome. Moreover, if a user sitting in the back seat of the car wants to play a song, it is even more difficult to use the central control screen for manual operation because their position is far away from the hollow screen.
[0003] Therefore, if a user searches for content using in-vehicle voice control but fails to obtain the desired results, how to enable the user to further obtain more search results is a technical problem that needs to be solved in the actual use of current in-vehicle voice control. Summary of the Invention
[0004] In view of this, embodiments of the present application provide a method, device, and vehicle for displaying fuzzy search terms for in-vehicle voice search to solve the problems in the prior art.
[0005] A first aspect of an embodiment of the present application provides a method for fuzzy search and display of terms for in-vehicle voice search, comprising: when a user in the vehicle uses voice commands to search for content and displays the corresponding search results on the central control screen, detecting whether the user responds to the search results within a preset time; if not, performing a fuzzy search of the terms and obtaining at least one related term; identifying the location of the user who issued the voice command; and sending the at least one related term obtained from the fuzzy search to an electronic screen near the user's location for display.
[0006] According to a second aspect of an embodiment of the present application, a fuzzy search and display device for in-vehicle voice search terms is provided, comprising: a response detection module configured to detect whether a user in the vehicle responds to a search result within a preset time when the user uses a voice command to search for content and displays the corresponding search results on a central control screen; a fuzzy search module configured to perform a fuzzy search for terms and obtain at least one related term if not; a location identification module configured to identify the location of the user who issues the voice command; and a term display module configured to send at least one related term obtained by the fuzzy search to an electronic screen near the user's location for display.
[0007] According to a third aspect of an embodiment of the present application, a car is provided, comprising a vehicle computer and a voice control system. The vehicle computer comprises a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the above method are implemented.
[0008] Compared with the prior art, the beneficial effects of the embodiments of the present application are as follows: since the above-mentioned fuzzy search and display method of the in-vehicle voice search term searches through the user in the car using voice commands and displays the corresponding search results on the central control screen, it detects whether the user responds to the search results within a preset time; if not, a fuzzy search of the term is performed and at least one related term is obtained; the position of the user who issued the voice command is identified; and at least one related term obtained by the fuzzy search is sent to an electronic screen close to the user's position for display, so that the related terms of the fuzzy search can be displayed according to the user's position, allowing the user to view and select related terms more easily and conveniently. In addition, fuzzy retrieval is used to further identify the voice command to obtain related terms, thereby providing the user with the option of further content search and increasing the probability of finding the target content the user wants. BRIEF DESCRIPTION OF THE DRAWINGS
[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.
[0010] Figure 1 This is a flow chart of a method for displaying fuzzy search terms for in-vehicle voice search provided by an embodiment of the present application;
[0011] Figure 2 This is a flow chart of another method for displaying fuzzy search terms for in-vehicle voice search provided by an embodiment of the present application;
[0012] Figure 3This is a flow chart of another method for displaying fuzzy search terms for in-vehicle voice search provided by an embodiment of the present application;
[0013] Figure 4 A schematic diagram of a user interaction interface of a watch provided in an embodiment of the present application;
[0014] Figure 5 This is a structural diagram of a fuzzy search and display device for in-vehicle voice search provided by an embodiment of the present application;
[0015] Figure 6 This is a schematic diagram of a partial structure of a car provided in an embodiment of the present application;
[0016] Figure 7 This is a structural diagram of a vehicle computer provided in an embodiment of the present application. DETAILED DESCRIPTION
[0017] In the following description, specific details such as specific system structures and techniques are provided for purposes of illustration rather than limitation to facilitate a thorough understanding of the embodiments of the present application. However, it will be apparent to those skilled in the art that the present application may be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid obscuring the description of the present application with unnecessary detail.
[0018] Figure 1 This is a flow chart of a method for displaying fuzzy search terms for vehicle-mounted voice search provided by an embodiment of the present application. Figure 1 The method is applied to cars that support voice control, and the car's head unit executes the Figure 1 method.
[0019] like Figure 1 As shown, the fuzzy search display method of the in-vehicle voice search term includes:
[0020] S101, when a user in the vehicle uses a voice command to search for content and the corresponding search results are displayed on the central control screen, detecting whether the user responds to the search results within a preset time;
[0021] S102, if not, perform a fuzzy search for the term and obtain at least one related term;
[0022] S103, identifying the location of the user who issued the voice command;
[0023] S104: Send at least one relevant term obtained through the fuzzy search to an electronic screen near the user's location for display.
[0024] According to the technical solution provided in the embodiment of the present application, when a user in the car uses voice commands to search for content and the corresponding search results are displayed on the central control screen, it is detected whether the user responds to the search results within a preset time; if not, a fuzzy search of the terms is performed and at least one related term is obtained; the location of the user who issued the voice command is identified; and at least one related term obtained by the fuzzy search is sent to an electronic screen close to the user's location for display, so that the related terms of the fuzzy search can be displayed according to the user's location, allowing the user to view and select related terms more easily and conveniently. In addition, fuzzy retrieval is used to further identify the voice command to obtain related terms, thereby providing the user with the option of further content search and increasing the probability of finding the target content the user wants.
[0025] In step S101 above, in a car that supports voice control, a user can use voice commands to control car functions, such as controlling the car's windows and air conditioning. Alternatively, voice commands can be used to control applications installed on the car's computer. For example, a user can use voice commands to control a music application on the car's computer to perform functions such as song search, song play, and pause; or a user can use voice commands to control a navigation application on the car's computer to perform navigation location search. In this embodiment, when a user in the car uses voice commands to search for content, it is preferred that the user use voice commands to control an application installed on the car's computer.
[0026] Detecting user responses to search results is related to how the search results are displayed, and there is no single way to do it.
[0027] In some embodiments, the search results are related to the match of the voice instruction. When the search results completely match the voice instruction, the search results are directly executed without the user having to confirm or respond to the search results. When the search results are related to the voice instruction, the search results are displayed and the user is waited for to confirm or respond to the search. If the user selects or confirms the search results within a preset time, it is determined that the user has responded to the search results. If the user does not select or confirm the search results within the preset time, it is determined that the user has not responded to the search results.
[0028] For example, a user uses voice commands to control music playback. Suppose the user issues the voice command "Play Song A". If the music app on the car computer includes Song A and the song's name A is correct, the music app will respond to the voice command and obtain the corresponding search result "Song A". That is, the search result completely matches the voice command, so the music app will directly play Song A without displaying the search result. However, if the music app on the car computer does not include the song's name A or the song's name A in the voice command is incorrect (the correct song's name is A1), the search result obtained by the music app in response to the voice command may not be "Song A1", but the related "Song A2". That is, the search result is related to the voice command. In this case, the music app will not directly play Song A2, but will display the search result "Song A2". If the user confirms the search result "Song A2" within the preset time, it is determined that the user has responded to the search result within the preset time. If the user does not confirm the search result "Song A2" within the preset time, it is determined that the user has not responded to the search result within the preset time.
[0029] In some embodiments, the search result of the voice command can be a result list, which includes at least one search result. The result list is displayed on the screen, and it is detected whether the user selects a target result from the result list within a preset time. If the user selects a target result, it is determined that the user has responded to the search result; if the user does not select the list within the preset time, it is determined that the user has not responded to the search result.
[0030] For example, a user uses voice commands to control a navigation application. Suppose the user issues a voice command "navigate to destination B", then the address results matching destination B are displayed in the destination column of the navigation application, that is, a result list, and then a countdown starts to detect whether the user selects a target address from the address results within a preset time. If the user selects one of the target addresses, it is determined that the user has responded to the search result within the preset time. If the user does not select any address, it is determined that the user has not responded to the search result within the preset time.
[0031] In the above step S102, fuzzy search is a search technology. In this embodiment, it refers to matching possible search term results based on the voice instructions issued by the user as fuzzy conditions. It can expand the term search scope by matching part or synonyms of the keyword to provide more possibly relevant results, helping users to obtain the required information more efficiently.
[0032] Specifically, fuzzy search retrieves more relevant terms based on voice commands, providing the most relevant or accurate search terms possible. If the user selects a target term from at least one term obtained through fuzzy search, the corresponding application will perform a secondary search based on the target term to obtain relevant search results, further helping the user find the desired search results.
[0033] For example, taking the music app on the car as an example, suppose the user issues a voice command "Please play song A", and the search results are a list of song names: A1, A2, A3, A4 and A5. If the user does not select any of the song names within the preset time, the system will determine that the user has not responded to the search results within the preset time, and perform a fuzzy search for terms using the voice command "Please play song A" to obtain terms related to the song. Assume that at least one of the terms obtained includes the song names: AA, A1A, AA1, etc., that is, at least one term obtained is a search term for the song search, not a search result. If the user selects one of the terms from the results of the fuzzy search as the target term (such as A1A), the system will search based on the target term A1A to obtain the corresponding search result. This can help users obtain more search results so that users can find the search results they want.
[0034] In the above step S103 , the specific implementation method of identifying the location of the user who issues the voice command is not unique.
[0035] For example, in some embodiments, at least one microphone is positioned at different locations within the vehicle, and the user measures the acoustic signal (i.e., voice command) emitted by the user. Since the acoustic signal arrives at each microphone with varying degrees of delay, an algorithm is used to process the measured acoustic signal to obtain the direction of arrival (including azimuth and elevation) and distance of the sound source relative to the microphone, thereby determining the location of the sound source emitting the voice command, which is then used as the user's location. This embodiment uses sound source localization to quickly and accurately identify the location of the sound source of the voice command, thereby using it as the user's location. However, this requires hardware support such as microphones, which is relatively costly.
[0036] For example, in some embodiments, a camera is installed inside the vehicle to capture an image of the user inside the vehicle. The image is then used to identify the user's gaze direction and behavior. If the user's gaze is directed at the central control screen and they speak, the user's location is determined as the user's location. This embodiment uses image recognition technology to identify the location of the user issuing the voice command. This requires minimal hardware support and is low-cost, but it places high demands on the algorithm. If the algorithm is inaccurate, it will lead to errors in user location recognition.
[0037] It is understandable that in actual use, a suitable implementation method can be selected according to the specific application scenario, and the specific implementation method of identifying the user location of the user issuing the voice command is not limited to the two methods listed above, and other implementation methods can also be used. This application does not limit this.
[0038] In the above step S104, the electronic screen displaying the relevant entries may be an in-vehicle screen, including but not limited to a display screen arranged on the center console, a display screen arranged in front of the rear seats, or a display screen arranged on the roof, such as a central control screen; or it may be a screen on an electronic device connected to communication with the car, including but not limited to a screen on an electronic device carried by the user, for example, the display screen of a smart watch worn by the user.
[0039] In some embodiments, taking the electronic screen as an in-vehicle screen as an example, the car is provided with a front screen and a rear screen, the front screen is arranged on the center console, and the rear screen is arranged in front of the rear seat (for example, the back of the front seat), or on the roof, etc. In the above step S104, at least one related term obtained by the fuzzy search is sent to the electronic screen near the user's position for display, including: according to the user's position, determining whether the user who issued the voice command is located in the front row or the back row of the cabin; if the user is located in the front row of the cabin, displaying at least one related term obtained by the fuzzy search on the screen position near the user's position on the front screen; if the user is located in the back row of the cabin, displaying at least one related term obtained by the fuzzy search on the back screen near the user's position.
[0040] For example, there is only one display screen on the front screen. If the user is in the left front seat, at least one related term obtained by the fuzzy search will be displayed on the display position near the left side of the front screen; if the user is in the right front seat, at least one related term obtained by the fuzzy search will be displayed on the display position near the right side of the front screen, so that the user can clearly see the results of the fuzzy search of the term, and it is convenient for the user to select the related term on the screen.
[0041] In some embodiments, the electronic screen is a screen on an electronic device connected to the car for example, see Figure 2 , Figure 2 This is a flow chart of another method for displaying fuzzy search terms for vehicle-mounted voice search provided by an embodiment of the present application. Figure 2 As shown, the fuzzy search display method of the in-vehicle voice search term includes:
[0042] S201, when the vehicle computer receives a connection request from an external electronic device, it sends a location confirmation request to the electronic device, the location confirmation request including location options of each seat in the vehicle;
[0043] S202, if a response to the location confirmation request from the electronic device is received, establishing a communication connection with the electronic device;
[0044] S203, when a user in the vehicle uses a voice command to search for content and the corresponding search results are displayed on the central control screen, detecting whether the user responds to the search results within a preset time;
[0045] S204, if not, perform a fuzzy search for the term and obtain at least one related term;
[0046] S205, identifying the location of the user who issued the voice command;
[0047] S206, detecting whether the vehicle computer is connected to an electronic device at the user's location;
[0048] S207: If there is, at least one relevant term obtained by the fuzzy search is sent as a selection request to the electronic device where the user is located for display.
[0049] According to the technical solution provided in the embodiment of the present application, the location of the electronic device in the vehicle is determined by sending a location confirmation request to the electronic device connected to the vehicle computer. When the user uses voice commands to search for content and displays the corresponding search results on the central control screen, if it is detected that the user has not responded to the search results within a preset time, the location of the user who issued the voice command is identified to determine whether the vehicle computer has an electronic device connected to the user's location. If so, at least one related term obtained by the fuzzy search is sent as a selection request to the electronic device where the user is located for display. This allows the user to easily view the fuzzy search results and respond to the fuzzy search results.
[0050] Specifically, the user can use an electronic device equipped with a car control application terminal to actively establish a short-range wireless connection with the car's head unit. When the head unit receives the connection request, it sends a request to the electronic device to confirm the seat position of the car, and displays a layout diagram of the seat positions in the car on the electronic device. The user can click on any seat position image in any layout diagram to select the seat position as a response to the position confirmation request, or the position options of each seat (such as front left, front right, rear left, rear right and rear center position options) can be displayed on the electronic device. When the user selects one of the position options, the selected position option is used as a response to the position confirmation request. The embodiment of the present application associates and binds the seat position selected by the user with the electronic device through the user's response to the position confirmation request on the electronic device. In this way, after the user's position is confirmed, the position of the electronic device can be determined, and the results of the fuzzy search of terms can be sent according to the position of the electronic device connected to the head unit, so that the user can better view and select related terms.
[0051] Preferably, in the above step S205, after identifying the position of the user who issued the voice command, the following steps can also be implemented: based on the user position, determine whether the user who issued the voice command is located in the front row or the back row of the cabin; if the user position is in the front row of the cabin, then display at least one related term obtained by the fuzzy search on the front row screen at a screen position close to the user position; if the user position is in the back row of the cabin, detect whether the electronic device of the user position is connected to the vehicle computer; if not, then display at least one related term obtained by the fuzzy search on the back row screen close to the user position.
[0052] Specifically, this preferred embodiment is applicable to cars with display screens in both the front and rear rows. If a user in the front row issues a voice command, the relevant terms obtained by the fuzzy search can be sent to the display position on the front screen close to the user side for display. If a user in the rear row issues a voice command, the relevant terms obtained by the fuzzy search can be sent to the rear screen close to the user position for display, so that users in different seat positions can all see the relevant terms and can conveniently select the relevant terms.
[0053] It should be noted that some cars may have more than two rows of seats (e.g., 6- or 7-seater cars). In this case, in addition to the front row, everything behind the front row can be considered the back row. For example, in some cars with three rows of seats, after a user in the second or third row issues a voice command, the user is determined to be in the back row. Then, at least one relevant term obtained through the fuzzy search is displayed on a screen in the back row near the user's position, so that the user can view the relevant term up close and select it more easily.
[0054] See also Figure 3 , Figure 3 This is a flow chart of another method for displaying fuzzy search terms for vehicle-mounted voice search provided by an embodiment of the present application. Figure 3 As shown, the fuzzy search display method of the in-vehicle voice search term includes:
[0055] S310, when a user in the vehicle uses a voice command to search for content and the corresponding search results are displayed on the central control screen, detecting whether the user responds to the search results within a preset time;
[0056] S320, if not, perform a fuzzy search for the term and obtain at least one related term;
[0057] S330, detecting whether the vehicle computer is connected to an external electronic device;
[0058] S340, if an electronic device is connected, sending a request to display fuzzy search results to the electronic device;
[0059] S341, if the electronic device approves the request, sending at least one related term obtained by the fuzzy search as a selection request to the electronic device for display;
[0060] S350, if no electronic device is connected, identifying the location of the user who issued the voice command;
[0061] S351, sending at least one relevant term obtained by the fuzzy search to an electronic screen near the user's location for display.
[0062] The embodiment of the present application preferentially detects whether the vehicle computer is connected to external electronic devices, sends requests to these electronic devices, and allows the user to choose whether to agree to send the fuzzy search results to the electronic device for display. If the user agrees, especially the user who issues the voice command, the user can directly view the relevant terms on the electronic device. If it is not the user who issues the voice command, it can also help the user who issues the voice command to make a selection with his or her consent, which makes it more convenient for the user to query the relevant terms of the fuzzy search and make corresponding choices; if the vehicle computer is not connected to an electronic device, at least one relevant term obtained by the fuzzy search is sent to an electronic screen close to the user's location for display, so that the relevant terms of the fuzzy search can be displayed according to the user's location, allowing the user to view and select the relevant terms more easily and conveniently. In addition, the voice command is further identified by fuzzy retrieval to obtain relevant terms, thereby providing the user with the option of further content search and increasing the probability of finding the target content the user wants.
[0063] Preferably, in the above step S341, when the electronic device approves the request, it also includes: obtaining the current vehicle status, which includes the driving status and the parking status; when the vehicle is in the driving state, sending at least one related term obtained by the fuzzy search as a selection request to the electronic device for display; when the vehicle is in the parking state, authorizing the cursor control authority of the screen displaying at least one term obtained by the fuzzy search to the electronic device, and displaying a preset cursor control interface on the electronic device.
[0064] Specifically, there is no unique way to identify the vehicle status. For example, the gear position of the car is detected. When the gear position of the vehicle is D / N / R, it is determined that the car is in a driving state. When the gear position of the vehicle is P, it is determined that the car is in a parking state. Depending on the status of the vehicle, the control method open to the electronic device by the car computer is different. Specifically, when the car computer identifies that the vehicle is in a driving state, because the vehicle will shake, the users in the seats, especially the back-seat users, will not be able to see the cursor on the front screen clearly. Therefore, in the driving state, the car computer only opens fuzzy search terms to the electronic device for the user to choose; and when the car computer identifies that the vehicle is in a parking state, the car computer will open two control permissions for the front screen (such as the central control screen) to control the cursor by the watch and to select fuzzy terms. Of course, in actual applications, the vehicle status can also be judged based on the current driving speed of the car, or other detection methods can be used to determine the vehicle status. The embodiments of the present application do not limit this.
[0065] Specifically, the electronic device in each of the above embodiments includes but is not limited to any one of a smart watch, a touch screen mobile phone and a tablet computer. In addition, the connection between the electronic device and the vehicle computer includes Wi-Fi or Bluetooth.
[0066] Preferably, taking the electronic device as a smart watch as an example, the car has an in-vehicle communication system, such as T-BOX, through which hotspots can be opened for use by other electronic devices. For example, the car computer uses the T-BOX network to create a hotspot, connects to the car computer network through the Wi-Fi function of the smart watch, opens the application APP on the car computer, and a connection setting window pops up. The window can display the name of the electronic device to be connected and the permissions to be opened, etc. When you click on the watch you want to connect, if you turn on the cursor permission at the same time, the selected watch is given the permission to control the cursor on the central control screen. Alternatively, when you click on the watch you want to connect, turn on the fuzzy entry selection permission, that is, give the car computer system the permission to send fuzzy entries to the corresponding user's watch. If the user does not turn on these two permissions, the watch only shares the car computer network, or the user can turn on the fuzzy entry selection permission and the permission to control the cursor on the central control screen at the same time.
[0067] First, if the selected watch is given the permission to control the cursor on the central control screen, the user can open the application APP on the watch (for example, the application terminal for controlling the car), and the watch will display the preset user interaction interface. Figure 4 For example, Figure 4 A schematic diagram of a user interaction interface of a watch provided in an embodiment of the present application is shown as follows: Figure 4As shown, a cursor graphic is displayed on the user interface, with the cursor graphic initially positioned in the center of the central control screen. The user interface also includes a graphic button for confirming an option and a graphic button for more options. The user can move the cursor on the user interface to select or control the central control screen's display. When the watch app detects the user's finger touching the cursor position control area, it converts the signal into an electrical signal, which is then sent to the vehicle computer via Wi-Fi communication to control cursor movement. For example, if the user clicks on the cursor image and touches it to move left, the cursor moves left; if they touch it to move right, the cursor moves right. Clicking the confirm option graphic button indicates confirmation; clicking the more options graphic button indicates more options; or the user circles the cursor position control area to exit cursor control.
[0068] Furthermore, for the car computer, the page functions displayed on the screen are implemented by program code. Each graphic button corresponds to an event handler function. When the user clicks the corresponding graphic button, the event handler function is called. The event handler function executes the corresponding code based on the button's function, thereby realizing the button's function. For example, when the cursor clicks the graphic button representing confirmation, the program will detect whether the cursor position is within the designated graphic button area. If so, the button's click event is triggered, and the button's event handler function is executed.
[0069] Secondly, if the selected watch is given the permission to enable fuzzy term selection, the car computer will send a location selection to the watch each time it connects to a watch. The user can make a selection based on his or her seat in the car. For example, when the passenger in the right rear seat uses a watch to connect to the car computer system, the passenger selects the rear right seat. When the passenger in the rear right seat wakes up the car computer system assistant and gives a command to the car computer system, a fuzzy search term will appear. It will be displayed on the central control screen and sent to the passenger in the rear right seat for selection. Passengers in other cars whose watches have been connected to the car computer system will not receive the fuzzy search term.
[0070] In some embodiments, after sending at least one related term obtained from the fuzzy search to an electronic screen near the user's location for display, it also includes: detecting the user's selection of one of the related terms; when the user selects one of the related terms, associating the selected related term with the voice instruction; when a content search request for the same voice instruction is received again, displaying the related term associated with the voice instruction.
[0071] In the embodiment of the present application, after the user selects a related term obtained from a fuzzy search, the car computer will learn the related term and memorize the corresponding voice command. The next time the car computer recognizes the same voice command, the related term will be directly displayed, which can greatly improve the efficiency and accuracy of the search.
[0072] All of the above optional technical solutions can be combined in any way to form optional embodiments of the present application, and will not be described in detail here.
[0073] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.
[0074] Figure 5 Schematic diagram of a fuzzy search display device for vehicle-mounted voice search provided by an embodiment of the present application. Figure 5 As shown, the vehicle-mounted voice search term fuzzy search display device includes:
[0075] The response detection module 501 is configured to detect whether the user responds to the search results within a preset time when the user in the vehicle uses a voice command to search for content and displays the corresponding search results on the central control screen;
[0076] The fuzzy search module 502 is configured to perform a fuzzy search for the term and obtain at least one related term if no such term exists;
[0077] A location identification module 503 is configured to identify the location of the user who issues the voice command;
[0078] The entry display module 504 is configured to send at least one relevant entry obtained through the fuzzy search to an electronic screen near the user's location for display.
[0079] According to the technical solution provided in the embodiment of the present application, when a user in the car uses voice commands to search for content and the corresponding search results are displayed on the central control screen, it is detected whether the user responds to the search results within a preset time; if not, a fuzzy search of the terms is performed and at least one related term is obtained; the location of the user who issued the voice command is identified; and at least one related term obtained by the fuzzy search is sent to an electronic screen close to the user's location for display, so that the related terms of the fuzzy search can be displayed according to the user's location, allowing the user to view and select related terms more easily and conveniently. In addition, fuzzy retrieval is used to further identify the voice command to obtain related terms, thereby providing the user with the option of further content search and increasing the probability of finding the target content the user wants.
[0080] In some embodiments, the above Figure 5 The entry display module 504 is specifically configured to determine whether the user who issues the voice command is located in the front row or the back row of the cabin based on the user's position; if the user is located in the front row of the cabin, at least one related entry obtained by the fuzzy search is displayed on the front row screen at a screen position close to the user's position; if the user is located in the back row of the cabin, at least one related entry obtained by the fuzzy search is displayed on the back row screen close to the user's position.
[0081] In some embodiments, the above-mentioned vehicle-mounted voice search term fuzzy search display device further includes:
[0082] The communication control module 505 is configured to, when the vehicle computer receives a connection request from an external electronic device, send a location confirmation request to the electronic device, the location confirmation request including location options for each seat in the vehicle; and establish a communication connection with the electronic device if a response to the location confirmation request is received from the electronic device;
[0083] The first display control module 506 is configured to, after performing a fuzzy search for terms and obtaining at least one related term, identify the location of the user who issued the voice command, and detect whether an electronic device at the user's location is connected to the vehicle computer: if so, send the at least one related term obtained from the fuzzy search as a selection request to the electronic device at the user's location for display.
[0084] In some embodiments, the above-mentioned vehicle-mounted voice search term fuzzy search display device further includes:
[0085] The second display control module 507 is configured to, after identifying the position of the user who issued the voice command, determine whether the user who issued the voice command is located in the front row or the back row of the cabin based on the user position; if the user position is in the front row of the cabin, display at least one related term obtained by the fuzzy search on the screen position near the user position on the front row screen; if the user position is in the back row of the cabin, detect whether there is an electronic device at the user position connected to the vehicle computer; if not, display at least one related term obtained by the fuzzy search on the back row screen near the user position.
[0086] In some embodiments, the above-mentioned vehicle-mounted voice search term fuzzy search display device further includes:
[0087] The third display control module 508 is configured to detect whether the vehicle computer is connected to an external electronic device after performing a fuzzy search for a term and obtaining at least one related term; if an electronic device is connected, send a request to the electronic device to display the fuzzy search results; if the electronic device approves the request, send at least one related term obtained from the fuzzy search as a selection request to the electronic device for display.
[0088] In some embodiments, the above-mentioned vehicle-mounted voice search term fuzzy search display device further includes:
[0089] The fourth display control module 509 is configured to obtain the current vehicle status when the electronic device passes the request, and the vehicle status includes driving status and parking status; when the vehicle is in the driving state, at least one related term obtained by the fuzzy search is sent to the electronic device as a selection request for display; when the vehicle is in the parking state, the cursor control authority of the screen displaying at least one term obtained by the fuzzy search is authorized to the electronic device, and a preset cursor control interface is displayed on the electronic device.
[0090] In some embodiments, the electronic device includes any one of a smart watch, a touch-screen phone, and a tablet computer; the connection between the electronic device and the vehicle computer includes Wi-Fi or Bluetooth.
[0091] In some embodiments, the above-mentioned vehicle-mounted voice search term fuzzy search display device further includes:
[0092] The search learning module 510 is configured to detect the user's selection of one of the related terms; when the user selects one of the related terms, the selected related term is associated with the voice instruction; when a content search request for the same voice instruction is received again, the related term associated with the voice instruction is displayed.
[0093] It should be understood that the size of the serial numbers of the steps in the above embodiments does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0094] Figure 6 This is a partial structural diagram of a car provided in an embodiment of the present application. Figure 6 As shown, the car 6 includes a voice control system 61 and a vehicle computer 62 .
[0095] The voice control system 61 of the car 6 is a voice control technology that allows users to control various car functions through voice commands without having to distract themselves from operating the control panel. This not only provides a more convenient operation method, but also increases driving safety.
[0096] Specifically, voice control systems can control a variety of vehicle functions, including navigation, audio, and climate control. Drivers can use voice commands to set a destination or find directions to a specific location, adjust the volume, change or play music or radio channels, and adjust the interior temperature. This control technology allows drivers to focus on the road without having to distract themselves by operating various control panels.
[0097] It is worth mentioning that the voice control system of a car may vary between different models and brands, but the embodiments of the present application do not limit the specific content and composition of the voice control system.
[0098] A car's onboard entertainment system (IVI), also known as a central entertainment system or multimedia system, is an electronic device integrated into the car that provides various functions, such as audio playback, navigation, and communication.
[0099] The vehicle 6 includes a head unit 62, or head unit system, which typically includes a touch screen display for viewing and operating various functions. Through the head unit system, a user in the vehicle can use navigation functions to find routes, view maps, and play audio files, such as listening to the radio or playing music via a connected mobile phone.
[0100] The car system can also integrate other functions, such as connecting external devices such as USB, AUX, and SD cards to play media files. In addition, some car systems also support voice control, allowing drivers to use voice commands to control various functions, which makes it more convenient to operate the vehicle's entertainment system.
[0101] Specifically, see Figure 7 , Figure 7 This is a schematic diagram of the structure of a vehicle computer provided by an embodiment of the present application. Figure 7 As shown, the vehicle computer 62 of this embodiment includes: a touch screen display 621, a processor 622, a memory 623, and a computer program 624 stored in the memory 623 and executable by the processor 622. When the processor 622 executes the computer program 624, the steps of the above-described method embodiments are implemented. Alternatively, when the processor 622 executes the computer program 624, the functions of the modules in the above-described device embodiments are implemented.
[0102] The vehicle computer 62 may be an electronic device such as a vehicle body computer, a vehicle controller, or a main control device. The vehicle computer 62 may include but is not limited to a processor 622 and a memory 623. It will be understood by those skilled in the art that Figure 6 The vehicle computer 62 is merely an example and does not limit the vehicle computer 62 . The vehicle computer 62 may include more or fewer components than shown in the figure, or different components.
[0103] The processor 622 can be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field-programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
[0104] The memory 623 can be an internal storage unit of the vehicle computer 62, such as the hard drive or memory of the vehicle computer 62. The memory 623 can also be an external storage device of the vehicle computer 62, such as a plug-in hard drive, a SmartMedia Card (SMC), a Secure Digital (SD) card, a flash memory card, etc. The memory 623 can also include both the internal storage unit of the vehicle computer 62 and an external storage device. The memory 623 is used to store computer programs and other programs and data required by the electronic device.
[0105] Those skilled in the art will clearly understand that for the sake of convenience and brevity of description, only the division of the above-mentioned functional modules is used as an example for illustration. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional units or modules to complete all or part of the functions described above. The functional modules in the embodiment can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units.
[0106] If the integrated module is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the present application implements all or part of the process in the above-mentioned embodiment method, and can also be completed by instructing the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and when the computer program is executed by the processor, it can implement the steps of the above-mentioned various method embodiments. The computer program may include computer program code, which may be in source code form, object code form, executable file or some intermediate form. The computer-readable medium may include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), electric carrier signal, telecommunication signal and software distribution medium. It should be noted that the content contained in the computer-readable medium can be appropriately increased or decreased according to the requirements of legislation and patent practice in the jurisdiction. For example, in some jurisdictions, according to legislation and patent practice, computer-readable media do not include electric carrier signals and telecommunication signals.
[0107] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present application, and should all be included in the scope of protection of the present application.
Claims
1. A fuzzy search and display method for vehicle-mounted voice search terms, characterized in that: include: When a user in the car uses voice commands to search for content and displays the corresponding search results on the central control screen, it detects whether the user responds to the search results within a preset time; If not, perform a fuzzy search for the term and obtain at least one relevant term; Identify the location of the user issuing the voice command; sending at least one relevant term obtained from the fuzzy search to an electronic screen near the user's location for display; Also includes: When the vehicle computer receives a connection request from an external electronic device, it sends a location confirmation request to the electronic device, wherein the location confirmation request includes location options of each seat in the vehicle; If a response to the location confirmation request is received from the electronic device, establishing a communication connection with the electronic device; After performing a fuzzy search for a term and obtaining at least one relevant term, identifying a location of a user issuing a voice command; Detecting whether the vehicle computer is connected to an electronic device at the user's location; If so, at least one relevant term obtained by the fuzzy search is sent as a selection request to the electronic device where the user is located for display.
2. The method according to claim 1, characterized in that Sending at least one relevant term obtained through the fuzzy search to an electronic screen near the user's location for display, including: determining, based on the user's position, whether the user issuing the voice command is in the front row or the back row of the cabin; If the user is located in the front row of the cabin, displaying at least one relevant term obtained by the fuzzy search at a screen position close to the user's position on the front row screen; If the user is located in the back row of the cabin, at least one relevant term obtained by the fuzzy search is displayed on the back row screen close to the user's position.
3. The method according to claim 1, characterized in that After identifying the location of the user issuing the voice command, it also includes: determining, based on the user's position, whether the user issuing the voice command is in the front row or the back row of the cabin; If the user is located in the front row of the cabin, displaying at least one relevant term obtained by the fuzzy search at a screen position close to the user's position on the front row screen; If the user is located in the back row of the cabin, detect whether the electronic device at the user's location is connected to the vehicle computer; If not, at least one relevant term obtained by the fuzzy search is displayed on the rear screen close to the user's position.
4. The method according to claim 1, wherein After performing a fuzzy search for a term and obtaining at least one relevant term, the following is also included: Detect whether the vehicle computer is connected to any external electronic device; If an electronic device is connected, sending a request to display fuzzy search results to the electronic device; When the electronic device passes the request, at least one related term obtained through the fuzzy search is sent to the electronic device as a selection request for display.
5. The method according to claim 4, characterized in that In the case where the electronic device approves the request, the method further includes: Get the current vehicle status, which includes driving status and parking status; When the vehicle is in a driving state, at least one relevant term obtained by the fuzzy search is sent as a selection request to the electronic device for display; When the vehicle is in a parked state, the cursor control authority of the screen displaying at least one entry obtained by the fuzzy search is authorized to the electronic device, and a preset cursor control interface is displayed on the electronic device.
6. The method according to any one of claims 1 or 3-5, characterized in that The electronic device includes any one of a smart watch, a touch-screen mobile phone and a tablet computer; The connection between the electronic device and the vehicle computer includes Wi-Fi or Bluetooth.
7. The method according to any one of claims 1 to 5, characterized in that Also includes: detecting a user's selection of one of the related terms; When the user selects one of the related terms, the selected related term is associated with the voice instruction; When a content search request for the same voice instruction is received again, related terms associated with the voice instruction are displayed.
8. A fuzzy search display device for vehicle-mounted voice search, characterized in that: include: a response detection module configured to detect whether a user responds to a search result within a preset time when the user in the vehicle uses a voice command to search for content and displays the corresponding search result on the central control screen; a fuzzy search module configured to perform a fuzzy search for a term and obtain at least one related term if none exists; a location recognition module configured to recognize the location of a user issuing a voice command; a term display module configured to send at least one relevant term obtained through the fuzzy search to an electronic screen near a user's location for display; Also includes: The communication control module is configured to, when the vehicle computer receives a connection request from an external electronic device, send a location confirmation request to the electronic device, the location confirmation request including location options for each seat in the vehicle; and establish a communication connection with the electronic device if a response to the location confirmation request is received from the electronic device; The first display control module is configured to identify the location of the user who issued the voice command after performing a fuzzy search for terms and obtaining at least one related term; detect whether the electronic device at the user's location is connected to the vehicle computer; if so, send the at least one related term obtained from the fuzzy search as a selection request to the electronic device at the user's location for display.
9. An automobile comprising a vehicle computer and a voice control system, wherein the vehicle computer comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.
Citation Information
Patent Citations
Saddle-type vehicle
CA3241685A1
Display signal switching method and electronic equipment and electronic system
CN103106055A