In-vehicle interaction method, storage medium, product, electronic device and vehicle

Abstract

The present application relates to an in-vehicle interaction method, storage medium, product, electronic device and vehicle, the in-vehicle interaction method comprising: obtaining the user's voice input information, parsing the screen selection information and command information in the voice input information; determining the target display screen according to the matching result of the screen selection information and the screen information; and controlling the target display screen according to the command information. Through the above technical solution, the screen selection information in the voice input information is matched with the screen information, and the target display screen is determined according to the matching result, so that the determination of the target display screen is not limited to the sound zone where the voice input is located, so that the user can speak all visible screen content, with accurate positioning and high recognition rate.

Description

Technical Field

[0001] The present application relates to the field of vehicle technology, and in particular to a vehicle-mounted interaction method, storage medium, product, electronic device and vehicle. Background Art

[0002] At present, voice control systems are widely used in vehicles, and existing intelligent voice systems already support "see and speak". Existing multi-screen voice interaction technology for in-vehicle computers collects voice requests, locates the sound source, and then starts the nearest screen to respond and process the voice request. It cannot interact with display screens across sound zones, and has problems such as inaccurate positioning and low recognition rate. Summary of the invention

[0003] The embodiments of the present application provide an in-vehicle interaction method, storage medium, product, electronic device and vehicle, which can achieve accurate display screen positioning and high recognition efficiency, so as to at least partially solve the above-mentioned technical problems.

[0004] In order to achieve the above-mentioned purpose, according to the first aspect of the present application, a vehicle-mounted interaction method is provided, including: obtaining the user's voice input information, parsing the screen selection information and command information in the voice input information; determining the target display screen according to the matching result of the screen selection information and the screen information; and controlling the target display screen according to the command information.

[0005] Optionally, the screen selection information includes one or more of screen entries, voiceprint information, sound source location information, and hot word entries; the screen information includes one or more of screen names, voiceprint data, screen location information, and screen hot words.

[0006] Optionally, the screen selection information includes a screen entry, the screen information includes a screen name, and determining the target display screen according to a matching result between the screen selection information and the screen information includes:

[0007] In the case where the screen entry matches the screen name, the target display screen is determined according to the screen entry.

[0008] Optionally, the screen selection information includes voiceprint information, the screen information includes voiceprint data, and determining the target display screen according to a matching result of the screen selection information and the screen information includes:

[0009] In a case where the voiceprint information matches the voiceprint data, the target display screen is determined according to the voiceprint information.

[0010] Optionally, the screen selection information includes sound source location information and hot word entries, the screen information includes screen location information and screen hot words, and determining the target display screen according to the matching result of the screen selection information and the screen information includes:

[0011] Selecting a display screen closest to the sound source location as a display screen to be matched according to the sound source location information and the screen location information;

[0012] In the case where the hot word entry matches the screen hot word of the display screen to be matched, the display screen to be matched is determined to be the target display screen.

[0013] Optionally, determining the target display screen according to the matching result of the screen selection information and the screen information includes:

[0014] In the case where the hot word entry does not match the screen hot word of the display screen to be matched, the hot word entry is matched with the screen hot words of the plurality of display screens in sequence according to the sound source position information and the screen position information;

[0015] In the case where the hot word entry matches a screen hot word of any of the display screens, the matching display screen is determined to be a target display screen.

[0016] Optionally, the method further comprises:

[0017] In the case where the screen selection information does not match the screen information, determining whether new screen selection information is received within a preset time period;

[0018] When new screen selection information is received, the new screen selection information is used to perform matching with the screen information, and the target display screen is determined according to the new matching result.

[0019] According to a second aspect of the present application, there is also provided a vehicle-mounted interactive device, comprising:

[0020] The parsing module is used to obtain the user's voice input information and parse the screen selection information and instruction information in the voice input information;

[0021] A matching module, used to determine a target display screen according to a matching result between the screen selection information and the screen information;

[0022] A control module is used to control the target display screen according to the instruction information.

[0023] According to a third aspect of the present application, a non-temporary computer-readable storage medium is also provided, on which a computer program is stored, and when the computer program is executed by a processor, the in-vehicle interaction method as described above is implemented.

[0024] According to a fourth aspect of the present application, a computer program product is also provided, comprising a computer program, which implements the in-vehicle interaction method as described above when executed by a processor.

[0025] According to the fifth aspect of the present application, there is also provided an electronic device, comprising a memory on which a computer program is stored; and a processor for executing the computer program in the memory to implement the in-vehicle interaction method as described above.

[0026] According to a sixth aspect of the present application, a vehicle is also provided, the vehicle comprising the computer program product as described above, or the electronic device as described above.

[0027] In the in-vehicle interaction method of the embodiment of the present application, the screen selection information in the voice input information is matched with the screen information through the above-mentioned technical scheme, and the target display screen is determined according to the matching result, so that the determination of the target display screen is not limited to the sound zone where the voice input is located, thereby enabling the user to speak all visible screen content with accurate positioning and high recognition rate.

[0028] Other features and advantages of the present application will be described in detail in the subsequent detailed description. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application, and those skilled in the art can obtain other drawings based on these drawings without creative work.

[0030] In order to more completely understand the present application and its beneficial effects, the following description will be given in conjunction with the accompanying drawings, wherein the same figure numbers represent the same parts in the following description.

[0031] Figure 1 This is a flow chart of an in-vehicle interaction method provided by an embodiment of the present application.

[0032] Figure 2 This is an application scenario block diagram of the in-vehicle interaction method provided by an embodiment of the present application.

[0033] Figure 3 This is a specific application scenario block diagram of the in-vehicle interaction method provided by an embodiment of the present application.

[0034] Figure 4 It is a top view schematic diagram of the arrangement of the vehicle interior display screen provided by one embodiment of the present application.

[0035] Figure 5 It is an internal schematic diagram of a vehicle interior display screen arrangement provided by an embodiment of the present application.

[0036] Figure 6 This is another specific application scenario block diagram of the in-vehicle interaction method provided by an embodiment of the present application.

[0037] Figure 7 This is another flow chart of the in-vehicle interaction method provided by an embodiment of the present application.

[0038] Figure 8 It is a block diagram of an in-vehicle interaction device provided by an embodiment of the present application.

[0039] Fig. 9 It is a block diagram of an electronic device provided by an embodiment of the present application.

[0040] Description of reference numerals:

[0041] 100. Vehicles;

[0042] 110, vehicle-mounted terminal; 111, first controller; 112, second controller;

[0043] 120. Voice collection device;

[0044] 130. Display device; 131. Instrument display screen; 132. Central control display screen; 133. Passenger display screen; 134. Rear display screen; 135. Function display screen;

[0045] 200, vehicle-mounted interactive device; 210, analysis module; 220, matching module; 230, control module. DETAILED DESCRIPTION

[0046] The technical solutions in the embodiments of the present application will be described clearly and completely below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.

[0047] According to the first aspect of the present application, the present application provides a vehicle-mounted interaction method. The vehicle-mounted interaction method provided in the embodiment of the present application is applied to a vehicle-mounted terminal of a vehicle. Figure 2 The vehicle terminal 110 is connected to a vehicle system, and the vehicle system includes a display device 130, a voice collection device 120, etc.

[0048] The display device 130 may be a display screen. Figure 3 The display screen may include at least one of an instrument display screen 131, a central control display screen 132, a co-pilot display screen 133, a rear display screen 134 and a roof display screen, and other functional display screens 135 (such as an air-conditioning operation screen, a head-up display screen (HUD)), etc.) may also be added, which is not limited here.

[0049] The voice collection device 120 includes a plurality of microphones, and the positions of the plurality of microphones can be set as required, for example, they can be arranged on the left and right sides of the front row and the left and right sides of the rear row in the vehicle.

[0050] The "display screen" defined in this application can be understood as a display screen that only includes a single display area. The entire screen only includes a complete image display area, that is, a single physical screen. Figures 3 to 5 The instrument display screen 131, the central control display screen 132, the co-pilot display screen 133, the rear display screen 134 and the roof display screen (not shown) are a single physical screen.

[0051] The "display screen" defined in this application can also be understood as one of the display areas in a single physical screen that includes multiple display areas, and each display area can display different content. For example, the instrument display screen 131 and the central control display screen 132 are included in a single physical screen; or the central control display screen 132 and the co-pilot display screen 133 are included in a single physical screen; or the instrument display screen 131, the central control display screen 132 and the co-pilot display screen 133 are all included in a single physical screen.

[0052] See also Figure 1 The vehicle-mounted interaction method of the present application comprises the following steps:

[0053] Step S110: Acquire the user's voice input information, and parse the screen selection information and instruction information in the voice input information;

[0054] Step S120: determining the target display screen according to the matching result between the screen selection information and the screen information;

[0055] Step S130: Control the target display screen according to the instruction information.

[0056] The microphones in the car are responsible for capturing the user's voice input. These microphones are distributed in appropriate locations in the car to ensure that the voice input can be effectively captured. The microphones convert the received sound waves into digital signals and transmit them to the vehicle terminal. The vehicle terminal uses voice recognition technologies such as deep learning to identify the intent and key information in the voice input, such as screen selection information and command information.

[0057] Among them, the screen selection information can be understood as the directional information contained in the voice input information, which is used to match the screen information associated with the display screen, so as to determine the display screen with which the user wants to interact.

[0058] The command information can be understood as interactive operations performed on the display screen that the user wants to interact with, such as setting general items, opening an application, searching for specific content, jumping to a specified screen area, and other functions such as video playback, switching music, etc.

[0059] Through the above technical solution, the screen selection information in the voice input information is matched with the screen information, and the target display screen is determined according to the matching result, so that the determination of the target display screen is not limited to the sound zone where the voice input is located, thereby enabling the user to speak all visible screen contents with accurate positioning and high recognition rate.

[0060] In some embodiments, the screen information includes one or more of screen name, voiceprint data, screen location information, and screen hot words.

[0061] Specifically, the screen naming can be understood as the preset display screen name of the display screen installed in the vehicle terminal. The display screen can be named in a variety of ways, such as the main driver's display screen, the co-driver's display screen, or the main driver's screen, the co-driver's screen, or the left front screen, the right front screen. It supports multiple forms of naming methods and can further support deep learning to meet the language habits of different users.

[0062] The voiceprint data can be understood as the binding relationship between the voiceprint information and the display screen, which is stored in a voiceprint database. The voiceprint database generally stores one or more voiceprint data.

[0063] Voiceprint data can be generated using the following steps:

[0064] Step S210, in response to receiving a voiceprint binding request from a user, obtaining the user's voiceprint information;

[0065] Step S220: Generate a binding relationship between the voiceprint information and the designated display screen.

[0066] In the setup wizard, the user's voiceprint is entered, voiceprint recognition is performed, and a special voiceprint code is generated, which is the user's voiceprint information. The vehicle terminal binds the voiceprint and the display screen name according to the user's voiceprint information and the display screen that the user requires to be bound, and stores the data in the voiceprint database. When a voice request is made later, the voiceprint data that matches the voiceprint information in the screen selection information will be searched from the voiceprint database, and the display screen bound to the voiceprint data will be determined as the target display screen.

[0067] After completing the above binding, specific users can perform voice control of specific screens, such as the driver's voice control of the central control screen, avoiding frequent calls to sound source positioning and enabling precise voice control.

[0068] The above voiceprint binding operation can be performed on the display interface of the display screen that currently needs to be bound, or on any other screen.

[0069] In some scenarios, the voiceprint of the same user can only be bound to one display, and a fixed display responds to a fixed user, enriching the driving voice interaction scenarios. Of course, in other special scenarios, the voiceprint recognition data of the same user can be bound to multiple displays. For example, the driver's voiceprint recognition data can be bound to the instrument display and the central control display at the same time to meet driving needs.

[0070] Specifically, the screen position information can be understood as the installation and layout of the display screens installed in the vehicle terminal. The position information of each display screen can be fixed, and the installation position is determined during the vehicle design and manufacturing process. Of course, the position information of each display screen can also be adjusted based on the user's usage needs. For example, the display screen is installed in the vehicle through a movable bracket, folding or rotating.

[0071] Specifically, screen hot words refer to a set of screen element names that users are most likely to request, which are calculated and generated based on the current screen elements of the display screen. These element names form a set and are collectively referred to as screen hot words. For example, the music playback interface will extract screen hot words such as play, pause, next song, and previous song.

[0072] The vehicle-mounted system may predetermine the function controls on the current display interface of the display screen. The current display interface may be the interface currently being displayed or the interface displayed after the display screen is awakened. That is, the screen hot words corresponding to the function controls visible to the user in the display screen are determined. The screen hot words corresponding to the function controls are determined based on the functions corresponding to the function controls. The screen hot words may include synonyms, generalized words, etc. of these functions.

[0073] For example, if the interface includes a functional control "navigation", the generalized terms may include "start navigation", "navigate to a certain address", "go to a certain address", etc. in addition to "navigation".

[0074] In some embodiments, the screen selection information includes one or more of screen entries, voiceprint information, sound source location information, and hot word entries.

[0075] Specifically, the screen entries can be understood as all entries related to the screen name obtained after semantic recognition of the voice input.

[0076] Specifically, voiceprint information includes voiceprint features such as sound frequency, sound energy, resonance peak, speaking speed and rhythm of voice input. The voiceprint recognition data of each user in the car is different and can be used to identify the identity of the passengers.

[0077] Specifically, the sound source location information can be understood as the location information of the sound source of the voice input relative to the space inside the vehicle. When the vehicle terminal receives the user's voice input collected by the voice collection device 120 (such as a microphone), it can determine the direction and distance of the sound source of the voice input relative to the voice collection device 120 based on the sound source positioning of the voice input, and then determine the location information of the sound source of the voice input relative to the space inside the vehicle in combination with the layout of the seats in the vehicle.

[0078] Sound source localization refers to locating the direction and distance of one or more sound sources based on sound signals. For example, sound source localization can be achieved using multiple signal classification (MUSIC) algorithm, neural network, time difference of arrival (TDOA) method, etc.

[0079] Specifically, the hot word entries can be understood as entries related to the screen hot words obtained after semantic recognition of the voice input.

[0080] By matching the above screen selection information and screen information to determine the target display screen, the control of the display screen by the present application is not limited to the association between the user's position in the car and the layout of the display screen (for example, the prior art divides the interior space of the car into multiple sound zones according to the layout of the seats, including the left front sound zone, the right front sound zone, the left rear sound zone, etc., and each sound zone can be arranged with a display screen respectively. When the user who issues the instruction is located in the left rear sound zone, only the display screen located in the left rear sound zone can be controlled). Therefore, the present application can overcome the problem in the prior art that only the display screen in a single sound zone can be supported to be visible and speakable, and realize visible and speakable across sound zones, accurate positioning, and high recognition rate.

[0081] In some embodiments, the screen selection information includes screen entries, and the screen information includes screen names. The above step S120 includes:

[0082] S121: When the screen entry matches the screen name, determine the target display screen according to the screen entry.

[0083] For example, when it is recognized that the voice input from the rear passenger contains "co-pilot", the co-pilot display screen is selected as the target display screen, and the target display screen is subsequently controlled according to the command information in the voice input to achieve the visibility of the front display screen by the rear passengers.

[0084] Since the target display screen can be matched by specifying the display screen name through user voice, the screen can be located quickly and the response speed is fast.

[0085] In some embodiments, the screen selection information includes voiceprint information, the screen information includes voiceprint data, and the above step S120 further includes:

[0086] S122: When the voiceprint information matches the voiceprint data, determine the target display screen according to the voiceprint information.

[0087] It can be understood that when the screen entry in the screen selection information fails to match the screen name in the screen information, the voiceprint information of the user's voice input continues to be matched with the voiceprint data. When the voiceprint information of the voice input matches the voiceprint information bound to any voiceprint data in the voiceprint database, it is determined that the voiceprint information of the voice input can match the voiceprint data, and the display screen corresponding to the successfully matched voiceprint data is selected as the target display screen.

[0088] Based on voiceprint information matching, the display screen that needs to be interacted with is improved in positioning accuracy, and the display screen can be quickly located, which improves the response efficiency and performance of the vehicle computer, with high recognition probability, good performance, and good content analysis. At the same time, voiceprint recognition and storage can meet the application of more scenarios, such as customized screen display and interaction, and provide different human-computer interaction care for different users.

[0089] In some embodiments, the screen selection information includes the audio source location information and the hot word entry, the screen information includes the screen location information and the screen hot word, and the above step S120 further includes:

[0090] S123: selecting a display screen closest to the sound source location as a display screen to be matched according to the sound source location information and the screen location information;

[0091] S124: When the hot word entry matches the screen hot word of the display screen to be matched, determine the display screen to be matched as the target display screen.

[0092] It can be understood that, in the case where the voiceprint information in the screen selection information fails to match the voiceprint data in the screen information, the hotword entry in the voice input continues to be matched with the screen hotword in the display screen. When the hotword entry included in the voice input matches the screen hotword in the display screen, the display screen is selected as the target display screen for subsequent interaction.

[0093] Combining the display screen closest to the sound source positioning with the hot word matching method can select the nearest display screen for hot word matching based on the position of the user's voice input in the car, reducing the number of hot word matches and thereby reducing the amount of calculation for the vehicle terminal.

[0094] In some embodiments, the above step S120 further includes:

[0095] S125: When the hot word entry does not match the screen hot word of the display screen to be matched, the hot word entry is matched with the screen hot words of multiple display screens in sequence according to the sound source position information and the screen position information;

[0096] S126: When the hot word entry matches the screen hot word of any display screen, determine the matching display screen as the target display screen.

[0097] In the case that the screen hot words in the display screen closest to the sound source of the voice input fail to match the hot word entries in the screen selection information, the screen hot words in multiple display screens are matched with the hot word entries in the screen selection information in sequence from near to far according to the distances between the multiple display screens and the sound source of the voice input, so that the final matching display screen can meet the visual experience and interactive experience of the user's position in the car.

[0098] It can be understood that when the present application matches the screen hot words in multiple display screens with the hot word entries in the screen selection information in sequence from near to far, when the hot word match on one of the display screens is successful, the hot word matching of the display screen that is farther away from the sound source location of the voice input is stopped.

[0099] Through the above screen selection information and screen information, voice input response is carried out step by step, and the cross-audio zone visible and speaking is realized, so that users at all positions in the car can truly see and speak, breaking the original audio zone restrictions and greatly enriching the interactive scenes in the car.

[0100] In some embodiments, the vehicle-mounted interaction method provided in the embodiments of the present application further includes the following steps:

[0101] The screen hot words in the user space to which the multiple display screens are connected are matched with the hot word entries in the screen selection information.

[0102] The vehicle system parses the content of all connected display screens and stores them in their respective user spaces (such as the front user buffer and the rear user buffer). After obtaining the user's voice input information, it matches the display screen. The vehicle terminal divides different buffers for multiple display screens. These buffers can be specific areas in the memory or independent folders on the hard disk.

[0103] For example, the display screens may be divided according to their functions. The contents of display screens related to driving, such as the instrument display screen, central control display screen, and HUD display screen, may be stored in the front user cache area, while the contents of display screens related to passengers, such as the co-pilot display screen, rear display screen, and roof display screen, may be stored in the rear user cache area.

[0104] For example, the display screens may be divided according to their different positions in the vehicle, with the contents of the display screens located in the front row of the vehicle, such as the instrument display screen, central control display screen, HUD display screen and co-pilot display screen, being stored in the front user cache area, while the contents of the display screens located in the rear row of the vehicle, such as the rear display screen and roof display screen, being stored in the rear user cache area.

[0105] The screen hot words stored in the user space are matched with the hot word entries in the screen selection information. When the current response matching user space fails to match the hot word entry in the screen selection information, all display screens connected to the user space are not matched. In this way, there is no need to match the hot words of multiple display screens one by one, and the user's voice input can be efficiently and accurately recognized and the display screen required by the user can be matched. At the same time, the cache of multiple users and multiple displays can improve efficiency and performance.

[0106] In some embodiments, the vehicle terminal includes a first controller and a second controller, which are controllers mounted on the vehicle, and can be existing controllers on the vehicle or independently controlled controllers, as long as they can implement the vehicle interaction method. Display screens associated with different user spaces can be controlled by different controllers.

[0107] For example, see Figure 6 The instrument display screen 131, the central control display screen 132, the co-pilot display screen 133 and the function display screen 135 are electrically connected to the first controller 111 and controlled by the first controller 111. The rear display screen 134 and the roof display screen (not shown) are electrically connected to the second controller 112 and controlled by the second controller 112.

[0108] In some embodiments, the vehicle-mounted interaction method of the present application further includes:

[0109] Step S310: In the case where the screen selection information does not match the screen information, determining whether new screen selection information is received within a preset time period;

[0110] Step S320: When new screen selection information is received, the new screen selection information is executed, matched with the screen information, and the target display screen is determined according to the new matching result.

[0111] In an embodiment of the present application, when the above screen entries and screen names, voiceprint information and voiceprint data, hot word entries and screen hot words, etc. all fail to match, and when new screen selection information is received within a preset time, the new screen selection information is matched with the screen information; when no new screen selection information is received within the preset time after the matching failure, the interaction ends, or the result of the voice interaction is fed back according to the scenario.

[0112] Below, the in-vehicle interaction method provided in an embodiment of the present application is introduced and explained with an example.

[0113] See also Figure 7 , an in-vehicle interaction method provided in an embodiment of the present application comprises the following steps:

[0114] Step ST401: After receiving the user's voice input, each microphone installed in the vehicle terminal converts it into a digital signal by the voice recognition algorithm and sends it to the vehicle terminal.

[0115] Step ST402: parse the screen terms in the voice input, such as the passenger display screen, the left rear display screen, etc.

[0116] Step ST403: traverse the display screens installed in the vehicle terminal to determine whether the screen entry matches the screen name.

[0117] Step ST404: When the screen entry matches the screen name, the successfully matched display screen is selected as the target display screen to execute step ST417.

[0118] Step ST405: When the screen entry fails to match the screen name, the voiceprint information of the speech input is parsed.

[0119] Step ST406: Determine whether the voiceprint information of the speech input matches the voiceprint data in the voiceprint database.

[0120] Step ST407: When the voiceprint information of the speech input matches the voiceprint data, the target display screen is determined according to the binding relationship between the voiceprint data and the display screen, and step ST417 is executed.

[0121] Step ST408: When the voiceprint information of the voice input fails to match the voiceprint data in the voiceprint database, the display screen closest to the sound source of the voice input is obtained based on the sound source positioning of the voice input.

[0122] Step ST409: Determine whether the screen hot word of the display screen closest to the sound source position of the voice input matches the hot word entry in the voice input.

[0123] Step ST410: When the screen hot word in the display screen closest to the sound source position of the voice input successfully matches the hot word entry in the voice input, select the display screen as the target display screen to execute step ST417.

[0124] Step ST411: When the screen hot words in the display screen closest to the sound source of the voice input fail to match the hot word entries in the voice input, the screen hot words in the multiple display screens are matched with the hot word entries in the screen selection information from near to far according to the distance between the multiple display screens and the sound source of the voice input.

[0125] Step ST412: Determine whether there is a screen hot word in any display screen that matches the hot word entry in the voice input.

[0126] Step ST413: When a screen hot word in any display screen successfully matches a hot word entry in the voice input, the display screen with the successful match is selected as the target display screen to execute step ST417.

[0127] Step ST414: When the screen hot words in all display screens fail to match the hot word entries in the voice input, determine whether a voice input containing new screen selection information is received within a preset time period.

[0128] Step ST415: When voice input containing new screen selection information is received within a preset time period, return to execute step ST401.

[0129] Step ST416: When no voice input containing new screen selection information is received within the preset time period, the interaction is terminated.

[0130] Step ST417: Specify the determined target display screen to interact with the instruction information in the voice input.

[0131] According to the second aspect of this application, please refer to Figure 8 The present application also provides a vehicle-mounted interactive device. The vehicle-mounted interactive device 200 provided in the embodiment of the present application can be an electronic device or can be set in an electronic device. The vehicle-mounted interactive device includes: a parsing module 210, a matching module 220 and a control module 230.

[0132] The parsing module 210 is used to obtain the user's voice input information and parse the screen selection information and instruction information in the voice input information; the matching module 220 is used to determine the target display screen based on the matching results of the screen selection information and the screen information; the control module 230 is used to control the target display screen according to the instruction information.

[0133] Among them, the screen selection information includes one or more of screen entries, voiceprint information, sound source location information, and hot word entries; the screen information includes one or more of screen naming, voiceprint data, screen location information, and screen hot words.

[0134] In some embodiments, the matching module 220 is further configured to determine a target display screen according to the screen entry when the screen entry matches the screen name.

[0135] In some embodiments, the matching module 220 is further configured to determine a target display screen according to the voiceprint information when the voiceprint information matches the voiceprint data.

[0136] In some embodiments, the matching module 220 is also used to select the display screen closest to the sound source position as the display screen to be matched based on the sound source position information and the screen position information; when the hot word entry matches the screen hot word of the display screen to be matched, the display screen to be matched is determined to be the target display screen.

[0137] In some embodiments, the matching module 220 is also used to match the hot word entry with the screen hot words of multiple display screens in sequence according to the sound source position information and the screen position information when the hot word entry does not match the screen hot word of the display screen to be matched; when the hot word entry matches the screen hot word of any display screen, determine that the matching display screen is the target display screen.

[0138] In some embodiments, the matching module 220 is also used to determine whether new screen selection information is received within a preset time period when the screen selection information does not match the screen information; when new screen selection information is received, the new screen selection information is executed to match the screen information, and the target display screen is determined based on the new matching results.

[0139] According to the third aspect of the present application, the embodiment of the present application further provides a non-transitory computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned vehicle-mounted interaction method are implemented. The non-transitory computer-readable storage medium has all the beneficial effects of the above-mentioned vehicle-mounted interaction method, and the present application will not repeat them here.

[0140] According to the fourth aspect of the present application, the embodiment of the present application further provides a computer program product, including a computer program, which implements the above-mentioned vehicle-mounted interaction method when the computer program is executed by a processor. The computer program product has all the beneficial effects of the above-mentioned vehicle-mounted interaction method, which will not be described in detail in this application.

[0141] According to the fifth aspect of the present application, an embodiment of the present application further provides an electronic device, comprising: a memory and a processor, wherein a computer program is stored in the memory; and the processor is used to execute the computer program in the memory to implement the steps of the above-mentioned vehicle-mounted interaction method. The electronic device has all the beneficial effects of the above-mentioned vehicle-mounted interaction method, and the present application will not repeat them here.

[0142] See also Fig. 9 , the electronic device 800 may include a processing device 801 (such as a central processing unit, a graphics processing unit, etc.), which can perform various appropriate actions and processes according to a program stored in a read-only memory (ROM) 802 or a program loaded from a storage device 808 to a random access memory (RAM) 803. Various programs and data required for the operation of the electronic device 800 are also stored in the random access memory (RAM) 803. The processing device 801, the ROM 802, and the RAM 803 are connected to each other via a bus 804. An input / output (I / O) interface 805 is also connected to the bus 804.

[0143] Typically, the following devices may be connected to the I / O interface 805: input devices 806 including, for example, a touch screen, a touch pad, a keyboard, a mouse, a camera, a microphone, an accelerometer, a gyroscope, etc.; output devices 807 including, for example, a liquid crystal display (LCD), a speaker, a vibrator, etc.; storage devices 808 including, for example, a magnetic tape, a hard disk, etc.; and communication devices 809. The communication device 809 may allow the electronic device 800 to communicate with other devices wirelessly or by wire to exchange data. Although Fig. 9 The electronic device 800 is shown with various devices, but it should be understood that it is not required to implement or possess all the devices shown. More or fewer devices may be implemented or possessed instead. Fig. 9 Each block shown in the figure may represent one device, or may represent multiple devices as required.

[0144] In particular, according to some embodiments of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, some embodiments of the present application include a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a program code for executing the method shown in the flowchart. In some such embodiments, the computer program can be downloaded and installed from the network through the communication device 809, or installed from the storage device 808, or installed from the ROM 802. When the computer program is executed by the processing device 801, the above-mentioned functions defined in the method of some embodiments of the present application are executed.

[0145] It should be noted that the computer-readable medium of some embodiments of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above, which is not specifically limited in the present application. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0146] In some embodiments of the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, apparatus, or device. In some embodiments of the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, which carries a computer-readable program code. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium, which may send, propagate, or transmit a program for use by or in combination with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium may be transmitted using any suitable medium, including but not limited to: wires, optical cables, RF (radio frequency), etc., or any suitable combination of the above.

[0147] In some embodiments, the client and the server may communicate using any currently known or future developed network protocol such as Hyper Text Transfer Protocol (HTTP), and may be interconnected with any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include a local area network (LAN), a wide area network (WAN), an internet (e.g., the Internet), and a peer-to-peer network (Advanced Developers Hands-On Conference, adho), as well as any currently known or future developed network.

[0148] The computer-readable medium may be included in the electronic device, or may exist independently without being installed in the electronic device. The computer-readable medium carries one or more programs. When the one or more programs are executed by the electronic device, the electronic device: obtains the user's voice input information, parses the screen selection information and instruction information in the voice input information; determines the target display screen according to the matching result between the screen selection information and the screen information; and controls the target display screen according to the instruction information.

[0149] Computer program code for performing the operations of some embodiments of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., through the Internet using an Internet service provider).

[0150] The flowcharts and block diagrams in the accompanying drawings illustrate the possible architecture, functions and operations of the systems, methods and computer program products according to various embodiments of the present application. In this regard, each box in the flowchart or block diagram may represent a module, a program segment, or a portion of a code, which contains one or more executable instructions for implementing a specified logical function.

[0151] It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures.

[0152] For example, two boxes shown in succession may actually be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of boxes in the block diagram and / or flow chart, can be implemented by a dedicated hardware-based system that performs the specified function or operation, or can be implemented by a combination of dedicated hardware and computer instructions.

[0153] The units described in some embodiments of the present application may be implemented by software or hardware. The described units may also be provided in a processor, for example, may be described as: a processor includes a parsing module, a selection module and a control module. The names of these units do not, in some cases, constitute limitations on the units themselves, for example, the selection module may also be described as "a unit for selecting at least one display screen according to screen selection information".

[0154] The functions described above in this article may be performed at least in part by one or more hardware logic components. For example, without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Array (FPGA), Application Specific Integrated Circuit (ASIC), Application Specific Standard Parts (ASSP), System on Chips (SOC), Complex Programmable Logic Device (CPLD), etc.

[0155] According to the sixth aspect of this application, please refer to Figure 4 The embodiment of the present application also provides a vehicle 100, including the above-mentioned computer program product, vehicle-mounted interactive device or electronic device. The vehicle has all the beneficial effects of the above-mentioned computer program product, vehicle-mounted interactive device or electronic device, which will not be described in detail in the present application.

[0156] The vehicle may be a fuel vehicle, a plug-in hybrid vehicle or a new energy vehicle, etc., and this application does not make any specific limitation on this.

[0157] In the description of this application, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of this application, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0158] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0159] The embodiments, implementation methods and related technical features of the present application can be combined and replaced with each other without conflict.

[0160] The above are only preferred embodiments of the present application and do not constitute any form of limitation to the present application. However, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present application without departing from the content of the technical solution of the present application are still within the scope of the technical solution of the present application.

Claims

1. A vehicle-mounted interaction method, characterized in that: include: Acquire the user's voice input information, and parse the screen selection information and instruction information in the voice input information; Determining a target display screen according to a matching result between the screen selection information and the screen information; Control the target display screen according to the instruction information; The screen selection information includes sound source location information and hot word entries, the screen information includes screen location information and screen hot words, and determining the target display screen according to the matching result between the screen selection information and the screen information includes: Selecting a display screen closest to the sound source location as a display screen to be matched according to the sound source location information and the screen location information; In the case where the hot word entry matches the screen hot word of the display screen to be matched, determining the display screen to be matched as a target display screen; In the case where the hot word entry does not match the screen hot word of the display screen to be matched, the hot word entry is matched with the screen hot words of the plurality of display screens in sequence according to the sound source position information and the screen position information; In the case where the hot word entry matches a screen hot word of any of the display screens, the matching display screen is determined to be a target display screen.

2. The vehicle-mounted interaction method according to claim 1, characterized in that: The screen selection information also includes one or more of screen entries and voiceprint information; the screen information also includes one or more of screen names and voiceprint data.

3. The vehicle-mounted interaction method according to claim 2, characterized in that: The screen selection information includes the screen entry, the screen information includes the screen name, and determining the target display screen according to the matching result between the screen selection information and the screen information includes: In the case where the screen entry matches the screen name, the target display screen is determined according to the screen entry.

4. The vehicle-mounted interaction method according to claim 3, characterized in that: The screen selection information includes the voiceprint information, the screen information includes the voiceprint data, and determining the target display screen according to the matching result between the screen selection information and the screen information includes: In a case where the voiceprint information matches the voiceprint data, the target display screen is determined according to the voiceprint information.

5. The vehicle-mounted interaction method according to any one of claims 1 to 4, characterized in that: The method further comprises: In the case where the screen selection information does not match the screen information, determining whether new screen selection information is received within a preset time period; When new screen selection information is received, the new screen selection information is used to perform matching with the screen information, and a target display screen is determined according to the new matching result.

6. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the in-vehicle interaction method described in any one of claims 1 to 5 is implemented.

7. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the in-vehicle interaction method according to any one of claims 1 to 5 is implemented.

8. An electronic device, characterized in that: include: a memory having a computer program stored thereon; A processor, used to execute the computer program in the memory to implement the in-vehicle interaction method according to any one of claims 1 to 5.

9. A vehicle, characterized in that: The vehicle comprises the computer program product according to claim 7, or the electronic device according to claim 8.

Images