Interface control selection method and device of vehicle-mounted equipment, equipment and medium

Abstract

The invention relates to an interface control selection method and device of vehicle-mounted equipment, equipment and a medium, and belongs to the technical field of vehicle-mounted equipment. The method comprises the steps that voice control instruction information of a user is acquired; converting the voice control instruction information into text information; inquiring whether an interface control matched with the control instruction information exists in an interface control library or not; if yes, selecting an interface control matched with the control instruction information, and taking the selected interface control as a to-be-selected target control; obtaining the number of to-be-selected target controls; under the condition that the number is greater than 1, selecting one of the to-be-selected target controls as a target control based on a selection strategy, and clicking the target control; and under the condition that the number of the to-be-selected target controls is equal to 1, directly taking the to-be-selected target controls as the target controls, and clicking the target controls. The method and the device have the effect of reducing the possibility of misoperation or incapability of meeting user requirements.

Description

Technical Field

[0001] The present application relates to the technical field of vehicle-mounted equipment, and in particular to a method, device, equipment and medium for selecting an interface control of a vehicle-mounted equipment. Background Art

[0002] With the rapid development of automotive electronic technology and people's increasing demand for diversified, convenient and user-friendly automotive functions, in-vehicle infotainment and information communication systems have gradually become a hot spot sought after by automobile manufacturers. In-vehicle infotainment and information communication systems mainly include in-vehicle communication systems, electronic navigation systems (GPS), intelligent transportation systems, in-vehicle networks, car audio systems, in-vehicle entertainment systems, etc.

[0003] Voice interaction technology plays a very important role in these systems. Voice interaction technology allows machines to convert voice signals into corresponding text or commands through the process of recognition and understanding, thereby realizing communication between people and machines. For example, users can directly speak the text information visible on the in-vehicle display screen without manually clicking on the interface controls; when users issue voice commands, the voice assistant of the in-vehicle system will recognize these commands and simulate clicking on the corresponding interface controls to perform the user's desired operations.

[0004] However, the same text information on the car display may correspond to multiple interface controls. For example, if the text information is "play", the corresponding interface controls include music playback and video playback. When the user issues a voice command, it may not be possible to determine which interface control the user wants to click, resulting in operational errors or failure to meet user needs. Summary of the invention

[0005] In order to reduce the possibility of operating errors or failure to meet user needs, the present application provides an interface control selection method, device, equipment and medium for an in-vehicle device.

[0006] In a first aspect, the present application provides a method for selecting an interface control of an in-vehicle device, which adopts the following technical solution:

[0007] A method for selecting an interface control of an in-vehicle device, comprising:

[0008] Obtain user's voice control command information;

[0009] Converting the voice control instruction information into text information;

[0010] Extracting control instruction information from the text information;

[0011] Querying an interface control library to determine whether there is an interface control that matches the control instruction information;

[0012] If it exists, then select the interface control that matches the control instruction information, and use the selected interface control as the target control to be selected;

[0013] Get the number of target controls to be selected;

[0014] When the number is greater than 1, one of the target controls to be selected is selected as the target control based on the selection strategy, and the target control is clicked;

[0015] When the number is equal to 1, the target control to be selected is directly used as the target control, and the target control is clicked.

[0016] By adopting the above technical solution, the voice control command is converted into text information, and the target control to be selected is extracted from the interface control library through the control command information in the text information. When there are multiple target controls to be selected, one of the target controls to be selected is selected as the target control according to the selection strategy. This can effectively reduce erroneous operations caused by ambiguous control command information or repeated interface controls, and improve the accuracy of stable response to voice control commands.

[0017] Optionally, selecting one of the target controls to be selected as the target control based on the selection strategy includes:

[0018] Obtaining coordinate information and size information of each target control to be selected;

[0019] Determine whether there is an inclusion relationship between the plurality of target controls to be selected based on the coordinate information and the size information;

[0020] If so, the target control to be selected with the smallest area is selected as the target control; otherwise, the target control is determined based on an arbitration strategy.

[0021] By adopting the above technical solution, the position and size of each target control to be selected on the vehicle display screen can be accurately determined through the coordinate information and size information of the interface controls, so as to more accurately judge the relative position relationship between the target controls to be selected, because smaller target controls to be selected often represent the user's intention more specifically and directly. Therefore, when multiple target controls to be selected have an inclusion relationship, the target control to be selected with the smallest area is selected as the target control, so that the determined target control can meet the user's needs and expectations to the greatest extent.

[0022] Optionally, determining the target control based on the arbitration strategy includes:

[0023] Acquiring the time of acquiring the voice control instruction information;

[0024] Determine a query time period based on the acquisition time;

[0025] Obtaining the voice information to be processed corresponding to the query time period;

[0026] Query whether there is a characteristic word in the voice information to be processed;

[0027] If so, a target control to be selected is selected as the target control based on the feature word.

[0028] By adopting the above technical solution, by analyzing the voice information to be processed within the query time period, it is possible to more comprehensively understand the user's intention in the current conversation or operation context. When feature words are detected in the voice information within the query time period, the user's true intention is determined based on these feature words, and the target control is selected accordingly, so that the selected target control is more in line with the user's expectations.

[0029] Optionally, determining the target control based on the arbitration strategy includes:

[0030] Get the current interface of the vehicle display;

[0031] Query whether the target control to be selected exists in the current interface;

[0032] If so, the target control to be selected is used as the target control.

[0033] By adopting the above technical solution, the target control is determined according to the actual situation of the current interface, which can more accurately reflect the actual intention of the user.

[0034] Optionally, determining the target control based on the arbitration strategy includes:

[0035] Get the user's historical operation information;

[0036] Querying whether the target control to be selected exists in the historical operation information;

[0037] If yes, then obtaining the usage count and usage time of each of the target controls to be selected;

[0038] Determine the user's usage habits based on the usage times and usage time;

[0039] A target control to be selected is selected as the target control based on the usage habit.

[0040] By adopting the above technical solution, by analyzing the user's historical operation information, the user's usage habits can be determined, and the target control can be selected by using the usage habits, so that the interaction process is more in line with the user's personalized needs, thereby improving the user experience.

[0041] Optionally, when the target control cannot be determined based on the arbitration strategy, the method further includes:

[0042] Obtain all the target controls to be selected;

[0043] Numbering each of the target controls to be selected;

[0044] Generate a selection interface based on the target control to be selected and the number corresponding to the target control to be selected;

[0045] The selection interface is displayed.

[0046] By adopting the above technical solution, all target controls to be selected are numbered to form a selection interface and displayed on the vehicle-mounted display screen, which makes it easy for users to quickly identify and confirm the target controls to be selected that they want to operate, reduces erroneous operations caused by ambiguity, and enables users to make choices based on their own wishes and judgment when the target control cannot be automatically determined, thereby improving the flexibility and satisfaction of the interaction.

[0047] Optionally, after displaying the selection interface, the method further includes:

[0048] Acquire the user's selection voice information on the selection interface;

[0049] Determining a number based on the selected voice information;

[0050] Select the target control to be selected based on the number;

[0051] The selected target control is used as the target control.

[0052] By adopting the above technical solution, the user's intended target control is quickly determined by selecting voice information and numbering, thereby reducing the possibility of accidental touches or misoperations when touching the screen, and further improving the accuracy of the operation.

[0053] In a second aspect, the present application provides an interface control selection device for an in-vehicle device, which adopts the following technical solution:

[0054] An interface control selection device for an in-vehicle device, comprising:

[0055] An acquisition module is used to obtain the user's voice control command information;

[0056] A conversion module, used to convert the voice control instruction information into text information;

[0057] A query module, used to query whether there is an interface control matching the control instruction information in the interface control library; if so, select the interface control matching the control instruction information and use the selected interface control as the target control to be selected;

[0058] An extraction module, used to extract control instruction information from the text information;

[0059] The second acquisition module is used to obtain the number of target controls to be selected;

[0060] A first clicking module is used for selecting one of the target controls to be selected as a target control based on a selection strategy when the number is greater than 1, and clicking the target control;

[0061] The second clicking module is used for directly taking the target control to be selected as the target control and clicking the target control when the number is equal to 1.

[0062] By adopting the above technical solution, the voice control command is converted into text information, and the target control to be selected is extracted from the interface control library through the control command information in the text information. When there are multiple target controls to be selected, one of the target controls to be selected is selected as the target control according to the selection strategy. This can effectively reduce erroneous operations caused by ambiguous control command information or repeated interface controls, and improve the accuracy of stable response to voice control commands.

[0063] In a third aspect, the present application provides an electronic device, which adopts the following technical solution:

[0064] An in-vehicle device comprises a processor and a memory, wherein the processor is coupled to the memory;

[0065] The processor is used to execute the computer program stored in the memory so that the electronic device performs the method as described in any one of the first aspects.

[0066] In a fourth aspect, the present application provides a computer-readable storage medium, which adopts the following technical solution:

[0067] A computer-readable storage medium comprises a computer program or an instruction, and when the computer program or the instruction is executed on a computer, the computer is caused to execute the method as described in any one of the first aspects.

[0068] In summary, the present application includes at least one of the following beneficial technical effects:

[0069] 1. Convert the voice control command into text information, and extract the target control to be selected from the interface control library through the control command information in the text information. When there are multiple target controls to be selected, one of the target controls to be selected is selected as the target control according to the selection strategy, which can effectively reduce the misoperation caused by the fuzzy control command information or the duplication of interface controls, and improve the accuracy of the stable response of the voice control command;

[0070] 2. Through the coordinate information and size information of the interface controls, the position and size of each target control to be selected on the vehicle display screen can be accurately determined, so as to more accurately judge the relative position relationship between the target controls to be selected, because smaller target controls to be selected often represent the user's intention more specifically and directly. Therefore, when multiple target controls to be selected have an inclusion relationship, the target control to be selected with the smallest area is selected as the target control, so that the determined target control can meet the user's needs and expectations to the greatest extent. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] Figure 1 It is a flow chart of a method for selecting an interface control of an in-vehicle device in an embodiment of the present application.

[0072] Figure 2 It is a structural block diagram of an interface control selection device for an in-vehicle device in an embodiment of the present application.

[0073] Figure 3 It is a structural block diagram of a vehicle-mounted device in an embodiment of the present application. DETAILED DESCRIPTION

[0074] The present application is further described in detail below in conjunction with the accompanying drawings.

[0075] This specific embodiment is merely an explanation of the present application and is not a limitation of the present application. After reading this specification, those skilled in the art may make modifications to the present embodiment without any creative contribution as needed, but such modifications are protected by the patent law as long as they are within the scope of the claims of the present application.

[0076] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0077] In addition, the term "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. In addition, the character " / " in this article, unless otherwise specified, generally means that the associated objects before and after are in an "or" relationship.

[0078] The embodiments of the present application are further described in detail below in conjunction with the drawings in the specification.

[0079] The embodiment of the present application provides an interface control selection method for an in-vehicle device, which can be executed by an electronic device, which can be a server or a terminal device, wherein the server can be an independent physical server, a server cluster or a distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device can be a smart phone, a tablet computer, a desktop computer, etc., but is not limited thereto.

[0080] like Figure 1 As shown, a method for selecting an interface control of a vehicle-mounted device, the main process of the method is described as follows (steps S101 to S109):

[0081] Step S101, obtaining user's voice control command information;

[0082] In this embodiment, the user selects the interface controls of the vehicle display screen through voice information, where the interface controls, also known as UI controls, are graphical elements used to implement user interaction in interface design. Interface controls are usually set on various interfaces such as windows, web pages, and mobile applications to provide users with input, selection, triggering and other operation functions.

[0083] In this embodiment, the vehicle-mounted device acquires the user's voice information in real time, and uses the acquired voice information as voice control instruction information.

[0084] Step S102, converting the voice control instruction information into text information;

[0085] Step S103, extracting control instruction information from the text information;

[0086] In this embodiment, the vehicle-mounted device converts the acquired voice control command information into text information, and identifies the control command information in the text information through NLP natural semantic analysis technology, where the control command information includes but is not limited to play and pause, fast forward and rewind, volume control, and selection and switching.

[0087] Step S104, querying whether there is an interface control matching the control instruction information in the interface control library, if yes, executing step S105, otherwise executing step S109;

[0088] In this embodiment, the vehicle-mounted device obtains all interface controls on the vehicle-mounted display screen and organizes all the interface controls into an interface control library, wherein the interface controls with the same control instruction information are a subset, and the interface controls of the same subset are stored together for quick search. For example, the interface control is play, music playback corresponds to a play interface control, and video playback corresponds to a play interface control. At this time, the two interface controls are stored in one subset.

[0089] In this embodiment, each interface control corresponds to a control command information. When the vehicle-mounted device obtains operation command information, it queries the operation command information in the interface control library to see whether there is control command information that is identical to the text information. When the same control command information exists, it determines whether there is an interface control that matches the control command information.

[0090] Step S105, selecting an interface control that matches the control instruction information, and using the selected interface control as a target control to be selected;

[0091] In this embodiment, when there are interface controls matching the control instruction information in the interface control library, all interface controls matching the control instruction information are extracted. The extracted interface controls are referred to as target controls to be selected, and the target controls to be selected that need to be clicked are referred to as target controls.

[0092] Step S106, obtaining the number of target controls to be selected;

[0093] In this embodiment, the vehicle-mounted device calculates the number of target controls to be selected, wherein the number of target controls to be selected is greater than 0 and is an integer.

[0094] Step S107, when the number is greater than 1, one of the target controls to be selected is selected as the target control based on the selection strategy, and the target control is clicked;

[0095] Specifically, the coordinate information and size information of each target control to be selected are obtained; based on the coordinate information and size information, it is determined whether multiple target controls to be selected have an inclusion relationship; if so, the target control to be selected with the smallest area is selected as the target control, otherwise the target control is determined based on the arbitration strategy.

[0096] In this embodiment, when there are multiple target controls to be selected, the coordinate information and size information of each target control to be selected are obtained. In this embodiment, taking the shape of the interface control as a rectangle as an example, the vehicle-mounted device obtains the coordinate information of the upper left corner of the target control to be selected and the length and width of the rectangle, thereby determining whether there is an inclusion relationship between multiple target controls to be selected based on the coordinate information of the upper left corner and the length and width of the rectangle. When there is an inclusion relationship between all the target controls to be selected, the target control with a smaller area to be selected is selected as the target control.

[0097] In the process of obtaining the text and contentDescription attributes of interface controls through accessibility services to obtain the text content of controls, the Tab control will contain multiple nested controls and the parent control FrameLayout will set the contentDescription attribute to the same content as the text attribute displayed by the child control TextView. In this case, there will be multiple collected and matched interface controls, and there will be a coordinate position inclusion relationship. It is often possible to determine which control is "smaller" or "more precise" by comparing the boundary coordinates of the controls. Therefore, directly selecting the target control with a smaller area can more accurately match the user's intention.

[0098] For example, the following calculation formula is used to calculate whether the target control to be selected has a containment relationship:

[0099] (rectA.left≤rectB.left)∧(rectA.top≤rectB.top)∧(rectA.right≥rectB.right)∧(rectA.bottom≥rectB.bottom).

[0100] When all conditions are met, it is determined that rectangle rectA contains rectangle rectB, and the target control to be selected corresponding to rectangle rectB is used as the target control.

[0101] It should be noted that, when some of the multiple target controls to be selected have an inclusion relationship and some do not have an inclusion relationship, the final target control can be determined by generating a selection interface.

[0102] When the target control to be selected does not have a containment relationship, the target control is determined based on the arbitration strategy, which includes the following three aspects:

[0103] The first aspect: obtaining the acquisition time of the voice control instruction information; determining the query time period based on the acquisition time; obtaining the voice information to be processed corresponding to the query time period; querying whether there are feature words in the voice information to be processed; if so, selecting a target control to be selected as the target control based on the feature words.

[0104] In this embodiment, the vehicle-mounted device obtains the acquisition time of the voice control command information, wherein the acquisition time is the acquisition time including the control command information, and the query time period is a preset time period, for example, 10s before the acquisition time and 10s after the acquisition time, and the 10s before the acquisition time, the 10s after the acquisition time and the acquisition time are used as the query time period, and the voice information to be processed in the query time period is converted into text information, and the NLP natural semantic analysis technology is used to identify the feature words in the text information, and the target control to be selected corresponding to the feature word is used as the target control, wherein the feature word is a modifier or qualifier, such as the music in "play music", the play list in "next song in play list", etc.

[0105] The second aspect: obtaining the current interface of the vehicle display screen; querying whether there is a target control to be selected in the current interface; if so, taking the target control to be selected as the target control.

[0106] In this embodiment, when an application interface exists on the vehicle display screen, the application interface is obtained and the application interface is used as the current interface. If a target control to be selected exists in the current interface, the target control to be selected is used as the target control.

[0107] The third aspect: obtaining the user's historical operation information; querying whether there is a target control to be selected in the historical operation information; if so, obtaining the number of times each target control to be selected is used and the usage time; determining the user's usage habits based on the number of times and the usage time; and selecting a target control to be selected as the target control based on the usage habits.

[0108] In this embodiment, the vehicle-mounted device obtains the user's historical operation information, where the historical operation information includes but is not limited to the used interface controls. The electronic device queries whether there is an interface control that is the same as the target control to be selected. If so, the corresponding interface control is selected, and the number of times the selected interface control is used and the usage time are obtained, and different weight values ​​are assigned to the number of times and the usage time, respectively. The selection score is calculated based on the number of times and the usage time and the corresponding weight values, and the target control to be selected with the largest selection score is selected as the target control.

[0109] When the target control cannot be determined based on the arbitration policy, the following are also included:

[0110] Specifically, all target controls to be selected are obtained; each target control to be selected is numbered; a selection interface is generated based on the target controls to be selected and the numbers corresponding to the target controls to be selected; and the selection interface is displayed.

[0111] In this embodiment, when the target control cannot be determined through the arbitration strategy, the vehicle-mounted device obtains all the target controls to be selected, numbers each target control to be selected, and generates a selection interface based on each target control to be selected and the corresponding number for the user to select, wherein the number can be a number or a letter, and there is no specific limitation on this.

[0112] The order of the numbers may also be determined according to the number of times each target control to be selected has been used in history.

[0113] After the selection interface is generated, the vehicle-mounted device issues a prompt voice message to prompt the user to make a selection, wherein the prompt voice message may be, please select a number.

[0114] It should be noted that, in this embodiment, when the target control cannot be determined by the selection strategy, the three aspects can be judged independently, and can also be judged in a certain order. For example, the target control is first determined by the first aspect. When the first aspect cannot determine the target control, the target control is then determined by the second aspect. When the second aspect cannot determine the target control, the target control is then determined by the third aspect.

[0115] After the selection interface is displayed, the following contents are also included:

[0116] Specifically, the user's selection voice information on the selection interface is obtained; the number is determined based on the selection voice information; the target control to be selected is selected based on the number, and the selected target control to be selected is used as the target control.

[0117] In this embodiment, after generating the selection interface, the vehicle-mounted device receives the real-time user's selection voice information and also uses NLP to analyze the selection voice information, thereby extracting the number in the selection voice information. The vehicle-mounted device selects the target control to be selected corresponding to the number, and uses the selected target control to be selected as the target control, thereby clicking the target control to respond to the voice control command information.

[0118] Step S108, when the number is equal to 1, directly taking the target control to be selected as the target control, and clicking the target control;

[0119] In this embodiment, when there is only one target control to be selected, it proves that there is only one interface control that meets the requirements. At this time, the target control to be selected is directly used as the target control and clicked to respond to the user's voice operation instruction information.

[0120] Step S109, generating prompt information and displaying the prompt information.

[0121] When there is no interface control matching the control command information in the interface control library, the vehicle-mounted device generates a prompt message and plays voice based on the prompt message, so that the user can reissue the voice control command information.

[0122] Figure 2 This is a structural block diagram of an interface control selection device 200 for an in-vehicle device provided in the present application.

[0123] like Figure 2 As shown, the interface control selection device 200 of the vehicle-mounted device mainly includes:

[0124] The first acquisition module 201 is used to acquire the user's voice control command information;

[0125] A conversion module 202, used to convert the voice control instruction information into text information;

[0126] Extraction module 203, extracting control instruction information from text information;

[0127] The query module 204 is used to query whether there is an interface control matching the control instruction information in the interface control library; if so, the interface control matching the control instruction information is selected and the selected interface control is used as the target control to be selected;

[0128] The second acquisition module 205 is used to acquire the number of target controls to be selected;

[0129] The first click module 206 is used to select one of the target controls to be selected as the target control based on the selection strategy when the number is greater than 1, and click the target control;

[0130] The second clicking module 207 is used to directly select the target control to be selected as the target control and click the target control when the number is equal to 1.

[0131] As an optional implementation of this embodiment, the first click module includes:

[0132] The information acquisition submodule is used to obtain the coordinate information and size information of each target control to be selected;

[0133] The relationship judgment submodule is used to determine whether multiple target controls to be selected have an inclusion relationship based on coordinate information and size information; if so, the target control to be selected with the smallest area is selected as the target control, otherwise the target control is determined based on the arbitration strategy.

[0134] In this optional embodiment, the relationship determination submodule is specifically used for:

[0135] Acquire the acquisition time of the voice control command information; determine the query time period based on the acquisition time; acquire the voice information to be processed corresponding to the query time period; query whether there is a feature word in the voice information to be processed; if so, select a target control to be selected as the target control based on the feature word.

[0136] In this optional embodiment, the relationship determination submodule is further specifically used for:

[0137] Get the current interface of the vehicle display screen; query whether there is a target control to be selected in the current interface; if so, use the target control to be selected as the target control.

[0138] In this optional embodiment, the relationship determination submodule is further specifically used for:

[0139] Obtain the user's historical operation information; query whether there is a target control to be selected in the historical operation information; if so, obtain the number of times each target control to be selected is used and the usage time; determine the user's usage habits based on the number of times and the usage time; select a target control to be selected as the target control based on the usage habits.

[0140] As an optional implementation of this embodiment, the interface control selection device 200 of the vehicle-mounted device further includes:

[0141] A control acquisition module, used to acquire all target controls to be selected when the target control cannot be determined based on the arbitration strategy;

[0142] A numbering module is used to number each target control to be selected;

[0143] A generation module, used for generating a selection interface based on the target control to be selected and the number corresponding to the target control to be selected;

[0144] The display module is used to display the selection interface.

[0145] As an optional implementation of this embodiment, the interface control selection device 200 of the vehicle-mounted device further includes:

[0146] A voice acquisition module, used to acquire the user's selection voice information on the selection interface after the selection interface is displayed;

[0147] A number determination module, used to determine the number based on the selected voice information;

[0148] The control selection module is used to select the target control to be selected based on the number.

[0149] As a module, it is used to take the selected target control as the target control.

[0150] The functional modules in the embodiments of the present application can be integrated together to form an independent part, or each module can exist separately, or two or more modules can be integrated to form an independent part. If the function is implemented in the form of a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes a number of instructions for enabling an electronic device (which can be a personal computer, a server or a network device, etc.) to execute all or part of the steps of an interface control selection method for a vehicle-mounted device in each embodiment of the present application.

[0151] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and modules described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0152] Figure 3 This is a structural block diagram of a vehicle-mounted device 300 provided in an embodiment of the present application. Figure 3 As shown, the electronic device 300 includes a memory 301, a processor 302 and a communication bus 303; the memory 301 and the processor 302 are connected via the communication bus 303. The memory 301 stores a method for selecting an interface control of a vehicle-mounted device provided in the above embodiment, which can be loaded and executed by the processor 302.

[0153] The memory 301 may be used to store instructions, programs, codes, code sets or instruction sets. The memory 301 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function, and instructions for implementing an interface control selection method for a vehicle-mounted device provided in the above embodiment, etc.; the data storage area may store data involved in the interface control selection method for a vehicle-mounted device provided in the above embodiment, etc.

[0154] The processor 302 may include one or more processing cores. The processor 302 executes various functions and processes data of the present application by running or executing instructions, programs, code sets or instruction sets stored in the memory 301, calling the data stored in the memory 301. The processor 302 may be at least one of an application-specific integrated circuit (ASIC), a digital signal processor (DSP), a digital signal processing device (DSPD), a programmable logic device (PLD), a field programmable gate array (FPGA), a central processing unit (CPU), a controller, a microcontroller and a microprocessor. It is understandable that for different devices, the electronic device used to implement the above-mentioned processor 302 function may also be other, and the embodiment of the present application is not specifically limited.

[0155] The communication bus 303 may include a path to transmit information between the above components. The communication bus 303 may be a PCI (Peripheral Component Interconnect) bus or an EISA (Extended Industry Standard Architecture) bus. The communication bus 303 may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 3 Only one double arrow is used in the diagram, but this does not mean that there is only one bus or only one type of bus.

[0156] An embodiment of the present application provides a computer-readable storage medium storing a computer program that can be loaded by a processor and executes a method for selecting an interface control of a vehicle-mounted device as provided in the above embodiment.

[0157] In this embodiment, the computer-readable storage medium may be a tangible device that holds and stores instructions used by the instruction execution device. The computer-readable storage medium may be, but is not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any combination thereof. Specifically, the computer-readable storage medium may be a portable computer disk, a hard disk, a USB flash drive, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a podium random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, an optical disk, a magnetic disk, a mechanical encoding device, and any combination thereof.

[0158] The terms "comprises," "comprising," or any other variations thereof are intended to cover non-exclusive inclusion such that a process, method, article, or apparatus that includes a list of elements includes not only those elements but also other elements not expressly listed, or also includes elements inherent to such process, method, article, or apparatus.

[0159] The above description is only a preferred embodiment of the present application and an explanation of the technical principles used. Those skilled in the art should understand that the scope of application involved in the present application is not limited to the technical solution formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the aforementioned application concept. For example, the above features are replaced with (but not limited to) technical features with similar functions applied in the present application.

Claims

1. A method for selecting an interface control of an in-vehicle device, characterized in that: include: Obtain user's voice control command information; Converting the voice control instruction information into text information; Extracting control instruction information from the text information; Querying an interface control library to determine whether there is an interface control that matches the control instruction information; If it exists, then select the interface control that matches the control instruction information, and use the selected interface control as the target control to be selected; Get the number of target controls to be selected; When the number is greater than 1, one of the target controls to be selected is selected as the target control based on the selection strategy, and the target control is clicked; When the number is equal to 1, the target control to be selected is directly used as the target control, and the target control is clicked.

2. The method according to claim 1, characterized in that The step of selecting one of the target controls to be selected as the target control based on the selection strategy includes: Obtaining coordinate information and size information of each target control to be selected; Determine whether there is an inclusion relationship between the plurality of target controls to be selected based on the coordinate information and the size information; If so, the target control to be selected with the smallest area is selected as the target control; otherwise, the target control is determined based on an arbitration strategy.

3. The method according to claim 2, characterized in that The determining the target control based on the arbitration strategy includes: Acquiring the time of acquiring the voice control instruction information; Determine a query time period based on the acquisition time; Obtaining the voice information to be processed corresponding to the query time period; Query whether there is a characteristic word in the voice information to be processed; If so, a target control to be selected is selected as the target control based on the feature word.

4. The method according to claim 2, characterized in that: The determining the target control based on the arbitration strategy includes: Get the current interface of the vehicle display; Query whether the target control to be selected exists in the current interface; If so, the target control to be selected is used as the target control.

5. The method according to claim 2, characterized in that: The determining the target control based on the arbitration strategy includes: Get the user's historical operation information; Querying whether the target control to be selected exists in the historical operation information; If yes, then obtaining the usage count and usage time of each of the target controls to be selected; Determine the user's usage habits based on the usage times and usage time; A target control to be selected is selected as the target control based on the usage habit.

6. The method according to claim 2, characterized in that When the target control cannot be determined based on the arbitration strategy, the method further includes: Obtain all the target controls to be selected; Numbering each of the target controls to be selected; Generate a selection interface based on the target control to be selected and the number corresponding to the target control to be selected; The selection interface is displayed.

7. The method according to claim 6, characterized in that After displaying the selection interface, the method further includes: Acquire the user's selection voice information on the selection interface; Determining a number based on the selected voice information; Select the target control to be selected based on the number; The selected target control is used as the target control.

8. An interface control selection device for an in-vehicle device, characterized in that: include: A first acquisition module, used to acquire the user's voice control command information; A conversion module, used to convert the voice control instruction information into text information; An extraction module, used to extract control instruction information from the text information; A query module, used to query whether there is an interface control matching the control instruction information in the interface control library; if so, select the interface control matching the control instruction information and use the selected interface control as the target control to be selected; The second acquisition module is used to obtain the number of target controls to be selected; A first clicking module is used for selecting one of the target controls to be selected as a target control based on a selection strategy when the number is greater than 1, and clicking the target control; The second clicking module is used for directly taking the target control to be selected as the target control and clicking the target control when the number is equal to 1.

9. A vehicle-mounted device, characterized in that: comprising a processor and a memory, wherein the processor is coupled to the memory; The processor is configured to execute a computer program stored in the memory, so that the electronic device executes the method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The method comprises a computer program or an instruction, which, when executed on a computer, causes the computer to execute the method according to any one of claims 1 to 7.

Images