Application control method and apparatus based on speech recognition, and electronic device, medium and vehicle

By using voice recognition technology to enable application flow between mobile terminals and vehicle-mounted systems, the problem of low application flow efficiency in the context of mobile-vehicle interconnection is solved, the ease of operation and user experience are improved, and the intelligent development of vehicle-mounted systems is promoted.

WO2025251477A1PCT designated stage Publication Date: 2025-12-11CHINA FAW CO LTD
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/123527
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-06-03
Filing Date
2024-10-09
Publication Date
2025-12-11

AI Technical Summary

Technical Problem

In the context of vehicle-to-vehicle connectivity, users need to manually transfer smart terminal applications to the vehicle's infotainment system, resulting in low application transfer efficiency and complex operation, which is detrimental to the development of intelligent vehicle infotainment systems.

Method used

Through voice recognition technology, the mobile terminal acquires the user's voice information, parses the voice commands, calls the target terminal application interface, transmits application data to the vehicle terminal, and performs data analysis and application flow through the vehicle terminal. Finally, the vehicle terminal application executes functions through voice signals.

Benefits of technology

It improved application flow efficiency, simplified operation processes, enhanced user experience, and promoted the intelligent development of in-vehicle systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024123527_11122025_PF_FP_ABST
    Figure CN2024123527_11122025_PF_FP_ABST
Patent Text Reader

Abstract

An application control method and apparatus based on speech recognition, and an electronic device, a storage medium and a vehicle. The method comprises: in response to a speech control operation performed by a user, acquiring user speech information by means of a mobile terminal, and parsing the user speech information to obtain a first speech instruction (S101); on the basis of the first speech instruction, invoking a target terminal application interface by means of the mobile terminal, so as to obtain target application data (S102); transmitting the target application data from the mobile terminal to a head unit end (S103); performing application continuation by means of the head unit end, performing data analysis on the target application data, and transmitting the target application data to a corresponding target head unit end application (S104); and acquiring a user speech signal by means of the head unit end, and on the basis of the user speech signal, controlling the target head unit end application to execute a corresponding application function (S105). By means of the method, user speech can be recognized, such that application continuation is implemented between a mobile terminal and a head unit end, and an application is controlled by speech, thereby improving the application control efficiency.
Need to check novelty before this filing date? Find Prior Art

Description

Application control method and device based on voice recognition, electronic device, medium and vehicle TECHNICAL FIELD

[0001] The present application relates to the technical field of intelligent control of car machines, and in particular to an application control method and device based on voice recognition, an electronic device, a medium and a vehicle. BACKGROUND

[0002] At present, interconnection between intelligent terminals and car machines is a major trend in the development of intelligent cockpits. Devices can complement each other, and applications from intelligent terminals can enrich the ecology of automobiles.

[0003] In the hand-car interconnection scenario, commonly used applications such as navigation, music, video, and schedules still need to be manually operated by the user in a relatively cumbersome manner to transfer the application to the car machine end for continued use, resulting in low application transfer efficiency and complex operation, which is not conducive to the intelligent development of car machines.

[0004] SUMMARY

[0005] To solve at least one of the above technical problems in the related art, the embodiments of the present application propose an application control method and device based on voice control, an electronic device, a medium and a vehicle, which can realize application transfer through voice control and improve application transfer efficiency.

[0006] In one aspect, the embodiments of the present application propose an application control method based on voice recognition, which comprises the following steps:

[0007] In response to a voice control operation of a user, a mobile terminal obtains user voice information, analyzes the user voice information, and obtains a first voice instruction;

[0008] According to the first voice instruction, the mobile terminal calls a target terminal application interface to obtain target application data;

[0009] The target application data is transmitted from the mobile terminal to a car machine end;

[0010] The car machine end performs application transfer, data analysis of the target application data, and transmission of the target application data to a corresponding target car machine end application;

[0011] The car machine end obtains user voice signals, and controls the target car machine end application to execute corresponding application functions according to the user voice signals.

[0012] In some embodiments, the method further comprises the steps of:

[0013] establish a communication channel, and utilize the communication channel for data transmission between the vehicle terminal and the mobile terminal.

[0014] In some embodiments, before the step of performing application flow switching by the vehicle terminal, performing data analysis on the target application data, and transmitting the target application data to a corresponding target vehicle terminal application, the method further comprises:

[0015] obtaining a plurality of terminal applications in the mobile terminal;

[0016] obtaining a plurality of vehicle terminal applications in the vehicle terminal;

[0017] For each terminal application, performing application interconnection matching to determine the vehicle terminal application matched with the terminal application, and establishing an interconnection protocol between the terminal application and the vehicle terminal application.

[0018] In some embodiments, the step of performing application flow switching by the vehicle terminal, performing data analysis on the target application data, and transmitting the target application data to a corresponding target vehicle terminal application specifically comprises:

[0019] performing data analysis by the vehicle terminal according to the target application data to determine a target terminal application corresponding to the target application data from a plurality of terminal applications;

[0020] determining, by the vehicle terminal, a target vehicle terminal application matched with the target terminal application from a plurality of vehicle terminal applications, and transmitting the target application data to the target vehicle terminal application, wherein an interconnection protocol has been established between the target terminal application and the target vehicle terminal application.

[0021] In some embodiments, the step of obtaining a user voice signal by the vehicle terminal and controlling the target vehicle terminal application to perform a corresponding application function according to the user voice signal specifically comprises:

[0022] transmitting the user voice signal from the vehicle terminal to the mobile terminal;

[0023] analyzing the user voice signal by the mobile terminal to obtain a second voice instruction;

[0024] According to the second voice instruction, calling the target terminal application interface by the mobile terminal to obtain a corresponding instruction data stream;

[0025] transmitting the instruction data stream from the mobile terminal to the vehicle terminal;

[0026] The instruction data stream is transmitted to the target vehicle terminal application through the vehicle terminal, and the target vehicle terminal application is controlled to execute corresponding application functions.

[0027] In some embodiments, the target terminal application interface is called through the mobile terminal according to the first voice instruction, and target application data is obtained, specifically including:

[0028] The first voice instruction is analyzed through the mobile terminal, and the target terminal application corresponding to the first voice instruction is determined from a plurality of terminal applications.

[0029] The target terminal application interface is called through the mobile terminal, and the target application data is obtained from the target terminal application.

[0030] In some embodiments, after the step of performing application flow conversion through the vehicle terminal, performing data analysis on the target application data, and transmitting the target application data to the corresponding target vehicle terminal application, the method further comprises:

[0031] Stopping responding to the user's voice control operation on the target terminal application through the mobile terminal.

[0032] In some embodiments, the target terminal application interface is called through the mobile terminal according to the second voice instruction, and corresponding instruction data stream is obtained, specifically including:

[0033] The second voice instruction is analyzed through the mobile terminal to generate a corresponding control instruction.

[0034] The target terminal application interface is called through the mobile terminal, and the target terminal application generates corresponding instruction data stream according to the control instruction.

[0035] In another aspect, the embodiments of the present application propose an application control device based on voice recognition, the device comprises:

[0036] The first module is used for obtaining user voice information through a mobile terminal in response to a user's voice control operation, analyzing the user voice information, and obtaining a first voice instruction.

[0037] The second module is used for calling a target terminal application interface through the mobile terminal according to the first voice instruction, and obtaining target application data.

[0038] The third module is used for transmitting the target application data from the mobile terminal to a vehicle terminal.

[0039] a fourth module configured to perform application flow conversion through the vehicle machine end, perform data analysis on the target application data, and transmit the target application data to a corresponding target vehicle machine end application;

[0040] a fifth module configured to acquire a user voice signal through the vehicle machine end and control the target vehicle machine end application to perform a corresponding application function according to the user voice signal.

[0041] In another aspect, an electronic device is provided, which includes a memory and a processor. The memory stores a computer program. The processor implements the application control method described above when executing the computer program.

[0042] In another aspect, a computer readable storage medium is provided, which stores a computer program. The computer program is executed by a processor to implement the application control method described above.

[0043] In yet another aspect, a vehicle is provided, which includes the application control device or the electronic device described above.

[0044] The application provides an application control method and device based on voice recognition, an electronic device, a computer readable storage medium, and a vehicle. The application control method and device based on voice recognition acquire user voice information through a mobile terminal, generate a first voice instruction according to the user voice information, call a target terminal application interface according to the first voice instruction, obtain target application data, perform application flow conversion through a vehicle machine end, perform data analysis on the target application data, transmit the target application data to a corresponding target vehicle machine end application, acquire a user voice signal through the vehicle machine end, and control the target vehicle machine end application to perform a corresponding application function according to the user voice signal. The application can recognize user voice information, implement application flow conversion between a mobile terminal and a vehicle machine end, improve application flow conversion efficiency, control applications through voice, improve application control efficiency, improve the convenience of using applications in a vehicle-terminal interconnection scenario, improve user experience, and facilitate the intelligent development of vehicles and terminals. BRIEF DESCRIPTION OF DRAWINGS

[0045] FIG. 1 is a flowchart of an application control method based on voice recognition according to an embodiment of the application;

[0046] FIG. 2 is a flowchart of step S102 according to an embodiment of the application;

[0047] FIG. 3 is another flowchart of an application control method based on voice recognition according to an embodiment of the application;

[0048] FIG. 4 is a schematic diagram of establishing an interconnection protocol between a terminal application and a vehicle machine end application according to an embodiment of the application;

[0049] Fig. 5 is a flow chart of step S104 in the embodiment of the present application;

[0050] Fig. 6 is a flow chart of step S105 in the embodiment of the present application;

[0051] Fig. 7 is a flow chart of step S503 in the embodiment of the present application;

[0052] Fig. 8 is a schematic diagram of the interaction between the mobile terminal and the vehicle terminal in the embodiment of the present application;

[0053] Fig. 9 is a structural schematic diagram of an application control device based on voice recognition provided in the embodiment of the present application;

[0054] Fig. 10 is a hardware structural schematic diagram of an electronic device provided in the embodiment of the present application. DETAILED DESCRIPTION

[0055] In order to make the purpose, technical solutions and advantages of the present application more clear, the present application is further described in detail below in combination with the drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application, and are not used to limit the present application.

[0056] It should be noted that although the functional modules are divided in the device schematic diagram, and the logical order is shown in the flow chart, in some cases, the steps shown or described can be executed in a manner different from the module division in the device or the order in the flow chart. The terms "first", "second", etc. in the description and claims and the above drawings are used to distinguish similar objects, and do not necessarily describe a specific order or sequence.

[0057] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the present application belongs. The terms used herein are only for the purpose of describing the embodiments of the present application, and are not intended to limit the present application.

[0058] First, the terms involved in the present application are analyzed:

[0059] Local area network: a private network, a local area network is a regional network formed in a local area, and its characteristic is that the distribution area range is limited, which can be large or small, as large as the connection between a building and adjacent buildings, and as small as the contact between offices. The local area network itself has faster transmission speed, more stable performance, simple framework, and is closed, which is the reason why many institutions choose it. The composition of the local area network itself is generally composed of three parts of computer equipment, network connection equipment and network transmission medium, among which the computer equipment includes servers and workstations, the network connection equipment includes network cards, hubs and switches, and the network transmission medium is simply a network cable, which is composed of three major components of coaxial cable, twisted pair cable and optical cable.

[0060] Instruction flow: refers to the flow of information involved in the operation process, used to control transmission, reading and writing, and various operations.

[0061] Data flow: data flow describes the path of data from one processing unit (such as an input device) through a series of processing or conversion to another processing unit (such as an output device) in an information system. Data flow can be divided into three types: input data flow, processing data flow and output data flow. Input data flow is the data flow from the external environment or other systems into the information system, processing data flow is the data flow processed in the information system, and output data flow is the data flow from the information system to the external environment or other systems.

[0062] The present application can be used in many general or special computer system environments or configurations. For example: car terminal, server computer, tablet device, multi-processor system, microprocessor-based system, network PC, small computer, large computer, distributed computing environment including any of the above systems or devices, etc. The present application can be described in the general context of computer-executable instructions executed by a computer, such as program modules. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform specific tasks or implement specific abstract data types. The present application can also be practiced in a distributed computing environment, in which tasks are performed by remote processing devices connected by a communication network. In a distributed computing environment, program modules can be located in local and remote computer storage media, including storage devices.

[0063] It should be noted that in each specific embodiment of the present application, when it is necessary to process data related to the identity or characteristics of the user, such as user information, user behavior data, user history data and user location information, the user's permission or consent will be obtained first, and the collection, use and processing of these data will comply with relevant laws, regulations and standards. In addition, when the embodiments of the present application need to obtain sensitive personal information of the user, the separate permission or separate consent of the user will be obtained through a pop-up window or a jump to a confirmation page, and after obtaining the separate permission or separate consent of the user, the necessary user-related data for the normal operation of the embodiments of the present application will be obtained.

[0064] The voice assistant of the intelligent cockpit can basically achieve accurate recognition of user intent and help users complete basic control instructions. However, in terms of providing users with all-round intelligent interaction experience, the voice assistant still has room for improvement. At present, the interconnection between intelligent terminal and car machine is a major trend in the development of intelligent cockpit. The devices can complement each other's advantages, and applications from intelligent terminal can also enrich the ecology of the car.

[0065] In the handcart interconnection scene, the user commonly used applications such as navigation, music, video, schedule, etc. still need to be manually operated more cumbersome, in order to flow to the application to the car machine end to continue to use, resulting in low application flow efficiency, and complex operation, not conducive to the intelligent development of car machine.

[0066] Referring to FIG. 1, FIG. 1 is an optional flowchart of an application control method based on voice recognition provided by an embodiment of the present application. The method can include, but is not limited to, steps S101 to S105:

[0067] Step S101, in response to the user's voice control operation, obtaining user voice information through the mobile terminal, analyzing the user voice information, and obtaining the first voice instruction;

[0068] Step S102, according to the first voice instruction, calling the target terminal application interface through the mobile terminal, and obtaining the target application data;

[0069] Step S103, transmitting the target application data from the mobile terminal to the car machine end;

[0070] Step S104, through the car machine end, the application flow is transferred, the target application data is analyzed, and the target application data is transmitted to the corresponding target car machine end application;

[0071] Step S105, obtaining the user voice signal through the car machine end, and controlling the target car machine end application to execute the corresponding application function according to the user voice signal.

[0072] In step S101 of some embodiments, the mobile terminal starts the voice recognition function, receives the user voice information, analyzes the user voice information, and obtains the first voice instruction. Optionally, when the user needs to transfer the navigation application in the mobile terminal to the car machine end, the user can issue a voice: "display navigation on the car machine" or "play music on the car machine", etc. The mobile terminal recognizes the voice issued by the user, obtains the corresponding user voice information, and then analyzes it to obtain the first voice instruction.

[0073] In some embodiments, a communication channel is established, and the communication channel is used for data transmission between the car machine end and the mobile terminal. Optionally, the mobile terminal and the car machine end are connected through wireless connection or physical cable connection, etc. So that the mobile terminal and the car machine end are in the same local area network, and the mobile terminal and the car machine end can use the local area network for data transmission.

[0074] In some embodiments, referring to FIG. 2, FIG. 2 is an optional flowchart of step S102 in an embodiment of the present application. Step S102 can include, but is not limited to, steps S201 to S202:

[0075] In step S201, the first voice instruction is parsed by the mobile terminal to determine a target terminal application corresponding to the first voice instruction from a plurality of terminal applications.

[0076] In step S202, a target application interface is called by the mobile terminal to obtain target application data from the target terminal application.

[0077] In some embodiments, the mobile terminal parses the first voice instruction to obtain corresponding user voice content, calls a corresponding application interface according to the user voice content, obtains an application data stream through the application interface, transmits the application data stream to the vehicle terminal, analyzes the application data stream after the vehicle terminal receives the application data stream, and sends the application data stream to a corresponding vehicle terminal application to complete the cross-device application flow.

[0078] For example, the first voice instruction is to display navigation on the vehicle terminal. According to the first voice instruction, a plurality of terminal applications are searched, a terminal application used for navigation is determined as a target terminal application corresponding to the first voice instruction, a target terminal application interface provided by the target terminal application is called, and target application data, i.e., all application data of the navigation application, including historical navigation records, personal application settings, navigation location labels, and navigation modes, is obtained from the target terminal application through the target terminal application interface.

[0079] In some embodiments, referring to FIG. 3, which is another optional flowchart of the application control method based on voice recognition provided by the embodiments of the present application, before step S104 is performed, the application control method can further include, but is not limited to, steps S301 to S303:

[0080] In step S301, a plurality of terminal applications in the mobile terminal are obtained.

[0081] In step S302, a plurality of vehicle terminal applications in the vehicle terminal are obtained.

[0082] In step S303, for each terminal application, an application interconnection matching is performed to determine a vehicle terminal application matched with the terminal application and establish an interconnection protocol between the terminal application and the vehicle terminal application.

[0083] In some embodiments, the mobile terminal and the vehicle terminal are in the same local area network. For each terminal application, the terminal application and the vehicle terminal application are matched to establish an interconnection protocol. After the interconnection protocol is established between the applications, the applications can transmit data to each other. Optionally, the terminal application is a music playing application, a vehicle terminal application used for playing music in the vehicle terminal is interconnected with the terminal application to establish an interconnection protocol.

[0084] Referring to FIG. 4, FIG. 4 is an optional schematic diagram of establishing an interconnection protocol between a terminal application and a vehicle terminal application in an embodiment of the present application. The mobile terminal includes terminal applications A to D, and the vehicle terminal application includes vehicle terminal applications 1 to 4. The application interconnection matching is performed. It is assumed that the terminal application A matches the vehicle terminal application 1, the interconnection protocol 1 between the terminal application A and the vehicle terminal application 1 is established, the terminal application B matches the vehicle terminal application 2, the interconnection protocol 2 between the terminal application B and the vehicle terminal application 2 is established, the terminal application C matches the vehicle terminal application 3, the interconnection protocol 3 between the terminal application C and the vehicle terminal application 3 is established, the terminal application D matches the vehicle terminal application 4, the interconnection protocol 4 between the terminal application D and the vehicle terminal application 4 is established, and so on.

[0085] In some embodiments, referring to FIG. 5, FIG. 5 is an optional flowchart of step S104 in an embodiment of the present application. Step S104 can include, but is not limited to, steps S401 to S402.

[0086] In step S401, the vehicle terminal performs data analysis according to the target application data, and determines a target terminal application corresponding to the target application data from a plurality of terminal applications.

[0087] In step S402, the vehicle terminal determines a target vehicle terminal application matching the target terminal application from a plurality of vehicle terminal applications, and transmits the target application data to the target vehicle terminal application. The target terminal application and the target vehicle terminal application have established an interconnection protocol.

[0088] In some embodiments, the target application data can include, but is not limited to, user behavior data, device information, system logs, business data, product-related data, application configuration data, application content data, etc. According to the target application data, data analysis is performed to determine the corresponding target terminal application, and the target application data is transmitted to the target vehicle terminal application which has established an interconnection protocol with the target terminal application.

[0089] In some embodiments, after step S104 is performed, the target application data corresponding to the target terminal application has been completely transmitted to the target vehicle terminal application, indicating that the application flow is completed. When the application flow is completed, the mobile terminal stops responding to the user's voice control operation of the target terminal application. At this time, the target vehicle terminal application opens the voice receiving function, and responds to the user's voice output operation through the target vehicle terminal application to obtain the user's voice signal, i.e., the user's voice audio.

[0090] In step S105 of some embodiments, the user voice signal of the user control application such as "stop navigation", "play the next song", "pause playing", "delete schedule" and the like is acquired by the car machine end, the corresponding user voice signal is transmitted to the mobile terminal, the mobile terminal receives the user voice signal and analyzes the user voice signal, the corresponding target terminal application is called through the application interface, the corresponding instruction data stream is generated by using the target terminal application, the instruction data stream is transmitted back to the car machine end, and the target car machine end application is controlled to execute the application function corresponding to the user voice signal.

[0091] In some embodiments, referring to FIG. 6, FIG. 6 is an optional flowchart of step S105 in the embodiments of the present application, and step S105 can include but is not limited to steps S501 to S505:

[0092] Step S501, the user voice signal is transmitted from the car machine end to the mobile terminal;

[0093] Step S502, the user voice signal is analyzed by the mobile terminal to obtain a second voice instruction;

[0094] Step S503, according to the second voice instruction, the target terminal application interface is called by the mobile terminal to obtain the corresponding instruction data stream;

[0095] Step S504, the instruction data stream is transmitted from the mobile terminal to the car machine end;

[0096] Step S505, the instruction data stream is transmitted to the target car machine end application by the car machine end to control the target car machine end application to execute the corresponding application function.

[0097] In some embodiments, after the car machine end acquires the user voice signal, the user voice signal is transmitted to the mobile terminal through the communication channel, the second voice instruction is obtained by voice recognition by the mobile terminal, the corresponding target terminal application interface is called by the second voice instruction, the corresponding instruction data stream is generated, the instruction data stream is transmitted back to the target car machine end application, and the target car machine end application is controlled to execute the application function.

[0098] Optionally, the target car machine end application is a car machine end music playing application, the user outputs the voice, the user voice signal is transmitted to the mobile terminal for analysis after being acquired, the second voice instruction is "play song XXX" or "play the current song in a loop", the application interface of the music playing application in the mobile terminal is called according to the second voice instruction, the instruction data stream is generated by the music playing application according to the second voice instruction, the instruction data stream is transmitted back to the car machine end music playing application, and the corresponding application function is executed by the car machine end music playing application to play song XXX or play the current song in a loop in the car machine end.

[0099] In some embodiments, referring to FIG. 7, FIG. 7 is an optional flowchart of step S503 in the embodiments of the present application, and step S503 can include but is not limited to steps S601-S602:

[0100] In step S601, the second voice instruction is parsed by the mobile terminal to generate a corresponding control instruction.

[0101] In step S602, the target terminal application interface is called by the mobile terminal to generate a corresponding instruction data stream according to the control instruction by using the target terminal application.

[0102] In some embodiments, the target terminal application executes an application function corresponding to the second voice instruction according to the control instruction, and generates a corresponding instruction data stream in the process of executing the application function, wherein the instruction data stream includes an instruction stream and a data stream for implementing the application function.

[0103] Referring to FIG. 8, FIG. 8 is an optional schematic diagram of the interaction between the mobile terminal and the vehicle terminal in the embodiments of the present application, wherein the mobile terminal includes a voice recognition module, an application interface calling module and a terminal application module, the voice recognition module is used to receive a user voice signal, analyze and recognize the user voice signal, and generate a user voice instruction, the application interface calling module is used to call a corresponding application interface according to the user voice instruction, and the terminal application module is used to store terminal application data and transmit the terminal application data to the vehicle terminal, the vehicle terminal includes a voice acquisition module, a data analysis module and a vehicle terminal application module, the voice acquisition module is used to acquire a user voice signal and transmit the user voice signal to the voice recognition module in the mobile terminal, the data analysis module is used to receive terminal application data or instruction data stream transmitted by the mobile terminal, analyze the terminal application data or instruction data stream, and transmit the terminal application data or instruction data stream to a corresponding vehicle terminal application, and the vehicle terminal application module is used to store a plurality of vehicle terminal applications and application data corresponding to each vehicle terminal application.

[0104] Referring to FIG. 9, FIG. 9 is an optional structural schematic diagram of an application control device based on voice recognition provided by the embodiments of the present application, which can be used to implement the above-mentioned application control method, and the device can include:

[0105] The first module is configured to acquire user voice information by the mobile terminal in response to a voice control operation of the user, analyze the user voice information, and obtain a first voice instruction.

[0106] The second module is configured to call a target terminal application interface by the mobile terminal according to the first voice instruction, and obtain target application data.

[0107] The third module is configured to transmit the target application data from the mobile terminal to the vehicle terminal.

[0108] The fourth module is configured to perform application flow conversion through the vehicle terminal, perform data analysis on the target application data, and transmit the target application data to the corresponding target vehicle terminal application.

[0109] The fifth module is configured to acquire a user voice signal through the vehicle terminal, and control the target vehicle terminal application to perform a corresponding application function according to the user voice signal.

[0110] The specific implementation of the application control device is basically the same as the specific embodiment of the application control method described above, and will not be repeated here.

[0111] The embodiments of the present application also provide an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor implements the application control method when executing the computer program. The electronic device can be any intelligent terminal, such as a tablet computer or a vehicle-mounted computer.

[0112] Please refer to FIG. 10, which shows the hardware structure of the electronic device of another embodiment. The electronic device includes:

[0113] The processor 901 can be implemented in the form of a general-purpose CPU (Central Processing Unit), a microprocessor, an ASIC (Application Specific Integrated Circuit), or one or more integrated circuits, and is used to execute related programs to implement the technical solutions provided by the embodiments of the present application.

[0114] The memory 902 can be implemented in the form of a ROM (ReadOnly Memory), a static storage device, a dynamic storage device, or a RAM (Random Access Memory). The memory 902 can store an operating system and other application programs. When the technical solutions provided by the embodiments of the present application are implemented by software or firmware, the related program codes are stored in the memory 902 and are called and executed by the processor 901 to implement the application control method of the embodiments of the present application.

[0115] The input / output interface 903 is used to realize information input and output.

[0116] The communication interface 904 is used to realize the communication interaction between the device and other devices. The communication can be realized by a wired manner (such as USB, network cable, etc.) or a wireless manner (such as mobile network, WIFI, Bluetooth, etc.).

[0117] The bus 905 transmits information between various components (such as the processor 901, the memory 902, the input / output interface 903, and the communication interface 904) of the device.

[0118] The processor 901, the memory 902, the input / output interface 903 and the communication interface 904 are communicatively connected with each other through the bus 905.

[0119] The application embodiment further provides a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the application control method.

[0120] The memory, as a non-transitory computer readable storage medium, can be used to store non-transitory software programs and non-transitory computer executable programs. In addition, the memory can include a high-speed random access memory, and can also include a non-transitory memory, such as at least one magnetic disk storage device, a flash memory device, or other non-transitory solid-state memory device. In some embodiments, the memory can optionally include a memory remotely arranged relative to the processor, and these remote memories can be connected to the processor through a network. Examples of the above network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and a combination thereof.

[0121] The application embodiment further provides a vehicle, which includes the electric drive assembly of the above application control device or electronic device. Specifically, the vehicle can be a private car, such as a sedan, an SUV, an MPV, a pickup truck, or the like. The vehicle can also be an operating vehicle, such as a van, a bus, a small truck, or a large trailer, etc. The vehicle can be a gasoline car or a new energy car. When the vehicle is a new energy car, it can be a hybrid car or a pure electric car.

[0122] The application embodiment provides an application control method and device based on voice recognition, an electronic device, a medium and a vehicle. The method includes obtaining user voice information through a mobile terminal, generating a first voice instruction according to the user voice information, calling a target terminal application interface according to the first voice instruction, obtaining target application data, performing application flow through a vehicle terminal, performing data analysis on the target application data, transmitting the target application data to a corresponding target vehicle terminal application, obtaining user voice signals through the vehicle terminal, and controlling the target vehicle terminal application to execute corresponding application functions according to the user voice signals. The application can recognize user voice information, realize application flow between the mobile terminal and the vehicle terminal, improve application flow efficiency, control the application through voice, improve application control efficiency, improve the convenience of users using the application in the hand-car interconnection scene, and improve user experience, which is conducive to the intelligent development of the vehicle terminal.

[0123] The embodiments described in the specification are for more clearly illustrating the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided by the embodiments of the present application. Those skilled in the art can know that, with the evolution of technology and the appearance of new application scenarios, the technical solutions provided by the embodiments of the present application are also applicable to similar technical problems.

[0124] Those skilled in the art can understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and can include more or fewer steps than shown in the figures, or combine certain steps, or different steps.

[0125] The device embodiments described above are only schematic, and the units described as separate components can or can not be physically separate, that is, can be located in one place, or can be distributed on multiple network units. Part or all of the modules can be selected according to actual needs to achieve the purpose of the embodiments of the present application.

[0126] Those skilled in the art can understand that all or some of the steps in the above disclosed method, the functional modules / units in the system and the device can be implemented as software, firmware, hardware and their appropriate combinations.

[0127] The terms "first", "second", "third", "fourth" and the like (if any) in the specification of the present application and the above-described drawings are used to distinguish similar objects, and do not necessarily have to be used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units does not have to be limited to those steps or units clearly listed, but can include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0128] It should be understood that, in the application, "at least one" refers to one or more, and "multiple" refers to two or more. "And / or" is used to describe the association relationship of the associated objects, which means that there can be three relationships, for example, "A and / or B" can represent three cases of only A, only B, and A and B existing at the same time, wherein A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects before and after it. "At least one of the following" or similar expressions means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b or c can represent a, b, c, "a and b", "a and c", "b and c", or "a and b and c", wherein a, b, and c can be single or multiple.

[0129] In several embodiments provided in the application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of the above units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the displayed or discussed mutual ones can be indirect coupling or communication connection through some interfaces, devices or units, and can be electrical, mechanical or other forms.

[0130] The units described above as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on multiple network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment scheme.

[0131] In addition, each functional unit in each embodiment of the application can be integrated in one processing unit, or each unit can exist physically, or two or more units can be integrated in one unit. The integrated unit can be realized in the form of hardware or in the form of a software functional unit.

[0132] It should be appreciated that embodiments of the present application can be realized by either computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable storage medium. The methods can be implemented in a computer program using standard programming techniques, including non-transitory computer-readable storage media configured with a computer program to cause a computer to operate in a specific and predefined manner according to the methods described in the detailed embodiments and drawings. Each program can be implemented in a high level procedural or object oriented programming language to communicate with a computer system. However, the programs can be implemented in assembly or machine language, if desired. In any case, the language can be a compiled or interpreted language. Also, the programs can be able to run on standalone systems or in conjunction with other programs.

[0133] Further, the operations of the processes described herein can be performed in any suitable order unless otherwise indicated herein or otherwise clearly contradicted by context. The processes described herein (or variations and / or combinations thereof) can be performed under the control of one or more computer systems configured with executable instructions (e.g., computer programs, one or more computer programs, or one or more applications) to perform the processes, by hardware, or combinations thereof. The computer programs include processor-executable instructions that are stored in memory within the one or more computer systems.

[0134] Further, the methods can be implemented in any suitable type of computing platform operably connected to, including but not limited to, a personal computer, a mini-computer, a mainframe, a workstation, a network or distributed computing environment, a stand-alone or integrated computer platform, or in communication with a charged particle tool or other imaging device, and the like. Aspects of the present application can be implemented in machine readable code stored on a non-transitory storage medium or device, whether removable or integrated into a computing platform, such as a hard disk, an optically readable and / or writable storage medium, RAM, ROM, and the like, such that it can be read by a programmable computer to configure and operate the computer to perform the processes described herein when the storage medium or device is read by the computer. Further, the machine readable code, or portions thereof, can be transmitted over a wired or wireless network. The present application described herein includes these and other different types of non-transitory computer readable storage media when such media include instructions or programs that implement the steps described above in conjunction with a microprocessor or other data processor. The present application also includes the computer itself when programmed in accordance with the methods and techniques described herein.

[0135] The integrated unit, if implemented in the form of a software function unit and sold or used as an independent product, can be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the present application, essentially or in other words, the part that contributes to the prior art or the whole or part of the technical solutions can be embodied in the form of a software product. The computer software product is stored in a storage medium, and includes multiple instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods of the various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various program storage media.

[0136] The preferred embodiments of the embodiments of the present application are described above with reference to the accompanying drawings, and are not limited to the scope of the embodiments of the present application. Any modifications, equivalent replacements and improvements made by those skilled in the art without departing from the scope and essence of the embodiments of the present application shall be within the scope of the embodiments of the present application.

Claims

1. A voice recognition-based application control method, characterized by, The method comprises the following steps: In response to a user's voice control operation, a user voice information is acquired by a mobile terminal, the user voice information is analyzed to obtain a first voice instruction; According to the first voice instruction, a target terminal application interface is called by the mobile terminal to obtain target application data; The target application data is transmitted from the mobile terminal to a car terminal; An application flow is transferred by the car terminal, the target application data is analyzed, and the target application data is transmitted to a corresponding target car terminal application; A user voice signal is acquired by the car terminal, and the target car terminal application is controlled to execute a corresponding application function according to the user voice signal.

2. The application control method according to claim 1, wherein The method further comprises the following steps: A communication channel is established, and data transmission between the car terminal and the mobile terminal is performed by using the communication channel.

3. The application control method according to claim 1, wherein Before the step of transferring the application flow by the car terminal, analyzing the target application data, and transmitting the target application data to the corresponding target car terminal application, the method further comprises: A plurality of terminal applications in the mobile terminal are acquired; A plurality of car terminal applications in the car terminal are acquired; For each terminal application, an application interconnection matching is performed, the car terminal application matched with the terminal application is determined, and an interconnection protocol between the terminal application and the car terminal application is established.

4. The application control method according to claim 3, wherein The target application data is transmitted to the target car terminal application by the car terminal according to the target application data, and the target terminal application and the target car terminal application have established an interconnection protocol. The user voice signal is transmitted from the car terminal to the mobile terminal; The user voice signal is analyzed by the mobile terminal to obtain a second voice instruction; 5. The application control method according to Claim 4, wherein According to the second voice instruction, the target terminal application interface is called by the mobile terminal to obtain corresponding instruction data flow; The instruction data flow is transmitted from the mobile terminal to the car terminal; The instruction data flow is transmitted to the target car terminal application by the car terminal to control the target car terminal application to execute a corresponding application function. According to the first voice instruction, the target terminal application interface is called by the mobile terminal to obtain the target application data, specifically comprising: The first voice instruction is analyzed by the mobile terminal to determine the target terminal application corresponding to the first voice instruction from a plurality of terminal applications; ​ 6. The application control method according to Claim 4, wherein ​ ​ The target terminal application interface is called through the mobile terminal, and the target application data is obtained from the target terminal application.

7. The application control method according to claim 6, wherein After the step of performing application flow conversion through the vehicle terminal, performing data analysis on the target application data, and transmitting the target application data to a corresponding target vehicle terminal application, the method further comprises: Stopping responding to the user's voice control operation on the target terminal application through the mobile terminal.

8. The application control method according to Claim 5, wherein The target terminal application interface is called through the mobile terminal according to the second voice instruction, and corresponding instruction data flow is obtained, specifically comprising: The second voice instruction is parsed through the mobile terminal to generate corresponding control instructions; The target terminal application interface is called through the mobile terminal, and the target terminal application generates corresponding instruction data flow according to the control instructions.

9. A voice-recognition-based application control device, characterized by comprising: The device comprises: A first module for obtaining user voice information through a mobile terminal in response to a user's voice control operation, parsing the user voice information, and obtaining a first voice instruction; A second module for calling a target terminal application interface through the mobile terminal according to the first voice instruction, and obtaining target application data; A third module for transmitting the target application data from the mobile terminal to a vehicle terminal; A fourth module for performing application flow conversion through the vehicle terminal, performing data analysis on the target application data, and transmitting the target application data to a corresponding target vehicle terminal application; A fifth module for obtaining user voice signals through the vehicle terminal and controlling the target vehicle terminal application to execute corresponding application functions according to the user voice signals.

10. An electronic device, comprising: The electronic device comprises a memory and a processor, the memory stores a computer program, and the processor executes the computer program to realize the application control method of any one of claims 1 to 8.

11. A computer-readable storage medium storing a computer program, wherein the computer program comprises the following steps of: receiving a request for a resource from a client; determining whether the client is authorized to access the resource; and if the client is authorized to access the resource, providing the resource to the client. The computer program is executed by the processor to realize the application control method of any one of claims 1 to 8.

12. A vehicle characterized by comprising: The vehicle comprises the application control device of claim 9 or the electronic device of claim 10.

Citation Information

Patent Citations

  • A vehicle-mounted voice recognition control method and a vehicle-mounted voice recognition control system

    CN103617795A

  • Vehicle control method and system based on mobile terminal

    CN105491080A

  • Speech recognition method and system, and control method and system based on speech instruction

    CN111627435A

  • Human-computer interaction method, electronic equipment and system

    CN114255745A

  • Voice control method based on vehicle terminal and terminal, electronic equipment and storage medium

    CN116631405A