Electronic equipment control method and device, electronic equipment and storage medium

Abstract

The invention discloses a control method and device of electronic equipment, the electronic equipment and a storage medium, and belongs to the technical field of computers. The first information comprises operation intention information and operation information; and executing an operation corresponding to the operation information according to the operation intention information.

Description

Technical Field

[0001] The present application belongs to the field of computer technology, and specifically relates to a control method and device for an electronic device, an electronic device, and a storage medium. Background Art

[0002] With the rapid development of electronic devices, users can trigger electronic devices to perform corresponding operations according to user needs, such as information query or search operations, through input. For example, users can input the information to be searched in the form of voice or text in the application of the electronic device to trigger the electronic device to perform the corresponding search operation.

[0003] However, in the above process, the user is usually required to input complete information to be searched, and after the electronic device receives the user input, the operation performed by the electronic device may not meet the user's needs. Therefore, the efficiency of the electronic device in performing the operation is low. Summary of the invention

[0004] The purpose of the embodiments of the present application is to provide a control method and device for an electronic device, an electronic device, and a storage medium, which can improve the efficiency of executing operations of the electronic device.

[0005] In a first aspect, an embodiment of the present application provides a method for controlling an electronic device, which includes: receiving first information; the first information includes operation intention information and operation information; and executing an operation corresponding to the operation information according to the operation intention information.

[0006] In the second aspect, an embodiment of the present application provides a control device of an electronic device, which includes: a receiving module and an execution module; the receiving module is used to receive first information; the first information includes operation intention information and operation information; the execution module is used to execute the operation corresponding to the operation information according to the operation intention information received by the receiving module.

[0007] In a third aspect, an embodiment of the present application provides an electronic device, which includes a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0008] In a fourth aspect, an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run a program or instruction to implement the method described in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program / program product, which is stored in a storage medium and is executed by at least one processor to implement the method described in the first aspect.

[0011] In an embodiment of the present application, the electronic device may receive first information including operation intention information and operation information, and perform the operation corresponding to the operation information according to the operation intention information in the first information. In this solution, since the operation intention information can reflect the user's operation intention, that is, the user can directly input the operation intention information to indicate the user's operation requirements to the electronic device, and then the user can input the operation information so that the electronic device performs the operation that meets the user's operation requirements based on the operation information, the efficiency of the electronic device in performing the operation can be improved. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] Figure 1A It is one of the example schematic diagrams of an interactive interface with AI provided by the related technology;

[0013] Figure 1B This is the second example schematic diagram of an interactive interface with AI provided by the relevant technology;

[0014] Figure 1C This is the third example schematic diagram of an interactive interface with AI provided by the relevant technology;

[0015] Figure 2 This is one of the flow charts of a control method of an electronic device provided in an embodiment of the present application;

[0016] Figure 3 This is the second flowchart of a control method of an electronic device provided in an embodiment of the present application;

[0017] Figure 4A This is one of the example schematic diagrams of a desktop display information editing box provided in an embodiment of the present application;

[0018] Figure 4B This is a second example schematic diagram of a desktop display information editing box provided in an embodiment of the present application;

[0019] Figure 5A This is one of the example schematic diagrams of a desktop display operation intention symbol provided by an embodiment of the present application;

[0020] Figure 5BThis is a second example schematic diagram of a desktop display operation intention symbol provided by an embodiment of the present application;

[0021] Figure 5C This is a third example schematic diagram of a desktop display operation intention symbol provided by an embodiment of the present application;

[0022] Figure 5D This is a fourth example schematic diagram of a desktop display operation intention symbol provided by an embodiment of the present application;

[0023] Figure 5E This is a fifth example schematic diagram of a desktop display operation intention symbol provided by an embodiment of the present application;

[0024] Fig. 6A This is one of the schematic diagrams of an example of a desktop displaying first information provided by an embodiment of the present application;

[0025] Figure 6B This is a second example schematic diagram of a desktop displaying first information provided by an embodiment of the present application;

[0026] Fig. 7A This is a third example schematic diagram of a desktop displaying first information provided by an embodiment of the present application;

[0027] Figure 7B This is a fourth example schematic diagram of a desktop displaying first information provided by an embodiment of the present application;

[0028] Fig. 8A This is a fifth example schematic diagram of a desktop displaying first information provided by an embodiment of the present application;

[0029] Figure 8B This is a sixth example schematic diagram of a desktop displaying first information provided by an embodiment of the present application;

[0030] Fig. 9 This is a seventh example schematic diagram of a desktop displaying first information provided by an embodiment of the present application;

[0031] Fig.10 This is an eighth example schematic diagram of a desktop displaying first information provided by an embodiment of the present application;

[0032] Fig.11 This is a third flowchart of a control method of an electronic device provided in an embodiment of the present application;

[0033] Fig. 12A This is one of the example schematic diagrams of displaying search results provided in the embodiment of the present application;

[0034] Fig. 12B This is a second example schematic diagram of displaying search results provided in an embodiment of the present application;

[0035] Fig.13 This is a fourth flowchart of a control method of an electronic device provided in an embodiment of the present application;

[0036] Fig.14A This is one of the example schematic diagrams for displaying operation results provided in the embodiments of the present application;

[0037] Fig. 14B This is a second example schematic diagram of displaying operation results provided by an embodiment of the present application;

[0038] Fig.15 This is a fifth flowchart of a control method of an electronic device provided in an embodiment of the present application;

[0039] Fig.16A It is one of the example schematic diagrams showing the operation results of the AI ​​function provided in the embodiment of the present application;

[0040] Fig. 16B This is a second example schematic diagram of displaying the operation result of an AI function provided in an embodiment of the present application;

[0041] Fig.17 is a schematic diagram of an example of displaying audio conversion results provided by an embodiment of the present application;

[0042] Fig.18 is a schematic diagram of an example of displaying content extraction results provided by an embodiment of the present application;

[0043] Fig.19 is a schematic structural diagram of a control device of an electronic device provided in an embodiment of the present application;

[0044] Fig. 20 This is one of the hardware structure diagrams of an electronic device provided in an embodiment of the present application;

[0045] Fig.21 This is the second schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] The following will be combined with the drawings in the embodiments of the present application to clearly describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all the embodiments. All other embodiments obtained by ordinary technicians in this field based on the embodiments in the present application belong to the scope of protection of this application.

[0047] The terms "first", "second", etc. in the specification of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are usually a class, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0048] The terms "at least one (item)", "at least one of" and the like in the specification of the present application refer to any one, any two or a combination of more than two of the objects included therein. For example, at least one (item) of a, b, and c can be represented by: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", where a, b, and c can be single or multiple. Similarly, "at least two (items)" refers to two or more, and its meaning is similar to that of "at least one (item)".

[0049] The control method of the electronic device provided by the embodiment of the present application is described in detail below through specific embodiments and application scenarios in conjunction with the accompanying drawings.

[0050] When a user inputs into an application of an electronic device to trigger the electronic device to perform a corresponding search operation, if the application is an application related to artificial intelligence (AI), the user can communicate with the AI ​​assistant in the AI ​​interaction interface by inputting voice or text to trigger the AI ​​assistant to perform a corresponding search operation according to the user's needs.

[0051] For example, a mobile phone is used as an example. Figure 1A As shown, when the mobile phone displays the AI ​​interactive interface 10, the user can send a search command to the AI ​​assistant in the form of voice or text, such as "Help me find an article called "Introduction to the functions of the file management component" to trigger the AI ​​assistant to perform the corresponding search operation according to the "Introduction to the functions of the file management component" in the command and display the search results to the user.

[0052] However, in the current process of using AI assistants to perform search operations, in order for the AI ​​assistants to execute corresponding search functions and instructions, users are usually required to enter complete natural language commands that the AI ​​assistants can understand, which has certain limitations. Especially when the user is not familiar with natural language commands, or cannot accurately enter the name of the information to be searched, the operation performed by the electronic device cannot meet the user's needs, and it is necessary to repeatedly send instructions to the AI ​​assistant until the required search results are successfully obtained.

[0053] For example, when the instruction input by the user is incomplete, such as Figure 1B ; or when the AI ​​assistant cannot understand the user's intention, such as Figure 1C In the case of the "Find materials for component introduction" shown in the figure, the AI ​​assistant cannot accurately understand the user's input intention and cannot perform the search operation required by the user. Therefore, the following is displayed: Figure 1B or Figure 1C The reply information shown in the figure is to inform the user that more details or context are needed so that the AI ​​assistant can perform subsequent operations. Figure 1A Only when the user clicks "Help me find an article called Introduction to the functions of the file management component" as shown in the figure, can the user successfully obtain the required "Introduction to the functions of the file management component" file.

[0054] The control method of the electronic device provided in the embodiment of the present application can be applied to the scenario where the electronic device performs a corresponding operation according to the user's input. For example, the operation performed by the electronic device can be an information query or search operation.

[0055] The following uses some specific scenarios as examples to illustrate the control method of the electronic device provided in the embodiments of the present application.

[0056] Scenario 1: User needs to find a specified file

[0057] When a user needs to search for a specified file, the user can input operation intention information that can represent the user's search intention and the name keyword of the specified file into the electronic device. For example, the operation intention information can be the symbol " / ". Then, the electronic device can perform a search operation based on the search intention corresponding to the symbol " / " and the name keyword of the specified file to obtain the search result, that is, the above-mentioned specified file.

[0058] Scenario 2: User needs to set an alarm

[0059] When a user needs to set an alarm through an electronic device, the user can input operation intention information that can represent the user's intention and the alarm information that needs to be set to the electronic device. For example, the operation intention information can be the symbol "-", and the symbol corresponds to the operation intention of the electronic device, and the alarm information can be "alarm at 5 o'clock". Then, the electronic device can perform the alarm setting operation based on the operation intention corresponding to the symbol "-" and the alarm information.

[0060] Scenario 3: User needs to seek help through AI functions

[0061] When a user needs to seek help through an AI function, for example, when a user needs to seek sports-related information through an AI function, the user can input into the electronic device the operation intention information that can represent the user's intention and the name of the AI ​​function to be used. For example, the operation intention information can be the symbol "@", and the name of the AI ​​function can be "sports coach". Then, the electronic device can provide sports-related information through the "sports coach" based on the operation intention of using the AI ​​function corresponding to the symbol "@" and the name of the AI ​​function.

[0062] Scenario 4: User needs to convert audio files into text

[0063] When a user needs to convert a specific audio file into text, the user can input operation intention information that can represent the user's intention and the audio file that needs to be converted into the electronic device. For example, the operation intention information can be the symbol ":", and the specific audio file can be an audio file actively selected by the user. Then, the electronic device can perform an audio conversion operation on the specific audio file based on the audio conversion intention corresponding to the symbol ":" and the specific audio file.

[0064] Scenario 5: User needs to obtain a summary of a file

[0065] When a user needs to obtain a summary of a certain file, the user can input operation intention information that can represent the user's intention and the file whose content needs to be extracted into the electronic device. For example, the operation intention information can be the symbol "~", and the certain file can be a file in any form. Then, the electronic device can perform a content extraction operation on the file whose content needs to be extracted based on the content extraction intention corresponding to the symbol "~" and the file whose content needs to be extracted.

[0066] It should be noted that the above-mentioned scenarios 1 to 5 are only illustrative examples of some scenarios in which the embodiments of the present application may be applied. In actual implementation, the embodiments of the present application can also be applied to any possible scenarios in which more users require electronic devices to perform operations, and the embodiments of the present application are not limited here.

[0067] In the control method of an electronic device provided in an embodiment of the present application, the electronic device may receive first information including operation intention information and operation information, so as to perform an operation corresponding to the operation information according to the operation intention information in the first information. In this solution, since the operation intention information can reflect the user's operation intention, that is, the user can directly input the operation intention information to indicate the user's operation requirements to the electronic device, and then the user can input the operation information so that the electronic device performs an operation that meets the user's operation requirements based on the operation information, the efficiency of the electronic device in performing operations can be improved.

[0068] The execution subject of the control method of the electronic device provided in the embodiment of the present application is a control device of the electronic device, which can be an electronic device, or a functional module or entity in the electronic device, and the embodiment of the present application does not limit this. The control method of the electronic device provided in the embodiment of the present application will be exemplarily described below by taking an electronic device as an example.

[0069] The present application provides a control method for an electronic device. Figure 2 FIG. 1 is a flow chart showing a control method of an electronic device provided by an embodiment of the present application. Figure 2 As shown, the control method of the electronic device provided in the embodiment of the present application may include the following steps 201 to 202.

[0070] Step 201: The electronic device receives first information; the first information includes operation intention information and operation information.

[0071] In the embodiment of the present application, the above-mentioned first information may include operation intention information and operation information.

[0072] In some embodiments of the present application, the above-mentioned operation intention information may be an operation intention symbol.

[0073] In some embodiments of the present application, the above-mentioned operation intention symbol may include but is not limited to at least one of the following symbols: “ / ”, “-”, “@”, “:”, “~”.

[0074] In some embodiments of the present application, the above-mentioned operation intention symbol can represent the user's operation intention.

[0075] In some embodiments of the present application, the above-mentioned operation intention may include but is not limited to any of the following: search intention, parameter setting intention, AI function usage intention, audio conversion intention, and content extraction intention.

[0076] For example, “ / ” can represent the user's search intention; “-” can represent the user's parameter setting intention; “@” can represent the user's AI function usage intention; “:” can represent the user's audio conversion intention; and “~” can represent the user's content extraction intention.

[0077] In some embodiments of the present application, the above-mentioned operation intention symbol may also include letters or symbols that can represent the file type.

[0078] Exemplarily, if the operation intention symbol is “ / ” and the “ / ” represents the user's search intention, then “ / W” can represent the user's search intention for document type files; “ / P” can represent the user's search intention for picture type files; “ / M” can represent the user's search intention for audio type files; and “ / V” can represent the user's search intention for video type files.

[0079] In some embodiments of the present application, the above-mentioned operation intention symbol may be a symbol set by default for the electronic device, or a symbol actively set by the user.

[0080] In some embodiments of the present application, the above-mentioned operation intention symbol can be a symbol that has little input interaction during daily use and has no ambiguity in daily conversations.

[0081] In this way, it is possible to avoid the situation where a frequently used symbol is used as an operation intention symbol, causing the electronic device to be unable to accurately understand the semantics of the content input by the user.

[0082] In some embodiments of the present application, in the process of setting the operation intention symbol, the display position of the symbol in the input method soft keyboard can be combined to set the symbol that can be easily found by the user as the operation intention symbol.

[0083] In some embodiments of the present application, the above-mentioned display position may include but is not limited to any of the following: the position where the symbol is displayed on the side of the nine-key form of the input method soft keyboard, and the home page in the symbol display interface.

[0084] For example, since the symbol " / " is rarely used in daily conversations with electronic devices, and when the electronic device is a mobile phone, the symbol " / " is usually displayed on the home page in the symbol display interface, the user can trigger the electronic device to set the symbol " / " as the above-mentioned operation intention symbol. Therefore, when the user needs to input the symbol " / ", the mobile phone can be directly triggered to display the symbol display interface, so that the symbol " / " can be directly viewed and used on the home page.

[0085] In this way, since the display position of the operation intention symbol is easy for users to find, when users need to use the operation intention symbol, they can quickly find and input the operation intention symbol through the input method soft keyboard, thereby improving the convenience of users using the operation intention symbol.

[0086] In some embodiments of the present application, the above-mentioned operation information may include but is not limited to at least one of the following types of information: text, picture, audio, video, document.

[0087] In some embodiments of the present application, when the operation information is text, the operation information may include but is not limited to any of the following: keywords, sentences, paragraphs.

[0088] In some embodiments of the present application, the user can input the first information through editing or voice input in the information editing box displayed by the electronic device, so that the electronic device can receive the first information.

[0089] In some embodiments of the present application, the above-mentioned information editing box can be any one of the following: an information editing box in an application of an electronic device, an information editing box in an AI interaction interface of the electronic device.

[0090] In some embodiments of the present application, the above-mentioned application may be any system application of the electronic device, or may be any third-party application.

[0091] In some embodiments of the present application, Figure 2 ,like Figure 3 The above step 201 can be specifically implemented through the following steps 201a and 201b.

[0092] Step 201a: The electronic device receives a first input to the AI ​​interaction interface.

[0093] Step 201b: The electronic device determines first information in response to the first input.

[0094] In some embodiments of the present application, the first input is an editing input of the first information.

[0095] In some embodiments of the present application, the above-mentioned editing input may be an editing input in text form or an editing input in voice form.

[0096] In some embodiments of the present application, the electronic device may respond to the first input through an AI assistant in the AI ​​interaction interface to determine the first information.

[0097] It is understandable that an AI assistant is an intelligent software program that uses artificial intelligence technology to understand and analyze user instructions and perform specific tasks. It is usually installed in a smartphone, and the user can interact with the AI ​​assistant so that the AI ​​assistant can provide the user with more intelligent services. Specifically, in the embodiment of the present application, the AI ​​assistant can realize the function of understanding user instructions, can interact with the user and perform the specified operations required by the user.

[0098] In some embodiments of the present application, the display form of the above-mentioned AI interaction interface may include but is not limited to any of the following forms: displaying it in the top area or bottom area of ​​any interface of the electronic device in the form of a floating window, and displaying the AI ​​interaction interface in the floating window; displaying the AI ​​interaction interface in full screen.

[0099] For example, the electronic device is a mobile phone. Figure 4A As shown, the mobile phone can display a floating window 12 of the AI ​​interaction interface in the bottom area of ​​the desktop 11. Or, as Figure 1A As shown, the mobile phone can display the AI ​​interaction interface 10 in full screen.

[0100] In some embodiments of the present application, the electronic device may display the above-mentioned AI interaction interface in response to the user's second input.

[0101] In some embodiments of the present application, the second input may include but is not limited to any of the following: click input, slide input, press input, gesture input, or other feasible input, which is not limited in the embodiments of the present application.

[0102] In some embodiments of the present application, the above-mentioned gesture input may include but is not limited to at least one of the following: click gesture, sliding gesture, drag gesture, pressure recognition gesture, long press gesture, area change gesture, double press gesture, double click gesture, specific gesture input or other possible gesture inputs. The specific gesture input form can be determined according to actual needs and is not limited to this in the embodiments of the present application.

[0103] In some embodiments of the present application, the second input may include but is not limited to any of the following: a user's click input on an application icon corresponding to the AI ​​interaction interface displayed in the interface, and a user's pressing input on a physical button of the electronic device.

[0104] In some embodiments of the present application, the above-mentioned physical button can be: a volume up button, a volume down button, a power button or any physical button in the electronic device.

[0105] For example, in combination Figure 4A, the desktop 11 displayed on the mobile phone contains 5 application icons, namely, the application icon corresponding to application A, the application icon corresponding to application B, the application icon corresponding to application C, the application icon corresponding to application D, and the "AI Assistant" application icon corresponding to the AI ​​interactive interface. In the case that the user needs to use the AI ​​assistant through the mobile phone, the user can click the "AI Assistant" application icon to trigger the mobile phone to display a floating window 12 to display the AI ​​interactive interface. At the same time, the floating window 12 contains an information editing box, a voice input mark and an object adding mark. Among them, the information editing box displays the prompt message "Ask me if you have any questions" to prompt the user to enter information in text form in the information editing box; the voice input mark can be used to receive the user's voice input so that the AI ​​assistant can obtain information in voice form; the object adding mark can be used to help the user send information in other forms other than text to the AI ​​assistant. If the user clicks on the object adding mark, the mobile phone can display the following Figure 4B The floating window 12 shown is used to display the identifiers corresponding to four types of files, namely, a "picture" file identifier, a "video" file identifier, an "audio" file identifier, and a "document" file identifier.

[0106] Furthermore, if the user clicks on the "picture" file identifier, the electronic device can jump to display a new interface to display all picture files contained in the electronic device; if the user clicks on the "video" file identifier, the electronic device can jump to display a new interface to display all video files contained in the electronic device, or the electronic device can display a video application interface to facilitate the user to select online video files; if the user clicks on the "audio" file identifier, the electronic device can jump to display a new interface to display all audio files contained in the electronic device, or the electronic device can display an audio application interface to facilitate the user to select online audio files; if the user clicks on the "document" file identifier, the electronic device can jump to display a new interface to display all document files contained in the electronic device, wherein the document file can be displayed in different areas according to the type of document, and the type of document can include but is not limited to: doc format, xls format, ppt format, pdf format, txt format, cad format.

[0107] For example, when a user is viewing any interface in a mobile phone and needs to use an AI assistant, the user can press the power button of the mobile phone for 0.5 seconds to trigger the mobile phone to directly overlay an AI assistant in the bottom area of ​​any displayed interface. Figure 4A The floating window 12 is shown to display the AI ​​interaction interface.

[0108] In an embodiment of the present application, the electronic device can determine the first information based on the user's first input to the AI ​​interaction interface, so that the AI ​​assistant can subsequently perform the operation corresponding to the operation information according to the operation intention information, thereby improving the flexibility of the electronic device in performing operations based on the received information.

[0109] In some embodiments of the present application, the control method of the electronic device provided in the embodiments of the present application further includes the following step 301.

[0110] Step 301: The electronic device displays prompt information in response to a first input.

[0111] In the embodiment of the present application, the above prompt information can be used to prompt the operation intention corresponding to the operation intention information.

[0112] In some embodiments of the present application, after the electronic device receives the operation intention information, the electronic device may display prompt information.

[0113] It is understandable that, since different operation intention information corresponds to different operation intentions, different operation intention information corresponds to different prompt information.

[0114] In some embodiments of the present application, the above prompt information can be displayed in an information editing box.

[0115] In some embodiments of the present application, after the electronic device displays the prompt information, the operation intention information and the prompt information can be displayed in the information editing box at the same time. Therefore, in order to distinguish the operation intention information input by the user and the prompt information provided by the electronic device, the electronic device can display the operation intention information and the prompt information separately through different display parameters.

[0116] In some embodiments of the present application, the above display parameters may include but are not limited to at least one of the following: display size, display color, and display thickness.

[0117] Exemplarily, the electronic device may display the operation intention information input by the user in bold and adjust the display color of the symbol to blue. At the same time, the electronic device may adjust the display color of the prompt information to gray so that the user can more intuitively distinguish between the operation intention information and the prompt information.

[0118] In some embodiments of the present application, after the electronic device receives the operation intention information, the electronic device can update the prompt information displayed in the information editing box to prompt the operation intention corresponding to the operation intention information.

[0119] For example, in combination Figure 4A ,like Figure 5AAs shown, if the user enters the symbol " / " in the information editing box in the floating window 21, that is, after the above-mentioned operation intention information, the electronic device can display a prompt message "Enter the content you want to search" to prompt the user of the search intention corresponding to the symbol " / ".

[0120] Combination Figure 4A ,like Figure 5B As shown, if the user enters the symbol “-” in the information editing box in the floating window 22, that is, after the above-mentioned operation intention information, the electronic device can display a prompt message “Enter the operation you want to perform” to prompt the user of the parameter setting intention corresponding to the symbol “-”.

[0121] Combination Figure 4A ,like Figure 5C As shown, if the user enters the symbol "@" in the information editing box in the floating window 23, that is, after the above-mentioned operation intention information, the electronic device can display a prompt message "Enter the person you want to call" to prompt the user of the AI ​​function usage intention corresponding to the symbol "@".

[0122] Combination Figure 4A ,like Figure 5D As shown, if the user enters the symbol ":" in the information editing box in the floating window 24, that is, after the above-mentioned operation intention information, the electronic device can display a prompt message "Enter the audio you want to convert" to prompt the user of the audio conversion intention corresponding to the symbol ":".

[0123] Combination Figure 4A ,like Figure 5E As shown, if the user enters the symbol "~" in the information editing box in the floating window 25, that is, after the above-mentioned operation intention information, the electronic device can display a prompt message "Enter the file whose content you want to extract" to prompt the user of the content extraction intention corresponding to the symbol "~".

[0124] Among them, FIG. 5A to FIG. 5E In the information editing box shown, the electronic device displays the operation intention information in an enlarged and bolded form, so that the user can distinguish the operation intention information and the prompt information more intuitively.

[0125] In an embodiment of the present application, the user can determine whether the input operation intention information is correct through the prompt information displayed by the electronic device, so that when the user finds that the prompt information does not meet his or her needs, the input operation intention information can be adjusted, so that the operation intention information finally received by the electronic device meets the user's actual operation needs, and can further improve the accuracy of the electronic device in performing operations based on user input.

[0126] In some embodiments of the present application, after the above step 301, after the electronic device receives the operation information, the electronic device may further display corresponding prompt information.

[0127] For example, in combination Figure 4A and Figure 5A , if the operation information entered by the user is "artificial intelligence", then Fig. 6A As shown, the mobile phone can display “ / AI” in the information editing box of the floating window 211. At this time, the mobile phone can display the corresponding prompt information “Search” in the information editing box of the floating window 211 and display a sending mark in the floating window 211.

[0128] For example, in combination Figure 4A and Figure 5A , if the operation information input by the user is a picture A in the form of a picture, then Figure 6B As shown, the mobile phone can display “ / ” and thumbnail A of picture A in the information editing box of the floating window 212. At this time, the mobile phone can display the corresponding prompt information “Search” in the information editing box of the floating window 212 and display a sending mark in the floating window 212.

[0129] For example, in combination Figure 4A and Figure 5B , if the user inputs the operation information "alarm at 5 o'clock", then Fig. 7A As shown, the mobile phone can display "-5 o'clock alarm" in the information editing box of the floating window 221. At this time, the mobile phone can display the corresponding prompt message "Go to set" in the information editing box of the floating window 221, and display a sending mark in the floating window 221.

[0130] For example, in combination Figure 4A and Figure 5B , if the operation information entered by the user is "anniversary", then Figure 7B As shown, the mobile phone can display “-Anniversary” in the information editing box of the floating window 222. At this time, the mobile phone can display the corresponding prompt message “Go to set” in the information editing box of the floating window 222 and display a sending mark in the floating window 222.

[0131] For example, in combination Figure 4A and Figure 5C , if the operation information input by the user is "sports coach", then Fig. 8A As shown, the mobile phone can display “@sports coach” in the information editing box of the floating window 231. At this time, the mobile phone can display the corresponding prompt information “Open” in the information editing box of the floating window 231 and display a sending mark in the floating window 231.

[0132] For example, in combination Figure 4A and Figure 5C , if the operation information input by the user is an audio file, such as audio B, then Fig. 9 As shown, the mobile phone can display “:” and a file icon representing audio B in the information editing box of the floating window 24. At this time, the mobile phone can display the corresponding prompt information “Convert” in the information editing box of the floating window 24 and display a sending mark in the floating window 24.

[0133] For example, in combination Figure 4A and Figure 5D , if the operation information input by the user is a video file, such as video C, then Fig.10 As shown, the mobile phone can display “~” and a file icon representing video C in the information editing box of the floating window 25. At this time, the mobile phone can display the corresponding prompt information “Extract” in the information editing box of the floating window 25 and display a sending mark in the floating window 25.

[0134] Step 202: The electronic device performs an operation corresponding to the operation information according to the operation intention information.

[0135] It is understandable that one operation intention information may correspond to one operation intention, and one operation intention may correspond to an operation type that can be performed by an electronic device.

[0136] Exemplarily, when the operation intention is a search intention, the electronic device can perform a search operation on the operation information; when the operation intention is a parameter setting intention, the electronic device can perform a setting operation on a parameter corresponding to the operation information; when the operation intention is an AI function usage intention, the electronic device can perform a corresponding operation on the operation information through the AI ​​function; when the operation intention is an audio conversion intention, the electronic device can perform a speech-to-text audio conversion operation on the audio file corresponding to the operation information; when the operation intention is a content extraction intention, the electronic device can perform a content extraction operation on the file corresponding to the operation information.

[0137] In some embodiments of the present application, the electronic device can determine the operation intention corresponding to the operation intention information from the correspondence between the operation intention information and the operation intention stored in the electronic device based on the received operation intention information, thereby executing the operation corresponding to the operation information.

[0138] In some embodiments of the present application, when the operation information is in text form, the electronic device can determine the meaning of the operation information based on semantic analysis.

[0139] In some embodiments of the present application, when the operation information is a picture file, the electronic device can obtain information such as objects, scenes, and characters contained in the picture based on picture recognition technology, thereby determining the information contained in the picture.

[0140] In some embodiments of the present application, when the operation information is an audio file, the electronic device can perform a speech recognition operation on the audio file to convert the speech into text, and further determine the meaning of the converted text based on semantic analysis to determine the information contained in the audio file.

[0141] In some embodiments of the present application, when the operation information is a video file, the electronic device can parse the video file to extract key information such as the pictures and audio contained in the video, and then identify the acquired pictures to obtain the content contained therein, and can perform speech recognition on the audio to perform natural language processing, so as to determine the information contained in the video file based on comprehensive understanding.

[0142] In some embodiments of the present application, the above-mentioned operation intention information is used to indicate the search intention, and the above-mentioned operation information is the search text; combined with Figure 2 ,like Fig.11 The above step 202 can be specifically implemented through the following step 202a.

[0143] Step 202a: The electronic device performs a search operation on the search text.

[0144] In some embodiments of the present application, the search scope of the search operation performed by the electronic device may include but is not limited to at least one of the following: files or content stored locally on the electronic device, article link summaries collected or saved by the electronic device, and online searches.

[0145] In some embodiments of the present application, after the electronic device performs a search operation on the search text, the electronic device may display the search results.

[0146] For example, in combination Fig. 12A , if the file that the user needs to search contains "artificial intelligence", the mobile phone can display the first information " / artificial intelligence" and the prompt information "search" in the information editing box of the floating window 211. Then, the user can click the send mark in the floating window 211 to trigger the mobile phone to perform a search operation based on the search text "artificial intelligence" to search for artificial intelligence-related content stored locally on the mobile phone, connected to the Internet, and collected by the user, so as to Fig. 12AAs shown, the search results, namely the document "Discussion and Record of the Development of Artificial Intelligence", are displayed in the floating window 311 in the desktop 11, and the file information of the document is displayed at the same time, such as the last modification time of the document is 2024 / 10 / 10, and the file size of the document is 234KB.

[0147] It should be noted that when the mobile phone displays search results, the mobile phone can mark the search text "artificial intelligence" in the search results, such as displaying it in bold, to facilitate user viewing.

[0148] It should be noted that due to the limited display size in the mobile phone interface, when the name of the file corresponding to the search result is long, the mobile phone can display the name in abbreviated form. For example, the file name displayed on the mobile phone can be "Artificial Intelligence... Record".

[0149] In some embodiments of the present application, when the operation information includes multiple words, the electronic device can perform search operations according to the multiple words respectively to obtain search results and display them to the user.

[0150] In some embodiments of the present application, when the operation information contains multiple words, the user can add input symbols to the multiple words so that the electronic device knows how to perform a search operation based on the multiple words. For example, if the electronic device receives the search text "artificial intelligence + technology", the electronic device can search for files containing both "artificial intelligence" and "technology" in the name, and display the search results to the user after the search is obtained.

[0151] For example, in combination Figure 6B , if the user needs to search for pictures that are associated with picture A, such as pictures similar to picture A, the mobile phone can display the operation intention symbol " / " and thumbnail picture A contained in the first information in the information editing box of the floating window 212, and display the prompt message "Search". Then, the user can click the send mark in the floating window 212 to trigger the mobile phone to perform a search operation based on picture A, and search for pictures similar to picture A stored locally on the mobile phone, so as to Fig. 12B As shown, thumbnail images of images similar to image A are displayed in the floating window 312 in the desktop 11, namely thumbnail image B, thumbnail image C, thumbnail image D and thumbnail image E. At the same time, the display order of thumbnail image B to thumbnail image E is determined according to the similarity between the image corresponding to the thumbnail image and image A.

[0152] In the embodiment of the present application, the electronic device can determine the user's search intention based on the operation intention information to perform a corresponding search operation on the search text. At this time, the search operation performed by the electronic device meets the actual operation needs of the user. Therefore, the operation performed by the electronic device based on the operation information meets the user's needs, so that while ensuring the user's operation convenience, the accuracy of the electronic device performing the operation based on the received information can be improved.

[0153] In some embodiments of the present application, the above-mentioned operation intention information is used to indicate the operation intention of the electronic device, and the above-mentioned operation information is an operation instruction; Figure 2 ,like Fig.13 The above step 202 can be specifically implemented through the following step 202b.

[0154] Step 202b: The electronic device executes the operation corresponding to the operation instruction.

[0155] In some embodiments of the present application, the operation corresponding to the above-mentioned operation instruction may include but is not limited to at least one of the following: setting an alarm, setting a countdown, adding a memo, and creating a new schedule.

[0156] For example, in combination Fig. 7A , if the user wants to set an "alarm at 5 o'clock", the mobile phone can display the first information "-5 o'clock alarm" and the prompt information "go to set" in the information editing box of the floating window 221. Then, the user can click the send mark in the floating window 221 to trigger the mobile phone to perform the corresponding operation of creating a new alarm based on the operation instruction "5 o'clock alarm", so that Fig.14A As shown, the operation result is displayed in the floating window 321 in the desktop 11, that is, the mobile phone has successfully set an alarm for 5 o'clock, and at the same time displays the corresponding information of the alarm. For example, if the alarm is set for "tomorrow", the reminder mode of the alarm is "only once", that is, the alarm will only ring once tomorrow.

[0157] For example, in combination Figure 7B , assuming that today's date is 2024 / 10 / 01. If the user wants to set a schedule, the mobile phone can display the first information "-Anniversary" and the prompt information "Go to set" in the information editing box of the floating window 222. Then, the user can click the send icon in the floating window 222 to trigger the mobile phone to perform the corresponding operation of creating a new schedule based on the operation instruction "Anniversary", so that Fig. 14B As shown, the setting result is displayed in the floating window 322 in the desktop 11, that is, the mobile phone has successfully added a new schedule to the calendar, and at the same time displays the schedule information corresponding to the schedule, such as the schedule name is "Anniversary" and the schedule time is "2024 / 10 / 01".

[0158] In the embodiment of the present application, the electronic device can determine the user's intention to instruct the electronic device to perform the operation according to the operation intention information, so as to perform the corresponding operation to the operation instruction. At this time, the operation performed by the electronic device meets the actual operation needs of the user. Therefore, the operation performed by the electronic device based on the operation instruction meets the needs of the user, so that the accuracy of the electronic device performing the operation according to the received information can be improved while ensuring the convenience of the user's operation.

[0159] In some embodiments of the present application, the above-mentioned operation intention information is used to indicate the operation intention of using the AI ​​function, and the above-mentioned operation information is an AI operation instruction; combined with Figure 2 ,like Fig.15 The above step 202 can be specifically implemented through the following step 202c.

[0160] Step 202c: The electronic device uses the AI ​​function to execute the operation corresponding to the AI ​​operation instruction.

[0161] In some embodiments of the present application, the above-mentioned use of the AI ​​function to execute the operation corresponding to the operation instruction may be that the electronic device executes the operation corresponding to the operation instruction based on the intelligent agent corresponding to the AI ​​function.

[0162] It should be noted that the above-mentioned agent refers to an agent that can perceive the environment and take actions to achieve specific goals. It can be software, hardware or a system with autonomy, adaptability and interaction capabilities. The agent perceives changes in the environment (such as through sensors or data input), makes judgments and decisions based on the knowledge and algorithms it has learned, and then performs actions to affect the environment or achieve predetermined goals.

[0163] In some embodiments of the present application, the above-mentioned intelligent agent may include but is not limited to at least one of the following: a sports coach, a food recommendation officer, a travel assistant, and a learning planner.

[0164] In some embodiments of the present application, the operations corresponding to the above-mentioned execution operation instructions can be understood as: the intelligent agent corresponding to the AI ​​function provides the user with information related to the functions it contains, thereby further executing the operations corresponding to the functions it contains.

[0165] For example, when the agent is a "sports coach", the "sports coach" can provide the user with sports-related information or make a sports plan for the user;

[0166] In the case where the agent is a "food recommendation officer", the "food recommendation officer" can provide users with food-related recommendations, or can provide other users' comments on a certain food;

[0167] When the agent is a "travel assistant", the "travel assistant" can provide scenic spot recommendations for the user or can plan a travel route for the user.

[0168] When the agent is a "learning planner", the "learning planner" can provide learning materials and learning methods for the user or can formulate a learning plan for the user.

[0169] Exemplarily, in combination with Fig. 8A , if the user wants to use the AI function to seek sports-related information, the mobile phone can display the first information "@sports coach" and the prompt message "Open" in the information editing box of the floating window 231 according to the user's edited input of the first information. Then, the user can click the send icon in the floating window 231, and thus as Fig.16A shown, the mobile phone can display a floating window 331 on the desktop 11 to display the content related to the conversation with the agent "sports coach". For example, the prompt message "Hello, I'm your personal sports coach. I can answer various sports questions, query and calculate your health data within three months. Let's exercise more healthily and efficiently together!", and the options "How many steps did I take last week" and "Give me a 14-day weight loss plan" that can quickly trigger a reply. Further, the user can input text information in the text editing box in the form of text or voice, or can trigger the agent "sports coach" to provide sports-related information that meets the user's needs by clicking on the options displayed in the floating window 331, so as to implement the operation corresponding to the AI operation instruction by using the AI function.

[0170] Exemplarily, in combination with Figure 8B , if the user wants to use the AI function to seek food-related information, the mobile phone can display the first information "@food recommender" and the prompt message "Open" in the information editing box of the floating window 232 according to the user's edited input of the first information. Then, the user can click the send icon in the floating window 232, and thus as Fig. 16B shown, the mobile phone can display a floating window 332 on the desktop 11 to display the content related to the conversation with the agent "food recommender". For example, the prompt message "Hello, I'm your personal food recommender. I can recommend food for you. Let's query the food around the current location together!", and the options "High-score recommended stores" and "High-score recommended foods" that can quickly trigger a reply. Further, the user can input text information in the text editing box in the form of text or voice, or can trigger the agent "food recommender" to provide food-related information that meets the user's needs by clicking on the options displayed in the floating window 332, so as to implement the operation corresponding to the AI operation instruction by using the AI function.

[0171] In the embodiment of the present application, the electronic device can determine the user's operation intention of using the AI ​​function based on the operation intention information to perform the corresponding operation on the AI ​​operation instruction. At this time, the operation performed by the electronic device meets the actual operation needs of the user. Therefore, the operation performed by the electronic device based on the corresponding AI operation instruction meets the needs of the user, so that while ensuring the user's operation convenience, the accuracy of the electronic device performing the operation according to the received information can be improved.

[0172] In some embodiments of the present application, when the above-mentioned operation intention information is used to indicate an audio conversion intention, and the above-mentioned operation information is an audio file, the electronic device can perform an audio conversion operation on the audio file.

[0173] For example, in combination Fig. 9 If the user needs to convert audio B, the mobile phone can display the operation intention symbol ":" and the file icon of audio B contained in the first information in the information editing box of the floating window 24, and display the prompt message "Convert". Then, the user can click the send mark in the floating window 24 to trigger the mobile phone to perform the audio conversion operation based on audio B, so that Fig.17 As shown, the mobile phone can display the audio conversion result in text form corresponding to the audio B in the floating window 34 in the desktop 11, such as "The theme of today's regular meeting is: ...".

[0174] In some embodiments of the present application, when the above-mentioned operation intention information is used to indicate the content extraction intention, and the above-mentioned operation information is any file in any form, the electronic device can perform a content extraction operation on any file.

[0175] For example, in combination Fig.10 , if the user needs to extract the content of video C, the mobile phone can display the operation intention symbol "~" contained in the first information and the file icon of video C in the information editing box of the floating window 25, and display the prompt information "Extract". Then, the user can click the sending mark in the floating window 25 to trigger the mobile phone to perform the video content extraction operation based on video C, so that Fig.18 As shown, the mobile phone can display a text-based introduction to the video content in a floating window 35 in the desktop 11, such as "Video C is a popular science video about pets, including how to feed pets..."

[0176] In the control method of the electronic device provided in the embodiment of the present application, the electronic device can receive operation information including operation intention information and operation information, so as to perform the operation corresponding to the operation information according to the operation intention information in the operation information. In this scheme, since the operation intention information can reflect the user's operation intention, that is, the user can directly input the operation intention information to indicate the user's operation requirements to the electronic device, and then the user can input the operation information so that the electronic device performs the operation that meets the user's operation requirements based on the operation information, the efficiency of the electronic device in performing the operation can be improved.

[0177] In some embodiments of the present application, the control method of the electronic device provided in the embodiments of the present application further includes the following steps 401 and 402.

[0178] Step 401: The electronic device receives a third input of second information.

[0179] In some embodiments of the present application, the second information includes at least one of the following: operation intention information and operation information.

[0180] In some embodiments of the present application, the third input may be a deletion input of the second information in the information editing box.

[0181] Step 402: The electronic device cancels the first operation in response to the third input.

[0182] It is understandable that, when the user wants to cancel or stop the operation that the electronic device needs to perform, the user can actively trigger the electronic device to delete the second information, that is, the third input, so that the electronic device cancels the operation corresponding to the operation information. At this time, the electronic device will process the information that has not been deleted in the information editing box in the form of a normal dialogue.

[0183] For example, in combination Fig. 6A If the user does not want the mobile phone to search for files whose names contain "artificial intelligence", the user can delete the operation intention symbol " / " displayed in the text editing box. Then, if the user clicks the send icon in the floating window 21, the mobile phone will provide explanations of terms related to "artificial intelligence", such as "Artificial Intelligence (Artificial Intelligence), abbreviated as AI in English. It is an important driving force for a new round of scientific and technological revolution and industrial transformation. It is a new technical science that studies and develops theories, methods, technologies and application systems for simulating, extending and expanding human intelligence. ..."

[0184] In an embodiment of the present application, the electronic device can determine the user's actual operation requirements based on whether the text editing box contains operation intention information, and thus perform the corresponding operation. Thus, it can avoid the situation where the electronic device cannot know the user's needs. In this way, it can improve the accuracy of the electronic device in performing operations based on the received information.

[0185] For various scenarios to which the embodiments of the present application can be applied, taking the electronic device as a mobile phone as an example, combined with the various implementation schemes of the embodiments of the present application described above, specific examples are given below to illustrate the implementation process in various scenarios of the embodiments of the present application:

[0186] Example 1: When a user needs to search for a specific file, such as the document "Discussion and Record of the Development of Artificial Intelligence", the user can first input the symbol " / " that can represent the search intention into the mobile phone, and then the mobile phone can display the prompt information "Enter the content you want to search". The user can determine whether the input symbol " / " is accurate through the displayed prompt information, and then input the operation information "artificial intelligence" into the mobile phone when the user determines that there is no input error. At this time, the first information " / artificial intelligence" and the corresponding prompt information "search" are displayed in the information editing box of the mobile phone. After the user clicks the mark used to trigger the sending of information, the mobile phone can perform a search operation based on the search text "artificial intelligence", searching for artificial intelligence-related content stored locally on the mobile phone, connected to the Internet, and actively collected by the user, thereby displaying the search results, that is, the document "Discussion and Record of the Development of Artificial Intelligence", and at the same time displaying the file information of the document, such as the last modification time of the document is 2024 / 10 / 10, and the file size of the document is 234KB.

[0187] Example 2: When a user needs to search for other pictures similar to a specified picture, such as pictures similar to picture A, the user can first input the symbol " / " that can represent the search intention into the mobile phone, and then the mobile phone can display the prompt message "Enter the content you want to search for". The user can determine whether the input symbol " / " is accurate through the displayed prompt information, and then select picture A, i.e., operation information, when the user is sure that there is no input error. At this time, the mobile phone's information editing box displays a thumbnail picture A of picture A and the corresponding prompt message "Search". After the user clicks the mark used to trigger the sending of information, the mobile phone can perform a search operation based on picture A, searching for pictures similar to picture A stored locally on the mobile phone, thereby displaying the search results, i.e., the document "Discussion and Record of the Development of Artificial Intelligence", and at the same time displaying thumbnails of pictures similar to picture A, i.e., thumbnail pictures B, thumbnail pictures C, thumbnail pictures D, and thumbnail pictures E.

[0188] Example 3: When a user needs to set an alarm through a mobile phone, for example, when the user needs to set an alarm at 5 o'clock, the user can first input the symbol "-" that can represent the user's intention into the mobile phone, and then the mobile phone can display a prompt message "Enter the operation you want to perform". The user can determine whether the input symbol "-" is accurate through the displayed prompt message, and then, when the user is sure that there is no input error, enter the operation instruction "alarm at 5 o'clock" into the mobile phone. At this time, the first information "-alarm at 5 o'clock" and the corresponding prompt information "Go to set" are displayed in the information editing box of the mobile phone. After the user clicks on the mark used to trigger the sending of the information, the mobile phone can perform the corresponding operation of creating a new alarm based on the operation information "alarm at 5 o'clock", successfully set an alarm at 5 o'clock for the user, and display the corresponding information of the alarm at the same time. For example, if the alarm is set for "tomorrow", the prompt mode of the alarm is "only once", that is, the alarm will only ring once tomorrow.

[0189] Example 4: When a user needs to set a schedule through a mobile phone, for example, when a user needs to set an "anniversary" schedule on 2024 / 10 / 01, the user can first input the symbol "-" that can represent the user's intention into the mobile phone, and then the mobile phone can display a prompt message "Enter the operation you want to perform". The user can determine whether the input symbol "-" is accurate through the displayed prompt message, and then, when the user is sure that there is no input error, enter the operation instruction "anniversary" into the mobile phone. At this time, the first information "-anniversary" and the corresponding prompt message "go to set" are displayed in the information editing box of the mobile phone. After the user clicks on the mark used to trigger the sending of the information, the mobile phone can perform the operation corresponding to the new schedule based on "anniversary", successfully set a new schedule for the user in the calendar, and display the schedule information corresponding to the schedule at the same time, such as the schedule name is "anniversary" and the schedule time is "2024 / 10 / 01".

[0190] Example 5: When a user needs to seek help through the AI ​​function, for example, when a user needs to seek sports-related information through the intelligent agent "sports coach" in the AI ​​function, the user can first enter the symbol "@" that can represent the user's intention to use the AI ​​function into the mobile phone, and then the mobile phone can display a prompt message "Enter the object you want to call out". The user can determine whether the input symbol "@" is accurate through the displayed prompt information, and then enter the AI ​​operation instruction "sports coach" into the mobile phone when the user determines that there is no input error. At this time, the first information "@sports coach" and the corresponding prompt information "open" are displayed in the information editing box of the mobile phone. After the user clicks on the mark used to trigger the sending of information, the mobile phone can display content related to the "sports coach" dialogue, such as the prompt message "Hello, I am your personal sports coach. I can answer various sports questions for you, query and calculate health data within three months. Let's exercise together to be healthier and more efficient!", and can display options that can quickly trigger replies, such as "How many steps did I walk last week" and "Give me a 14-day weight loss plan." Furthermore, the user can click on the option that can quickly trigger a reply, or can enter the text message that requires a conversation in the form of text or voice, so as to trigger the intelligent agent "sports coach" in the AI ​​function to provide the sports-related information required by the user.

[0191] Example 6: When a user needs to seek help through the AI ​​function, for example, when a user needs to seek food-related information through the intelligent agent "Food Recommender" in the AI ​​function, the user can first input the symbol "@" that can represent the user's intention to use the AI ​​function into the mobile phone, and then the mobile phone can display a prompt message "Enter the person you want to call out". The user can determine whether the input symbol "@" is accurate through the displayed prompt message, and then enter the AI ​​operation instruction "Food Recommender" into the mobile phone when the user is sure that there is no input error. At this time, the first information "@Food Recommender" and the corresponding prompt message "Open" are displayed in the information editing box of the mobile phone. After the user clicks the mark used to trigger the sending of the information, the mobile phone can display content related to the dialogue with the "Food Recommender", such as the prompt message "Hello, I am your personal food recommendation officer, I can recommend food for you, let's check the food around the current location together!", and can display options that can quickly trigger replies, such as "High-score recommended stores" and "High-score recommended food". Furthermore, the user can click on the option that can quickly trigger a reply, or can enter the text message that requires a conversation in the form of text or voice, so as to trigger the intelligent agent "Food Recommender" in the AI ​​function to provide food-related information that the user needs.

[0192] Example 7: When a user needs to obtain corresponding information for an audio file through a mobile phone, for example, when the user wants to perform audio conversion on audio B, the user can first input the symbol ":" that can represent the audio conversion intention into the mobile phone, and then the mobile phone can display the prompt message "Enter the audio you want to convert". The user can determine whether the input symbol ":" is accurate through the displayed prompt information, so that when the user determines that there is no input error, the mobile phone is triggered to select audio B, that is, the operation information. At this time, the operation intention symbol ":" and the file icon of audio B contained in the first information are displayed in the information editing box of the mobile phone, and the prompt message "Convert" is displayed. After the user clicks the mark used to trigger the sending of the information, the mobile phone can perform the audio conversion operation based on audio B, and display the audio conversion result in the form of text corresponding to audio B, such as "The theme of today's regular meeting is:..."

[0193] Example 8: When a user needs to obtain the content corresponding to a file through a mobile phone, for example, when the user wants to obtain the video content corresponding to video C, the user can first input the symbol "~" that can represent the intention of content extraction into the mobile phone, and then the mobile phone can display the prompt information "Enter the file you want to extract the content". The user can determine whether the input symbol "~" is accurate through the displayed prompt information, so that when the user determines that there is no input error, the mobile phone is triggered to select video C, that is, operation information. At this time, the operation intention symbol "~" and the file icon of video C contained in the first information are displayed in the information editing box of the mobile phone, and the prompt information "Extract" is displayed. After the user clicks the mark used to trigger the sending of information, the mobile phone can perform the video content extraction operation based on video C, and display the video content introduction in text form, such as "Video C is a popular science video about pets, including how to feed pets..."

[0194] It should be noted that the above-mentioned method embodiments, or various possible implementation methods in each method embodiment, can be executed separately, or, under the premise that there is no contradiction, can also be executed in combination with each other. The specific implementation can be determined according to actual usage requirements, and the embodiments of the present application do not limit this.

[0195] It should be noted that the electronic device control method provided in the embodiment of the present application can be executed by a control device of the electronic device. In the embodiment of the present application, the control device of the electronic device executing the electronic device control method is taken as an example to illustrate the control device of the electronic device provided in the embodiment of the present application.

[0196] Fig.19 FIG. 1 shows a possible structural diagram of a control device of an electronic device involved in an embodiment of the present application. Fig.19 As shown, the control device 70 of the electronic device may include: a receiving module 71 and an execution module 72;

[0197] The receiving module 71 is used to receive first information; the first information includes operation intention information and operation information;

[0198] The execution module 72 is used to execute the operation corresponding to the operation information according to the operation intention information received by the receiving module 71.

[0199] In a possible implementation, the above-mentioned operation intention information is an operation intention symbol.

[0200] In a possible implementation, the receiving module 71 is specifically configured to receive a first input to the artificial intelligence (AI) interaction interface; and determine first information in response to the first input.

[0201] In a possible implementation, the above-mentioned operation intention information is used to indicate the search intention, and the above-mentioned operation information is a search text; the execution module 72 is specifically used to perform a search operation on the search text.

[0202] In a possible implementation, the operation intention information is used to indicate the operation intention of the electronic device, and the operation information is an operation instruction; the execution module 72 is specifically used to execute the operation corresponding to the operation instruction.

[0203] In a possible implementation, the above-mentioned operation intention information is used to indicate the operation intention of utilizing the AI ​​function, and the above-mentioned operation information is an AI operation instruction; the execution module 72 is specifically used to utilize the AI ​​function to execute the operation corresponding to the AI ​​operation instruction.

[0204] In one possible implementation, the control device 70 of the electronic device provided in the embodiment of the present application also includes: a display module; a display module for displaying prompt information in response to the first input received by the receiving module 71; the prompt information is used to prompt the operation intention corresponding to the operation intention information.

[0205] In the control device of the electronic device provided in the embodiment of the present application, since the operation intention information can reflect the user's operation intention, that is, the user can directly input the operation intention information to indicate the user's operation requirements to the control device of the electronic device, and then the user can input the operation information so that the control device of the electronic device performs operations that meet the user's operation requirements based on the operation information. Therefore, while ensuring the user's operation convenience, the operation performed by the control device of the electronic device can meet the user's needs. In this way, the accuracy of the control device of the electronic device in performing operations according to the received information is improved.

[0206] The control device of the electronic device in the embodiment of the present application can be an electronic device, or a component in the electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal, or it can be other devices other than a terminal. Exemplarily, the electronic device can be a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted electronic device, a mobile Internet device (Mobile Internet Device, MID), an augmented reality (augmented reality, AR) / virtual reality (virtual reality, VR) device, a robot, a wearable device, an ultra-mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), etc., and can also be a server, a network attached storage (Network Attached Storage, NAS), a personal computer (personal computer, PC), a television (television, TV), a teller machine or a self-service machine, etc., which is not specifically limited in the embodiment of the present application.

[0207] The control device of the electronic device in the embodiment of the present application may be a device having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiment of the present application.

[0208] The control device of the electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment, and will not be described again here to avoid repetition.

[0209] Alternatively, if Fig. 20 As shown, an embodiment of the present application further provides an electronic device 90, including a processor 91 and a memory 92, wherein the memory 92 stores programs or instructions that can be executed on the processor 91, and when the program or instructions are executed by the processor 91, the various steps of the control method embodiment of the above-mentioned electronic device are implemented, and the same technical effect can be achieved. To avoid repetition, they are not described here.

[0210] It should be noted that the electronic devices in the embodiments of the present application include the mobile electronic devices and non-mobile electronic devices mentioned above.

[0211] Fig.21 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of the present application.

[0212] The electronic device 100 includes but is not limited to components such as a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110.

[0213] Those skilled in the art will appreciate that the electronic device 100 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 110 through a power management system, thereby implementing functions such as managing charging, discharging, and power consumption management through the power management system. Fig.21 The electronic device structure shown in the figure does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently, which will not be described in detail here.

[0214] The processor 110 receives first information, which includes operation intention information and operation information, and executes an operation corresponding to the operation information according to the operation intention information.

[0215] Optionally, the above operation intention information is an operation intention symbol.

[0216] Optionally, the user input unit 107 is used to receive a first input to the artificial intelligence AI interaction interface; the processor 110 is specifically used to determine the first information in response to the first input.

[0217] Optionally, the above-mentioned operation intention information is used to indicate the search intention, and the above-mentioned operation information is a search text; the processor 110 is specifically used to perform a search operation on the search text.

[0218] Optionally, the above-mentioned operation intention information is used to indicate the operation intention of the electronic device, and the above-mentioned operation information is an operation instruction; the processor 110 is specifically used to execute the operation corresponding to the operation instruction.

[0219] Optionally, the above-mentioned operation intention information is used to indicate the operation intention of utilizing the AI ​​function, and the above-mentioned operation information is an AI operation instruction; the processor 110 is specifically used to utilize the AI ​​function to execute the operation corresponding to the AI ​​operation instruction.

[0220] Optionally, the display unit 106 is used to display prompt information in response to the first input; the prompt information is used to prompt the operation intention corresponding to the operation intention information.

[0221] In the electronic device provided in the embodiment of the present application, since the operation intention information can reflect the user's operation intention, that is, the user can directly input the operation intention information to indicate the user's operation requirements to the electronic device, and then the user can input the operation information so that the electronic device performs the operation that meets the user's operation requirements based on the operation information, the efficiency of the electronic device in performing operations can be improved.

[0222] The electronic device provided in the embodiment of the present application can implement each process implemented in the above method embodiment and can achieve the same technical effect. To avoid repetition, it will not be described here.

[0223] The beneficial effects of various implementations in this embodiment can be specifically referred to the beneficial effects of the corresponding implementations in the above method embodiment. To avoid repetition, they will not be described again here.

[0224] It should be understood that in the embodiment of the present application, the input unit 104 may include a graphics processor (Graphics Processing Unit, GPU) 1041 and a microphone 1042, and the graphics processor 1041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc. The user input unit 107 includes a touch panel 1071 and at least one of other input devices 1072. The touch panel 1071 is also called a touch screen. The touch panel 1071 may include two parts: a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.

[0225] The memory 109 can be used to store software programs and various data. The memory 109 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc. In addition, the memory 109 may include a volatile memory or a non-volatile memory, or the memory 109 may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDRSDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synchronous link dynamic random access memory (SLDRAM) and a direct memory bus random access memory (DRRAM). The memory 109 in the embodiment of the present application includes but is not limited to these and any other suitable types of memory.

[0226] The processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 110.

[0227] An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the various processes of the above-mentioned method embodiment are implemented and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0228] The processor is the processor in the electronic device described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.

[0229] An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0230] It should be understood that the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.

[0231] An embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to implement the various processes of the above-mentioned method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.

[0232] It should be noted that, in this article, the terms "comprise", "include" or any other variant thereof are intended to cover non-exclusive inclusion, so that the process, method, article or device including a series of elements includes not only those elements, but also includes other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise one..." do not exclude the presence of other identical elements in the process, method, article or device including the element. In addition, it should be pointed out that the scope of the methods and devices in the embodiments of the present application is not limited to performing functions in the order shown or discussed, and may also include performing functions in a substantially simultaneous manner or in reverse order according to the functions involved, for example, the described method may be performed in an order different from that described, and various steps may also be added, omitted, or combined. In addition, the features described with reference to certain examples may be combined in other examples.

[0233] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present application, or the part that contributes to the prior art, can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM / RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.

[0234] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific implementation methods. The above-mentioned specific implementation methods are merely illustrative and not restrictive. Under the guidance of the present application, ordinary technicians in this field can also make many forms without departing from the purpose of the present application and the scope of protection of the claims, all of which are within the protection of the present application.

Claims

1. A control method for an electronic device, characterized in that: The method comprises: Receive first information; the first information includes operation intention information and operation information; According to the operation intention information, the operation corresponding to the operation information is performed.

2. The method according to claim 1, characterized in that: The operation intention information is an operation intention symbol.

3. The method according to claim 1, characterized in that The receiving of the first information comprises: Receiving a first input to the artificial intelligence AI interaction interface; In response to the first input, the first information is determined.

4. The method according to claim 1, characterized in that: The operation intention information is used to indicate the search intention, and the operation information is the search text; The performing, according to the operation intention information, an operation corresponding to the operation information, includes: A search operation is performed on the search text.

5. The method according to claim 1, characterized in that The operation intention information is used to indicate the operation intention of the electronic device, and the operation information is an operation instruction; The performing, according to the operation intention information, an operation corresponding to the operation information, includes: Execute the operation corresponding to the operation instruction.

6. The method according to claim 1, characterized in that The operation intention information is used to indicate the operation intention of utilizing the AI ​​function, and the operation information is an AI operation instruction; The performing, according to the operation intention information, an operation corresponding to the operation information, includes: The AI ​​function is used to perform the operation corresponding to the AI ​​operation instruction.

7. The method according to claim 3, characterized in that The method further comprises: In response to the first input, prompt information is displayed; the prompt information is used to prompt the operation intention corresponding to the operation intention information.

8. A control device for an electronic device, characterized in that: The control device of the electronic device comprises: a receiving module and an execution module; The receiving module is used to receive first information; the first information includes operation intention information and operation information; The execution module is used to execute the operation corresponding to the operation information according to the operation intention information received by the receiving module.

9. An electronic device, characterized in that: The electronic device comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the control method of the electronic device as described in any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or an instruction, and when the program or the instruction is executed by the processor, the steps of the control method of the electronic device according to any one of claims 1 to 7 are implemented.

Images