Voice recognition method and electronic device supporting the method

Abstract

An electronic device is provided. The electronic device includes a display, a microphone, a memory, a communication circuit, and a processor. The processor receives a user's voice input via the microphone, displays a first response corresponding to the voice input on the display, receives a first user input, displays a user interface for changing at least one parameter associated with the voice input in response to the first user input, receives a second user input via the user interface, and displays a second response corresponding to the voice input on the display based on a value of the at least one parameter, the value being selected by the second user input.

Description

Technical Field

[0001] The present disclosure relates to technology regarding a method for recognizing a user's voice and an electronic device for supporting the method. Background Art

[0002] Various electronic devices that operate in response to a user's interactive voice input (or vocal input or voice command input) have been put on the market. For example, a smart phone can perform various functions such as making / making calls, sending and receiving messages, file transfer, and web searching in response to a user's voice input.

[0003] The electronic device can analyze the user's voice input by using internal arithmetic operations or processing of an external server. The electronic device can display the result of analyzing the voice input and can provide various services desired by the user.

[0004] The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with respect to the present disclosure. Summary of the invention

[0005] Technical issues

[0006] When providing a service corresponding to a user's voice input, an electronic device according to the prior art may provide the service in a manner of simply displaying the result or in a manner of allowing the user to continuously select one of various options. In a manner of simply displaying the result, when the user wants to change the option, he or she has to generate a voice input again. In a manner of allowing the user to select one of various options, the user has to generate an additional input for continuously determining the option regarding the one-time voice input.

[0007] Technical Solution

[0008] Aspects of the present disclosure are to solve at least the above problems and / or disadvantages and provide at least the advantages described below. Therefore, one aspect of the present disclosure is to provide a device and method for recognizing a user's voice and an electronic device for supporting the method.

[0009] Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments.

[0010] According to one aspect of the present invention, an electronic device is provided. The electronic device includes a display, a microphone, a memory, a communication circuit, and a processor. The processor can be configured to: receive a user's voice input via the microphone; display a first response corresponding to the voice input on the display; receive a first user input on the display; display a user interface for changing at least one parameter associated with the voice input on the display; receive a second user input via the user interface in response to the first user input; and display a second response corresponding to the voice input on the display based on a value of at least one parameter, the value being selected by the second user input.

[0011] Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure.

[0012] Beneficial Effects

[0013] The electronic device according to various embodiments disclosed in the present disclosure may display a first response corresponding to a one-time voice input, and then may display a second response whose execution option is changed by a simple user input.

[0014] The electronic device according to various embodiments disclosed in the present disclosure can provide a user interface that can change the parameters of the voice input in various ways. In addition, various effects determined directly or indirectly by the present disclosure can be provided. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description in conjunction with the accompanying drawings, in which:

[0016] Figure 1 is a diagram illustrating an integrated intelligent system according to an embodiment of the present disclosure;

[0017] Figure 2 is a block diagram showing a configuration of a user terminal according to an embodiment of the present disclosure;

[0018] Figure 3 is a flow chart illustrating a method for processing voice input according to an embodiment of the present disclosure;

[0019] Figure 4 is a diagram showing a screen for displaying a parameter UI according to an embodiment of the present disclosure;

[0020] Figure 5 is a diagram illustrating a screen indicating a button type object for changing a value of an option parameter according to an embodiment of the present disclosure;

[0021] Figure 6is a diagram illustrating a screen indicating a selection type object and a pop-up window for changing a value of an option parameter according to an embodiment of the present disclosure;

[0022] Figure 7 is a diagram showing a screen indicating provision of additional information associated with an option parameter according to an embodiment of the present disclosure;

[0023] Figure 8 is a diagram showing a screen indicating a transition between a first response and a second response according to an embodiment of the present disclosure;

[0024] Fig. 9 is a diagram illustrating a screen when there is no optional parameter according to an embodiment of the present disclosure; and

[0025] Fig.10 is a block diagram illustrating electronic devices in a network environment according to an embodiment of the present disclosure.

[0026] Throughout the drawings, like reference numerals will be understood to refer to like parts, components and structures. DETAILED DESCRIPTION

[0027] The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of the various embodiments of the present invention as defined by the claims and their equivalents. It includes various specific details to assist in understanding, but these are considered to be exemplary only. Therefore, it will be appreciated by those of ordinary skill in the art that various changes and modifications may be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and structures may be omitted for clarity and brevity.

[0028] The terms and words used in the following description and claims are not limited to the bibliographic meanings, but are merely used by the inventor to enable a clear and consistent understanding of the present disclosure. Therefore, it should be clear to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustrative purposes only and not for limiting the disclosure defined by the attached claims and their equivalents.

[0029] In the disclosure disclosed herein, the expressions “having”, “may have”, “include” and “including” or “may include” and “may include” used herein indicate the existence of corresponding features (for example, elements such as values, functions, operations or components), but do not exclude the existence of additional features.

[0030] In the disclosure disclosed herein, the expressions "A or B", "at least one of A or / and B", or "one or more of A or / and B", etc. used herein may include any and all combinations of one or more of the relevant listed items. For example, the term "A or B", "at least one of A and B", or "at least one of A or B" may refer to all of the following cases: (1) a case including at least one A; (2) a case including at least one B; or (3) a case including both at least one A and at least one B.

[0031] The terms used herein, such as "first", "second", etc., may refer to various elements of various embodiments of the present disclosure, but are not limited to these elements. For example, such terms are only used to distinguish an element from another element, without limiting the order and / or priority of the elements. For example, a first user device and a second user device may represent different user devices, regardless of order or importance. For example, without departing from the scope of the present disclosure, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.

[0032] It should be understood that when an element (e.g., a first element) is referred to as being (operably or communicatively) coupled or connected to another element (e.g., a second element), it may be directly coupled and / or connected to another element, or there may be an intermediate element (e.g., a third element). Conversely, when an element (e.g., a first element) is referred to as being directly coupled or directly connected to another element (e.g., a second element), it should be understood that there is no intermediate element (e.g., a third element).

[0033] Depending on the situation, the expression "configured to" used herein may be used as, for example, the expression "suitable for", with "designed to", "suitable for", "manufactured to", or "capable of". The term "configured to" does not necessarily mean only "specially designed to" in hardware. On the contrary, a device "configured to" may mean that the device is able to "operate" with another device or other component. CPU, for example, "a processor configured to" perform A, B, and C" may mean a dedicated processor (e.g., an embedded processor) for performing the corresponding operations, or a general-purpose processor (e.g., a central processing unit (CPU) or an application processor) that can perform the corresponding operations by executing one or more software programs stored in a memory device.

[0034] The terms used in this specification are used to describe the specific embodiments of the present disclosure, rather than to limit the scope of the present disclosure. Unless otherwise specified, the terms in the singular may include plural forms. Unless otherwise defined herein, all terms used herein (including technical or scientific terms) may have the same meanings commonly understood by those skilled in the art. It will be further understood that, unless clearly defined in the various embodiments of the present disclosure, the terms defined in the dictionary and commonly used should also be interpreted as being customary in the relevant related fields, rather than being interpreted in an idealized or overly formalized manner. In some cases, even if the terms are defined in the specification, they cannot be interpreted as contradictory to the embodiments of the present disclosure.

[0035] According to various embodiments of the present disclosure, wearable devices may include accessories (e.g., watches, rings, bracelets, anklets, glasses, contact lenses, or head-mounted devices (HMDs)), fabric-integrated types (e.g., electronic apparel), body-attached types (e.g., skin pads or tattoos), or implantable types (e.g., implantable circuits).

[0036] Hereinafter, an electronic device according to an embodiment of the present disclosure will be described with reference to the accompanying drawings. The term "user" used herein may refer to a person using an electronic device, or may refer to a device (eg, an artificial intelligence electronic device) using the electronic device.

[0037] Figure 1 is a diagram illustrating an integrated intelligent system according to an embodiment of the present disclosure.

[0038] Reference Figure 1 , the integrated intelligent system 10 may include a user terminal 100 , an intelligent server 200 and a business server 300 .

[0039] According to an embodiment, the user terminal 100 may provide a specified service to its user through an application (or applications) stored therein (e.g., an alarm application, a message application, a scheduling application, etc.). According to an embodiment, the user terminal 100 may provide a voice recognition service through an intelligent application (or a voice recognition application) stored therein. For example, the user terminal 100 may recognize a voice input received through an intelligent application, and may provide a service corresponding to the recognized voice input to the user. According to an embodiment, the user terminal 100 may correspond to each of various terminal devices (or various electronic devices) that may be connected to the Internet, such as a mobile phone, a smart phone, a personal digital assistant (PDA), or a notebook computer. Alternatively, the user terminal 100 may be a device such as a television (TV), a refrigerator, a speaker, etc., each of which includes a display.

[0040] According to an embodiment, the user terminal 100 may receive user input. The user input may include, for example, input through a physical button, touch input, voice input, etc. According to an embodiment, the user terminal 100 may receive a voice input by a user's speech. The user terminal 100 may perform a specified operation based on the received voice input. For example, the user terminal 100 may execute an app corresponding to the received voice input, and may perform a specified operation with the aid of the executed app.

[0041] According to an embodiment, the intelligent server 200 may receive a voice input from the user terminal 100 via a communication network. According to an embodiment, the intelligent server 200 may change the received voice input into text data. According to an embodiment, the intelligent server 200 may generate a plan for performing a specified task based on the text data. The plan may include, for example, a plurality of operations arranged on a step-by-step basis (or on a hierarchical basis) to perform a task corresponding to the user's intention. A plurality of concepts may be a format that defines input values ​​(or parameters) and result values ​​associated with the plurality of operations.

[0042] According to an embodiment, the plan may be generated by an artificial intelligence (AI) system. The AI ​​system may be a rule-based system or may be a system based on a neural network (e.g., a feedforward neural network (FNN) or a recursive neural network (RNN)). Alternatively, the AI ​​system may be a combination of the above systems or an AI system different from the above systems. According to an embodiment, the plan may be selected from a set of predefined plans, or the plan may be generated in real time in response to a user request. For example, the AI ​​system may select a plan from at least a plurality of predefined plans, or may generate a plan based on dynamics (or based on real time). In addition, the user terminal 100 may provide a plan using a hybrid system.

[0043] According to an embodiment, the intelligent server 200 may send the result according to the generated plan to the user terminal 100, or may send the generated plan to the user terminal 100. According to an embodiment, the user terminal 100 may display the result on its display according to the plan. According to an embodiment, the user terminal 100 may display the result of performing the operation according to the plan on the display.

[0044] According to an embodiment, the business server 300 may provide a specified service (e.g., food order, hotel reservation, etc.) to the user terminal 100. According to an embodiment, the business server 300 may be a server operated by a third party. The third party may be a person other than the manufacturer of the user terminal 100 and the person operating the intelligent server 200. According to an embodiment, the business server 300 may provide information about the specified service to the intelligent server 200. According to an embodiment, the intelligent server 200 may determine the operation for performing a task corresponding to the voice input based on the information provided. According to an embodiment, the business server 300 may provide information about the result of performing the determined operation to the intelligent server 200. The intelligent server 200 may send the result information to the user terminal 100.

[0045] Therefore, the integrated intelligent system 10 can recognize the intention of the user's speech through the intelligent server 200, and can determine its operation to distinguish the level of processing inputs made through physical buttons, touch panels, etc. or voice inputs for performing simple operations (for example, activation of an electronic device or execution of a program) and provide a new type of input interface that is capable of processing user speech for multiple operations that require organic correlation with each other.

[0046] According to various embodiments, the service server 300 may provide the smart server 200 with an execution result associated with an application not installed in the user terminal 100. The smart server 200 may provide the user terminal 100 with a service associated with an application not installed in the user terminal 100 in response to a user's voice input.

[0047] Figure 2 is a block diagram illustrating a configuration of a user terminal according to an embodiment of the present invention.

[0048] Reference Figure 2 , the user terminal 100 may include a communication interface 110 , a microphone 120 , a speaker 130 , a display 140 , a memory 150 , and a processor 160 .

[0049] According to an embodiment, the communication interface 110 can be connected to an external device to send and receive data. For example, the communication interface 110 can send the received voice input to the intelligent server 200. In addition, the communication interface 110 can receive a response corresponding to the voice input. The response can include, for example, information for performing a task corresponding to the voice input or a result of performing the task.

[0050] According to an embodiment, the microphone 120 may receive a voice input by a user's speech. For example, the microphone 120 may detect a user's speech and may generate a signal (or a voice signal) corresponding to the detected user's speech.

[0051] According to an embodiment, the speaker 130 may output a voice signal. For example, the speaker 130 may output a voice signal generated in the user terminal 100 to the outside.

[0052] According to an embodiment, the display 140 may display an image (or a video image). For example, the display 140 may display a graphical user interface (GUI) of an executed app.

[0053] According to an embodiment, the memory 150 may store a client module 151 and a software development kit (SDK) 153. Each of the client module 151 and the SDK 153 may be a framework (or solution program) for performing a general function. For example, each of the client module 151 and the SDK 153 may be a framework for processing voice input. According to an embodiment, each of the client module 151 and the SDK 153 may be executed by the processor 160, and its functions may be implemented. According to an embodiment, the client module 151 and the SDK 153 may be implemented with hardware as well as software.

[0054] According to an embodiment, the memory 150 may store a plurality of applications (or applications) 155. The plurality of applications 155 may be programs for performing a specified function. According to an embodiment, the plurality of applications 155 may include a first application 155_1, a second application 155_3, etc. According to an embodiment, each of the plurality of applications 155 may include a plurality of operations for performing a specified function. According to an embodiment, the plurality of applications 155 may be executed by the processor 160 to sequentially perform at least some of the plurality of operations. The processor 160 may control the operations of the plurality of applications 155 through the SDK 153.

[0055] According to an embodiment, the processor 160 may control the overall operation of the user terminal 100. For example, the processor 160 may control the communication interface 110 to connect to an external device. The processor 160 may be connected to the microphone 120 to receive a voice input. The processor 160 may be connected to the speaker 130 to output a voice signal. The processor 160 may be connected to the display 140 to output an image. The processor 160 may execute a program stored in the memory 150 to perform a specified function.

[0056] According to an embodiment, the processor 160 may execute at least one of the client module 151 and the SDK 153 to perform the following operation for processing a voice input. The operations described below as the operations of the client module 151 and the SDK 153 may be operations performed by the processor 160.

[0057] According to an embodiment, the client module 151 may receive a voice input. For example, the client module 151 may receive a voice signal corresponding to a user's speech detected by the microphone 120. According to an embodiment, the client module 151 may preprocess the received user input. According to an embodiment, in order to preprocess the user input, the client module 151 may include an adaptive echo canceller (AEC) module, a noise suppression (NS) module, an endpoint detection (EPD) module, or an automatic gain control (AGC) module. The AEC module may cancel the echo included in the user input. The NS module may suppress background noise included in the user input. The EPD module may detect the endpoint of the user's voice included in the user input, and may use the detected endpoint to find a portion where the user's voice exists. The AGC module may adjust the volume of the user input to be suitable for identifying the user input and processing the identified user input. According to an embodiment, all preprocessing components may be executed to perform performance, but some preprocessing components may be executed to operate at low power.

[0058] According to an embodiment, the client module 151 may send the received voice input to the intelligent server 200. For example, the client module 151 may send the first data corresponding to the received voice input to the intelligent server 200 through the communication interface 110. According to an embodiment, the client module 151 may send the state information of the user terminal 100 together with the received voice input to the intelligent server 200. The state information may be, for example, information about the state of executing the app. According to an embodiment, the client module 151 may obtain the information about the state of executing the app through the SDK 153.

[0059] According to an embodiment, the client module 151 may receive text data corresponding to the transmitted voice input. According to an embodiment, the client module 151 may display the received text data on the display 140. The client module 151 may display the received text data on the display 140 in a streaming manner. Therefore, the user may recognize the voice input received in the user terminal 100.

[0060] According to an embodiment, the client module 151 may receive a result corresponding to the received voice input. For example, when the intelligent server 200 is capable of calculating a result corresponding to the received voice input (in the case of a server endpoint), the client module 151 may receive a result corresponding to the received voice input. The result may include, for example, information corresponding to the received voice input. In addition, the result may also include information about a specified state of a specified application (e.g., the first application 155_1) for displaying information. According to an embodiment, the client module 151 may display the received result on the display 140.

[0061] According to an embodiment, the client module 151 may receive a request for obtaining information necessary for calculating a result corresponding to a voice input from the intelligent server 200. According to an embodiment, the client module 151 may send necessary information to the intelligent server 200 in response to the request. Therefore, the client module 151 may receive a result calculated using the information.

[0062] According to an embodiment, the client module 151 may receive a plan corresponding to the received voice input. For example, when the intelligent server 200 cannot obtain a result corresponding to the received user input (in the case of a client endpoint), the client module 151 may receive a plan corresponding to the received voice input. The plan may include, for example, multiple operations for performing tasks corresponding to the voice input and multiple concepts associated with the multiple operations. The concept may be a parameter defined when performing multiple operations or a result value output by performing multiple operations. In addition, the plan may include information about the arrangement relationship between the multiple operations and between the multiple concepts. Multiple operations and multiple concepts may be arranged step by step (or sequentially) to perform tasks corresponding to the voice input. According to an embodiment, the client module 151 may deliver the received plan to the SDK 153.

[0063] According to an embodiment, the client module 151 may use a deep link when receiving information required for performing an operation from the smart server 200. For example, the client module 151 may receive operation information for obtaining necessary information and a deep link including a plan corresponding to a voice input from the smart server 200. The plan may include a plurality of pieces of operation information for performing a task.

[0064] According to an embodiment, SDK 153 may execute at least one of the plurality of applications 155 (e.g., first application 155_1 and second application 155_2) according to a plan, and may perform a specified operation of the at least one application executed. For example, SDK 153 may bind at least one app to be executed according to a plan, and may pass a command to the bound app to perform a specified operation according to a plan. When a result value generated by an operation of one app (e.g., first app_155_1) is a parameter input (or a parameter that must be input) in executing an operation of another app (or second app_155_2), SDK 153 may pass the generated result value from one app to another app.

[0065] According to an embodiment, the client module 151 may display the results of executing multiple operations of the application according to the plan on the display 140. The client module 151 may sequentially display the results of executing the multiple operations on the display 140. For another example, the user terminal 100 may display only some of the multiple operations (e.g., only the result of the last operation) on the display 140. For another example, the user terminal 100 may receive the results of executing the operations according to the plan from the smart server 200, and may display the received results on the display 140.

[0066] According to another embodiment, the SDK 153 may be included in each of the plurality of applications 155. In other words, each of the plurality of applications 155 may include the SDK 153. When each of the plurality of applications 155 includes the SDK 153, the client module 151 may execute the application according to a plan, and may send a request for performing a designated operation through the SDK 153 included in each of the plurality of applications 155.

[0067] According to an embodiment, the client module 151 may send information about the results of performing a plurality of operations according to a plan to the intelligent server 200. The intelligent server 200 may use the result information to determine that the received voice input is processed correctly.

[0068] According to an embodiment, the client module 151 may receive a request for obtaining additional information from the intelligent server 200. The additional information may be information necessary for determining a plan corresponding to the received voice input. For example, the additional information may include any one of the state information of the user terminal 100 or the content information stored in the memory 150 of the user terminal 100. According to an embodiment, the client module 151 may obtain information about the state of executing the app through the SDK 153. According to an embodiment, when the information necessary for determining the plan is not included in the received voice input, the intelligent server 200 may send a request to the user terminal 100 to obtain the additional information.

[0069] According to an embodiment, the client module 151 may include a voice input module. According to an embodiment, the client module 151 may recognize voice input for executing limited functions through the voice input module. For example, the client module 151 may execute an intelligent application for processing voice input so as to perform organic operations (such as wake up!) by specifying input. According to an embodiment, the voice input module may help the intelligent server 200 process voice input. Therefore, the voice input module may quickly process voice input that can be processed in the user terminal 100.

[0070] According to an embodiment, the speed recognition module of the client module 151 may use a specified algorithm to recognize the voice input. The specified algorithm may include, for example, at least one of a Hidden Markov Model (HMM) algorithm, an Artificial Neural Network (ANN) algorithm, or a Dynamic Time Warping (DTW) algorithm.

[0071] Figure 3 is a flow chart illustrating a method for processing speech input according to an embodiment of the present invention.

[0072] Reference Figure 3 In operation 310, Figure 2 The processor 160 may be configured to Figure 2 The microphone 120 receives the user's voice input (or vocal input or voice command). According to an embodiment, the processor 160 can execute a smart application to wait for receiving the user's voice input. The smart application can be executed by the user's input, or can be executed by calling another application.

[0073] According to an embodiment, the processor 160 may convert the electrical signal generated by the microphone 120 into text, and may display the text in real time. Figure 2 The converted text is displayed on the display 140.

[0074] According to an embodiment, the processor 160 may Figure 2 The intelligent server 200 provides voice input (or information converting the voice input into the voice input (e.g., converting voice into text)).

[0075] The voice input may be an interactive command informed by the user. For example, the voice input may be a sentence "find a hotel under $400 in San Jose for Thanksgiving holiday", "send these photos to mom", etc.

[0076] According to various embodiments, voice input may include Figure 2 At least one parameter necessary for the user terminal 100 to perform the service (or response or task) corresponding to the voice input. In the voice input "Looking for hotels under $400 in San Jose for Thanksgiving holiday", the processor 160 can determine "Thanksgiving holiday", "San Jose", "$400", "hotel", etc. as parameters. For another example, in the voice input "Send these photos to mom", the processor 160 can determine "these photos (e.g., photos selected on the screen)", "mom", etc. as parameters.

[0077] Each parameter can have specified attributes (e.g., location attribute, date attribute, time attribute, application type attribute, etc.) and can be changed to a specified type (e.g., "Thanksgiving Holiday" → "2018 / 11 / 18").

[0078] According to various embodiments, the processor 160 of the user terminal 100 or the intelligent server 200 may determine a parameter not included in the user's voice input (hereinafter referred to as a "hidden parameter"). The hidden parameter may be necessary for performing a service (or response or task) corresponding to the user's voice input and may be determined according to a specified rule not included in the user's voice input.

[0079] For example, in the voice input "Looking for hotels under $400 in San Jose for Thanksgiving vacation (on the hotel search app)", the processor 160 or the intelligent server 200 may determine "on the hotel search app" which is not included in the user's voice input as a hidden parameter. For another example, in the voice input "Send these photos to mom (via the messaging app)", the processor 160 or the intelligent server 200 may determine "message app" which is not included in the user's voice input as a hidden parameter.

[0080] The hidden parameter may be determined based on a state of using the user terminal 100 , application execution information of the user terminal 100 , a history of user execution of applications, and the like.

[0081] According to various embodiments, the processor 160 of the user terminal 100 or the intelligent server 200 may determine a parameter (hereinafter referred to as an "option parameter") that can be changed within a specified range among parameters regarding the user's voice input. The option parameter may be a parameter that is variable within a specified range between parameters or hidden parameters that are included in the user's voice input.

[0082] For example, in the voice input "Looking for a hotel in San Jose during Thanksgiving holiday", the processor 160 of the user terminal 100 or the intelligent server 200 may determine "Thanksgiving holiday" with a periodic attribute as an option parameter. When two identical place names are found for "San Jose" with a location attribute, the processor 160 of the user terminal 100 or the intelligent server 200 may determine "San Jose" as an option parameter.

[0083] In operation 320, the processor 160 may display a first response corresponding to the voice input on the display 140. For example, in response to the voice input "Looking for hotels under $400 in San Jose for Thanksgiving vacation", the processor 160 may use the "Hotels.com" application to display the result of searching for a list of hotels under $400 that can be reserved for Thanksgiving vacation near San Jose.

[0084] According to an embodiment, although the hidden parameter is included in the user's voice input, the processor 160 may display the first response without requesting a separate additional input.

[0085] According to an embodiment, the processor 160 may use the intelligent server 200 to analyze and process the voice input. The processor 160 may send the voice input (or information associated with the voice input) to the intelligent server 200. The intelligent server 200 may receive the voice input from the user terminal 100 through a communication network. According to an embodiment, the intelligent server 200 may change the received voice input into text data. According to an embodiment, the intelligent server 200 may generate a plan for executing a specified task based on the text data.

[0086] The intelligent server 200 can send the result to the user terminal 100 according to the generated plan. The user terminal 100 can display the result on the display 140 as the first response according to the plan. The intelligent server 200 can use Figure 2 The business server 300 executes the plan.

[0087] According to another embodiment, the intelligent server 200 may send the generated plan to the user terminal 100. The user terminal 100 may perform operations according to the received plan. The user terminal 100 may display the result performed by the user terminal 100 on the display 140 as a first response.

[0088] In operation 330, the processor 160 may receive a first user input. The first user input may be an input for displaying a user interface (UI) for changing a value of an option parameter associated with the voice input.

[0089] The processor 160 may receive a first user input in a state where a first response to the user's voice input is displayed on the display 140. For example, the first user input may be an input for swiping the screen in a specified direction (e.g., an upward and downward direction). For another example, the first user input may be a touch input for pressing a button displayed together with the first response.

[0090] In operation 340, the processor 160 may display a UI for changing the value of the option parameter (hereinafter referred to as "parameter UI") in response to the first user input. For example, the parameter UI may be a window overlapping the first response. For another example, the UI may be a pop-up window displayed adjacent to the touch button on which the first user input occurs. Here, it is not limited thereto, and various types of parameter UIs are possible.

[0091] In operation 350, the processor 160 may receive a second user input. The second user input may be an input for selecting a value of an option parameter.

[0092] When the second user input occurs, in operation 360 , the processor 160 may display a second response based on the value of the option parameter selected by the second user input.

[0093] According to an embodiment, the processor 160 may replace a portion of the first response to generate a second response. For example, the processor 160 may change the search value to a cycle changed by the second user input, and may display the found hotel on the hotel search application installed in the user terminal 100.

[0094] According to another embodiment, the processor 160 may receive a new result based on the value of the option parameter selected from the intelligent server 200, and may display the second response independently of the first response.

[0095] According to various embodiments, a voice recognition method performed in an electronic device may include: receiving a user's voice input via a microphone of the electronic device; displaying a first response corresponding to the voice input on a display of the electronic device; receiving a first user input; in response to the first user input, displaying a user interface for changing at least one parameter associated with the voice input; receiving a second user input; and displaying a second response corresponding to the voice input on the display based on the value of at least one parameter selected by the second user input.

[0096] According to various embodiments, the voice recognition method may further include: changing a value of at least one parameter by additional voice input after the voice input.

[0097] According to various embodiments, displaying the first response may include sending a value of at least one parameter to an external server and receiving the first response. Displaying the second response may include sending a selected value of the parameter to an external server and receiving the second response.

[0098] According to various embodiments, displaying the first response may include receiving a first response associated with executing an application not installed in the electronic device. Displaying the second response may include receiving a second response associated with executing an application not installed in the electronic device.

[0099] According to various embodiments, displaying the user interface may include: displaying the user interface including an image associated with at least one parameter.

[0100] According to various embodiments, displaying the second response may include: displaying the second response and a first object for changing the screen to the first response. The speech recognition method may also include: after the screen is changed by user input, displaying the first response and a second object for changing the screen to the second response, wherein the user input occurs on the first object.

[0101] Figure 4 is a diagram illustrating a screen for displaying a parameter UI according to an embodiment of the present disclosure. Figure 4 This is merely illustrative and not limiting.

[0102] Reference Figure 4 , Figure 2 The processor 160 may execute a smart application. The smart application may receive a user's voice input and may display a response corresponding to the received voice input. The smart application may be executed by the user's input or may be executed by calling another application.

[0103] For example, the processor 160 may execute the smart application in response to a voice input (wake-up word) (e.g., Hi Bixby) (start speaking) for starting a user's voice command. For another example, the processor 160 may execute the smart application by a user input appearing on a dedicated button for executing the smart application.

[0104] On screen 410, when the smart application is executed, the processor 160 may enter an idle state capable of receiving a user's voice input. The processor 160 may display a state of waiting to receive a user's voice input using text or voice.

[0105] On screen 420, processor 160 may receive a user's voice input. Processor 160 may convert the received voice input into text 421 and may display the received voice input in a text format. Figure 2 The text 421 is displayed on the display 140 of the processor 160. While recognizing the displayed text 421, the user can determine whether the recognized voice input matches the user's intention. According to various embodiments, the processor 160 can send the received voice input or the text 421 converted from the voice input to the processor 160. Figure 2 Intelligent server 200.

[0106] On screen 430, the processor 160 may display an idle screen while processing the user's voice input. The processor 160 may display an animation image 431 indicating that the voice input is being processed.

[0107] On the screen 440, the processor 160 may display a first response 441 corresponding to the user's voice input. According to an embodiment, the processor 160 may receive a result according to a plan generated by the smart server 200, and may display the first response 441 on the display 140 based on the received result. For example, when there is a voice input "Looking for a hotel under $400 in San Jose for Thanksgiving holiday", the processor 160 may receive the result (hotel list) found by the hotel search app from the smart server 200, and may display the received result as the first response 441.

[0108] According to another embodiment, the processor 160 may receive a plan generated by the intelligent server 200 and may Figure 2The user terminal 100 performs an operation according to the received plan. The processor 160 can display the executed result on the display 140 as a first response 441. For example, when there is a voice input "Looking for hotels under $400 in San Jose during the Thanksgiving holiday", the processor 160 can receive a plan including execution app information (Hotels.com), cycle information (2018 / 11 / 18), location information (San Jose, USA), amount information ($0-$400), etc. from the smart server 200. In the user terminal 100 itself, the processor 160 can execute the "Hotels.com" application according to the received plan, and can input cycle information (2018 / 11 / 18), location information (San Jose, USA), amount information ($0-$400), etc. as search options, thereby displaying the found results on the display 140 as a first response 441.

[0109] According to various embodiments, when there is an option parameter associated with a voice input, the processor 160 or the intelligent server 200 may determine a value according to a specified rule, and may display a first response 441. For example, when there is a voice input "find a hotel under $400 in San Jose during the Thanksgiving holiday", the location parameter ("San Jose") may be found in the United States as a first area, and in Costa Rica as a second area. In this case, the processor 160 or the intelligent server 200 may determine an area based on the location of the user terminal 100, the distance between the user terminal 100 and the first area or the second area, historical information about the movement path of the user terminal 100, etc., and may display the result of searching for a hotel in the determined area as a first response 441.

[0110] According to various embodiments, the processor 160 may receive a first user input 445 for changing a value of an option parameter in a state where the first response 441 is displayed. For example, the first user input 445 may be an upward and downward sliding input.

[0111] On screen 450, processor 160 may display a parameter UI for selecting a value of an option parameter in response to first user input 445. For example, the parameter UI may be a window overlapped with first response 441 and displayed.

[0112] The parameter UI may include a list of at least one option parameter, such as a location parameter 451 , a date parameter 452 , and an application type parameter 453 .

[0113] Processor 160 may determine whether a second user input 455 for selecting one of the option parameters in the list occurs.

[0114] On screen 460 , the processor 160 may display a variable value of the option parameter selected by the second user input 455 appearing on the parameter UI.

[0115] For example, when the second user input 455 selects the location parameter 451, the processor 160 may display a variable value as the location parameter 451. For example, in the voice input "Looking for hotels under $400 in San Jose for Thanksgiving vacation", the location parameter 451 may include a first region in the United States and a second region in Costa Rica.

[0116] When the third user input 465 for changing the location parameter 451 occurs, the processor 160 may display a second response based on the value selected by the third user input 465. For example, in a state where the first response for searching for hotels around the first area is displayed, the processor 160 may display a second response for searching for hotels around the second area selected by the third user input 465.

[0117] Figure 5 is a diagram illustrating a screen indicating a button type object for changing a value of an option parameter according to an embodiment of the present disclosure. Figure 5 This is for illustrative purposes only and is not intended to be limiting.

[0118] Reference Figure 5 , on screen 540, Figure 2 The processor 160 may display a first response 541 corresponding to the user's voice input. The processor 160 may receive the first response 541 according to the voice input of the user. Figure 2 The intelligent server 200 generates the results of the plan, and can receive the results based on the received Figure 2 Alternatively, the processor 160 may receive a plan generated by the intelligent server 200 and may perform an operation according to the plan received in the user terminal 100. The processor 160 may display the executed result as the first response 541 on the display 140.

[0119] According to various embodiments, the processor 160 may display a button type object for changing the option parameter value and the first response 541. According to an embodiment, the button type object 542 may be displayed as an icon or text associated with one of the option parameters. For example, the button type object 542 may be displayed as an icon and a name of an application executed when the first response 541 is displayed. The processor 160 may receive a first user input 545 on the button type object 542.

[0120] On screen 550, processor 160 may display a parameter UI corresponding to first user input 545. For example, parameter UI may be a window that overlaps with first response 541 and is displayed. Parameter UI may include a list about at least one option parameter. The list may include, for example, app type parameter 553. Processor 160 may determine whether a second user input 555 for selecting one of the option parameters in the list occurs.

[0121] On screen 560 , the processor 160 may display an option list 561 including variable values ​​of the option parameter selected by the second user input 555 on the parameter UI.

[0122] For example, when the second user input 555 selects the app type parameter 553 , the processor 160 may display a variable value of the app type parameter 553 .

[0123] According to various embodiments, on screen 540 , when first user input 545 occurs, processor 160 may not display screen 550 , and may display option list 561 on screen 560 .

[0124] On screen 570 , processor 160 may display a second response 571 executed by a second application (eg, Expedia) selected by third user input 565 .

[0125] According to an embodiment, the processor 160 may transmit the information selected by the third user input 565 to the smart server 200, and may receive a result according to the plan generated by the smart server 200, thereby displaying a second response 571 on the display 140 based on the received result. For example, the smart server 200 may request the business server 300 associated with "Expedia" selected by the third user input 565 to search for a hotel and may receive the result. The smart server 200 may transmit the received result to the user terminal 100. The processor 160 of the user terminal 100 may display the received result of searching for a hotel as the second response 571.

[0126] According to another embodiment, the processor 160 may reflect the information selected by the third user input 565 in the plan received from the smart server 200. The processor 160 may perform an operation according to the plan in the user terminal 100, and may display the result of the execution on the display 140 as a second response 571. For example, the processor 160 may execute the "Expedia" application selected by the third user input 565, and may input the search options defined in the plan to search for hotels. The processor 160 may display the hotel search results found by the "Expedia" application as a second response 571.

[0127] According to various embodiments, the processor 160 may display a button type object 572 for changing a parameter together with the second response 571. The icon of the button type object 572 may be changed by reflecting information selected by the third user input 565.

[0128] Figure 6 is a diagram illustrating a screen indicating a selection type object and a popup window for changing a value of an option parameter according to an embodiment of the present disclosure. Figure 6 This is merely illustrative and not limiting.

[0129] Reference Figure 6 , on screen 640, Figure 2 The processor 160 may display a first response 641 corresponding to the user's voice input.

[0130] The processor 160 may receive Figure 2 The intelligent server 200 generates the results of the plan, and can receive the results based on the received Figure 2 Alternatively, the processor 160 may receive a plan generated by the intelligent server 200 and may generate a first response 641 based on the plan generated by the intelligent server 200. Figure 2 The processor 160 may display the result of the execution on the display 140 as a first response 641.

[0131] According to various embodiments, the processor 160 may display a button type object 642 for parameter change and a first response 641. According to an embodiment, the button type object 642 may be displayed as an icon or text associated with one of the selectable parameters. For example, the button type object 642 may be displayed as an icon or name of an application executed when the first response 641 is displayed. The processor 160 may receive a first user input 645 on the button type object 642.

[0132] exist Figure 6 In the embodiment, a button type object 642 is shown. However, the embodiment is not limited thereto. For example, a button type object may be displayed by the number of option parameters, or two or three of a plurality of option parameters may be selected, and icons associated with the selected option parameters may be displayed.

[0133] On the screen 660 , the processor 160 may include a popup window 661 including a variable value of an option parameter associated with the button type object 642 .

[0134] For example, in a state where a button type object 642 associated with the type of executed app is displayed, when a first user input 645 occurs, the processor 160 may display a popup window 661 including a variable value of an app type parameter adjacent to the button type object 642 .

[0135] In screen 670 , when a second user input 665 for selecting a second application (eg, Expedia) is received, the processor 160 may display a second response 671 executed by the second application (eg, Expedia).

[0136] According to various embodiments, the processor 160 may send information selected by the second user input 665 to the smart server 200, and may receive results according to a plan generated by the smart server 200, thereby displaying a second response 671 on the display 140 based on the received results.

[0137] According to another embodiment, the processor 160 may reflect the information selected by the second user input 665 in the plan received from the smart server 200. The processor 160 may perform an operation according to the plan in the user terminal 100, and may display the executed result as a second response 671 on the display 140.

[0138] According to various embodiments, the processor 160 may display a button type object 672 for parameter change and a second response 671. The icon of the button type object 672 may be changed by reflecting information selected by the second user input 665.

[0139] According to various embodiments, when a separate voice input 646 for option change occurs, the processor 160 may change the option parameter based on the voice input 646, and may display a second response 671. In this case, a separate pop-up window 661 may not be displayed (there may be a change from screen 640 to screen 670).

[0140] Figure 7 is a diagram illustrating a screen indicating provision of additional information associated with an option parameter according to an embodiment of the present disclosure. Figure 7 This is for illustrative purposes only and is not intended to be limiting.

[0141] Reference Figure 7 , on screen 750, Figure 2 The processor 160 may display a parameter UI capable of changing the value of the option parameter. The parameter UI may include a list of at least one option parameter. The processor 160 may determine whether a user input 755 for selecting an option parameter in the list occurs. The list may include, for example, a position parameter 751.

[0142] According to an embodiment, on the screen 750a, the processor 160 may display a list about option parameters using an image. For example, the processor 160 may display the location parameter 751a using a map image. The processor 160 may determine whether a user input 755a for selecting one option parameter in the list occurs.

[0143] On screen 770, processor 160 may display additional information 771 in response to user input 755 or user input 755a. For example, when position parameter 751 (or position parameter 751a) is selected by user input 755 (or user input 755a), processor 160 may display a movable map image as additional information 771.

[0144] When the location is changed by moving and selecting the map image, and when an input 775 for determining the user's location occurs, the processor 160 may display a second response performed through the determined location.

[0145] Figure 8 is a diagram illustrating a screen indicating a transition between a first response and a second response according to an embodiment of the present disclosure.

[0146] Reference Figure 8 , on screen 840, Figure 2 The processor 160 may display a first response 841 corresponding to the user's voice input. The processor 160 may display a button type object 842 for parameter change as well as the first response 841. According to an embodiment, the button type object 842 may be displayed as an icon or text associated with one of the option parameters. For example, the button type object 842 may be displayed as an icon and name of an application executed when the first response 841 is displayed.

[0147] When user input occurs on button type object 842, processor 160 may display a list of changeable option parameters. When additional user input occurs on the list, processor 160 may change the value of the option parameter.

[0148] For screen 870, processor 160 may display a second response 871 in response to the value of the option parameter selected by user input. Processor 160 may display a button type object 872 for parameter change and second response 871. The icon of button type object 872 may change by reflecting the information selected by user input.

[0149] According to various embodiments, the processor 160 may display a return button 873 for returning to the result before changing the option parameter. The processor 160 may receive a user input 875 on a first screen movement button (eg, back button) 873 .

[0150] On screen 840a, when user input 875 appears on the back button 873, the processor 160 may display the first response 841 again. The processor 160 may display a second screen movement button (e.g., a forward button) 843 for returning the response result after changing the option parameter. When receiving a user input 845 on the second screen movement button 843, the processor 160 may display the second response 871 again.

[0151] According to various embodiments, when the user continuously changes the option parameters, the first screen move button 873 and the second screen move button 843 may be simultaneously displayed.

[0152] Fig. 9 is a diagram illustrating a screen when there are no optional parameters according to an embodiment of the present disclosure.

[0153] Reference Fig. 9 , for screen 940, Figure 2 The processor 160 may display a first response 941 corresponding to the user's voice input. In a state where the first response 941 is displayed, the processor 160 may receive a first user input 945 for changing the value of the option parameter. For example, the first user input 945 may be an upward and downward sliding input.

[0154] On the screen 950 , when there are no changeable option parameters, the processor 160 may display an information message 951 .

[0155] According to an embodiment, when there are no changeable option parameters, the processor 160 may display the parameters without changeable options using a popup message without a separate screen movement.

[0156] Fig.102001 in a network environment 2000 according to an embodiment of the present invention. The electronic device according to various embodiments of the present disclosure may include at least one of a smart phone, a tablet personal computer (PC), a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, a mobile medical device, a camera, and a wearable device. According to various embodiments of the present disclosure, the wearable device may include an accessory (e.g., a watch, a ring, a bracelet, an anklet, glasses, contact lenses, or a head-mounted device (HMD)), a fabric integrated type (e.g., an electronic clothing), a body attached type (e.g., a skin pad or a tattoo), or an implantable type (e.g., an implantable circuit). In some embodiments of the present disclosure, the electronic device may be one of household appliances. The household appliance may include, for example, a digital video disk (DVD) player, an audio, a refrigerator, an air conditioner, a cleaner, an oven, a microwave oven, a washing machine, an air cleaner, a set-top box, a home automation control panel, a security control panel, a game console, an electronic dictionary, an electronic key, a camcorder, or an electronic panel.

[0157] In another embodiment of the present disclosure, the electronic device may include at least one of various navigation systems, a global navigation satellite system (GNSS), an event data recorder (EDR) (e.g., a vehicle / ship / aircraft black box), an automotive infotainment device (e.g., a head-up display of a vehicle), an industrial or home robot, a drone, an automated teller machine (ATM), or a point of sale (POS) or IoT device (e.g., a light bulb, a sprinkler device, a fire alarm, a thermostat, or a street lamp). The electronic device according to an embodiment of the present document is not limited to the above-mentioned devices, and may also be equipped with multiple electronic devices, such as a smart phone with a function of measuring biometric information (e.g., heartbeat or blood sugar). In this document, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0158] Reference Fig.10 , the electronic device 2001 in the network environment 2000 may communicate with the electronic device 2002 through the first network 2098 (e.g., a short-range wireless communication network), or may communicate with the electronic device 2004 or the server 2008 through the second network 2099 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 2001 may communicate with the electronic device 2004 through the server 2008.

[0159] According to an embodiment, the electronic device 2001 may include a processor 2020, a memory 2030, an input device 2050, a sound output device 2055, a display device 2060, an audio module 2070, a sensor module 2076, an interface 2077, a tactile module 2079, a camera module 2080, a power management module 2088, a battery 2089, a communication module 2090, a user identification module 2096, or an antenna module 2097. In any embodiment, at least one (e.g., display device 2060 or camera module 2080) component may be omitted from the electronic device 2001, or one or more other components may be further included in the electronic device 2001. In any embodiment, some components may be implemented with a single integrated circuit. For example, the sensor module 2076 (e.g., a fingerprint sensor, an iris sensor, or an illumination sensor) may be embedded in the display device 2060 (e.g., a display).

[0160] The processor 2020 may execute, for example, software (e.g., program 2040) to control at least one other component (e.g., hardware or software component) of the electronic device 2001 connected to the processor 2020, and may perform various data processing or operations. According to an embodiment, as at least part of the data processing or operation, the processor 2020 may load a command or data received from any other component (e.g., sensor module 2076 or communication module 2090) to the volatile memory 2032, may process the command or data stored in the volatile memory 2032, and may store the processed data in the non-volatile memory 2034. According to an embodiment, the processor 2020 may include a main processor 2021 (e.g., a central processing unit or an application processor) and an auxiliary processor 2023 (e.g., a graphics processing device, an image signal processor, a sensor hub processor, or a communication processor), which may operate independently of the main processor 2021 or together with the main processor 2021. Additionally or alternatively, the auxiliary processor 2023 may be configured to use less power than the main processor 2021, or to be dedicated to a specified function. The auxiliary processor 2023 may be implemented separately from the main processor 2021, or may be implemented as part of the main processor 2021.

[0161] The auxiliary processor 2023 may control at least a portion of the state of one or more functions associated with at least one component of the electronic device 2001 (e.g., the display device 2060, the sensor module 2076, or the communication module 2090), for example, instead of the main processor 2021 when the main processor 2021 is in an inactive (e.g., sleep) state; and control at least a portion of the state of one or more functions associated with at least one component of the electronic device 2001 (e.g., the display device 2060, the sensor module 2076, or the communication module 2090) together with the main processor 2021 when the main processor 2021 is in an active (e.g., application execution) state. According to an embodiment, the auxiliary processor 2023 (e.g., an image signal processor or a communication processor) may be implemented as a part of any other component (e.g., the camera module 2080 or the communication module 2090) that is functionally (or operably) associated with the auxiliary processor 2023.

[0162] The memory 2030 may store various data used by at least one component of the electronic device 2001 (e.g., the processor 2020 or the sensor module 2076). The data may include, for example, software (e.g., the program 2040) or input data or output data associated with a command of the software. The memory 2030 may include a volatile memory 2032 or a non-volatile memory 2034. The non-volatile memory 2034 may include an internal memory and / or an external memory (e.g., an internal memory 2036 and an external memory 2038).

[0163] The program 2040 may be stored as software in the memory 2030 , and may include, for example, an operating system 2042 , middleware 2044 , or an application 2046 .

[0164] The input device 2050 may receive a command or data to be used by a component (eg, processor 2020) of the electronic device 2001 from outside (eg, a user) of the electronic device 2001. The input device 2050 may include, for example, a microphone, a mouse, or a keyboard.

[0165] The sound output device 2055 can output a sound signal to the outside of the electronic device 2001. The sound output device 2055 may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as multimedia playback or record playback, and the receiver may be used to receive an incoming call. According to an embodiment, the receiver may be implemented separately from the speaker, or may be implemented as a part of the speaker.

[0166] The display device 2060 can visually provide information to the outside of the electronic device 2001 (e.g., a user). The display device 2060 may include, for example, a display, a hologram device, or a control circuit for controlling a projector and corresponding devices. According to an embodiment, the display device 2060 may include a touch circuit configured to sense a touch, or a sensor circuit (e.g., a pressure sensor) configured to measure the strength of a force generated by a touch.

[0167] The audio module 2070 may convert sound into an electrical signal, or conversely, may convert an electrical signal into sound. According to an embodiment, the audio module 2070 may obtain sound through the input device 2050, or may output sound through the sound output device 2055, or may output sound through an external electronic device (e.g., electronic device 2002) (e.g., a speaker or earphone) directly or wirelessly connected to the electronic device 2001.

[0168] The sensor module 2076 may sense an operating state (e.g., power or temperature) or an external environment state (e.g., a user state) of the electronic device 2001, and may generate an electrical signal or data value corresponding to the sensed state. According to an embodiment, the sensor module 2076 may include, for example, a gesture sensor, a grip sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0169] The interface 2077 may support one or more specified protocols, which may be used to directly and wirelessly connect the electronic device 2001 to an external electronic device (e.g., the electronic device 2002). According to an embodiment, the interface 2077 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0170] The connection terminal 2078 may include a connector that allows the electronic device 2001 to be physically connected to an external electronic device (e.g., the electronic device 2002). According to an embodiment, the connection terminal 2078 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0171] The haptic module 2079 may convert an electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation, and the user may sense the mechanical stimulation or electrical stimulation through a touch sense or a motion sense. According to an embodiment, the haptic module 2079 may include, for example, a motor, a piezoelectric sensor, or an electrical stimulation device.

[0172] The camera module 2080 may capture still images and videos. According to an embodiment, the camera module 2080 may include one or more lenses, an image sensor, an image signal processor, or a flash (or electric flash).

[0173] The power management module 2088 may manage power supplied to the electronic device 2001. According to an embodiment, the power management module 2088 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0174] The battery 2089 may power at least one component of the electronic device 2001. According to an embodiment, the battery 2089 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0175] The communication module 2090 may establish a direct (or wired) communication channel or a wireless communication channel between the electronic device 2001 and an external electronic device (e.g., the electronic device 2002, the electronic device 2004, or the server 2008), or may perform communication through the established communication channel. The communication module 2090 may include one or more communication processors that operate independently of the processor 2020 (e.g., the application processor) and support direct (or wired) communication or wireless communication. According to an embodiment, the communication module 2090 may include a wireless communication module 2092 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 2094 (e.g., a local area network (LAN) communication module or a power line communication module). The corresponding communication module of such a communication module may communicate with an external electronic device through a first network 2098 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 2099 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., LAN or WAN)). The above-mentioned types of communication modules can be integrated into one component (e.g., a single chip), or can be implemented with multiple components (e.g., multiple chips) that are independent of each other. The wireless communication module 2092 can verify and authenticate the electronic device 2001 within the communication network (e.g., the first network 2098 or the second network 2099) by using the user information (e.g., International Mobile Subscriber Identity (IMSI)) stored in the user identification module 2096.

[0176] The antenna module 2097 may transmit a signal or power to the outside (e.g., an external electronic device), or may receive a signal or power from the outside. According to an embodiment, the antenna module 2097 may include one or more antennas, and at least one antenna may be selected from the one or more antennas by the communication module 2090, for example, and the at least one antenna is suitable for a communication scheme used in a computer network such as the first network 2098 or the second network 2099. A signal or power may be exchanged between the communication module 2090 and the external electronic device through the selected at least one antenna, or may be received from the external electronic device through the selected at least one antenna and the communication module 2090.

[0177] At least some components may be connected to each other through a communication scheme (e.g., a bus, general purpose input and output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) between peripheral devices, and may exchange signals (e.g., commands or data) with each other.

[0178] According to an embodiment, a command or data may be sent or received (or exchanged) between the electronic device 2001 and the electronic device 2004 through the server 2008 connected to the second network 2099. Each of the electronic devices 2002 and 2004 may be a device of the same or different kind as the electronic device 2001. According to an embodiment, all or part of the operations to be performed in the electronic device 2001 may be performed in one or more external devices of the electronic device 2002, 2004 or 2008. For example, in the case where the electronic device 2001 should automatically or in response to a request from a user or any other device to perform any function or service, the electronic device 2001 may request one or more external electronic devices to perform at least a part of the function or service instead of performing the function or service itself, or may request one or more external electronic devices to perform at least a part of the function or service in addition to performing the function or service. The one or more external electronic devices receiving the request may perform at least a part of the function or service requested in this way or an additional function or service associated with the request, and may provide the result of the execution to the electronic device 2001. The electronic device 2001 may process the received result as is or additionally, and may provide the processed result as at least a part of the response to the request. To this end, for example, cloud computing, distributed computing or client-server computing technology may be used.

[0179] According to various embodiments, the electronic device includes a display, a microphone, a memory, a communication circuit, and a processor, wherein the processor is configured to: receive a user's voice input via the microphone; display a first response corresponding to the voice input on the display; receive a first user input; in response to the first user input, display a user interface for changing at least one parameter associated with the voice input; receive a second user input via the user interface; and display a second response corresponding to the voice input on the display based on a value of at least one parameter, wherein the value is selected by the second user input.

[0180] According to various embodiments, the user interface includes a list of at least one parameter or a list of changeable values ​​of at least one parameter.

[0181] According to various embodiments, the user interface is a pop-up window including a list of changeable values ​​of the at least one parameter.

[0182] According to various embodiments, the processor is configured to change the value of at least one parameter by an additional voice input subsequent to the voice input.

[0183] According to various embodiments, the processor is configured to send the value of the at least one parameter to the external server via the communication circuit, and receive the first response or the second response.

[0184] According to various embodiments, the processor is configured to receive a first response or a second response associated with executing an application that is not installed in the electronic device.

[0185] According to various embodiments, the processor is configured to display a user interface including an image associated with at least one parameter.

[0186] According to various embodiments, the processor is configured to display the second response and the first object for changing the screen to the first response.

[0187] According to various embodiments, the processor is configured to display a first response and a second object for changing the screen to a second response after the screen is changed by a user input, wherein the user input occurs on the first object.

[0188] According to various embodiments, the first user input is a sliding input in a designated direction.

[0189] According to various embodiments, the first user input is a touch input on a button-type object displayed with the first response.

[0190] According to various embodiments, the processor is configured to display the button type object as an icon or text associated with at least one parameter.

[0191] It should be understood that the various embodiments of the documents and terms used are not intended to limit the technology described in this document to any specific embodiment, but are intended to include various modifications, equivalents and / or replacements of the embodiments. In conjunction with the description of the accompanying drawings, the same reference numerals may be used for similar parts. Singular expressions may include plural expressions unless the context clearly specifies otherwise. In this article, the expressions "A or B", "at least one of A and / or B", "A, B or C" or "at least one of A, B and / or C" include possible combinations. Expressions such as "first", "second" are not limited to those components. When referring to some (e.g., first) components (functionally or communicatively) connected or connected to another (second) component, it can be directly connected to the component, or it can be connected through another component (e.g., the third component).

[0192] In this document, the term "suitable for or configured to" as used herein is intended to cover all types of information, including (but not limited to) "made to", "designed to" or "designed to". In some cases, the device stated "configured to..." may mean that the device can "do" with other devices or components. For example, a processor configured (or configured) to execute the phrases "A, B, and C" may be a processor dedicated to performing operations (e.g., an embedded processor). By executing the above program, it may mean a general-purpose processor (e.g., a CPU or AP) that can perform the corresponding operations.

[0193] As used herein, the term "module" includes a unit of hardware, software or firmware, and can be used interchangeably with terms such as logic, logic block, component, etc. A "module" can be a component or minimum unit of an overall structure that performs one or more functions, or a portion thereof. A "module" can be implemented mechanically or electronically, such as by an application specific integrated circuit (ASIC) chip, a field programmable gate array (FPGA), and a programmable logic device.

[0194] At least some of the devices (e.g., modules or functions thereof) or methods (e.g., operations) according to various embodiments may be stored in a computer-readable storage medium (e.g., memory 2030). When the instruction is executed by a processor (e.g., processor 2020), the processor may perform a function corresponding to the instruction. The computer-readable recording medium may be a hard disk, a floppy disk, a magnetic medium such as a magnetic tape, an optical recording medium such as a CD-ROM, a DVD, a magneto-optical medium such as a floppy disk, and the instruction may include a code generated by a compiler or a code that can be executed by an interpreter.

[0195] Each component (e.g., module or program module) according to various embodiments may include a single entity or multiple entities, and some of the previously mentioned subcomponents may be omitted. Alternatively or additionally, some components (e.g., modules or program modules) may be integrated into one entity to perform the same or similar functions performed by each corresponding component before integration. According to various embodiments, the operations performed by modules, program modules or other components may be performed sequentially in a parallel, repeated or heuristic manner, or at least some operations may be performed in a different order or may be added.

[0196] While the present disclosure has been shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made without departing from the spirit and scope of the invention as defined by the appended claims and their equivalents.

Claims

1. An electronic device, comprising: monitor; microphone; Memory; as well as processor, Wherein, the processor is configured as follows: receiving a user's voice input via the microphone, determining whether the speech input includes at least one option parameter, the at least one option parameter having a plurality of selectable values, In the case where the voice input includes the at least one option parameter: determining a first value of the at least one option parameter from the plurality of optional values ​​according to a predetermined option parameter rule, determining, according to a predetermined hidden parameter rule, a first hidden parameter value corresponding to a hidden parameter not included in the voice input, wherein the first hidden parameter value indicates an application required to provide a first response corresponding to the voice input, Based on the first value of the at least one option parameter and the first hidden parameter value, displaying the first response corresponding to the voice input on the display, and a user input interface for changing the value of the at least one option parameter and the corresponding hidden parameter, receiving a first user input via the user input interface, In response to the first user input, displaying on the display a parameter user interface for selecting a value of the at least one option parameter associated with the voice input and a corresponding hidden parameter, wherein the parameter user interface includes a list of the at least one option parameter and the hidden parameter, receiving a second user input via the parameter user interface to select a hidden parameter from the list; In response to the second user input, displaying a list of selectable values ​​for the selected hidden parameter on the parameter user interface; receiving a third user input via a user interface displaying the selectable value list to select a second hidden parameter value for the selected hidden parameter from the selectable value list, wherein the second hidden parameter value indicates an application required to provide a second response corresponding to the voice input, and Based on the second hidden parameter value, the second response corresponding to the voice input is displayed on the display.

2. The electronic device according to claim 1, wherein: The parameter user interface comprises a pop-up window including a list of the plurality of selectable values ​​and corresponding hidden parameters of the at least one option parameter.

3. The electronic device according to claim 1, wherein: The processor is further configured to: after receiving the voice input, change the value of the at least one option parameter and the corresponding hidden parameter by additional voice input.

4. The electronic device according to claim 1, wherein: The electronic device further includes a communication circuit, and the processor is further configured to: sending the first value of the at least one option parameter or the second hidden parameter value of the selected hidden parameter to an external server via the communication circuit, and The first response or the second response is received.

5. The electronic device according to claim 4, wherein: The processor is further configured to: The first response or the second response associated with executing an application not installed on the electronic device is received.

6. The electronic device according to claim 1, wherein: The processor is further configured to: The parameter user interface including an image associated with the at least one option parameter is displayed.

7. The electronic device according to claim 1, wherein: The processor is further configured to: A first object for changing the screen to the first response is displayed together with the second response.

8. The electronic device according to claim 7, wherein: The processor is further configured to: After the screen is changed by a user input occurring on the first object, a second object for changing the screen to the second response is displayed together with the first response.

9. The electronic device according to claim 1, wherein: The first user input includes a sliding input in a specified direction.

10. The electronic device according to claim 1, wherein: The first user input comprises a touch input on a button-type object displayed together with the first response.

11. The electronic device according to claim 10, wherein: The processor is further configured to: The button type object is displayed as an icon or text associated with the at least one option parameter.

12. A speech recognition method performed in an electronic device, the method comprising: receiving a user's voice input via a microphone of the electronic device; Determining whether the speech input includes at least one option parameter, the at least one option parameter having a plurality of selectable values; In the case where the voice input includes the at least one option parameter: Determining a first value of the at least one option parameter from the plurality of optional values ​​according to a predetermined option parameter rule; determining, according to a predetermined hidden parameter rule, a first hidden parameter value corresponding to a hidden parameter not included in the voice input, wherein the first hidden parameter value indicates an application required to provide a first response corresponding to the voice input; Based on the first value of the at least one option parameter and the first hidden parameter value, displaying the first response corresponding to the voice input on a display of the electronic device, and a user input interface for changing the value of the at least one option parameter and the corresponding hidden parameter; receiving a first user input via the user input interface; In response to the first user input, displaying a parameter user interface for selecting a value of the at least one option parameter and a corresponding hidden parameter associated with the voice input, wherein the parameter user interface includes a list of the at least one option parameter and the hidden parameter; receiving a second user input via the parameter user interface to select a hidden parameter from the list; In response to the second user input, displaying a list of selectable values ​​for the selected hidden parameter; receiving a third user input via a user interface displaying the selectable value list to select a second hidden parameter value of the selected hidden parameter from the selectable value list, wherein the second hidden parameter value indicates an application required to provide a second response corresponding to the voice input; and Based on the second hidden parameter value, the second response corresponding to the voice input is displayed on the display.

13. The method according to claim 12, further comprising: After receiving the voice input, the value of the at least one option parameter and the corresponding hidden parameter are changed by additional voice input.

14. The method according to claim 12, in, Displaying the first response includes: sending the first value of the at least one option parameter to an external server; and receiving the first response, and The displaying of the second response includes: sending the second hidden parameter value of the selected hidden parameter to the external server; and The second response is received.

Images