Electronic device and control method thereof
By implementing the visitor mode in electronic devices, the problem that traditional artificial intelligence assistant functions can only be used on specific devices is solved, allowing users to use their artificial intelligence assistant functions on different devices, realizing collaborative work across devices, enhancing user experience and convenience.
Patent Information
- Application Number
- CN202210639432.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-09-13
- Filing Date
- 2018-09-17
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2038-09-17
AI Technical Summary
The traditional AI Assistant function can only be used on devices previously registered by the user and cannot work on devices that are not set up or on devices with different AI Assistant functions.
By implementing the guest mode in an electronic device, the user is allowed to communicate and operate through identification information and user commands using the AI assistant function they previously used on unset devices or devices with different AI assistant functions.
Users can use their AI assistant functions on devices with different AI assistant functions to achieve collaborative work across devices, enhancing user experience and convenience.
Smart Images

Figure CN115016708B_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to a method of utilizing an artificial intelligence assistant, and more particularly, to an electronic device that provides a guest mode using an artificial intelligence assistant function in an external device and a control method thereof. Background Art
[0002] In addition to the traditional input method using a keyboard or a mouse, recent electronic devices can also support various input methods such as voice input. For example, electronic devices such as smart phones, tablet computers, and artificial intelligence speakers can recognize user voice input when performing a voice recognition service, and perform an operation corresponding to the voice input or provide search results corresponding to the voice input.
[0003] The speech recognition function is developed based on the technology of processing natural language. The technology of processing natural language is the technology of recognizing the intention of the user's speech and providing the user with the result suitable for the intention.
[0004] Recently, various companies are providing artificial intelligence assistant functions based on such voice recognition functions.
[0005] An AI system is a system in which machines can learn, make judgments, and become more intelligent on their own, unlike traditional rule-based intelligent systems. The more an AI system is used, the higher its recognition rate is, and the more it becomes able to correctly understand user preferences. Therefore, traditional rule-based intelligent systems are gradually being replaced by AI systems based on deep learning.
[0006] Artificial intelligence technologies include machine learning (e.g., deep learning) and basic technologies that utilize machine learning.
[0007] Machine learning refers to algorithmic technology that classifies / learns the characteristics of input data by the machine itself, and basic technology refers to technology that simulates the functions of the human brain (such as cognition and determination) by using machine learning algorithms (such as deep learning), and includes technical fields such as language understanding, visual understanding, inference / prediction, knowledge representation, and operation control.
[0008] Examples of various fields of application of artificial intelligence technology are as follows. Language understanding refers to the technology of recognizing human language / text and applying / processing it, including natural voice processing, machine translation, communication systems, query and response, speech recognition / synthesis, etc. Visual understanding refers to the technology of recognizing objects and processing them in a way similar to human vision, including object recognition, object tracking, image search, person recognition, scene understanding, space understanding, image improvement, etc. Inference / prediction refers to the technology of determining information and then making logical inferences and predictions, including knowledge / probability-based inference, optimization prediction, preference-based planning, recommendation, etc. Knowledge representation refers to the technology of automatically processing human experience information into knowledge data, including knowledge construction (data generation / classification), knowledge management (data utilization), etc. Operation control refers to the technology of controlling the autonomous driving of vehicles and the movement of robots, including mobile control (navigation, collision, driving), operation control (behavior control), etc. Summary of the invention
[0009] Technical issues
[0010] The conventional artificial intelligence assistant function can be executed on a device previously registered by the user. Therefore, there is an inconvenience that the user cannot continuously use the artificial intelligence assistant function suitable for the user on a device that the user has not previously set up or on another person's device.
[0011] In addition, there is an inconvenience in that the user cannot use the user's artificial intelligence assistant function on a device that uses an artificial intelligence assistant function different from the artificial intelligence assistant function used by the user.
[0012] The present disclosure proposes a method by which a user can use an artificial intelligence assistant function previously used by the user on a device that the user has not previously set up or on another person's device. In addition, the present disclosure aims to propose a method by which a user can use the user's artificial intelligence assistant function on a device that provides an artificial intelligence assistant different from the artificial intelligence assistant used by the user.
[0013] Technical Solutions
[0014] An electronic device according to an embodiment of the present disclosure includes an input unit, a communication unit, a processor, and a memory, wherein the memory may include instructions for the processor to control the communication unit to request identification information including a call word for using an artificial intelligence assistant function from another electronic device based on the occurrence of an event for requesting configuration of a first mode in which the artificial intelligence assistant function of another electronic device can be used, and in response to the request, receive the identification information from the other electronic device through the communication unit, and send a user command to the other electronic device based on the identification information based on the user command received during operation of the first mode of the artificial intelligence assistant.
[0015] In addition, an electronic device according to an embodiment of the present disclosure includes a display, a communication unit, a processor, and a memory, wherein the memory may include instructions for the processor to control the display to display a user interface for requesting user confirmation of sending identification information based on a signal for requesting the sending of identification information including a call word for using an artificial intelligence assistant function received through the communication unit, and to send the identification information to another electronic device as a result of user confirmation through the user interface.
[0016] According to an embodiment of the present disclosure, a control method of an electronic device may include the following steps: detecting the occurrence of an event for requesting configuration of a first mode, in which an artificial intelligence assistant function of another electronic device can be used; and based on detecting the occurrence of the event for requesting configuration of the first mode, requesting identification information including a call word for using the artificial intelligence assistant function from another electronic device; receiving identification information from another electronic device in response to the request; and based on receiving a user command during operation of the first mode of the artificial intelligence assistant, sending the user command to the other electronic device based on the identification information.
[0017] In addition, the control method of an electronic device according to an embodiment of the present disclosure may include the following steps: receiving a signal for requesting the sending of identification information including a call word for using an artificial intelligence assistant function; and based on the received signal, displaying a user interface on a display for requesting user confirmation for sending the identification information; and sending the identification information to another electronic device as a result of the user confirmation.
[0018] A computer program product according to an embodiment of the present disclosure may include a recording medium for storing instructions, wherein the instructions are configured to perform the following operations: detecting the occurrence of an event for requesting configuration of a first mode in which an artificial intelligence assistant function of another electronic device can be used; and based on detecting the occurrence of the event for requesting configuration of the first mode, requesting identification information including a call word for using the artificial intelligence assistant function from another electronic device; receiving the identification information from the other electronic device in response to the request; and based on receiving a user command during operation of the first mode of the artificial intelligence assistant, sending the user command to the other electronic device based on the identification information.
[0019] A computer program product according to an embodiment of the present disclosure may include a recording medium for storing instructions, wherein the instructions are configured to perform the following operations: receiving a signal for requesting the sending of identification information including a call word for using an artificial intelligence assistant function; and based on the received signal, displaying a user interface on a display for requesting user confirmation of sending the identification information; and sending the identification information to another electronic device as a result of the user confirmation.
[0020] Effects of the Invention
[0021] According to various embodiments of the present disclosure, a user becomes able to use an artificial intelligence assistant function used by the user on a device that provides a different artificial intelligence assistant function.
[0022] In addition, according to various embodiments of the present disclosure, a user becomes able to use an artificial intelligence assistant function suitable for the user on an external device that is not a device on which the user uses the artificial intelligence assistant function. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] Figure 1a is a diagram for illustrating a process of setting a visitor mode included in an artificial intelligence assistant function according to an embodiment of the present disclosure;
[0024] Figure 1b is a diagram for illustrating a case where a guest mode of an artificial intelligence assistant is utilized by using a user device according to an embodiment of the present disclosure;
[0025] Figure 1c is a diagram for illustrating a case where a guest mode of an artificial intelligence assistant is utilized by using a server according to an embodiment of the present disclosure;
[0026] Figure 1d is a diagram for illustrating another case of utilizing a guest mode of an artificial intelligence assistant by using a server according to an embodiment of the present disclosure;
[0027] Figure 1e is a diagram for illustrating a case where a guest mode of an artificial intelligence assistant is terminated according to an embodiment of the present disclosure;
[0028] Figure 2 is a diagram for illustrating a case where a visitor device generates a notification notifying the start and end of a visitor mode included in an artificial intelligence assistant function according to an embodiment of the present disclosure;
[0029] Figure 3 is a diagram for illustrating a situation in which a user device requests user authentication to start a guest mode of an artificial intelligence assistant according to an embodiment of the present disclosure;
[0030] Figure 4 is a diagram for illustrating various situations in which a user device requests user authentication according to an embodiment of the present disclosure;
[0031] Figure 5 is a schematic block diagram of a visitor device, a user device and a server according to an embodiment of the present disclosure;
[0032] Figure 6is a diagram showing an embodiment of an identification signal sent by a visitor device to a user device according to an embodiment of the present disclosure;
[0033] Figure 7 is a diagram for illustrating utilization of a guest mode in a case where a user device and a guest device use the same artificial intelligence assistant function according to an embodiment of the present disclosure;
[0034] Figure 8 is a flow chart showing a method for executing a visitor mode of an artificial intelligence assistant function according to an embodiment of the present disclosure;
[0035] Figure 9a is a flow chart showing a case where a guest mode of an artificial intelligence assistant is utilized by using a user device according to an embodiment of the present disclosure;
[0036] Figure 9b is a flowchart for illustrating a case where a guest mode of an artificial intelligence assistant is utilized by using a server according to an embodiment of the present disclosure;
[0037] Fig.9c is a diagram for illustrating another case of utilizing a guest mode of an artificial intelligence assistant by using a server according to an embodiment of the present disclosure;
[0038] Fig.10 is a flow chart showing a case where a guest mode is utilized when a guest device and a user device use the same artificial intelligence assistant function according to an embodiment of the present disclosure;
[0039] Fig.11a is a flow chart showing a case where an artificial intelligence assistant function is terminated by using a visitor device according to an embodiment of the present disclosure;
[0040] Fig.11b is a flowchart showing a case where an artificial intelligence assistant function is terminated by using a user device according to an embodiment of the present disclosure; and
[0041] Fig.12 is a diagram for illustrating a method for operating an artificial intelligence assistant function according to an embodiment of the present disclosure. DETAILED DESCRIPTION
[0042] The electronic device according to various embodiments described in the present disclosure may be a device of various forms. The electronic device may include, for example, at least one of a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. However, the electronic device according to the embodiments of the present disclosure is not limited to the aforementioned devices.
[0043] The various embodiments of the present disclosure and the terms used in the embodiments are not used to limit the technology described in the present disclosure to specific embodiments, but should be interpreted as including various modifications, equivalents and / or substitutions to the embodiments. Meanwhile, with respect to the detailed description of the accompanying drawings, similar elements can be represented by similar reference numerals. In addition, unless the context is clearly defined differently, singular expressions may include plural expressions. In addition, in the present disclosure, expressions "A or B", "at least one of A and / or B", "A, B or C" or "at least one of A, B and / or C" etc. may include all possible combinations of listed items. In addition, expressions such as "first", "second", etc. may be used to describe various elements, regardless of any order and / or degree of importance, and are only used to distinguish one element from another, and are not intended to limit elements. In addition, the description in the present disclosure that one element (e.g., a first element) is "(operably or communicatively) coupled to / (operably or communicatively) coupled to" or "connected to" another element (e.g., a second element) should be interpreted to include both the case where one element is directly coupled to another element and the case where one element is coupled to another element via another element (e.g., a third element).
[0044] Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings.
[0045] Figure 1a is a diagram for illustrating a process of setting a visitor mode included in an artificial intelligence assistant function according to an embodiment of the present disclosure.
[0046] The artificial intelligence assistant function according to an embodiment of the present disclosure can be implemented by using an electronic device including at least one of a guest mode providing device (hereinafter referred to as a guest device) 10 or a user device 20 and at least one server 15, 25. The server 15, 25 may include a cloud server. However, the present disclosure is not limited thereto.
[0047] The electronic device may include at least one of the guest device 10 or the user device 20. In addition, the electronic device may provide functions or services required by the user through an app (or application program) stored inside the electronic device (eg, a notification app, a message app, an album app, etc.).
[0048] For example, the electronic device may execute and operate another app through a smart app such as a voice recognition app stored inside the electronic device. In addition, the electronic device may receive user input for operating a smart app such as a voice recognition app. The user input may be received, for example, through a physical button, a touch pad, a voice input unit, a remote input unit, etc.
[0049] According to an embodiment of the present disclosure, the electronic device may include various types of devices that can be connected to the Internet, such as a mobile phone, a smart phone, a personal digital assistant (PDA), an artificial intelligence (AI) speaker, or a notebook computer.
[0050] In addition, according to an embodiment of the present disclosure, the electronic device can receive a user speech as a user input. The electronic device can receive the user speech and generate a command for operating the app based on the user speech. Therefore, the electronic device can operate various apps by using the generated command.
[0051] In addition, according to an embodiment of the present disclosure, the server 15, 25 can receive the user's voice input from the electronic device through the third device 30 and change the voice into text data. The third device can be, for example, at least one of an access point (AP), a repeater, a sharing device, a gateway, or a hub.
[0052] According to various embodiments of the present disclosure, there may be multiple servers 15, 25. For example, the A server 15 may be a server of a platform or manufacturer that supports the A artificial intelligence assistant function, and the B server 25 may be a server of a platform or manufacturer that supports the B artificial intelligence assistant function. However, the present disclosure is not limited thereto. For example, the A artificial intelligence assistant function and the B artificial intelligence assistant function may be implemented by using multiple servers.
[0053] In addition, according to various embodiments of the present disclosure, the server 15, 25 may generate (or select) a path rule based on the text data. The path rule may include information about the action (or operation) used to execute the function of the app or information about the parameters required to execute the action. In addition, the path rule may include the action sequence of the app. The electronic device may receive the path rule, select an app according to the path rule, and execute the action included in the path rule in the selected app.
[0054] According to an embodiment of the present disclosure, the server 15, 25 may include a database in which user information is stored. The server 15, 25 may receive user information (e.g., context information, app execution information, etc.) from the electronic device and store the information in the database. In addition, when generating a path rule for user input, the server 15, 25 may use the information included in the database.
[0055] In addition, according to an embodiment of the present disclosure, the server 15, 25 may include a database in which an introduction to functions or apps stored in the electronic device or information about functions to be provided is stored. For example, the server 15, 25 may generate a database of functions that the user can use by using user information. The electronic device may receive information about functions that can be provided from the server 15, 25 through a communication network and provide the information to the user.
[0056] According to various embodiments of the present disclosure, the server 15, 25 or the electronic device may include a recognition model (such as a natural language understanding module, a natural language generation module, etc.) that improves recognition capabilities through learning. In this case, the recognition model may be a model trained by using an artificial intelligence algorithm such as a machine learning, a neural network, or a deep learning algorithm. In this case, the artificial intelligence algorithm may be used in the aforementioned process of recognizing user utterances and changing the utterances into text data. This will be referred to later. Fig.12 This is explained.
[0057] In the following, reference will be made to Figure 1a Describes a method for setting a guest mode included in an artificial intelligence assistant function.
[0058] The first mode (e.g., guest mode) of the artificial intelligence assistant function may mean, for example, a mode in which the artificial intelligence assistant function used on the electronic device owned by the user is performed using another electronic device that is not owned by the user. That is, the first mode may mean a mode in which the artificial intelligence assistant function used at the user device 20 is used by controlling the user device 20 at the guest device 10 that is not owned by the user.
[0059] In this case, the visitor device 10 and the user device 20 can use different artificial intelligence assistant functions from each other. For example, the visitor device 10 can use the A artificial intelligence assistant function interlocked with the A server 15, while the user device 20 can use the B artificial intelligence assistant function interlocked with the B server 25.
[0060] That is, the user can use the B artificial intelligence assistant function used at the user device 20 at the guest device 10 through the guest mode. According to various embodiments of the present disclosure, the A server 15 may be a server generated at the A manufacturer or the A platform, and the B server 25 may be a server generated at the B manufacturer or the B platform.
[0061] According to an embodiment of the present disclosure, the visitor device 10 can receive information related to data of an artificial intelligence assistant function used by a user or voice assistant data adapted to the user through the user's use from the user device 20 or the B server 25 connected to the user device 20 through a communication network.
[0062] In action ①, the guest device 10 may receive a command for requesting configuration of the guest mode from the user 1. For example, the user 1 may speak a request to configure the guest mode. In addition, the guest device 10 may receive the speech of the user 1 and recognize the content included in the speech by using a smart app such as a voice recognition app.
[0063] According to various embodiments of the present disclosure, the guest device 10 may identify content included in a command received from the user 1 by using the A server 15 .
[0064] For example, in action ②, the guest device 10 may send the received command to the third device 30. In addition, in action ②', the A server 15 may receive the command of the user 1. The A server 15 may receive the user's speech and recognize the content of the speech by using an intelligent program such as a voice recognition program. According to various embodiments of the present disclosure, the guest device 10 and the servers 15, 25 may directly form a network without using the third device 30.
[0065] In action ③, the A server 15 may send the content of the speech to the third device 30. In addition, in action ③', the guest device 10 may receive the content of the speech for requesting configuration of the guest mode.
[0066] According to various embodiments of the present disclosure, in a case where the visitor device 10 recognizes the utterance of the user 1 by using a smart app such as a voice recognition app, actions ②, ②′, ③, and ③′ may be omitted.
[0067] In action ④, the guest device 10 may prepare to configure the guest mode. For example, the guest device 10 may generate an identification signal for searching for a communicable device located nearby by performing a Wi-Fi direct connection or a self-organizing function, and transmit the signal. Here, the device located nearby may be the user device 20. That is, the guest device 10 may request identification information for using the artificial intelligence assistant function used at the user device 20.
[0068] In action ⑤, the user device 20 may receive an identification signal for requesting identification information including a call word (e.g., Bixby, Alexa, Cortana, etc.) for using an artificial intelligence assistant function from the visitor device 10. In this case, the user device 20 may display a user interface for requesting confirmation of sending the identification information by the user 1.
[0069] The identification information for using the artificial intelligence assistant function may include, for example, information of an account that can access the B artificial intelligence assistant, the name of the B artificial intelligence assistant, the name of the manufacturer providing the B artificial intelligence assistant, information of the uniform resource locator (URL) of the B artificial intelligence assistant, or at least one of the platforms providing the B artificial intelligence assistant.
[0070] Here, in a case where the identification information is the name of B's artificial intelligence assistant, the manufacturer of B's artificial intelligence assistant, information of the uniform resource locator (URL) of B's artificial intelligence assistant, or a platform providing B's artificial intelligence assistant, the visitor device 10 may store a call word of the artificial intelligence assistant corresponding to the name of B's artificial intelligence assistant, the manufacturer of B's artificial intelligence assistant, information of the uniform resource locator (URL) of B's artificial intelligence, or a platform providing B's artificial intelligence assistant.
[0071] In action ⑥, when there is confirmation from user 1 that the identification information is to be transmitted, the user device 20 may transmit the identification information to the guest device 10 .
[0072] In action ⑦, in the case where the identification information is received from the user device 20, the guest device 10 may transmit information capable of connecting to the third device 30 to the user device 20. For example, in the case where the guest device 10 and the third device 30 establish a communication network by using wireless fidelity (Wi-Fi), the interface between the guest device 10 and the user device 20 may be defined by using an optional field included in a wired / wireless local area network (LAN) frame.
[0073] According to an embodiment of the present disclosure, the visitor device 10 and the user device 20 can define an interface based on a natural language. For example, the visitor device 10 and the user device 20 can send and receive voice input from the user in the form of a file. In addition, the visitor device 10 and the user device 20 can convert the voice into a structured text form (e.g., comma separated values (CSV), extensible markup language (XML), hypertext markup language (HTML), JavaScript object notation (JSON), etc.), or convert the voice into a text form in a natural language form, and send and receive text.
[0074] In action ⑧, the guest device 10 may terminate the Wi-Fi Direct or ad hoc function and generate a user interface notifying that the third device 30 has been accessed and the guest mode has been executed.
[0075] For example, if the guest device 10 is an artificial intelligence (AI) speaker, the guest device 10 may notify the user of the start of the guest mode by voice. Meanwhile, if the guest device 10 is a smart phone or a tablet PC, the guest device 10 may display a user interface notifying the start of the guest mode on a display or the like.
[0076] Meanwhile, in the aforementioned embodiment, it is described that a user command (e.g., user speech) for requesting configuration of the guest mode to enter the guest mode is received. However, this is only an example, and in the case where the guest device 10 is connected to a network system (e.g., a home network system) included in the user device 20, the guest device 10 may enter the guest mode.
[0077] Figure 1b is a diagram for illustrating a situation in which a user device is used to utilize a guest mode of an artificial intelligence assistant according to an embodiment of the present disclosure.
[0078] In action ①, the guest device 10 can receive the command of user 1 to play music by using the B artificial intelligence assistant function. Hereinafter, the explanation will be based on the assumption that the call word of the B artificial intelligence assistant is "Bixby". The command of user 1 can be, for example, "Bixby, continue playing the album of the singer I listened to yesterday". The guest device 10 can receive the speech of user 1 and recognize the content included in the received speech by using a smart app such as a voice recognition app.
[0079] According to various embodiments of the present disclosure, the guest device 10 may identify content included in a command received from the user 1 by using the A server 15 .
[0080] For example, in action ②, the guest device 10 may send the received command to the third device 30. In addition, in action ②', the A server 15 may receive the command of the user 1. The A server 15 may receive the speech of the user 1 and recognize the content of the speech by using an intelligent program such as a speech recognition program.
[0081] In action ③, the A server 15 may send the content of the speech to the third device 30. In addition, in action ③', the visitor device 10 may receive the content of the speech for wishing to play music.
[0082] According to various embodiments of the present disclosure, in a case where the visitor device 10 recognizes the utterance of the user 1 by using a smart app such as a voice recognition app, actions ②, ②′, ③, and ③′ may be omitted.
[0083] In action ④, the guest device 10 may divide the command of the user 1 into an action to be performed by the guest device 10 and an action to be performed by the user device 20. For example, the guest device 10 may determine that playing music is an action of the guest device 10, and obtaining a music file (e.g., a music file in an album of a singer that the user listened to yesterday) is an action of the user device 20.
[0084] In action ⑤, the guest device 10 may request the user device 20 to send the user a music file of the singer's album that the user listened to yesterday. For example, the guest device 10 may send a natural language-based text (such as "Bixby, send me the music file from the singer's album that I listened to yesterday") to the third device 30 by using the identification information received from the user device 20 (e.g., Bixby as the call word of the B artificial intelligence assistant). According to another embodiment of the present disclosure, the guest device 10 may directly send the input voice (not the natural language-based text) to the user device 20 in the form of a file according to the interface defined between the guest device 10 and the user device 20, or change the input voice into a structured text corresponding to the B artificial intelligence assistant function and send the text to the user device 20.
[0085] According to various embodiments of the present disclosure, in a case where the identification information is not "Bixby" but the name of B's artificial intelligence assistant, the manufacturer of B's artificial intelligence assistant, the information of the uniform resource locator (URL) of B's artificial intelligence assistant, or the platform providing B's artificial intelligence assistant, the visitor device 10 may perform the same action as action ⑤ by using "Bixby", where "Bixby" is a call word stored corresponding to the name of B's artificial intelligence assistant, the manufacturer of B's artificial intelligence assistant, the information of the uniform resource locator (URL) of B's artificial intelligence, or the platform providing B's artificial intelligence assistant.
[0086] In action ⑤, the user device 20 may receive a request from the guest device 10 from the third device 30, namely, “Bixby, send me the music file from the album of the singer I listened to yesterday”.
[0087] In action ⑥, the user device 20 may search for a music file corresponding to the request of the guest device 10 (e.g., a music file in an album of a singer that the user listened to yesterday). In addition, in action ⑥, in the case where the music file corresponding to the request of the guest device 10 (e.g., a music file in an album of a singer that the user listened to yesterday) does not exist in the user device 20, the user device 20 may request the B server 25 connected via the communication network to send the music file corresponding to the request of the guest device 10 (e.g., a music file in an album of a singer that the user listened to yesterday), and receive the file.
[0088] In action ⑦, the user device 20 can send the received music file (for example, a music file in the album of a singer that the user listened to yesterday) to the third device 30.
[0089] In addition, in action ⑦, the guest device 10 can receive the music file transmitted from the third device 30 (for example, the music file in the album of the singer that the user listened to yesterday).
[0090] In action ⑧, the guest device 10 may execute the music playing app and play the received music file (eg, a music file in an album of a singer that the user listened to yesterday).
[0091] According to various embodiments of the present disclosure, the user 1 may control various home appliances 1000 connected to the network by using a guest mode.
[0092] For example, the guest device 10 may receive a command from user 1, namely, "Turn on the TV and show me channel 1". The guest device 10 may send the received command to the user device 20. Then, the user device 20 may control the TV 1001 connected to the network according to the received command and turn on the TV and change the channel to channel 1.
[0093] Figure 1c is a diagram for illustrating a case where a guest mode of an artificial intelligence assistant is utilized by using a server according to an embodiment of the present disclosure.
[0094] For example, the case may be a case where the B artificial intelligence assistant function provided by the B server 25 is used as a guest mode through the A server 15 used by the guest device 10.
[0095] In action ①, the guest device 10 can receive a command from user 1 to play music by using the B artificial intelligence assistant function. Hereinafter, the explanation will be based on the assumption that the call word of the B artificial intelligence assistant function is "Bixby". The command of user 1 can be, for example, "Bixby, play the album I have listened to the most". The guest device 10 can receive the speech of user 1 and recognize the content included in the received speech by using a smart app such as a voice recognition app.
[0096] According to various embodiments of the present disclosure, the guest device 10 may transmit the content included in the command received from the user 1 to the A server 15 , and may recognize the content by using a voice recognition algorithm or the like included in the A server 15 .
[0097] In action ②, the guest device 10 may send the received command in the form of a voice file to the third device 30. In addition, in action ②′, the A server 15 may receive the command of the user 1 from the third device 30.
[0098] In action ③, the A server 15 may divide the command of the user 1 into an action performed by the guest device 10 and an action performed by the B server 25. For example, the A server 15 may determine that playing music is an action of the guest device 10, and obtaining music files (e.g., music files in the album that the user has listened to the most) is an action of the B server 25.
[0099] In action ④, the A server 15 may request the B server 25 to send the music files in the “album that the user has listened to the most”. For example, the A server 15 may send a natural language-based text (such as “Bixby, send the music files in the album that I have listened to the most”) to the B server 25 by using the identification information received from the user device 20 (e.g., Bixby as the call word of the B artificial intelligence assistant), as described above with reference to Figure 1a According to another embodiment of the present disclosure, the A server 15 can send the input voice (rather than natural language-based text) directly to the B server 25 in the form of a file according to the interface defined between the A server 15 and the B server 25, or change the input voice into a structured text corresponding to the B artificial intelligence assistant function and send the text to the B server 25.
[0100] In action ⑤, the B server 25 may search for a music file corresponding to the request of the A server 15 (e.g., a music file included in the album that the user has listened to the most). In addition, in action ⑤, in the case that the music file corresponding to the request of the A server 15 (e.g., a music file included in the album that the user has listened to the most) does not exist in the B server 25, the B server 25 may request the user device 20 connected through the communication network to send the music file corresponding to the request of the A server 15 (e.g., a music file included in the album that the user has listened to the most), and receive the file.
[0101] In action ⑥, the B server 25 can send the received music files (for example, the music files included in the album that the user has listened to most) to the A server 15.
[0102] In action ⑦, the A server 15 may transmit the received music file (e.g., the music file included in the album that the user has listened to the most) to the third device 30. In addition, the A server 15 may command the guest device 10 to execute the music playback app. In addition, in action ⑦, the guest device 10 may receive the music file (e.g., the music file included in the album that the user has listened to the most) received by the third device 30 and the command from the third device 30.
[0103] In action ⑧, the guest device 10 may execute the music playing app and play the received music file (eg, the music file included in the album that the user has listened to the most).
[0104] Figure 1d 2 is a diagram for illustrating another case of utilizing a guest mode of an artificial intelligence assistant by using a server according to an embodiment of the present disclosure.
[0105] For example, the case may be a case where the guest device 10 uses the B artificial intelligence assistant function provided by the B server 25 as the guest mode through the B server 25.
[0106] In action ①, the guest device 10 can receive a command from user 1 to display an image by using the B artificial intelligence assistant function. Hereinafter, the explanation will be based on the assumption that the call word of the B artificial intelligence assistant is "Bixby". The command of user 1 can be, for example, "Bixby, show me the image I took yesterday". Then, the guest device 10 can receive the speech of user 1 and recognize the content included in the received speech by using a smart app such as a voice recognition app.
[0107] According to various embodiments of the present disclosure, the guest device 10 may transmit the content included in the command received from the user 1 to the A server 15 , and may recognize the content by using a voice recognition algorithm or the like included in the A server 15 .
[0108] In action ②, the guest device 10 may divide the command of the user 1 into an action to be performed by the guest device 10 and an action to be performed by the B server 25. For example, the guest device 10 may determine that displaying an image is an action of the guest device 10, and acquiring an image file (e.g., an image taken yesterday) is an action of the B server 25.
[0109] In action ③, the guest device 10 may send a command such as “Bixby, send the image I took yesterday” to the third device 30. In addition, in action ③′, the B server 25 may receive the command sent by the guest device 10 through the third device 30. However, the present disclosure is not limited thereto, and the guest device 10 and the B server 25 may directly send and receive commands or data through the communication network without the third device 30.
[0110] In action ④, the B server 25 may search for an image file (e.g., an image captured yesterday) corresponding to the request of the visitor device 10. In addition, in the case where there is no image file (e.g., an image captured yesterday) corresponding to the request of the visitor device 10, in action ④', the B server 25 may request that the image file (e.g., an image captured yesterday) corresponding to the request of the visitor device 10 be transmitted to the user device 20 connected through the communication network, and receive the file.
[0111] In action ⑤, the B server 25 may transmit the image file (eg, the image captured yesterday) to the third device 30. In addition, in action ⑤′, the guest device 10 may receive the image file (eg, the image captured yesterday) from the third device 30.
[0112] In action ⑥, the guest device 10 may execute the image playback app and display the received image file (eg, an image taken yesterday).
[0113] Figure 1e 2 is a diagram for illustrating a case where a guest mode of an artificial intelligence assistant is terminated according to an embodiment of the present disclosure.
[0114] In action ①, the guest device 10 may receive a command requesting the termination of the guest mode from the user 1. For example, the user 1 may speak a request to terminate the guest mode. Then, the guest device 10 may receive the speech of the user 1 and recognize the content included in the speech by using a smart app such as a voice recognition app.
[0115] According to various embodiments of the present disclosure, the guest device 10 may identify content included in a command received from the user 1 by using the A server 15 .
[0116] For example, in action ②, the guest device 10 may send the received command to the third device 30. In addition, in action ②', the A server 15 may receive the command of the user 1. In addition, the A server 15 may receive the speech of the user 1 and recognize the content of the speech by using an intelligent program such as a speech recognition program.
[0117] In action ③, the A server 15 may send the content of the speech to the third device 30. In addition, in action ③', the guest device 10 may receive the content of the speech requesting to terminate the guest mode.
[0118] According to various embodiments of the present disclosure, in a case where the visitor device 10 recognizes the utterance of the user 1 by using an intelligent program such as a voice recognition program, actions ②, ②′, ③, and ③′ may be omitted.
[0119] In action ④, the guest device 10 may send a notification regarding termination of the guest mode to the third device 30 .
[0120] In addition, in action ④′, the user device 20 may receive a notification regarding termination of the guest mode from the third device 30 .
[0121] In action ⑤, the guest device 10 may delete all data and identification information received from the user device 20 during the operation of the guest mode of the artificial intelligence assistant function. Therefore, the user 1 may not leave information related to the user 1 in another person's electronic device (such as the guest device 10). In addition, the guest device 10 may generate a user interface notifying the termination of the guest mode.
[0122] According to various embodiments of the present disclosure, the user 1 may terminate the guest mode by using the user device 20 .
[0123] In action ⑥, the user device 20 may receive a command from user 1 requesting to terminate the guest mode. For example, user 1 may speak a request to terminate the guest mode. In addition, the user device 20 may receive the speech of user 1 and recognize the content included in the speech by using an intelligent program such as a speech recognition program.
[0124] In action ⑦, the user device 20 may send a notification about terminating the guest mode to the third device 30. In addition, in action ⑦′, the guest device 10 may receive a notification about terminating the guest mode from the third device 30. In addition, the user device 20 may terminate data transmission to the guest device 10 according to the received command.
[0125] Upon receiving the notification about terminating the guest mode, the guest device 10 may delete all data and identification information received from the user device 20 during the operation of the guest mode of the artificial intelligence assistant function. Therefore, the user 1 may not leave information related to the user 1 in another person's electronic device (such as the guest device 10).
[0126] As described above, according to an embodiment of the present disclosure, user 1 can use the artificial intelligence assistant function used on the user's electronic device by using another electronic device (not the electronic device used by the user). Thus, the user can use the artificial intelligence assistant function optimized according to the usage history at another electronic device without separate settings.
[0127] In addition, according to an embodiment of the present disclosure, another electronic device that supports the voice assistant visitor mode can delete all received data when the visitor mode is terminated, thereby preventing the user's information from remaining in the other electronic device.
[0128] Meanwhile, in the aforementioned embodiment, it is described that the guest device 10 and the user device 20 use different artificial intelligence assistant functions from each other, but this is only an example, and the guest device 10 and the user device 20 may use the same artificial intelligence assistant function. For example, both the guest device 10 and the user device 20 may use the artificial intelligence assistant function interlocked with the A server 15. In this case, if a command requesting configuration of the guest mode is received at the guest device 10, the guest device 10 may obtain the account information of the user device 20 from the A server 15. Then, the guest device 10 may access the user device 20 based on the obtained account information of the user device 20, and control the user device 20.
[0129] In addition, in the aforementioned embodiment, in the case where the user utterance using the call word of the B artificial intelligence assistant is input into the visitor device 10, the visitor device 10 transmits the user utterance (or a text corresponding to the user utterance) to the user device 20. However, this is merely an example, and in the case where the user utterance using the call word of the A artificial intelligence assistant is input into the visitor device 10, the visitor device 10 may also transmit the user utterance (or a text corresponding to the user utterance) to the user device 20.
[0130] For example, when the call word of A artificial intelligence assistant is "Galaxy" and the call word of B artificial intelligence assistant is "Bixby", the user voice of "Galaxy, please show me the image I took yesterday" may be input into the guest device 10. Here, the guest device 10 may receive the user speech and recognize the content included in the received speech by using a smart app such as a voice recognition app.
[0131] The guest device 10 may divide the command of the user 1 into an action to be performed by the guest device 10 and an action to be performed by the user device 20 (or the B server 25). For example, the guest device 10 may determine that displaying an image is an action of the guest device 10, and acquiring an image file (e.g., an image taken yesterday) is an action of the user device 20 (or the B server 25).
[0132] Here, the guest device 10 may use the call word of the B artificial intelligence assistant function included in the identification information to send a command determined as an operation of the user device 20 (or the B server 25). For example, the guest device 10 may generate a command including the call word of the B artificial intelligence assistant function, such as a text (or structured text) like "Bixby, send the image I took yesterday", and send the generated command to the user device 20 (or the B server 25).
[0133] Then, in response to the command received from the guest device 10 , the user device 20 (or the B server 25 ) may transmit the image captured yesterday to the guest device 10 .
[0134] That is, even if a user command including a call word of the B artificial intelligence assistant function is not input, the guest device 10 can transmit the user command to the user device 20 (or the B server 25) by using the call word of the B artificial intelligence assistant function.
[0135] In another embodiment of the present disclosure, the guest device 10 may determine the action to be performed by the user device 20 based on the call word of the B artificial intelligence assistant function included in the user utterance. For example, in the case where the user utterance "Galaxy, request Bixby to send the image I took yesterday" is received at the guest device 10, the guest device 10 may determine that the action to be performed by the B artificial intelligence assistant (i.e., the user device 20) is "send the image taken yesterday" based on the call word "Bixby" of the B artificial intelligence assistant included in the user utterance.
[0136] Figure 2 is a diagram for illustrating a case in which a guest device generates a notification notifying the start and termination of a guest mode included in an artificial intelligence assistant function according to an embodiment of the present disclosure.
[0137] refer to Figure 2 In (a), the guest device 10 may receive a user command requesting configuration of the guest mode and display a notification of “Ready to configure guest mode” 210 .
[0138] In the case where the guest device 10 is an AI speaker, the guest device 10 may receive a user speech requesting configuration of the guest mode. The AI speaker may receive the user speech and convert the speech into text form by using an intelligent app such as a speech recognition app, and recognize the speech content requesting configuration of the guest mode.
[0139] In the case where the guest device 10 includes a touch screen or physical keys (such as a smart phone), the guest device 10 can receive a user's touch input or key input requesting configuration of the guest mode and start the guest mode. However, the present disclosure is not limited thereto, and the smart phone can also receive a user's speech and start the guest mode.
[0140] According to various embodiments of the present disclosure, in the case where the guest device 10 is an AI speaker, the guest device 10 may generate a voice of "preparing to configure the guest mode". However, the present disclosure is not limited thereto, and the guest device 10 may generate light using a lighting device installed inside thereof to indicate the steps of preparing to configure the guest mode. In addition, the guest device 10 may generate a sound to indicate the steps of preparing to configure the guest mode.
[0141] refer to Figure 2 (b), the guest device 10 may transmit an identification signal for searching for a communicable device located nearby by performing a Wi-Fi direct connection or a self-organizing function. Here, the identification signal may be, for example, a signal requesting identification information for using an artificial intelligence assistant function used at the user device.
[0142] The guest device 10 may transmit an identification signal, and during the reception of the identification information, may display a notification of “identification usage information” 220 on the display 11 .
[0143] According to various embodiments of the present disclosure, in the case where the guest device 10 is an AI speaker, the guest device 10 may generate a voice of "recognizing usage information". However, the present disclosure is not limited thereto, and the guest device 10 may generate light using a lighting device installed inside thereof to indicate the step of recognizing usage information. In addition, the guest device 10 may generate a sound to indicate the step of recognizing usage information.
[0144] refer to Figure 2 (c), when the guest device 10 receives the identification information from the user device, the guest device 10 may start the guest mode. For example, the guest device 10 may change the communication method to the Wi-Fi mode and provide the user device with Wi-Fi connection information that allows access to the third device. When recognizing that the user device has accessed the third device, the guest device 10 may display a notification of "starting the guest mode" 230 on the display 11.
[0145] According to various embodiments of the present disclosure, in the case where the visitor device 10 is an AI speaker, the visitor device 10 may generate a voice of "starting the visitor mode". However, the present disclosure is not limited thereto, and the visitor device 10 may generate light using a lighting device installed inside thereof to indicate the step of starting the visitor mode. In addition, the visitor device 10 may generate a sound to indicate the step of starting the visitor mode.
[0146] refer to Figure 2 (d), when the guest device 10 receives a user command requesting to terminate the guest mode, the guest device 10 may terminate the guest mode. For example, in the case where the guest device 10 is an AI speaker, the guest device 10 may receive a user speech requesting to terminate the guest mode. The guest device 10 may receive the user speech and recognize the content of the speech by using an intelligent app such as a voice recognition app.
[0147] In the case where the guest device 10 includes a touch screen or physical keys (such as a smart phone), the guest device 10 can receive a user's touch input or key input requesting to terminate the guest mode and terminate the guest mode. However, the present disclosure is not limited thereto, and the smart phone can also receive a user's speech and terminate the guest mode.
[0148] According to an embodiment of the present disclosure, the guest device 10 may delete all data and identification information received from an external server or a user device and stored in the guest device 10 during execution of the guest mode.
[0149] After deleting the data or while deleting the data, the guest device 10 may display a notification of "terminating the guest mode" 240 on the display 11. In the case where the guest device 10 is an AI speaker, the guest device 10 may generate a voice of "terminating the guest mode". However, the present disclosure is not limited thereto, and the guest device 10 may generate light using a lighting device installed inside thereof to indicate the step of terminating the guest mode. In addition, the guest device 10 may generate a sound to indicate the step of terminating the guest mode.
[0150] Figure 3 is a diagram for illustrating a situation in which a user device requests user authentication to start a guest mode of an artificial intelligence assistant according to an embodiment of the present disclosure.
[0151] refer to Figure 3 (a), the user device 20 may generate a notification requesting user authentication for starting the guest mode. For example, when receiving an identification signal requesting identification information for executing the guest mode from the guest device, the user device 20 may display a user interface of “requesting user authentication for the guest mode” 310 on the display 21.
[0152] refer to Figure 3 (b), the user device 20 may display a user interface requesting a user utterance for user authentication to send identification information. For example, the user device 20 may display a user interface of “Samsung” and “Read the displayed word” 320 .
[0153] According to an embodiment of the present disclosure, the user device 20 can receive user speech and analyze voice data to identify the user. That is, the user device 20 can compare the voice characteristics (e.g., tone, intonation, etc.) of the read-out displayed word with the user's voice characteristics accumulated when using the artificial intelligence assistant function, and identify whether the characteristics are the same.
[0154] refer to Figure 3 (c) , when the voice characteristics of the read-out speech are the same as the voice characteristics accumulated when using the artificial intelligence assistant function, the user device 20 can display a user interface of “User authentication of guest mode completed” 340 on the display 21 .
[0155] refer to Figure 3 (d), when the voice characteristics of the read-out utterance and the voice characteristics accumulated when using the artificial intelligence assistant function are different, the user device 20 may display a user interface for requesting the utterance again. In this case, the user device 20 may set a word that can more easily distinguish the voice characteristics than the previously displayed word. For example, the user device may display a user interface of "boiled eggs" and "read the displayed word" 330.
[0156] Meanwhile, in the case where the voice characteristics of the read-out speech are the same as the voice characteristics accumulated when the artificial intelligence assistant function is used, the user device 20 may display a user interface of “User authentication of the guest mode has been completed” 340 on the display 21, such as Figure 3 Same as in (c).
[0157] Figure 4 1 is a diagram for illustrating various situations in which a user device requests user authentication according to an embodiment of the present disclosure.
[0158] According to an embodiment of the present disclosure, the user device 20 may perform user confirmation for sending identification information by various methods other than recognizing speech.
[0159] refer to Figure 4 (a) to Figure 4 (c) The user device 20 may display a biometric user interface for recognizing at least a part of the user's body on the display 21.
[0160] refer to Figure 4 (a), the user device 20 may display the iris recognition user interface 410. In addition, the user device 20 may recognize the user's irises by taking an image using a camera (not shown) installed inside the user device with both eyes of the user located in two circles.
[0161] refer to Figure 4 (b), the user device 20 may display the face recognition user interface 420. The user device 20 may capture an image with the user's face located in an ellipse by using a camera (not shown) installed inside the user device and recognize the user's face.
[0162] refer to Figure 4 (c), the user device 20 may display the fingerprint recognition user interface 430. In addition, the user device 20 may include a fingerprint recognition module in a portion of the display 21. In this case, the user device 20 may display the fingerprint recognition user interface in a specific area of the display 21.
[0163] According to various embodiments of the present disclosure, the user device 20 may position the fingerprint recognition module in a main key or a different area of the user device 20. In this case, the user device 20 may display a user interface on the display 21 to guide positioning the finger on the area.
[0164] refer to Figure 4(d), the user device 20 may display a user interface 440 for inputting a predetermined password. In this case, for example, when the user touches the password input user interface, the user device may display a pop-up user interface on the display 21 in which characters or numbers may be input.
[0165] Figure 5 is a schematic block diagram of a guest device, a user device, and a server according to an embodiment of the present disclosure.
[0166] refer to Figure 5 (a) to Figure 5 (c), the visitor device 10 may include a processor 510, a communication unit 512, a memory 514, and an input unit 516. The user device 20 may include a processor 520, a communication unit 522, a memory 524, and a display 526. The server 15 may include a processor 530, a communication unit 532, and a memory 534. However, the present disclosure is not limited thereto, and the visitor device 10, the user device 20, and the server 15 may include more or fewer components.
[0167] According to an embodiment of the present disclosure, the processors 510, 520, 530 may, for example, operate software and control at least one other component (e.g., hardware or software component) of the electronic device connected to the processors 510, 520, 530, and perform various data processing and operations. In addition, the processors 510, 520, 530 may load a command or data received from another component (e.g., a communication unit) onto a volatile memory and process it, and store the result data in a non-volatile memory.
[0168] In addition, according to an embodiment of the present disclosure, the processors 510, 520, 530 may include a main processor (e.g., a central processing unit or an application processor) and an auxiliary processor (e.g., a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor) that operates independently of the main processor and additionally or generally uses lower power than the main processor or is dedicated to a specified function. Here, the auxiliary processor may operate separately from the main processor, or may operate by being embedded in the main processor.
[0169] In this case, the auxiliary processor can, for example, replace the main processor for control when the main processor is in an inactive (e.g., sleep) state, or control at least some of the functions or states related to at least one component (e.g., input unit or communication unit) among the components of the electronic device together with the main processor when the main processor is in an active (e.g., executing an application) state. According to an embodiment of the present disclosure, the auxiliary processor (e.g., image signal processor or communication processor) can be implemented as some components of another component that is functionally related (e.g., communication unit, camera module).
[0170] According to an embodiment of the present disclosure, the memory 514, 524, 534 may store various data (e.g., software) used by at least one component of the electronic device (e.g., processor 510, 520, 530) and input data or output data about commands related thereto. In addition, the memory 514, 524, 534 may include a volatile memory or a non-volatile memory.
[0171] In addition, according to an embodiment of the present disclosure, the communication units 512, 522, 532 may support establishing a wired or wireless communication channel with the guest device 10, the user device 20, and the server 15, and perform communication through the established communication channel. In addition, the communication units 512, 522, 532 may include at least one communication processor that supports wired communication or wireless communication and operates independently of the processors 510, 520, 530 (e.g., an application processor).
[0172] In addition, according to an embodiment of the present disclosure, the communication units 512, 522, and 532 may include a wireless communication module (e.g., a cellular communication module, a near-field wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module or a power line communication module), and may communicate with an external electronic device through a first network (e.g., a near-field communication network, such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network (e.g., a long-distance communication network, such as a cellular network, the Internet, or a computer network (e.g., a LAN or a WAN)) by using a corresponding communication module in the first network or the second network. The aforementioned various types of communication modules may be implemented as one chip or as separate chips, respectively.
[0173] refer to Figure 5 (a), when a command requesting configuration of a visitor mode in which an artificial intelligence assistant function can be used at an external device is received through the input unit 516, the processor 510 of the visitor device 10 can control the communication unit 512 to request identification information including a call word for using the artificial intelligence assistant function from the user device 20, and receive the identification information from the user device 20.
[0174] According to an embodiment of the present disclosure, in the memory 514 of the guest device 10, identification information received from the user device 20 and data used during the operation of the guest mode of the artificial intelligence assistant function may be stored. The input unit 516 of the guest device 10 may be, for example, a component that can receive user input, such as a microphone, a touch panel, etc. According to various embodiments of the present disclosure, the guest device 10 may further include: a display and an output unit (e.g.: a speaker, a lighting device, etc.).
[0175] refer to Figure 5 (b) When receiving a signal requesting identification information for using the artificial intelligence assistant function, the processor 520 of the user device 20 can generate a user interface requesting user confirmation to send the identification information, and if there is user confirmation, the processor 520 can control the communication unit 522 to send the identification information to the visitor device 10.
[0176] According to an embodiment of the present disclosure, data generated as a user uses the artificial intelligence assistant function may be stored in the memory 524 of the user device 20. For example, identification information for calling the artificial intelligence assistant function, the user's usage history, etc. may be stored. In addition, the memory 524 of the user device 20 may store information that enables access to a third device received from the guest device 10.
[0177] The display 526 of the user device 20 may display a user interface for requesting confirmation to send the identification information to the visitor device under the control of the processor 520. The display 526 may be in the form of a touch screen for receiving touch input. According to various embodiments of the present disclosure, the user device 20 may further include an output unit (e.g., a speaker, a lighting device, etc.), an input unit (e.g., a microphone), a camera module, etc.
[0178] refer to Figure 5 (c), the processor 530 of the server 15 may recognize the content included in the voice file received from the guest device 10 or the user device 20 by using a voice recognition algorithm. In addition, the processor 530 of the server 15 may transmit and receive data with the guest device 10 or the user device 20 according to the recognized content.
[0179] Figure 6 is a diagram illustrating an embodiment of an identification signal transmitted by a guest device to a user device according to an embodiment of the present disclosure.
[0180] refer to Figure 6 , visitor device (for example: Figure 1a The guest device 10 in the example may change the communication method to the second communication method, and then generate an identification signal including a structure as described below and search for a user device (for example: Figure 1a 20 in the user device).
[0181] By visitor device (for example: Figure 1a The identification signal generated by the guest device 10 in the wireless network may mean, for example, a frame that notifies the existence of the wireless network and helps the other device find the wireless network and is broadcast regularly (for example, 10 times per second) to participate in the wireless network. In this case, the identification signal may include various types of parameter information related to the wireless network.
[0182] The identification signal according to an embodiment of the present disclosure may be divided into a header and a frame body.
[0183] The header may include, for example, a frame control field, a duration / ID field, a destination address (DA) field and a source address (SA) field, a basic service set identifier (BSS ID) field, and a sequence control field.
[0184] The frame control field may be located at the first start portion of the frame and may have a size of 2 bytes. In addition, the frame control field may contain information related to control of a frame transmitted between each device forming a network.
[0185] The Duration / ID field is a field having a size of 2 bytes immediately following the Frame Control field. In addition, the Duration / ID field may provide a Network Allocation Vector (NAV) value or a station ID of the ps-poll frame.
[0186] The destination address (DA) field and the source address (SA) field may mean a physical address implemented on hardware and having a size of 6 bytes for identifying an electronic device.
[0187] A Basic Service Set Identifier (BSS ID) field is a numeric value and may mean a 6-byte identifier identifying a basic service area or a network ID. When several basic service areas coexist, the BSS ID field may enable the several basic service areas to identify each other.
[0188] The sequence control field is a field having a size of 2 bytes that instructs control operations to be performed sequentially according to a set order.
[0189] A frame check sequence (FCS) field is a 4-byte field located in the end portion of a frame, and is a field inserted to help detect errors on the receiver side.
[0190] According to the purpose of management, the frame body can be flexibly composed of several fields / elements with fixed or variable lengths. The frame body can include, for example, a timestamp field, a beacon interval field, a capability information field, an SSID field, and an optional field.
[0191] The timestamp field is a field having a size of 8 bytes, and is a field used for synchronization between each device in a basic service area.
[0192] The beacon interval field has a size of 2 bytes and may display a transmission period (or time interval) of a beacon frame.
[0193] The capacity information field has a size of 2 bytes and may be mainly used for a beacon frame, a probe response frame, and the like.
[0194] The SSID field is a variable field and has a character value, and may mean the name of a service provider that groups several access points and manages them under the control of one IP subnet.
[0195] The optional fields may include various information. According to an embodiment of the present disclosure, in the present disclosure, the optional fields may include information for the visitor device (e.g.: Figure 1a The guest device 10 in the example and the user device (for example: Figure 1b For example, a guest device (e.g., Figure 1a The guest device 10) and the user device (for example: Figure 1b The visitor device 20) in the user interface can define an interactive communication method based on natural language.
[0196] In this case, two devices (e.g., visitor device, user device) can send and receive the user's voice input in the form of a file, or change the user's voice input into a structured text format (e.g., comma separated values (CSV), extensible markup language (XML), hypertext markup language (HTML), JavaScript object notation (JSON), etc.), or change the user's voice input into a natural language text format and send and receive text.
[0197] Figure 7 is a diagram for illustrating utilizing a guest mode when a user device and a guest device use the same artificial intelligence assistant function according to an embodiment of the present disclosure.
[0198] In action ①, the visitor device 10 can receive a command that the user wants to display an image by using the artificial intelligence assistant function. Hereinafter, the explanation will be based on the assumption that the call word of the artificial intelligence assistant is "Bixby". The command of user 1 can be, for example, "Bixby, show pictures taken in August". The visitor device 10 can receive the speech of user 1 and recognize the content included in the received speech by using a smart app such as a voice recognition app.
[0199] According to various embodiments of the present disclosure, the guest device 10 may identify content included in a command received from the user 1 by using the A server 15 .
[0200] For example, in action ②, the guest device 10 may send the received command to the third device 30. In addition, in action ②', the A server 15 may receive the user's command. The A server 15 may receive the user 1's speech and recognize the content of the speech by using an intelligent program such as a speech recognition program.
[0201] In action ③, the A server 15 may transmit the content of the speech to the third device 30. In addition, in action ③', the visitor device 10 may receive the content of the speech for which the image is desired to be displayed.
[0202] According to various embodiments of the present disclosure, in a case where the guest device 10 recognizes the user's utterance by using a smart app such as a voice recognition app, actions ②, ②′, ③, and ③′ may be omitted.
[0203] In action ④, the guest device 10 may divide the command of the user 1 into an action to be performed by the guest device 10 and an action to be performed by the server 15. For example, the guest device 10 may determine that displaying an image is an action of the guest device 10, and acquiring an image file (e.g., an image taken in August) is an action of the server 15.
[0204] In action ⑤, the guest device 10 may request the server 15 to send the file of “images taken in August”. For example, the guest device 10 may send a natural language-based text (such as “Bixby, send the image file taken in August”) to the third device 30.
[0205] In addition, in action ⑤′, the server 15 may receive a request “Bixby, send the image file taken in August” from the guest device 10 from the third device 30 .
[0206] In action ⑥, the server 15 may search for an image file (e.g., an image file taken in August) corresponding to the request of the visitor device 10. In addition, in the case where the image file (e.g., an image file taken in August) corresponding to the request of the visitor device 10 does not exist at the server 15, in action ⑥', the server 15 may request the image file (e.g., an image file taken in August) corresponding to the request of the visitor device 10 from the user device 20 connected through the communication network, and receive the file.
[0207] In action ⑦, the server 15 may send the image file to the third device 30 .
[0208] Furthermore, in action ⑦′, the guest device 10 may receive the image file from the third device 30 .
[0209] In action ⑧, the guest device 10 may execute the image playback app and display the received image file (eg, an image file taken in August).
[0210] Figure 8 is a flow chart illustrating a method for executing a visitor mode of an artificial intelligence assistant function according to an embodiment of the present disclosure.
[0211] Referring to action 810, the guest device 10 may receive a command requesting configuration of the guest mode of the artificial intelligence assistant function. In addition, the guest device 10 may receive a user speech and recognize the content included in the speech by using a smart app such as a voice recognition app. In this case, the guest device 10 may send the received command to a server that establishes a communication network for the artificial intelligence assistant function, and recognize the content included in the speech.
[0212] Referring to action 820, the guest device 10 may change the first communication method to the second communication method. For example, the guest device 10 may change the Wi-Fi mode to an ad-hoc mode or a Wi-Fi Direct mode.
[0213] Referring to action 830 , the guest device 10 may request identification information for using the artificial intelligence assistant function from the user device 20 by using a second communication method.
[0214] Referring to action 840, the user device 20 may generate a user interface requesting user confirmation to send the identification information and display the user interface. For example, the user device 20 may receive the user confirmation by using a voice recognition function.
[0215] Referring to action 850 , the user device 20 may send identification information to the guest device 10 .
[0216] Referring to action 860 , the guest device 10 that has received the identification information may transmit information allowing connection to the first communication method to the user device 20 .
[0217] Referring to action 870, the guest device 10 may change the second communication method to the first communication method. For example, the guest device 10 may change the ad hoc mode or the Wi-Fi Direct mode to the Wi-Fi mode.
[0218] Referring to action 880, the user device 20 may be connected to the guest device 10 by establishing a communication network using connection information that allows connection to the first communication method.
[0219] Referring to action 890 , the user device 20 may send a connection complete message to the guest device 10 .
[0220] Figure 9a is a flowchart illustrating a case where a guest mode of an artificial intelligence assistant is utilized by using a user device according to an embodiment of the present disclosure.
[0221] Referring to action 910, the guest device 10 may receive a command from a user that he or she wishes to use an artificial intelligence assistant.
[0222] Referring to action 912, the guest device 10 may distinguish between an action to be performed by the guest device 10 and an action to be performed by the user device 20 in the received command. For example, in the case where the user command is "Bixby, tell me today's itinerary", the guest device 10 may determine that obtaining today's itinerary is an action of the user device 20, and displaying the received itinerary is an action of the guest device 10.
[0223] Referring to action 914, the visitor device 10 may send a command including an action of the user device 20 to the user device 20 by using the previously received identification information of the artificial intelligence assistant used by the user device 20. For example, the visitor device 10 may send a natural language-based text (such as "Bixby, send me today's itinerary") to the user device 20.
[0224] Referring to action 916, the user device 20 may obtain data according to the received command. For example, the user device 20 may obtain the user's today's itinerary stored in the itinerary app. According to various embodiments of the present disclosure, the user device 20 may obtain the user's today's itinerary by interlocking with a server supporting an artificial intelligence assistant function.
[0225] Referring to action 918 , the user device 20 may send data to the guest device 10 .
[0226] Referring to action 920, the guest device 10 may execute the user command by using the received data. For example, the guest device 10 may provide the received user's today's itinerary through a speaker, or display the itinerary through a display.
[0227] Figure 9b is a flowchart for illustrating a case where a guest mode of an artificial intelligence assistant is utilized by using a server according to an embodiment of the present disclosure.
[0228] Referring to action 930, the visitor device 10 may receive a command from a user who wishes to use an artificial intelligence assistant. The user's command may be, for example, "Bixby, tell me about tomorrow's schedule."
[0229] Referring to action 932 , the guest device 10 may send the received user command to the A server 15 .
[0230] Referring to action 934, the A server 15 may distinguish in the received command between an action to be performed by the guest device 10 and an action to be performed by the B server 25. For example, the A server 15 may determine that obtaining tomorrow's itinerary is an action of the B server 25, while displaying the received itinerary is an action of the guest device 10.
[0231] Referring to action 936, the A server 15 may send a command including an action of the B server 25 to the B server 25 by using the previously received identification information of the artificial intelligence assistant used by the B server 25. For example, the A server 15 may send a natural language-based text (e.g., "Bixby, send me tomorrow's schedule") to the B server 25.
[0232] Referring to action 938, the B server 25 may obtain data according to the received command. For example, the B server 25 may obtain a user's specific file (e.g., the user's tomorrow's itinerary file) stored in the memory. According to various embodiments of the present disclosure, the B server 25 may obtain a user's specific file (e.g., the user's tomorrow's itinerary file) by interlocking with the user device 20.
[0233] Referring to action 940 , the B server 25 may send the acquired data to the A server 15 .
[0234] Referring to action 942 , the A server 15 may identify the action of the guest device 10 .
[0235] Referring to action 944, the A server 15 may transmit the action to be performed by the guest device 10 and the received data to the guest device 10. For example, the A server 15 may instruct the guest device 10 to execute the trip management app.
[0236] Referring to action 946, the guest device 10 may execute the user command by using the received action and data to be executed by the guest device 10. For example, the guest device 10 may provide the received user's tomorrow's itinerary through a speaker, or display the itinerary through a display.
[0237] Fig.9c 2 is a diagram for illustrating another case of utilizing a guest mode of an artificial intelligence assistant by using a server according to an embodiment of the present disclosure.
[0238] Referring to action 950 , the guest device 10 may receive a command from a user that he or she wishes to use an artificial intelligence assistant.
[0239] Referring to action 952, the guest device 10 may divide the received command into an action to be performed by the guest device 10 and an action to be performed by the B-server 25. For example, in the case where the user command is "Bixby, show me the document I drafted yesterday", the guest device 10 may determine that obtaining the document drafted yesterday is an action of the B-server 25, while displaying the received file is an action of the guest device 10.
[0240] Referring to action 954, the guest device 10 may send a command including an action of the B server 25 to the B server 25 by using the previously received identification information of the artificial intelligence assistant used by the B server 25. For example, the guest device 10 may send a natural language-based text (such as “Bixby, show me the document I drafted yesterday”) to the B server 25.
[0241] Referring to action 956, the B server 25 may obtain data according to the received command. For example, the B server 25 may obtain a document file stored in a document drafting app (e.g., a document file drafted by the user yesterday). According to various embodiments of the present disclosure, the B server 25 may obtain a document file (e.g., a document file drafted by the user yesterday) by interlocking with the user device 20.
[0242] Referring to action 958 , the user device 20 may transmit the acquired data to the guest device 10 .
[0243] Referring to action 960, the guest device 10 may execute the user command by using the received data. For example, the guest device 10 may display the received document file (eg, the document file drafted by the user yesterday) through the display.
[0244] Fig.10 is a flowchart illustrating a case where a guest mode is utilized when a guest device and a user device use the same artificial intelligence assistant function according to an embodiment of the present disclosure.
[0245] Referring to action 1010 , the visitor device 10 may receive a command from a user that he or she wishes to use an artificial intelligence assistant.
[0246] Referring to action 1020, the guest device 10 may divide the actions to be performed by the guest device and the actions to be performed by the user device in the received command. For example, in the case where the user command is "Bixby, play Beethoven's Fifth Symphony", the guest device 10 may determine that obtaining the music file of Beethoven's Fifth Symphony is an action of the A server 15, and playing the received music file is an action of the user device 20.
[0247] Referring to action 1030, the guest device 10 may send a command including an action of the A server 15 to the user device 20 by using the identification information of the artificial intelligence assistant. For example, the guest device 10 may send a natural language-based text (such as "Bixby, send me the music file of Beethoven's Fifth Symphony") to the A server 15.
[0248] Referring to action 1040, the A server 15 may obtain data according to the received command. For example, the A server 15 may obtain a music file (e.g., a music file of Beethoven's Fifth Symphony) stored in the memory. According to various embodiments of the present disclosure, the A server 15 may obtain a music file (e.g., a music file of Beethoven's Fifth Symphony) by interlocking with the user device using an artificial intelligence assistant function.
[0249] Referring to action 1050 , the A server 15 may transmit data (eg, a music file) to the guest device 10 .
[0250] Referring to action 1060, the guest device 10 may execute the user command by using the received data. For example, the guest device 10 may play the received music file (eg, a music file of Beethoven's Fifth Symphony) through a speaker.
[0251] Fig.11a is a flowchart illustrating a case where an artificial intelligence assistant function is terminated by using a visitor device according to an embodiment of the present disclosure.
[0252] Referring to action 1110 , the guest device 10 may receive a command from a user that he or she wishes to terminate the guest mode of the artificial intelligence assistant function.
[0253] Referring to action 1112, the guest device 10 may notify the user device 20 that a command requesting the user to terminate the guest mode has been received. For example, the guest device 10 may send a natural language-based text (such as "Bixby, terminate the guest mode") to the user device 20.
[0254] Referring to action 1114 , the user device 20 may terminate the first communication method of forming a communication network with the guest device 10 .
[0255] Referring to action 1116, the guest device 10 may delete the received data and identification information. For example, the guest device 10 may execute the guest mode of the artificial intelligence assistant function and delete the identification information received from the user device 20 and all data received from the user device 20 or an external server.
[0256] Fig.11b is a flowchart illustrating a case where an artificial intelligence assistant function is terminated by using a user device according to an embodiment of the present disclosure.
[0257] Referring to action 1120, the user device 20 may receive a command from a user wishing to terminate the guest mode of the artificial intelligence assistant.
[0258] Referring to action 1122 , the user device 20 may notify the guest device 10 that a command requesting the user to terminate the guest mode has been received.
[0259] Referring to action 1124, the guest device 10 may delete the received data and identification information. For example, the guest device 10 may execute the guest mode of the artificial intelligence assistant function and delete the identification information received from the user device 20 and all data received from the user device 20 or an external server.
[0260] Referring to action 1126 , the user device 20 may terminate the first communication method of forming a communication network with the guest device 10 .
[0261] Fig.12 is a diagram for illustrating a method for operating an artificial intelligence assistant function according to an embodiment of the present disclosure.
[0262] refer to Fig.12 , the artificial intelligence assistant function may include an electronic device 1200d including a visitor device 10 and a user device 20, an intelligent server 1200a, a personal information server 1200b, and a suggestion server 1200c. According to various embodiments of the present disclosure, the intelligent server 1200a, the personal information server 1200b, and the suggestion server 1200c may be constructed as follows Figure 1a A server in .
[0263] The intelligent server 1200a may include an automatic speech recognition (ASR) module 1210, a natural language understanding (NLU) module 1220, a path planner module 1230, a dialogue manager (DM) module 1240, a natural language generator (NLG) module 1250 or a text to speech (TTS) module 1260.
[0264] The natural language understanding module 1220 or the path planner module 1230 of the intelligent server 1200a can generate path rules.
[0265] According to an embodiment of the present disclosure, the automatic speech recognition (ASR) module 1210 may convert a user input received from the electronic device 1200 d into text data.
[0266] According to an embodiment of the present disclosure, the automatic speech recognition module 1210 can convert the user input received from the electronic device 1200d into text data. For example, the automatic speech recognition module 1210 may include a speech recognition module. The speech recognition module may include an acoustic model and a language model. For example, the acoustic model may include information related to utterance, and the language model may include unit phoneme information and information about a combination of unit phoneme information. The speech recognition module may convert the user speech into text data by using information related to utterance and information related to unit phoneme information. Information about the acoustic model and the language model may be stored, for example, in an automatic speech recognition database (ASR DB) 1211.
[0267] According to an embodiment of the present disclosure, the natural language understanding module 1220 can identify the user's intention by performing syntactic analysis or semantic analysis. Syntactic analysis can divide the user input into syntactic units (e.g., words, phrases, morphemes, etc.) and identify which syntactic elements the divided units have. Semantic analysis can be performed by using semantic matching, rule matching, formula matching, etc. Therefore, the natural language understanding module 1220 can obtain the domain and intention of the user input, or the parameters (or time slots) required to express the intention.
[0268] According to an embodiment of the present disclosure, the natural language understanding module 1220 can determine the user's intention and parameters by using matching rules, and the matching rules are divided into domains, intentions, and parameters (or time slots) required to identify the intentions. For example, a domain (e.g., notification) can include multiple intentions (e.g., notification settings, notification release, etc.), and an intention can include multiple parameters (e.g., time, number of repetitions, notification sound, etc.). Multiple rules can include, for example, at least one basic element parameter. The matching rules can be stored in a natural language understanding database (NLU DB) 1221.
[0269] According to an embodiment of the present disclosure, the natural language understanding module 1220 can determine the user's intention by using language features such as morphemes, phrases, etc. (e.g., syntactic elements) to identify the meaning of words extracted from the user input and by matching the meaning of the identified words with the domain and intent. For example, the natural language understanding module 1220 can determine the user's intention by calculating how many words extracted from the user input are included in each domain and intent. According to an embodiment of the present disclosure, the natural language understanding module 1220 can determine the parameters of the user input by using words that become the basis for identifying the intention. In addition, according to an embodiment of the present disclosure, the natural language understanding module 1220 can determine the user's intention by using a natural language understanding database 1221 storing language features for identifying the intention of the user input. According to another embodiment of the present disclosure, the natural language understanding module 1220 can determine the user's intention by using a personal language model (PML). For example, the natural language understanding module 1220 can determine the user's intention by using personal information (e.g., contact list, music list). The personal language model can be stored in, for example, a natural language understanding database 1221. According to an embodiment of the present disclosure, not only the natural language understanding module 1220 but also the automatic speech recognition module 1210 may recognize the user's speech by referring to a personal language model stored in the natural language understanding database 1221 .
[0270] According to an embodiment of the present disclosure, the natural language understanding module 1220 may generate a path rule based on the intent and parameters input by the user. For example, the natural language understanding module 1220 may select an app to be executed based on the intent input by the user, and determine the action to be performed at the selected app. The natural language understanding module 1220 may generate a path rule by determining the parameters corresponding to the determined action. According to an embodiment of the present disclosure, the path rule generated by the natural language understanding module 1220 may include information about the app to be executed, the action to be performed at the app, and the parameters required to perform the action.
[0271] According to an embodiment of the present disclosure, the natural language understanding module 1220 can generate one or more path rules based on the intention and parameters input by the user. For example, the natural language understanding module 1220 can receive a path rule set corresponding to the electronic device 1200d from the path planner module 1230, and can use the received path rule set to map the intention and parameters input by the user, and thereby determine the path rule.
[0272] According to another embodiment of the present disclosure, the natural language understanding module 1220 can generate a path rule or multiple path rules by determining the app to be executed, the action to be performed at the app, and the parameters required to execute the app based on the intention and parameters input by the user. For example, the natural language understanding module 1220 can generate path rules by using the information of the electronic device 1200d to arrange the app to be executed and the action to be performed at the app in the form of an ontology or a graphical model. The generated path rules can be stored in, for example, a path rule database (PR DB) 1231 by the path planner module 1230. In addition, the generated path rules can be added to the path rule set of the data set 1231.
[0273] According to an embodiment of the present disclosure, the natural language understanding module 1220 may select at least one path rule from a plurality of generated path rules. For example, the natural language understanding module 1220 may select the optimal path rule from a plurality of path rules. As another example, in the case where only some actions are specified based on user speech, the natural language understanding module 1220 may select a plurality of path rules. In addition, the natural language understanding module 1220 may determine a path rule from a plurality of path rules through additional input from the user.
[0274] According to an embodiment of the present disclosure, the natural language understanding module 1220 may send a path rule to the electronic device 1200d in response to a user input. For example, the natural language understanding module 1220 may send one path rule corresponding to the user input to the electronic device 1200d. In another example, the natural language understanding module 1220 may send multiple path rules corresponding to the user input to the electronic device 1200d. In the case where only some actions are specified based on user speech, multiple path rules may be generated, for example, by the natural language understanding module 1220.
[0275] According to an embodiment of the present disclosure, the path planner module 1230 may select at least one path rule among a plurality of path rules.
[0276] According to an embodiment of the present disclosure, the path planner module 1230 may send a path rule set including a plurality of path rules to the natural language understanding module 1220. The plurality of path rules in the path rule set may be stored in a table form in a path rule database 1231 connected to the path planner module 1230. For example, the path planner module 1230 may send a path rule set corresponding to information (e.g., OS information, app information) of the electronic device 1222d to the natural language understanding module 1220. The table stored in the path rule database 1231 may be stored, for example, for each domain or each version of the domain.
[0277] According to an embodiment of the present disclosure, the path planner module 1230 may select one path rule or multiple path rules in the path rule set, and send the selected path rule to the natural language understanding module 1220. For example, the path planner module 1230 may match the user's intention and parameters with the path rule set corresponding to the electronic device 1200d, and select one path rule or multiple path rules, and send the selected path rule to the natural language understanding module 1220.
[0278] According to an embodiment of the present disclosure, the path planner module 1230 may generate one path rule or multiple path rules by using the user's intention and parameters. For example, the path planner module 1230 may determine the app to be executed and the action to be executed in the app based on the user's intention and parameters, and may generate one path rule or multiple path rules. According to an embodiment of the present disclosure, the path planner module 1230 may store the generated path rules in the path rule database 1231.
[0279] According to an embodiment of the present disclosure, the path planner module 1230 may store the path rules generated in the natural language understanding module 1220 in the path rule database 1231. The generated path rules may be added to the path rule set stored in the path rule database 1231.
[0280] According to an embodiment of the present disclosure, the table stored in the path rule database 1231 may include multiple path rules or multiple path rule sets. Multiple path rules or multiple path rule sets may reflect the kind, version, type or characteristics of the device executing each path rule.
[0281] According to an embodiment of the present disclosure, the dialogue manager module 1240 may determine whether the intention of the user identified by the natural language understanding module 1220 is clear. For example, the dialogue manager module 1240 may determine whether the user intention is clear based on whether the information of the parameter is sufficient. The dialogue manager module 1240 may determine whether the parameters identified at the natural language understanding module 1220 are sufficient to perform the task. According to an embodiment of the present disclosure, in the case where the user's intention is unclear, the dialogue manager module 1240 may perform feedback requesting necessary information from the user. For example, the dialogue manager module 1240 may perform feedback requesting information of the parameters used to identify the user's intention.
[0282] According to an embodiment of the present disclosure, the dialogue manager module 1240 may include a content provider module. If the content provider module can perform an action based on the intent and parameters recognized at the natural language understanding module 1220, the content provider module may generate a result of performing a task corresponding to the user input. According to an embodiment of the present disclosure, the dialogue manager module 1240 may send the result generated at the content provider module to the electronic device 1200d as a response to the user input.
[0283] According to an embodiment of the present disclosure, the natural language generator (NLG) module 1250 can change the specified information into a text form. The information changed into a text form can be in the form of a natural language speech. The specified information can be, for example, information about additional input, information notifying the completion of an action corresponding to a user input, or information notifying additional user input (e.g., information about feedback of a user input). The information changed into a text form can be sent to the electronic device 1200d and displayed on a display, or can be sent to a text-to-speech (TTS) module 1260 and can be changed into a voice form.
[0284] According to an embodiment of the present disclosure, the text-to-speech (TTS) module 1260 may change information in text form into information in voice form. In addition, the text-to-speech module 1260 may receive information in text form from the natural language generator module 1250, and change the information in text form into information in voice form, and send the information to the electronic device 1200d. The electronic device 1200d may output the information in voice form through a speaker.
[0285] According to an embodiment of the present disclosure, the natural language understanding module 1220, the path planner module 1230, and the dialogue manager module 1240 may be implemented as one module. For example, the natural language understanding module 1220, the path planner module 1230, and the dialogue manager module 1240 may be implemented as one module, and determine the user's intention and parameters, and generate a response (e.g., path rule) corresponding to the determined user intention and parameters. Therefore, the generated response may be sent to the electronic device 1200d.
[0286] A control method of an electronic device according to an embodiment of the present disclosure is as follows, wherein the electronic device is the aforementioned guest device 10 , and the other electronic device is the aforementioned user device 20 .
[0287] First, the electronic device may detect the occurrence of an event requesting configuration of a first mode, in which the artificial intelligence assistant function of another electronic device may be used. Here, the event requesting configuration of the first mode may include: an event receiving a user speech requesting configuration of the first mode (e.g., "Bixby, change the mode to guest mode"), an event selecting a specific button set on the electronic device, an event receiving a user input requesting configuration of the first mode through a menu screen displayed on the electronic device, an event accessing a network system including another electronic device, etc. Here, the electronic device may change the first communication method of the communication unit to the second communication method, and request identification information from another electronic device by using the second communication method.
[0288] The electronic device may request identification information including a call word for using an artificial intelligence assistant function from another electronic device. That is, the electronic device may request identification information including a call word (e.g., Bixby) for using the B artificial intelligence assistant function used by another electronic device from another electronic device. Here, the identification information may include at least one of the name of the artificial intelligence assistant, the account information of the artificial intelligence assistant, the name of the manufacturer that manufactures the artificial intelligence assistant, the URL information of the artificial intelligence assistant, or the name of the platform that provides the artificial intelligence assistant.
[0289] The electronic device may receive identification information from another electronic device as a response to the request. Here, the electronic device may receive the identification information by using the second communication method. In the case where the identification information is received by using the second communication method, the electronic device may change the second communication method back to the first communication method.
[0290] The electronic device may receive a user command while operating in the first mode of the artificial intelligence assistant. In an embodiment of the present disclosure, the electronic device may receive a user speech command including a call word included in the identification information. For example, the electronic device may receive a user speech command including a call word of "Bixby, show me the photos I took yesterday." In another embodiment of the present disclosure, the electronic device may include a user speech command including a call word of the artificial intelligence assistant function of the electronic device. For example, in a case where the call word of the artificial intelligence assistant function of the electronic device is "Galaxy," the electronic device may receive a user speech command including a call word of "Galaxy, send me the photos I took yesterday."
[0291] The electronic device can send the user command to another electronic device based on the identification information. Specifically, the electronic device can distinguish the action to be performed by another electronic device from the user command received by using the input unit, generate the action to be performed by another electronic device including the identification information as a command, and send the generated command to the other electronic device.
[0292] A control method of an electronic device according to an embodiment of the present disclosure is as follows, wherein the electronic device is the aforementioned user device 20 , and another electronic device is the aforementioned guest device 10 .
[0293] The electronic device may receive a signal requesting transmission of identification information including a call word for using an artificial intelligence assistant function. Here, the electronic device may receive the signal requesting transmission of the identification information by using a first communication method.
[0294] The electronic device may display a user interface on the display requesting the user to confirm sending the identification information. Figures 2 to 4 The method described in receives user confirmation via a user interface.
[0295] As a result of the user confirmation, the electronic device may send the identification information to another electronic device. Here, the electronic device may send the identification information by using the first communication method, and after sending the identification information, the electronic device may change the first communication method to the second communication method.
[0296] Some embodiments of the present disclosure may also be implemented in the form of a recording medium (such as a program module executed by a computer) including instructions executable by a computer. Computer-readable media may be any available media that can be accessed by a computer, and include all of volatile and nonvolatile media and separable and inseparable media. In addition, computer-readable media may include both computer storage media and communication media. Computer storage media include all of volatile and / or nonvolatile media and separable and inseparable media implemented by methods and techniques for storing information (such as computer-readable instructions, data structures, program modules or other data). Communication media typically include other data such as modulated data signals such as carrier waves, or other transmission mechanisms, and include any information transmission media.
[0297] Additionally, methods according to embodiments described herein may be provided as a computer program product.
[0298] The computer program product may include an S / W program, a storage medium readable by a computer storing the S / W program, and a product traded between a seller and a buyer.
[0299] For example, the computer program product may include a product in the form of an S / W program electronically distributed by an electronic device or a manufacturer of the electronic device or an electronic market (e.g., Google Store, Apple Store). For electronic distribution, at least a portion of the S / W program may be stored in a storage medium or may be temporarily generated. In this case, the storage medium may be a server of a manufacturer or an electronic market, or a storage medium of a relay server.
[0300] In addition, in this specification, a "section" may include a hardware component such as a processor or a circuit, and / or a software component executed by a hardware component such as a processor.
[0301] The foregoing description of the present disclosure is an exemplary description of the present disclosure, and a person of ordinary skill in the technical field to which the present disclosure belongs will be able to understand that the present disclosure can be easily modified into another specific form without changing the technical ideas or basic characteristics of the present disclosure. Therefore, the embodiments described above should be understood as exemplary embodiments in all aspects and should not be understood as restrictive embodiments. For example, each component described as a single type can be implemented when dispersed, and similarly, the components described as dispersed can be implemented in a combined form.
[0302] Additionally, the scope of the present disclosure is more fully described by the appended claims rather than the detailed description above, and it should be interpreted that all modifications or modified forms derived from the meaning and scope of the claims and their equivalent concepts are included in the scope of the present disclosure.
Claims
1. An electronic device, include: monitor; Ministry of Communications; processor; as well as Memory, wherein the memory includes instructions for the processor to: upon receiving a signal requesting transmission of identification information including a call word for a first mode of using an artificial intelligence assistant function of the electronic device from another electronic device via the communication unit by using a first communication method, controlling the display to display a user interface for requesting user confirmation of transmitting the identification information, as a result of user confirmation through the user interface, controlling the communication section to transmit the identification information to the other electronic device using the first communication method, and A command is received via the communication portion using a second communication method, the command including the identification information and an action to be performed by the artificial intelligence assistant function of the electronic device.
2. The electronic device according to claim 1, Wherein the memory includes instructions for causing the processor to connect to the other electronic device by using the second communication method.
3. The electronic device according to claim 2, The memory includes instructions for the processor to perform the following operations: based on receiving a command from the other electronic device via the communication unit requesting termination of the first mode of the artificial intelligence assistant function, terminating the connection with the other electronic device.
4. The electronic device according to claim 1, The memory includes instructions for the processor to perform the following operations: based on obtaining a user command requesting termination of the first mode of the artificial intelligence assistant function, controlling the communication unit to send a command to the other electronic device requesting deletion of data sent from the electronic device.
5. The electronic device according to claim 1, The memory includes instructions for the processor to perform the following operations: connecting to an access point to which the other electronic device is connected by using the information for using the second communication method.
6. The electronic device according to claim 1, wherein the memory includes instructions for the processor to: receiving a command including an action of the electronic device from the other electronic device through the communication unit, Get data according to the received command, and The communication unit is controlled to transmit the acquired data to the other electronic device.
7. A control method for an electronic device, include: upon receiving a signal requesting transmission of identification information including a call word for a first mode of using an artificial intelligence assistant function of the electronic device from another electronic device by using a first communication method, displaying a user interface for requesting user confirmation of transmitting the identification information, as a result of user confirmation through the user interface, transmitting the identification information to the other electronic device using the first communication method, and A command is received using a second communication method, the command including the identification information and an action to be performed by the artificial intelligence assistant function of the electronic device.
8. The control method for an electronic device according to claim 7, in, The control method comprises: The connection is made to the other electronic device by using the second communication method.
9. The control method for an electronic device according to claim 8, The control method include: Based on receiving a command from the other electronic device requesting to terminate the first mode of the artificial intelligence assistant function, the connection with the other electronic device is terminated.
10. The control method for an electronic device according to claim 7, The control method include: Based on obtaining a user command requesting to terminate the first mode of the artificial intelligence assistant function, a command requesting to delete the data sent from the electronic device is sent to the other electronic device.
11. The control method for an electronic device according to claim 7, The control method include: A connection is made to an access point to which the other electronic device is connected by using the information for using the second communication method.
12. The control method for an electronic device according to claim 7, The control method include: receiving a command including an action of the electronic device from the other electronic device, Get data according to the received command, and The acquired data is sent to the other electronic device.
13. A non-transitory computer-readable recording medium comprising a program for executing a control method of an electronic device, wherein the control method of the electronic device include: upon receiving a signal requesting transmission of identification information including a call word for a first mode of using an artificial intelligence assistant function of the electronic device from another electronic device by using a first communication method, displaying a user interface for requesting user confirmation of transmitting the identification information, as a result of user confirmation through the user interface, transmitting the identification information to the other electronic device using the first communication method, and A command is received via the communication portion using a second communication method, the command including the identification information and an action to be performed by the artificial intelligence assistant function of the electronic device.
Citation Information
Patent Citations
Electronic device and speech recognition executing method using electronic device and server
CN104978965A
Computer voice control method and intelligent voice assistant system
CN106898349A
Telephone voice personnal assistant
EP2784774A1
Apparatus and method for remote controlling terminal
KR1020130116107A
Virtual assistant system to remotely control external services and selectively share control
US20150213355A1
