Contact control program, terminal and contact control method

Abstract

To provide an artificial intelligence contact control technique that reflects personal schedule and lifestyles.SOLUTION: A contact control method according to an embodiment of the present invention is capable of processing contact requests, such as voice calls, video calls, and / or instant message receptions, which are transmitted to a user from external sources, without requiring user control, by utilizing artificial intelligence (AI) and reflecting the user's schedule and lifestyle.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The following description relates to an artificial intelligence contact control technology that reflects a personal schedule and lifestyle, and more particularly to a contact control method in which artificial intelligence (AI) can process contact requests transmitted to a user from the outside, such as voice calls, video calls, and / or instant message reception, by reflecting the user's schedule and lifestyle, a computer device that executes the contact control method, and a computer program stored in a computer-readable recording medium in combination with a computer to cause the computer to execute the contact control method, and the recording medium. [Background technology]

[0002] Electronic devices capable of wired or wireless communication can contact each other by using voice calling services, video calling services, services for sending and receiving instant messages, etc. Such a contact request may be unilaterally transmitted from a sending side (caller) to a receiving side (recipient) without the consent of the receiving side, but there are situations in which the receiving side user cannot accept the contact request transmitted at this time.

[0003] For example, suppose that a sender attempts to make a video call to a receiver, but the receiver is in a meeting and is unable to respond to the video call request. In this case, in the prior art, the receiver's electronic device outputs a notification to inform the receiver's user that a request for a video call has been transmitted, and the receiver's user can respond to the notification and generate an input to accept or reject the video call on the electronic device. In this case, the electronic device can process the execution or rejection of the video call according to the generated input. For example, Patent Document 1 relates to a caller number display and call rejection method in a mobile communication terminal, and discloses a technology that, when a call is detected and an end key input is detected on a keypad, a reception rejection menu item setting is searched for, and a reception rejection reason menu is displayed on a screen display window, and a key input corresponding to the reception rejection reason is detected, and a text message or voice message corresponding to the key is read and sent to the caller, and the call is released and a reception rejection completion is displayed on a screen display window. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Korean Patent Publication No. 10-2005-0039

[0005] However, such conventional technology has a problem that when the receiving side processes the contact request of the sending side, the receiving side requires direct control by the receiving user or setting information previously set by the receiving user for processing the contact request. For example, the user must directly input the call rejection, or directly set information regarding the time period and conditions for automatic call rejection. In other words, the conventional technology has a problem that the process related to the delivery of voice calls, video calls, or instant messages must all be directly controlled according to the situation of the receiving user. Summary of the Invention [Problem to be solved by the invention]

[0006] The present invention provides a contact control method in which artificial intelligence (AI) can process contact requests transmitted to a user from the outside, such as voice calls, video calls, and / or instant message reception, by reflecting the user's schedule and lifestyle, a computer device for executing the contact control method, and a computer program stored in a computer-readable recording medium in combination with a computer to cause the computer to execute the contact control method, and the recording medium. [Means for solving the problem]

[0007] The contact control method includes the steps of receiving a contact request from a caller via a network, determining whether the caller can directly control the contact request, and, if the caller cannot directly control the contact, using artificial intelligence to converse with the caller and process the contact.

[0008] A contact control method of a server providing a service for contact between a caller and a callee, comprising the steps of: receiving a contact request for the callee from the caller via a network; determining whether the callee can be directly controlled in response to the contact request; if the callee cannot be directly controlled, using artificial intelligence to converse with the caller and process the contact; and generating summary information of the conversation and providing it to the callee.

[0009] The present invention is characterized in that a computer program is stored in a computer-readable recording medium in combination with a computer to cause the computer to execute the contact control method.

[0010] A computer-readable recording medium having recorded thereon a program for causing a computer to execute the contact control method.

[0011] A computing device comprising at least one processor implemented to execute computer readable instructions, the at least one processor receiving a contact request from a caller over a network, determining whether direct control of the callee is possible for the contact request, and if direct control of the callee is not possible, utilizing artificial intelligence to converse with the caller of the contact to handle the contact.

[0012] A computer device providing a service for contact between a caller and a callee, comprising at least one processor implemented to execute computer readable instructions, the at least one processor receiving a contact request from the caller to the callee via a network, determining whether the callee is able to directly control the contact request, and if the callee is unable to directly control the contact, using artificial intelligence to converse with the caller of the contact to process the contact, and generating summary information of the conversation to provide to the callee. Effect of the Invention

[0013] Contact requests transmitted to the user from the outside, such as voice calls, video calls, and / or receiving instant messages, can be processed by artificial intelligence (AI) reflecting the user's schedule and lifestyle. [Brief description of the drawings]

[0014] [Figure 1] FIG. 1 illustrates an example of a network environment in accordance with an embodiment of the present invention. [Diagram 2]2 is a block diagram illustrating the internal configuration of an electronic device and a server according to an embodiment of the present invention. FIG. [Diagram 3] FIG. 1 illustrates an example of a cloud artificial intelligence platform in one embodiment of the present invention. [Figure 4] FIG. 2 is a diagram illustrating an example of an overall process for contact control of an electronic device in one embodiment of the present invention. [Diagram 5] FIG. 2 illustrates an example of an overall process for contact control of a server in accordance with an embodiment of the present invention. [Figure 6] FIG. 13 illustrates an example of providing a summary in accordance with an embodiment of the present invention. [Figure 7] FIG. 13 illustrates an example of providing a summary in accordance with an embodiment of the present invention. [Figure 8] FIG. 13 illustrates an example in which a post-processing operation is performed in accordance with an embodiment of the present invention. [Figure 9] FIG. 2 illustrates an example user interface for selecting to accept or reject a voice call in accordance with one embodiment of the present invention. [Figure 10] FIG. 13 is a diagram showing an example of a preview screen displaying a selfie video in accordance with an embodiment of the present invention. [Figure 11] 1 is a flowchart illustrating an example of a contact control method of an electronic device in an embodiment of the present invention. [Figure 12] 1 is a flow chart illustrating an example of using artificial intelligence to process contacts in accordance with an embodiment of the present invention. [Figure 13] 4 is a flowchart illustrating an example of a contact control method of a server in an embodiment of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0015] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings.

[0016] The contact control method according to the embodiment of the present invention may be executed by a computer device such as an electronic device or a server described below. In this case, a computer program according to an embodiment of the present invention may be installed and driven in the computer device, and the computer device may execute the contact control method according to an embodiment of the present invention according to the control of the driven computer program. The above-mentioned computer program may be stored in a computer-readable recording medium in order to cause a computer to execute the contact control method in combination with the computer device. For example, according to the control of an application installed and driven in the electronic device, the electronic device may automatically process a contact request transmitted from the outside to the user, such as a voice call, a video call, and / or an instant message reception, by using artificial intelligence (AI) to reflect the user's schedule and lifestyle. Such processing may be performed independently by the electronic device according to the control of an application installed and driven in the electronic device, or may be performed by a server providing an artificial intelligence function depending on the embodiment. For example, the artificial intelligence may automatically recognize a situation in which the user is unable to process the transmitted contact request, and automatically process the transmitted contact request based on the recognized situation without the need for user control.

[0017] Fig. 1 is a diagram showing an example of a network environment in one embodiment of the present invention. The network environment in Fig. 1 shows an example including a plurality of electronic devices 110, 120, 130, 140, a plurality of servers 150, 160, and a network 170. Fig. 1 is merely an example for explaining the invention, and the number of electronic devices and the number of servers are not limited to those shown in Fig. 1.

[0018] The electronic devices 110, 120, 130, 140 may be fixed terminals or mobile terminals realized by computer devices. Examples of the electronic devices 110, 120, 130, 140 include smartphones, mobile phones, navigation systems, personal computers (PCs), notebook computers, digital broadcasting terminals, personal digital assistants (PDAs), portable multimedia players (PMPs), tablets, etc. As an example, FIG. 1 shows the shape of a smartphone as an example of the electronic device 1 (110), but in the embodiment of the present invention, the electronic device 1 (110) may mean one of various physical computer devices that can communicate with other electronic devices 120, 130, 140 and / or servers 150, 160 via a network 170 using substantially wireless or wired communication methods.

[0019] The communication method is not limited, and may include not only a communication method utilizing a communication network (for example, a mobile communication network, a wired Internet, a wireless Internet, a broadcasting network) that the network 170 can include, but also short-range wireless communication between devices. For example, the network 170 may include any one or more of a personal area network (PAN), a local area network (LAN), a campus area network (CAN), a metropolitan area network (MAN), a wide area network (WAN), a broadband network (BBN), the Internet, and the like. Furthermore, the network 170 may include any one or more of a network topology including, but not limited to, a bus network, a star network, a ring network, a mesh network, a star-bus network, a tree or a hierarchical network.

[0020] Each of the servers 150, 160 may be realized by a computer device or multiple computer devices that communicate with the multiple electronic devices 110, 120, 130, 140 via the network 170 to provide instructions, codes, files, content, services, etc. For example, the server 150 may be a system that provides a first service to the multiple electronic devices 110, 120, 130, 140 connected via the network 170, and the server 160 may be a system that provides a second service to the multiple electronic devices 110, 120, 130, 140 connected via the network 170. As a more specific example, the server 150 may provide a service targeted by the application (e.g., a service for processing the contact control method according to the present embodiment, a voice call service, a video call service, a search service, an information provision service, a messaging service, an email service, and / or a content transmission service) as a first service to the plurality of electronic devices 110, 120, 130, 140 through an application as a computer program installed and running on the plurality of electronic devices 110, 120, 130, 140. As another example, the server 160 may provide a service of distributing files for installing and running the above-mentioned application to the plurality of electronic devices 110, 120, 130, 140 as a second service.

[0021] Fig. 2 is a block diagram for explaining the internal configuration of an electronic device and a server in one embodiment of the present invention. In Fig. 2, the internal configuration of electronic device 1 (110) and the internal configuration of server 150 will be explained as examples of electronic devices. In addition, other electronic devices 120, 130, 140 and server 160 may have the same or similar internal configuration as electronic device 1 (110) or server 150 described above.

[0022] The electronic device 1 (110) and the server 150 may include memories 211 and 221, processors 212 and 222, communication modules 213 and 223, and input / output interfaces 214 and 224. The memories 211 and 221 are computer-readable recording media and may include a random access memory (RAM), a read only memory (ROM), and a permanent mass storage device such as a disk drive. Here, the ROM and the permanent mass storage device such as a disk drive may be included in the electronic device 1 (110) or the server 150 as a separate permanent storage device separate from the memories 211 and 221. The memories 211 and 221 may also store an operating system and at least one program code (for example, a code for a browser installed and operated in the electric device 1 (110) or an application installed in the electronic device 1 (110) to provide a specific service). Such software components may be loaded from a computer-readable recording medium separate from the memories 211 and 221. Such another computer-readable recording medium may include a computer-readable recording medium such as a floppy drive, a disk, a tape, a DVD / CD-ROM drive, a memory card, etc. In another embodiment, the software components may be loaded into the memory 211, 221 through a communication module 213, 223 that is not a computer-readable recording medium. For example, at least one program may be loaded into the memory 211, 221 based on a computer program (for example, the above-mentioned application) that is installed by a file provided via the network 170 by a developer or a file distribution system that distributes an installation file of the application (for example, the above-mentioned server 160).

[0023] The processors 212, 222 may be configured to process instructions of a computer program by performing basic arithmetic, logic, and input / output operations. The instructions may be provided to the processors 212, 222 by the memory 211, 221 or the communication modules 213, 223. For example, the processors 212, 222 may be configured to execute instructions received according to program codes stored in a recording device such as the memory 211, 221.

[0024] The communication modules 213 and 223 may provide a function for the electronic device 1 (110) and the server 150 to communicate with each other via the network 170, or may provide a function for the electronic device 1 (110) and / or the server 150 to communicate with other electronic devices (for example, the electronic device 2 (120)) or other servers (for example, the server 160). As an example, a request generated by the processor 212 of the electronic device 1 (110) according to a program code stored in a recording device such as the memory 211 may be transmitted to the server 150 via the network 170 under the control of the communication module 213. Conversely, a control signal, an instruction, a content, a file, etc. provided under the control of the processor 222 of the server 150 may be received by the electronic device 1 (110) through the communication module 213 of the electronic device 1 (110) via the communication module 223 and the network 170. For example, control signals, instructions, content, files, etc. from the server 150 received through the communication module 213 may be transmitted to the processor 212 or memory 211, and the content, files, etc. may be stored in a storage medium (the permanent storage device described above) that the electronic device 1 (110) may further include.

[0025] The input / output interface 214 may be a means for interfacing with the input / output device 215. For example, the input device may include a device such as a keyboard or a mouse, and the output device may include a device such as a display or a speaker. As another example, the input / output interface 214 may be a means for interfacing with a device in which functions for input and output are integrated into one, such as a touch screen. The input / output device 215 may be configured as one device together with the electronic device 1 (110). Also, the input / output interface 224 of the server 150 may be a means for interfacing with a device for input or output (not shown) that may be connected to the server 150 or included in the server 150. As a more specific example, when the processor 212 of the electronic device 1 (110) processes the instructions of the computer program loaded in the memory 211, a service screen or content configured using data provided by the server 150 or the electronic device 2 (120) may be displayed on a display through the input / output interface 214.

[0026] In other embodiments, the electronic device 1 (110) and the server 150 may include more components than those in FIG. 2. However, it is not necessary to clearly show most of the conventional technical components in the figure. For example, the electronic device 1 (110) may be realized to include at least some of the input / output devices 215 described above, and may further include other components such as a transceiver, a GPS (Global Positioning System) module, a camera, various sensors, a database, etc. As a more specific example, if the electronic device 1 (110) is a smartphone, various components such as an acceleration sensor, a gyro sensor, a camera module, various physical buttons, a button using a touch panel, an input / output port, a vibrator for vibration, etc., which are generally included in a smartphone, may be realized to be further included in the electronic device 1 (110).

[0027] 3 is a diagram illustrating an example of a cloud-based artificial intelligence platform according to an embodiment of the present invention. FIG. 3 illustrates an electronic device 310, a cloud-based artificial intelligence platform 320, and a content service 330.

[0028] As an example, the electronic device 310 may include at least the above-mentioned multiple electronic devices 110, 120, 130, and 140, and the electronic device 310 or an application (hereinafter, an app) installed and operated on the electronic device 310 may link with the cloud artificial intelligence platform 320 via the interface connect 340. As an example, the cloud artificial intelligence platform 320 may include at least the above-mentioned server 150. Here, the interface connect 340 may provide a developer with an SDK (Software Development Kit) and / or development documents for developing the electronic device 310 or the app installed and operated on the electronic device 310. In addition, the interface connect 340 may provide an API (Application Program Interface) that allows the electronic device 310 or the app installed and operated on the electronic device 310 to utilize functions provided by the cloud artificial intelligence platform 320. As a specific example, devices and apps developed by developers using the SDK (Software Development Kit) and / or development documents provided by Interface Connect 340 can utilize the functions provided by the cloud artificial intelligence platform 320 by using the API provided by Interface Connect 340.

[0029] For example, the cloud artificial intelligence platform 320 may provide a function for providing a voice-based service. For example, the cloud artificial intelligence platform 320 may include various modules for providing a voice-based service, such as a voice processing module 321 for recognizing received voice and synthesizing a voice to be output for the recognized voice, a vision processing module 322 for analyzing and processing received images and videos, a conversation processing module 323 for determining a suitable conversation to output a suitable voice according to the received voice, a recommendation module 324 for recommending a function suitable for the received voice, and a neural machine translation (NMT) 325 for helping the artificial intelligence translate a language on a sentence-by-sentence basis based on data learning.

[0030] For example, consider a situation in which the user of electronic device 2 (120) transmits a voice call request to electronic device 1 (110) using electronic device 2 (120). At this time, electronic device 1 (110) recognizes a situation in which the user of electronic device 1 (110) cannot directly accept the voice call request according to the control of an application. In this case, electronic device 1 (110) automatically accepts the voice call request from electronic device 2 (120) without the direct control of the user, and a voice call session is set between electronic device 1 (110) and electronic device 2 (120). In addition, electronic device 1 (110) may execute a conversation using artificial intelligence with the user of electronic device 2 (120) by utilizing a function provided by the cloud artificial intelligence platform 320 via the interface connect 340 according to the control of the application. In this case, the artificial intelligence may recognize the voice of the user of electronic device 2 (120) transmitted through the above-mentioned voice call session by the voice processing module 321, and may determine a conversation suitable for the recognized voice by the conversation processing module 323. In addition, the artificial intelligence may synthesize an output voice to be output according to the determined conversation, again using the voice processing module 321, and the synthesized output voice may be transmitted to the electronic device 2 (120) through the above-mentioned voice call session, thereby establishing a voice call between the artificial intelligence and the user of the electronic device 2 (120).

[0031] The expansion kit 350 may provide a development kit that enables a third-party content developer or company to realize a new voice-based function based on the cloud artificial intelligence platform 320. For example, assume that an application installed in the electronic device 1 (110) is a third-party content developed by the above-mentioned development kit. In this case, the third-party content developer can provide a conversation function using artificial intelligence by having his / her application communicate with the cloud artificial intelligence platform 320 via the interface connect 340 and utilize the functions included in the cloud artificial intelligence platform 320, without having to independently develop artificial intelligence for automatically performing voice calls.

[0032] In the embodiment of FIG. 3, an example has been described in which the function for processing voice conversation among the functions for artificial intelligence is provided to modules (voice processing module 321 and conversation processing module 323) included in the cloud artificial intelligence platform 320. However, in some embodiments, all the functions for artificial intelligence may be included in an application installed and run on the electronic device 1 (110). In this case, the electronic device 1 (110) does not need to communicate with a server 150 such as the cloud artificial intelligence platform 320, and the voice processing module 321 and the conversation processing module 323 can autonomously execute a conversation with the user of the electronic device 2 (120).

[0033] FIG. 4 is a diagram illustrating an example of an overall process for contact control of an electronic device in an embodiment of the present invention.

[0034] The first step 410 may be a step in which the electronic device 1 (110) receives a contact request from the electronic device 2 (120). Here, the contact may include a contact that requires the establishment and maintenance of a communication session between the electronic device 1 (110) and the electronic device 2 (120), such as a voice call, a video call, or sending and receiving an instant message using a messenger, or may include a contact that does not require the maintenance of a communication session between the electronic device 1 (110) and the electronic device 2 (120), such as receiving an SMS (Short Message Service), an MMS (Multimedia Message Service), or an e-mail. In addition, although the contact request is shown to be sent directly from the electronic device 2 (120) to the electronic device 1 (110) in FIG. 4, the contact request may be sent to the electronic device 1 (110) via various intermediate nodes on the network depending on the type of contact. For example, an instant message using a messenger may be sent to the electronic device 1 (110) via a messenger server, and a call signal for a voice call may be sent to the electronic device 1 (110) via a server that processes the call signal for the voice call. Similarly, a call signal for a video call may be sent to the electronic device 1 (110) via a server that processes the video call.

[0035] The second process 420 may be a process of determining whether the electronic device 1 (110) is directly controllable by the user of the electronic device 1 (110). Here, the user's situation may be broadly divided into two: a situation where the user can directly control the contact request (hereinafter, "first situation"), and a situation where the user cannot directly control the contact request (hereinafter, "second situation"). In this case, the user's situation may be determined by analyzing information acquired in relation to the user, such as the user's schedule or lifestyle. Such information may be information that is pre-stored and managed in the electronic device 1 (110), or may be information received from outside the electronic device 1 (110), such as a server (e.g., server 150) that manages information related to the user's schedule and lifestyle online. Such a second process 420 may be executed before providing a notification to the user in response to the reception of the contact request. For example, in the prior art, a notification such as a ring tone or vibration is output in response to the reception of a voice call signal, and the user processes the contact request in response to the output of such a notification. On the other hand, the electronic device 1 (110) according to the present embodiment may determine in advance a user situation in which direct control by the user is possible, before outputting a notification in response to receipt of a contact request.

[0036] The third step 430 may be a step in which the electronic device 1 (110) outputs a notification of the receipt of the contact request in the first situation, in which the user of the electronic device 1 (110) may directly process the contact request in response to the output notification.

[0037] The fourth process 440 may be a process in which the electronic device 1 (110) processes the contact under the direct control of the user, and then the process for the contact control is terminated. For example, if the requested contact is a voice call or a video call, the contact control related to the contact request received in the first process 410 may be terminated after the voice call or video call is made between the user of the electronic device 1 (110) and the user of the electronic device 2 (120). Alternatively, if the requested contact is an instant message, the contact control related to the contact request received in the first process 410 may be terminated after the user of the electronic device 1 (110) checks the received instant message.

[0038] The fifth step 450 may be a step in which, in the second situation, the electronic device 1 (110) accepts the contact request using the artificial intelligence and executes a response. For example, in the case of a voice call or video call, the artificial intelligence directly accepts the contact request, and then a voice call or video call may be made between the user of the electronic device 2 (120) and the artificial intelligence. In this case, the voice or video transmitted and received between the user of the electronic device 2 (120) and the artificial intelligence does not need to be output to the electronic device 1 (110), and the voice call or video call may be made internally in the electronic device 1 (110). As another example, when an instant message is received, the artificial intelligence may send a reply message to the received instant message to the electronic device 2 (120).

[0039] The sixth step 460 may be a step in which the electronic device 1 (110) generates a summary related to the AI ​​response. The summary may include information such as the type of contact (e.g., voice call, video call, instant message, etc.), the time when the contact request was received, the content of the conversation between the AI ​​and the user of the electronic device 2 (120) according to the AI ​​response, or summary information of such conversation content. For example, when the AI ​​responds to a voice call, the AI ​​may recognize the voice included in the content of the conversation with the user of the electronic device 2 (120) and convert the recognized voice into text. Then, the converted text may be analyzed to generate summary information.

[0040] The seventh step 470 may be a step of the electronic device 1 (110) monitoring whether the user of the electronic device 1 (110) can directly control the electronic device 1 (110). In this case, the electronic device 1 (110) may determine whether the situation is a first situation in which the user of the electronic device 1 (110) can directly control the electronic device 1 (110) in response to the contact request, or a second situation in which the user of the electronic device 1 (110) cannot directly control the electronic device 1 (110) in response to the contact request, by analyzing information acquired in relation to the user of the electronic device 1 (110), such as the schedule or lifestyle of the user of the electronic device 1 (110).

[0041] For example, according to the schedule of the user of the electronic device 1 (110), a meeting is scheduled from 14:00 to 16:00 today, and the time when the contact request described in the first step 410 was received is 15:00 today. In this case, the AI ​​may determine that the user of the electronic device 1 (110) is in the second situation where the user cannot directly control the received contact request, and may accept the contact request and handle the response directly, as described in the fifth step 450. After this, the AI ​​may generate a summary sentence related to the response. In this case, it is assumed that the time when the summary sentence was generated is 15:30. Since the end time of the meeting is scheduled to be 16:00, the AI ​​may determine that the user of the electronic device 1 (110) is in the second situation where the user cannot directly control the received contact request until 16:00, and may delay the report of the summary sentence until 16:00.

[0042] The eighth step 480 may be a step in which the electronic device 1 (110) reports the generated summary to the user of the electronic device 1 (110) when the status of the user of the electronic device 1 (110) changes from the second status to the first status. For example, the electronic device 1 (110) may provide the user with a notification to inform him or her that a contact has been made, and display the generated summary on the screen of the electronic device 1 (110) according to the user's response to the notification.

[0043] On the other hand, in some embodiments, the summary sentence may be reported in the second situation. For example, the artificial intelligence may report the summary sentence even in the second situation if an input by the user of the electronic device 1 (110) occurs after the generation of the summary sentence, or if a condition preset by the user is satisfied. For example, even if the user is in a meeting, if an input occurs in the electronic device 1 (110), it may be determined that the user has some free time. In this case, in response to the occurrence of the user input, the summary sentence may be reported even in the second situation. In effect, a notification regarding the report of the summary sentence may be provided to the user, and the user may select whether to check the reported summary immediately or slowly depending on the situation. As another example, even if the user is in a situation where he or she cannot answer the phone directly, the summary sentence may be able to be checked. In such a case, if a condition preset by the user (for example, the importance of the contact, a specific time, or a specific location, etc.) is satisfied, the summary sentence may be reported even in the second situation.

[0044] In another embodiment, even if the user directly processes the contact request in the above-mentioned fourth step 440, a summary may be generated and provided at the user's request. For example, assume that a ringtone is sounded due to the receipt of a voice call, and the user operates the electronic device 1 (110) to start a voice call. At this time, the AI ​​may record and summarize the contents of the voice call between the user and the caller and provide a summary in response to a request input from the user. In this case, the user can reconfirm the main points of the call with the caller through the summary even after the call ends. At this time, the request from the user may be input as a preset voice (for example, "Sally (example of AI identifier), please record / summarize the call contents now") or may be input by a preset user interface button displayed on the screen (for example, "AI call request"). As a more specific example, when the electronic device 1 (110) recognizes a preset voice (for example, the above-mentioned "Sally") according to the control of an application while the user is in direct contact with the caller, the electronic device 1 (110) may operate to process the request or display a user interface on the screen for triggering recording and / or summarization of the call contents. In addition, the electronic device 1 (110) may record and / or summarize the contents of the contact between the user and the caller according to an input user request, and report the recorded contents and summary to the user. On the other hand, when the caller's consent is required to record the contents of the call, the electronic device 1 (110) may synthesize a voice to obtain the caller's consent, and may start recording according to the caller's response. In this case, the process of requesting the caller's consent and the caller's response may also be recorded. In this way, even when the user directly contacts the caller, not in the case of an automatic response using artificial intelligence, the contents of the corresponding contact may be recorded and / or summarized and provided to the user. In addition, such a recording and / or summarization function may be provided even in a video call. In this case, at least some of the video may be recorded together and included in the summary.

[0045] In the embodiment of Fig. 4, an example is described in which electronic device 1 (110) directly processes contact control using artificial intelligence in response to a contact request from electronic device 2 (120). On the other hand, in another embodiment, an example is described in which a server that connects contact between electronic device 1 (110) and electronic device 2 (120) processes such contact control.

[0046] 5 is a diagram showing an example of the overall process for server contact control in one embodiment of the present invention. The server 150 may be a computer device of a system that provides a service for a specific contact between the electronic device 1 (110) and the electronic device 2 (120). In this case, a contact request from the electronic device 2 (120) may be transmitted to the electronic device 1 (110) via the server 150.

[0047] In the first step 510, the server 150 may receive a contact request from the electronic device 2 (120) to the electronic device 1 (110). For example, the server 150 may be a computer device of a system that provides a messaging service, a voice call service, and / or a video call service through a messenger. When a user of the electronic device 2 (120) selects an account or a phone number of a user of the electronic device 1 (110) and requests to make a voice call, a video call, or send an instant message, the contact request may be transmitted to the electronic device 1 (110) via the server 150. The first step 510 may refer to a process in which the server 150 receives such a contact request.

[0048] The second step 520 may be a step in which the server 150 determines whether the user of the electronic device 1 (110) can directly control the electronic device 1 (110). For example, the server 150 may determine whether the first situation is one in which the user of the electronic device 1 (110) can directly control the electronic device 1 (110) in response to a contact request, or whether the second situation is one in which the user of the electronic device 1 (110) cannot directly control the electronic device 1 (110) in response to a contact request, by analyzing information acquired in relation to the user of the electronic device 1 (110), such as the schedule or lifestyle of the user of the electronic device 1 (110). In this case, the information such as the schedule or lifestyle may be information directly managed by the server 150 by uploading it by the user of the electronic device 1 (110), or may be information provided from a schedule management server or the like.

[0049] The third step 530 may be a step in which the server 150 transmits a contact request to the electronic device 1 (110) in the first situation. In this case, the electronic device 1 (110) may output a notification such as a ring tone or vibration in response to the received contact request.

[0050] The fourth step 540 may be a step of terminating the contact control process after the electronic device 1 (110) processes the contact. For example, the electronic device 1 (110) may execute contact processing such as making a voice call or a video call or displaying a received instant message on a screen according to the user's control for the contact request, and may then terminate the contact control process. In this case, even if the user directly processes the contact with the caller, as described above, the triggered artificial intelligence may record and / or summarize the voice call or video call upon the input of a request from the user, and may provide the user with a summarized summary.

[0051] The fifth step 550 may be a step in which the server 150 processes a contact with the electronic device 2 (120) through an artificial intelligence response in the second situation. As described above, in the case of a voice call or video call, the artificial intelligence may directly accept the contact request, and then a voice call or video call may be made between the user of the electronic device 2 (120) and the artificial intelligence. As another example, when an instant message is received, the artificial intelligence may send a reply message to the received instant message to the electronic device 2 (120).

[0052] The sixth step 560 may be a step of generating a summary of the AI ​​response after the AI ​​response is completed. As described above, the summary may include information such as the type of contact (e.g., voice call, video call, instant message, etc.), the time when the contact request was received, the content of the conversation between the AI ​​response AI and the user of the electronic device 2 (120), or summary information of such conversation content.

[0053] The seventh step 570 may be a step in which the server 150 monitors whether the user of the electronic device 1 (110) can directly control the electronic device 1 (110). In this case, the server 150 may determine whether the situation is a first situation in which the user of the electronic device 1 (110) can directly control the electronic device 1 (110) in response to the contact request, or a second situation in which the user of the electronic device 1 (110) cannot directly control the electronic device 1 (110) in response to the contact request, by analyzing information acquired in relation to the user of the electronic device 1 (110), such as the schedule or lifestyle of the user of the electronic device 1 (110).

[0054] The eighth step 580 may be a step in which the server 150 reports the generated summary sentence to the electronic device 1 (110) when the status of the user of the electronic device 1 (110) changes from the second status to the first status. The reported summary sentence may be displayed through the electronic device 1 (110) and provided to the user of the electronic device 1 (110).

[0055] Meanwhile, an embodiment in which the embodiment of FIG. 4 and the embodiment of FIG. 5 are combined may be considered. For example, the first step 410 and the second step 420 of FIG. 4 may be executed by the electronic device 1 (110), and in the first situation in which the user cannot directly control the contact request, the contact request may be transmitted to the server 150 so that the server 150 may process an AI response with the electronic device 2 (120). In this case, the server 150 may process the fifth step 550 and the sixth step 560 of FIG. 5 to process the AI ​​response and the generation of a summary sentence. The generated summary may be transmitted to the electronic device 1 (110) and may be reported to the user through the seventh step 470 and the eighth step 480 of FIG. 4.

[0056] In this way, when a voice or video call or message is received by synchronizing the user's (the recipient's) schedule and analyzing the user's lifestyle, the user's situation is estimated, and if it is determined that the user is in a situation where it is difficult for the user to respond directly, the conversation with the caller is automatically processed using artificial intelligence, and the contents of the response are summarized and reported to the user, making it possible to use artificial intelligence to control contact requests even for those that are difficult for the user to respond to directly.

[0057] 6 and 7 are diagrams showing an example of providing a summary sentence in one embodiment of the present invention.

[0058] FIG. 6 shows an example of a screen of the electronic device 1 (110) on which a summary of a response to a voice call is displayed, and shows an example of the summary being displayed on the screen of the electronic device 1 (110) in the form of a pop-up window 610. Such a pop-up window 610 shows information indicating what type of contact (voice call) was made by whom (Ms. Alice), the date and time when the contact request was received, the time when the artificial intelligence responded to the contact (call duration), and summary information on the response content (summary of the response content). The pop-up window 610 also shows an example in which a "call now button 620" is provided as a user interface for connecting to a call with the contact (Ms. Alice) immediately. When a user selects the call now button 620 (for example, the user touches an area where the call now button 620 is displayed in a touch screen environment), a voice call with the contact (Ms. Alice) may be attempted.

[0059] FIG. 7 shows an example of a screen of the electronic device 1 (110) on which a summary of a received message is displayed, and shows an example of the summary being displayed on the screen of the electronic device 1 (110) in the form of a pop-up window 710. Such a pop-up window 710 shows information indicating who (Mr. Ted) made the contact (message received using messenger A), the date and time when the contact request (message) was received, and summary information on the response (summary of the response). The pop-up window 710 also shows an example in which a "Go to chat room" button 720 is provided as a user interface for calling up a chat room of messenger A that has sent and received a message with the contact (Mr. Ted). When a user selects the Go to chat room button 720, a chat room with the contact (Mr. Ted) may be displayed on the screen of the electronic device 1 (110) in messenger A.

[0060] On the other hand, the identification information for identifying the contact such as Alice in FIG. 6 or Ted in FIG. 7 may be the name of the caller searched by phone number from the address book or the friend list of the messenger (or a service that provides VoIP voice calls or video calls) of the electronic device 1 (110), or may be the display name of the searched account. The gender of the contact (Ms. or Mr.) may be determined by analyzing the probability value of the gender of the name and / or the voice of the caller. For example, data in which the probability value of the target gender being male or female for each name such as the identified name "Alice" is empirically accumulated may be utilized. The gender of the contact may be determined by analyzing the tone of the voice of the contact using artificial intelligence. The gender of the contact may be determined by using both the probability value and the voice. Furthermore, the display of gender may be omitted for the display name of the account instead of the person's name.

[0061] If it is difficult to obtain identification information for identifying a contact from an address book, messenger account, etc., the artificial intelligence may directly ask the contact's name, relationship to the user of electronic device 1 (110), etc. during the process of responding. For example, the artificial intelligence may obtain information about the contact by asking a question such as "Who would you like to say is contacting you?" and may use the obtained information to generate a summary.

[0062] In addition, in voice and video calls, the gender and tone of the AI's response voice may be changed according to the gender and age of the caller. For example, the AI ​​may respond to a male caller with a female voice, and vice versa, to a female caller with a male voice. As another example, a child caller may be responded to with the voice of a specific character (for example, an animation character popular with children).

[0063] In addition, in the embodiment of FIG. 6 and FIG. 7, the summary sentence is reported using the pop-up windows 610 and 710. However, the summary sentence may be reported to the user in various ways. For example, the summary sentence may be displayed on the execution screen of an application that provides a service for contact control, or the summary may be reported in the form of outputting the synthesized voice after the artificial intelligence synthesizes the content of the summary sentence as voice. In this case, the artificial intelligence may report the summary sentence in the form of a conversation with the user. For example, in relation to the embodiment of FIG. 6, when the artificial intelligence is outputting the synthesized voice of "You have received a voice call from Ms. Alice", if a voice command is recognized by the user's utterance "Call Alice", the artificial intelligence may not need to report the entire summary sentence and may immediately execute a voice call with Alice.

[0064] In the above-described embodiment, an example has been described in which the artificial intelligence directly responds to a contact through contact control in response to a contact request, and reports the result to the user.

[0065] In addition, artificial intelligence can also perform various post-processing tasks, such as automatically setting new schedules or alarm times, based on the information obtained from interacting with the contact.

[0066] FIG. 8 is a diagram showing an example of reporting post-processing contents in one embodiment of the present invention.

[0067] FIG. 8 shows an example of a screen of the electronic device 1 (110) on which a summary of a response to a voice call is displayed, and shows an example of the summary being displayed on the screen of the electronic device 1 (110) in the form of a pop-up window 810. In such a pop-up window 810, information for indicating what type of contact (voice call) was made by whom (Ms. Carol), the date and time when the contact request was received, the time when the AI ​​responded to the contact (call duration), summary information on the response content (summary of the response content), and post-processing content (schedule addition) are displayed. For example, the AI ​​may analyze the response content to recognize a schedule for an appointment at "Saturday 3:00 p.m." and search for the recognized schedule from the registered schedule. If no schedule is registered for the corresponding date and time, the AI ​​may add the corresponding schedule. Also, FIG. 8 shows an example of a user interface that includes a schedule confirmation button 830 as a user interface that can drive a schedule application in the pop-up window 810 to confirm additional schedules. If the user selects the schedule confirmation button 830, the schedule application may be executed and information on the additional schedule may be displayed to the user. In some embodiments, the contact may set up an appointment in a conversation with the AI. For example, the AI ​​may recognize a request from the contact to make an appointment with the user to meet at 7pm today, add the appointment to the schedule, and then report such follow-up and response to the user.

[0068] The AI ​​may also maintain a conversation with the contact until the user is able to take direct control over the contact. For example, a situation may be considered where the user is in a meeting or exercising and the meeting or exercise is predicted to end within a preset time (for example, one minute). In this case, the AI ​​may maintain the contact by informing the contact that the user will be able to take a call within a certain time and guiding the conversation with the contact during the waiting time. In other words, the AI ​​may maintain the contact until the user is able to directly participate in the contact, depending on the situation.

[0069] In another embodiment, the AI ​​may suspend the AI ​​response depending on the urgency of the contact and provide a notification for the user to participate in the contact. As an example, the AI ​​may measure the importance of the user's current situation and measure and compare the importance of the contact through the AI ​​response. In this case, the AI ​​may determine the purpose of the contact through a conversation with the contact partner and determine the importance of the contact according to the determined purpose. In addition, the AI ​​may determine the importance of the situation depending on the type of the user's situation (for example, during a meeting or during exercise). In this case, if the importance of the contact is higher than the importance of the situation, the AI ​​may suspend the AI ​​response and provide a notification for the user to participate in the contact. In this case, the AI ​​may display information on the screen to inform the user that the requested contact is related to an extremely important purpose, or may output it as a synthesized voice.

[0070] Additionally, in other embodiments, a user may directly select whether or not to have an artificial intelligence response performed on a contact.

[0071] FIG. 9 is a diagram showing an example of a user interface for selecting to accept or reject a voice call in an embodiment of the present invention. FIG. 9 shows a first screen 910 and a second screen 920 of the electronic device 1 (110) when a voice call is received. The first screen 910 shows an accept button 911 for accepting an incoming voice call and a reject button 912 for rejecting an incoming voice call. When the user selects the reject button 912, the first screen 910 may be changed to a second screen 920. The second screen 920 shows an AI call button 921, a message button 922, and a snooze button 923 added in addition to the accept button 911 and the reject button 912 whose sizes and shapes have been changed.

[0072] At this time, the AI ​​call button 921 may be a user interface for artificial intelligence response. For example, when a user selects the AI ​​call button 921, the above-mentioned artificial intelligence response may be executed. In other words, the artificial intelligence may converse with the caller of the voice call, generate a summary sentence, and provide it to the user.

[0073] Furthermore, the message button 922 may be a user interface for transmitting a preset rejection message. For example, when a user selects the message button 922, a preset rejection message may be transmitted to the caller of the voice call. As another example, when a user selects the message button 922, a user interface for selecting one of a plurality of rejection messages may be provided to the user. In this case, when the user selects one of the plurality of rejection messages, the selected rejection message may be transmitted to the caller of the voice call.

[0074] Furthermore, the snooze button 923 may be a user interface for requesting the caller to leave a voice memo. For example, when the user selects the snooze button 923, a request to leave a voice memo may be provided to the caller. When the caller leaves a voice memo, the voice memo may be stored in the electronic device 1 (110), and a notification to listen to the voice memo after a preset time (for example, 3 minutes) or text information obtained by recognizing and converting the voice memo into text may be provided to the user in the form of a pop-up window or the like.

[0075] Such various rejection options can support the user in understanding the caller's contact intention in various ways even when it is difficult for the user to answer the phone, and can increase the call connection rate. Also, a user interface for selecting whether to accept or reject not only a voice call but also a video call may be implemented in the same manner as the embodiment of FIG.

[0076] In still another embodiment, the artificial intelligence may determine a preview screen for receiving a video call by considering the relationship between the user and the caller, the user's tendency, and / or the user's settings in relation to receiving a video call. For example, if the caller is someone the user wants to be well-liked by (for example, a friend of the opposite sex), if the user has a tendency to value appearance, or if the caller is a person set by the user, a selfie video may be displayed on the preview screen of the video call. In other words, the user may be given time to check and improve his / her appearance in advance through the selfie video displayed on the preview screen before accepting the video call. On the other hand, if the caller has an intimate relationship with the user, if the user has a tendency to want to accept a video call quickly and make a video call quickly rather than improve his / her appearance, or if the caller is not a person set by the user, the selfie video may not be displayed on the preview screen of the video call. In this way, the artificial intelligence may automatically turn on / off the function for displaying the selfie video on the preview screen of the video call according to various conditions.

[0077] FIG. 10 is a diagram showing an example of a preview screen on which a selfie video is displayed in an embodiment of the present invention. FIG. 10 shows an example of a preview screen 1010 on which a user of the electronic device 1 (110) can select whether to accept or reject a video call when a video call request from a caller "Ted" is received. In this case, the electronic device 1 (110) may determine whether to display the selfie video on the preview screen 1010 based on the above-mentioned various conditions (the relationship between the user and the caller, the user's inclination, and / or the user's settings). FIG. 10 shows an example in which the electronic device 1 (110) determines to display the selfie video, and thereby displays a real-time video stream 1030 captured by a front camera (or selfie camera) 1020 included in the electronic device 1 (110) on the preview screen 1010.

[0078] FIG. 11 is a flowchart showing an example of a contact control method according to an embodiment of the present invention. The contact control method according to this embodiment may be executed by a computer device such as the electronic device 1 (110) described above. In this case, the processor 212 of the electronic device 1 (110) may be realized to execute control instructions according to the operating system code or at least one program code included in the memory 211. Here, the processor 212 may control the electronic device 1 (110) so that the electronic device 1 (110) executes steps 1110 to 1150 included in the contact control method shown in FIG. 11 according to the control instructions provided by the code stored in the electronic device 1 (110).

[0079] In step 1110, the electronic device 1 (110) may receive a contact request from a caller through a network. As described above, the contact may refer to a voice call, a video call, or the sending and receiving of a message. In this case, the contact request may include a call signal in the case of a voice call or a video call, and may include a message sent by the caller in the case of the sending and receiving of a message. Such a contact request may be sent directly from the caller through a network, but may generally be transmitted via a server that provides a voice call service, a video call service, or a messaging service. In this case, the user of the electronic device 1 (110) may be the recipient of the contact.

[0080] In step 1120, the electronic device 1 (110) may determine whether the callee can directly control the contact request. For example, the electronic device 1 (110) may determine whether the callee can directly control the contact request by using at least one of the callee's schedule information registered for the callee, the lifestyle information previously analyzed for the callee, and the callee's input, and the time when the contact request was received. In this case, the schedule information may include schedule information registered in the electronic device 1 (110) and / or information registered online and synchronized with the electronic device 1 (110). Meanwhile, the lifestyle information may include information about the callee's status predicted at the current time based on information obtained by continuously analyzing the callee's daily routine. For example, for a callee who jogs every morning between 6 and 7 a.m., the status between 6 and 7 a.m. may be determined to be "exercising". Alternatively, the callee's status may be subdivided based on the time the callee is at work or at home. The callee's input may be used in conjunction with the time the contact request is received to determine whether the callee is operating the electronic device 1 110. For example, if the callee is continuously operating the electronic device 1 110, it may be determined that the callee is in a situation where he or she can directly handle the contact request.

[0081] In steps 1130 and 1140, the electronic device 1 (110) may output a notification of the contact request if the contact request allows the recipient to directly control the contact request. In this case, the user may directly process the contact request in response to the output notification.

[0082] In steps 1130 and 1150, if the called party is unable to directly control the contact request, the electronic device 1 (110) may use artificial intelligence to converse with the contact sender and process the contact. If it is determined that the called party is in a difficult situation to directly process the contact request, the electronic device 1 (110) may not provide a notification to the called party and may directly process the contact using artificial intelligence.

[0083] Meanwhile, the electronic device 1 (110) may generate summary information of the conversation and report it to the called party under the control of the application. For example, the electronic device 1 (110) may generate summary information regarding the conversation performed in step 1150, and may provide the generated summary information to the called party when the called party's direct control is enabled. Here, the summary information may include summary information regarding the type of contact, the time when the contact request was received, and the content of the conversation.

[0084] Also, the electronic device 1 (110) may perform post-processing depending on the result of the conversation. For example, an example of post-processing to add a schedule has been described in FIG. 8. For this purpose, the electronic device 1 (110) may extract information on at least one of the date, time, and location included in the content of the conversation, and may register a schedule or an alarm by associating the extracted information with information on the sender of the contact.

[0085] Also, the electronic device 1 (110) may allow the user to directly process the contact request in various ways, as described with reference to FIG. 9. For example, the electronic device 1 (110) may further provide a user interface for accepting or rejecting the contact request when the recipient can directly control the contact request. Such a user interface may be provided together with the notification described in step 1140. In this case, the user interface may include a user interface for accepting the contact request and a user interface for rejecting the contact request, and may further include at least two or more of a user interface for conducting a conversation with the caller using artificial intelligence, a user interface for requesting the caller to leave a voice memo, and a user interface for sending a rejection message to the caller.

[0086] In addition, as described with reference to FIG. 10, when the contact is a video call and can be directly controlled by the recipient, the electronic device 1 (110) determines whether to display a selfie video based on at least one of the relationship between the recipient and the caller, the recipient's inclination, and the recipient's settings. If the selfie video is to be displayed, the electronic device 1 (110) may drive a selfie camera (front camera 1020 described with reference to FIG. 10) and display a real-time video stream captured by the selfie camera on a preview screen of the video call, thereby providing the recipient with time to check and adjust their appearance depending on the conditions.

[0087] 12 is a flow chart illustrating an example of processing a contact using artificial intelligence according to an embodiment of the present invention. Steps 1210 to 1250 in FIG. 12 may be performed when the contact is a voice call or a video call, and may be included in step 1150 described with reference to FIG. 11 and may be performed by the electronic device 1 (110).

[0088] In step 1210, the electronic device 1 (110) may receive the voice of the contact originator through a voice call session or a video call session established by accepting the contact request.

[0089] In step 1220, the electronic device 1 (110) may recognize the received voice by a voice processing module included in the artificial intelligence. For example, the artificial intelligence may be realized by an application installed and run on the electronic device 1 (110). Such an application may include a voice processing module for voice recognition and synthesis, and the electronic device 1 (110) may recognize the received voice by such a voice processing module according to the control of the application. As described with reference to the embodiment of FIG. 3 above, the artificial intelligence may be realized by the cloud artificial intelligence platform 320. In this case, the electronic device 1 (110) may transmit the received voice to the cloud artificial intelligence platform 320 via the interface connect 340, and the received voice may be recognized by the voice processing module 321 included in the cloud artificial intelligence platform 320.

[0090] In step 1230, the electronic device 1 (110) may generate a reply conversation by analyzing the recognized voice by a conversation processing module included in the artificial intelligence. In this case, the electronic device 1 (110) may generate the reply conversation by using a conversation processing module realized by an application, or may generate the reply conversation by using the conversation processing module 323 included in the cloud artificial intelligence platform 320.

[0091] In step 1240, the electronic device 1 (110) may generate an output voice corresponding to the reply conversation generated by the voice processing module. In this case, the electronic device 1 (110) may synthesize the output voice using a voice processing module realized by an application, or may synthesize the output voice using the voice processing module 321 included in the cloud artificial intelligence platform 320.

[0092] In step 1250, the electronic device 1 (110) may transmit the generated output voice to the contact originator through the set voice call session or video call session. In this case, the contact originator can hear the AI ​​response voice corresponding to the originator's voice through the requested contact (voice call or video call).

[0093] When utilizing an external artificial intelligence server such as a cloud artificial intelligence platform 320, the electronic device 1 (110) may transmit the voice or message received from the contact originator to the artificial intelligence server via a network, receive a reply voice or reply message corresponding to the voice or message from the artificial intelligence server, and transmit the received reply voice or reply message to the contact originator.

[0094] These steps 1210 to 1250 may represent one conversation process in which the AI ​​responds to the caller's speech. However, it will be easily understood by those skilled in the art that, if necessary, the AI ​​may synthesize an output voice first and transmit it to the caller, or multiple conversations may be conducted between the AI ​​and the caller.

[0095] In another embodiment, when the contact includes message transmission and reception, the electronic device 1 (110) may analyze a message received from the contact originator as a contact request using a conversation processing module included in the artificial intelligence, generate a reply conversation, and send a message including the generated reply conversation to the contact originator, without requiring a voice recognition or voice synthesis process. Here, the conversation processing module of the artificial intelligence may be realized by an application of the electronic device 1 (110) as described above, or may correspond to the conversation processing module 323 included in the cloud artificial intelligence platform 320.

[0096] In another embodiment, the contact processing using artificial intelligence may be performed by a server providing a service for contact. For example, the server may be a system providing a service for contact between a recipient and a caller (for example, a voice call service, a video call service, or a messaging service). In this case, the electronic device 1 (110) may request the server providing the service for contact to process the conversation using artificial intelligence in step 1150 described with reference to FIG. 11. In this case, the server may be realized to process the contact by having a conversation with the caller of the contact using artificial intelligence according to the request of the recipient, and to generate and transmit summary information of the conversation. For example, the server may correspond to the server 150 described with reference to FIG. 5. In this case, the electronic device 1 (110) may receive summary information of the conversation from the server in step 1150. The summary information may correspond to a summary sentence described with reference to FIGS. 6 to 8, and may be reported to the recipient when the recipient, who is the user of the electronic device 1 (110), is in a situation where he or she can directly control the contact.

[0097] 13 is a flowchart showing an example of a contact control method of a server in an embodiment of the present invention. The contact control method according to this embodiment may be executed by a computer device such as the above-mentioned server 150. In this case, the processor 222 of the server 150 may be realized to execute control instructions according to the operating system code or at least one program code included in the memory 221. Here, the processor 222 may control the server 150 so that the server 150 executes steps 1310 to 1360 included in the contact control method of FIG. 13 according to the control instructions provided by the code stored in the server 150.

[0098] In step 1310, the server 150 may receive a contact request from a caller to a callee via a network. As described above, the contact may refer to a voice call, a video call, or sending and receiving a message. In this case, the contact request may include a call signal in the case of a voice call or a video call, and may include a message sent by the caller in the case of sending and receiving a message. The server 150 may receive a contact request to be transmitted to the callee, and may perform step 1320 before transmitting the contact request to the callee. Here, the callee may correspond to a user of the electronic device 1 (110) described above.

[0099] In step 1320, the server 150 may determine whether the callee can be directly controlled in response to the contact request. For example, the server 150 may determine whether the callee can be directly controlled by using at least one of the callee's schedule information registered for the callee, the callee's lifestyle information previously analyzed, and the callee's input, and the time when the contact request was received. In this case, the schedule information may be information that the server 150 synchronizes and manages the callee's schedule information registered in the electronic device 1 (110) and / or the callee's schedule information registered online. Meanwhile, the lifestyle information may include information about the callee's status predicted at the current time based on information that continuously analyzes the callee's daily routine. For example, for a callee who jogs between 6:00 and 7:00 a.m. every morning, the status between 6:00 and 7:00 a.m. may be determined to be "exercising". In addition, the callee's status may be subdivided based on the time the callee is at work or at home. Such lifestyle information may be generated and managed by the server 150 based on various information that the server 150 receives from the electronic device 1 (110).

[0100] In steps 1330 and 1340, the server 150 may transmit the contact request to the recipient. In this case, the recipient, who is the user of the electronic device 1 (110), may directly process the contact request in response to a notification output by the electronic device 1 (110) according to the transmitted contact request.

[0101] In steps 1330 and 1350, if the recipient is unable to directly control the contact request, the server 150 may process the contact by conversing with the contact originator using artificial intelligence. If it is determined that the recipient is in a difficult situation to directly process the contact request, the server 150 may not transmit the contact request to the recipient and may directly process the contact using artificial intelligence.

[0102] The server 150 may generate summary information of the conversation and provide it to the called party in step 1360. In other words, if the called party cannot directly handle the contact request, the server 150 may directly handle the contact by conversing with the caller using artificial intelligence in step 1350, and may generate summary information as a processing result and provide it to the called party in step 1360.

[0103] In some embodiments, the server 150 may immediately transmit the received contact request to the recipient. In this case, the recipient's electronic device 1 (110) may determine whether the recipient's direct control is possible based on the schedule information, lifestyle information, and / or the recipient's input, and may send a contact processing request to the server 150 if the recipient's direct control is not possible. In this case, the server 150 may process a response using artificial intelligence in steps 1350 and 1360 in response to receiving the contact processing request, and may generate summary information of the conversation as a processing result and provide it to the recipient. The summary information provided to the electronic device 1 (110) may be reported to the recipient when the recipient's direct control is possible.

[0104] In some embodiments, the server 150 may directly perform post-processing of the conversation, such as registering a schedule or an alarm. For example, the server 150 may extract information on at least one of the date, time, and location included in the content of the conversation, and associate the extracted information with information on the contact sender to register a schedule or an alarm for the recipient. The registered schedule or alarm may be synchronized with the electronic device 1 (110).

[0105] The server 150 may directly process the conversation with the caller using artificial intelligence implemented in the server 150, or may process the conversation in cooperation with the cloud artificial intelligence platform 320.

[0106] As described above, according to the embodiment of the present invention, the AI ​​can process a contact request transmitted to the user from the outside, such as a voice call, a video call, and / or an instant message, by reflecting the schedule and lifestyle of the user. Also, a summary of the conversation in response to the AI ​​response is generated and provided, so that the user can understand the content of the response automatically processed using the AI. In addition, the AI ​​response can be selected even when the user processes the contact request directly, and a selfie video can be displayed on the preview screen during a video call, so that the user can have time to check their appearance before accepting the video call.

[0107] The above-described systems or devices may be realized by hardware components, software components, or a combination of hardware and software components. For example, the devices and components described in the embodiments may be realized using one or more general-purpose or special-purpose computers, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or various devices capable of executing and responding to instructions. The processing device may execute an operating system (OS) and one or more software applications that run on the OS. The processing device may also respond to the execution of the software to access, store, manipulate, process, and generate data. For convenience of understanding, one processing device may be described as being used, but one skilled in the art will understand that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, the processing device may include multiple processors or one processor and one controller. Other processing configurations, such as parallel processors, are also possible.

[0108] The software may include computer programs, codes, instructions, or a combination of one or more of these, and may configure a processing device to operate as desired or instruct the processing device, either independently or collectively. The software and / or data may be embodied in any type of machine, component, physical device, virtual device, computer storage medium, or device to be interpreted by the processing device or to provide instructions or data to the processing device. The software may be distributed and stored and executed in a distributed manner on computer systems connected by a network. The software and data may be stored in one or more computer-readable recording media.

[0109] The method according to the embodiment may be realized in the form of program instructions executable by various computer means and recorded on a computer readable medium. The computer readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be specially designed and configured for the embodiment, or may be available to those skilled in the art of computer software. Examples of computer readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program instructions, such as ROMs, RAMs, flash memories, and the like. Such recording media may be various recording or storage means in the form of a single or multiple hardware devices combined, and are not limited to media directly connected to a certain computer system, but may be distributed over a network. Examples of program instructions include not only machine language codes such as those generated by a compiler, but also high-level language codes executed by a computer using an interpreter or the like.

[0110] Although the embodiments have been described above based on the limited embodiments and drawings, those skilled in the art will appreciate that various modifications and variations can be made from the above description. For example, the described techniques may be performed in a different order than described, and / or the components of the described systems, structures, devices, circuits, etc. may be combined or combined in a different manner than described, or may be counterbalanced or replaced by other components or equivalents, and still achieve suitable results.

[0111] Therefore, different embodiments are within the scope of the appended claims provided they are equivalent to the claims. [Explanation of symbols]

[0112] 110, 120, 130, 140: Electronic equipment 150, 160: Server 170: Network

Claims

1. A contact control program executed by a terminal, receiving a contact request from a caller; utilizing artificial intelligence to converse with the contact originator and process the contact based on the contact request; A process of obtaining summary information of the conversation; and A process for providing the summary information to the recipient causing a computer of the terminal to execute the above; The summary information includes summary information on the type of the contact and the content of the conversation including a summary of the content of the conversation.

2. A contact control program executed by a terminal, receiving a contact request from a caller; utilizing artificial intelligence to converse with the contact originator and process the contact based on the contact request; A process of obtaining summary information of the conversation; and A process for providing the summary information to the recipient causing a computer of the terminal to execute the above; The summary information includes a time when the contact request was received and summary information regarding the content of the conversation including a summary of the content of the conversation.

3. between the process of receiving the contact request and the process of processing the contact, causing the computer of the terminal to execute a process of determining whether the contact request can be directly controlled by the recipient based on the recipient's status.

3. The contact control program according to claim 1.

4. In the process of determining, a computer of the terminal executes a process of determining the status of the recipient by analyzing information acquired in relation to the recipient. The contact control program according to claim 3 .

5. The information acquired in relation to the recipient is information managed by the recipient's terminal or an external device capable of communicating with the terminal. The contact control program according to claim 4 .

6. The information obtained in relation to the recipient is information relating to at least one of the recipient's schedule and the recipient's lifestyle. The contact control program according to claim 4 .

7. a communication unit that receives a contact request from a caller; a processing unit that utilizes artificial intelligence to converse with the contact originator and process the contact based on the contact request; Equipped with The processing unit includes: Obtaining summary information of the conversation; Execute a process of providing the summary information to a recipient; The summary information includes summary information regarding the type of contact and the content of the conversation including a summary of the content of the conversation.

8. a communication unit that receives a contact request from a caller; a processing unit that utilizes artificial intelligence to converse with the contact originator and process the contact based on the contact request; Equipped with The processing unit includes: Obtaining summary information of the conversation; Execute a process of providing the summary information to a recipient; The summary information includes a time when the contact request was received and summary information regarding the content of the conversation including a summary of the content of the conversation.

9. A contact control method, comprising: receiving a contact request from a caller; Based on the contact request, utilizing artificial intelligence to converse with the contact originator and process the contact; obtaining summary information of the conversation; providing the summary information to a recipient; Including, The summary information includes summary information regarding the type of the contact and the content of the conversation including a summary of the content of the conversation.

10. A contact control method, comprising: receiving a contact request from a caller; Based on the contact request, utilizing artificial intelligence to converse with the contact originator and process the contact; obtaining summary information of the conversation; providing the summary information to a recipient; Including, The summary information includes a time when the contact request was received and summary information regarding the content of the conversation, including a summary of the content of the interaction.

Images