system

Abstract

To provide a system capable of providing an effective measurement against a troublesome telephone call and a scam telephone call.SOLUTION: A system according to an embodiment, comprises a collection part, a learning part, a responce part, and a display part. The collection part collects information on a troublesome telephone call. The learning part leans a pattern of the troublesome telephone call on the basis of the information collected by the collection part. The responce part automatically responses to the troublesome telephone call on the basis of the pattern learned by the learning part. The display part displays a risk ranking on an incoming call screen on the basis of the pattern learned by the learning part.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the conventional technology, effective countermeasures against nuisance calls and fraud calls have not been fully taken, and there is room for improvement.

[0005] The system according to the embodiment aims to provide effective countermeasures against nuisance calls and fraud calls.

Means for Solving the Problems

[0006] The system according to this embodiment comprises a collection unit, a learning unit, a response unit, and a display unit. The collection unit collects information on spam calls. The learning unit learns patterns of spam calls based on the information collected by the collection unit. The response unit automatically responds to spam calls based on the patterns learned by the learning unit. The display unit displays a risk ranking on the incoming call screen based on the patterns learned by the learning unit. [Effects of the Invention]

[0007] The system according to this embodiment can provide effective countermeasures against nuisance calls and fraudulent calls. [Brief explanation of the drawing]

[0008] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Modes for carrying out the invention]

[0009] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0010] First, let's explain the terminology used in the following explanation.

[0011] In the following embodiments, the signed processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Furthermore, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include CPU (Central Processing Unit), GPU (Graphics Processing Unit), GPGPU (General-Purpose computing on Graphics Processing Units), APU (Accelerated Processing Unit), or TPU (Tensor Processing Unit).

[0012] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0013] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0014] In the following embodiments, the numbered communication I / F (Interface) is an interface including a communication processor, an antenna, and the like. The communication I / F manages communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0015] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B". That is, "A and / or B" means that it may be only A, only B, or a combination of A and B. Also, in this specification, when expressing three or more matters connected by "and / or", the same concept as "A and / or B" is applied.

[0016] [First Embodiment] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0017] As shown in FIG. 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0018] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. Also, the database 24 and the communication I / F 26 are connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0019] The smart device 14 comprises a computer 36, a receiving device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The receiving device 38, output device 40, and camera 42 are also connected to the bus 52.

[0020] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, and accepts user input. The touch panel 38A accepts user input via touch by detecting contact with an object (e.g., a pen or finger). The microphone 38B accepts user input via voice by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 (see Figure 2) acquires the data indicating the user input.

[0021] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user by outputting the data in a form perceptible to the user (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0022] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0023] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0024] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0025] Storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotions using the emotion identification model 59 and perform identification processing using the user's emotions. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotions, including but not limited to these examples. Furthermore, emotion estimation and prediction also include, for example, emotion analysis.

[0026] In the smart device 14, specific processing is performed by the processor 46. The storage 50 stores a specific processing program 60. The specific processing program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 operating as a control unit 46A according to the specific processing program 60 executed on the RAM 48. The smart device 14 also has a data generation model 58 and an emotion identification model 59, similar to the data generation model and emotion identification model 59, and can perform processing similar to that of the specific processing unit 290 using these models.

[0027] Furthermore, other devices besides the data processing device 12 may also have the data generation model 58. For example, a server device (e.g., a generation server) may have the data generation model 58. In this case, the data processing device 12 obtains processing results (such as prediction results) using the data generation model 58 by communicating with the server device having the data generation model 58. The data processing device 12 may also be a server device or a terminal device owned by a user (e.g., a mobile phone, robot, home appliance, etc.). Next, an example of processing by the data processing system 10 according to the first embodiment will be described.

[0028] (Example of form 1) The spam and fraud call prevention system according to an embodiment of the present invention is a system that collects, learns, automatically responds to, and displays a risk ranking of spam calls. This system ensures the safety and security of users by collecting, learning, automatically responding to, and displaying a risk ranking of spam calls. For example, it has an automatic spam call response function. When a user receives a spam call, the system automatically responds and uses a fixed phrase. For example, it uses a phrase such as, "This call has been determined to be a spam call. Please refrain from contacting us again in the future." This function eliminates the need for the user to directly deal with spam calls. Next, there is the operation of a spam call prevention database. Information on spam calls is collected and stored in the database. The system refers to this database and learns spam call patterns. This allows it to respond quickly to new spam calls. Furthermore, there is a function to display a risk ranking on the incoming call screen. If there is an incoming call that may be a spam call, the system evaluates the risk level of the phone number and displays it on the incoming call screen. For example, it displays "Risk Level: High". This function allows the user to understand the risk level of an incoming call in advance and decide how to respond. In this way, by utilizing the system, it is possible to provide effective countermeasures against spam calls and ensure the safety and security of users. This allows the spam and fraud call countermeasure system to collect and learn information on spam calls, automatically respond, and display a risk ranking.

[0029] The spam and fraud call prevention system according to the embodiment comprises a collection unit, a learning unit, a response unit, and a display unit. The collection unit collects information on spam calls. Information on spam calls includes, but is not limited to, telephone numbers, call content, and caller information. The collection unit registers the telephone numbers of spam calls in a database and analyzes the call content. The collection unit can also collect caller information and identify spam call patterns. For example, the collection unit automatically detects the telephone numbers of spam calls and registers them in a database. The call content is converted into text data using speech recognition technology and analyzed. Caller information includes attribute information such as the caller's region and industry to identify spam call patterns. The learning unit learns spam call patterns based on the information collected by the collection unit. Learning is performed, for example, using a machine learning algorithm, but is not limited to this example. For example, the learning unit uses a neural network to learn spam call patterns. The learning unit can also learn spam call patterns using a support vector machine. Furthermore, the learning unit can learn patterns of spam calls based on past spam call data. For example, the learning unit inputs past spam call data into a neural network to learn spam call patterns. A support vector machine is used to classify spam call patterns. Past spam call data includes information such as the origin of the spam call and the content of the call. The answering unit automatically answers spam calls based on the patterns learned by the learning unit. Automatic answering is performed based on, for example, the method of selecting the answering phrase and the timing of the answering, but is not limited to such examples. For example, the answering unit automatically answers spam calls using a fixed phrase. The answering unit can also automatically answer using a user-customizable answering phrase. The answering unit can also dynamically generate an answering phrase based on the content of the spam call. For example, the answering unit automatically answers spam calls using a fixed phrase such as, "This call has been identified as spam. Please refrain from contacting us again." User-customizable answering phrases are set to a extent that the user can edit.Dynamically generated response phrases are generated in real time based on the content of spam calls. The display unit displays a risk ranking on the incoming call screen based on patterns learned by the learning unit. The risk ranking is displayed based on, for example, evaluation items or scoring methods, but is not limited to such examples. For example, the display unit displays the risk level of spam calls as ranks such as "high," "medium," and "low." The display unit can also visually display the risk ranking using color coding or icons. The display unit can also update the risk ranking in real time. For example, the display unit displays the risk level of spam calls using red, yellow, and green colors. Icons are displayed as warning icons for high-risk spam calls. The real-time updated risk ranking is displayed based on the latest spam call information. Thus, the spam and fraud call countermeasure system according to this embodiment can collect, learn, automatically respond to, and display a risk ranking of spam calls.

[0030] The collection unit collects information on spam calls. This information includes, but is not limited to, phone numbers, call content, and caller information. For example, the collection unit registers spam phone numbers in a database and analyzes the call content. The collection unit can also collect caller information and identify spam call patterns. For example, the collection unit automatically detects spam phone numbers and registers them in a database. Call content is converted into text data using speech recognition technology and analyzed. Caller information is collected to identify spam call patterns by gathering attribute information such as the caller's region and industry. The collection unit uses a combination of technologies to efficiently collect this information. For example, it utilizes telecommunications carrier databases and user reports to collect phone numbers. For call content analysis, it uses not only speech recognition technology but also natural language processing technology to analyze the meaning of the call content and extract characteristics of spam calls. For caller information collection, it utilizes publicly available information on the internet and corporate databases to obtain detailed information about callers. This allows the collection unit to collect spam call information from multiple perspectives and register it in a database. Furthermore, the data collection unit can update the collected information in real time, ensuring that it always maintains the latest information on spam calls. For example, it can immediately reflect newly reported spam call information in the database, making it available to other departments. The data collection unit can also enhance the effectiveness of spam call countermeasures by linking the collected information with other systems and services. For instance, it can share collected spam call information with other security systems to achieve comprehensive security measures. This allows the data collection unit to efficiently and effectively collect spam call information, improving the overall system performance.

[0031] The learning unit learns patterns of spam calls based on information collected by the collection unit. Learning is performed using, for example, machine learning algorithms, but is not limited to such examples. For example, the learning unit uses a neural network to learn spam call patterns. The learning unit can also learn spam call patterns using a support vector machine. Furthermore, the learning unit can learn spam call patterns based on past spam call data. For example, the learning unit inputs past spam call data into a neural network to learn spam call patterns. A support vector machine is used to classify spam call patterns. Past spam call data includes information such as the originator of the spam call and the content of the call. The learning unit uses this data to extract features of spam calls and identify patterns. For example, a neural network analyzes text data of the call content and learns phrases and expressions specific to spam calls. A support vector machine classifies spam call patterns based on telephone number and originator attribute information. As a result, the learning unit can learn spam call patterns with high accuracy and predict future spam calls. Furthermore, the learning unit can continuously update its learning results to adapt to the latest spam call patterns. For example, it can retrain the learning model based on newly collected spam call information to improve accuracy. The learning unit can also use anomaly detection algorithms to detect spam calls with unusual patterns at an early stage. As a result, the learning unit can quickly and accurately learn spam call patterns, improving the reliability and security of the entire system.

[0032] The answering unit automatically answers spam calls based on patterns learned by the learning unit. Automatic responses are based on, for example, the selection of response phrases and the timing of responses, but are not limited to these examples. For instance, the answering unit can automatically respond to spam calls using fixed phrases. It can also automatically respond using user-customizable response phrases. Furthermore, the answering unit can dynamically generate response phrases based on the content of the spam call. For example, the answering unit can automatically respond to spam calls using a fixed phrase such as, "This call has been identified as spam. Please refrain from contacting us again." User-customizable response phrases are set to a user-editable extent. Dynamically generated response phrases are generated in real time based on the content of the spam call. The answering unit sends these response phrases at the appropriate time to effectively address the spam caller. For example, if the content of a spam call is suspected to be fraudulent, the answering unit automatically sends a warning phrase such as, "This call is being recorded. Fraudulent activity is punishable by law." The answering unit can also automatically block spam calls depending on user settings. For example, it can automatically reject calls from specific phone numbers or callers and notify the user. Furthermore, the answering unit can record the history of spam calls and provide data for later analysis. This allows the answering unit to respond to spam calls quickly and effectively, reducing the burden on the user.

[0033] The display unit shows a risk ranking on the incoming call screen based on patterns learned by the learning unit. The risk ranking is displayed based on, for example, evaluation items or scoring methods, but is not limited to these examples. For example, the display unit displays the risk level of spam calls as ranks such as "high," "medium," and "low." The display unit can also visually display the risk ranking using color coding and icons. The display unit can also update the risk ranking in real time. For example, the display unit displays the risk level of spam calls using red, yellow, and green colors. Icons are displayed as warning icons for spam calls with a high risk level. The risk ranking, which is updated in real time, is displayed based on the latest spam call information. The display unit employs an intuitive interface to provide this information to the user in an easy-to-understand manner. For example, it displays large icons and color-coded bars on the incoming call screen so that the user can judge the risk level at a glance. The display unit can also display detailed information about spam calls. For example, it displays the phone number, the region of origin, and a summary of the call content so that the user can check the content of the spam call. Furthermore, the display unit provides a function that allows users to check their past history of spam calls. For example, it can display a list of spam calls received in the past, allowing users to check the risk level and detailed information for each call. In this way, the display unit can provide users with information about spam calls in an easy-to-understand manner and support them in taking prompt action.

[0034] The answering unit can automatically answer spam calls using user-customizable answering phrases. For example, the answering unit can automatically answer spam calls using user-customizable answering phrases. For example, the answering unit can set answering phrases to a user-editable extent. The answering unit can also provide default answering phrases that users can customize. For example, the answering unit can provide a default answering phrase such as, "This call has been identified as spam. Please refrain from contacting us again." Users can edit this default answering phrase and customize it to their liking. This allows for more flexible responses by using user-customized answering phrases. Some or all of the above processing in the answering unit may be performed using AI, or not. For example, the answering unit can input user-customized answering phrases into AI, and the AI ​​can automatically answer spam calls based on those answering phrases.

[0035] The learning unit can update the database based on user feedback. For example, the learning unit can collect user ratings and comments on spam calls and reflect them in the database. The learning unit can also update the database considering the timing of user feedback on spam calls. For example, if a user rates a spam call as "very annoying," "somewhat annoying," or "not annoying," the learning unit will reflect that rating in the database. User comments include information about the content and origin of the spam call. Feedback is collected at appropriate times, such as immediately after the user receives the spam call or after a certain period of time. This improves the accuracy of the database by reflecting user feedback. Some or all of the above processing in the learning unit may be performed using AI, or not using AI. For example, the learning unit can input user feedback into AI, and the AI ​​can update the database based on that feedback.

[0036] The display unit can visually display the risk level ranking using color coding or icons. For example, the display unit can visually display the risk level of spam calls using red, yellow, and green colors. The display unit can also display warning icons for spam calls with a high risk level. For example, the display unit can display a red warning icon for spam calls with a high risk level, a yellow warning icon for spam calls with a moderate risk level, and a green warning icon for spam calls with a low risk level. This allows users to intuitively grasp the risk level by visually displaying it. Some or all of the above processing in the display unit may be performed using AI, for example, or without AI. For example, the display unit can input the risk level of spam calls into AI, and the AI ​​can display the risk level using color coding or icons.

[0037] The response unit may include settings to automatically respond when the risk level is high. For example, the response unit can automatically respond using a response phrase if it determines that a call is a high-risk spam call. The response unit can also automatically respond based on a risk threshold set by the user. For example, the response unit can be set to automatically respond to spam calls rated as "high" risk, and for spam calls rated as "medium" or "low" risk, the user is required to respond manually. This reduces the burden on the user by automatically responding when the risk level is high. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the risk level of a spam call into the AI, and the AI ​​can automatically respond based on that risk level.

[0038] The learning unit can assess the level of risk based on the frequency and content of spam calls. For example, the learning unit can assess the level of risk based on the number of calls and keywords in the call content. The learning unit can also assess the level of risk based on information about the originator of the spam calls and past call history. For example, the learning unit will rate the level of risk higher if the number of spam calls is high. The learning unit can also rate the level of risk higher if the call content includes keywords such as "fraud" or "solicitation." Furthermore, the learning unit can also rate the level of risk higher if the originators of the spam calls are concentrated in a specific region or industry. This allows for a more accurate assessment of risk by evaluating the level of risk based on the frequency and content of spam calls. Some or all of the above processing in the learning unit may be performed using AI, for example, or without AI. For example, the learning unit can input the frequency and content of spam calls into the AI, and the AI ​​can assess the level of risk based on that information.

[0039] The data collection unit can analyze the user's past call history and select the optimal collection method when collecting information on spam calls. For example, the data collection unit can analyze the patterns of spam calls the user has received in the past and prioritize collecting calls with similar patterns. The data collection unit can also concentrate information collection during specific time periods if the user's call history indicates that many spam calls are received during those times. Furthermore, the data collection unit can prioritize collecting calls from specific callers based on the user's call history. This allows for the selection of the optimal information collection method by analyzing past call history. Some or all of the above processing in the data collection unit may be performed using AI, for example, or without AI. For example, the data collection unit can input the user's past call history into AI, which can then select the optimal collection method based on that call history.

[0040] The data collection unit can filter information about spam calls based on the user's current location and time of day. For example, if the user is in a specific area, the data collection unit will prioritize collecting information about spam calls that are frequent in that area. Furthermore, if the user receives a spam call at night, the data collection unit can also collect information about spam calls that are frequent at night. Additionally, if the user is on the move, the data collection unit can collect information about spam calls that are frequent in their destination area based on their current location. This allows for more effective information collection by filtering based on the current location and time of day. Some or all of the above processing in the data collection unit may be performed using AI, or not. For example, the data collection unit can input the user's current location and time of day into the AI, which can then perform filtering based on that information.

[0041] The data collection unit can collect relevant spam call information by analyzing the user's social media activity when collecting spam call information. For example, if a user posts about spam calls on social media, the data collection unit can collect relevant spam call information based on that post. The data collection unit can also collect spam call information based on posts made by the user's social media friends. Furthermore, if a user shares information about a specific spam call on social media, the data collection unit can also collect spam call information based on that information. This allows for the effective collection of relevant spam call information by analyzing social media activity. Some or all of the above processing in the data collection unit may be performed using AI, for example, or without AI. For example, the data collection unit can input the user's social media activity into AI, and the AI ​​can collect relevant spam call information based on that activity.

[0042] The data collection unit can, when collecting information on spam calls, refer to the user's contact list to prioritize the collection of known spam phone numbers. For example, the data collection unit can, when collecting information on spam calls, refer to the user's contact list to prioritize the collection of known spam phone numbers. For example, the data collection unit can prioritize the collection of spam phone numbers that match numbers registered in the user's contact list. The data collection unit can also prioritize the collection of spam calls originating from numbers registered in the user's contact list. Furthermore, the data collection unit can also prioritize the collection of spam phone numbers that are similar to numbers registered in the user's contact list. This allows for the priority collection of known spam phone numbers by referring to the contact list. Some or all of the above processing in the data collection unit may be performed using AI, for example, or without AI. For example, the data collection unit can input the user's contact list into AI, and the AI ​​can prioritize the collection of known spam phone numbers based on that list.

[0043] The learning unit can optimize its learning algorithm by referring to past spam call data during the learning process. For example, the learning unit can learn spam call patterns based on past spam call data and optimize the algorithm. The learning unit can also learn patterns of specific callers from past spam call data and optimize the algorithm. Furthermore, the learning unit can analyze past spam call data to discover new spam call patterns and optimize the algorithm. In this way, the learning algorithm can be optimized by referring to past spam call data. Some or all of the above processes in the learning unit may be performed using AI, for example, or without AI. For example, the learning unit can input past spam call data into AI, and the AI ​​can optimize the learning algorithm based on that data.

[0044] The learning unit can perform learning based on attribute information of the originator of spam calls. For example, the learning unit can learn spam call patterns by region based on the geographical information of the originator of spam calls. The learning unit can also learn spam call patterns by industry based on the industry information of the originator of spam calls. Furthermore, the learning unit can learn spam call patterns by time of day based on the time of day information of the originator of spam calls. This allows for more accurate learning by considering the attribute information of the originator. Some or all of the above processing in the learning unit may be performed using AI, for example, or without AI. For example, the learning unit can input attribute information of the originator of spam calls into the AI, and the AI ​​can perform learning based on that information.

[0045] The learning unit can weight the training data based on the time periods in which spam calls are made during training. For example, the learning unit can weight the training data based on the time periods in which spam calls are made during training. For example, the learning unit can weight the data for time periods when spam calls are frequent to enhance learning. The learning unit can also lightly weight the data for time periods when spam calls are infrequent to improve learning efficiency. Furthermore, the learning unit can weight the data for spam calls that occur in concentrated time periods to optimize learning. In this way, the efficiency of learning is improved by weighting the training data based on the time periods in which calls are made. Some or all of the above processing in the learning unit may be performed using AI, for example, or without using AI. For example, the learning unit can input the time periods in which spam calls are made into the AI, and the AI ​​can weight the training data based on those time periods.

[0046] The learning unit can perform text analysis of the content of spam calls during training and learn based on specific keywords. For example, the learning unit can perform text analysis of the content of spam calls during training and learn based on specific keywords. For example, the learning unit can perform text analysis of the content of spam calls and learn based on specific keywords (e.g., fraud, solicitation). The learning unit can also extract frequently occurring keywords from the content of spam calls and use them as training data. Furthermore, the learning unit can analyze the content of spam calls, discover new keywords, and add them to the training data. This makes it possible to perform more accurate training by performing training based on text analysis. Some or all of the above processing in the learning unit may be performed using AI, for example, or without using AI. For example, the learning unit can input the content of spam calls into AI, and the AI ​​can extract specific keywords based on that content and perform training.

[0047] The response unit can dynamically generate response phrases based on the content of spam calls when answering. For example, the response unit can dynamically generate response phrases based on the content of spam calls when answering. For example, the response unit can analyze the content of spam calls and generate response phrases that include warnings if there is a possibility of fraud. The response unit can also generate refusal response phrases if there is a possibility of solicitation based on the content of spam calls. Furthermore, the response unit can generate response phrases corresponding to specific keywords based on the content of spam calls. This allows for more flexible responses by generating response phrases based on the content of spam calls. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the content of spam calls into AI, and the AI ​​can dynamically generate response phrases based on that content.

[0048] The response unit can respond while considering the attribute information of the caller of a nuisance call. For example, if the caller of a nuisance call is from a specific region, the response unit can use a response phrase specific to that region. Also, if the caller of a nuisance call is from a specific industry, the response unit can use a response phrase specific to that industry. Furthermore, the response unit can select an appropriate response phrase based on the time of day information of the caller of the nuisance call. This makes it possible to provide a more appropriate response by considering the attribute information of the caller. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the attribute information of the caller of a nuisance call into the AI, and the AI ​​can select a response phrase based on that information.

[0049] The answering unit can select an answering phrase based on the geographical location information of the caller of a nuisance call when answering. For example, the answering unit can select an answering phrase based on the geographical location information of the caller of a nuisance call when answering. For example, if the caller of a nuisance call is from a specific region, the answering unit can use an answering phrase specific to that region. The answering unit can also generate an answering phrase in the language of a specific country if the caller is from that country. Furthermore, the answering unit can select an appropriate answering phrase based on the geographical location information of the caller of a nuisance call. This allows for the selection of a more appropriate answering phrase by considering the geographical location information of the caller. Some or all of the above processing in the answering unit may be performed using AI, for example, or not using AI. For example, the answering unit can input the geographical location information of the caller of a nuisance call into AI, and the AI ​​can select an answering phrase based on that information.

[0050] The response unit can analyze the content of spam calls as text and select a response phrase based on specific keywords. For example, the response unit can analyze the content of spam calls as text and select a response phrase based on specific keywords. For example, the response unit can analyze the content of spam calls as text and select a response phrase that includes a warning if there is a possibility of fraud. The response unit can also select a refusal response phrase if there is a possibility of solicitation based on the content of the spam call. Furthermore, the response unit can select a response phrase that corresponds to specific keywords based on the content of the spam call. This makes it possible to provide a more appropriate response by selecting a response phrase based on text analysis. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the content of a spam call into an AI, which can then extract specific keywords based on that content and select a response phrase.

[0051] The display unit can optimize its display algorithm by referring to past spam call data when displaying the risk ranking. For example, the display unit optimizes the display algorithm for the risk ranking by referring to past spam call data when displaying the risk ranking. For example, the display unit optimizes the display algorithm for the risk ranking based on past spam call data. The display unit can also evaluate the risk level of a specific caller from past spam call data and optimize the display algorithm. Furthermore, the display unit can analyze past spam call data, introduce new risk evaluation criteria, and optimize the display algorithm. In this way, the display algorithm can be optimized by referring to past spam call data. Some or all of the above processing in the display unit may be performed using AI, for example, or without using AI. For example, the display unit can input past spam call data into AI, and the AI ​​can optimize the display algorithm based on that data.

[0052] The display unit can display risk rankings based on attribute information of the caller of spam calls. For example, the display unit can display risk rankings by region based on the region information of the caller of spam calls. The display unit can also display risk rankings by industry based on the industry information of the caller of spam calls. Furthermore, the display unit can display risk rankings by time of day based on the time of day information of the caller of spam calls. This allows for a more accurate risk ranking to be displayed by considering the attribute information of the caller. Some or all of the above processing in the display unit may be performed using AI, for example, or without AI. For example, the display unit can input attribute information of the caller of spam calls into AI, and the AI ​​can perform the display based on that information.

[0053] The display unit can weight the displayed data based on the time of day the spam calls are made when displaying the risk ranking. For example, the display unit can weight the displayed data based on the time of day the spam calls are made when displaying the risk ranking. For example, the display unit can weight the data for times when spam calls are frequent to enhance the display. The display unit can also lightly weight the data for times when spam calls are infrequent to improve display efficiency. Furthermore, the display unit can weight the data for spam calls that occur in a concentrated period of time to optimize the display. In this way, the efficiency of the display is improved by weighting the displayed data based on the time of day the calls are made. Some or all of the above processing in the display unit may be performed using AI, for example, or without AI. For example, the display unit can input the time of day the spam calls are made into the AI, and the AI ​​can weight the displayed data based on that time.

[0054] The display unit can perform text analysis of the content of spam calls when displaying the risk ranking and display information based on specific keywords. For example, the display unit can perform text analysis of the content of spam calls when displaying the risk ranking and display information based on specific keywords. For example, the display unit can perform text analysis of the content of spam calls and display a warning if there is a possibility of fraud. The display unit can also display a refusal if there is a possibility of solicitation based on the content of the spam calls. Furthermore, the display unit can display information corresponding to specific keywords based on the content of the spam calls. This allows for a more accurate risk ranking to be displayed by performing the display based on text analysis. Some or all of the above processing in the display unit may be performed using AI, for example, or without using AI. For example, the display unit can input the content of spam calls into AI, and the AI ​​can extract specific keywords based on that content and display them.

[0055] The system according to the embodiment is not limited to the example described above, and various modifications are possible, for example, as follows.

[0056] The data collection unit can analyze a user's call history and identify patterns in spam calls. For example, it analyzes the time of day and caller information of spam calls a user has received in the past and prioritizes collecting calls with similar patterns. It can also extract calls containing specific keywords from a user's call history and use that information to identify spam call patterns. Furthermore, based on the user's call history, the data collection unit can prioritize collecting spam calls from specific regions or industries. This allows for more effective spam call countermeasures by utilizing the user's call history.

[0057] The response unit can dynamically generate response phrases based on the content of spam calls. For example, the response unit analyzes the content of a spam call and generates a response phrase including a warning if there is a possibility of fraud. The response unit can also generate a refusal response phrase if the content of the spam call suggests a solicitation. Furthermore, the response unit can generate response phrases corresponding to specific keywords based on the content of the spam call. This allows for more flexible responses by generating response phrases based on the content of spam calls.

[0058] The learning unit can learn based on attribute information of the caller of spam calls. For example, the learning unit can learn spam call patterns by region based on the geographical information of the caller. It can also learn spam call patterns by industry based on the industry information of the caller. Furthermore, the learning unit can learn spam call patterns by time of day based on the time of day information of the caller. This allows for more accurate learning by considering the attribute information of the caller.

[0059] The display unit can display risk rankings based on attribute information of the caller of nuisance calls. For example, the display unit can display risk rankings by region based on the geographical information of the caller of nuisance calls. It can also display risk rankings by industry based on the industry information of the caller of nuisance calls. Furthermore, the display unit can display risk rankings by time of day based on the time of day information of the caller of nuisance calls. This allows for a more accurate risk ranking by considering the attribute information of the caller.

[0060] The data collection unit can analyze users' social media activity when collecting information on spam calls and collect relevant spam call information. For example, if a user posts about spam calls on social media, the data collection unit can collect relevant spam call information based on that content. The data collection unit can also collect spam call information based on posts made by the user's social media friends. Furthermore, if a user shares information about a specific spam call on social media, the data collection unit can collect spam call information based on that information. This allows for the effective collection of relevant spam call information by analyzing social media activity.

[0061] The following briefly describes the processing flow for example form 1.

[0062] Step 1: The collection unit collects information on spam calls. This information includes, for example, phone numbers, call content, and caller information. The collection unit registers the phone numbers of spam calls in a database and analyzes the call content. It can also collect caller information and identify patterns in spam calls. For example, the collection unit automatically detects the phone numbers of spam calls and registers them in a database. The call content is converted into text data using speech recognition technology and analyzed. Caller information is used to collect attribute information such as the caller's region and industry, and to identify patterns in spam calls. Step 2: The learning unit learns patterns of spam calls based on the information collected by the collection unit. Learning is performed using, for example, machine learning algorithms. For example, the learning unit uses neural networks or support vector machines to learn patterns of spam calls. It is also possible to learn patterns of spam calls based on past spam call data. Past spam call data includes information such as the origin of the spam call and the content of the call. Step 3: The response unit automatically answers spam calls based on patterns learned by the learning unit. The automatic response is performed based on, for example, the method of selecting the response phrase and the timing of the response. For example, the response unit can automatically answer spam calls using a fixed phrase. It can also automatically answer using a user-customizable response phrase. Furthermore, it can dynamically generate a response phrase based on the content of the spam call. Step 4: The display unit displays a risk ranking on the incoming call screen based on patterns learned by the learning unit. The risk ranking is displayed based on evaluation items and scoring methods, for example. For example, the display unit displays the risk level of nuisance calls as ranks such as "high," "medium," and "low." The risk ranking can also be displayed visually using color coding or icons. Furthermore, the risk ranking can be updated in real time.

[0063] (Example of form 2) The spam and fraud call prevention system according to an embodiment of the present invention is a system that collects, learns, automatically responds to, and displays a risk ranking of spam calls. This system ensures the safety and security of users by collecting, learning, automatically responding to, and displaying a risk ranking of spam calls. For example, it has an automatic spam call response function. When a user receives a spam call, the system automatically responds and uses a fixed phrase. For example, it uses a phrase such as, "This call has been determined to be a spam call. Please refrain from contacting us again in the future." This function eliminates the need for the user to directly deal with spam calls. Next, there is the operation of a spam call prevention database. Information on spam calls is collected and stored in the database. The system refers to this database and learns spam call patterns. This allows it to respond quickly to new spam calls. Furthermore, there is a function to display a risk ranking on the incoming call screen. If there is an incoming call that may be a spam call, the system evaluates the risk level of the phone number and displays it on the incoming call screen. For example, it displays "Risk Level: High". This function allows the user to understand the risk level of an incoming call in advance and decide how to respond. In this way, by utilizing the system, it is possible to provide effective countermeasures against spam calls and ensure the safety and security of users. This allows the spam and fraud call countermeasure system to collect and learn information on spam calls, automatically respond, and display a risk ranking.

[0064] The spam and fraud call prevention system according to the embodiment comprises a collection unit, a learning unit, a response unit, and a display unit. The collection unit collects information on spam calls. Information on spam calls includes, but is not limited to, telephone numbers, call content, and caller information. The collection unit registers the telephone numbers of spam calls in a database and analyzes the call content. The collection unit can also collect caller information and identify spam call patterns. For example, the collection unit automatically detects the telephone numbers of spam calls and registers them in a database. The call content is converted into text data using speech recognition technology and analyzed. Caller information includes attribute information such as the caller's region and industry to identify spam call patterns. The learning unit learns spam call patterns based on the information collected by the collection unit. Learning is performed, for example, using a machine learning algorithm, but is not limited to this example. For example, the learning unit uses a neural network to learn spam call patterns. The learning unit can also learn spam call patterns using a support vector machine. Furthermore, the learning unit can learn patterns of spam calls based on past spam call data. For example, the learning unit inputs past spam call data into a neural network to learn spam call patterns. A support vector machine is used to classify spam call patterns. Past spam call data includes information such as the origin of the spam call and the content of the call. The answering unit automatically answers spam calls based on the patterns learned by the learning unit. Automatic answering is performed based on, for example, the method of selecting the answering phrase and the timing of the answering, but is not limited to such examples. For example, the answering unit automatically answers spam calls using a fixed phrase. The answering unit can also automatically answer using a user-customizable answering phrase. The answering unit can also dynamically generate an answering phrase based on the content of the spam call. For example, the answering unit automatically answers spam calls using a fixed phrase such as, "This call has been identified as spam. Please refrain from contacting us again." User-customizable answering phrases are set to a extent that the user can edit.Dynamically generated response phrases are generated in real time based on the content of spam calls. The display unit displays a risk ranking on the incoming call screen based on patterns learned by the learning unit. The risk ranking is displayed based on, for example, evaluation items or scoring methods, but is not limited to such examples. For example, the display unit displays the risk level of spam calls as ranks such as "high," "medium," and "low." The display unit can also visually display the risk ranking using color coding or icons. The display unit can also update the risk ranking in real time. For example, the display unit displays the risk level of spam calls using red, yellow, and green colors. Icons are displayed as warning icons for high-risk spam calls. The real-time updated risk ranking is displayed based on the latest spam call information. Thus, the spam and fraud call countermeasure system according to this embodiment can collect, learn, automatically respond to, and display a risk ranking of spam calls.

[0065] The collection unit collects information on spam calls. This information includes, but is not limited to, phone numbers, call content, and caller information. For example, the collection unit registers spam phone numbers in a database and analyzes the call content. The collection unit can also collect caller information and identify spam call patterns. For example, the collection unit automatically detects spam phone numbers and registers them in a database. Call content is converted into text data using speech recognition technology and analyzed. Caller information is collected to identify spam call patterns by gathering attribute information such as the caller's region and industry. The collection unit uses a combination of technologies to efficiently collect this information. For example, it utilizes telecommunications carrier databases and user reports to collect phone numbers. For call content analysis, it uses not only speech recognition technology but also natural language processing technology to analyze the meaning of the call content and extract characteristics of spam calls. For caller information collection, it utilizes publicly available information on the internet and corporate databases to obtain detailed information about callers. This allows the collection unit to collect spam call information from multiple perspectives and register it in a database. Furthermore, the data collection unit can update the collected information in real time, ensuring that it always maintains the latest information on spam calls. For example, it can immediately reflect newly reported spam call information in the database, making it available to other departments. The data collection unit can also enhance the effectiveness of spam call countermeasures by linking the collected information with other systems and services. For instance, it can share collected spam call information with other security systems to achieve comprehensive security measures. This allows the data collection unit to efficiently and effectively collect spam call information, improving the overall system performance.

[0066] The learning unit learns patterns of spam calls based on information collected by the collection unit. Learning is performed using, for example, machine learning algorithms, but is not limited to such examples. For example, the learning unit uses a neural network to learn spam call patterns. The learning unit can also learn spam call patterns using a support vector machine. Furthermore, the learning unit can learn spam call patterns based on past spam call data. For example, the learning unit inputs past spam call data into a neural network to learn spam call patterns. A support vector machine is used to classify spam call patterns. Past spam call data includes information such as the originator of the spam call and the content of the call. The learning unit uses this data to extract features of spam calls and identify patterns. For example, a neural network analyzes text data of the call content and learns phrases and expressions specific to spam calls. A support vector machine classifies spam call patterns based on telephone number and originator attribute information. As a result, the learning unit can learn spam call patterns with high accuracy and predict future spam calls. Furthermore, the learning unit can continuously update its learning results to adapt to the latest spam call patterns. For example, it can retrain the learning model based on newly collected spam call information to improve accuracy. The learning unit can also use anomaly detection algorithms to detect spam calls with unusual patterns at an early stage. As a result, the learning unit can quickly and accurately learn spam call patterns, improving the reliability and security of the entire system.

[0067] The answering unit automatically answers spam calls based on patterns learned by the learning unit. Automatic responses are based on, for example, the selection of response phrases and the timing of responses, but are not limited to these examples. For instance, the answering unit can automatically respond to spam calls using fixed phrases. It can also automatically respond using user-customizable response phrases. Furthermore, the answering unit can dynamically generate response phrases based on the content of the spam call. For example, the answering unit can automatically respond to spam calls using a fixed phrase such as, "This call has been identified as spam. Please refrain from contacting us again." User-customizable response phrases are set to a user-editable extent. Dynamically generated response phrases are generated in real time based on the content of the spam call. The answering unit sends these response phrases at the appropriate time to effectively address the spam caller. For example, if the content of a spam call is suspected to be fraudulent, the answering unit automatically sends a warning phrase such as, "This call is being recorded. Fraudulent activity is punishable by law." The answering unit can also automatically block spam calls depending on user settings. For example, it can automatically reject calls from specific phone numbers or callers and notify the user. Furthermore, the answering unit can record the history of spam calls and provide data for later analysis. This allows the answering unit to respond to spam calls quickly and effectively, reducing the burden on the user.

[0068] The display unit shows a risk ranking on the incoming call screen based on patterns learned by the learning unit. The risk ranking is displayed based on, for example, evaluation items or scoring methods, but is not limited to these examples. For example, the display unit displays the risk level of spam calls as ranks such as "high," "medium," and "low." The display unit can also visually display the risk ranking using color coding and icons. The display unit can also update the risk ranking in real time. For example, the display unit displays the risk level of spam calls using red, yellow, and green colors. Icons are displayed as warning icons for spam calls with a high risk level. The risk ranking, which is updated in real time, is displayed based on the latest spam call information. The display unit employs an intuitive interface to provide this information to the user in an easy-to-understand manner. For example, it displays large icons and color-coded bars on the incoming call screen so that the user can judge the risk level at a glance. The display unit can also display detailed information about spam calls. For example, it displays the phone number, the region of origin, and a summary of the call content so that the user can check the content of the spam call. Furthermore, the display unit provides a function that allows users to check their past history of spam calls. For example, it can display a list of spam calls received in the past, allowing users to check the risk level and detailed information for each call. In this way, the display unit can provide users with information about spam calls in an easy-to-understand manner and support them in taking prompt action.

[0069] The answering unit can automatically answer spam calls using user-customizable answering phrases. For example, the answering unit can automatically answer spam calls using user-customizable answering phrases. For example, the answering unit can set answering phrases to a user-editable extent. The answering unit can also provide default answering phrases that users can customize. For example, the answering unit can provide a default answering phrase such as, "This call has been identified as spam. Please refrain from contacting us again." Users can edit this default answering phrase and customize it to their liking. This allows for more flexible responses by using user-customized answering phrases. Some or all of the above processing in the answering unit may be performed using AI, or not. For example, the answering unit can input user-customized answering phrases into AI, and the AI ​​can automatically answer spam calls based on those answering phrases.

[0070] The learning unit can update the database based on user feedback. For example, the learning unit can collect user ratings and comments on spam calls and reflect them in the database. The learning unit can also update the database considering the timing of user feedback on spam calls. For example, if a user rates a spam call as "very annoying," "somewhat annoying," or "not annoying," the learning unit will reflect that rating in the database. User comments include information about the content and origin of the spam call. Feedback is collected at appropriate times, such as immediately after the user receives the spam call or after a certain period of time. This improves the accuracy of the database by reflecting user feedback. Some or all of the above processing in the learning unit may be performed using AI, or not using AI. For example, the learning unit can input user feedback into AI, and the AI ​​can update the database based on that feedback.

[0071] The display unit can visually display the risk level ranking using color coding or icons. For example, the display unit can visually display the risk level of spam calls using red, yellow, and green colors. The display unit can also display warning icons for spam calls with a high risk level. For example, the display unit can display a red warning icon for spam calls with a high risk level, a yellow warning icon for spam calls with a moderate risk level, and a green warning icon for spam calls with a low risk level. This allows users to intuitively grasp the risk level by visually displaying it. Some or all of the above processing in the display unit may be performed using AI, for example, or without AI. For example, the display unit can input the risk level of spam calls into AI, and the AI ​​can display the risk level using color coding or icons.

[0072] The response unit may include settings to automatically respond when the risk level is high. For example, the response unit can automatically respond using a response phrase if it determines that a call is a high-risk spam call. The response unit can also automatically respond based on a risk threshold set by the user. For example, the response unit can be set to automatically respond to spam calls rated as "high" risk, and for spam calls rated as "medium" or "low" risk, the user is required to respond manually. This reduces the burden on the user by automatically responding when the risk level is high. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the risk level of a spam call into the AI, and the AI ​​can automatically respond based on that risk level.

[0073] The learning unit can assess the level of risk based on the frequency and content of spam calls. For example, the learning unit can assess the level of risk based on the number of calls and keywords in the call content. The learning unit can also assess the level of risk based on information about the originator of the spam calls and past call history. For example, the learning unit will rate the level of risk higher if the number of spam calls is high. The learning unit can also rate the level of risk higher if the call content includes keywords such as "fraud" or "solicitation." Furthermore, the learning unit can also rate the level of risk higher if the originators of the spam calls are concentrated in a specific region or industry. This allows for a more accurate assessment of risk by evaluating the level of risk based on the frequency and content of spam calls. Some or all of the above processing in the learning unit may be performed using AI, for example, or without AI. For example, the learning unit can input the frequency and content of spam calls into the AI, and the AI ​​can assess the level of risk based on that information.

[0074] The data collection unit can estimate the user's emotions and adjust the timing of collecting spam call information based on the estimated emotions. For example, if the user is stressed, the data collection unit can delay collecting spam call information and collect it when the user is relaxed. Alternatively, if the user is relaxed, the data collection unit can immediately collect spam call information and add it to the database. Furthermore, if the user is busy, the data collection unit can postpone collecting spam call information and collect it when the user is calm. This reduces the user's burden by adjusting the timing of information collection according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or generative AI. Generative AI is, but is not limited to, text generation AI (e.g., LLM) or multimodal generation AI. Some or all of the above processing in the data collection unit may be performed using AI, for example, or without AI. For example, the data collection unit can input user emotion data into a generating AI, which can then adjust the timing of information collection based on that emotion data.

[0075] The data collection unit can analyze the user's past call history and select the optimal collection method when collecting information on spam calls. For example, the data collection unit can analyze the patterns of spam calls the user has received in the past and prioritize collecting calls with similar patterns. The data collection unit can also concentrate information collection during specific time periods if the user's call history indicates that many spam calls are received during those times. Furthermore, the data collection unit can prioritize collecting calls from specific callers based on the user's call history. This allows for the selection of the optimal information collection method by analyzing past call history. Some or all of the above processing in the data collection unit may be performed using AI, for example, or without AI. For example, the data collection unit can input the user's past call history into AI, which can then select the optimal collection method based on that call history.

[0076] The data collection unit can filter information about spam calls based on the user's current location and time of day. For example, if the user is in a specific area, the data collection unit will prioritize collecting information about spam calls that are frequent in that area. Furthermore, if the user receives a spam call at night, the data collection unit can also collect information about spam calls that are frequent at night. Additionally, if the user is on the move, the data collection unit can collect information about spam calls that are frequent in their destination area based on their current location. This allows for more effective information collection by filtering based on the current location and time of day. Some or all of the above processing in the data collection unit may be performed using AI, or not. For example, the data collection unit can input the user's current location and time of day into the AI, which can then perform filtering based on that information.

[0077] The data collection unit can estimate the user's emotions and determine the priority of spam call information to collect based on the estimated emotions. For example, if the user is stressed, the data collection unit may postpone collecting less important spam call information to reduce stress. If the user is relaxed, the data collection unit may collect all spam call information equally. Furthermore, if the user is in a hurry, the data collection unit may prioritize collecting high-priority spam call information. This reduces the user's burden by prioritizing information according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or generative AI. Generative AI may be, but is not limited to, text generation AI (e.g., LLM) or multimodal generation AI. Some or all of the above processing in the data collection unit may be performed using AI or not using AI. For example, the data collection unit can input user emotion data into a generative AI, which can then determine the priority of information based on that emotion data.

[0078] The data collection unit can collect relevant spam call information by analyzing the user's social media activity when collecting spam call information. For example, if a user posts about spam calls on social media, the data collection unit can collect relevant spam call information based on that post. The data collection unit can also collect spam call information based on posts made by the user's social media friends. Furthermore, if a user shares information about a specific spam call on social media, the data collection unit can also collect spam call information based on that information. This allows for the effective collection of relevant spam call information by analyzing social media activity. Some or all of the above processing in the data collection unit may be performed using AI, for example, or without AI. For example, the data collection unit can input the user's social media activity into AI, and the AI ​​can collect relevant spam call information based on that activity.

[0079] The data collection unit can, when collecting information on spam calls, refer to the user's contact list to prioritize the collection of known spam phone numbers. For example, the data collection unit can, when collecting information on spam calls, refer to the user's contact list to prioritize the collection of known spam phone numbers. For example, the data collection unit can prioritize the collection of spam phone numbers that match numbers registered in the user's contact list. The data collection unit can also prioritize the collection of spam calls originating from numbers registered in the user's contact list. Furthermore, the data collection unit can also prioritize the collection of spam phone numbers that are similar to numbers registered in the user's contact list. This allows for the priority collection of known spam phone numbers by referring to the contact list. Some or all of the above processing in the data collection unit may be performed using AI, for example, or without AI. For example, the data collection unit can input the user's contact list into AI, and the AI ​​can prioritize the collection of known spam phone numbers based on that list.

[0080] The learning unit can estimate the user's emotions and select training data based on the estimated emotions. For example, if the user is stressed, the learning unit may prioritize less important training data to reduce stress. If the user is relaxed, the learning unit may select all training data equally. Furthermore, if the user is in a hurry, the learning unit may prioritize selecting highly important training data. This improves the efficiency of learning by selecting training data according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or generative AI. Generative AI may be, but is not limited to, text generation AI (e.g., LLM) or multimodal generation AI. Some or all of the above processing in the learning unit may be performed using AI, or not using AI. For example, the learning unit can input user emotion data into a generative AI, which can then select training data based on that emotion data.

[0081] The learning unit can optimize its learning algorithm by referring to past spam call data during the learning process. For example, the learning unit can learn spam call patterns based on past spam call data and optimize the algorithm. The learning unit can also learn patterns of specific callers from past spam call data and optimize the algorithm. Furthermore, the learning unit can analyze past spam call data to discover new spam call patterns and optimize the algorithm. In this way, the learning algorithm can be optimized by referring to past spam call data. Some or all of the above processes in the learning unit may be performed using AI, for example, or without AI. For example, the learning unit can input past spam call data into AI, and the AI ​​can optimize the learning algorithm based on that data.

[0082] The learning unit can perform learning based on attribute information of the originator of spam calls. For example, the learning unit can learn spam call patterns by region based on the geographical information of the originator of spam calls. The learning unit can also learn spam call patterns by industry based on the industry information of the originator of spam calls. Furthermore, the learning unit can learn spam call patterns by time of day based on the time of day information of the originator of spam calls. This allows for more accurate learning by considering the attribute information of the originator. Some or all of the above processing in the learning unit may be performed using AI, for example, or without AI. For example, the learning unit can input attribute information of the originator of spam calls into the AI, and the AI ​​can perform learning based on that information.

[0083] The learning unit can estimate the user's emotions and adjust the learning frequency based on the estimated emotions. For example, if the user is stressed, the learning unit can reduce the learning frequency to alleviate the user's burden. Conversely, if the user is relaxed, the learning unit can increase the learning frequency to learn more efficiently. Furthermore, if the user is in a hurry, the learning unit can adjust the learning frequency and prioritize learning important data. This reduces the user's burden by adjusting the learning frequency according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or generative AI. Generative AI is, but is not limited to, text generation AI (e.g., LLM) or multimodal generation AI. Some or all of the above processing in the learning unit may be performed using AI or not using AI. For example, the learning unit can input user emotion data into a generative AI, which can then adjust the learning frequency based on that emotion data.

[0084] The learning unit can weight the training data based on the time periods in which spam calls are made during training. For example, the learning unit can weight the training data based on the time periods in which spam calls are made during training. For example, the learning unit can weight the data for time periods when spam calls are frequent to enhance learning. The learning unit can also lightly weight the data for time periods when spam calls are infrequent to improve learning efficiency. Furthermore, the learning unit can weight the data for spam calls that occur in concentrated time periods to optimize learning. In this way, the efficiency of learning is improved by weighting the training data based on the time periods in which calls are made. Some or all of the above processing in the learning unit may be performed using AI, for example, or without using AI. For example, the learning unit can input the time periods in which spam calls are made into the AI, and the AI ​​can weight the training data based on those time periods.

[0085] The learning unit can perform text analysis of the content of spam calls during training and learn based on specific keywords. For example, the learning unit can perform text analysis of the content of spam calls during training and learn based on specific keywords. For example, the learning unit can perform text analysis of the content of spam calls and learn based on specific keywords (e.g., fraud, solicitation). The learning unit can also extract frequently occurring keywords from the content of spam calls and use them as training data. Furthermore, the learning unit can analyze the content of spam calls, discover new keywords, and add them to the training data. This makes it possible to perform more accurate training by performing training based on text analysis. Some or all of the above processing in the learning unit may be performed using AI, for example, or without using AI. For example, the learning unit can input the content of spam calls into AI, and the AI ​​can extract specific keywords based on that content and perform training.

[0086] The response unit can estimate the user's emotions and select a response phrase based on the estimated emotions. For example, if the user is stressed, the response unit may select a calm response phrase to alleviate the stress. If the user is relaxed, the response unit may also select a standard response phrase. Furthermore, if the user is in a hurry, the response unit may select a short response phrase for a quick response. This allows for a more appropriate response by selecting a response phrase according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or generative AI. The generative AI is, but is not limited to, text generation AI (e.g., LLM) or multimodal generation AI. Some or all of the above processing in the response unit may be performed using AI, or not using AI. For example, the response unit can input user emotion data into the generative AI, which can then select a response phrase based on that emotion data.

[0087] The response unit can dynamically generate response phrases based on the content of spam calls when answering. For example, the response unit can dynamically generate response phrases based on the content of spam calls when answering. For example, the response unit can analyze the content of spam calls and generate response phrases that include warnings if there is a possibility of fraud. The response unit can also generate refusal response phrases if there is a possibility of solicitation based on the content of spam calls. Furthermore, the response unit can generate response phrases corresponding to specific keywords based on the content of spam calls. This allows for more flexible responses by generating response phrases based on the content of spam calls. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the content of spam calls into AI, and the AI ​​can dynamically generate response phrases based on that content.

[0088] The response unit can respond while considering the attribute information of the caller of a nuisance call. For example, if the caller of a nuisance call is from a specific region, the response unit can use a response phrase specific to that region. Also, if the caller of a nuisance call is from a specific industry, the response unit can use a response phrase specific to that industry. Furthermore, the response unit can select an appropriate response phrase based on the time of day information of the caller of the nuisance call. This makes it possible to provide a more appropriate response by considering the attribute information of the caller. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the attribute information of the caller of a nuisance call into the AI, and the AI ​​can select a response phrase based on that information.

[0089] The response unit can estimate the user's emotions and determine the priority of responses based on the estimated emotions. For example, if the user is stressed, the response unit may postpone less important responses to reduce stress. If the user is relaxed, the response unit may process all responses equally. Furthermore, if the user is in a hurry, the response unit may prioritize high-importance responses. This reduces the user's burden by determining the priority of responses according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or generative AI. Generative AI is, but is not limited to, text generation AI (e.g., LLM) or multimodal generation AI. Some or all of the above processing in the response unit may be performed using AI or not using AI. For example, the response unit can input user emotion data into a generative AI, which can then determine the priority of responses based on that emotion data.

[0090] The answering unit can select an answering phrase based on the geographical location information of the caller of a nuisance call when answering. For example, the answering unit can select an answering phrase based on the geographical location information of the caller of a nuisance call when answering. For example, if the caller of a nuisance call is from a specific region, the answering unit can use an answering phrase specific to that region. The answering unit can also generate an answering phrase in the language of a specific country if the caller is from that country. Furthermore, the answering unit can select an appropriate answering phrase based on the geographical location information of the caller of a nuisance call. This allows for the selection of a more appropriate answering phrase by considering the geographical location information of the caller. Some or all of the above processing in the answering unit may be performed using AI, for example, or not using AI. For example, the answering unit can input the geographical location information of the caller of a nuisance call into AI, and the AI ​​can select an answering phrase based on that information.

[0091] The response unit can analyze the content of spam calls as text and select a response phrase based on specific keywords. For example, the response unit can analyze the content of spam calls as text and select a response phrase based on specific keywords. For example, the response unit can analyze the content of spam calls as text and select a response phrase that includes a warning if there is a possibility of fraud. The response unit can also select a refusal response phrase if there is a possibility of solicitation based on the content of the spam call. Furthermore, the response unit can select a response phrase that corresponds to specific keywords based on the content of the spam call. This makes it possible to provide a more appropriate response by selecting a response phrase based on text analysis. Some or all of the above processing in the response unit may be performed using AI, for example, or without AI. For example, the response unit can input the content of a spam call into an AI, which can then extract specific keywords based on that content and select a response phrase.

[0092] The display unit can estimate the user's emotions and adjust the display method of the risk ranking based on the estimated user emotions. For example, the display unit can estimate the user's emotions and adjust the display method of the risk ranking based on the estimated user emotions. For example, if the user is stressed, the display unit can provide a simple and highly visible display method. The display unit can also provide a display method that includes detailed information if the user is relaxed. Furthermore, if the user is in a hurry, the display unit can provide a display method that gets straight to the point. This reduces the burden on the user by adjusting the display method according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or a generative AI. The generative AI is a text generation AI (e.g., LLM) or a multimodal generation AI, but is not limited to such examples. Some or all of the above processing in the display unit may be performed using AI, for example, or without AI. For example, the display unit can input user emotion data into a generative AI, and the generative AI can adjust the display method based on that emotion data.

[0093] The display unit can optimize its display algorithm by referring to past spam call data when displaying the risk ranking. For example, the display unit optimizes the display algorithm for the risk ranking by referring to past spam call data when displaying the risk ranking. For example, the display unit optimizes the display algorithm for the risk ranking based on past spam call data. The display unit can also evaluate the risk level of a specific caller from past spam call data and optimize the display algorithm. Furthermore, the display unit can analyze past spam call data, introduce new risk evaluation criteria, and optimize the display algorithm. In this way, the display algorithm can be optimized by referring to past spam call data. Some or all of the above processing in the display unit may be performed using AI, for example, or without using AI. For example, the display unit can input past spam call data into AI, and the AI ​​can optimize the display algorithm based on that data.

[0094] The display unit can display risk rankings based on attribute information of the caller of spam calls. For example, the display unit can display risk rankings by region based on the region information of the caller of spam calls. The display unit can also display risk rankings by industry based on the industry information of the caller of spam calls. Furthermore, the display unit can display risk rankings by time of day based on the time of day information of the caller of spam calls. This allows for a more accurate risk ranking to be displayed by considering the attribute information of the caller. Some or all of the above processing in the display unit may be performed using AI, for example, or without AI. For example, the display unit can input attribute information of the caller of spam calls into AI, and the AI ​​can perform the display based on that information.

[0095] The display unit can estimate the user's emotions and determine the priority of the risk ranking based on the estimated emotions. For example, if the user is stressed, the display unit may postpone lower-priority risk rankings to reduce stress. If the user is relaxed, the display unit may also display all risk rankings equally. Furthermore, if the user is in a hurry, the display unit may prioritize displaying higher-priority risk rankings. This reduces the user's burden by determining priorities according to the user's emotions. Emotion estimation is achieved using an emotion estimation function, for example, using an emotion engine or generative AI. Generative AI may be, but is not limited to, text generation AI (e.g., LLM) or multimodal generation AI. Some or all of the above processing in the display unit may be performed using AI, or not using AI. For example, the display unit can input user emotion data into a generative AI, which can then determine priorities based on that emotion data.

[0096] The display unit can weight the displayed data based on the time of day the spam calls are made when displaying the risk ranking. For example, the display unit can weight the displayed data based on the time of day the spam calls are made when displaying the risk ranking. For example, the display unit can weight the data for times when spam calls are frequent to enhance the display. The display unit can also lightly weight the data for times when spam calls are infrequent to improve display efficiency. Furthermore, the display unit can weight the data for spam calls that occur in a concentrated period of time to optimize the display. In this way, the efficiency of the display is improved by weighting the displayed data based on the time of day the calls are made. Some or all of the above processing in the display unit may be performed using AI, for example, or without AI. For example, the display unit can input the time of day the spam calls are made into the AI, and the AI ​​can weight the displayed data based on that time.

[0097] The display unit can perform text analysis of the content of spam calls when displaying the risk ranking and display information based on specific keywords. For example, the display unit can perform text analysis of the content of spam calls when displaying the risk ranking and display information based on specific keywords. For example, the display unit can perform text analysis of the content of spam calls and display a warning if there is a possibility of fraud. The display unit can also display a refusal if there is a possibility of solicitation based on the content of the spam calls. Furthermore, the display unit can display information corresponding to specific keywords based on the content of the spam calls. This allows for a more accurate risk ranking to be displayed by performing the display based on text analysis. Some or all of the above processing in the display unit may be performed using AI, for example, or without using AI. For example, the display unit can input the content of spam calls into AI, and the AI ​​can extract specific keywords based on that content and display them.

[0098] The system according to the embodiment is not limited to the example described above, and various modifications are possible, for example, as follows.

[0099] The data collection unit can analyze a user's call history and identify patterns in spam calls. For example, it analyzes the time of day and caller information of spam calls a user has received in the past and prioritizes collecting calls with similar patterns. It can also extract calls containing specific keywords from a user's call history and use that information to identify spam call patterns. Furthermore, based on the user's call history, the data collection unit can prioritize collecting spam calls from specific regions or industries. This allows for more effective spam call countermeasures by utilizing the user's call history.

[0100] The response unit can dynamically generate response phrases based on the content of spam calls. For example, the response unit analyzes the content of a spam call and generates a response phrase including a warning if there is a possibility of fraud. The response unit can also generate a refusal response phrase if the content of the spam call suggests a solicitation. Furthermore, the response unit can generate response phrases corresponding to specific keywords based on the content of the spam call. This allows for more flexible responses by generating response phrases based on the content of spam calls.

[0101] The learning unit can learn based on attribute information of the caller of spam calls. For example, the learning unit can learn spam call patterns by region based on the geographical information of the caller. It can also learn spam call patterns by industry based on the industry information of the caller. Furthermore, the learning unit can learn spam call patterns by time of day based on the time of day information of the caller. This allows for more accurate learning by considering the attribute information of the caller.

[0102] The display unit can display risk rankings based on attribute information of the caller of nuisance calls. For example, the display unit can display risk rankings by region based on the geographical information of the caller of nuisance calls. It can also display risk rankings by industry based on the industry information of the caller of nuisance calls. Furthermore, the display unit can display risk rankings by time of day based on the time of day information of the caller of nuisance calls. This allows for a more accurate risk ranking by considering the attribute information of the caller.

[0103] The data collection unit can analyze users' social media activity when collecting information on spam calls and collect relevant spam call information. For example, if a user posts about spam calls on social media, the data collection unit can collect relevant spam call information based on that content. The data collection unit can also collect spam call information based on posts made by the user's social media friends. Furthermore, if a user shares information about a specific spam call on social media, the data collection unit can collect spam call information based on that information. This allows for the effective collection of relevant spam call information by analyzing social media activity.

[0104] The data collection unit can estimate the user's emotions and adjust the timing of collecting spam call information based on those emotions. For example, if the user is stressed, the unit can delay collecting spam call information and collect it when the user is relaxed. Alternatively, if the user is relaxed, the unit can immediately collect spam call information and add it to the database. Furthermore, if the user is busy, the unit can postpone collecting spam call information and collect it when the user is calm. By adjusting the timing of information collection according to the user's emotions, the system reduces the burden on the user.

[0105] The learning unit can estimate the user's emotions and select training data based on those emotions. For example, if the user is stressed, the learning unit will prioritize less important training data to reduce stress. If the user is relaxed, the learning unit can select all training data equally. Furthermore, if the user is in a hurry, the learning unit can prioritize selecting highly important training data. By selecting training data according to the user's emotions, the learning efficiency is improved.

[0106] The response unit can estimate the user's emotions and select a response phrase based on those emotions. For example, if the user is stressed, the response unit will select a calm response phrase to alleviate the stress. It can also select a standard response phrase if the user is relaxed. Furthermore, if the user is in a hurry, the response unit can select a short response phrase for a quick response. This allows for more appropriate responses by selecting response phrases according to the user's emotions.

[0107] The display unit can estimate the user's emotions and adjust the display method of the risk ranking based on the estimated emotions. For example, if the user is feeling stressed, the display unit provides a simple and highly visible display method. If the user is relaxed, the display unit can also provide a display method that includes detailed information. Furthermore, if the user is in a hurry, the display unit can provide a concise display method. This reduces the user's burden by adjusting the display method according to their emotions.

[0108] The display unit can estimate the user's emotions and determine the priority of the risk ranking based on those emotions. For example, if the user is stressed, the display unit will postpone lower-priority risk rankings to reduce stress. If the user is relaxed, the display unit can also display all risk rankings equally. Furthermore, if the user is in a hurry, the display unit can prioritize displaying higher-priority risk rankings. This reduces the user's burden by prioritizing according to their emotions.

[0109] The following briefly describes the processing flow for example form 2.

[0110] Step 1: The collection unit collects information on spam calls. This information includes, for example, phone numbers, call content, and caller information. The collection unit registers the phone numbers of spam calls in a database and analyzes the call content. It can also collect caller information and identify patterns in spam calls. For example, the collection unit automatically detects the phone numbers of spam calls and registers them in a database. The call content is converted into text data using speech recognition technology and analyzed. Caller information is used to collect attribute information such as the caller's region and industry, and to identify patterns in spam calls. Step 2: The learning unit learns patterns of spam calls based on the information collected by the collection unit. Learning is performed using, for example, machine learning algorithms. For example, the learning unit uses neural networks or support vector machines to learn patterns of spam calls. It is also possible to learn patterns of spam calls based on past spam call data. Past spam call data includes information such as the origin of the spam call and the content of the call. Step 3: The response unit automatically answers spam calls based on patterns learned by the learning unit. The automatic response is performed based on, for example, the method of selecting the response phrase and the timing of the response. For example, the response unit can automatically answer spam calls using a fixed phrase. It can also automatically answer using a user-customizable response phrase. Furthermore, it can dynamically generate a response phrase based on the content of the spam call. Step 4: The display unit displays a risk ranking on the incoming call screen based on patterns learned by the learning unit. The risk ranking is displayed based on evaluation items and scoring methods, for example. For example, the display unit displays the risk level of nuisance calls as ranks such as "high," "medium," and "low." The risk ranking can also be displayed visually using color coding or icons. Furthermore, the risk ranking can be updated in real time.

[0111] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0112] Data generation model 58 is a form of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> Examples of generative AI include text generation AI, image generation AI, and multimodal generation AI. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images (e.g., still image data or video data). The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference result in one or more data formats from audio data, text data, and image data. The data generation model 58 includes, for example, text generation AI, image generation AI, and multimodal generation AI. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The specific processing unit 290 performs the specific processing described above using the data generation model 58. The data generation model 58 may be a fine-tuned model that outputs inference results from prompts that do not contain instructions, in which case the data generation model 58 can output inference results from prompts that do not contain instructions. In the data processing device 12, etc., there are multiple types of data generation models 58, and the data generation model 58 includes AI other than generative AI. AI other than generative AI includes, for example, linear regression, logistic regression, decision trees, random forests, support vector machines (SVMs), k-means clustering, convolutional neural networks (CNNs), recurrent neural networks (RNNs), generative adversarial networks (GANs), or naive Bayes, and can perform various processes, but is not limited to these examples. Also, the AI ​​may be an AI agent. Furthermore, when the processing of each of the above parts is performed by the AI, the processing may be performed by the AI ​​in part or in whole, but is not limited to this example.Furthermore, processing performed by AI, including generative AI, may be replaced with rule-based processing, and rule-based processing may be replaced with processing performed by AI, including generative AI.

[0113] Furthermore, the processing performed by the data processing system 10 described above is carried out by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the smart device 14, but it may also be carried out by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the smart device 14. In addition, the specific processing unit 290 of the data processing device 12 acquires or collects information necessary for processing from the smart device 14 or an external device, and the smart device 14 acquires or collects information necessary for processing from the data processing device 12 or an external device.

[0114] Each of the multiple elements described above, including the collection unit, learning unit, response unit, and display unit, is implemented in at least one of the smart device 14 and the data processing unit 12. For example, the collection unit collects information on spam calls using the camera 42 and microphone 38B of the smart device 14 and registers it in a database by the control unit 46A. The learning unit is implemented in the identification processing unit 290 of the data processing unit 12 and learns spam call patterns based on the collected information. The response unit is implemented in the control unit 46A of the smart device 14 and automatically answers spam calls based on the learned patterns. The display unit is implemented in the display 40A of the smart device 14 and displays a risk ranking on the incoming call screen. The correspondence between each unit and the device or control unit is not limited to the example described above and can be modified in various ways.

[0115] [Second Embodiment] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0116] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0117] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN and / or LAN.

[0118] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0119] The microphone 238 receives voice signals from the user and accepts instructions from the user. The microphone 238 captures the voice signals from the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0120] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, which captures images of the area around the user (for example, an imaging range defined by a field of view equivalent to the field of vision of a typical healthy person).

[0121] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0122] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing by the processor 28. The storage 32 stores the specific processing program 56.

[0123] The processor 28 reads a specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 acting as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0124] Storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotions using the emotion identification model 59 and perform identification processing using the user's emotions. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotions, including but not limited to these examples. Furthermore, emotion estimation and prediction also include, for example, emotion analysis.

[0125] In the smart glasses 214, specific processing is performed by the processor 46. The storage 50 stores a specific processing program 60. The processor 46 reads the specific processing program 60 from the storage 50 and executes the read specific processing program 60 on the RAM 48. The specific processing is realized by the processor 46 acting as a control unit 46A according to the specific processing program 60 executed on the RAM 48. The smart glasses 214 also have a data generation model 58 and an emotion identification model 59, similar to the data generation model and emotion identification model 59, and can perform processing similar to that of the specific processing unit 290 using these models.

[0126] Furthermore, other devices besides the data processing device 12 may also have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 obtains processing results (such as prediction results) using the data generation model 58 by communicating with the server device that has the data generation model 58. Also, the data processing device 12 may be a server device or a terminal device owned by the user (for example, a mobile phone, robot, home appliance, etc.).

[0127] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0128] The data generation model 58 is a so-called generative AI. An example of a data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and inference data such as audio data representing speech, text data representing text, and image data representing images (e.g., still image data or video data). The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference result in one or more data formats such as audio data, text data, and image data. The data generation model 58 includes, for example, text generation AI, image generation AI, and multimodal generation AI. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The specific processing unit 290 performs the specific processing described above using the data generation model 58. The data generation model 58 may be a fine-tuned model that outputs inference results from prompts that do not contain instructions, in which case the data generation model 58 can output inference results from prompts that do not contain instructions. In the data processing device 12, etc., there are multiple types of data generation models 58, and the data generation model 58 includes AI other than generative AI. AI other than generative AI includes, for example, linear regression, logistic regression, decision trees, random forests, support vector machines (SVM), k-means clustering, convolutional neural networks (CNN), recurrent neural networks (RNN), generative adversarial networks (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. Also, the AI ​​may be an AI agent. Furthermore, when the processing of each part described above is performed by the AI, the processing may be performed by the AI ​​in part or in whole, but is not limited to this example. Also, processing performed by an AI including a generative AI may be replaced by rule-based processing, and rule-based processing may be replaced by processing performed by an AI including a generative AI.

[0129] The data processing system 210 according to the second embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 210 is performed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the smart glasses 214, but it may also be performed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the smart glasses 214. In addition, the specific processing unit 290 of the data processing device 12 acquires or collects information necessary for processing from the smart glasses 214 or an external device, and the smart glasses 214 acquires or collects information necessary for processing from the data processing device 12 or an external device.

[0130] Each of the multiple elements described above, including the collection unit, learning unit, response unit, and display unit, is implemented in at least one of the smart glasses 214 and the data processing unit 12. For example, the collection unit collects information on spam calls using the camera 42 and microphone 238 of the smart glasses 214 and registers it in a database by the control unit 46A. The learning unit is implemented in the identification processing unit 290 of the data processing unit 12 and learns spam call patterns based on the collected information. The response unit is implemented in the control unit 46A of the smart glasses 214 and automatically answers spam calls based on the learned patterns. The display unit is implemented in the display of the smart glasses 214 and displays a risk ranking on the incoming call screen. The correspondence between each unit and the device or control unit is not limited to the example described above and can be modified in various ways.

[0131] [Third Embodiment] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0132] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0133] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN and / or LAN.

[0134] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0135] The microphone 238 receives voice signals from the user and accepts instructions from the user. The microphone 238 captures the voice signals from the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0136] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, which captures images of the area around the user (for example, an imaging range defined by a field of view equivalent to the field of vision of a typical healthy person).

[0137] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0138] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0139] The processor 28 reads a specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 acting as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0140] Storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotions using the emotion identification model 59 and perform identification processing using the user's emotions. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotions, including but not limited to these examples. Furthermore, emotion estimation and prediction also include, for example, emotion analysis.

[0141] In the headset terminal 314, specific processing is performed by the processor 46. The storage 50 stores a specific program 60. The processor 46 reads the specific program 60 from the storage 50 and executes the read specific program 60 on the RAM 48. The specific processing is realized by the processor 46 acting as a control unit 46A according to the specific program 60 executed on the RAM 48. The headset terminal 314 also has a data generation model 58 and an emotion identification model 59, similar to the data generation model and emotion identification model 59, and can perform processing similar to that of the specific processing unit 290 using these models.

[0142] Furthermore, other devices besides the data processing device 12 may also have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 obtains processing results (such as prediction results) using the data generation model 58 by communicating with the server device that has the data generation model 58. Also, the data processing device 12 may be a server device or a terminal device owned by the user (for example, a mobile phone, robot, home appliance, etc.).

[0143] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0144] The data generation model 58 is a so-called generative AI. An example of a data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and inference data such as audio data representing speech, text data representing text, and image data representing images (e.g., still image data or video data). The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference result in one or more data formats such as audio data, text data, and image data. The data generation model 58 includes, for example, text generation AI, image generation AI, and multimodal generation AI. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The specific processing unit 290 performs the specific processing described above using the data generation model 58. The data generation model 58 may be a fine-tuned model that outputs inference results from prompts that do not contain instructions, in which case the data generation model 58 can output inference results from prompts that do not contain instructions. In the data processing device 12, etc., there are multiple types of data generation models 58, and the data generation model 58 includes AI other than generative AI. AI other than generative AI includes, for example, linear regression, logistic regression, decision trees, random forests, support vector machines (SVM), k-means clustering, convolutional neural networks (CNN), recurrent neural networks (RNN), generative adversarial networks (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. Also, the AI ​​may be an AI agent. Furthermore, when the processing of each part described above is performed by the AI, the processing may be performed by the AI ​​in part or in whole, but is not limited to this example. Also, processing performed by an AI including a generative AI may be replaced by rule-based processing, and rule-based processing may be replaced by processing performed by an AI including a generative AI.

[0145] The data processing system 310 according to the third embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 310 is performed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the headset terminal 314, but may also be performed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the headset terminal 314. In addition, the specific processing unit 290 of the data processing device 12 acquires or collects information necessary for processing from the headset terminal 314 or an external device, and the headset terminal 314 acquires or collects information necessary for processing from the data processing device 12 or an external device.

[0146] Each of the multiple elements described above, including the collection unit, learning unit, response unit, and display unit, is implemented in at least one of the headset terminal 314 and the data processing unit 12. For example, the collection unit collects information on spam calls using the camera 42 and microphone 238 of the headset terminal 314 and registers it in a database by the control unit 46A. The learning unit is implemented in the identification processing unit 290 of the data processing unit 12 and learns spam call patterns based on the collected information. The response unit is implemented in the control unit 46A of the headset terminal 314 and automatically answers spam calls based on the learned patterns. The display unit is implemented in the display 343 of the headset terminal 314 and displays a risk ranking on the incoming call screen. The correspondence between each unit and the device or control unit is not limited to the example described above and can be modified in various ways.

[0147] [Fourth Embodiment] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[0148] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[0149] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN and / or LAN.

[0150] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[0151] The microphone 238 receives voice signals from the user and accepts instructions from the user. The microphone 238 captures the voice signals from the user, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0152] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS image sensor or CCD image sensor, which captures images of the area around the user (for example, an imaging range defined by a field of view equivalent to the field of vision of a typical healthy person).

[0153] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0154] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. The robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[0155] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0156] The processor 28 reads a specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 acting as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0157] Storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290. The identification processing unit 290 can estimate the user's emotions using the emotion identification model 59 and perform identification processing using the user's emotions. The emotion estimation function (emotion identification function) using the emotion identification model 59 performs various estimations and predictions regarding the user's emotions, including but not limited to these examples. Furthermore, emotion estimation and prediction also include, for example, emotion analysis.

[0158] In robot 414, specific processing is performed by processor 46. A specific program 60 is stored in storage 50. Processor 46 reads the specific program 60 from storage 50 and executes it on RAM 48. The specific processing is achieved by processor 46 acting as a control unit 46A according to the specific program 60 executed on RAM 48. Robot 414 also has data generation model 58 and emotion identification model 59, similar to those of the robot, and can perform processing similar to that of the specific processing unit 290 using these models.

[0159] Furthermore, other devices besides the data processing device 12 may also have the data generation model 58. For example, a server device may have the data generation model 58. In this case, the data processing device 12 obtains processing results (such as prediction results) using the data generation model 58 by communicating with the server device that has the data generation model 58. Also, the data processing device 12 may be a server device or a terminal device owned by the user (for example, a mobile phone, robot, home appliance, etc.).

[0160] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0161] The data generation model 58 is a so-called generative AI. An example of a data generation model 58 is a generative AI such as ChatGPT. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and inference data such as audio data representing speech, text data representing text, and image data representing images (e.g., still image data or video data). The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference result in one or more data formats such as audio data, text data, and image data. The data generation model 58 includes, for example, text generation AI, image generation AI, and multimodal generation AI. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization. The specific processing unit 290 performs the specific processing described above using the data generation model 58. The data generation model 58 may be a fine-tuned model that outputs inference results from prompts that do not contain instructions, in which case the data generation model 58 can output inference results from prompts that do not contain instructions. In the data processing device 12, etc., there are multiple types of data generation models 58, and the data generation model 58 includes AI other than generative AI. AI other than generative AI includes, for example, linear regression, logistic regression, decision trees, random forests, support vector machines (SVM), k-means clustering, convolutional neural networks (CNN), recurrent neural networks (RNN), generative adversarial networks (GAN), or naive Bayes, and can perform various processes, but is not limited to these examples. Also, the AI ​​may be an AI agent. Furthermore, when the processing of each part described above is performed by the AI, the processing may be performed by the AI ​​in part or in whole, but is not limited to this example. Also, processing performed by an AI including a generative AI may be replaced by rule-based processing, and rule-based processing may be replaced by processing performed by an AI including a generative AI.

[0162] The data processing system 410 according to the fourth embodiment performs the same processing as the data processing system 10 according to the first embodiment. The processing by the data processing system 410 is performed by the specific processing unit 290 of the data processing device 12 or the control unit 46A of the robot 414, but it may also be performed by the specific processing unit 290 of the data processing device 12 and the control unit 46A of the robot 414. In addition, the specific processing unit 290 of the data processing device 12 acquires or collects information necessary for processing from the robot 414 or an external device, and the robot 414 acquires or collects information necessary for processing from the data processing device 12 or an external device.

[0163] Each of the multiple elements described above, including the collection unit, learning unit, response unit, and display unit, is implemented in at least one of the robot 414 and the data processing unit 12. For example, the collection unit collects information on spam calls using the camera 42 and microphone 238 of the robot 414 and registers it in a database by the control unit 46A. The learning unit is implemented in the identification processing unit 290 of the data processing unit 12 and learns spam call patterns based on the collected information. The response unit is implemented in the control unit 46A of the robot 414 and automatically answers spam calls based on the learned patterns. The display unit is implemented in the display of the robot 414 and displays a danger ranking on the incoming call screen. The correspondence between each unit and the device or control unit is not limited to the example described above and can be modified in various ways.

[0164] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[0165] Figure 9 shows the emotion map 400, in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[0166] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[0167] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[0168] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, and motorcycles, emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated based, for example, on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[0169] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[0170] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[0171] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing method for the specific process may be used, which includes computer 22 and multiple other computers.

[0172] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[0173] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[0174] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[0175] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[0176] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[0177] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[0178] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[0179] Furthermore, although the above-described examples were divided into four embodiments, some or all of these embodiments may be combined. Also, the smart device 14, smart glasses 214, headset terminal 314, and robot 414 are just examples, and they may be combined, or other devices may be used. Also, although the above-described examples were divided into two embodiments, Embodiment 1 and Embodiment 2, these may be combined.

[0180] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and other things that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0181] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[0182] (Note 1) A collection department that collects information on nuisance calls, A learning unit learns patterns of nuisance calls based on the information collected by the aforementioned collection unit, A response unit that automatically responds to nuisance calls based on patterns learned by the learning unit, The system includes a display unit that displays a danger ranking on the incoming call screen based on patterns learned by the learning unit. A system characterized by the following features. (Note 2) The response unit is The system automatically answers spam calls using user-customizable response phrases. The system described in Appendix 1, characterized by the features described herein. (Note 3) The aforementioned learning unit, We update the database based on user feedback. The system described in Appendix 1, characterized by the features described herein. (Note 4) The aforementioned display unit is Specify the concrete method for visually displaying the risk ranking using color coding or icons. The system described in Appendix 1, characterized by the features described herein. (Note 5) The response unit is Includes a setting to automatically respond in high-risk situations. The system described in Appendix 1, characterized by the features described herein. (Note 6) The aforementioned learning unit, The level of risk is assessed based on the frequency and content of nuisance calls. The system described in Appendix 1, characterized by the features described herein. (Note 7) The aforementioned collection unit is This document outlines a method for estimating user emotions and specifically adjusting the timing of collecting information on spam calls based on those estimated emotions. The system described in Appendix 1, characterized by the features described herein. (Note 8) The aforementioned collection unit is When collecting information on spam calls, the system analyzes the user's past call history and selects the appropriate collection method. The system described in Appendix 1, characterized by the features described herein. (Note 9) The aforementioned collection unit is When collecting information on spam calls, filtering is performed based on the user's current location and time of day. The system described in Appendix 1, characterized by the features described herein. (Note 10) The aforementioned collection unit is This document will specify a method for estimating user sentiment and for determining the priority of spam call information to be collected based on that estimated sentiment. The system described in Appendix 1, characterized by the features described herein. (Note 11) The aforementioned collection unit is When collecting information on spam calls, the system analyzes users' social media activity to gather relevant spam call information. The system described in Appendix 1, characterized by the features described herein. (Note 12) The aforementioned collection unit is When collecting information on spam calls, the system prioritizes collecting known spam phone numbers by referring to the user's contact list. The system described in Appendix 1, characterized by the features described herein. (Note 13) The aforementioned learning unit, This document clearly outlines a method for estimating user emotions and specifically selecting training data based on those estimated emotions. The system described in Appendix 1, characterized by the features described herein. (Note 14) The aforementioned learning unit, During training, the learning algorithm is appropriately optimized by referring to past spam call data. The system described in Appendix 1, characterized by the features described herein. (Note 15) The aforementioned learning unit, During the learning process, the system learns based on attribute information of the caller of spam calls. The system described in Appendix 1, characterized by the features described herein. (Note 16) The aforementioned learning unit, This document will specify how to estimate user emotions and how to adjust the learning frequency based on those estimated emotions. The system described in Appendix 1, characterized by the features described herein. (Note 17) The aforementioned learning unit, During training, the training data is weighted based on the time of day when spam calls are made. The system described in Appendix 1, characterized by the features described herein. (Note 18) The aforementioned learning unit, During the learning process, the content of spam calls is analyzed as text, and learning is performed based on specific keywords. The system described in Appendix 1, characterized by the features described herein. (Note 19) The response unit is This document clearly outlines a method for estimating user emotions and specifically selecting response phrases based on those estimated emotions. The system described in Appendix 1, characterized by the features described herein. (Note 20) The response unit is When answering a call, the system dynamically generates a response phrase based on the content of the spam call. The system described in Appendix 1, characterized by the features described herein. (Note 21) The response unit is When answering a call, the system will respond based on the attribute information of the caller of the spam call. The system described in Appendix 1, characterized by the features described herein. (Note 22) The response unit is This document clearly outlines how to estimate user emotions and specifically determine response priorities based on those estimated emotions. The system described in Appendix 1, characterized by the features described herein. (Note 23) The response unit is When answering a call, the system selects a response phrase based on the geographical location information of the caller of the spam call. The system described in Appendix 1, characterized by the features described herein. (Note 24) The response unit is When answering a call, the system analyzes the content of the spam call as text and selects a response phrase based on specific keywords. The system described in Appendix 1, characterized by the features described herein. (Note 25) The aforementioned display unit is This document will specify how to estimate user sentiment and how to adjust the display of risk rankings based on that estimated sentiment. The system described in Appendix 1, characterized by the features described herein. (Note 26) The aforementioned display unit is When displaying the danger ranking, the display algorithm is optimized by referring to past spam call data. The system described in Appendix 1, characterized by the features described herein. (Note 27) The aforementioned display unit is When displaying the danger ranking, the ranking will be based on the attribute information of the caller of the spam call. The system described in Appendix 1, characterized by the features described herein. (Note 28) The aforementioned display unit is This document will specify a method for estimating user sentiment and for specifically determining the priority of risk rankings based on that estimated sentiment. The system described in Appendix 1, characterized by the features described herein. (Note 29) The aforementioned display unit is When displaying the danger ranking, the displayed data is weighted based on the time of day the spam call was made. The system described in Appendix 1, characterized by the features described herein. (Note 30) The aforementioned display unit is When displaying the danger ranking, the content of spam calls is analyzed as text and displayed based on specific keywords. The system described in Appendix 1, characterized by the features described herein. [Explanation of Symbols]

[0183] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots

Claims

1. A collection department that collects information on nuisance calls, Based on the information collected by the collection unit, a learning unit analyzes the content of the spam calls as text and learns patterns of spam calls based on specific keywords. A response unit that automatically responds to nuisance calls based on patterns learned by the learning unit, The system includes a display unit that displays a danger ranking on the incoming call screen based on patterns learned by the learning unit, The aforementioned collection unit is The system uses a generative AI or emotion engine to estimate the user's emotions, and based on these estimates, it adjusts the timing of information collection: if the user is estimated to be stressed, it delays the collection of information about spam calls; if the user is estimated to be relaxed, it immediately collects the information about spam calls. A system characterized by the following features.

2. The response unit is The system automatically answers spam calls using user-customizable response phrases. The system according to feature 1.

3. The aforementioned learning unit, As user feedback, we collect ratings or comments that users have made about spam calls, and update the database based on those ratings or comments. The system according to feature 1.

4. The aforementioned display unit is The risk level ranking is visually displayed using red, yellow, and green color coding or warning icons. The system according to feature 1.

5. The response unit is Includes a setting to automatically respond in high-risk situations. The system according to feature 1.

6. The aforementioned learning unit, The level of risk is assessed based on the frequency and content of nuisance calls. The system according to feature 1.

7. The aforementioned collection unit is When collecting information on spam calls, the system analyzes the user's past call history and prioritizes collecting calls that have a similar pattern to spam calls the user has received in the past. The system according to feature 1.

8. The aforementioned collection unit is When collecting information on spam calls, filtering is performed to prioritize the collection of information on spam calls that are frequently occurring in the user's area or time zone, based on the user's current location and time of day. The system according to feature 1.

9. The aforementioned collection unit is Furthermore, the system estimates the user's emotions and, based on these estimates, determines the priority of the spam call information to collect. If the user is estimated to be stressed, it prioritizes collecting less important spam call information. If the user is estimated to be in a hurry, it prioritizes collecting more important spam call information. The system according to feature 1.

Images