system
The communication device addresses unstable communication environments by automatically selecting relay devices and optimizing paths with AI, ensuring stable and efficient data transmission.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- SOFTBANK GROUP CORP
- Filing Date
- 2024-12-04
- Publication Date
- 2026-06-16
AI Technical Summary
In areas with unstable communication environments, users face issues such as interrupted communication and reduced network performance due to weak or unstable radio waves, necessitating alternative means for stable data communication.
A communication device that measures its own signal strength and connection stability, detects nearby devices using Bluetooth or Wi-Fi, selects an optimal relay device, and optimizes communication paths with a server using artificial intelligence to ensure stable communication, while compensating relay device providers.
Enables stable and efficient data communication in unstable environments by automatically selecting relay devices and optimizing communication paths, improving user experience and network performance.
Smart Images

Figure 2026097225000001_ABST
Abstract
Description
Technical Field
[0001] The technology of the present disclosure relates to a system.
Background Art
[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.
Prior Art Documents
Patent Documents
[0003]
Patent Document 1
Summary of the Invention
Problems to be Solved by the Invention
[0004] In areas or buildings with unstable communication environments, users often face problems such as interrupted communication or delays due to weak or unstable radio waves. In such environments, it is difficult to ensure sufficient network performance with conventional communication means, and alternative means for smooth data communication are required. Therefore, it is an issue to provide stable communication by improving communication quality using the surrounding communication environment.
Means for Solving the Problems
[0005] This invention enables a communication device to automatically measure its own signal strength and connection stability, and to detect other nearby communication devices using Bluetooth or Wi-Fi. From the detected other communication devices, it selects the most appropriate relay device based on communication quality, sends a connection request to the selected relay device, and borrows communication resources. Furthermore, by providing a system in which a server optimizes the communication path to efficiently transmit data, calculates the costs incurred by the user, and distributes compensation to the relay device provider, it enables stable communication even in unstable communication environments.
[0006] A "communication device" is a device that has the function of measuring radio wave strength and connection stability, detects other communication devices in the surrounding area, and transmits and receives data.
[0007] "Radio wave strength" is an indicator that shows the strength of radio waves received by a communication device, and is used to understand the state of the communication environment.
[0008] "Connection stability" refers to a characteristic that indicates the state in which communication devices can continuously and uninterruptedly send and receive data, and is a criterion for evaluating network quality.
[0009] A "relay device" is a device that accepts connection requests from other communication devices and provides communication resources, forming part of the communication path.
[0010] A "server" is a computing system that optimizes data communication and manages efficient data transmission.
[0011] "Optimization of communication paths" is the process of setting up and managing communication paths so that data can reach its destination in the most efficient and rapid way possible.
[0012] "Artificial intelligence" refers to a computer system or software that has the ability to learn from experience and automatically improve tasks, and in this system, it is used to optimize communication paths.
[0013] "Fees" refer to charges imposed on users who utilize communication improvement services, and are calculated as compensation for the use of relay equipment.
[0014] "Reward distribution" is the process of paying a portion of the incurred costs to users who provided relay equipment, and is compensation for the resources provided. [Brief explanation of the drawing]
[0015] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when combined with an emotion engine. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when combined with an emotion engine.
Mode for Carrying Out the Invention
[0016] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described with reference to the accompanying drawings.
[0017] First, the terms used in the following description will be explained.
[0018] In the following embodiments, a processor with a reference numeral (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.
[0019] In the following embodiments, a RAM (Random Access Memory) with a reference numeral is a memory in which information is temporarily stored and is used as a work memory by the processor.
[0020] In the following embodiments, a storage with a reference numeral is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, and the like.
[0021] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).
[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."
[0023] [First Embodiment]
[0024] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.
[0025] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0026] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0027] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.
[0028] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0030] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.
[0031] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0032] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.
[0033] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0034] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0035] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0036] The system of the present invention has a configuration in which multiple communication devices optimally utilize each other's resources in order to provide stable data communication in situations where the communication environment is unstable. The specific program processing and embodiments thereof are described below.
[0037] First, the communication device (hereinafter referred to as "terminal") constantly monitors its own signal strength and connection stability, and detects other nearby terminals using Bluetooth or Wi-Fi as needed. For example, if a user is inside a building and the signal strength is unstable, the user's terminal scans for other nearby terminals and identifies one with a good signal strength.
[0038] Next, the terminal selects the candidate with the most stable communication from among the detected terminals and prepares to use this terminal as a relay device. In the selection process, factors such as the signal strength and battery level of the other terminal are taken into consideration. Since the user's terminal performs this process automatically, the user can maintain communication quality without any special operation.
[0039] Subsequently, the user's terminal sends a connection request to a relay device selected by the user. After the necessary authentication procedures are completed between both terminals, the user's terminal borrows the communication resources of the relay device to connect to the internet. For example, user A's terminal can achieve stable data communication by using user B's terminal, which has good signal strength, as a relay device.
[0040] In addition, the server plays a role in optimizing the communication path across the entire network. Using artificial intelligence, the server analyzes the location information and communication history of connected devices to ensure the most efficient data flow. This improves the overall system performance, allowing users to enjoy a smoother communication experience.
[0041] Finally, if the communication improvement is successful, the server automatically calculates the cost charged to the user, and compensation is distributed to the relay equipment provider according to the resources used. This mechanism provides an incentive for users who provide relay equipment to receive compensation for their service.
[0042] The above describes a specific embodiment for implementing the present invention, a system in which users can automatically improve their communication environment while simultaneously obtaining mutual benefits.
[0043] The following describes the processing flow.
[0044] Step 1:
[0045] The device measures its own signal strength. The device continuously acquires signal strength data, and if it falls below a threshold, it determines that the signal is unstable and searches for ways to improve it.
[0046] Step 2:
[0047] The device detects surrounding communication devices. The device activates Bluetooth and Wi-Fi and scans for nearby, connectable devices. At this point, the device records the MAC address and signal strength of the detected devices.
[0048] Step 3:
[0049] The terminal selects an appropriate relay device. From the detected communication devices, the terminal selects the one with the best radio signal strength and sufficient battery power as the relay device. The selection criteria include multiple evaluation indicators.
[0050] Step 4:
[0051] The terminal sends a connection request to the selected relay device. During the connection to the selected relay device, a mutual authentication process is performed between the terminals to confirm that a secure connection is established.
[0052] Step 5:
[0053] The server optimizes communication. Based on information from connected terminals, the server uses AI to optimize the data path, supporting the shortest and most efficient data transmission.
[0054] Step 6:
[0055] Users are charged a fee, and the rewards are distributed to the users of the relay equipment. Once the server confirms the improvement in communication, it bills the user for the fee and pays the reward to the user who provided the relay equipment.
[0056] (Example 1)
[0057] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0058] Technical means are needed to provide stable data communication even in unstable communication environments. In particular, improving the continuity and quality of communication in environments where wireless communication is easily interrupted is a challenge. Furthermore, it is important to improve overall communication performance by efficiently utilizing communication resources and optimizing communication paths. In addition, there is a need for fair distribution of compensation for the communication resources provided.
[0059] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0060] In this invention, the server includes means for the communication terminal to continuously monitor radio wave strength and connection stability, means for the communication terminal to detect other surrounding communication terminals using wireless communication technology, and means for the communication terminal to evaluate the stability of communication from the detection results and select the optimal relay terminal. This enables stable data communication even in situations where the communication environment is unstable.
[0061] A "communication terminal" is an electronic device used to send and receive data using radio waves.
[0062] "Radio wave strength" is an indicator that shows the strength of the signal received by a communication terminal.
[0063] "Connection stability" refers to the degree to which a communication terminal can maintain communication without interruption.
[0064] "Wireless communication technology" refers to all technologies that use radio waves to send and receive data.
[0065] A "relay terminal" is a terminal that plays a role in assisting other communication terminals with sending and receiving data.
[0066] A "data network management device" is a device that manages and optimizes communication paths and data flow within a network.
[0067] "Communication resources" refers to resources such as bandwidth and processing power that are necessary for data communication.
[0068] The system of this invention provides stable data communication even in unstable communication conditions by using multiple communication terminals and a data network management device (server). The communication terminals continuously monitor radio wave strength and connection stability and detect other nearby communication terminals using wireless communication technologies such as Bluetooth and Wi-Fi. Based on the detected terminal information, the terminals automatically select relay terminals and secure an appropriate communication path.
[0069] The server optimizes the communication path across the entire network, ensuring efficient data flow. Specifically, it uses machine learning models to analyze terminal location information and communication history, proposing the most efficient data transmission route. This allows users to automatically enjoy the optimal communication environment without complex operations. The server also monitors the usage of resources required for communication and distributes compensation to providers of relay terminals based on usage.
[0070] As a concrete example of its use, consider a situation where a user is in an underground parking lot and experiences unstable internet connectivity due to weak signal strength. In such a situation, the user's device can automatically scan for other devices in the vicinity and select a device with a good signal strength to use as a relay device. As a result, the user can achieve stable communication.
[0071] As an example of a prompt to the generating AI model to verify the operation of this system, the following text can be used: "I would like to know how to detect surrounding communication terminals and select the most stable relay device. Please explain the specific process."
[0072] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0073] Step 1:
[0074] Status monitoring and detection by terminals
[0075] The device frequently monitors its own signal strength and connection stability. Inputs include current signal strength and connection status, while output is a determination of whether the stability falls below a certain threshold. Specifically, it analyzes real-time data using a signal strength sensor and communication logs, and if the signal strength falls below the threshold, it immediately uses wireless communication technology to scan for other nearby communication devices.
[0076] Step 2:
[0077] Detection and listing of peripheral devices
[0078] The terminal uses wireless communication technology (Bluetooth or WiFi) to detect other terminals in its vicinity. The input for this step is the monitoring result obtained in the previous step, and the output is a list of the detected other terminals. Specifically, the terminal scans for surrounding signals and stores the ID and signal strength of all corresponding terminals in temporary memory.
[0079] Step 3:
[0080] Selection of the optimal relay terminal
[0081] The terminal selects the optimal relay terminal based on signal strength and battery level from the list created in the previous step. The input is the list of detected terminals, and the output is the selected relay terminal. The terminal calculates an evaluation score for each terminal using a proprietary algorithm and performs the specific action of selecting the terminal with the highest score.
[0082] Step 4:
[0083] Connection request and authentication procedure for relay terminals
[0084] The user's terminal sends a connection request to a selected relay terminal and performs the necessary authentication procedures. The input is information about the selected relay terminal, and the output is whether or not the connection is permitted. Specifically, encrypted messages are exchanged between the terminals to complete bidirectional authentication.
[0085] Step 5:
[0086] Internet connection and data communication
[0087] The user's terminal connects to the internet via a relay terminal and performs normal data communication. The input is a confirmation of a successful connection, and the output is a state of stable data communication. It performs specific actions such as sending and receiving packets, continuously monitoring delays and errors, and making adjustments as needed.
[0088] Step 6:
[0089] Server-based optimization of communication paths
[0090] The server collects information from connected devices and uses artificial intelligence to calculate the optimal communication path. The input is location information and communication history transmitted from the devices, and the output is a proposed optimized communication path. The server performs real-time processing using machine learning models to improve the efficiency of data transmission.
[0091] (Application Example 1)
[0092] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."
[0093] In smart cities, a wide variety of electronic devices exist, and stable communication is essential for infrastructure management and user services. However, if the communication environment becomes unstable, user convenience will decrease, and efficient urban management may be hindered. Therefore, stable data transmission and efficient selection of communication routes, even in unstable communication conditions, are required.
[0094] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0095] In this invention, the server includes means for measuring signal strength and connection stability of a device having communication capabilities, means for detecting other devices having communication capabilities in the vicinity, and means for selecting an appropriate relay device. This makes it possible to automatically optimize the communication environment in public places in smart cities.
[0096] A "device with communication capabilities" is a device that has the ability to send and receive signals.
[0097] "Signal strength" is an indicator that shows the strength of radio waves or signals in communications, and is a fundamental element for judging the quality of communications.
[0098] "Connection stability" is an indicator that shows the state in which communication can be performed continuously without interruption, and it is an important factor in evaluating the reliability of communication.
[0099] "Other devices with communication capabilities in the vicinity" refers to other electronic devices that are located in close proximity to a particular electronic device and possess communication capabilities.
[0100] A "relay device" is a device that receives communication data and then forwards that data to another location.
[0101] A "data processing device" is an electronic system capable of performing calculations, analyses, and optimizations of data, and contributes to the efficient management of information.
[0102] A "communication path" refers to all the physical or logical routes that data takes when it is sent and received, and is an essential element for efficient information transmission.
[0103] A "smart city" is a city that aims to improve the quality of life for its residents by using information technology to streamline urban infrastructure and services.
[0104] A "public place" refers to an open space that can be freely used by the general public, and is an area shared within a city.
[0105] "Location information" refers to data that indicates the geographical location of a specific device or user, and is used to provide location-based services.
[0106] "Connection history" refers to a record of connections made by a device in the past, and is used to analyze communication trends and efficiency.
[0107] The system implementing this invention is designed to optimize the communication environment in smart cities and achieve stable data transmission. The hardware primarily used includes devices with communication capabilities (e.g., smartphones) and data processing devices (e.g., cloud servers).
[0108] The terminal uses its built-in communication module (Bluetooth or WiFi) to detect other communication-enabled devices in the vicinity. It continuously monitors the signal strength and connection stability of the detected devices and automatically selects the optimal relay device. It also sends a connection request to the selected relay device and borrows its communication resources. This process is performed without requiring any special action from the user.
[0109] The server uses machine learning algorithms to analyze received location information and connection history to optimize the data transmission path. This data processing automatically selects the most efficient and stable communication path, providing a comfortable overall communication environment. The server also automatically calculates the costs incurred during the communication stabilization process and distributes compensation to the providers of participating devices.
[0110] For example, if a user is in a crowded event venue, this system causes surrounding devices to act as relay devices. As a result, the user can watch high-definition live video with no delay.
[0111] An example of a prompt statement used as input to a generative AI model is as follows: "Design an optimal inter-device communication management system to ensure stable communication in smart cities, and describe its specific application."
[0112] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0113] Step 1:
[0114] The device detects other communication-enabled devices in its vicinity using Bluetooth or Wi-Fi. The device's wireless communication module is used as input, and a list of detected devices is output. Specifically, it scans surrounding devices at regular intervals, collecting data on signal strength and device ID.
[0115] Step 2:
[0116] From the devices detected by the terminal, the optimal relay device is selected based on signal strength and connection stability. The device list obtained in step 1 is used as input, and the ID of the optimal relay device is output. In this step, an algorithm is executed that evaluates the signal strength of each device and selects the device with the most stability.
[0117] Step 3:
[0118] The terminal sends a connection request to a selected relay device, and after approval, borrows the communication resources of that device. The inputs are the relay device's ID and the terminal's connection information, and the success or failure of the connection is output. Specifically, a security-conscious authentication process is performed, and the connection is established.
[0119] Step 4:
[0120] The server analyzes location information and connection history transmitted from terminals to optimize communication paths between terminals. It requires terminal location information and connection history data as input, and outputs optimized path information. Specific operations include calculating efficient data flow ranges using machine learning algorithms.
[0121] Step 5:
[0122] The server calculates the costs incurred by users who received optimized communication and distributes the rewards to the providers of relay equipment. Inputs include communication usage and user information, and the calculated cost and reward details are output. Specifically, processing is performed based on a defined fee structure.
[0123] Step 6:
[0124] Users will experience improved communication within the smart city and enhanced engagement. The output will be more stable communication and a resulting smoother service experience. Specific actions include real-time display of communication status and provision of improvement notifications.
[0125] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0126] This invention provides a system that, in addition to conventional communication optimization methods, recognizes user emotions and adaptively adjusts the communication environment based on that information to provide stable data communication even in unstable communication situations. The specific program processing and embodiments are shown below.
[0127] First, the device measures signal strength and connection stability, and detects surrounding devices via Bluetooth and Wi-Fi to understand the communication environment. At this time, the device receives voice input, and the emotion engine analyzes the user's emotions. For example, if the user speaks in an irritated tone, the emotion is analyzed as unpleasant, and it is determined that further improvement of communication is urgently needed.
[0128] Next, the terminal selects the optimal relay device from surrounding terminals and borrows communication resources after mutual authentication. User sentiment analysis data is used as supplementary information to improve communication quality during this selection process.
[0129] The server analyzes data collected from each terminal and emotional data from the emotion engine to optimize the communication path. Using AI, the server prioritizes a fast and stable path, especially when a user expresses unpleasant emotions. This process enables network adjustments based on emotions.
[0130] After the communication is restored to normal, the server charges the user an appropriate fee, taking into account the improvement costs that reflect the information from the emotion engine. Subsequently, rewards are distributed to the users who provided the relay equipment. This reward system serves as an incentive for users to be more willing to provide relay equipment.
[0131] This embodiment of the invention makes it possible to understand the user's emotional state and optimize the communication environment accordingly. In particular, it provides a new approach to improving the user's actual experience by utilizing emotional data.
[0132] The following describes the processing flow.
[0133] Step 1:
[0134] The device measures its own signal strength. Specifically, the device analyzes signal strength and connection stability using sensors, and if the results fall below a certain threshold, it initiates a process to improve communication.
[0135] Step 2:
[0136] The device searches for nearby devices capable of communicating. Using Bluetooth and Wi-Fi, it scans for nearby devices and adds their information to a list. In this step, the MAC address and signal strength of each device are recorded.
[0137] Step 3:
[0138] The emotion engine analyzes the user's emotions through voice input. A microphone built into the device captures the user's voice, and when anger, frustration, or other emotions are detected, the emotion engine analyzes the data to understand the situation.
[0139] Step 4:
[0140] The terminal selects the most appropriate relay device. Based on information from surrounding terminals, a terminal with good communication status and sufficient power is selected. Sentimental data may also be considered.
[0141] Step 5:
[0142] The terminal sends a connection request to the selected relay device and performs mutual authentication. If authentication is successful, an environment for secure data exchange is established and resource borrowing begins.
[0143] Step 6:
[0144] The server optimizes the communication path. AI analyzes communication data and emotional data collected from the terminal to select (or adjust) the optimal path to improve user satisfaction.
[0145] Step 7:
[0146] Once the communication stabilizes, the user will be charged for the improvement. The server confirms the communication improvement, automatically calculates the cost reflecting the sentiment analysis results, and notifies the user.
[0147] Step 8:
[0148] Rewards are distributed to users who provide relay devices. The server distributes rewards to providers based on the communication resources used, clearly indicating the benefits received for their services.
[0149] (Example 2)
[0150] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".
[0151] In situations with unstable communication environments, users experience stress due to reduced data flow, making it difficult to enjoy a comfortable communication experience. Furthermore, conventional communication optimization methods cannot adjust the communication environment while considering the user's emotional state, and therefore, improvements in the user experience have not been fully achieved.
[0152] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0153] In this invention, the server includes means for the communication terminal to analyze the user's emotions using voice input, means for the server to adjust the communication path according to the user's emotions using artificial intelligence, and means for optimizing data transmission using a generative AI model. This makes it possible to provide a flexible and optimal communication environment that responds to the user's emotional state.
[0154] A "communication terminal" is a device used by users to send and receive data, and is capable of measuring radio wave strength and connection stability, as well as detecting surrounding terminals.
[0155] A "relay device" is a device that plays a relaying role in a communication path in order to effectively transmit data and communication signals.
[0156] "Communication resources" is a general term for the resources necessary for communication, such as bandwidth and signal spectrum required for data transmission.
[0157] A "server" is a computing device that receives data from communication terminals via a network, processes and analyzes it, and directs the optimal communication path.
[0158] Artificial intelligence is a technology that uses algorithms and learning models to perform processing that mimics human intelligence in order to quickly analyze data and make decisions.
[0159] A "generative AI model" is a machine learning model used for data generation and prediction, and is particularly a model that creates new data by utilizing trained knowledge.
[0160] "Wireless communication technology" refers to all technologies that transmit data using radio waves without requiring physical connections such as cables.
[0161] "Voice input" is a method in which a device receives voice input from a user and digitally processes that information.
[0162] "Emotional analysis" is an analytical technique that uses collected audio data and other information to identify a user's emotional state based on the tone and content of their voice.
[0163] "Reward distribution" is the process of distributing rewards to relay equipment providers who have contributed to providing resources for the communication network, based on their usage.
[0164] This invention includes a system for providing users with comfortable data communication even in unstable communication environments. This system is composed of a communication terminal, a server, and relay equipment.
[0165] Functions of a communication terminal
[0166] The communication terminal uses built-in sensors to measure signal strength and connection stability. Based on this data, the terminal uses wireless communication technologies such as Bluetooth and Wi-Fi to detect other nearby terminals and create a list of potential relay devices.
[0167] The communication terminal captures the user's voice using its voice input function and analyzes their emotions through an emotion analysis engine. Specifically, "natural language processing" and "machine learning algorithms" can be used for emotion analysis. The results of this analysis are used as important input data for optimizing communication.
[0168] Server Functions
[0169] The server comprehensively analyzes communication data and sentiment analysis data transmitted from each terminal. Using generative AI models (e.g., models using TENSORFLOW® or PyTorch), it sets the optimal communication path according to the user's emotional state. Through AI analysis and optimization techniques, it prioritizes high-speed and stable communication, especially when the user is expressing unpleasant emotions.
[0170] Furthermore, after the communication is successfully provided, the server calculates the communication costs incurred and bills the user. Appropriate compensation is distributed to other users who provided relay equipment. This compensation serves as an incentive to encourage cooperation from other users and improve the overall efficiency of the network.
[0171] Specific example
[0172] For example, if a user complains in a cafe that "the internet is too slow to work," a terminal that detects this complaint will send back an analysis result indicating "discomfort." Based on this data, the server will select a nearby, powerful relay device and set up the optimal communication path.
[0173] Example of a prompt
[0174] "If a user is dissatisfied with their experience at a cafe, please explain how the device can provide an optimal communication environment. Please also mention specific methods and technologies used."
[0175] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0176] Step 1:
[0177] The terminal uses a built-in signal sensor to measure current signal strength and connection stability. The input data consists of real-time measurements of ambient signal strength and connection stability, while the output is communication environment evaluation data. By processing this data, the current communication status can be quantified and understood.
[0178] Step 2:
[0179] The device uses Bluetooth and Wi-Fi to detect nearby communication devices. It collects the MAC addresses and signal strength information of the detected devices as data input and creates a list of potential relay devices as output. This identifies available relay devices. The detected devices are listed and used for the selection process in the next step.
[0180] Step 3:
[0181] The device acquires the user's voice input through the microphone and sends it to the emotion analysis engine. The voice data becomes the input, and as a result of the processing, the user's emotional state is output. Here, the AI model performs emotion analysis based on the tone and content of the voice and obtains evaluation results such as "unpleasant" or "normal".
[0182] Step 4:
[0183] The terminal selects the optimal relay device based on a list of candidate relay devices and the results of sentiment analysis. Signal strength, distance, and sentiment evaluation are inputs, and the output is the selected relay device. Using Bluetooth communication, mutual authentication is performed with the selected relay device, and communication resources are borrowed. At this stage, aggregated data processing is performed according to the selection criteria.
[0184] Step 5:
[0185] The server receives environmental and emotional data from terminals and sets the optimal communication path. Data input consists of communication status data and emotional evaluations collected from each terminal, while output is the optimized communication path. A generative AI model is used to perform data analysis and path optimization, establishing high-priority communications.
[0186] Step 6:
[0187] The server calculates communication costs after confirming stable communication. It also bills users appropriately and rewards other users who provided relay equipment. Inputs to the process include communication usage and improvement factors based on sentiment, while outputs are billing cost and reward data. Rewards are processed by an aggregation and distribution algorithm on the server side.
[0188] (Application Example 2)
[0189] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".
[0190] The present invention aims to achieve stable data communication even in environments with unstable communication, improve communication quality based on user emotions, and enhance the user experience. Furthermore, it aims to provide a comfortable living environment by utilizing user emotions in the control of home appliances.
[0191] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0192] In this invention, the server includes means for the communication device to analyze the user's emotions, means for prioritizing an appropriate communication path to improve communication quality based on the emotion data, and means for the wearable device to perform environmental control via the emotion data. This enables optimal communication and environmental control in accordance with the user's emotions.
[0193] A "communication device" is a device that can measure radio wave strength and evaluate connection stability.
[0194] A "relay device" is an auxiliary device used to effectively transfer data between communication devices.
[0195] "User emotions" refers to data that describes the user's psychological state, obtained through voice analysis.
[0196] "Emotional data" refers to information obtained by analyzing a user's emotions.
[0197] "Communication path" refers to the network route that data takes when it is transmitted.
[0198] A "wearable device" is a device that a user can wear to receive instructions for environmental control.
[0199] "Environmental control" refers to the act of adjusting home appliances and surrounding environmental settings in accordance with the user's emotional data.
[0200] "Data transmission" refers to the act of transferring information over a network.
[0201] "Emotion analysis" is the process of identifying a user's emotions from voice and other inputs.
[0202] This invention provides a system that allows users to maintain a comfortable communication environment while simultaneously adaptively controlling the surrounding environment based on emotional data. The server provides a foundation for communication and environmental control through cooperation with multiple communication devices and wearable devices.
[0203] First, the terminal functions as a communication device, measuring signal strength and connection stability using Wi-Fi and Bluetooth. When the user speaks, the audio data is converted into text using speech recognition software (e.g., Google® Speech-to-Text API). The converted text is then analyzed using sentiment analysis software (e.g., IBM Watson® Tone Analyzer) to analyze the user's emotions and generate sentiment data.
[0204] The server comprehensively analyzes emotional data and communication quality information. Utilizing artificial intelligence, it selects the optimal communication path based on the user's emotions, ensuring high-speed and stable data transmission. For example, if the analysis indicates a user is experiencing stress, the server immediately optimizes the communication path to improve the user experience.
[0205] Furthermore, the wearable device controls home appliances based on analyzed emotional data. Specifically, it provides a comfortable living environment by adjusting lighting and music according to the user's emotions.
[0206] This system allows users to receive personalized communication and environmental adjustments tailored to their individual emotional states, improving comfort and convenience. Generative AI models can also be used to predict the most suitable environmental settings for a user's emotions.
[0207] For example, if a user says "I'm a little cold," and the analyzed emotion is "uncomfortable," the wearable device will instantly adjust the heating and play relaxing music. To realize such a scenario, the following prompt might be input to the generative AI model: "If the user finds it too loud, consider how the sound settings should be improved."
[0208] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0209] Step 1:
[0210] The device uses Wi-Fi and Bluetooth functionality to measure ambient radio wave strength and connection stability. The input is the surrounding wireless signal, and the output is data on the signal's strength and stability. This allows for understanding the current connection status.
[0211] Step 2:
[0212] When a user speaks, the device collects the audio data and converts it into text data using speech recognition software (e.g., Google Speech-to-Text API). The input is the user's voice, and the output is text data. This text data is used for analyzing the user's sentiment.
[0213] Step 3:
[0214] The collected text data is analyzed using sentiment analysis software (e.g., IBM Watson Tone Analyzer) to obtain user sentiment data. The input is the text data obtained in step 2, and the output is sentiment data. This process clarifies the user's psychological state.
[0215] Step 4:
[0216] The server receives emotion data and connection status data transmitted from the terminal and selects the optimal communication path. The input is emotion data and connection status data, and the output is the selected communication path. Artificial intelligence is used to comprehensively analyze this data to achieve high-speed and stable communication.
[0217] Step 5:
[0218] The server uses a generative AI model to instruct the wearable device to configure the optimal environment settings based on the user's emotions. The input is emotion data, and the output is specific instructions for environment settings. The wearable device controls home appliances based on these instructions to improve the user's comfort.
[0219] Step 6:
[0220] Users send feedback on changes they perceive, and the system uses this feedback to adjust the environment in the future. The input is user feedback, and the output is adjustments to the environment control within the system. This allows for more personalized responses.
[0221] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0222] Data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0223] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.
[0224] [Second Embodiment]
[0225] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.
[0226] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0227] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0228] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.
[0229] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0230] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0231] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0232] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0233] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0234] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0235] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0236] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0237] The system of the present invention has a configuration in which multiple communication devices optimally utilize each other's resources in order to provide stable data communication in situations where the communication environment is unstable. The specific program processing and embodiments thereof are described below.
[0238] First, the communication device (hereinafter referred to as "terminal") constantly monitors its own signal strength and connection stability, and detects other nearby terminals using Bluetooth or Wi-Fi as needed. For example, if a user is inside a building and the signal strength is unstable, the user's terminal scans for other nearby terminals and identifies one with a good signal strength.
[0239] Next, the terminal selects the candidate with the most stable communication from among the detected terminals and prepares to use this terminal as a relay device. In the selection process, factors such as the signal strength and battery level of the other terminal are taken into consideration. Since the user's terminal performs this process automatically, the user can maintain communication quality without any special operation.
[0240] Subsequently, the user's terminal sends a connection request to a relay device selected by the user. After the necessary authentication procedures are completed between both terminals, the user's terminal borrows the communication resources of the relay device to connect to the internet. For example, user A's terminal can achieve stable data communication by using user B's terminal, which has good signal strength, as a relay device.
[0241] In addition, the server plays a role in optimizing the communication path across the entire network. Using artificial intelligence, the server analyzes the location information and communication history of connected devices to ensure the most efficient data flow. This improves the overall system performance, allowing users to enjoy a smoother communication experience.
[0242] Finally, if the communication improvement is successful, the server automatically calculates the cost charged to the user, and compensation is distributed to the relay equipment provider according to the resources used. This mechanism provides an incentive for users who provide relay equipment to receive compensation for their service.
[0243] The above describes a specific embodiment for implementing the present invention, a system in which users can automatically improve their communication environment while simultaneously obtaining mutual benefits.
[0244] The following describes the processing flow.
[0245] Step 1:
[0246] The device measures its own signal strength. The device continuously acquires signal strength data, and if it falls below a threshold, it determines that the signal is unstable and searches for ways to improve it.
[0247] Step 2:
[0248] The device detects surrounding communication devices. The device activates Bluetooth and Wi-Fi and scans for nearby, connectable devices. At this point, the device records the MAC address and signal strength of the detected devices.
[0249] Step 3:
[0250] The terminal selects an appropriate relay device. From the detected communication devices, the terminal selects the one with the best radio signal strength and sufficient battery power as the relay device. The selection criteria include multiple evaluation indicators.
[0251] Step 4:
[0252] The terminal sends a connection request to the selected relay device. During the connection to the selected relay device, a mutual authentication process is performed between the terminals to confirm that a secure connection is established.
[0253] Step 5:
[0254] The server optimizes communication. Based on information from connected terminals, the server uses AI to optimize the data path, supporting the shortest and most efficient data transmission.
[0255] Step 6:
[0256] Users are charged a fee, and the rewards are distributed to the users of the relay equipment. Once the server confirms the improvement in communication, it bills the user for the fee and pays the reward to the user who provided the relay equipment.
[0257] (Example 1)
[0258] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0259] Technical means are needed to provide stable data communication even in unstable communication environments. In particular, improving the continuity and quality of communication in environments where wireless communication is easily interrupted is a challenge. Furthermore, it is important to improve overall communication performance by efficiently utilizing communication resources and optimizing communication paths. In addition, there is a need for fair distribution of compensation for the communication resources provided.
[0260] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0261] In this invention, the server includes means for the communication terminal to continuously monitor radio wave strength and connection stability, means for the communication terminal to detect other surrounding communication terminals using wireless communication technology, and means for the communication terminal to evaluate the stability of communication from the detection results and select the optimal relay terminal. This enables stable data communication even in situations where the communication environment is unstable.
[0262] A "communication terminal" is an electronic device used to send and receive data using radio waves.
[0263] "Radio wave strength" is an indicator that shows the strength of the signal received by a communication terminal.
[0264] "Connection stability" refers to the degree to which a communication terminal can maintain communication without interruption.
[0265] "Wireless communication technology" refers to all technologies that use radio waves to send and receive data.
[0266] A "relay terminal" is a terminal that plays a role in assisting other communication terminals with sending and receiving data.
[0267] A "data network management device" is a device that manages and optimizes communication paths and data flow within a network.
[0268] "Communication resources" refers to resources such as bandwidth and processing power that are necessary for data communication.
[0269] The system of this invention provides stable data communication even in unstable communication conditions by using multiple communication terminals and a data network management device (server). The communication terminals continuously monitor radio wave strength and connection stability and detect other nearby communication terminals using wireless communication technologies such as Bluetooth and Wi-Fi. Based on the detected terminal information, the terminals automatically select relay terminals and secure an appropriate communication path.
[0270] The server optimizes the communication path across the entire network, ensuring efficient data flow. Specifically, it uses machine learning models to analyze terminal location information and communication history, proposing the most efficient data transmission route. This allows users to automatically enjoy the optimal communication environment without complex operations. The server also monitors the usage of resources required for communication and distributes compensation to providers of relay terminals based on usage.
[0271] As a concrete example of its use, consider a situation where a user is in an underground parking lot and experiences unstable internet connectivity due to weak signal strength. In such a situation, the user's device can automatically scan for other devices in the vicinity and select a device with a good signal strength to use as a relay device. As a result, the user can achieve stable communication.
[0272] As an example of a prompt to the generating AI model to verify the operation of this system, the following text can be used: "I would like to know how to detect surrounding communication terminals and select the most stable relay device. Please explain the specific process."
[0273] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0274] Step 1:
[0275] Situation Monitoring and Detection by Terminal
[0276] The terminal frequently monitors the intensity of its own radio waves and the stability of the connection. The inputs are the current radio wave intensity and connection status, and the output is the determination result of whether the stability is below the standard. Specifically, real-time data is analyzed using a radio wave intensity sensor and communication logs. When the reference value is exceeded, an operation is immediately performed to scan other surrounding communication terminals using wireless communication technology.
[0277] Step 2:
[0278] Detection and Listing of Peripheral Terminals
[0279] The terminal uses wireless communication technology (Bluetooth or WiFi) to detect other surrounding terminals. The input for this step is the monitoring result obtained in the previous step, and the output is a list of the detected other terminals. As a specific operation, the terminal scans the surrounding signals and temporarily stores the IDs and signal strengths of all corresponding terminals in the temporary memory.
[0280] Step 3:
[0281] Selection of the Optimal Relay Terminal
[0282] The terminal selects the optimal relay terminal based on the signal strength and battery level from the list created in the previous step. The input is the list of detected terminals, and the output is the selected relay terminal. A specific operation is performed to calculate the evaluation score of each terminal using its own algorithm and select the terminal with the highest score.
[0283] Step 4:
[0284] Connection Request and Authentication Procedure to the Relay Terminal
[0285] Send a connection request to the selected relay terminal from the user's terminal and perform the necessary authentication procedures. The input is the information of the selected relay terminal, and the output is whether connection permission is obtained. Specifically, perform an operation to exchange encrypted messages between terminals and complete two-way authentication.
[0286] Step 5:
[0287] Perform Internet connection and data communication
[0288] The user's terminal connects to the Internet via the relay terminal and performs normal data communication. The input is the confirmation of a successful connection, and the output is a stable data communication state. Perform specific operations such as packet transmission and reception, continuously monitor delays and errors, and adjust as necessary.
[0289] Step 6:
[0290] Optimization of the communication path by the server
[0291] The server collects information on the connected terminals and calculates the optimal communication path using artificial intelligence. The input is the location information and communication history transmitted from the terminals, and the output is a proposal for the optimized communication path. The server performs an operation to perform real-time processing to improve the efficiency of data transmission using a machine learning model.
[0292] (Application Example 1)
[0293] Next, Application Example 1 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart glasses 214 are referred to as the "terminal".
[0294] In smart cities, a wide variety of electronic devices exist, and stable communication is essential for infrastructure management and user services. However, if the communication environment becomes unstable, user convenience will decrease, and efficient urban management may be hindered. Therefore, stable data transmission and efficient selection of communication routes, even in unstable communication conditions, are required.
[0295] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0296] In this invention, the server includes means for measuring signal strength and connection stability of a device having communication capabilities, means for detecting other devices having communication capabilities in the vicinity, and means for selecting an appropriate relay device. This makes it possible to automatically optimize the communication environment in public places in smart cities.
[0297] A "device with communication capabilities" is a device that has the ability to send and receive signals.
[0298] "Signal strength" is an indicator that shows the strength of radio waves or signals in communications, and is a fundamental element for judging the quality of communications.
[0299] "Connection stability" is an indicator that shows the state in which communication can be performed continuously without interruption, and it is an important factor in evaluating the reliability of communication.
[0300] "Other devices with communication capabilities in the vicinity" refers to other electronic devices that are located in close proximity to a particular electronic device and possess communication capabilities.
[0301] A "relay device" is a device that receives communication data and then forwards that data to another location.
[0302] A "data processing device" is an electronic system capable of performing calculations, analyses, and optimizations of data, and contributes to the efficient management of information.
[0303] The "communication path" refers to all physical or logical routes through which data is transmitted and received, and is an essential element for efficient information transmission.
[0304] A "smart city" is a city that aims to optimize urban infrastructure and services using information technology and improve the quality of life of its residents.
[0305] A "public place" is an open space that can be freely used by the general public and refers to an area shared within the city.
[0306] "Location information" is data indicating the geographical location where a specific device or user exists and is utilized for providing location-based services.
[0307] The "connection history" refers to the records related to connections when a certain device communicated in the past and is used when analyzing communication trends and efficiency.
[0308] The system for implementing this invention is designed to optimize the communication environment in a smart city and achieve stable data transmission. The main hardware used includes a device with a communication function (e.g., a smartphone) and a data processing device (e.g., a cloud server).
[0309] The terminal uses the built-in communication module (Bluetooth or WiFi) to detect other devices with communication functions in the vicinity. Continuously monitors the radio wave intensity and connection stability of the detected devices, and automatically selects the optimal relay device. Also, sends a connection request to the selected relay device and borrows the communication resources of that device. This process is carried out without requiring special operations by the user.
[0310] The server uses machine learning algorithms to analyze received location information and connection history to optimize the data transmission path. This data processing automatically selects the most efficient and stable communication path, providing a comfortable overall communication environment. The server also automatically calculates the costs incurred during the communication stabilization process and distributes compensation to the providers of participating devices.
[0311] For example, if a user is in a crowded event venue, this system causes surrounding devices to act as relay devices. As a result, the user can watch high-definition live video with no delay.
[0312] An example of a prompt statement used as input to a generative AI model is as follows: "Design an optimal inter-device communication management system to ensure stable communication in smart cities, and describe its specific application."
[0313] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0314] Step 1:
[0315] The device detects other communication-enabled devices in its vicinity using Bluetooth or Wi-Fi. The device's wireless communication module is used as input, and a list of detected devices is output. Specifically, it scans surrounding devices at regular intervals, collecting data on signal strength and device ID.
[0316] Step 2:
[0317] From the devices detected by the terminal, the optimal relay device is selected based on signal strength and connection stability. The device list obtained in step 1 is used as input, and the ID of the optimal relay device is output. In this step, an algorithm is executed that evaluates the signal strength of each device and selects the device with the most stability.
[0318] Step 3:
[0319] The terminal sends a connection request to a selected relay device, and after approval, borrows the communication resources of that device. The inputs are the relay device's ID and the terminal's connection information, and the success or failure of the connection is output. Specifically, a security-conscious authentication process is performed, and the connection is established.
[0320] Step 4:
[0321] The server analyzes location information and connection history transmitted from terminals to optimize communication paths between terminals. It requires terminal location information and connection history data as input, and outputs optimized path information. Specific operations include calculating efficient data flow ranges using machine learning algorithms.
[0322] Step 5:
[0323] The server calculates the costs incurred by users who received optimized communication and distributes the rewards to the providers of relay equipment. Inputs include communication usage and user information, and the calculated cost and reward details are output. Specifically, processing is performed based on a defined fee structure.
[0324] Step 6:
[0325] Users will experience improved communication within the smart city and enhanced engagement. The output will be more stable communication and a resulting smoother service experience. Specific actions include real-time display of communication status and provision of improvement notifications.
[0326] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0327] This invention provides a system that, in addition to conventional communication optimization methods, recognizes user emotions and adaptively adjusts the communication environment based on that information to provide stable data communication even in unstable communication situations. The specific program processing and embodiments are shown below.
[0328] First, the device measures signal strength and connection stability, and detects surrounding devices via Bluetooth and Wi-Fi to understand the communication environment. At this time, the device receives voice input, and the emotion engine analyzes the user's emotions. For example, if the user speaks in an irritated tone, the emotion is analyzed as unpleasant, and it is determined that further improvement of communication is urgently needed.
[0329] Next, the terminal selects the optimal relay device from surrounding terminals and borrows communication resources after mutual authentication. User sentiment analysis data is used as supplementary information to improve communication quality during this selection process.
[0330] The server analyzes data collected from each terminal and emotional data from the emotion engine to optimize the communication path. Using AI, the server prioritizes a fast and stable path, especially when a user expresses unpleasant emotions. This process enables network adjustments based on emotions.
[0331] After the communication is restored to normal, the server charges the user an appropriate fee, taking into account the improvement costs that reflect the information from the emotion engine. Subsequently, rewards are distributed to the users who provided the relay equipment. This reward system serves as an incentive for users to be more willing to provide relay equipment.
[0332] This embodiment of the invention makes it possible to understand the user's emotional state and optimize the communication environment accordingly. In particular, it provides a new approach to improving the user's actual experience by utilizing emotional data.
[0333] The following describes the processing flow.
[0334] Step 1:
[0335] The device measures its own signal strength. Specifically, the device analyzes signal strength and connection stability using sensors, and if the results fall below a certain threshold, it initiates a process to improve communication.
[0336] Step 2:
[0337] The device searches for nearby devices capable of communicating. Using Bluetooth and Wi-Fi, it scans for nearby devices and adds their information to a list. In this step, the MAC address and signal strength of each device are recorded.
[0338] Step 3:
[0339] The emotion engine analyzes the user's emotions through voice input. A microphone built into the device captures the user's voice, and when anger, frustration, or other emotions are detected, the emotion engine analyzes the data to understand the situation.
[0340] Step 4:
[0341] The terminal selects the most appropriate relay device. Based on information from surrounding terminals, a terminal with good communication status and sufficient power is selected. Sentimental data may also be considered.
[0342] Step 5:
[0343] The terminal sends a connection request to the selected relay device and performs mutual authentication. If authentication is successful, an environment for secure data exchange is established and resource borrowing begins.
[0344] Step 6:
[0345] The server optimizes the communication path. AI analyzes communication data and emotional data collected from the terminal to select (or adjust) the optimal path to improve user satisfaction.
[0346] Step 7:
[0347] Once the communication stabilizes, the user will be charged for the improvement. The server confirms the communication improvement, automatically calculates the cost reflecting the sentiment analysis results, and notifies the user.
[0348] Step 8:
[0349] Rewards are distributed to users who provide relay devices. The server distributes rewards to providers based on the communication resources used, clearly indicating the benefits received for their services.
[0350] (Example 2)
[0351] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".
[0352] In situations with unstable communication environments, users experience stress due to reduced data flow, making it difficult to enjoy a comfortable communication experience. Furthermore, conventional communication optimization methods cannot adjust the communication environment while considering the user's emotional state, and therefore, improvements in the user experience have not been fully achieved.
[0353] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0354] In this invention, the server includes means for the communication terminal to analyze the user's emotions using voice input, means for the server to adjust the communication path according to the user's emotions using artificial intelligence, and means for optimizing data transmission using a generative AI model. This makes it possible to provide a flexible and optimal communication environment that responds to the user's emotional state.
[0355] A "communication terminal" is a device used by users to send and receive data, and is capable of measuring radio wave strength and connection stability, as well as detecting surrounding terminals.
[0356] A "relay device" is a device that plays a relaying role in a communication path in order to effectively transmit data and communication signals.
[0357] "Communication resources" is a general term for the resources necessary for communication, such as bandwidth and signal spectrum required for data transmission.
[0358] A "server" is a computing device that receives data from communication terminals via a network, processes and analyzes it, and directs the optimal communication path.
[0359] Artificial intelligence is a technology that uses algorithms and learning models to perform processing that mimics human intelligence in order to quickly analyze data and make decisions.
[0360] A "generative AI model" is a machine learning model used for data generation and prediction, and is particularly a model that creates new data by utilizing trained knowledge.
[0361] "Wireless communication technology" refers to all technologies that transmit data using radio waves without requiring physical connections such as cables.
[0362] "Voice input" is a method in which a device receives voice input from a user and digitally processes that information.
[0363] "Emotional analysis" is an analytical technique that uses collected audio data and other information to identify a user's emotional state based on the tone and content of their voice.
[0364] "Reward distribution" is the process of distributing rewards to relay equipment providers who have contributed to providing resources for the communication network, based on their usage.
[0365] This invention includes a system for providing users with comfortable data communication even in unstable communication environments. This system is composed of a communication terminal, a server, and relay equipment.
[0366] Functions of a communication terminal
[0367] The communication terminal uses built-in sensors to measure signal strength and connection stability. Based on this data, the terminal uses wireless communication technologies such as Bluetooth and Wi-Fi to detect other nearby terminals and create a list of potential relay devices.
[0368] The communication terminal captures the user's voice using its voice input function and analyzes their emotions through an emotion analysis engine. Specifically, "natural language processing" and "machine learning algorithms" can be used for emotion analysis. The results of this analysis are used as important input data for optimizing communication.
[0369] Server Functions
[0370] The server comprehensively analyzes communication data and sentiment analysis data transmitted from each terminal. It utilizes generative AI models (e.g., models using TensorFlow or PyTorch) to set the optimal communication path according to the user's emotional state. Through AI analysis and optimization techniques, it prioritizes fast and stable communication, especially when the user is expressing unpleasant emotions.
[0371] Furthermore, after the communication is successfully provided, the server calculates the communication costs incurred and bills the user. Appropriate compensation is distributed to other users who provided relay equipment. This compensation serves as an incentive to encourage cooperation from other users and improve the overall efficiency of the network.
[0372] Specific example
[0373] For example, if a user complains in a cafe that "the internet is too slow to work," a terminal that detects this complaint will send back an analysis result indicating "discomfort." Based on this data, the server will select a nearby, powerful relay device and set up the optimal communication path.
[0374] Example of a prompt
[0375] "If a user is dissatisfied with their experience at a cafe, please explain how the device can provide an optimal communication environment. Please also mention specific methods and technologies used."
[0376] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0377] Step 1:
[0378] The terminal uses a built-in signal sensor to measure current signal strength and connection stability. The input data consists of real-time measurements of ambient signal strength and connection stability, while the output is communication environment evaluation data. By processing this data, the current communication status can be quantified and understood.
[0379] Step 2:
[0380] The device uses Bluetooth and Wi-Fi to detect nearby communication devices. It collects the MAC addresses and signal strength information of the detected devices as data input and creates a list of potential relay devices as output. This identifies available relay devices. The detected devices are listed and used for the selection process in the next step.
[0381] Step 3:
[0382] The device acquires the user's voice input through the microphone and sends it to the emotion analysis engine. The voice data becomes the input, and as a result of the processing, the user's emotional state is output. Here, the AI model performs emotion analysis based on the tone and content of the voice and obtains evaluation results such as "unpleasant" or "normal".
[0383] Step 4:
[0384] The terminal selects the optimal relay device based on a list of candidate relay devices and the results of sentiment analysis. Signal strength, distance, and sentiment evaluation are inputs, and the output is the selected relay device. Using Bluetooth communication, mutual authentication is performed with the selected relay device, and communication resources are borrowed. At this stage, aggregated data processing is performed according to the selection criteria.
[0385] Step 5:
[0386] The server receives environmental and emotional data from terminals and sets the optimal communication path. Data input consists of communication status data and emotional evaluations collected from each terminal, while output is the optimized communication path. A generative AI model is used to perform data analysis and path optimization, establishing high-priority communications.
[0387] Step 6:
[0388] The server calculates communication costs after confirming stable communication. It also bills users appropriately and rewards other users who provided relay equipment. Inputs to the process include communication usage and improvement factors based on sentiment, while outputs are billing cost and reward data. Rewards are processed by an aggregation and distribution algorithm on the server side.
[0389] (Application Example 2)
[0390] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."
[0391] The present invention aims to achieve stable data communication even in environments with unstable communication, improve communication quality based on user emotions, and enhance the user experience. Furthermore, it aims to provide a comfortable living environment by utilizing user emotions in the control of home appliances.
[0392] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0393] In this invention, the server includes means for the communication device to analyze the user's emotions, means for prioritizing an appropriate communication path to improve communication quality based on the emotion data, and means for the wearable device to perform environmental control via the emotion data. This enables optimal communication and environmental control in accordance with the user's emotions.
[0394] A "communication device" is a device that can measure radio wave strength and evaluate connection stability.
[0395] A "relay device" is an auxiliary device used to effectively transfer data between communication devices.
[0396] "User emotions" refers to data that describes the user's psychological state, obtained through voice analysis.
[0397] "Emotional data" refers to information obtained by analyzing a user's emotions.
[0398] "Communication path" refers to the network route that data takes when it is transmitted.
[0399] A "wearable device" is a device that a user can wear to receive instructions for environmental control.
[0400] "Environmental control" refers to the act of adjusting home appliances and surrounding environmental settings in accordance with the user's emotional data.
[0401] "Data transmission" refers to the act of transferring information over a network.
[0402] "Emotion analysis" is the process of identifying a user's emotions from voice and other inputs.
[0403] This invention provides a system that allows users to maintain a comfortable communication environment while simultaneously adaptively controlling the surrounding environment based on emotional data. The server provides a foundation for communication and environmental control through cooperation with multiple communication devices and wearable devices.
[0404] First, the terminal functions as a communication device, measuring signal strength and connection stability using Wi-Fi and Bluetooth. When the user speaks, the audio data is converted into text using speech recognition software (e.g., Google Speech-to-Text API). The converted text is then analyzed using sentiment analysis software (e.g., IBM Watson Tone Analyzer) to determine the user's emotions and generate sentiment data.
[0405] The server comprehensively analyzes emotional data and communication quality information. Utilizing artificial intelligence, it selects the optimal communication path based on the user's emotions, ensuring high-speed and stable data transmission. For example, if the analysis indicates a user is experiencing stress, the server immediately optimizes the communication path to improve the user experience.
[0406] Furthermore, the wearable device controls home appliances based on analyzed emotional data. Specifically, it provides a comfortable living environment by adjusting lighting and music according to the user's emotions.
[0407] This system allows users to receive personalized communication and environmental adjustments tailored to their individual emotional states, improving comfort and convenience. Generative AI models can also be used to predict the most suitable environmental settings for a user's emotions.
[0408] For example, if a user says "I'm a little cold," and the analyzed emotion is "uncomfortable," the wearable device will instantly adjust the heating and play relaxing music. To realize such a scenario, the following prompt might be input to the generative AI model: "If the user finds it too loud, consider how the sound settings should be improved."
[0409] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0410] Step 1:
[0411] The device uses Wi-Fi and Bluetooth functionality to measure ambient radio wave strength and connection stability. The input is the surrounding wireless signal, and the output is data on the signal's strength and stability. This allows for understanding the current connection status.
[0412] Step 2:
[0413] When a user speaks, the device collects the audio data and converts it into text data using speech recognition software (e.g., Google Speech-to-Text API). The input is the user's voice, and the output is text data. This text data is used for analyzing the user's sentiment.
[0414] Step 3:
[0415] The collected text data is analyzed using sentiment analysis software (e.g., IBM Watson Tone Analyzer) to obtain user sentiment data. The input is the text data obtained in step 2, and the output is sentiment data. This process clarifies the user's psychological state.
[0416] Step 4:
[0417] The server receives emotion data and connection status data transmitted from the terminal and selects the optimal communication path. The input is emotion data and connection status data, and the output is the selected communication path. Artificial intelligence is used to comprehensively analyze this data to achieve high-speed and stable communication.
[0418] Step 5:
[0419] The server uses a generative AI model to instruct the wearable device to configure the optimal environment settings based on the user's emotions. The input is emotion data, and the output is specific instructions for environment settings. The wearable device controls home appliances based on these instructions to improve the user's comfort.
[0420] Step 6:
[0421] Users send feedback on changes they perceive, and the system uses this feedback to adjust the environment in the future. The input is user feedback, and the output is adjustments to the environment control within the system. This allows for more personalized responses.
[0422] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0423] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0424] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.
[0425] [Third Embodiment]
[0426] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.
[0427] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.
[0428] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0429] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.
[0430] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0431] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0432] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0433] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0434] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0435] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0436] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0437] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".
[0438] The system of the present invention has a configuration in which multiple communication devices optimally utilize each other's resources in order to provide stable data communication in situations where the communication environment is unstable. The specific program processing and embodiments thereof are described below.
[0439] First, the communication device (hereinafter referred to as "terminal") constantly monitors its own signal strength and connection stability, and detects other nearby terminals using Bluetooth or Wi-Fi as needed. For example, if a user is inside a building and the signal strength is unstable, the user's terminal scans for other nearby terminals and identifies one with a good signal strength.
[0440] Next, the terminal selects the candidate with the most stable communication from among the detected terminals and prepares to use this terminal as a relay device. In the selection process, factors such as the signal strength and battery level of the other terminal are taken into consideration. Since the user's terminal performs this process automatically, the user can maintain communication quality without any special operation.
[0441] Subsequently, the user's terminal sends a connection request to a relay device selected by the user. After the necessary authentication procedures are completed between both terminals, the user's terminal borrows the communication resources of the relay device to connect to the internet. For example, user A's terminal can achieve stable data communication by using user B's terminal, which has good signal strength, as a relay device.
[0442] In addition, the server plays a role in optimizing the communication path across the entire network. Using artificial intelligence, the server analyzes the location information and communication history of connected devices to ensure the most efficient data flow. This improves the overall system performance, allowing users to enjoy a smoother communication experience.
[0443] Finally, if the communication improvement is successful, the server automatically calculates the cost charged to the user, and compensation is distributed to the relay equipment provider according to the resources used. This mechanism provides an incentive for users who provide relay equipment to receive compensation for their service.
[0444] The above describes a specific embodiment for implementing the present invention, a system in which users can automatically improve their communication environment while simultaneously obtaining mutual benefits.
[0445] The following describes the processing flow.
[0446] Step 1:
[0447] The device measures its own signal strength. The device continuously acquires signal strength data, and if it falls below a threshold, it determines that the signal is unstable and searches for ways to improve it.
[0448] Step 2:
[0449] The device detects surrounding communication devices. The device activates Bluetooth and Wi-Fi and scans for nearby, connectable devices. At this point, the device records the MAC address and signal strength of the detected devices.
[0450] Step 3:
[0451] The terminal selects an appropriate relay device. From the detected communication devices, the terminal selects the one with the best radio signal strength and sufficient battery power as the relay device. The selection criteria include multiple evaluation indicators.
[0452] Step 4:
[0453] The terminal sends a connection request to the selected relay device. During the connection to the selected relay device, a mutual authentication process is performed between the terminals to confirm that a secure connection is established.
[0454] Step 5:
[0455] The server optimizes communication. Based on information from connected terminals, the server uses AI to optimize the data path, supporting the shortest and most efficient data transmission.
[0456] Step 6:
[0457] Users are charged a fee, and the rewards are distributed to the users of the relay equipment. Once the server confirms the improvement in communication, it bills the user for the fee and pays the reward to the user who provided the relay equipment.
[0458] (Example 1)
[0459] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0460] Technical means are needed to provide stable data communication even in unstable communication environments. In particular, improving the continuity and quality of communication in environments where wireless communication is easily interrupted is a challenge. Furthermore, it is important to improve overall communication performance by efficiently utilizing communication resources and optimizing communication paths. In addition, there is a need for fair distribution of compensation for the communication resources provided.
[0461] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0462] In this invention, the server includes means for the communication terminal to continuously monitor radio wave strength and connection stability, means for the communication terminal to detect other surrounding communication terminals using wireless communication technology, and means for the communication terminal to evaluate the stability of communication from the detection results and select the optimal relay terminal. This enables stable data communication even in situations where the communication environment is unstable.
[0463] A "communication terminal" is an electronic device used to send and receive data using radio waves.
[0464] "Radio wave strength" is an indicator that shows the strength of the signal received by a communication terminal.
[0465] "Connection stability" refers to the degree to which a communication terminal can maintain communication without interruption.
[0466] "Wireless communication technology" refers to all technologies that use radio waves to send and receive data.
[0467] A "relay terminal" is a terminal that plays a role in assisting other communication terminals with sending and receiving data.
[0468] A "data network management device" is a device that manages and optimizes communication paths and data flow within a network.
[0469] "Communication resources" refers to resources such as bandwidth and processing power that are necessary for data communication.
[0470] The system of this invention provides stable data communication even in unstable communication conditions by using multiple communication terminals and a data network management device (server). The communication terminals continuously monitor radio wave strength and connection stability and detect other nearby communication terminals using wireless communication technologies such as Bluetooth and Wi-Fi. Based on the detected terminal information, the terminals automatically select relay terminals and secure an appropriate communication path.
[0471] The server optimizes the communication path across the entire network, ensuring efficient data flow. Specifically, it uses machine learning models to analyze terminal location information and communication history, proposing the most efficient data transmission route. This allows users to automatically enjoy the optimal communication environment without complex operations. The server also monitors the usage of resources required for communication and distributes compensation to providers of relay terminals based on usage.
[0472] As a concrete example of its use, consider a situation where a user is in an underground parking lot and experiences unstable internet connectivity due to weak signal strength. In such a situation, the user's device can automatically scan for other devices in the vicinity and select a device with a good signal strength to use as a relay device. As a result, the user can achieve stable communication.
[0473] As an example of a prompt to the generating AI model to verify the operation of this system, the following text can be used: "I would like to know how to detect surrounding communication terminals and select the most stable relay device. Please explain the specific process."
[0474] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0475] Step 1:
[0476] Status monitoring and detection by terminals
[0477] The device frequently monitors its own signal strength and connection stability. Inputs include current signal strength and connection status, while output is a determination of whether the stability falls below a certain threshold. Specifically, it analyzes real-time data using a signal strength sensor and communication logs, and if the signal strength falls below the threshold, it immediately uses wireless communication technology to scan for other nearby communication devices.
[0478] Step 2:
[0479] Detection and listing of peripheral devices
[0480] The terminal uses wireless communication technology (Bluetooth or WiFi) to detect other terminals in its vicinity. The input for this step is the monitoring result obtained in the previous step, and the output is a list of the detected other terminals. Specifically, the terminal scans for surrounding signals and stores the ID and signal strength of all corresponding terminals in temporary memory.
[0481] Step 3:
[0482] Selection of the optimal relay terminal
[0483] The terminal selects the optimal relay terminal based on signal strength and battery level from the list created in the previous step. The input is the list of detected terminals, and the output is the selected relay terminal. The terminal calculates an evaluation score for each terminal using a proprietary algorithm and performs the specific action of selecting the terminal with the highest score.
[0484] Step 4:
[0485] Connection request and authentication procedure for relay terminals
[0486] The user's terminal sends a connection request to a selected relay terminal and performs the necessary authentication procedures. The input is information about the selected relay terminal, and the output is whether or not the connection is permitted. Specifically, encrypted messages are exchanged between the terminals to complete bidirectional authentication.
[0487] Step 5:
[0488] Internet connection and data communication
[0489] The user's terminal connects to the internet via a relay terminal and performs normal data communication. The input is a confirmation of a successful connection, and the output is a state of stable data communication. It performs specific actions such as sending and receiving packets, continuously monitoring delays and errors, and making adjustments as needed.
[0490] Step 6:
[0491] Server-based optimization of communication paths
[0492] The server collects information from connected devices and uses artificial intelligence to calculate the optimal communication path. The input is location information and communication history transmitted from the devices, and the output is a proposed optimized communication path. The server performs real-time processing using machine learning models to improve the efficiency of data transmission.
[0493] (Application Example 1)
[0494] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0495] In smart cities, a wide variety of electronic devices exist, and stable communication is essential for infrastructure management and user services. However, if the communication environment becomes unstable, user convenience will decrease, and efficient urban management may be hindered. Therefore, stable data transmission and efficient selection of communication routes, even in unstable communication conditions, are required.
[0496] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0497] In this invention, the server includes means for measuring signal strength and connection stability of a device having communication capabilities, means for detecting other devices having communication capabilities in the vicinity, and means for selecting an appropriate relay device. This makes it possible to automatically optimize the communication environment in public places in smart cities.
[0498] A "device with communication capabilities" is a device that has the ability to send and receive signals.
[0499] "Signal strength" is an indicator that shows the strength of radio waves or signals in communications, and is a fundamental element for judging the quality of communications.
[0500] "Connection stability" is an indicator that shows the state in which communication can be performed continuously without interruption, and it is an important factor in evaluating the reliability of communication.
[0501] "Other devices with communication capabilities in the vicinity" refers to other electronic devices that are located in close proximity to a particular electronic device and possess communication capabilities.
[0502] A "relay device" is a device that receives communication data and then forwards that data to another location.
[0503] A "data processing device" is an electronic system capable of performing calculations, analyses, and optimizations of data, and contributes to the efficient management of information.
[0504] A "communication path" refers to all the physical or logical routes that data takes when it is sent and received, and is an essential element for efficient information transmission.
[0505] A "smart city" is a city that aims to improve the quality of life for its residents by using information technology to streamline urban infrastructure and services.
[0506] A "public place" refers to an open space that can be freely used by the general public, and is an area shared within a city.
[0507] "Location information" refers to data that indicates the geographical location of a specific device or user, and is used to provide location-based services.
[0508] "Connection history" refers to a record of connections made by a device in the past, and is used to analyze communication trends and efficiency.
[0509] The system implementing this invention is designed to optimize the communication environment in smart cities and achieve stable data transmission. The hardware primarily used includes devices with communication capabilities (e.g., smartphones) and data processing devices (e.g., cloud servers).
[0510] The terminal uses its built-in communication module (Bluetooth or WiFi) to detect other communication-enabled devices in the vicinity. It continuously monitors the signal strength and connection stability of the detected devices and automatically selects the optimal relay device. It also sends a connection request to the selected relay device and borrows its communication resources. This process is performed without requiring any special action from the user.
[0511] The server uses machine learning algorithms to analyze received location information and connection history to optimize the data transmission path. This data processing automatically selects the most efficient and stable communication path, providing a comfortable overall communication environment. The server also automatically calculates the costs incurred during the communication stabilization process and distributes compensation to the providers of participating devices.
[0512] For example, if a user is in a crowded event venue, this system causes surrounding devices to act as relay devices. As a result, the user can watch high-definition live video with no delay.
[0513] An example of a prompt statement used as input to a generative AI model is as follows: "Design an optimal inter-device communication management system to ensure stable communication in smart cities, and describe its specific application."
[0514] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0515] Step 1:
[0516] The device detects other communication-enabled devices in its vicinity using Bluetooth or Wi-Fi. The device's wireless communication module is used as input, and a list of detected devices is output. Specifically, it scans surrounding devices at regular intervals, collecting data on signal strength and device ID.
[0517] Step 2:
[0518] From the devices detected by the terminal, the optimal relay device is selected based on signal strength and connection stability. The device list obtained in step 1 is used as input, and the ID of the optimal relay device is output. In this step, an algorithm is executed that evaluates the signal strength of each device and selects the device with the most stability.
[0519] Step 3:
[0520] The terminal sends a connection request to a selected relay device, and after approval, borrows the communication resources of that device. The inputs are the relay device's ID and the terminal's connection information, and the success or failure of the connection is output. Specifically, a security-conscious authentication process is performed, and the connection is established.
[0521] Step 4:
[0522] The server analyzes location information and connection history transmitted from terminals to optimize communication paths between terminals. It requires terminal location information and connection history data as input, and outputs optimized path information. Specific operations include calculating efficient data flow ranges using machine learning algorithms.
[0523] Step 5:
[0524] The server calculates the costs incurred by users who received optimized communication and distributes the rewards to the providers of relay equipment. Inputs include communication usage and user information, and the calculated cost and reward details are output. Specifically, processing is performed based on a defined fee structure.
[0525] Step 6:
[0526] Users will experience improved communication within the smart city and enhanced engagement. The output will be more stable communication and a resulting smoother service experience. Specific actions include real-time display of communication status and provision of improvement notifications.
[0527] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0528] This invention provides a system that, in addition to conventional communication optimization methods, recognizes user emotions and adaptively adjusts the communication environment based on that information to provide stable data communication even in unstable communication situations. The specific program processing and embodiments are shown below.
[0529] First, the device measures signal strength and connection stability, and detects surrounding devices via Bluetooth and Wi-Fi to understand the communication environment. At this time, the device receives voice input, and the emotion engine analyzes the user's emotions. For example, if the user speaks in an irritated tone, the emotion is analyzed as unpleasant, and it is determined that further improvement of communication is urgently needed.
[0530] Next, the terminal selects the optimal relay device from surrounding terminals and borrows communication resources after mutual authentication. User sentiment analysis data is used as supplementary information to improve communication quality during this selection process.
[0531] The server analyzes data collected from each terminal and emotional data from the emotion engine to optimize the communication path. Using AI, the server prioritizes a fast and stable path, especially when a user expresses unpleasant emotions. This process enables network adjustments based on emotions.
[0532] After the communication is restored to normal, the server charges the user an appropriate fee, taking into account the improvement costs that reflect the information from the emotion engine. Subsequently, rewards are distributed to the users who provided the relay equipment. This reward system serves as an incentive for users to be more willing to provide relay equipment.
[0533] This embodiment of the invention makes it possible to understand the user's emotional state and optimize the communication environment accordingly. In particular, it provides a new approach to improving the user's actual experience by utilizing emotional data.
[0534] The following describes the processing flow.
[0535] Step 1:
[0536] The device measures its own signal strength. Specifically, the device analyzes signal strength and connection stability using sensors, and if the results fall below a certain threshold, it initiates a process to improve communication.
[0537] Step 2:
[0538] The device searches for nearby devices capable of communicating. Using Bluetooth and Wi-Fi, it scans for nearby devices and adds their information to a list. In this step, the MAC address and signal strength of each device are recorded.
[0539] Step 3:
[0540] The emotion engine analyzes the user's emotions through voice input. A microphone built into the device captures the user's voice, and when anger, frustration, or other emotions are detected, the emotion engine analyzes the data to understand the situation.
[0541] Step 4:
[0542] The terminal selects the most appropriate relay device. Based on information from surrounding terminals, a terminal with good communication status and sufficient power is selected. Sentimental data may also be considered.
[0543] Step 5:
[0544] The terminal sends a connection request to the selected relay device and performs mutual authentication. If authentication is successful, an environment for secure data exchange is established and resource borrowing begins.
[0545] Step 6:
[0546] The server optimizes the communication path. AI analyzes communication data and emotional data collected from the terminal to select (or adjust) the optimal path to improve user satisfaction.
[0547] Step 7:
[0548] Once the communication stabilizes, the user will be charged for the improvement. The server confirms the communication improvement, automatically calculates the cost reflecting the sentiment analysis results, and notifies the user.
[0549] Step 8:
[0550] Rewards are distributed to users who provide relay devices. The server distributes rewards to providers based on the communication resources used, clearly indicating the benefits received for their services.
[0551] (Example 2)
[0552] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0553] In situations with unstable communication environments, users experience stress due to reduced data flow, making it difficult to enjoy a comfortable communication experience. Furthermore, conventional communication optimization methods cannot adjust the communication environment while considering the user's emotional state, and therefore, improvements in the user experience have not been fully achieved.
[0554] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0555] In this invention, the server includes means for the communication terminal to analyze the user's emotions using voice input, means for the server to adjust the communication path according to the user's emotions using artificial intelligence, and means for optimizing data transmission using a generative AI model. This makes it possible to provide a flexible and optimal communication environment that responds to the user's emotional state.
[0556] A "communication terminal" is a device used by users to send and receive data, and is capable of measuring radio wave strength and connection stability, as well as detecting surrounding terminals.
[0557] A "relay device" is a device that plays a relaying role in a communication path in order to effectively transmit data and communication signals.
[0558] "Communication resources" is a general term for the resources necessary for communication, such as bandwidth and signal spectrum required for data transmission.
[0559] A "server" is a computing device that receives data from communication terminals via a network, processes and analyzes it, and directs the optimal communication path.
[0560] Artificial intelligence is a technology that uses algorithms and learning models to perform processing that mimics human intelligence in order to quickly analyze data and make decisions.
[0561] A "generative AI model" is a machine learning model used for data generation and prediction, and is particularly a model that creates new data by utilizing trained knowledge.
[0562] "Wireless communication technology" refers to all technologies that transmit data using radio waves without requiring physical connections such as cables.
[0563] "Voice input" is a method in which a device receives voice input from a user and digitally processes that information.
[0564] "Emotional analysis" is an analytical technique that uses collected audio data and other information to identify a user's emotional state based on the tone and content of their voice.
[0565] "Reward distribution" is the process of distributing rewards to relay equipment providers who have contributed to providing resources for the communication network, based on their usage.
[0566] This invention includes a system for providing users with comfortable data communication even in unstable communication environments. This system is composed of a communication terminal, a server, and relay equipment.
[0567] Functions of a communication terminal
[0568] The communication terminal uses built-in sensors to measure signal strength and connection stability. Based on this data, the terminal uses wireless communication technologies such as Bluetooth and Wi-Fi to detect other nearby terminals and create a list of potential relay devices.
[0569] The communication terminal captures the user's voice using its voice input function and analyzes their emotions through an emotion analysis engine. Specifically, "natural language processing" and "machine learning algorithms" can be used for emotion analysis. The results of this analysis are used as important input data for optimizing communication.
[0570] Server Functions
[0571] The server comprehensively analyzes communication data and sentiment analysis data transmitted from each terminal. It utilizes generative AI models (e.g., models using TensorFlow or PyTorch) to set the optimal communication path according to the user's emotional state. Through AI analysis and optimization techniques, it prioritizes fast and stable communication, especially when the user is expressing unpleasant emotions.
[0572] Furthermore, after the communication is successfully provided, the server calculates the communication costs incurred and bills the user. Appropriate compensation is distributed to other users who provided relay equipment. This compensation serves as an incentive to encourage cooperation from other users and improve the overall efficiency of the network.
[0573] Specific example
[0574] For example, if a user complains in a cafe that "the internet is too slow to work," a terminal that detects this complaint will send back an analysis result indicating "discomfort." Based on this data, the server will select a nearby, powerful relay device and set up the optimal communication path.
[0575] Example of a prompt
[0576] "If a user is dissatisfied with their experience at a cafe, please explain how the device can provide an optimal communication environment. Please also mention specific methods and technologies used."
[0577] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0578] Step 1:
[0579] The terminal uses a built-in signal sensor to measure current signal strength and connection stability. The input data consists of real-time measurements of ambient signal strength and connection stability, while the output is communication environment evaluation data. By processing this data, the current communication status can be quantified and understood.
[0580] Step 2:
[0581] The device uses Bluetooth and Wi-Fi to detect nearby communication devices. It collects the MAC addresses and signal strength information of the detected devices as data input and creates a list of potential relay devices as output. This identifies available relay devices. The detected devices are listed and used for the selection process in the next step.
[0582] Step 3:
[0583] The device acquires the user's voice input through the microphone and sends it to the emotion analysis engine. The voice data becomes the input, and as a result of the processing, the user's emotional state is output. Here, the AI model performs emotion analysis based on the tone and content of the voice and obtains evaluation results such as "unpleasant" or "normal".
[0584] Step 4:
[0585] The terminal selects the optimal relay device based on a list of candidate relay devices and the results of sentiment analysis. Signal strength, distance, and sentiment evaluation are inputs, and the output is the selected relay device. Using Bluetooth communication, mutual authentication is performed with the selected relay device, and communication resources are borrowed. At this stage, aggregated data processing is performed according to the selection criteria.
[0586] Step 5:
[0587] The server receives environmental and emotional data from terminals and sets the optimal communication path. Data input consists of communication status data and emotional evaluations collected from each terminal, while output is the optimized communication path. A generative AI model is used to perform data analysis and path optimization, establishing high-priority communications.
[0588] Step 6:
[0589] The server calculates communication costs after confirming stable communication. It also bills users appropriately and rewards other users who provided relay equipment. Inputs to the process include communication usage and improvement factors based on sentiment, while outputs are billing cost and reward data. Rewards are processed by an aggregation and distribution algorithm on the server side.
[0590] (Application Example 2)
[0591] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."
[0592] The present invention aims to achieve stable data communication even in environments with unstable communication, improve communication quality based on user emotions, and enhance the user experience. Furthermore, it aims to provide a comfortable living environment by utilizing user emotions in the control of home appliances.
[0593] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0594] In this invention, the server includes means for the communication device to analyze the user's emotions, means for prioritizing an appropriate communication path to improve communication quality based on the emotion data, and means for the wearable device to perform environmental control via the emotion data. This enables optimal communication and environmental control in accordance with the user's emotions.
[0595] A "communication device" is a device that can measure radio wave strength and evaluate connection stability.
[0596] A "relay device" is an auxiliary device used to effectively transfer data between communication devices.
[0597] "User emotions" refers to data that describes the user's psychological state, obtained through voice analysis.
[0598] "Emotional data" refers to information obtained by analyzing a user's emotions.
[0599] "Communication path" refers to the network route that data takes when it is transmitted.
[0600] A "wearable device" is a device that a user can wear to receive instructions for environmental control.
[0601] "Environmental control" refers to the act of adjusting home appliances and surrounding environmental settings in accordance with the user's emotional data.
[0602] "Data transmission" refers to the act of transferring information over a network.
[0603] "Emotion analysis" is the process of identifying a user's emotions from voice and other inputs.
[0604] This invention provides a system that allows users to maintain a comfortable communication environment while simultaneously adaptively controlling the surrounding environment based on emotional data. The server provides a foundation for communication and environmental control through cooperation with multiple communication devices and wearable devices.
[0605] First, the terminal functions as a communication device, measuring signal strength and connection stability using Wi-Fi and Bluetooth. When the user speaks, the audio data is converted into text using speech recognition software (e.g., Google Speech-to-Text API). The converted text is then analyzed using sentiment analysis software (e.g., IBM Watson Tone Analyzer) to determine the user's emotions and generate sentiment data.
[0606] The server comprehensively analyzes emotional data and communication quality information. Utilizing artificial intelligence, it selects the optimal communication path based on the user's emotions, ensuring high-speed and stable data transmission. For example, if the analysis indicates a user is experiencing stress, the server immediately optimizes the communication path to improve the user experience.
[0607] Furthermore, the wearable device controls home appliances based on analyzed emotional data. Specifically, it provides a comfortable living environment by adjusting lighting and music according to the user's emotions.
[0608] This system allows users to receive personalized communication and environmental adjustments tailored to their individual emotional states, improving comfort and convenience. Generative AI models can also be used to predict the most suitable environmental settings for a user's emotions.
[0609] For example, if a user says "I'm a little cold," and the analyzed emotion is "uncomfortable," the wearable device will instantly adjust the heating and play relaxing music. To realize such a scenario, the following prompt might be input to the generative AI model: "If the user finds it too loud, consider how the sound settings should be improved."
[0610] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0611] Step 1:
[0612] The device uses Wi-Fi and Bluetooth functionality to measure ambient radio wave strength and connection stability. The input is the surrounding wireless signal, and the output is data on the signal's strength and stability. This allows for understanding the current connection status.
[0613] Step 2:
[0614] When a user speaks, the device collects the audio data and converts it into text data using speech recognition software (e.g., Google Speech-to-Text API). The input is the user's voice, and the output is text data. This text data is used for analyzing the user's sentiment.
[0615] Step 3:
[0616] The collected text data is analyzed using sentiment analysis software (e.g., IBM Watson Tone Analyzer) to obtain user sentiment data. The input is the text data obtained in step 2, and the output is sentiment data. This process clarifies the user's psychological state.
[0617] Step 4:
[0618] The server receives emotion data and connection status data transmitted from the terminal and selects the optimal communication path. The input is emotion data and connection status data, and the output is the selected communication path. Artificial intelligence is used to comprehensively analyze this data to achieve high-speed and stable communication.
[0619] Step 5:
[0620] The server uses a generative AI model to instruct the wearable device to configure the optimal environment settings based on the user's emotions. The input is emotion data, and the output is specific instructions for environment settings. The wearable device controls home appliances based on these instructions to improve the user's comfort.
[0621] Step 6:
[0622] Users send feedback on changes they perceive, and the system uses this feedback to adjust the environment in the future. The input is user feedback, and the output is adjustments to the environment control within the system. This allows for more personalized responses.
[0623] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0624] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0625] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.
[0626] [Fourth Embodiment]
[0627] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.
[0628] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[0629] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0630] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.
[0631] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.
[0632] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).
[0633] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.
[0634] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.
[0635] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.
[0636] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0637] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0638] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.
[0639] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0640] The system of the present invention has a configuration in which multiple communication devices optimally utilize each other's resources in order to provide stable data communication in situations where the communication environment is unstable. The specific program processing and embodiments thereof are described below.
[0641] First, the communication device (hereinafter referred to as "terminal") constantly monitors its own signal strength and connection stability, and detects other nearby terminals using Bluetooth or Wi-Fi as needed. For example, if a user is inside a building and the signal strength is unstable, the user's terminal scans for other nearby terminals and identifies one with a good signal strength.
[0642] Next, the terminal selects the candidate with the most stable communication from among the detected terminals and prepares to use this terminal as a relay device. In the selection process, factors such as the signal strength and battery level of the other terminal are taken into consideration. Since the user's terminal performs this process automatically, the user can maintain communication quality without any special operation.
[0643] Subsequently, the user's terminal sends a connection request to a relay device selected by the user. After the necessary authentication procedures are completed between both terminals, the user's terminal borrows the communication resources of the relay device to connect to the internet. For example, user A's terminal can achieve stable data communication by using user B's terminal, which has good signal strength, as a relay device.
[0644] In addition, the server plays a role in optimizing the communication path across the entire network. Using artificial intelligence, the server analyzes the location information and communication history of connected devices to ensure the most efficient data flow. This improves the overall system performance, allowing users to enjoy a smoother communication experience.
[0645] Finally, if the communication improvement is successful, the server automatically calculates the cost charged to the user, and compensation is distributed to the relay equipment provider according to the resources used. This mechanism provides an incentive for users who provide relay equipment to receive compensation for their service.
[0646] The above describes a specific embodiment for implementing the present invention, a system in which users can automatically improve their communication environment while simultaneously obtaining mutual benefits.
[0647] The following describes the processing flow.
[0648] Step 1:
[0649] The device measures its own signal strength. The device continuously acquires signal strength data, and if it falls below a threshold, it determines that the signal is unstable and searches for ways to improve it.
[0650] Step 2:
[0651] The device detects surrounding communication devices. The device activates Bluetooth and Wi-Fi and scans for nearby, connectable devices. At this point, the device records the MAC address and signal strength of the detected devices.
[0652] Step 3:
[0653] The terminal selects an appropriate relay device. From the detected communication devices, the terminal selects the one with the best radio signal strength and sufficient battery power as the relay device. The selection criteria include multiple evaluation indicators.
[0654] Step 4:
[0655] The terminal sends a connection request to the selected relay device. During the connection to the selected relay device, a mutual authentication process is performed between the terminals to confirm that a secure connection is established.
[0656] Step 5:
[0657] The server optimizes communication. Based on information from connected terminals, the server uses AI to optimize the data path, supporting the shortest and most efficient data transmission.
[0658] Step 6:
[0659] Users are charged a fee, and the rewards are distributed to the users of the relay equipment. Once the server confirms the improvement in communication, it bills the user for the fee and pays the reward to the user who provided the relay equipment.
[0660] (Example 1)
[0661] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0662] Technical means are needed to provide stable data communication even in unstable communication environments. In particular, improving the continuity and quality of communication in environments where wireless communication is easily interrupted is a challenge. Furthermore, it is important to improve overall communication performance by efficiently utilizing communication resources and optimizing communication paths. In addition, there is a need for fair distribution of compensation for the communication resources provided.
[0663] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.
[0664] In this invention, the server includes means for the communication terminal to continuously monitor radio wave strength and connection stability, means for the communication terminal to detect other surrounding communication terminals using wireless communication technology, and means for the communication terminal to evaluate the stability of communication from the detection results and select the optimal relay terminal. This enables stable data communication even in situations where the communication environment is unstable.
[0665] A "communication terminal" is an electronic device used to send and receive data using radio waves.
[0666] "Radio wave strength" is an indicator that shows the strength of the signal received by a communication terminal.
[0667] "Connection stability" refers to the degree to which a communication terminal can maintain communication without interruption.
[0668] "Wireless communication technology" refers to all technologies that use radio waves to send and receive data.
[0669] A "relay terminal" is a terminal that plays a role in assisting other communication terminals with sending and receiving data.
[0670] A "data network management device" is a device that manages and optimizes communication paths and data flow within a network.
[0671] "Communication resources" refers to resources such as bandwidth and processing power that are necessary for data communication.
[0672] The system of this invention provides stable data communication even in unstable communication conditions by using multiple communication terminals and a data network management device (server). The communication terminals continuously monitor radio wave strength and connection stability and detect other nearby communication terminals using wireless communication technologies such as Bluetooth and Wi-Fi. Based on the detected terminal information, the terminals automatically select relay terminals and secure an appropriate communication path.
[0673] The server optimizes the communication path across the entire network, ensuring efficient data flow. Specifically, it uses machine learning models to analyze terminal location information and communication history, proposing the most efficient data transmission route. This allows users to automatically enjoy the optimal communication environment without complex operations. The server also monitors the usage of resources required for communication and distributes compensation to providers of relay terminals based on usage.
[0674] As a concrete example of its use, consider a situation where a user is in an underground parking lot and experiences unstable internet connectivity due to weak signal strength. In such a situation, the user's device can automatically scan for other devices in the vicinity and select a device with a good signal strength to use as a relay device. As a result, the user can achieve stable communication.
[0675] As an example of a prompt to the generating AI model to verify the operation of this system, the following text can be used: "I would like to know how to detect surrounding communication terminals and select the most stable relay device. Please explain the specific process."
[0676] The flow of the specific processing in Example 1 will be explained using Figure 11.
[0677] Step 1:
[0678] Status monitoring and detection by terminals
[0679] The device frequently monitors its own signal strength and connection stability. Inputs include current signal strength and connection status, while output is a determination of whether the stability falls below a certain threshold. Specifically, it analyzes real-time data using a signal strength sensor and communication logs, and if the signal strength falls below the threshold, it immediately uses wireless communication technology to scan for other nearby communication devices.
[0680] Step 2:
[0681] Detection and listing of peripheral devices
[0682] The terminal uses wireless communication technology (Bluetooth or WiFi) to detect other terminals in its vicinity. The input for this step is the monitoring result obtained in the previous step, and the output is a list of the detected other terminals. Specifically, the terminal scans for surrounding signals and stores the ID and signal strength of all corresponding terminals in temporary memory.
[0683] Step 3:
[0684] Selection of the optimal relay terminal
[0685] The terminal selects the optimal relay terminal based on signal strength and battery level from the list created in the previous step. The input is the list of detected terminals, and the output is the selected relay terminal. The terminal calculates an evaluation score for each terminal using a proprietary algorithm and performs the specific action of selecting the terminal with the highest score.
[0686] Step 4:
[0687] Connection request and authentication procedure for relay terminals
[0688] The user's terminal sends a connection request to a selected relay terminal and performs the necessary authentication procedures. The input is information about the selected relay terminal, and the output is whether or not the connection is permitted. Specifically, encrypted messages are exchanged between the terminals to complete bidirectional authentication.
[0689] Step 5:
[0690] Internet connection and data communication
[0691] The user's terminal connects to the internet via a relay terminal and performs normal data communication. The input is a confirmation of a successful connection, and the output is a state of stable data communication. It performs specific actions such as sending and receiving packets, continuously monitoring delays and errors, and making adjustments as needed.
[0692] Step 6:
[0693] Server-based optimization of communication paths
[0694] The server collects information from connected devices and uses artificial intelligence to calculate the optimal communication path. The input is location information and communication history transmitted from the devices, and the output is a proposed optimized communication path. The server performs real-time processing using machine learning models to improve the efficiency of data transmission.
[0695] (Application Example 1)
[0696] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0697] In smart cities, a wide variety of electronic devices exist, and stable communication is essential for infrastructure management and user services. However, if the communication environment becomes unstable, user convenience will decrease, and efficient urban management may be hindered. Therefore, stable data transmission and efficient selection of communication routes, even in unstable communication conditions, are required.
[0698] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.
[0699] In this invention, the server includes means for measuring signal strength and connection stability of a device having communication capabilities, means for detecting other devices having communication capabilities in the vicinity, and means for selecting an appropriate relay device. This makes it possible to automatically optimize the communication environment in public places in smart cities.
[0700] A "device with communication capabilities" is a device that has the ability to send and receive signals.
[0701] "Signal strength" is an indicator that shows the strength of radio waves or signals in communications, and is a fundamental element for judging the quality of communications.
[0702] "Connection stability" is an indicator that shows the state in which communication can be performed continuously without interruption, and it is an important factor in evaluating the reliability of communication.
[0703] "Other devices with communication capabilities in the vicinity" refers to other electronic devices that are located in close proximity to a particular electronic device and possess communication capabilities.
[0704] A "relay device" is a device that receives communication data and then forwards that data to another location.
[0705] A "data processing device" is an electronic system capable of performing calculations, analyses, and optimizations of data, and contributes to the efficient management of information.
[0706] A "communication path" refers to all the physical or logical routes that data takes when it is sent and received, and is an essential element for efficient information transmission.
[0707] A "smart city" is a city that aims to improve the quality of life for its residents by using information technology to streamline urban infrastructure and services.
[0708] A "public place" refers to an open space that can be freely used by the general public, and is an area shared within a city.
[0709] "Location information" refers to data that indicates the geographical location of a specific device or user, and is used to provide location-based services.
[0710] "Connection history" refers to a record of connections made by a device in the past, and is used to analyze communication trends and efficiency.
[0711] The system implementing this invention is designed to optimize the communication environment in smart cities and achieve stable data transmission. The hardware primarily used includes devices with communication capabilities (e.g., smartphones) and data processing devices (e.g., cloud servers).
[0712] The terminal uses its built-in communication module (Bluetooth or WiFi) to detect other communication-enabled devices in the vicinity. It continuously monitors the signal strength and connection stability of the detected devices and automatically selects the optimal relay device. It also sends a connection request to the selected relay device and borrows its communication resources. This process is performed without requiring any special action from the user.
[0713] The server uses machine learning algorithms to analyze received location information and connection history to optimize the data transmission path. This data processing automatically selects the most efficient and stable communication path, providing a comfortable overall communication environment. The server also automatically calculates the costs incurred during the communication stabilization process and distributes compensation to the providers of participating devices.
[0714] For example, if a user is in a crowded event venue, this system causes surrounding devices to act as relay devices. As a result, the user can watch high-definition live video with no delay.
[0715] An example of a prompt statement used as input to a generative AI model is as follows: "Design an optimal inter-device communication management system to ensure stable communication in smart cities, and describe its specific application."
[0716] The flow of a specific process in Application Example 1 will be explained using Figure 12.
[0717] Step 1:
[0718] The device detects other communication-enabled devices in its vicinity using Bluetooth or Wi-Fi. The device's wireless communication module is used as input, and a list of detected devices is output. Specifically, it scans surrounding devices at regular intervals, collecting data on signal strength and device ID.
[0719] Step 2:
[0720] From the devices detected by the terminal, the optimal relay device is selected based on signal strength and connection stability. The device list obtained in step 1 is used as input, and the ID of the optimal relay device is output. In this step, an algorithm is executed that evaluates the signal strength of each device and selects the device with the most stability.
[0721] Step 3:
[0722] The terminal sends a connection request to a selected relay device, and after approval, borrows the communication resources of that device. The inputs are the relay device's ID and the terminal's connection information, and the success or failure of the connection is output. Specifically, a security-conscious authentication process is performed, and the connection is established.
[0723] Step 4:
[0724] The server analyzes location information and connection history transmitted from terminals to optimize communication paths between terminals. It requires terminal location information and connection history data as input, and outputs optimized path information. Specific operations include calculating efficient data flow ranges using machine learning algorithms.
[0725] Step 5:
[0726] The server calculates the costs incurred by users who received optimized communication and distributes the rewards to the providers of relay equipment. Inputs include communication usage and user information, and the calculated cost and reward details are output. Specifically, processing is performed based on a defined fee structure.
[0727] Step 6:
[0728] Users will experience improved communication within the smart city and enhanced engagement. The output will be more stable communication and a resulting smoother service experience. Specific actions include real-time display of communication status and provision of improvement notifications.
[0729] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.
[0730] This invention provides a system that, in addition to conventional communication optimization methods, recognizes user emotions and adaptively adjusts the communication environment based on that information to provide stable data communication even in unstable communication situations. The specific program processing and embodiments are shown below.
[0731] First, the device measures signal strength and connection stability, and detects surrounding devices via Bluetooth and Wi-Fi to understand the communication environment. At this time, the device receives voice input, and the emotion engine analyzes the user's emotions. For example, if the user speaks in an irritated tone, the emotion is analyzed as unpleasant, and it is determined that further improvement of communication is urgently needed.
[0732] Next, the terminal selects the optimal relay device from surrounding terminals and borrows communication resources after mutual authentication. User sentiment analysis data is used as supplementary information to improve communication quality during this selection process.
[0733] The server analyzes data collected from each terminal and emotional data from the emotion engine to optimize the communication path. Using AI, the server prioritizes a fast and stable path, especially when a user expresses unpleasant emotions. This process enables network adjustments based on emotions.
[0734] After the communication is restored to normal, the server charges the user an appropriate fee, taking into account the improvement costs that reflect the information from the emotion engine. Subsequently, rewards are distributed to the users who provided the relay equipment. This reward system serves as an incentive for users to be more willing to provide relay equipment.
[0735] This embodiment of the invention makes it possible to understand the user's emotional state and optimize the communication environment accordingly. In particular, it provides a new approach to improving the user's actual experience by utilizing emotional data.
[0736] The following describes the processing flow.
[0737] Step 1:
[0738] The device measures its own signal strength. Specifically, the device analyzes signal strength and connection stability using sensors, and if the results fall below a certain threshold, it initiates a process to improve communication.
[0739] Step 2:
[0740] The device searches for nearby devices capable of communicating. Using Bluetooth and Wi-Fi, it scans for nearby devices and adds their information to a list. In this step, the MAC address and signal strength of each device are recorded.
[0741] Step 3:
[0742] The emotion engine analyzes the user's emotions through voice input. A microphone built into the device captures the user's voice, and when anger, frustration, or other emotions are detected, the emotion engine analyzes the data to understand the situation.
[0743] Step 4:
[0744] The terminal selects the most appropriate relay device. Based on information from surrounding terminals, a terminal with good communication status and sufficient power is selected. Sentimental data may also be considered.
[0745] Step 5:
[0746] The terminal sends a connection request to the selected relay device and performs mutual authentication. If authentication is successful, an environment for secure data exchange is established and resource borrowing begins.
[0747] Step 6:
[0748] The server optimizes the communication path. AI analyzes communication data and emotional data collected from the terminal to select (or adjust) the optimal path to improve user satisfaction.
[0749] Step 7:
[0750] Once the communication stabilizes, the user will be charged for the improvement. The server confirms the communication improvement, automatically calculates the cost reflecting the sentiment analysis results, and notifies the user.
[0751] Step 8:
[0752] Rewards are distributed to users who provide relay devices. The server distributes rewards to providers based on the communication resources used, clearly indicating the benefits received for their services.
[0753] (Example 2)
[0754] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0755] In situations with unstable communication environments, users experience stress due to reduced data flow, making it difficult to enjoy a comfortable communication experience. Furthermore, conventional communication optimization methods cannot adjust the communication environment while considering the user's emotional state, and therefore, improvements in the user experience have not been fully achieved.
[0756] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.
[0757] In this invention, the server includes means for the communication terminal to analyze the user's emotions using voice input, means for the server to adjust the communication path according to the user's emotions using artificial intelligence, and means for optimizing data transmission using a generative AI model. This makes it possible to provide a flexible and optimal communication environment that responds to the user's emotional state.
[0758] A "communication terminal" is a device used by users to send and receive data, and is capable of measuring radio wave strength and connection stability, as well as detecting surrounding terminals.
[0759] A "relay device" is a device that plays a relaying role in a communication path in order to effectively transmit data and communication signals.
[0760] "Communication resources" is a general term for the resources necessary for communication, such as bandwidth and signal spectrum required for data transmission.
[0761] A "server" is a computing device that receives data from communication terminals via a network, processes and analyzes it, and directs the optimal communication path.
[0762] Artificial intelligence is a technology that uses algorithms and learning models to perform processing that mimics human intelligence in order to quickly analyze data and make decisions.
[0763] A "generative AI model" is a machine learning model used for data generation and prediction, and is particularly a model that creates new data by utilizing trained knowledge.
[0764] "Wireless communication technology" refers to all technologies that transmit data using radio waves without requiring physical connections such as cables.
[0765] "Voice input" is a method in which a device receives voice input from a user and digitally processes that information.
[0766] "Emotional analysis" is an analytical technique that uses collected audio data and other information to identify a user's emotional state based on the tone and content of their voice.
[0767] "Reward distribution" is the process of distributing rewards to relay equipment providers who have contributed to providing resources for the communication network, based on their usage.
[0768] This invention includes a system for providing users with comfortable data communication even in unstable communication environments. This system is composed of a communication terminal, a server, and relay equipment.
[0769] Functions of a communication terminal
[0770] The communication terminal uses built-in sensors to measure signal strength and connection stability. Based on this data, the terminal uses wireless communication technologies such as Bluetooth and Wi-Fi to detect other nearby terminals and create a list of potential relay devices.
[0771] The communication terminal captures the user's voice using its voice input function and analyzes their emotions through an emotion analysis engine. Specifically, "natural language processing" and "machine learning algorithms" can be used for emotion analysis. The results of this analysis are used as important input data for optimizing communication.
[0772] Server Functions
[0773] The server comprehensively analyzes communication data and sentiment analysis data transmitted from each terminal. It utilizes generative AI models (e.g., models using TensorFlow or PyTorch) to set the optimal communication path according to the user's emotional state. Through AI analysis and optimization techniques, it prioritizes fast and stable communication, especially when the user is expressing unpleasant emotions.
[0774] Furthermore, after the communication is successfully provided, the server calculates the communication costs incurred and bills the user. Appropriate compensation is distributed to other users who provided relay equipment. This compensation serves as an incentive to encourage cooperation from other users and improve the overall efficiency of the network.
[0775] Specific example
[0776] For example, if a user complains in a cafe that "the internet is too slow to work," a terminal that detects this complaint will send back an analysis result indicating "discomfort." Based on this data, the server will select a nearby, powerful relay device and set up the optimal communication path.
[0777] Example of a prompt
[0778] "If a user is dissatisfied with their experience at a cafe, please explain how the device can provide an optimal communication environment. Please also mention specific methods and technologies used."
[0779] The flow of the specific processing in Example 2 will be explained using Figure 13.
[0780] Step 1:
[0781] The terminal uses a built-in signal sensor to measure current signal strength and connection stability. The input data consists of real-time measurements of ambient signal strength and connection stability, while the output is communication environment evaluation data. By processing this data, the current communication status can be quantified and understood.
[0782] Step 2:
[0783] The device uses Bluetooth and Wi-Fi to detect nearby communication devices. It collects the MAC addresses and signal strength information of the detected devices as data input and creates a list of potential relay devices as output. This identifies available relay devices. The detected devices are listed and used for the selection process in the next step.
[0784] Step 3:
[0785] The device acquires the user's voice input through the microphone and sends it to the emotion analysis engine. The voice data becomes the input, and as a result of the processing, the user's emotional state is output. Here, the AI model performs emotion analysis based on the tone and content of the voice and obtains evaluation results such as "unpleasant" or "normal".
[0786] Step 4:
[0787] The terminal selects the optimal relay device based on a list of candidate relay devices and the results of sentiment analysis. Signal strength, distance, and sentiment evaluation are inputs, and the output is the selected relay device. Using Bluetooth communication, mutual authentication is performed with the selected relay device, and communication resources are borrowed. At this stage, aggregated data processing is performed according to the selection criteria.
[0788] Step 5:
[0789] The server receives environmental and emotional data from terminals and sets the optimal communication path. Data input consists of communication status data and emotional evaluations collected from each terminal, while output is the optimized communication path. A generative AI model is used to perform data analysis and path optimization, establishing high-priority communications.
[0790] Step 6:
[0791] The server calculates communication costs after confirming stable communication. It also bills users appropriately and rewards other users who provided relay equipment. Inputs to the process include communication usage and improvement factors based on sentiment, while outputs are billing cost and reward data. Rewards are processed by an aggregation and distribution algorithm on the server side.
[0792] (Application Example 2)
[0793] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".
[0794] The present invention aims to achieve stable data communication even in environments with unstable communication, improve communication quality based on user emotions, and enhance the user experience. Furthermore, it aims to provide a comfortable living environment by utilizing user emotions in the control of home appliances.
[0795] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.
[0796] In this invention, the server includes means for the communication device to analyze the user's emotions, means for prioritizing an appropriate communication path to improve communication quality based on the emotion data, and means for the wearable device to perform environmental control via the emotion data. This enables optimal communication and environmental control in accordance with the user's emotions.
[0797] A "communication device" is a device that can measure radio wave strength and evaluate connection stability.
[0798] A "relay device" is an auxiliary device used to effectively transfer data between communication devices.
[0799] "User emotions" refers to data that describes the user's psychological state, obtained through voice analysis.
[0800] "Emotional data" refers to information obtained by analyzing a user's emotions.
[0801] "Communication path" refers to the network route that data takes when it is transmitted.
[0802] A "wearable device" is a device that a user can wear to receive instructions for environmental control.
[0803] "Environmental control" refers to the act of adjusting home appliances and surrounding environmental settings in accordance with the user's emotional data.
[0804] "Data transmission" refers to the act of transferring information over a network.
[0805] "Emotion analysis" is the process of identifying a user's emotions from voice and other inputs.
[0806] This invention provides a system that allows users to maintain a comfortable communication environment while simultaneously adaptively controlling the surrounding environment based on emotional data. The server provides a foundation for communication and environmental control through cooperation with multiple communication devices and wearable devices.
[0807] First, the terminal functions as a communication device, measuring signal strength and connection stability using Wi-Fi and Bluetooth. When the user speaks, the audio data is converted into text using speech recognition software (e.g., Google Speech-to-Text API). The converted text is then analyzed using sentiment analysis software (e.g., IBM Watson Tone Analyzer) to determine the user's emotions and generate sentiment data.
[0808] The server comprehensively analyzes emotional data and communication quality information. Utilizing artificial intelligence, it selects the optimal communication path based on the user's emotions, ensuring high-speed and stable data transmission. For example, if the analysis indicates a user is experiencing stress, the server immediately optimizes the communication path to improve the user experience.
[0809] Furthermore, the wearable device controls home appliances based on analyzed emotional data. Specifically, it provides a comfortable living environment by adjusting lighting and music according to the user's emotions.
[0810] This system allows users to receive personalized communication and environmental adjustments tailored to their individual emotional states, improving comfort and convenience. Generative AI models can also be used to predict the most suitable environmental settings for a user's emotions.
[0811] For example, if a user says "I'm a little cold," and the analyzed emotion is "uncomfortable," the wearable device will instantly adjust the heating and play relaxing music. To realize such a scenario, the following prompt might be input to the generative AI model: "If the user finds it too loud, consider how the sound settings should be improved."
[0812] The flow of a specific process in Application Example 2 will be explained using Figure 14.
[0813] Step 1:
[0814] The device uses Wi-Fi and Bluetooth functionality to measure ambient radio wave strength and connection stability. The input is the surrounding wireless signal, and the output is data on the signal's strength and stability. This allows for understanding the current connection status.
[0815] Step 2:
[0816] When a user speaks, the device collects the audio data and converts it into text data using speech recognition software (e.g., Google Speech-to-Text API). The input is the user's voice, and the output is text data. This text data is used for analyzing the user's sentiment.
[0817] Step 3:
[0818] The collected text data is analyzed using sentiment analysis software (e.g., IBM Watson Tone Analyzer) to obtain user sentiment data. The input is the text data obtained in step 2, and the output is sentiment data. This process clarifies the user's psychological state.
[0819] Step 4:
[0820] The server receives emotion data and connection status data transmitted from the terminal and selects the optimal communication path. The input is emotion data and connection status data, and the output is the selected communication path. Artificial intelligence is used to comprehensively analyze this data to achieve high-speed and stable communication.
[0821] Step 5:
[0822] The server uses a generative AI model to instruct the wearable device to configure the optimal environment settings based on the user's emotions. The input is emotion data, and the output is specific instructions for environment settings. The wearable device controls home appliances based on these instructions to improve the user's comfort.
[0823] Step 6:
[0824] Users send feedback on changes they perceive, and the system uses this feedback to adjust the environment in the future. The input is user feedback, and the output is adjustments to the environment control within the system. This allows for more personalized responses.
[0825] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.
[0826] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0827] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.
[0828] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[0829] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.
[0830] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.
[0831] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.
[0832] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.
[0833] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."
[0834] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.
[0835] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.
[0836] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.
[0837] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.
[0838] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[0839] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.
[0840] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.
[0841] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.
[0842] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.
[0843] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.
[0844] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.
[0845] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.
[0846] The following is further disclosed regarding the embodiments described above.
[0847] (Claim 1)
[0848] A means for measuring radio wave strength and connection stability in a communication device,
[0849] The communication device includes means for detecting other nearby communication devices,
[0850] The means for selecting an appropriate relay device based on the communication quality from other communication devices detected by the aforementioned communication device,
[0851] The means by which the communication device sends a connection request to the selected relay device and borrows communication resources,
[0852] A means by which the server optimizes the communication path and efficiently transmits data,
[0853] A means of calculating the costs incurred by the user and distributing compensation to the provider of the relay device,
[0854] A system that includes this.
[0855] (Claim 2)
[0856] The system according to claim 1, wherein the communication device detects other nearby communication devices using Bluetooth or WiFi.
[0857] (Claim 3)
[0858] The system according to claim 1, wherein the server uses artificial intelligence to optimize data transmission.
[0859] "Example 1"
[0860] (Claim 1)
[0861] A means for a communication terminal to continuously monitor radio wave strength and connection stability,
[0862] The aforementioned communication terminal includes means for detecting other communication terminals in its vicinity using wireless communication technology,
[0863] The aforementioned communication terminal evaluates the stability of communication based on the detection results and selects the optimal relay terminal,
[0864] A means for the aforementioned communication terminal to send a connection request to a relay terminal selected by the aforementioned communication terminal, and to borrow resources to perform data communication,
[0865] A data network management device optimizes communication paths and improves communication performance.
[0866] A means to accurately calculate the costs of using communication services and to allocate appropriate compensation to resource providers,
[0867] A system that includes this.
[0868] (Claim 2)
[0869] The system according to claim 1, wherein the communication terminal detects other communication terminals in the vicinity using short-range wireless communication technology.
[0870] (Claim 3)
[0871] The system according to claim 1, wherein the data network management device utilizes a machine learning model to ensure efficient data transfer.
[0872] "Application Example 1"
[0873] (Claim 1)
[0874] A device having communication capabilities includes means for measuring signal strength and connection stability,
[0875] The device includes means for detecting other devices in the vicinity that have communication functions,
[0876] The aforementioned device includes means for selecting an appropriate relay device based on communication quality from other devices detected by the device,
[0877] The aforementioned device transmits a connection request to a selected relay device and borrows communication resources;
[0878] A means by which a data processing device optimizes the communication path and efficiently transmits data,
[0879] A means of calculating the costs incurred by the user and distributing compensation to the provider of the relay device,
[0880] A means of automatically optimizing the communication environment in public places in smart cities,
[0881] A means of providing benefits to participating users by performing optimization processing using location information and connection history,
[0882] A system that includes this.
[0883] (Claim 2)
[0884] The system according to claim 1, wherein the device detects other devices in the vicinity using short-range wireless communication or a wireless network.
[0885] (Claim 3)
[0886] The system according to claim 1, wherein the data processing device optimizes data transmission using machine learning.
[0887] "Example 2 of combining an emotion engine"
[0888] (Claim 1)
[0889] A means for measuring radio wave strength and connection stability in a communication terminal,
[0890] The aforementioned communication terminal includes means for detecting other nearby communication terminals,
[0891] The means for selecting an appropriate relay device based on the communication quality from other communication terminals detected by the aforementioned communication terminal,
[0892] The means by which the aforementioned communication terminal sends a connection request to the selected relay device and borrows communication resources,
[0893] The aforementioned communication terminal includes means for analyzing the user's emotions using voice input,
[0894] A means by which the server optimizes the communication path and efficiently transmits data,
[0895] A means by which the server uses artificial intelligence to adjust the communication path according to the user's emotions,
[0896] A means of calculating the costs incurred by the user and distributing compensation to the provider of relay equipment,
[0897] A system that includes this.
[0898] (Claim 2)
[0899] The system according to claim 1, wherein the communication terminal detects other nearby communication terminals using wireless communication technology.
[0900] (Claim 3)
[0901] The system according to claim 1, wherein the server optimizes data transmission using a generated AI model.
[0902] "Application example 2 when combining with an emotional engine"
[0903] (Claim 1)
[0904] A means for measuring radio wave strength and connection stability in a communication device,
[0905] The communication device includes means for detecting other nearby communication devices,
[0906] The aforementioned communication device includes means for analyzing the user's emotions,
[0907] The aforementioned communication device has means for selecting an appropriate relay device to improve communication quality based on the analyzed emotion data,
[0908] The means by which the communication device sends a connection request to the selected relay device and borrows communication resources,
[0909] A means by which the server optimizes the communication path to efficiently transmit data and prioritizes communication paths that respond to the user's emotions,
[0910] A means of calculating the costs incurred by the user and distributing compensation to the provider of the relay device,
[0911] A system that includes means for a wearable device to control the environment via emotional data.
[0912] (Claim 2)
[0913] The system according to claim 1, wherein the communication device uses Bluetooth or WiFi to detect other nearby communication devices and performs control based on emotion data.
[0914] (Claim 3)
[0915] The system according to claim 1, wherein the server uses artificial intelligence to analyze emotional data and optimize data transmission. [Explanation of Symbols]
[0916] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>
Claims
1. A means for measuring radio wave strength and connection stability in a communication device, The communication device includes means for detecting other nearby communication devices, The means for selecting an appropriate relay device based on the communication quality from other communication devices detected by the aforementioned communication device, The means by which the communication device sends a connection request to the selected relay device and borrows communication resources, A means by which the server optimizes the communication path and efficiently transmits data, A means of calculating the costs incurred by the user and distributing compensation to the provider of the relay device, A system that includes this.
2. The system according to claim 1, wherein the communication device detects other nearby communication devices using Bluetooth or WiFi.
3. The system according to claim 1, wherein the server uses artificial intelligence to optimize data transmission.