system
A system that collects, compares, and translates flight information into Japanese for users at foreign airports addresses language barriers, ensuring accurate and timely flight updates.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-21
- Publication Date
- 2026-03-06
AI Technical Summary
Users face difficulties in obtaining accurate flight information at airports in foreign countries where they do not speak the local language, leading to potential misinterpretation of flight information due to language barriers.
A system that collects flight information from an airport's system, allows users to register their flight details, compares and translates this information into Japanese, and notifies users through their devices, ensuring timely and accurate updates.
Enables users to receive accurate and up-to-date flight information in Japanese without language barriers, reducing errors and providing a convenient travel experience.
Smart Images

Figure 2026037427000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] When using an airport in a foreign country where the language is not spoken, users face the problem of difficulty in obtaining accurate flight information. This puts users at risk of acting on incorrect flight information. Furthermore, airport announcements and bulletin boards are displayed only in the local language, making it difficult for users unfamiliar with languages other than Japanese to understand the information. There is a need for a system that can solve these problems and overcome language barriers to provide accurate flight information. [Means for solving the problem]
[0005] The present invention provides a system that includes a means for collecting flight information from an airport's flight information system and a means for users to register their own flight information. Furthermore, the system includes a means for comparing the registered flight information with the collected flight information, a means for translating the compared flight information into Japanese, and a means for notifying the user of the translated flight information on their terminal. This allows users to receive accurate flight information in Japanese without worrying about language barriers. Furthermore, by periodically updating the collected flight information, users can always obtain the latest information. This system reduces errors in obtaining flight information due to language barriers.
[0006] "Flight Information System" means an electronic system operated by an airport to manage and provide flight schedules, gate information, departure and arrival times, etc.
[0007] "Flight information" is a collective term for information regarding an aircraft's flight number, departure time, arrival time, boarding gate, and current status (e.g., on time, delayed, canceled, etc.).
[0008] "User" refers to travelers using the airport and those who require flight information.
[0009] "Registering" refers to the process by which a User enters their flight information into the System and stores that information in the System.
[0010] "Collecting" is the process of obtaining the latest flight information from an external flight information system and storing it within the system.
[0011] "Matching" is the process of comparing the flight information registered by the user with the collected flight information to see if they match.
[0012] "Translating" refers to the process of converting flight information into another language, specifically Japanese.
[0013] "Notifying" is the process of sending information to a specific user through their device to inform them.
[0014] "Terminal" means a device used by a user to receive information, including a smartphone, tablet, or PC.
[0015] The term "system" refers to an overall configuration for performing a specific function by integrating multiple means and processes according to the present invention. [Brief explanation of the drawings]
[0016] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0017] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0018] First, the terms used in the following description will be explained.
[0019] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0020] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0021] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0022] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0024] [First embodiment]
[0025] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0026] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0027] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0028] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0029] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0031] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0032] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0033] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0034] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0035] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0036] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0037] The present invention relates to a system for providing airport flight information in Japanese, and specific embodiments thereof will be described below.
[0038] First, the system is composed of multiple means. Users can register their flight information in the system. As a registration means, users are provided with an interface for entering their flight number and departure date and time.
[0039] Next, the server has a collection means for connecting to the airport's flight information system and periodically collecting all flight information, which is then stored in a database.
[0040] The server compares the flight information registered by the user with the collected flight information, and the comparison means searches all flight information based on the flight number registered by the user to obtain the corresponding latest flight information.
[0041] The collated flight information is then translated into Japanese. The translation means converts the flight information into a predefined Japanese format and prepares it for display in a form that is easily understandable to the user.
[0042] The translated flight information is sent from the server to the user's device via push notification, email, in-app notification, etc. The device then displays the received notification to the user.
[0043] Specific examples
[0044] For example, consider a scenario in which Tanaka uses this system. Tanaka logs into the system and registers his flight, "XZ123." The server records this information and periodically compares it with information collected from the airport's flight information system. At one point, the server receives an update from the flight information system stating that "the departure time of XZ123 has been changed to 14:00."
[0045] The server translates this information into Japanese and generates a message such as, "The departure time of flight XZ123 has been changed to 14:00." The server then notifies Tanaka of this Japanese message on his smartphone. Tanaka's device receives the notification and displays it on its screen. This allows Tanaka to check the latest flight information in Japanese without experiencing any language barriers.
[0046] As described above, the system based on the present invention enables users to receive appropriate flight information in Japanese even at airports in foreign countries where they do not understand the language. This system provides a convenient environment for users through a series of processes, from registering flight information to collecting, translating, and notifying the latest information.
[0047] The processing flow will be explained below.
[0048] Step 1:
[0049] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[0050] Step 2:
[0051] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[0052] Step 3:
[0053] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[0054] Step 4:
[0055] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[0056] Step 5:
[0057] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information, which is then stored in a database.
[0058] Step 6:
[0059] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[0060] Step 7:
[0061] (Server) If matching flight information is found, the information is translated into Japanese. The translated information is converted into a format such as "The departure time of flight XXX has been changed to XXX."
[0062] Step 8:
[0063] (Server) The translated Japanese guide is sent to the user's device via push notification, email, or in-app notification.
[0064] Step 9:
[0065] (Device) The user's device receives the notification and displays the notification content on the screen. The user can check the notification and obtain the latest flight information in Japanese.
[0066] Step 10:
[0067] After receiving the notification, the user further utilizes the system to check flight information as needed, including additional information such as departure gate changes.
[0068] Example 1
[0069] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0070] Currently, flight information provided at many airports is written in English, making it difficult for users who are unfamiliar with foreign languages to accurately understand the latest flight information. Furthermore, when flight information changes, there are limited ways to quickly grasp the information. To solve this problem, there is a need for a system that provides flight information in Japanese, allowing users to easily obtain the latest information.
[0071] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0072] In this invention, the server includes means for providing an interface for users to register their flight information, means for periodically collecting airport flight information and storing it in a database, means for comparing the flight information registered by users with the collected flight information, means for using machine translation software to translate the compared flight information into Japanese, and means for notifying the user's terminal of the translated flight information, thereby enabling users to quickly receive the latest information about their flights in Japanese and eliminating the barrier of information transmission in foreign languages.
[0073] "User" means a person who uses the system to register his / her flight information and obtain the latest flight information based on that information.
[0074] An "interface" is software or hardware that serves as a point of contact through which a user inputs data into or receives information from a system.
[0075] A "server" is a central computer system that provides data and services to other computers and terminals via a network.
[0076] "Database" means a structured information system for storing and managing collected flight information and user-registered information.
[0077] "Matching" refers to the process of comparing the flight information registered by the user with the flight information collected by the server and identifying matching information.
[0078] "Translation" refers to the process of converting collected flight information into Japanese using machine translation software.
[0079] "Notification" refers to the means or process for notifying the user of translated flight information on their terminal.
[0080] A "terminal" is a device that a user uses to receive and display information, and includes smartphones, tablets, and personal computers.
[0081] "Push notification" is a communication method that sends information from a server to a device in real time to notify the user.
[0082] "Machine translation software" means software that automatically translates input text into a specified language.
[0083] The present invention is a system that provides flight information in Japanese at airports, and a specific embodiment thereof is described below. The main elements required are a user, a server, and a terminal, which work together to provide information.
[0084] Flight information registration
[0085] A user uses the provided web or mobile application to register their flight information. Specific flight information includes flight number and departure date and time. When the user enters the registration information through the interface and clicks the "Register" button, the information is sent to the server and stored in the database. For example, the user registers flight number "AB123" and departure date and time "2023-10-12 10:00."
[0086] Collecting flight information
[0087] The server periodically connects to the airport's flight information system to collect and store the latest flight information. This is done using API requests using Python scripts, etc. The collected data is then stored in a database on the server. Specifically, an internet-enabled server and a database server are required, and flight information is obtained from the airport API.
[0088] Flight information verification
[0089] The server matches the flight information registered by the user with the collected flight information, using a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. This matching process allows the user to identify the latest information they want to know.
[0090] Flight information translation
[0091] The collated flight information is translated into Japanese. Machine translation software such as Google® Translate API is used for the translation. The collated English flight information is converted into Japanese text and formatted in a way that is easy for users to understand. For example, "Flight AB123 has been delayed to 14:00." is converted to "Flight AB123 has been delayed to 14:00."
[0092] Flight information notifications
[0093] The translated flight information is sent from the server to the user's device. This notification is sent as a push notification using Firebase Cloud Messaging (FCM). In addition to push notifications, email or in-app notifications may also be used. For example, a message saying "The departure time of flight AB123 has been changed to 14:00" is sent.
[0094] View flight information
[0095] The user's device (smartphone, tablet, PC, etc.) will display the received notification. The user can check the notification and understand the latest flight information in Japanese. Specifically, the user's smartphone will receive a notification with the message "Flight AB123 has been delayed until 14:00."
[0096] Adding specific examples
[0097] For example, a user registers their flight "XZ123" in the system, and the server records this information. The latest information is periodically collected from the airport's flight information system, and when the latest information is obtained, it is translated as "The departure time of XZ123 has been changed to 14:00." The server then pushes this Japanese message to the user's smartphone. The user's device receives the notification and displays it on the screen, allowing the user to check the latest flight information in Japanese.
[0098] Examples of prompt statements
[0099] "Please explain the overview of the system that translates and notifies airport flight information into Japanese."
[0100] "Please tell me in detail the process of collecting the latest information based on the flight information registered by the user and notifying them in Japanese."
[0101] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0102] Step 1: User registers their flight information
[0103] The user uses the interface of a web or mobile application to enter flight information (flight number and departure date and time). The entered information is sent to the server and stored in the database by pressing the "Register" button. Specifically, the user enters the flight number "AB123" and departure date and time "2023-10-12 10:00" and clicks the "Register" button. Input data: flight number, departure date and time. Output data: flight information stored in the database.
[0104] Step 2: The server periodically collects airport flight information
[0105] The server periodically connects to the airport's flight information system and collects the latest information on all flights through API requests. The collected information is stored in a database. For example, a Python script is used to get the latest flight information from the airport API and store it in the database. Input data: Flight information from the airport API. Output data: All flight information stored in the database.
[0106] Step 3: The server checks the flight information registered by the user against the collected flight information.
[0107] The server periodically retrieves the user's registration information from the database and compares it with all the flight information collected. It uses a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. For example, a query like "SELECT FROM flights WHERE flight_number='AB123'" is used. Input data: The flight number registered by the user. Output data: The latest matched flight information.
[0108] Step 4: The server translates the matched flight information into Japanese.
[0109] The server translates the matched flight information into Japanese using machine translation software (e.g., Google Translate API). This converts flight information obtained in English (e.g., "Flight AB123 has been delayed to 14:00") into Japanese text (e.g., "Flight AB123 was delayed to 14:00"). Input data: English flight information. Output data: Flight information translated into Japanese.
[0110] Step 5: The server sends the translated flight information to the user's device.
[0111] The server notifies the user's device of the flight information translated into Japanese. This notification is made using Firebase Cloud Messaging (FCM). For example, the Python "pyfcm" library is used to send a push notification to the user's device. Input data: Flight information translated into Japanese. Output data: Push notification sent to the user's device.
[0112] Step 6: Your device receives and displays the notification
[0113] The user's device receives the push notification sent from the server and displays it on the screen. This allows the user to check the latest flight information in Japanese. For example, a message such as "Flight AB123 has been delayed to 14:00" is displayed in the smartphone's notification center. Input data: Received push notification. Output data: Flight information displayed on the screen.
[0114] This allows users to obtain the latest flight information without language barriers.
[0115] (Application example 1)
[0116] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0117] Understanding the operating status and maintenance information of factory equipment in real time is important for efficient production management. However, when different equipment information is provided in multiple languages, it is difficult for factory managers and operators to quickly and accurately understand the information. Furthermore, if equipment abnormalities and maintenance information is not received in a timely manner, the production line may stop and business efficiency may decrease.
[0118] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0119] In this invention, the server includes means for collecting information on the operation status of equipment from the factory equipment information system, means for users to register information on the equipment they manage, means for comparing the registered equipment information with the collected equipment information, means for translating the compared equipment information into Japanese, and means for notifying the translated equipment information to the user's terminal. This makes it possible to grasp the latest equipment information in real time and receive timely notifications in Japanese.
[0120] A "factory equipment information system" is an information system for collecting, managing, and monitoring the operating status and maintenance information of equipment within a factory.
[0121] "Device operation status information" is information about the current operating status of the device (for example, operating, stopped, undergoing maintenance, etc.).
[0122] "Means for users to register information about devices they manage" refers to the interface and mechanism by which users can input and register information about devices they manage into the system.
[0123] "Means for verifying registered equipment information with collected equipment information" refers to a mechanism for comparing and verifying equipment information registered by the user with the latest equipment information collected from the factory's equipment information system.
[0124] "Means for translating equipment information into Japanese" refers to a system for converting collected or collated equipment operating status information into Japanese.
[0125] "Means for notifying the user of translated device information" refers to a mechanism for notifying the user of the translated device's operating status information on the user's device (e.g., a smartphone, tablet, etc.).
[0126] The present invention relates to a system that provides the latest information on equipment in a factory in Japanese and notifies the user's terminal, and specific embodiments thereof are described below.
[0127] First, the system is composed of multiple means. Users can register information about the devices they manage in the system. As a registration method, users are provided with an interface for entering the IDs and names of the devices they manage.
[0128] Next, the server is connected to the factory's equipment information system and has a means of periodically collecting information on the operating status of all equipment. This collected equipment information is stored in a database.
[0129] The server compares the device information registered by the user with the collected device information. The comparison means searches all device information based on the device ID registered by the user and obtains the corresponding latest operating status information.
[0130] The collated device information is then translated into Japanese. The translation means converts the device information into a predetermined Japanese format and prepares it for display in a form that can be easily understood by the user.
[0131] The translated device information is sent from the server to the user's device. Possible notification methods include push notifications, emails, and in-app notifications. The device then displays the received notification to the user. This allows users to check the latest device information in Japanese without experiencing a language barrier.
[0132] As a concrete example, consider a scenario in which a factory manager uses this system. The manager logs into the system and registers the device "MACH01" that he manages. The server records this information and periodically compares it with information collected from the factory's device information system. At one point, the server receives the latest information from the device information system stating that "the operating status of MACH01 has changed to operating."
[0133] The server translates this information into Japanese and generates a message such as "The latest status of device MACH01 is up and running." The server then notifies the administrator of this Japanese message. The administrator's device receives the notification and displays it on the screen. This allows the administrator to check the latest device information in Japanese without having to worry about the language barrier.
[0134] The hardware and software used here include a server for connecting to the device information system, a database for managing user information, an API for processing collected information, and a push notification service for sending notifications. For example, the server is built using Python and runs code that connects to an API for collecting flight information. MySQL (registered trademark) or PostgreSQL is used as the database, and Firebase Cloud Messaging (FCM) is used for push notifications.
[0135] In addition, the translation function is realized by a generative AI model, and examples of prompt sentences that translate appropriately into Japanese are as follows:
[0136] "Please translate the latest status of the factory equipment in Japanese. For example:
[0137] 'running' -> 'Running'
[0138] 'maintenance required' -> 'maintenance required'
[0139] 'shutdown' -> 'stopping'"
[0140] As described above, the system based on the present invention grasps the operating status of equipment within a factory in real time and notifies the manager in Japanese, enabling the manager to efficiently manage the factory.
[0141] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0142] Step 1:
[0143] The server collects information on the operation status of equipment from the factory's equipment information system. Specifically, it periodically sends requests to the API endpoint to obtain the latest information. The input is the API request, and the output is equipment information data in JSON format. This data is stored in a database on the server.
[0144] Step 2:
[0145] Users register information about the devices they manage in the system. The user enters the device ID and name through the interface, and that information is sent to the server and recorded in the database. The input is the device information registered by the user, and the output is the device information being saved to the database.
[0146] Step 3:
[0147] The server compares the registered device information with the collected device information. Specifically, it searches for and retrieves the latest operating status information based on the device ID registered by the user in the database. The input is the device ID and latest device information stored in the database, and the output is the operating status data of the compared devices.
[0148] Step 4:
[0149] The server translates the matched device information into Japanese. It uses a prompt generated by the AI model to convert the operation status information into Japanese. The input is the matched device information, and the output is the device operation status sentence translated into Japanese. Specifically, the following prompt sentence is sent to the AI model, which then translates it:
[0150] "Please translate the latest status of the factory equipment in Japanese. For example:
[0151] 'running' -> 'Running'
[0152] 'maintenance required' -> 'maintenance required'
[0153] 'shutdown' -> 'stopping'"
[0154] Step 5:
[0155] The server notifies the user's device of the translated device information. Specifically, the translated information is sent using push notifications or email sending functions. The input is the device information translated into Japanese, and the output is the completion of notification to the user's device. Firebase Cloud Messaging (FCM) and similar services are used for push notifications.
[0156] Step 6:
[0157] The user device displays the received notification. The received message is displayed in the device's notification center or application. The input is the notification information received from the server, and the output is a screen display that the user can see. Specifically, the device's notification function or application UI is activated.
[0158] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0159] The present invention is a system that overcomes language barriers and enables users to receive airport flight information in Japanese. Furthermore, the present invention is a system that incorporates an emotion engine that recognizes the user's emotions and adjusts the content and format of information notifications based on the emotions.
[0160] The system comprises the following means:
[0161] 1. Flight information registration:
[0162] The user registers his / her flight information in the system by inputting his / her flight number and departure date and time and sending it to the server.
[0163] 2. Collecting flight information:
[0164] The server periodically connects to the airport's flight information system to collect the latest information on all flights, which is then stored in a database that is kept up to date.
[0165] 3. Flight information verification:
[0166] The server compares all collected flight information with the flight information registered by the user, and identifies the latest flight information corresponding to the flight number registered by the user.
[0167] 4. Flight Information Translation:
[0168] The collated flight information is translated into Japanese. The server uses a translation means to convert the flight information into a Japanese format.
[0169] 5. Emotion Engine:
[0170] It has a built-in emotion engine that recognizes the user's emotions. The emotion engine analyzes the user's current emotional state based on the user's facial expressions, voice, past behavioral patterns, etc.
[0171] 6. Emotion-based notification adjustment:
[0172] Based on the perceived emotion, the server adjusts the content and format of the notification, for example, delivering the notification faster and in a clearer format if the user is feeling impatient or anxious.
[0173] 7. Flight Information Notification:
[0174] The translated flight information and adjusted notifications are sent from the server to the user's device, which receives the notifications and displays them to the user.
[0175] Program processing explanation
[0176] Step 1: User Registration and Login
[0177] (User) Accesses the system to register or log in as a new user. When registering as a new user, the user enters the required information and sends it to the system. The server receives this information, stores it in the database, and performs authentication.
[0178] Step 2: Register your flight information
[0179] After logging in, the user enters the flight number and departure date and time to register. The server receives this information and stores it in the database.
[0180] Step 3: Gather your flight information
[0181] (Server) Connects to the airport's flight information system and periodically collects the latest flight information. The collected data is stored in a database.
[0182] Step 4: Check and translate flight information
[0183] (Server) Compares the flight information registered by the user with the latest flight information and translates the matching flight information into Japanese.
[0184] Step 5: Activating the Emotion Engine
[0185] (Server) The emotion engine collects facial expression and voice data from the user's device and analyzes their emotional state. As a result of the analysis, it identifies whether the user is relaxed, anxious, or in a hurry.
[0186] Step 6: Adjust notifications
[0187] (Server) Adjust the notification content and format based on the analysis results of the emotion engine. For example, send a warning notification to a user who is anxious, and send information in a standard notification format to a user who is relaxed.
[0188] Step 7: Flight Information Notification
[0189] The server sends the adjusted notification to the user's device, which receives it and displays it on the screen or provides an audio notification to the user. This allows the user to obtain the latest flight information in real time and receive the information in a way that suits their emotional state.
[0190] Specific examples
[0191] For example, consider a scenario in which Mr. Sato uses the system. After registering as a new user, Mr. Sato registers his flight "AA123." The server periodically retrieves the latest flight information from the airport information system and receives information that "the departure time of AA123 has been changed to 15:30."
[0192] The server translates this information and displays it in Japanese as "The departure time of flight AA123 has been changed to 15:30." At the same time, if the emotion engine detects an emotion of impatience from Sato's facial expression or voice data, the server emphasizes the content of the notification and notifies Sato's smartphone of the information in a format that conveys urgency. Sato's device receives the notification and displays the message, "The departure time of flight AA123 has been changed. Please be careful."
[0193] This system will allow Sato to receive accurate flight information in Japanese in a timely manner, and the information will be presented in an easy-to-understand format that is tailored to his current emotions.
[0194] The processing flow will be explained below.
[0195] Step 1:
[0196] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[0197] Step 2:
[0198] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[0199] Step 3:
[0200] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[0201] Step 4:
[0202] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[0203] Step 5:
[0204] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information. The collected latest flight information is stored in a database.
[0205] Step 6:
[0206] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[0207] Step 7:
[0208] (Server) If matching flight information is found, translate the information into Japanese. Use translation means to convert the flight information into Japanese format.
[0209] Step 8:
[0210] (Server) Activates the emotion engine and collects the user's facial expression and voice data from the device. The emotion engine analyzes this data and identifies the user's emotional state.
[0211] Step 9:
[0212] (Server) Adjust the content and format of notifications based on the user's recognized emotions. For example, if the user is anxious, make the notification more emphatic and less anxious.
[0213] Step 10:
[0214] (Server) Send adjusted Japanese notifications to the user's device.
[0215] Step 11:
[0216] (Device) The user's device receives the notification and displays the notification content on the screen. If necessary, a voice notification is also provided.
[0217] Step 12:
[0218] (User) Check notifications on the device to understand flight changes and warnings. This allows the user to understand the latest flight information and reduce anxiety.
[0219] Example 2
[0220] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0221] While users have a need to receive airport flight information in Japanese, flight information is usually provided in international languages, creating a language barrier. Furthermore, if flight information notifications are uniformly provided, it is not possible to provide appropriate information according to the user's emotional state, and users who feel anxious or impatient cannot receive prompt and clear information.
[0222] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for collecting flight information from an airport's flight information system, a means for a user to register their own flight information, a means for comparing the registered flight information with the collected flight information, a means for translating the compared flight information into Japanese, a means for notifying the translated flight information to the user's terminal, an emotion recognition means for analyzing the user's emotional state, and a means for adjusting the notification content based on the analysis result. This allows the user to obtain real-time flight information in Japanese and receive the information in an appropriate format according to their emotional state at that time.
[0223] An "airport flight information system" is a digital system that provides flight information such as aircraft departure and arrival times, gate numbers, and delay information.
[0224] "Flight information collection" is the process of obtaining up-to-date flight data from the airport's flight information system.
[0225] "User" means an individual who uses the system and registers and receives their flight information.
[0226] "Registering flight information" refers to the act of a user entering and saving the flight number and departure date and time of the user's planned flight into the system.
[0227] "Flight information matching" is the process of comparing the flight information registered by the user with the latest collected flight information to find matching data.
[0228] "Flight information translation" is the process of converting flight information into Japanese.
[0229] A "notification" is a message or alert sent to inform a user of specific information.
[0230] A "terminal" is a digital device such as a smartphone or computer that a user owns.
[0231] The "emotion recognition means" is a system that analyzes the user's facial expressions and voice data to determine their current emotional state (relaxed, anxious, anxious, etc.).
[0232] The "analysis result" is data obtained after the emotion recognition means analyzes the user's emotional state.
[0233] "Adjusting notification content" is the process of changing the content and display format of a notification message based on the user's emotional state.
[0234] The present invention provides a system that allows users to receive airport flight information in Japanese and adjusts the content and format of the information notification based on the user's emotional state. Specifically, the system includes the following means:
[0235] Flight information registration
[0236] Users access the system and register by entering their flight information (flight number and departure date and time). After registration, the server stores this information in a database. The terminals used by users are digital devices such as smartphones and PCs.
[0237] Collecting flight information
[0238] The server periodically connects to the airport's flight information system to collect the latest flight information, which is then stored in a database and updated in real time using a digital interface such as an airport information API.
[0239] Flight information collation and translation
[0240] The server compares the flight information registered by the user with the latest flight information collected and identifies matching flight information. This matching flight information is then translated into Japanese using translation software such as a real-time translation API.
[0241] Analysis by emotion engine
[0242] The server collects facial expression and voice data from the user's device and analyzes this data using an emotion engine. The emotion engine determines whether the user is relaxed, anxious, or in a hurry. Analysis of the user's emotional state uses a facial recognition API and voice emotion recognition software.
[0243] Adjusting notification content
[0244] The server adjusts the content and format of notifications based on the analysis results of the emotion engine. For example, it sends a warning notification to a user who is anxious, and a regular notification to a user who is relaxed.
[0245] Flight information notifications
[0246] The server then sends the tailored notification to the user's device, which receives the notification and displays it on the screen or provides an audio notification to the user, allowing the user to obtain the latest flight information in real time and receive it in a format that suits their emotional state.
[0247] Specific examples
[0248] Specifically, suppose a user registers his / her flight "AB123" after registering a new flight. The server retrieves the latest flight information from the airport information system and obtains the information that "the departure time of AB123 has been changed to 16:00."
[0249] The server translates this information into Japanese and converts it to "The departure time of flight AB123 has been changed to 16:00." At the same time, if the emotion engine detects an emotion of impatience from the user's facial expression or voice data, the server emphasizes the notification content and sends the information in a format that conveys urgency, saying, "The departure time of flight AB123 has been changed. Please be careful." The user's device receives this and displays it on the screen.
[0250] Examples of prompt statements
[0251] Examples of prompts to input to a generative AI model include:
[0252] "Collect flight information entered by the user and translate it into Japanese. Then, explain in detail how to analyze the user's emotional state and provide the flight information in an appropriate notification format."
[0253] Using this prompt, the generative AI model can explain the detailed processing of the system in natural language.
[0254] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0255] Program processing flow
[0256] Step 1: User Registration and Login
[0257] 1. The user accesses the system's registration page and enters the required personal information (name, email address, password, etc.).
[0258] Input: Name, Email Address, Password
[0259] Data processing: Converting input information into the appropriate format
[0260] Output: Registration processing request
[0261] 2. When the user submits the information, the server receives the data and stores it in a database.
[0262] Input: Registration processing request
[0263] Data processing: Data validation and storage processing
[0264] Output: User information saved
[0265] 3. The server returns a message that user registration is complete.
[0266] Input: User information saved result
[0267] Data operation: generating a success or failure message
[0268] Output: Completion message
[0269] Step 2: Register your flight information
[0270] 1. After logging in, the user accesses the flight information registration page and enters the flight number and departure date and time.
[0271] Input: Flight number, departure date and time
[0272] Data processing: Format conversion of input information
[0273] Output: Flight information registration request
[0274] 2. When the user submits the information, the server receives the data and stores it in a database.
[0275] Input: Flight information registration request
[0276] Data processing: Data validation and storage processing
[0277] Output: Flight information saved
[0278] 3. The server returns a message that flight information registration is complete.
[0279] Input: Flight information saved result
[0280] Data operation: generating a success or failure message
[0281] Output: Completion message
[0282] Step 3: Gather your flight information
[0283] 1. The server periodically connects to the airport's flight information system to collect the latest flight information.
[0284] Input: None (periodic trigger)
[0285] Data processing: Data acquisition and processing from airport information API
[0286] Output: Collected flight information
[0287] 2. The server stores the collected flight information in a database.
[0288] Input: Collected flight information
[0289] Data processing: Data validation and storage processing
[0290] Output: Flight information saved
[0291] Step 4: Check and translate flight information
[0292] 1. The server retrieves the flight information registered by the user from the database.
[0293] Input: User ID
[0294] Data processing: generating and executing database queries
[0295] Output: Registered flight information
[0296] 2. The server checks the current flight information against the user's flight information.
[0297] Input: Registered flight information, latest collected flight information
[0298] Data processing: Matching process and extraction of matching data
[0299] Output: Matching flight information
[0300] 3. The server translates the matched flight information into Japanese.
[0301] Input: Matching flight information
[0302] Data calculation: Japanese conversion using translation API
[0303] Output: Translated flight information
[0304] Step 5: Activating the Emotion Engine
[0305] 1. The server collects facial expression and voice data from the user's device.
[0306] Input: facial expression data, voice data
[0307] Data Processing: Data collection and pre-processing
[0308] Output: Collected user data
[0309] 2. The server analyzes the data using an emotion engine to determine the emotional state.
[0310] Input: Collected user data
[0311] Data Calculation: Analysis with Emotion Recognition API
[0312] Output: Emotional state analysis results
[0313] 3. The server stores the analysis results and uses them to adjust notifications.
[0314] Input: Emotional state analysis results
[0315] Data processing: Saving to database
[0316] Output: Save completion result
[0317] Step 6: Adjust notifications
[0318] 1. The server adjusts the content and format of the notification based on the analysis results of the emotion engine.
[0319] Input: Emotional state analysis results, translated flight information
[0320] Data calculation: Adjusting notification content and format
[0321] Output: Reconciled notification message
[0322] 2. Provide highlighted notifications for anxious users and normal notifications for relaxed users.
[0323] Input: Reconciled notification message
[0324] Data operation: Notification message format conversion
[0325] Output: Optimized notification message
[0326] Step 7: Flight Information Notification
[0327] 1. The server sends the tailored notification to the user's device.
[0328] Input: Optimized notification message
[0329] Data processing: Creating push notification messages
[0330] Output: Send processing request
[0331] 2. The device receives the notification and displays it on the screen or provides an audio notification to the user.
[0332] Input: Notification message sent
[0333] Data calculation: Message analysis and display processing
[0334] Output: User notification display
[0335] (Application example 2)
[0336] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0337] In situations where users need to receive real-time information, such as international flight information or food delivery, language barriers and stress levels often hinder their understanding of the information. Furthermore, there is no way to provide information in an appropriate format depending on the user's emotional state, making it difficult to effectively communicate information.
[0338] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting flight information from an airport's flight information system, means for a user to register their own flight information, means for comparing the registered flight information with the collected flight information, means for translating the compared flight information into Japanese, means for notifying the translated flight information to the user's terminal, and means for recognizing the user's emotional state using an emotion engine and adjusting the content and format of the information notification. This enables the user to receive accurate information in real time across language barriers, and further enables the information to be provided in an optimal format depending on the user's emotional state at the time.
[0339] An "airport flight information system" is a system that manages and provides aircraft flight information in real time.
[0340] "User" refers to an individual, corporation, or organization that uses this system.
[0341] "Flight information" refers to data that includes detailed information such as aircraft departure and arrival times, gate numbers, and flight numbers.
[0342] "Registering" refers to the act of a user entering and saving their flight information into the system.
[0343] "Matching" refers to the process of comparing registered flight information with collected flight information to identify matching information.
[0344] "Translation" refers to the act of converting acquired flight information into other languages, particularly Japanese.
[0345] "Notification" refers to the act of the system sending information to the user's terminal and informing the user visually or audibly.
[0346] An "emotion engine" is an algorithm or software that recognizes a user's emotional state and adjusts the content and format of notifications based on that information.
[0347] The present invention provides a system that allows a user to receive accurate information in real time and receive notifications in an optimal format depending on the user's emotional state. Specific embodiments are described below.
[0348] Hardware and Software Configuration
[0349] The system mainly consists of a server, a user's device (a smartphone or other display device), and a network infrastructure. The server is equipped with a flight information collection system and an emotion engine, and the user's device has a notification application installed.
[0350] 1. Collecting flight information
[0351] The server periodically connects with the airport's flight information system to collect the latest flight information, which is then stored in a database that is kept up to date.
[0352] 2. User registration and flight information entry
[0353] A user accesses the system using his / her terminal and registers his / her flight information, which includes the flight number, date and time, and other details specified by the user.
[0354] 3. Flight information verification and translation
[0355] The server compares the collected flight information with the flight information registered by the user. The matched flight information is translated into Japanese. A translation API, such as the Google Translate API, is used here.
[0356] 4. Emotion analysis using an emotion engine
[0357] The emotion engine installed on the server collects data (facial images, voice data, etc.) from the user's device and uses a deep learning model to analyze the user's emotional state, which can include joy, anger, sadness, surprise, etc.
[0358] 5. Coordinating and sending notifications
[0359] The content and format of the notification are adjusted according to the user's emotional state. For example, if the user is feeling anxious, the notification will be quick and detailed. If the user is relaxed, the notification will be in a normal format. This notification is sent to the user's device, and the device will display it on the screen or make an audio notification.
[0360] Specific examples
[0361] For example, suppose a user uses this system and registers their flight information. The server retrieves the latest flight information from the airport information system, translates the information, "Flight AA123 has been delayed and its departure time has been changed to 15:30," and notifies the user. If the emotion engine detects impatience in the user's facial expression, the server sends an emergency message in a special format: "The departure time of flight AA123 has been changed to 15:30. Please be careful." The user's device receives the notification and presents the information in an appropriate format.
[0362] Prompt Sentence Examples
[0363] Below are some examples of typical prompts that users may encounter when using the system.
[0364] "What time is the food scheduled to be delivered?"
[0365] The system uses generative AI models to return appropriate answers.
[0366] "The sushi set is scheduled to be delivered at 6:30 PM. Our delivery staff is currently near you. Please hurry."
[0367] In this way, the present invention allows users to receive accurate information in real time, regardless of language barriers, and further allows users to receive information in an easily understandable format that suits their emotions at the time.
[0368] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0369] Processing steps of the system program that realizes the application example
[0370] Step 1:
[0371] A user launches the smartphone app and registers or logs in. Here, the user enters their flight or delivery information. Input includes the flight number, departure date and time, delivery order details, and delivery address information. The server receives this information and stores it in a database. The output is the registered user information, flight information, and delivery information.
[0372] Step 2:
[0373] The server periodically connects to the airport's flight information system or food delivery management system to collect the latest flight information and delivery status. The input is flight information and delivery status data obtained from external systems. The data is stored in a database and is always kept up to date. The output is flight information and delivery information associated with registered user information.
[0374] Step 3:
[0375] The server matches the collected flight or delivery information with the information registered by the user. The input is all flight and delivery information stored in the database and the information registered by the user. This process identifies matching flight and delivery information. The output is the identified flight and delivery information.
[0376] Step 4:
[0377] Translate the collated flight or delivery information into Japanese. The server uses a translation API (e.g., Google Translate API) to convert the information into Japanese format. The input is the collated original information, and the output is the translated Japanese information.
[0378] Step 5:
[0379] The emotion engine collects facial expression and voice data from the user's device and analyzes the user's emotional state. The input is the user's facial expression and voice data, as well as past behavioral patterns. The emotion engine uses a deep learning model to identify the emotional state. The output is a judgment of the user's emotional state, such as whether they are relaxed, anxious, or impatient.
[0380] Step 6:
[0381] The server adjusts the notification content and format based on the analysis results of the emotion engine. The input is the analysis results and translated information from the emotion engine. For example, if the user is feeling impatient, the notification will be more detailed and prompt. The output is the adjusted notification information.
[0382] Step 7:
[0383] The server sends the adjusted notification to the user's device. The input is the output of step 6, and the output is the notification content displayed on the user's device. Now, the device receives the notification and presents the information to the user in an appropriate format. The user can check the notification and take the necessary action.
[0384] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0385] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0386] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0387] [Second embodiment]
[0388] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0389] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0390] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0391] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0392] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0393] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0394] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0395] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0396] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0397] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0398] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0399] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0400] The present invention relates to a system for providing airport flight information in Japanese, and specific embodiments thereof will be described below.
[0401] First, the system is composed of multiple means. Users can register their flight information in the system. As a registration means, users are provided with an interface for entering their flight number and departure date and time.
[0402] Next, the server has a collection means for connecting to the airport's flight information system and periodically collecting all flight information, which is then stored in a database.
[0403] The server compares the flight information registered by the user with the collected flight information, and the comparison means searches all flight information based on the flight number registered by the user to obtain the corresponding latest flight information.
[0404] The collated flight information is then translated into Japanese. The translation means converts the flight information into a predefined Japanese format and prepares it for display in a form that is easily understandable to the user.
[0405] The translated flight information is sent from the server to the user's device via push notification, email, in-app notification, etc. The device then displays the received notification to the user.
[0406] Specific examples
[0407] For example, consider a scenario in which Tanaka uses this system. Tanaka logs into the system and registers his flight, "XZ123." The server records this information and periodically compares it with information collected from the airport's flight information system. At one point, the server receives an update from the flight information system stating that "the departure time of XZ123 has been changed to 14:00."
[0408] The server translates this information into Japanese and generates a message such as, "The departure time of flight XZ123 has been changed to 14:00." The server then notifies Tanaka of this Japanese message on his smartphone. Tanaka's device receives the notification and displays it on its screen. This allows Tanaka to check the latest flight information in Japanese without experiencing any language barriers.
[0409] As described above, the system based on the present invention enables users to receive appropriate flight information in Japanese even at airports in foreign countries where they do not understand the language. This system provides a convenient environment for users through a series of processes, from registering flight information to collecting, translating, and notifying the latest information.
[0410] The processing flow will be explained below.
[0411] Step 1:
[0412] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[0413] Step 2:
[0414] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[0415] Step 3:
[0416] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[0417] Step 4:
[0418] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[0419] Step 5:
[0420] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information, which is then stored in a database.
[0421] Step 6:
[0422] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[0423] Step 7:
[0424] (Server) If matching flight information is found, the information is translated into Japanese. The translated information is converted into a format such as "The departure time of flight XXX has been changed to XXX."
[0425] Step 8:
[0426] (Server) The translated Japanese guide is sent to the user's device via push notification, email, or in-app notification.
[0427] Step 9:
[0428] (Device) The user's device receives the notification and displays the notification content on the screen. The user can check the notification and obtain the latest flight information in Japanese.
[0429] Step 10:
[0430] After receiving the notification, the user further utilizes the system to check flight information as needed, including additional information such as departure gate changes.
[0431] Example 1
[0432] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0433] Currently, flight information provided at many airports is written in English, making it difficult for users who are unfamiliar with foreign languages to accurately understand the latest flight information. Furthermore, when flight information changes, there are limited ways to quickly grasp the information. To solve this problem, there is a need for a system that provides flight information in Japanese, allowing users to easily obtain the latest information.
[0434] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0435] In this invention, the server includes means for providing an interface for users to register their flight information, means for periodically collecting airport flight information and storing it in a database, means for comparing the flight information registered by users with the collected flight information, means for using machine translation software to translate the compared flight information into Japanese, and means for notifying the user's terminal of the translated flight information, thereby enabling users to quickly receive the latest information about their flights in Japanese and eliminating the barrier of information transmission in foreign languages.
[0436] "User" means a person who uses the system to register his / her flight information and obtain the latest flight information based on that information.
[0437] An "interface" is software or hardware that serves as a point of contact through which a user inputs data into or receives information from a system.
[0438] A "server" is a central computer system that provides data and services to other computers and terminals via a network.
[0439] "Database" means a structured information system for storing and managing collected flight information and user-registered information.
[0440] "Matching" refers to the process of comparing the flight information registered by the user with the flight information collected by the server and identifying matching information.
[0441] "Translation" refers to the process of converting collected flight information into Japanese using machine translation software.
[0442] "Notification" refers to the means or process for notifying the user of translated flight information on their terminal.
[0443] A "terminal" is a device that a user uses to receive and display information, and includes smartphones, tablets, and personal computers.
[0444] "Push notification" is a communication method that sends information from a server to a device in real time to notify the user.
[0445] "Machine translation software" means software that automatically translates input text into a specified language.
[0446] The present invention is a system that provides flight information in Japanese at airports, and a specific embodiment thereof is described below. The main elements required are a user, a server, and a terminal, which work together to provide information.
[0447] Flight information registration
[0448] A user uses the provided web or mobile application to register their flight information. Specific flight information includes flight number and departure date and time. When the user enters the registration information through the interface and clicks the "Register" button, the information is sent to the server and stored in the database. For example, the user registers flight number "AB123" and departure date and time "2023-10-12 10:00."
[0449] Collecting flight information
[0450] The server periodically connects to the airport's flight information system to collect and store the latest flight information. This is done using API requests using Python scripts, etc. The collected data is then stored in a database on the server. Specifically, an internet-enabled server and a database server are required, and flight information is obtained from the airport API.
[0451] Flight information verification
[0452] The server matches the flight information registered by the user with the collected flight information, using a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. This matching process allows the user to identify the latest information they want to know.
[0453] Flight information translation
[0454] The collated flight information is translated into Japanese. Machine translation software such as Google Translate API is used for the translation. The collated English flight information is converted into Japanese text and formatted in a way that is easy for users to understand. For example, "Flight AB123 has been delayed to 14:00." is converted to "Flight AB123 has been delayed to 14:00."
[0455] Flight information notifications
[0456] The translated flight information is sent from the server to the user's device. This notification is sent as a push notification using Firebase Cloud Messaging (FCM). In addition to push notifications, email or in-app notifications may also be used. For example, a message saying "The departure time of flight AB123 has been changed to 14:00" is sent.
[0457] View flight information
[0458] The user's device (smartphone, tablet, PC, etc.) will display the received notification. The user can check the notification and understand the latest flight information in Japanese. Specifically, the user's smartphone will receive a notification with the message "Flight AB123 has been delayed until 14:00."
[0459] Adding specific examples
[0460] For example, a user registers their flight "XZ123" in the system, and the server records this information. The latest information is periodically collected from the airport's flight information system, and when the latest information is obtained, it is translated as "The departure time of XZ123 has been changed to 14:00." The server then pushes this Japanese message to the user's smartphone. The user's device receives the notification and displays it on the screen, allowing the user to check the latest flight information in Japanese.
[0461] Examples of prompt statements
[0462] "Please explain the overview of the system that translates and notifies airport flight information into Japanese."
[0463] "Please tell me in detail the process of collecting the latest information based on the flight information registered by the user and notifying them in Japanese."
[0464] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0465] Step 1: User registers their flight information
[0466] The user uses the interface of a web or mobile application to enter flight information (flight number and departure date and time). The entered information is sent to the server and stored in the database by pressing the "Register" button. Specifically, the user enters the flight number "AB123" and departure date and time "2023-10-12 10:00" and clicks the "Register" button. Input data: flight number, departure date and time. Output data: flight information stored in the database.
[0467] Step 2: The server periodically collects airport flight information
[0468] The server periodically connects to the airport's flight information system and collects the latest information on all flights through API requests. The collected information is stored in a database. For example, a Python script is used to get the latest flight information from the airport API and store it in the database. Input data: Flight information from the airport API. Output data: All flight information stored in the database.
[0469] Step 3: The server checks the flight information registered by the user against the collected flight information.
[0470] The server periodically retrieves the user's registration information from the database and compares it with all the flight information collected. It uses a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. For example, a query like "SELECT FROM flights WHERE flight_number='AB123'" is used. Input data: The flight number registered by the user. Output data: The latest matched flight information.
[0471] Step 4: The server translates the matched flight information into Japanese.
[0472] The server translates the matched flight information into Japanese using machine translation software (e.g., Google Translate API). This converts flight information obtained in English (e.g., "Flight AB123 has been delayed to 14:00") into Japanese text (e.g., "Flight AB123 was delayed to 14:00"). Input data: English flight information. Output data: Flight information translated into Japanese.
[0473] Step 5: The server sends the translated flight information to the user's device.
[0474] The server notifies the user's device of the flight information translated into Japanese. This notification is made using Firebase Cloud Messaging (FCM). For example, the Python "pyfcm" library is used to send a push notification to the user's device. Input data: Flight information translated into Japanese. Output data: Push notification sent to the user's device.
[0475] Step 6: Your device receives and displays the notification
[0476] The user's device receives the push notification sent from the server and displays it on the screen. This allows the user to check the latest flight information in Japanese. For example, a message such as "Flight AB123 has been delayed to 14:00" is displayed in the smartphone's notification center. Input data: Received push notification. Output data: Flight information displayed on the screen.
[0477] This allows users to obtain the latest flight information without language barriers.
[0478] (Application example 1)
[0479] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0480] Understanding the operating status and maintenance information of factory equipment in real time is important for efficient production management. However, when different equipment information is provided in multiple languages, it is difficult for factory managers and operators to quickly and accurately understand the information. Furthermore, if equipment abnormalities and maintenance information is not received in a timely manner, the production line may stop and business efficiency may decrease.
[0481] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0482] In this invention, the server includes means for collecting information on the operation status of equipment from the factory equipment information system, means for users to register information on the equipment they manage, means for comparing the registered equipment information with the collected equipment information, means for translating the compared equipment information into Japanese, and means for notifying the translated equipment information to the user's terminal. This makes it possible to grasp the latest equipment information in real time and receive timely notifications in Japanese.
[0483] A "factory equipment information system" is an information system for collecting, managing, and monitoring the operating status and maintenance information of equipment within a factory.
[0484] "Device operation status information" is information about the current operating status of the device (for example, operating, stopped, undergoing maintenance, etc.).
[0485] "Means for users to register information about devices they manage" refers to the interface and mechanism by which users can input and register information about devices they manage into the system.
[0486] "Means for verifying registered equipment information with collected equipment information" refers to a mechanism for comparing and verifying equipment information registered by the user with the latest equipment information collected from the factory's equipment information system.
[0487] "Means for translating equipment information into Japanese" refers to a system for converting collected or collated equipment operating status information into Japanese.
[0488] "Means for notifying the user of translated device information" refers to a mechanism for notifying the user of the translated device's operating status information to the user's device (e.g., a smartphone, tablet, etc.).
[0489] The present invention relates to a system that provides the latest information on equipment in a factory in Japanese and notifies the user's terminal, and specific embodiments thereof are described below.
[0490] First, the system is composed of multiple means. Users can register information about the devices they manage in the system. As a registration method, users are provided with an interface for entering the IDs and names of the devices they manage.
[0491] Next, the server is connected to the factory's equipment information system and has a means of periodically collecting information on the operating status of all equipment. This collected equipment information is stored in a database.
[0492] The server compares the device information registered by the user with the collected device information. The comparison means searches all device information based on the device ID registered by the user and obtains the corresponding latest operating status information.
[0493] The collated device information is then translated into Japanese. The translation means converts the device information into a predetermined Japanese format and prepares it for display in a form that can be easily understood by the user.
[0494] The translated device information is sent from the server to the user's device. Possible notification methods include push notifications, emails, and in-app notifications. The device then displays the received notification to the user. This allows users to check the latest device information in Japanese without experiencing a language barrier.
[0495] As a concrete example, consider a scenario in which a factory manager uses this system. The manager logs into the system and registers the device "MACH01" that he manages. The server records this information and periodically compares it with information collected from the factory's device information system. At one point, the server receives the latest information from the device information system stating that "the operating status of MACH01 has changed to operating."
[0496] The server translates this information into Japanese and generates a message such as "The latest status of device MACH01 is up and running." The server then notifies the administrator of this Japanese message. The administrator's device receives the notification and displays it on the screen. This allows the administrator to check the latest device information in Japanese without having to worry about the language barrier.
[0497] The hardware and software used here include a server for connecting to the device information system, a database for managing user information, an API for processing the collected information, and a push notification service for sending notifications. For example, the server is built using Python and runs code that connects to an API for collecting flight information. MySQL or PostgreSQL is used as the database, and Firebase Cloud Messaging (FCM) is used for push notifications.
[0498] In addition, the translation function is realized by a generative AI model, and examples of prompt sentences that translate appropriately into Japanese are as follows:
[0499] "Please translate the latest status of the factory equipment in Japanese. For example:
[0500] 'running' -> 'Running'
[0501] 'maintenance required' -> 'maintenance required'
[0502] 'shutdown' -> 'stopping'"
[0503] As described above, the system based on the present invention grasps the operating status of equipment within a factory in real time and notifies the manager in Japanese, enabling the manager to efficiently manage the factory.
[0504] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0505] Step 1:
[0506] The server collects information on the operation status of equipment from the factory's equipment information system. Specifically, it periodically sends requests to the API endpoint to obtain the latest information. The input is the API request, and the output is equipment information data in JSON format. This data is stored in a database on the server.
[0507] Step 2:
[0508] Users register information about the devices they manage in the system. The user enters the device ID and name through the interface, and that information is sent to the server and recorded in the database. The input is the device information registered by the user, and the output is the device information being saved to the database.
[0509] Step 3:
[0510] The server compares the registered device information with the collected device information. Specifically, it searches for and retrieves the latest operating status information based on the device ID registered by the user in the database. The input is the device ID and latest device information stored in the database, and the output is the verified operating status data of the device.
[0511] Step 4:
[0512] The server translates the matched device information into Japanese. It uses a prompt generated by the AI model to convert the operation status information into Japanese. The input is the matched device information, and the output is the device operation status sentence translated into Japanese. Specifically, the following prompt sentence is sent to the AI model, which then translates it:
[0513] "Please translate the latest status of the factory equipment in Japanese. For example:
[0514] 'running' -> 'Running'
[0515] 'maintenance required' -> 'maintenance required'
[0516] 'shutdown' -> 'stopping'"
[0517] Step 5:
[0518] The server notifies the user's device of the translated device information. Specifically, the translated information is sent using push notifications or email sending functions. The input is the device information translated into Japanese, and the output is the completion of notification to the user's device. Firebase Cloud Messaging (FCM) and similar services are used for push notifications.
[0519] Step 6:
[0520] The user device displays the received notification. The received message is displayed in the device's notification center or application. The input is the notification information received from the server, and the output is a screen display that the user can see. Specifically, the device's notification function or application UI is activated.
[0521] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0522] The present invention is a system that overcomes language barriers and enables users to receive airport flight information in Japanese. Furthermore, the present invention is a system that incorporates an emotion engine that recognizes the user's emotions and adjusts the content and format of information notifications based on the emotions.
[0523] The system comprises the following means:
[0524] 1. Flight information registration:
[0525] The user registers his / her flight information in the system by inputting his / her flight number and departure date and time and sending it to the server.
[0526] 2. Collecting flight information:
[0527] The server periodically connects to the airport's flight information system to collect the latest information on all flights, which is then stored in a database that is kept up to date.
[0528] 3. Flight information verification:
[0529] The server compares all collected flight information with the flight information registered by the user, and identifies the latest flight information corresponding to the flight number registered by the user.
[0530] 4. Flight Information Translation:
[0531] The collated flight information is translated into Japanese. The server uses a translation means to convert the flight information into a Japanese format.
[0532] 5. Emotion Engine:
[0533] It has a built-in emotion engine that recognizes the user's emotions. The emotion engine analyzes the user's current emotional state based on the user's facial expressions, voice, past behavioral patterns, etc.
[0534] 6. Emotion-based notification adjustment:
[0535] Based on the perceived emotion, the server can adjust the content and format of notifications, for example, delivering notifications faster and in a clearer format if the user is feeling impatient or anxious.
[0536] 7. Flight Information Notification:
[0537] The translated flight information and adjusted notifications are sent from the server to the user's device, which receives the notifications and displays them to the user.
[0538] Program processing explanation
[0539] Step 1: User Registration and Login
[0540] (User) Accesses the system to register or log in as a new user. When registering as a new user, the user enters the required information and sends it to the system. The server receives this information, stores it in the database, and performs authentication.
[0541] Step 2: Register your flight information
[0542] After logging in, the user enters the flight number and departure date and time to register. The server receives this information and stores it in the database.
[0543] Step 3: Gather your flight information
[0544] (Server) Connects to the airport's flight information system and periodically collects the latest flight information. The collected data is stored in a database.
[0545] Step 4: Check and translate flight information
[0546] (Server) Compares the flight information registered by the user with the latest flight information and translates the matching flight information into Japanese.
[0547] Step 5: Activating the Emotion Engine
[0548] (Server) The emotion engine collects facial expression and voice data from the user's device and analyzes their emotional state. As a result of the analysis, it identifies whether the user is relaxed, anxious, or in a hurry.
[0549] Step 6: Adjust notifications
[0550] (Server) Adjust the notification content and format based on the analysis results of the emotion engine. For example, send a warning notification to a user who is anxious, and send information in a standard notification format to a user who is relaxed.
[0551] Step 7: Flight Information Notification
[0552] The server sends the adjusted notification to the user's device, which receives it and displays it on the screen or provides an audio notification to the user. This allows the user to obtain the latest flight information in real time and receive the information in a way that suits their emotional state.
[0553] Specific examples
[0554] For example, consider a scenario in which Mr. Sato uses the system. After registering as a new user, Mr. Sato registers his flight "AA123." The server periodically retrieves the latest flight information from the airport information system and receives information that "the departure time of AA123 has been changed to 15:30."
[0555] The server translates this information and displays it in Japanese as "The departure time of flight AA123 has been changed to 15:30." At the same time, if the emotion engine detects an emotion of impatience from Sato's facial expression or voice data, the server emphasizes the content of the notification and notifies Sato's smartphone of the information in a format that conveys urgency. Sato's device receives the notification and displays the message, "The departure time of flight AA123 has been changed. Please be careful."
[0556] This system will allow Sato to receive accurate flight information in Japanese in a timely manner, and the information will be presented in an easy-to-understand format that is tailored to his current emotions.
[0557] The processing flow will be explained below.
[0558] Step 1:
[0559] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[0560] Step 2:
[0561] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[0562] Step 3:
[0563] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[0564] Step 4:
[0565] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[0566] Step 5:
[0567] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information, which is then stored in a database.
[0568] Step 6:
[0569] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[0570] Step 7:
[0571] (Server) If matching flight information is found, translate the information into Japanese. Use translation means to convert the flight information into Japanese format.
[0572] Step 8:
[0573] (Server) Activates the emotion engine and collects the user's facial expression and voice data from the device. The emotion engine analyzes this data and identifies the user's emotional state.
[0574] Step 9:
[0575] (Server) Adjust the content and format of notifications based on the user's recognized emotions. For example, if the user is anxious, make the notification more emphatic and less anxious.
[0576] Step 10:
[0577] (Server) Send adjusted Japanese notifications to the user's device.
[0578] Step 11:
[0579] (Device) The user's device receives the notification and displays the notification content on the screen. If necessary, a voice notification is also provided.
[0580] Step 12:
[0581] (User) Check notifications on the device to understand flight changes and warnings. This allows the user to understand the latest flight information and reduce anxiety.
[0582] Example 2
[0583] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0584] While users have a need to receive airport flight information in Japanese, flight information is usually provided in international languages, creating a language barrier. Furthermore, if flight information notifications are uniformly provided, it is not possible to provide appropriate information according to the user's emotional state, and users who feel anxious or impatient cannot receive prompt and clear information.
[0585] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for collecting flight information from an airport's flight information system, a means for a user to register their own flight information, a means for comparing the registered flight information with the collected flight information, a means for translating the compared flight information into Japanese, a means for notifying the translated flight information to the user's terminal, an emotion recognition means for analyzing the user's emotional state, and a means for adjusting the notification content based on the analysis result. This allows the user to obtain real-time flight information in Japanese and receive the information in an appropriate format according to their emotional state at that time.
[0586] An "airport flight information system" is a digital system that provides flight information such as aircraft departure and arrival times, gate numbers, and delay information.
[0587] "Flight information collection" is the process of obtaining up-to-date flight data from the airport's flight information system.
[0588] "User" means an individual who uses the system and registers and receives their flight information.
[0589] "Registering flight information" refers to the act of a user entering and saving the flight number and departure date and time of the user's planned flight into the system.
[0590] "Flight information matching" is the process of comparing the flight information registered by the user with the latest collected flight information to find matching data.
[0591] "Flight information translation" is the process of converting flight information into Japanese.
[0592] A "notification" is a message or alert sent to inform a user of specific information.
[0593] A "terminal" is a digital device such as a smartphone or computer that a user owns.
[0594] The "emotion recognition means" is a system that analyzes the user's facial expressions and voice data to determine their current emotional state (relaxed, anxious, anxious, etc.).
[0595] The "analysis result" is data obtained after the emotion recognition means analyzes the user's emotional state.
[0596] "Adjusting notification content" is the process of changing the content and display format of a notification message based on the user's emotional state.
[0597] The present invention provides a system that allows users to receive airport flight information in Japanese and adjusts the content and format of the information notification based on the user's emotional state. Specifically, the system includes the following means:
[0598] Flight information registration
[0599] Users access the system and register by entering their flight information (flight number and departure date and time). After registration, the server stores this information in a database. The terminals used by users are digital devices such as smartphones and PCs.
[0600] Collecting flight information
[0601] The server periodically connects to the airport's flight information system to collect the latest flight information, which is then stored in a database and updated in real time using a digital interface such as an airport information API.
[0602] Flight information collation and translation
[0603] The server compares the flight information registered by the user with the latest flight information collected and identifies matching flight information. This matching flight information is then translated into Japanese using translation software such as a real-time translation API.
[0604] Analysis by emotion engine
[0605] The server collects facial expression and voice data from the user's device and analyzes this data using an emotion engine. The emotion engine determines whether the user is relaxed, anxious, or in a hurry. Analysis of the user's emotional state uses a facial recognition API and voice emotion recognition software.
[0606] Adjusting notification content
[0607] The server adjusts the content and format of notifications based on the analysis results of the emotion engine. For example, it sends a warning notification to a user who is anxious, and a regular notification to a user who is relaxed.
[0608] Flight information notifications
[0609] The server then sends the tailored notification to the user's device, which receives the notification and displays it on the screen or provides an audio notification to the user, allowing the user to obtain the latest flight information in real time and receive the information in a format that suits their emotional state.
[0610] Specific examples
[0611] Specifically, suppose a user registers his / her flight "AB123" after registering a new flight. The server retrieves the latest flight information from the airport information system and receives the information that "the departure time of AB123 has been changed to 16:00."
[0612] The server translates this information into Japanese and converts it to "The departure time of flight AB123 has been changed to 16:00." At the same time, if the emotion engine detects an emotion of impatience from the user's facial expression or voice data, the server emphasizes the notification content and sends the information in a format that conveys urgency, saying, "The departure time of flight AB123 has been changed. Please be careful." The user's device receives this and displays it on the screen.
[0613] Examples of prompt statements
[0614] Examples of prompts to input to a generative AI model include:
[0615] "Collect flight information entered by the user and translate it into Japanese. Then, explain in detail how to analyze the user's emotional state and provide the flight information in an appropriate notification format."
[0616] Using this prompt, the generative AI model can explain the detailed processing of the system in natural language.
[0617] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0618] Program processing flow
[0619] Step 1: User Registration and Login
[0620] 1. The user accesses the system's registration page and enters the required personal information (name, email address, password, etc.).
[0621] Input: Name, Email Address, Password
[0622] Data processing: Converting input information into the appropriate format
[0623] Output: Registration processing request
[0624] 2. When the user submits the information, the server receives the data and stores it in a database.
[0625] Input: Registration processing request
[0626] Data processing: Data validation and storage processing
[0627] Output: User information saved
[0628] 3. The server returns a message that user registration is complete.
[0629] Input: User information saved result
[0630] Data operation: generating a success or failure message
[0631] Output: Completion message
[0632] Step 2: Register your flight information
[0633] 1. After logging in, the user accesses the flight information registration page and enters the flight number and departure date and time.
[0634] Input: Flight number, departure date and time
[0635] Data processing: Format conversion of input information
[0636] Output: Flight information registration request
[0637] 2. When the user submits the information, the server receives the data and stores it in a database.
[0638] Input: Flight information registration request
[0639] Data processing: Data validation and storage processing
[0640] Output: Flight information saved
[0641] 3. The server returns a message that flight information registration is complete.
[0642] Input: Flight information saved result
[0643] Data operation: generating a success or failure message
[0644] Output: Completion message
[0645] Step 3: Gather your flight information
[0646] 1. The server periodically connects to the airport's flight information system to collect the latest flight information.
[0647] Input: None (periodic trigger)
[0648] Data processing: Data acquisition and processing from airport information API
[0649] Output: Collected flight information
[0650] 2. The server stores the collected flight information in a database.
[0651] Input: Collected flight information
[0652] Data processing: Data validation and storage processing
[0653] Output: Flight information saved
[0654] Step 4: Check and translate flight information
[0655] 1. The server retrieves the flight information registered by the user from the database.
[0656] Input: User ID
[0657] Data processing: generating and executing database queries
[0658] Output: Registered flight information
[0659] 2. The server checks the current flight information against the user's flight information.
[0660] Input: Registered flight information, latest collected flight information
[0661] Data processing: Matching process and extraction of matching data
[0662] Output: Matching flight information
[0663] 3. The server translates the matched flight information into Japanese.
[0664] Input: Matching flight information
[0665] Data calculation: Japanese conversion using translation API
[0666] Output: Translated flight information
[0667] Step 5: Activating the Emotion Engine
[0668] 1. The server collects facial expression and voice data from the user's device.
[0669] Input: facial expression data, voice data
[0670] Data Processing: Data collection and pre-processing
[0671] Output: Collected user data
[0672] 2. The server analyzes the data using an emotion engine to determine the emotional state.
[0673] Input: Collected user data
[0674] Data Calculation: Analysis with Emotion Recognition API
[0675] Output: Emotional state analysis results
[0676] 3. The server stores the analysis results and uses them to adjust notifications.
[0677] Input: Emotional state analysis results
[0678] Data processing: Saving to database
[0679] Output: Save completion result
[0680] Step 6: Adjust notifications
[0681] 1. The server adjusts the content and format of the notification based on the analysis results of the emotion engine.
[0682] Input: Emotional state analysis results, translated flight information
[0683] Data calculation: Adjusting notification content and format
[0684] Output: Reconciled notification message
[0685] 2. Provide highlighted notifications for anxious users and normal notifications for relaxed users.
[0686] Input: Reconciled notification message
[0687] Data operation: Notification message format conversion
[0688] Output: Optimized notification message
[0689] Step 7: Flight Information Notification
[0690] 1. The server sends the tailored notification to the user's device.
[0691] Input: Optimized notification message
[0692] Data processing: Creating push notification messages
[0693] Output: Send processing request
[0694] 2. The device receives the notification and displays it on the screen or provides an audio notification to the user.
[0695] Input: Notification message sent
[0696] Data calculation: Message analysis and display processing
[0697] Output: User notification display
[0698] (Application example 2)
[0699] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0700] In situations where users need to receive real-time information, such as international flight information or food delivery, language barriers and stress levels often hinder their understanding of the information. Furthermore, there is no way to provide information in an appropriate format depending on the user's emotional state, making it difficult to effectively communicate information.
[0701] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting flight information from an airport's flight information system, means for a user to register their own flight information, means for comparing the registered flight information with the collected flight information, means for translating the compared flight information into Japanese, means for notifying the translated flight information to the user's terminal, and means for recognizing the user's emotional state using an emotion engine and adjusting the content and format of the information notification. This enables the user to receive accurate information in real time across language barriers, and further enables the information to be provided in an optimal format depending on the user's emotional state at the time.
[0702] An "airport flight information system" is a system that manages and provides aircraft flight information in real time.
[0703] "User" refers to an individual, corporation, or organization that uses this system.
[0704] "Flight information" refers to data that includes detailed information such as aircraft departure and arrival times, gate numbers, and flight numbers.
[0705] "Registering" refers to the act of a user entering and saving their flight information into the system.
[0706] "Matching" refers to the process of comparing registered flight information with collected flight information to identify matching information.
[0707] "Translation" refers to the act of converting acquired flight information into other languages, particularly Japanese.
[0708] "Notification" refers to the act of the system sending information to the user's terminal and informing the user visually or audibly.
[0709] An "emotion engine" is an algorithm or software that recognizes a user's emotional state and adjusts the content and format of notifications based on that information.
[0710] The present invention provides a system that allows a user to receive accurate information in real time and receive notifications in an optimal format depending on the user's emotional state. Specific embodiments are described below.
[0711] Hardware and Software Configuration
[0712] The system mainly consists of a server, a user's device (a smartphone or other display device), and a network infrastructure. The server is equipped with a flight information collection system and an emotion engine, and the user's device has a notification application installed.
[0713] 1. Collecting flight information
[0714] The server periodically connects with the airport's flight information system to collect the latest flight information, which is then stored in a database that is kept up to date.
[0715] 2. User registration and flight information entry
[0716] A user accesses the system using his / her terminal and registers his / her flight information, which includes the flight number, date and time, and other details specified by the user.
[0717] 3. Flight information verification and translation
[0718] The server compares the collected flight information with the flight information registered by the user. The matched flight information is translated into Japanese. A translation API, such as the Google Translate API, is used here.
[0719] 4. Emotion analysis using an emotion engine
[0720] The emotion engine installed on the server collects data (facial images, voice data, etc.) from the user's device and uses a deep learning model to analyze the user's emotional state, which can include joy, anger, sadness, surprise, etc.
[0721] 5. Coordinating and sending notifications
[0722] The content and format of the notification are adjusted according to the user's emotional state. For example, if the user is feeling anxious, the notification will be quick and detailed. If the user is relaxed, the notification will be in a normal format. This notification is sent to the user's device, and the device will display it on the screen or make an audio notification.
[0723] Specific examples
[0724] For example, suppose a user uses this system and registers their flight information. The server retrieves the latest flight information from the airport information system, translates the information, "Flight AA123 has been delayed and its departure time has been changed to 15:30," and notifies the user. If the emotion engine detects impatience in the user's facial expression, the server sends an emergency message in a special format: "The departure time of flight AA123 has been changed to 15:30. Please be careful." The user's device receives the notification and presents the information in an appropriate format.
[0725] Prompt Sentence Examples
[0726] Below are some examples of typical prompts that users may encounter when using the system.
[0727] "What time is the food scheduled to be delivered?"
[0728] The system uses generative AI models to return appropriate answers.
[0729] "The sushi set is scheduled to be delivered at 6:30 PM. Our delivery staff is currently near you. Please hurry."
[0730] In this way, the present invention enables users to receive accurate information in real time, regardless of language barriers, and further allows users to receive information in an easily understandable format that suits their emotions at the time.
[0731] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0732] Processing steps of the system program that realizes the application example
[0733] Step 1:
[0734] A user launches the smartphone app and registers or logs in. Here, the user enters their flight or delivery information. Input includes the flight number, departure date and time, delivery order details, and delivery address information. The server receives this information and stores it in a database. The output is the registered user information, flight information, and delivery information.
[0735] Step 2:
[0736] The server periodically connects to the airport's flight information system or food delivery management system to collect the latest flight information and delivery status. The input is flight information and delivery status data obtained from external systems. The data is stored in a database and is always kept up to date. The output is flight information and delivery information associated with registered user information.
[0737] Step 3:
[0738] The server matches the collected flight or delivery information with the information registered by the user. The input is all flight and delivery information stored in the database and the information registered by the user. This process identifies matching flight and delivery information. The output is the identified flight and delivery information.
[0739] Step 4:
[0740] Translate the collated flight or delivery information into Japanese. The server uses a translation API (e.g., Google Translate API) to convert the information into Japanese format. The input is the collated original information, and the output is the translated Japanese information.
[0741] Step 5:
[0742] The emotion engine collects facial expression and voice data from the user's device and analyzes the user's emotional state. The input is the user's facial expression and voice data, as well as past behavioral patterns. The emotion engine uses a deep learning model to identify the emotional state. The output is a judgment of the user's emotional state, such as whether they are relaxed, anxious, or impatient.
[0743] Step 6:
[0744] The server adjusts the notification content and format based on the analysis results of the emotion engine. The input is the analysis results and translated information from the emotion engine. For example, if the user is feeling impatient, the notification will be more detailed and prompt. The output is the adjusted notification information.
[0745] Step 7:
[0746] The server sends the adjusted notification to the user's device. The input is the output of step 6, and the output is the notification content displayed on the user's device. Now, the device receives the notification and presents the information to the user in an appropriate format. The user can check the notification and take the necessary action.
[0747] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0748] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0749] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[0750] [Third embodiment]
[0751] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[0752] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[0753] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0754] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[0755] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0756] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0757] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0758] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0759] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0760] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0761] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0762] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[0763] The present invention relates to a system for providing airport flight information in Japanese, and specific embodiments thereof will be described below.
[0764] First, the system is composed of multiple means. Users can register their flight information in the system. As a registration means, users are provided with an interface for entering their flight number and departure date and time.
[0765] Next, the server has a collection means for connecting to the airport's flight information system and periodically collecting all flight information, which is then stored in a database.
[0766] The server compares the flight information registered by the user with the collected flight information, and the comparison means searches all flight information based on the flight number registered by the user to obtain the corresponding latest flight information.
[0767] The collated flight information is then translated into Japanese. The translation means converts the flight information into a predefined Japanese format and prepares it for display in a form that is easily understandable to the user.
[0768] The translated flight information is sent from the server to the user's device via push notification, email, in-app notification, etc. The device then displays the received notification to the user.
[0769] Specific examples
[0770] For example, consider a scenario in which Tanaka uses this system. Tanaka logs into the system and registers his flight, "XZ123." The server records this information and periodically compares it with information collected from the airport's flight information system. At one point, the server receives an update from the flight information system stating that "the departure time of XZ123 has been changed to 14:00."
[0771] The server translates this information into Japanese and generates a message such as, "The departure time of flight XZ123 has been changed to 14:00." The server then notifies Tanaka of this Japanese message on his smartphone. Tanaka's device receives the notification and displays it on its screen. This allows Tanaka to check the latest flight information in Japanese without experiencing any language barriers.
[0772] As described above, the system based on the present invention enables users to receive appropriate flight information in Japanese even at airports in foreign countries where they do not understand the language. This system provides a convenient environment for users through a series of processes, from registering flight information to collecting, translating, and notifying the latest information.
[0773] The processing flow will be explained below.
[0774] Step 1:
[0775] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[0776] Step 2:
[0777] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[0778] Step 3:
[0779] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[0780] Step 4:
[0781] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[0782] Step 5:
[0783] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information, which is then stored in a database.
[0784] Step 6:
[0785] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[0786] Step 7:
[0787] (Server) If matching flight information is found, the information is translated into Japanese. The translated information is converted into a format such as "The departure time of flight XXX has been changed to XXX."
[0788] Step 8:
[0789] (Server) The translated Japanese guide is sent to the user's device via push notification, email, or in-app notification.
[0790] Step 9:
[0791] (Device) The user's device receives the notification and displays the notification content on the screen. The user can check the notification and obtain the latest flight information in Japanese.
[0792] Step 10:
[0793] After receiving the notification, the user further utilizes the system to check flight information as needed, including additional information such as departure gate changes.
[0794] Example 1
[0795] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0796] Currently, flight information provided at many airports is written in English, making it difficult for users who are unfamiliar with foreign languages to accurately understand the latest flight information. Furthermore, when flight information changes, there are limited ways to quickly grasp the information. To solve this problem, there is a need for a system that provides flight information in Japanese, allowing users to easily obtain the latest information.
[0797] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0798] In this invention, the server includes means for providing an interface for users to register their flight information, means for periodically collecting airport flight information and storing it in a database, means for comparing the flight information registered by users with the collected flight information, means for using machine translation software to translate the compared flight information into Japanese, and means for notifying the user's terminal of the translated flight information, thereby enabling users to quickly receive the latest information about their flights in Japanese and eliminating the barrier of information transmission in foreign languages.
[0799] "User" means a person who uses the system to register his / her flight information and obtain the latest flight information based on that information.
[0800] An "interface" is software or hardware that serves as a point of contact through which a user inputs data into or receives information from a system.
[0801] A "server" is a central computer system that provides data and services to other computers and terminals via a network.
[0802] "Database" means a structured information system for storing and managing collected flight information and user-registered information.
[0803] "Matching" refers to the process of comparing the flight information registered by the user with the flight information collected by the server and identifying matching information.
[0804] "Translation" refers to the process of converting collected flight information into Japanese using machine translation software.
[0805] "Notification" refers to the means or process for notifying the user of translated flight information on their terminal.
[0806] A "terminal" is a device that a user uses to receive and display information, and includes smartphones, tablets, and personal computers.
[0807] "Push notification" is a communication method that sends information from a server to a device in real time to notify the user.
[0808] "Machine translation software" means software that automatically translates input text into a specified language.
[0809] The present invention is a system that provides flight information in Japanese at airports, and a specific embodiment thereof is described below. The main elements required are a user, a server, and a terminal, which work together to provide information.
[0810] Flight information registration
[0811] A user uses the provided web or mobile application to register their flight information. Specific flight information includes flight number and departure date and time. When the user enters the registration information through the interface and clicks the "Register" button, the information is sent to the server and stored in the database. For example, the user registers flight number "AB123" and departure date and time "2023-10-12 10:00."
[0812] Collecting flight information
[0813] The server periodically connects to the airport's flight information system to collect and store the latest flight information. This is done using API requests using Python scripts, etc. The collected data is then stored in a database on the server. Specifically, an internet-enabled server and a database server are required, and flight information is obtained from the airport API.
[0814] Flight information verification
[0815] The server matches the flight information registered by the user with the collected flight information, using a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. This matching process allows the user to identify the latest information they want to know.
[0816] Flight information translation
[0817] The collated flight information is translated into Japanese. Machine translation software such as Google Translate API is used for the translation. The collated English flight information is converted into Japanese text and formatted in a way that is easy for users to understand. For example, "Flight AB123 has been delayed to 14:00." is converted to "Flight AB123 has been delayed to 14:00."
[0818] Flight information notifications
[0819] The translated flight information is sent from the server to the user's device. This notification is sent as a push notification using Firebase Cloud Messaging (FCM). In addition to push notifications, email or in-app notifications may also be used. For example, a message saying "The departure time of flight AB123 has been changed to 14:00" is sent.
[0820] View flight information
[0821] The user's device (smartphone, tablet, PC, etc.) will display the received notification. The user can check the notification and understand the latest flight information in Japanese. Specifically, the user's smartphone will receive a notification with the message "Flight AB123 has been delayed until 14:00."
[0822] Adding specific examples
[0823] For example, a user registers their flight "XZ123" in the system, and the server records this information. The latest information is periodically collected from the airport's flight information system, and when the latest information is obtained, it is translated as "The departure time of XZ123 has been changed to 14:00." The server then pushes this Japanese message to the user's smartphone. The user's device receives the notification and displays it on the screen, allowing the user to check the latest flight information in Japanese.
[0824] Examples of prompt statements
[0825] "Please explain the overview of the system that translates and notifies airport flight information into Japanese."
[0826] "Please tell me in detail the process of collecting the latest information based on the flight information registered by the user and notifying them in Japanese."
[0827] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0828] Step 1: User registers their flight information
[0829] The user uses the interface of a web or mobile application to enter flight information (flight number and departure date and time). The entered information is sent to the server and stored in the database by pressing the "Register" button. Specifically, the user enters the flight number "AB123" and departure date and time "2023-10-12 10:00" and clicks the "Register" button. Input data: flight number, departure date and time. Output data: flight information stored in the database.
[0830] Step 2: The server periodically collects airport flight information
[0831] The server periodically connects to the airport's flight information system and collects the latest information on all flights through API requests. The collected information is stored in a database. For example, a Python script is used to get the latest flight information from the airport API and store it in the database. Input data: Flight information from the airport API. Output data: All flight information stored in the database.
[0832] Step 3: The server checks the flight information registered by the user against the collected flight information.
[0833] The server periodically retrieves the user's registration information from the database and compares it with all the flight information collected. It uses a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. For example, a query like "SELECT FROM flights WHERE flight_number='AB123'" is used. Input data: The flight number registered by the user. Output data: The latest matched flight information.
[0834] Step 4: The server translates the matched flight information into Japanese.
[0835] The server translates the matched flight information into Japanese using machine translation software (e.g., Google Translate API). This converts flight information obtained in English (e.g., "Flight AB123 has been delayed to 14:00") into Japanese text (e.g., "Flight AB123 was delayed to 14:00"). Input data: English flight information. Output data: Flight information translated into Japanese.
[0836] Step 5: The server sends the translated flight information to the user's device.
[0837] The server notifies the user's device of the flight information translated into Japanese. This notification is made using Firebase Cloud Messaging (FCM). For example, the Python "pyfcm" library is used to send a push notification to the user's device. Input data: Flight information translated into Japanese. Output data: Push notification sent to the user's device.
[0838] Step 6: Your device receives and displays the notification
[0839] The user's device receives the push notification sent from the server and displays it on the screen. This allows the user to check the latest flight information in Japanese. For example, a message such as "Flight AB123 has been delayed to 14:00" is displayed in the smartphone's notification center. Input data: Received push notification. Output data: Flight information displayed on the screen.
[0840] This allows users to obtain the latest flight information without language barriers.
[0841] (Application example 1)
[0842] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0843] Understanding the operating status and maintenance information of factory equipment in real time is important for efficient production management. However, when different equipment information is provided in multiple languages, it is difficult for factory managers and operators to quickly and accurately understand the information. Furthermore, if equipment abnormalities and maintenance information is not received in a timely manner, the production line may stop and business efficiency may decrease.
[0844] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0845] In this invention, the server includes means for collecting information on the operation status of equipment from the factory equipment information system, means for users to register information on the equipment they manage, means for comparing the registered equipment information with the collected equipment information, means for translating the compared equipment information into Japanese, and means for notifying the translated equipment information to the user's terminal. This makes it possible to grasp the latest equipment information in real time and receive timely notifications in Japanese.
[0846] A "factory equipment information system" is an information system for collecting, managing, and monitoring the operating status and maintenance information of equipment within a factory.
[0847] "Device operation status information" is information about the current operating status of the device (for example, operating, stopped, undergoing maintenance, etc.).
[0848] "Means for users to register information about devices they manage" refers to the interface and mechanism by which users can input and register information about devices they manage into the system.
[0849] "Means for verifying registered equipment information with collected equipment information" refers to a mechanism for comparing and verifying equipment information registered by the user with the latest equipment information collected from the factory's equipment information system.
[0850] "Means for translating equipment information into Japanese" refers to a system for converting collected or collated equipment operating status information into Japanese.
[0851] "Means for notifying the user of translated device information" refers to a mechanism for notifying the user of the translated device's operating status information to the user's device (e.g., a smartphone, tablet, etc.).
[0852] The present invention relates to a system that provides the latest information on equipment in a factory in Japanese and notifies the user's terminal, and specific embodiments thereof are described below.
[0853] First, the system is composed of multiple means. Users can register information about the devices they manage in the system. As a registration method, users are provided with an interface for entering the IDs and names of the devices they manage.
[0854] Next, the server is connected to the factory's equipment information system and has a means of periodically collecting information on the operating status of all equipment. This collected equipment information is stored in a database.
[0855] The server compares the device information registered by the user with the collected device information. The comparison means searches all device information based on the device ID registered by the user and obtains the corresponding latest operating status information.
[0856] The collated device information is then translated into Japanese. The translation means converts the device information into a predetermined Japanese format and prepares it for display in a form that can be easily understood by the user.
[0857] The translated device information is sent from the server to the user's device. Possible notification methods include push notifications, emails, and in-app notifications. The device then displays the received notification to the user. This allows users to check the latest device information in Japanese without experiencing a language barrier.
[0858] As a concrete example, consider a scenario in which a factory manager uses this system. The manager logs into the system and registers the device "MACH01" that he manages. The server records this information and periodically compares it with information collected from the factory's device information system. At one point, the server receives the latest information from the device information system stating that "the operating status of MACH01 has changed to operating."
[0859] The server translates this information into Japanese and generates a message such as "The latest status of device MACH01 is up and running." The server then notifies the administrator of this Japanese message. The administrator's device receives the notification and displays it on the screen. This allows the administrator to check the latest device information in Japanese without having to worry about the language barrier.
[0860] The hardware and software used here include a server for connecting to the device information system, a database for managing user information, an API for processing the collected information, and a push notification service for sending notifications. For example, the server is built using Python and runs code that connects to an API for collecting flight information. MySQL or PostgreSQL is used as the database, and Firebase Cloud Messaging (FCM) is used for push notifications.
[0861] In addition, the translation function is realized by a generative AI model, and examples of prompt sentences that translate appropriately into Japanese are as follows:
[0862] "Please translate the latest status of the factory equipment in Japanese. For example:
[0863] 'running' -> 'Running'
[0864] 'maintenance required' -> 'maintenance required'
[0865] 'shutdown' -> 'stopping'"
[0866] As described above, the system based on the present invention grasps the operating status of equipment within a factory in real time and notifies the manager in Japanese, enabling the manager to efficiently manage the factory.
[0867] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0868] Step 1:
[0869] The server collects information on the operation status of equipment from the factory's equipment information system. Specifically, it periodically sends requests to the API endpoint to obtain the latest information. The input is the API request, and the output is equipment information data in JSON format. This data is stored in a database on the server.
[0870] Step 2:
[0871] Users register information about the devices they manage in the system. The user enters the device ID and name through the interface, and that information is sent to the server and recorded in the database. The input is the device information registered by the user, and the output is the device information being saved to the database.
[0872] Step 3:
[0873] The server compares the registered device information with the collected device information. Specifically, it searches for and retrieves the latest operating status information based on the device ID registered by the user in the database. The input is the device ID and latest device information stored in the database, and the output is the verified operating status data of the device.
[0874] Step 4:
[0875] The server translates the matched device information into Japanese. It uses a prompt generated by the AI model to convert the operation status information into Japanese. The input is the matched device information, and the output is the device operation status sentence translated into Japanese. Specifically, the following prompt sentence is sent to the AI model, which then translates it:
[0876] "Please translate the latest status of the factory equipment in Japanese. For example:
[0877] 'running' -> 'Running'
[0878] 'maintenance required' -> 'maintenance required'
[0879] 'shutdown' -> 'stopping'"
[0880] Step 5:
[0881] The server notifies the user's device of the translated device information. Specifically, the translated information is sent using push notifications or email sending functions. The input is the device information translated into Japanese, and the output is the completion of notification to the user's device. Firebase Cloud Messaging (FCM) and similar services are used for push notifications.
[0882] Step 6:
[0883] The user device displays the received notification. The received message is displayed in the device's notification center or application. The input is the notification information received from the server, and the output is a screen display that the user can see. Specifically, the device's notification function or application UI is activated.
[0884] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[0885] The present invention is a system that overcomes language barriers and enables users to receive airport flight information in Japanese. Furthermore, the present invention is a system that incorporates an emotion engine that recognizes the user's emotions and adjusts the content and format of information notifications based on the emotions.
[0886] The system comprises the following means:
[0887] 1. Flight information registration:
[0888] The user registers his / her flight information in the system by inputting his / her flight number and departure date and time and sending it to the server.
[0889] 2. Collecting flight information:
[0890] The server periodically connects to the airport's flight information system to collect the latest information on all flights, which is then stored in a database that is kept up to date.
[0891] 3. Flight information verification:
[0892] The server compares all collected flight information with the flight information registered by the user, and identifies the latest flight information corresponding to the flight number registered by the user.
[0893] 4. Flight Information Translation:
[0894] The collated flight information is translated into Japanese. The server uses a translation means to convert the flight information into a Japanese format.
[0895] 5. Emotion Engine:
[0896] It has a built-in emotion engine that recognizes the user's emotions. The emotion engine analyzes the user's current emotional state based on the user's facial expressions, voice, past behavioral patterns, etc.
[0897] 6. Emotion-based notification adjustment:
[0898] Based on the perceived emotion, the server can adjust the content and format of notifications, for example, delivering notifications faster and in a clearer format if the user is feeling impatient or anxious.
[0899] 7. Flight Information Notification:
[0900] The translated flight information and adjusted notifications are sent from the server to the user's device, which receives the notifications and displays them to the user.
[0901] Program processing explanation
[0902] Step 1: User Registration and Login
[0903] (User) Accesses the system to register or log in as a new user. When registering as a new user, the user enters the required information and sends it to the system. The server receives this information, stores it in the database, and performs authentication.
[0904] Step 2: Register your flight information
[0905] After logging in, the user enters the flight number and departure date and time to register. The server receives this information and stores it in the database.
[0906] Step 3: Gather your flight information
[0907] (Server) Connects to the airport's flight information system and periodically collects the latest flight information. The collected data is stored in a database.
[0908] Step 4: Check and translate flight information
[0909] (Server) Compares the flight information registered by the user with the latest flight information and translates the matching flight information into Japanese.
[0910] Step 5: Activating the Emotion Engine
[0911] (Server) The emotion engine collects facial expression and voice data from the user's device and analyzes their emotional state. As a result of the analysis, it identifies whether the user is relaxed, anxious, or in a hurry.
[0912] Step 6: Adjust notifications
[0913] (Server) Adjust the notification content and format based on the analysis results of the emotion engine. For example, send a warning notification to a user who is anxious, and send information in a standard notification format to a user who is relaxed.
[0914] Step 7: Flight Information Notification
[0915] The server sends the adjusted notification to the user's device, which receives it and displays it on the screen or provides an audio notification to the user. This allows the user to obtain the latest flight information in real time and receive the information in a way that suits their emotional state.
[0916] Specific examples
[0917] For example, consider a scenario in which Mr. Sato uses the system. After registering as a new user, Mr. Sato registers his flight "AA123." The server periodically retrieves the latest flight information from the airport information system and receives information that "the departure time of AA123 has been changed to 15:30."
[0918] The server translates this information and displays it in Japanese as "The departure time of flight AA123 has been changed to 15:30." At the same time, if the emotion engine detects an emotion of impatience from Sato's facial expression or voice data, the server emphasizes the content of the notification and notifies Sato's smartphone of the information in a format that conveys urgency. Sato's device receives the notification and displays the message, "The departure time of flight AA123 has been changed. Please be careful."
[0919] This system will allow Sato to receive accurate flight information in Japanese in a timely manner, and the information will be presented in an easy-to-understand format that is tailored to his current emotions.
[0920] The processing flow will be explained below.
[0921] Step 1:
[0922] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[0923] Step 2:
[0924] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[0925] Step 3:
[0926] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[0927] Step 4:
[0928] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[0929] Step 5:
[0930] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information, which is then stored in a database.
[0931] Step 6:
[0932] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[0933] Step 7:
[0934] (Server) If matching flight information is found, translate the information into Japanese. Use translation means to convert the flight information into Japanese format.
[0935] Step 8:
[0936] (Server) Activates the emotion engine and collects the user's facial expression and voice data from the device. The emotion engine analyzes this data and identifies the user's emotional state.
[0937] Step 9:
[0938] (Server) Adjust the content and format of notifications based on the user's recognized emotions. For example, if the user is anxious, make the notification more emphatic and less anxious.
[0939] Step 10:
[0940] (Server) Send adjusted Japanese notifications to the user's device.
[0941] Step 11:
[0942] (Device) The user's device receives the notification and displays the notification content on the screen. If necessary, a voice notification is also provided.
[0943] Step 12:
[0944] (User) Check notifications on the device to understand flight changes and warnings. This allows the user to understand the latest flight information and reduce anxiety.
[0945] Example 2
[0946] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[0947] While users have a need to receive airport flight information in Japanese, flight information is usually provided in international languages, creating a language barrier. Furthermore, if flight information notifications are uniformly provided, it is not possible to provide appropriate information according to the user's emotional state, and users who feel anxious or impatient cannot receive prompt and clear information.
[0948] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for collecting flight information from an airport's flight information system, a means for a user to register their own flight information, a means for comparing the registered flight information with the collected flight information, a means for translating the compared flight information into Japanese, a means for notifying the translated flight information to the user's terminal, an emotion recognition means for analyzing the user's emotional state, and a means for adjusting the notification content based on the analysis result. This allows the user to obtain real-time flight information in Japanese and receive the information in an appropriate format according to their emotional state at that time.
[0949] An "airport flight information system" is a digital system that provides flight information such as aircraft departure and arrival times, gate numbers, and delay information.
[0950] "Flight information collection" is the process of obtaining up-to-date flight data from the airport's flight information system.
[0951] "User" means an individual who uses the system and registers and receives their flight information.
[0952] "Registering flight information" refers to the act of a user entering and saving the flight number and departure date and time of the user's planned flight into the system.
[0953] "Flight information matching" is the process of comparing the flight information registered by the user with the latest collected flight information to find matching data.
[0954] "Flight information translation" is the process of converting flight information into Japanese.
[0955] A "notification" is a message or alert sent to inform a user of specific information.
[0956] A "terminal" is a digital device such as a smartphone or computer that a user owns.
[0957] The "emotion recognition means" is a system that analyzes the user's facial expressions and voice data to determine their current emotional state (relaxed, anxious, anxious, etc.).
[0958] The "analysis result" is data obtained after the emotion recognition means analyzes the user's emotional state.
[0959] "Adjusting notification content" is the process of changing the content and display format of a notification message based on the user's emotional state.
[0960] The present invention provides a system that allows users to receive airport flight information in Japanese and adjusts the content and format of the information notification based on the user's emotional state. Specifically, the system includes the following means:
[0961] Flight information registration
[0962] Users access the system and register by entering their flight information (flight number and departure date and time). After registration, the server stores this information in a database. The terminals used by users are digital devices such as smartphones and PCs.
[0963] Collecting flight information
[0964] The server periodically connects to the airport's flight information system to collect the latest flight information, which is then stored in a database and updated in real time using a digital interface such as an airport information API.
[0965] Flight information collation and translation
[0966] The server compares the flight information registered by the user with the latest flight information collected and identifies matching flight information. This matching flight information is then translated into Japanese using translation software such as a real-time translation API.
[0967] Analysis by emotion engine
[0968] The server collects facial expression and voice data from the user's device and analyzes this data using an emotion engine. The emotion engine determines whether the user is relaxed, anxious, or in a hurry. Analysis of the user's emotional state uses a facial recognition API and voice emotion recognition software.
[0969] Adjusting notification content
[0970] The server adjusts the content and format of notifications based on the analysis results of the emotion engine. For example, it sends a warning notification to a user who is anxious, and a regular notification to a user who is relaxed.
[0971] Flight information notifications
[0972] The server then sends the tailored notification to the user's device, which receives the notification and displays it on the screen or provides an audio notification to the user, allowing the user to obtain the latest flight information in real time and receive the information in a format that suits their emotional state.
[0973] Specific examples
[0974] Specifically, suppose a user registers his / her flight "AB123" after registering a new flight. The server retrieves the latest flight information from the airport information system and receives the information that "the departure time of AB123 has been changed to 16:00."
[0975] The server translates this information into Japanese and converts it to "The departure time of flight AB123 has been changed to 16:00." At the same time, if the emotion engine detects an emotion of impatience from the user's facial expression or voice data, the server emphasizes the notification content and sends the information in a format that conveys urgency, saying, "The departure time of flight AB123 has been changed. Please be careful." The user's device receives this and displays it on the screen.
[0976] Examples of prompt statements
[0977] Examples of prompts to input to a generative AI model include:
[0978] "Collect flight information entered by the user and translate it into Japanese. Then, explain in detail how to analyze the user's emotional state and provide the flight information in an appropriate notification format."
[0979] Using this prompt, the generative AI model can explain the detailed processing of the system in natural language.
[0980] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0981] Program processing flow
[0982] Step 1: User Registration and Login
[0983] 1. The user accesses the system's registration page and enters the required personal information (name, email address, password, etc.).
[0984] Input: Name, Email Address, Password
[0985] Data processing: Converting input information into the appropriate format
[0986] Output: Registration processing request
[0987] 2. When the user submits the information, the server receives the data and stores it in a database.
[0988] Input: Registration processing request
[0989] Data processing: Data validation and storage processing
[0990] Output: User information saved
[0991] 3. The server returns a message that user registration is complete.
[0992] Input: User information saved result
[0993] Data operation: generating a success or failure message
[0994] Output: Completion message
[0995] Step 2: Register your flight information
[0996] 1. After logging in, the user accesses the flight information registration page and enters the flight number and departure date and time.
[0997] Input: Flight number, departure date and time
[0998] Data processing: Format conversion of input information
[0999] Output: Flight information registration request
[1000] 2. When the user submits the information, the server receives the data and stores it in a database.
[1001] Input: Flight information registration request
[1002] Data processing: Data validation and storage processing
[1003] Output: Flight information saved
[1004] 3. The server returns a message that flight information registration is complete.
[1005] Input: Flight information saved result
[1006] Data operation: generating a success or failure message
[1007] Output: Completion message
[1008] Step 3: Gather your flight information
[1009] 1. The server periodically connects to the airport's flight information system to collect the latest flight information.
[1010] Input: None (periodic trigger)
[1011] Data processing: Data acquisition and processing from airport information API
[1012] Output: Collected flight information
[1013] 2. The server stores the collected flight information in a database.
[1014] Input: Collected flight information
[1015] Data processing: Data validation and storage processing
[1016] Output: Flight information saved
[1017] Step 4: Check and translate flight information
[1018] 1. The server retrieves the flight information registered by the user from the database.
[1019] Input: User ID
[1020] Data processing: generating and executing database queries
[1021] Output: Registered flight information
[1022] 2. The server checks the current flight information against the user's flight information.
[1023] Input: Registered flight information, latest collected flight information
[1024] Data processing: Matching process and extraction of matching data
[1025] Output: Matching flight information
[1026] 3. The server translates the matched flight information into Japanese.
[1027] Input: Matching flight information
[1028] Data calculation: Japanese conversion using translation API
[1029] Output: Translated flight information
[1030] Step 5: Activating the Emotion Engine
[1031] 1. The server collects facial expression and voice data from the user's device.
[1032] Input: facial expression data, voice data
[1033] Data Processing: Data collection and pre-processing
[1034] Output: Collected user data
[1035] 2. The server analyzes the data using an emotion engine to determine the emotional state.
[1036] Input: Collected user data
[1037] Data Calculation: Analysis with Emotion Recognition API
[1038] Output: Emotional state analysis results
[1039] 3. The server stores the analysis results and uses them to adjust notifications.
[1040] Input: Emotional state analysis results
[1041] Data processing: Saving to database
[1042] Output: Save completion result
[1043] Step 6: Adjust notifications
[1044] 1. The server adjusts the content and format of the notification based on the analysis results of the emotion engine.
[1045] Input: Emotional state analysis results, translated flight information
[1046] Data calculation: Adjusting notification content and format
[1047] Output: Reconciled notification message
[1048] 2. Provide highlighted notifications for anxious users and normal notifications for relaxed users.
[1049] Input: Reconciled notification message
[1050] Data operation: Notification message format conversion
[1051] Output: Optimized notification message
[1052] Step 7: Flight Information Notification
[1053] 1. The server sends the tailored notification to the user's device.
[1054] Input: Optimized notification message
[1055] Data processing: Creating push notification messages
[1056] Output: Send processing request
[1057] 2. The device receives the notification and displays it on the screen or provides an audio notification to the user.
[1058] Input: Notification message sent
[1059] Data calculation: Message analysis and display processing
[1060] Output: User notification display
[1061] (Application example 2)
[1062] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1063] In situations where users need to receive real-time information, such as international flight information or food delivery, language barriers and stress levels often hinder their understanding of the information. Furthermore, there is no way to provide information in an appropriate format depending on the user's emotional state, making it difficult to effectively communicate information.
[1064] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting flight information from an airport's flight information system, means for a user to register their own flight information, means for comparing the registered flight information with the collected flight information, means for translating the compared flight information into Japanese, means for notifying the translated flight information to the user's terminal, and means for recognizing the user's emotional state using an emotion engine and adjusting the content and format of the information notification. This enables the user to receive accurate information in real time across language barriers, and further enables the information to be provided in an optimal format depending on the user's emotional state at the time.
[1065] An "airport flight information system" is a system that manages and provides aircraft flight information in real time.
[1066] "User" refers to an individual, corporation, or organization that uses this system.
[1067] "Flight information" refers to data that includes detailed information such as aircraft departure and arrival times, gate numbers, and flight numbers.
[1068] "Registering" refers to the act of a user entering and saving their flight information into the system.
[1069] "Matching" refers to the process of comparing registered flight information with collected flight information to identify matching information.
[1070] "Translation" refers to the act of converting acquired flight information into other languages, particularly Japanese.
[1071] "Notification" refers to the act of the system sending information to the user's terminal and informing the user visually or audibly.
[1072] An "emotion engine" is an algorithm or software that recognizes a user's emotional state and adjusts the content and format of notifications based on that information.
[1073] The present invention provides a system that allows a user to receive accurate information in real time and receive notifications in an optimal format depending on the user's emotional state. Specific embodiments are described below.
[1074] Hardware and Software Configuration
[1075] The system mainly consists of a server, a user's device (a smartphone or other display device), and a network infrastructure. The server is equipped with a flight information collection system and an emotion engine, and the user's device has a notification application installed.
[1076] 1. Collecting flight information
[1077] The server periodically connects with the airport's flight information system to collect the latest flight information, which is then stored in a database that is kept up to date.
[1078] 2. User registration and flight information entry
[1079] A user accesses the system using his / her terminal and registers his / her flight information, which includes the flight number, date and time, and other details specified by the user.
[1080] 3. Flight information verification and translation
[1081] The server compares the collected flight information with the flight information registered by the user. The matched flight information is translated into Japanese. A translation API, such as the Google Translate API, is used here.
[1082] 4. Emotion analysis using an emotion engine
[1083] The emotion engine installed on the server collects data (facial images, voice data, etc.) from the user's device and uses a deep learning model to analyze the user's emotional state, which can include joy, anger, sadness, surprise, etc.
[1084] 5. Coordinating and sending notifications
[1085] The content and format of the notification are adjusted according to the user's emotional state. For example, if the user is feeling anxious, the notification will be quick and detailed. If the user is relaxed, the notification will be in a normal format. This notification is sent to the user's device, and the device will display it on the screen or make an audio notification.
[1086] Specific examples
[1087] For example, suppose a user uses this system and registers their flight information. The server retrieves the latest flight information from the airport information system, translates the information, "Flight AA123 has been delayed and its departure time has been changed to 15:30," and notifies the user. If the emotion engine detects impatience in the user's facial expression, the server sends an emergency message in a special format: "The departure time of flight AA123 has been changed to 15:30. Please be careful." The user's device receives the notification and presents the information in an appropriate format.
[1088] Prompt Sentence Examples
[1089] Below are some examples of typical prompts that users may encounter when using the system.
[1090] "What time is the food scheduled to be delivered?"
[1091] The system uses generative AI models to return appropriate answers.
[1092] "The sushi set is scheduled to be delivered at 6:30 PM. Our delivery staff is currently near you. Please hurry."
[1093] In this way, the present invention enables users to receive accurate information in real time, regardless of language barriers, and further allows users to receive information in an easily understandable format that suits their emotions at the time.
[1094] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1095] Processing steps of the system program that realizes the application example
[1096] Step 1:
[1097] A user launches the smartphone app and registers or logs in. Here, the user enters their flight or delivery information. Input includes the flight number, departure date and time, delivery order details, and delivery address information. The server receives this information and stores it in a database. The output is the registered user information, flight information, and delivery information.
[1098] Step 2:
[1099] The server periodically connects to the airport's flight information system or food delivery management system to collect the latest flight information and delivery status. The input is flight information and delivery status data obtained from external systems. The data is stored in a database and is always kept up to date. The output is flight information and delivery information associated with registered user information.
[1100] Step 3:
[1101] The server matches the collected flight or delivery information with the information registered by the user. The input is all flight and delivery information stored in the database and the information registered by the user. This process identifies matching flight and delivery information. The output is the identified flight and delivery information.
[1102] Step 4:
[1103] Translate the collated flight or delivery information into Japanese. The server uses a translation API (e.g., Google Translate API) to convert the information into Japanese format. The input is the collated original information, and the output is the translated Japanese information.
[1104] Step 5:
[1105] The emotion engine collects facial expression and voice data from the user's device and analyzes the user's emotional state. The input is the user's facial expression and voice data, as well as past behavioral patterns. The emotion engine uses a deep learning model to identify the emotional state. The output is a judgment of the user's emotional state, such as whether they are relaxed, anxious, or impatient.
[1106] Step 6:
[1107] The server adjusts the notification content and format based on the analysis results of the emotion engine. The input is the analysis results and translated information from the emotion engine. For example, if the user is feeling impatient, the notification will be more detailed and prompt. The output is the adjusted notification information.
[1108] Step 7:
[1109] The server sends the adjusted notification to the user's device. The input is the output of step 6, and the output is the notification content displayed on the user's device. Now, the device receives the notification and presents the information to the user in an appropriate format. The user can check the notification and take the necessary action.
[1110] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1111] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1112] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[1113] [Fourth embodiment]
[1114] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[1115] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[1116] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1117] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[1118] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1119] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1120] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1121] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[1122] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1123] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1124] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1125] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1126] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1127] The present invention relates to a system for providing airport flight information in Japanese, and specific embodiments thereof will be described below.
[1128] First, the system is composed of multiple means. Users can register their flight information in the system. As a registration means, users are provided with an interface for entering their flight number and departure date and time.
[1129] Next, the server has a collection means for connecting to the airport's flight information system and periodically collecting all flight information, which is then stored in a database.
[1130] The server compares the flight information registered by the user with the collected flight information, and the comparison means searches all flight information based on the flight number registered by the user to obtain the latest corresponding flight information.
[1131] The collated flight information is then translated into Japanese. The translation means converts the flight information into a predefined Japanese format and prepares it for display in a form that can be easily understood by the user.
[1132] The translated flight information is sent from the server to the user's device via push notification, email, in-app notification, etc. The device then displays the received notification to the user.
[1133] Specific examples
[1134] For example, consider a scenario in which Tanaka uses this system. Tanaka logs into the system and registers his flight, "XZ123." The server records this information and periodically compares it with information collected from the airport's flight information system. At one point, the server receives an update from the flight information system stating that "the departure time of XZ123 has been changed to 14:00."
[1135] The server translates this information into Japanese and generates a message such as, "The departure time of flight XZ123 has been changed to 14:00." The server then notifies Tanaka of this Japanese message on his smartphone. Tanaka's device receives the notification and displays it on its screen. This allows Tanaka to check the latest flight information in Japanese without experiencing any language barriers.
[1136] As described above, the system based on the present invention enables users to receive appropriate flight information in Japanese even at airports in foreign countries where they do not understand the language. This system provides a convenient environment for users through a series of processes, from registering flight information to collecting, translating, and notifying the latest information.
[1137] The processing flow will be explained below.
[1138] Step 1:
[1139] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[1140] Step 2:
[1141] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[1142] Step 3:
[1143] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[1144] Step 4:
[1145] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[1146] Step 5:
[1147] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information, which is then stored in a database.
[1148] Step 6:
[1149] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[1150] Step 7:
[1151] (Server) If matching flight information is found, the information is translated into Japanese. The translated information is converted into a format such as "The departure time of flight XXX has been changed to XXX."
[1152] Step 8:
[1153] (Server) The translated Japanese guide is sent to the user's device via push notification, email, or in-app notification.
[1154] Step 9:
[1155] (Device) The user's device receives the notification and displays the notification content on the screen. The user can check the notification and obtain the latest flight information in Japanese.
[1156] Step 10:
[1157] After receiving the notification, the user further utilizes the system to check flight information as needed, including additional information such as departure gate changes.
[1158] Example 1
[1159] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1160] Currently, flight information provided at many airports is written in English, making it difficult for users who are unfamiliar with foreign languages to accurately understand the latest flight information. Furthermore, when flight information changes, there are limited ways to quickly grasp the information. To solve this problem, there is a need for a system that provides flight information in Japanese, allowing users to easily obtain the latest information.
[1161] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1162] In this invention, the server includes means for providing an interface for users to register their flight information, means for periodically collecting airport flight information and storing it in a database, means for comparing the flight information registered by users with the collected flight information, means for using machine translation software to translate the compared flight information into Japanese, and means for notifying the user's terminal of the translated flight information, thereby enabling users to quickly receive the latest information about their flights in Japanese and eliminating the barrier of information transmission in foreign languages.
[1163] "User" means a person who uses the system to register his / her flight information and obtain the latest flight information based on that information.
[1164] An "interface" is software or hardware that serves as a point of contact through which a user inputs data into or receives information from a system.
[1165] A "server" is a central computer system that provides data and services to other computers and terminals via a network.
[1166] "Database" means a structured information system for storing and managing collected flight information and user-registered information.
[1167] "Matching" refers to the process of comparing the flight information registered by the user with the flight information collected by the server and identifying matching information.
[1168] "Translation" refers to the process of converting collected flight information into Japanese using machine translation software.
[1169] "Notification" refers to the means or process for notifying the user of translated flight information on their terminal.
[1170] A "terminal" is a device that a user uses to receive and display information, and includes smartphones, tablets, and personal computers.
[1171] "Push notification" is a communication method that sends information from a server to a device in real time to notify the user.
[1172] "Machine translation software" means software that automatically translates input text into a specified language.
[1173] The present invention is a system that provides flight information in Japanese at airports, and a specific embodiment thereof is described below. The main elements required are a user, a server, and a terminal, which work together to provide information.
[1174] Flight information registration
[1175] A user uses the provided web or mobile application to register their flight information. Specific flight information includes flight number and departure date and time. When the user enters the registration information through the interface and clicks the "Register" button, the information is sent to the server and stored in the database. For example, the user registers flight number "AB123" and departure date and time "2023-10-12 10:00."
[1176] Collecting flight information
[1177] The server periodically connects to the airport's flight information system to collect and store the latest flight information. This is done using API requests using Python scripts, etc. The collected data is then stored in a database on the server. Specifically, an internet-enabled server and a database server are required, and flight information is obtained from the airport API.
[1178] Flight information verification
[1179] The server matches the flight information registered by the user with the collected flight information, using a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. This matching process allows the user to identify the latest information they want to know.
[1180] Flight information translation
[1181] The collated flight information is translated into Japanese. Machine translation software such as Google Translate API is used for the translation. The collated English flight information is converted into Japanese text and formatted in a way that is easy for users to understand. For example, "Flight AB123 has been delayed to 14:00." is converted to "Flight AB123 has been delayed to 14:00."
[1182] Flight information notifications
[1183] The translated flight information is sent from the server to the user's device. This notification is sent as a push notification using Firebase Cloud Messaging (FCM). In addition to push notifications, email or in-app notifications may also be used. For example, a message saying "The departure time of flight AB123 has been changed to 14:00" is sent.
[1184] View flight information
[1185] The user's device (smartphone, tablet, PC, etc.) will display the received notification. The user can check the notification and understand the latest flight information in Japanese. Specifically, the user's smartphone will receive a notification with the message "Flight AB123 has been delayed until 14:00."
[1186] Adding specific examples
[1187] For example, a user registers their flight "XZ123" in the system, and the server records this information. The latest information is periodically collected from the airport's flight information system, and when the latest information is obtained, it is translated as "The departure time of XZ123 has been changed to 14:00." The server then pushes this Japanese message to the user's smartphone. The user's device receives the notification and displays it on the screen, allowing the user to check the latest flight information in Japanese.
[1188] Examples of prompt statements
[1189] "Please explain the overview of the system that translates and notifies airport flight information into Japanese."
[1190] "Please tell me in detail the process of collecting the latest information based on the flight information registered by the user and notifying them in Japanese."
[1191] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1192] Step 1: User registers their flight information
[1193] The user uses the interface of a web or mobile application to enter flight information (flight number and departure date and time). The entered information is sent to the server and stored in the database by pressing the "Register" button. Specifically, the user enters the flight number "AB123" and departure date and time "2023-10-12 10:00" and clicks the "Register" button. Input data: flight number, departure date and time. Output data: flight information stored in the database.
[1194] Step 2: The server periodically collects airport flight information
[1195] The server periodically connects to the airport's flight information system and collects the latest information on all flights through API requests. The collected information is stored in a database. For example, a Python script is used to get the latest flight information from the airport API and store it in the database. Input data: Flight information from the airport API. Output data: All flight information stored in the database.
[1196] Step 3: The server checks the flight information registered by the user against the collected flight information.
[1197] The server periodically retrieves the user's registration information from the database and compares it with all the flight information collected. It uses a database query (e.g. SQL) to find the latest flight information that matches the registered flight number. For example, a query like "SELECT FROM flights WHERE flight_number='AB123'" is used. Input data: The flight number registered by the user. Output data: The latest matched flight information.
[1198] Step 4: The server translates the matched flight information into Japanese.
[1199] The server translates the matched flight information into Japanese using machine translation software (e.g., Google Translate API). This converts flight information obtained in English (e.g., "Flight AB123 has been delayed to 14:00") into Japanese text (e.g., "Flight AB123 was delayed to 14:00"). Input data: English flight information. Output data: Flight information translated into Japanese.
[1200] Step 5: The server sends the translated flight information to the user's device.
[1201] The server notifies the user's device of the flight information translated into Japanese. This notification is made using Firebase Cloud Messaging (FCM). For example, the Python "pyfcm" library is used to send a push notification to the user's device. Input data: Flight information translated into Japanese. Output data: Push notification sent to the user's device.
[1202] Step 6: Your device receives and displays the notification
[1203] The user's device receives the push notification sent from the server and displays it on the screen. This allows the user to check the latest flight information in Japanese. For example, a message such as "Flight AB123 has been delayed to 14:00" is displayed in the smartphone's notification center. Input data: Received push notification. Output data: Flight information displayed on the screen.
[1204] This allows users to obtain the latest flight information without language barriers.
[1205] (Application example 1)
[1206] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1207] Understanding the operating status and maintenance information of factory equipment in real time is important for efficient production management. However, when different equipment information is provided in multiple languages, it is difficult for factory managers and operators to quickly and accurately understand the information. Furthermore, if equipment abnormalities and maintenance information is not received in a timely manner, the production line may stop and business efficiency may decrease.
[1208] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1209] In this invention, the server includes means for collecting information on the operation status of equipment from the factory equipment information system, means for users to register information on the equipment they manage, means for comparing the registered equipment information with the collected equipment information, means for translating the compared equipment information into Japanese, and means for notifying the translated equipment information to the user's terminal. This makes it possible to grasp the latest equipment information in real time and receive timely notifications in Japanese.
[1210] A "factory equipment information system" is an information system for collecting, managing, and monitoring the operating status and maintenance information of equipment within a factory.
[1211] "Device operation status information" is information about the current operating status of the device (for example, operating, stopped, undergoing maintenance, etc.).
[1212] "Means for users to register information about devices they manage" refers to the interface and mechanism by which users can input and register information about devices they manage into the system.
[1213] "Means for verifying registered equipment information with collected equipment information" refers to a mechanism for comparing and verifying equipment information registered by the user with the latest equipment information collected from the factory's equipment information system.
[1214] "Means for translating equipment information into Japanese" refers to a system for converting collected or collated equipment operating status information into Japanese.
[1215] "Means for notifying the user of translated device information" refers to a mechanism for notifying the user of the translated device's operating status information on the user's device (e.g., a smartphone, tablet, etc.).
[1216] The present invention relates to a system that provides the latest information on equipment in a factory in Japanese and notifies the user's terminal, and specific embodiments thereof are described below.
[1217] First, the system is composed of multiple means. Users can register information about the devices they manage in the system. As a registration method, users are provided with an interface for entering the IDs and names of the devices they manage.
[1218] Next, the server is connected to the factory's equipment information system and has a means of periodically collecting information on the operating status of all equipment. This collected equipment information is stored in a database.
[1219] The server compares the device information registered by the user with the collected device information. The comparison means searches all device information based on the device ID registered by the user and obtains the corresponding latest operating status information.
[1220] The collated device information is then translated into Japanese. The translation means converts the device information into a predetermined Japanese format and prepares it for display in a form that can be easily understood by the user.
[1221] The translated device information is sent from the server to the user's device. Possible notification methods include push notifications, emails, and in-app notifications. The device then displays the received notification to the user. This allows users to check the latest device information in Japanese without experiencing a language barrier.
[1222] As a concrete example, consider a scenario in which a factory manager uses this system. The manager logs into the system and registers the device "MACH01" that he manages. The server records this information and periodically compares it with information collected from the factory's device information system. At one point, the server receives the latest information from the device information system stating that "the operating status of MACH01 has changed to operating."
[1223] The server translates this information into Japanese and generates a message such as "The latest status of device MACH01 is up and running." The server then notifies the administrator of this Japanese message. The administrator's device receives the notification and displays it on the screen. This allows the administrator to check the latest device information in Japanese without having to worry about the language barrier.
[1224] The hardware and software used here include a server for connecting to the device information system, a database for managing user information, an API for processing the collected information, and a push notification service for sending notifications. For example, the server is built using Python and runs code that connects to an API for collecting flight information. MySQL or PostgreSQL is used as the database, and Firebase Cloud Messaging (FCM) is used for push notifications.
[1225] In addition, the translation function is realized by a generative AI model, and examples of prompt sentences that translate appropriately into Japanese are as follows:
[1226] "Please translate the latest status of the factory equipment in Japanese. For example:
[1227] 'running' -> 'Running'
[1228] 'maintenance required' -> 'maintenance required'
[1229] 'shutdown' -> 'stopping'"
[1230] As described above, the system based on the present invention grasps the operating status of equipment within a factory in real time and notifies the manager in Japanese, enabling the manager to efficiently manage the factory.
[1231] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1232] Step 1:
[1233] The server collects information on the operation status of equipment from the factory's equipment information system. Specifically, it periodically sends requests to the API endpoint to obtain the latest information. The input is the API request, and the output is equipment information data in JSON format. This data is stored in a database on the server.
[1234] Step 2:
[1235] Users register information about the devices they manage in the system. The user enters the device ID and name through the interface, and that information is sent to the server and recorded in the database. The input is the device information registered by the user, and the output is the device information being saved to the database.
[1236] Step 3:
[1237] The server compares the registered device information with the collected device information. Specifically, it searches for and retrieves the latest operating status information based on the device ID registered by the user in the database. The input is the device ID and latest device information stored in the database, and the output is the verified operating status data of the device.
[1238] Step 4:
[1239] The server translates the matched device information into Japanese. It uses a prompt generated by the AI model to convert the operation status information into Japanese. The input is the matched device information, and the output is the device operation status sentence translated into Japanese. Specifically, the following prompt sentence is sent to the AI model, which then translates it:
[1240] "Please translate the latest status of the factory equipment in Japanese. For example:
[1241] 'running' -> 'Running'
[1242] 'maintenance required' -> 'maintenance required'
[1243] 'shutdown' -> 'stopping'"
[1244] Step 5:
[1245] The server notifies the user's device of the translated device information. Specifically, the translated information is sent using push notifications or email sending functions. The input is the device information translated into Japanese, and the output is the completion of notification to the user's device. Firebase Cloud Messaging (FCM) and similar services are used for push notifications.
[1246] Step 6:
[1247] The user device displays the received notification. The received message is displayed in the device's notification center or application. The input is the notification information received from the server, and the output is a screen display that the user can see. Specifically, the device's notification function or application UI is activated.
[1248] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1249] The present invention is a system that overcomes language barriers and enables users to receive airport flight information in Japanese. Furthermore, the present invention is a system that incorporates an emotion engine that recognizes the user's emotions and adjusts the content and format of information notifications based on the emotions.
[1250] The system comprises the following means:
[1251] 1. Flight information registration:
[1252] The user registers his / her flight information in the system by inputting his / her flight number and departure date and time and sending it to the server.
[1253] 2. Collecting flight information:
[1254] The server periodically connects to the airport's flight information system to collect the latest information on all flights, which is then stored in a database that is kept up to date.
[1255] 3. Flight information verification:
[1256] The server compares all collected flight information with the flight information registered by the user, and identifies the latest flight information corresponding to the flight number registered by the user.
[1257] 4. Flight Information Translation:
[1258] The collated flight information is translated into Japanese. The server uses a translation means to convert the flight information into a Japanese format.
[1259] 5. Emotion Engine:
[1260] It has a built-in emotion engine that recognizes the user's emotions. The emotion engine analyzes the user's current emotional state based on the user's facial expressions, voice, past behavioral patterns, etc.
[1261] 6. Emotion-based notification adjustment:
[1262] Based on the perceived emotion, the server can adjust the content and format of notifications, for example, delivering notifications faster and in a clearer format if the user is feeling impatient or anxious.
[1263] 7. Flight Information Notification:
[1264] The translated flight information and adjusted notifications are sent from the server to the user's device, which receives the notifications and displays them to the user.
[1265] Program processing explanation
[1266] Step 1: User Registration and Login
[1267] (User) Accesses the system to register or log in as a new user. When registering as a new user, the user enters the required information and sends it to the system. The server receives this information, stores it in the database, and performs authentication.
[1268] Step 2: Register your flight information
[1269] After logging in, the user enters the flight number and departure date and time to register. The server receives this information and stores it in the database.
[1270] Step 3: Gather your flight information
[1271] (Server) Connects to the airport's flight information system and periodically collects the latest flight information. The collected data is stored in a database.
[1272] Step 4: Check and translate flight information
[1273] (Server) Compares the flight information registered by the user with the latest flight information and translates the matching flight information into Japanese.
[1274] Step 5: Activating the Emotion Engine
[1275] (Server) The emotion engine collects facial expression and voice data from the user's device and analyzes their emotional state. As a result of the analysis, it identifies whether the user is relaxed, anxious, or in a hurry.
[1276] Step 6: Adjust notifications
[1277] (Server) Adjust the notification content and format based on the analysis results of the emotion engine. For example, send a warning notification to a user who is anxious, and send information in a standard notification format to a user who is relaxed.
[1278] Step 7: Flight Information Notification
[1279] The server sends the adjusted notification to the user's device, which receives it and displays it on the screen or provides an audio notification to the user. This allows the user to obtain the latest flight information in real time and receive the information in a way that suits their emotional state.
[1280] Specific examples
[1281] For example, consider a scenario in which Mr. Sato uses the system. After registering as a new user, Mr. Sato registers his flight "AA123." The server periodically retrieves the latest flight information from the airport information system and receives information that "the departure time of AA123 has been changed to 15:30."
[1282] The server translates this information and displays it in Japanese as "The departure time of flight AA123 has been changed to 15:30." At the same time, if the emotion engine detects an emotion of impatience from Sato's facial expression or voice data, the server emphasizes the content of the notification and notifies Sato's smartphone of the information in a format that conveys urgency. Sato's device receives the notification and displays the message, "The departure time of flight AA123 has been changed. Please be careful."
[1283] This system will allow Sato to receive accurate flight information in Japanese in a timely manner, and the information will be presented in an easy-to-understand format that is tailored to his current emotions.
[1284] The processing flow will be explained below.
[1285] Step 1:
[1286] (User) Access the system and register or log in. When registering, enter basic information such as username, password, and email address.
[1287] Step 2:
[1288] (Server) Receives user registration or login information and stores it in the database or authenticates it. In the case of new registration, generates a user ID and stores it in the database.
[1289] Step 3:
[1290] (User) After logging in, register your flight information by entering the flight number and departure date and time and submitting it to the system.
[1291] Step 4:
[1292] (Server) Save the flight information registered by the user in the database. Specifically, record the flight number and departure date and time in association with the user ID.
[1293] Step 5:
[1294] (Server) Connects to the airport's flight information system at regular intervals to collect the latest flight information, which is then stored in a database.
[1295] Step 6:
[1296] (Server) Compares the user's flight information stored in the database with all the latest flight information. Searches for the latest information based on the flight number registered by the user.
[1297] Step 7:
[1298] (Server) If matching flight information is found, translate the information into Japanese. Use translation means to convert the flight information into Japanese format.
[1299] Step 8:
[1300] (Server) Activates the emotion engine and collects the user's facial expression and voice data from the device. The emotion engine analyzes this data and identifies the user's emotional state.
[1301] Step 9:
[1302] (Server) Adjust the content and format of notifications based on the user's recognized emotions. For example, if the user is anxious, make the notification more emphatic and less anxious.
[1303] Step 10:
[1304] (Server) Send adjusted Japanese notifications to the user's device.
[1305] Step 11:
[1306] (Device) The user's device receives the notification and displays the notification content on the screen. If necessary, a voice notification is also provided.
[1307] Step 12:
[1308] (User) Check notifications on the device to understand flight changes and warnings. This allows the user to understand the latest flight information and reduce anxiety.
[1309] Example 2
[1310] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1311] While users have a need to receive airport flight information in Japanese, flight information is usually provided in international languages, creating a language barrier. Furthermore, if flight information notifications are uniformly provided, it is not possible to provide appropriate information according to the user's emotional state, and users who feel anxious or impatient cannot receive prompt and clear information.
[1312] The identification process by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for collecting flight information from an airport's flight information system, a means for a user to register their own flight information, a means for comparing the registered flight information with the collected flight information, a means for translating the compared flight information into Japanese, a means for notifying the translated flight information to the user's terminal, an emotion recognition means for analyzing the user's emotional state, and a means for adjusting the notification content based on the analysis result. This allows the user to obtain real-time flight information in Japanese and receive the information in an appropriate format according to their emotional state at that time.
[1313] An "airport flight information system" is a digital system that provides flight information such as aircraft departure and arrival times, gate numbers, and delay information.
[1314] "Flight information collection" is the process of obtaining up-to-date flight data from the airport's flight information system.
[1315] "User" means an individual who uses the system and registers and receives their flight information.
[1316] "Registering flight information" refers to the act of a user entering and saving the flight number and departure date and time of the user's planned flight into the system.
[1317] "Flight information matching" is the process of comparing the flight information registered by the user with the latest collected flight information to find matching data.
[1318] "Flight information translation" is the process of converting flight information into Japanese.
[1319] A "notification" is a message or alert sent to inform a user of specific information.
[1320] A "terminal" is a digital device such as a smartphone or computer that a user owns.
[1321] The "emotion recognition means" is a system that analyzes the user's facial expressions and voice data to determine their current emotional state (relaxed, anxious, anxious, etc.).
[1322] The "analysis result" is data obtained after the emotion recognition means analyzes the user's emotional state.
[1323] "Adjusting notification content" is the process of changing the content and display format of a notification message based on the user's emotional state.
[1324] The present invention provides a system that allows users to receive airport flight information in Japanese and adjusts the content and format of the information notification based on the user's emotional state. Specifically, the system includes the following means:
[1325] Flight information registration
[1326] Users access the system and register by entering their flight information (flight number and departure date and time). After registration, the server stores this information in a database. The terminals used by users are digital devices such as smartphones and PCs.
[1327] Collecting flight information
[1328] The server periodically connects to the airport's flight information system to collect the latest flight information, which is then stored in a database and updated in real time using a digital interface such as an airport information API.
[1329] Flight information collation and translation
[1330] The server compares the flight information registered by the user with the latest flight information collected and identifies matching flight information. This matching flight information is then translated into Japanese using translation software such as a real-time translation API.
[1331] Analysis by emotion engine
[1332] The server collects facial expression and voice data from the user's device and analyzes this data using an emotion engine. The emotion engine determines whether the user is relaxed, anxious, or in a hurry. Analysis of the user's emotional state uses a facial recognition API and voice emotion recognition software.
[1333] Adjusting notification content
[1334] The server adjusts the content and format of notifications based on the analysis results of the emotion engine. For example, it sends a warning notification to a user who is anxious, and a regular notification to a user who is relaxed.
[1335] Flight information notifications
[1336] The server then sends the tailored notification to the user's device, which receives the notification and displays it on the screen or provides an audio notification to the user, allowing the user to obtain the latest flight information in real time and receive the information in a format that suits their emotional state.
[1337] Specific examples
[1338] Specifically, suppose a user registers his / her flight "AB123" after registering a new flight. The server retrieves the latest flight information from the airport information system and receives the information that "the departure time of AB123 has been changed to 16:00."
[1339] The server translates this information into Japanese and converts it to "The departure time of flight AB123 has been changed to 16:00." At the same time, if the emotion engine detects an emotion of impatience from the user's facial expression or voice data, the server emphasizes the notification content and sends the information in a format that conveys urgency, saying, "The departure time of flight AB123 has been changed. Please be careful." The user's device receives this and displays it on the screen.
[1340] Examples of prompt statements
[1341] Examples of prompts to input to a generative AI model include:
[1342] "Collect flight information entered by the user and translate it into Japanese. Then, explain in detail how to analyze the user's emotional state and provide the flight information in an appropriate notification format."
[1343] Using this prompt, the generative AI model can explain the detailed processing of the system in natural language.
[1344] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1345] Program processing flow
[1346] Step 1: User Registration and Login
[1347] 1. The user accesses the system's registration page and enters the required personal information (name, email address, password, etc.).
[1348] Input: Name, Email Address, Password
[1349] Data processing: Converting input information into the appropriate format
[1350] Output: Registration processing request
[1351] 2. When the user submits the information, the server receives the data and stores it in a database.
[1352] Input: Registration processing request
[1353] Data processing: Data validation and storage processing
[1354] Output: User information saved
[1355] 3. The server returns a message that user registration is complete.
[1356] Input: User information saved result
[1357] Data operation: generating a success or failure message
[1358] Output: Completion message
[1359] Step 2: Register your flight information
[1360] 1. After logging in, the user accesses the flight information registration page and enters the flight number and departure date and time.
[1361] Input: Flight number, departure date and time
[1362] Data processing: Format conversion of input information
[1363] Output: Flight information registration request
[1364] 2. When the user submits the information, the server receives the data and stores it in a database.
[1365] Input: Flight information registration request
[1366] Data processing: Data validation and storage processing
[1367] Output: Flight information saved
[1368] 3. The server returns a message that flight information registration is complete.
[1369] Input: Flight information saved result
[1370] Data operation: generating a success or failure message
[1371] Output: Completion message
[1372] Step 3: Gather your flight information
[1373] 1. The server periodically connects to the airport's flight information system to collect the latest flight information.
[1374] Input: None (periodic trigger)
[1375] Data processing: Data acquisition and processing from airport information API
[1376] Output: Collected flight information
[1377] 2. The server stores the collected flight information in a database.
[1378] Input: Collected flight information
[1379] Data processing: Data validation and storage processing
[1380] Output: Flight information saved
[1381] Step 4: Check and translate flight information
[1382] 1. The server retrieves the flight information registered by the user from the database.
[1383] Input: User ID
[1384] Data processing: generating and executing database queries
[1385] Output: Registered flight information
[1386] 2. The server checks the current flight information against the user's flight information.
[1387] Input: Registered flight information, latest collected flight information
[1388] Data processing: Matching process and extraction of matching data
[1389] Output: Matching flight information
[1390] 3. The server translates the matched flight information into Japanese.
[1391] Input: Matching flight information
[1392] Data calculation: Japanese conversion using translation API
[1393] Output: Translated flight information
[1394] Step 5: Activating the Emotion Engine
[1395] 1. The server collects facial expression and voice data from the user's device.
[1396] Input: facial expression data, voice data
[1397] Data Processing: Data collection and pre-processing
[1398] Output: Collected user data
[1399] 2. The server analyzes the data using an emotion engine to determine the emotional state.
[1400] Input: Collected user data
[1401] Data Calculation: Analysis with Emotion Recognition API
[1402] Output: Emotional state analysis results
[1403] 3. The server stores the analysis results and uses them to adjust notifications.
[1404] Input: Emotional state analysis results
[1405] Data processing: Saving to database
[1406] Output: Save completion result
[1407] Step 6: Adjust notifications
[1408] 1. The server adjusts the content and format of the notification based on the analysis results of the emotion engine.
[1409] Input: Emotional state analysis results, translated flight information
[1410] Data calculation: Adjusting notification content and format
[1411] Output: Reconciled notification message
[1412] 2. Provide highlighted notifications for anxious users and normal notifications for relaxed users.
[1413] Input: Reconciled notification message
[1414] Data operation: Notification message format conversion
[1415] Output: Optimized notification message
[1416] Step 7: Flight Information Notification
[1417] 1. The server sends the tailored notification to the user's device.
[1418] Input: Optimized notification message
[1419] Data processing: Creating push notification messages
[1420] Output: Send processing request
[1421] 2. The device receives the notification and displays it on the screen or provides an audio notification to the user.
[1422] Input: Notification message sent
[1423] Data calculation: Message analysis and display processing
[1424] Output: User notification display
[1425] (Application example 2)
[1426] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[1427] In situations where users need to receive real-time information, such as international flight information or food delivery, language barriers and stress levels often hinder their understanding of the information. Furthermore, there is no way to provide information in an appropriate format depending on the user's emotional state, making it difficult to effectively communicate information.
[1428] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for collecting flight information from an airport's flight information system, means for a user to register their own flight information, means for comparing the registered flight information with the collected flight information, means for translating the compared flight information into Japanese, means for notifying the translated flight information to the user's terminal, and means for recognizing the user's emotional state using an emotion engine and adjusting the content and format of the information notification. This enables the user to receive accurate information in real time across language barriers, and further enables the information to be provided in an optimal format depending on the user's emotional state at the time.
[1429] An "airport flight information system" is a system that manages and provides aircraft flight information in real time.
[1430] "User" refers to an individual, corporation, or organization that uses this system.
[1431] "Flight information" refers to data that includes detailed information such as aircraft departure and arrival times, gate numbers, and flight numbers.
[1432] "Registering" refers to the act of a user entering and saving their flight information into the system.
[1433] "Matching" refers to the process of comparing registered flight information with collected flight information to identify matching information.
[1434] "Translation" refers to the act of converting acquired flight information into other languages, particularly Japanese.
[1435] "Notification" refers to the act of the system sending information to the user's terminal and informing the user visually or audibly.
[1436] An "emotion engine" is an algorithm or software that recognizes a user's emotional state and adjusts the content and format of notifications based on that information.
[1437] The present invention provides a system that allows a user to receive accurate information in real time and receive notifications in an optimal format depending on the user's emotional state. Specific embodiments are described below.
[1438] Hardware and Software Configuration
[1439] The system mainly consists of a server, a user's device (a smartphone or other display device), and a network infrastructure. The server is equipped with a flight information collection system and an emotion engine, and the user's device has a notification application installed.
[1440] 1. Collecting flight information
[1441] The server periodically connects with the airport's flight information system to collect the latest flight information, which is then stored in a database that is kept up to date.
[1442] 2. User registration and flight information entry
[1443] A user accesses the system using his / her terminal and registers his / her flight information, which includes the flight number, date and time, and other details specified by the user.
[1444] 3. Flight information verification and translation
[1445] The server compares the collected flight information with the flight information registered by the user. The matched flight information is translated into Japanese. A translation API, such as the Google Translate API, is used here.
[1446] 4. Emotion analysis using an emotion engine
[1447] The emotion engine installed on the server collects data (facial images, voice data, etc.) from the user's device and uses a deep learning model to analyze the user's emotional state, which can include joy, anger, sadness, surprise, etc.
[1448] 5. Coordinating and sending notifications
[1449] The content and format of the notification are adjusted according to the user's emotional state. For example, if the user is feeling anxious, the notification will be quick and detailed. If the user is relaxed, the notification will be in a normal format. This notification is sent to the user's device, and the device will display it on the screen or make an audio notification.
[1450] Specific examples
[1451] For example, suppose a user uses this system and registers their flight information. The server retrieves the latest flight information from the airport information system, translates the information, "Flight AA123 has been delayed and its departure time has been changed to 15:30," and notifies the user. If the emotion engine detects impatience in the user's facial expression, the server sends an emergency message in a special format: "The departure time of flight AA123 has been changed to 15:30. Please be careful." The user's device receives the notification and presents the information in an appropriate format.
[1452] Prompt Sentence Examples
[1453] Below are some examples of typical prompts that users may encounter when using the system.
[1454] "What time is the food scheduled to be delivered?"
[1455] The system uses generative AI models to return appropriate answers.
[1456] "The sushi set is scheduled to be delivered at 6:30 PM. Our delivery staff is currently near you. Please hurry."
[1457] In this way, the present invention enables users to receive accurate information in real time, regardless of language barriers, and further allows users to receive information in an easily understandable format that suits their emotions at the time.
[1458] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1459] Processing steps of the system program that realizes the application example
[1460] Step 1:
[1461] A user launches the smartphone app and registers or logs in. Here, the user enters their flight or delivery information. Input includes the flight number, departure date and time, delivery order details, and delivery address information. The server receives this information and stores it in a database. The output is the registered user information, flight information, and delivery information.
[1462] Step 2:
[1463] The server periodically connects to the airport's flight information system or food delivery management system to collect the latest flight information and delivery status. The input is flight information and delivery status data obtained from external systems. The data is stored in a database and is always kept up to date. The output is flight information and delivery information associated with registered user information.
[1464] Step 3:
[1465] The server matches the collected flight or delivery information with the information registered by the user. The input is all flight and delivery information stored in the database and the information registered by the user. This process identifies matching flight and delivery information. The output is the identified flight and delivery information.
[1466] Step 4:
[1467] Translate the collated flight or delivery information into Japanese. The server uses a translation API (e.g., Google Translate API) to convert the information into Japanese format. The input is the collated original information, and the output is the translated Japanese information.
[1468] Step 5:
[1469] The emotion engine collects facial expression and voice data from the user's device and analyzes the user's emotional state. The input is the user's facial expression and voice data, as well as past behavioral patterns. The emotion engine uses a deep learning model to identify the emotional state. The output is a judgment of the user's emotional state, such as whether they are relaxed, anxious, or impatient.
[1470] Step 6:
[1471] The server adjusts the notification content and format based on the analysis results of the emotion engine. The input is the analysis results and translated information from the emotion engine. For example, if the user is feeling impatient, the notification will be more detailed and prompt. The output is the adjusted notification information.
[1472] Step 7:
[1473] The server sends the adjusted notification to the user's device. The input is the output of step 6, and the output is the notification content displayed on the user's device. Now, the device receives the notification and presents the information to the user in an appropriate format. The user can check the notification and take the necessary action.
[1474] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.
[1475] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1476] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.
[1477] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.
[1478] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.
[1479] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.
[1480] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).
[1481] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.
[1482] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."
[1483] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.
[1484] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).
[1485] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.
[1486] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.
[1487] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.
[1488] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.
[1489] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.
[1490] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.
[1491] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.
[1492] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.
[1493] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.
[1494] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.
[1495] The following is further disclosed regarding the above embodiment.
[1496] (Claim 1)
[1497] a means for collecting flight information from an airport flight information system;
[1498] A means for users to register their flight information;
[1499] a means for matching registered flight information with collected flight information;
[1500] A means of translating the collated flight information into Japanese;
[1501] A means of notifying the user of the translated flight information on their device;
[1502] A system including:
[1503] (Claim 2)
[1504] 10. The system of claim 1, wherein updates of the collected flight information are performed periodically.
[1505] (Claim 3)
[1506] 10. The system of claim 1, wherein the user's terminal receives and displays the notification.
[1507] "Example 1"
[1508] (Claim 1)
[1509] means for providing an interface for a user to register their flight information;
[1510] A means for periodically collecting and storing airport flight information in a database;
[1511] means for matching the flight information registered by the user with the collected flight information;
[1512] using machine translation software to translate the collated flight information into Japanese;
[1513] means for notifying a user of the translated flight information on the user's terminal;
[1514] A system including:
[1515] (Claim 2)
[1516] 10. The system of claim 1, further comprising a script configured to perform periodic updates of the collected flight information.
[1517] (Claim 3)
[1518] 10. The system of claim 1, wherein the user's terminal has an interface for receiving the notification and displaying it on a screen.
[1519] "Application Example 1"
[1520] (Claim 1)
[1521] A means for collecting information on the operation status of equipment from a factory equipment information system;
[1522] A means for users to register information about the devices they manage;
[1523] means for comparing registered device information with collected device information;
[1524] A means for translating the collated device information into Japanese;
[1525] A means for notifying the user of the translated device information;
[1526] A system including:
[1527] (Claim 2)
[1528] 10. The system of claim 1, wherein the collected device information is updated periodically.
[1529] (Claim 3)
[1530] 10. The system of claim 1, wherein the user's terminal receives and displays the notification.
[1531] "Example 2: Combining Emotion Engines"
[1532] (Claim 1)
[1533] a means for collecting flight information from an airport flight information system;
[1534] a means for users to register their flight information;
[1535] a means for matching registered flight information with collected flight information;
[1536] A means of translating the collated flight information into Japanese;
[1537] means for notifying a user of the translated flight information on the user's terminal;
[1538] An emotion recognition means for analyzing the emotional state of a user, and a means for adjusting the content of a notification based on the analysis result;
[1539] A system including:
[1540] (Claim 2)
[1541] 10. The system of claim 1, wherein updates of the collected flight information are performed periodically.
[1542] (Claim 3)
[1543] 10. The system of claim 1, wherein the user's terminal receives and displays the notification.
[1544] "Application example 2 when combining emotion engines"
[1545] (Claim 1)
[1546] a means for collecting flight information from an airport flight information system;
[1547] a means for users to register their flight information;
[1548] a means for matching registered flight information with collected flight information;
[1549] A means of translating the collated flight information into Japanese;
[1550] means for notifying a user of the translated flight information on the user's terminal;
[1551] a means for recognizing the emotional state of a user by an emotion engine and adjusting the content and format of information notification;
[1552] A system including:
[1553] (Claim 2)
[1554] 10. The system of claim 1, wherein the collected flight information is periodically updated and the emotion engine collects facial and voice data of the user.
[1555] (Claim 3)
[1556] 2. The system of claim 1, wherein the user's terminal receives the notification and displays it in a format that corresponds to the emotion. [Explanation of symbols]
[1557] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>
Claims
1. a means for collecting flight information from an airport flight information system; A means for users to register their flight information; a means for matching registered flight information with collected flight information; A means of translating the collated flight information into Japanese; A means of notifying the user of the translated flight information on their device; A system including:
2. 10. The system of claim 1, wherein the system periodically updates the collected flight information.
3. The system of claim 1, wherein the user's terminal receives and displays the notification.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A