System

Abstract

A system is provided.SOLUTION: The system includes a first means for inputting member information, a second means for storing the inputted member information in a database, and a third means for displaying and updating the stored member information.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Elderly local residents often play a key role in running neighborhood associations and community groups, making it difficult to run them efficiently. Furthermore, there are a wide range of tasks involved, including membership management, budget management, environmental maintenance, and meeting minutes preparation, all of which are complicated and time-consuming, making it difficult for elderly people to complete these tasks. Furthermore, fraud and errors are likely to occur in budget management, so a system to prevent this is needed. [Means for solving the problem]

[0005] The present invention solves the above-mentioned problems by providing a system including a first means for inputting member information, a second means for saving the input member information in a database, and a third means for displaying and updating the saved member information. Furthermore, the system includes a fourth means for inputting budget data, a fifth means for aggregating the input budget data and automatically generating a report, and a sixth means for notifying the user of the generated report, thereby improving efficiency and transparency in budget management. The system also includes a seventh means for recording audio data of meetings, an eighth means for analyzing the recorded audio data and automatically generating minutes, and a ninth means for allowing the user to review and modify the generated minutes, thereby improving the efficiency of creating minutes. This makes it easy for even elderly local residents to manage neighborhood associations and other community groups.

[0006] "Member information" refers to personal information about members of a neighborhood association or town association, including data such as name, address, contact information, and job title.

[0007] The "first means" is a device or software that provides an interface or form for users to input member information.

[0008] The "second means" is a device or software for storing the member information input from the first means in a database.

[0009] The "third means" is a device or software that displays the member information stored in the database and allows the user to update it as needed.

[0010] "Budget data" refers to data that includes information about income and expenditures of a neighborhood association or town association.

[0011] The "fourth means" is a device or software that provides an interface or form for a user to input budget data.

[0012] The "fifth means" is a device or software that aggregates the budget data input from the fourth means and automatically generates a report as necessary.

[0013] The "sixth means" is a device or software that notifies the user of the report generated by the fifth means.

[0014] "Meeting audio data" refers to data including audio information recorded during a neighborhood association or town association meeting.

[0015] The "seventh means" is a device or software for recording audio data of a conference.

[0016] The "eighth means" is a device or software that analyzes the audio data recorded by the seventh means and automatically generates minutes as corresponding text data.

[0017] The "ninth means" is a device or software that allows a user to check and modify the minutes generated by the eighth means. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7]FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] This system automates various management and operational tasks to improve the efficiency of neighborhood associations and community associations. The system consists of a server, terminals, and users, each with a specific role.

[0040] Membership Management System

[0041] Enter and save member information

[0042] Users enter their membership information from their terminals, which is then sent to the server, where it is stored in a database.

[0043] Example: When a user enters the name, address, and phone number of a new member, "Yamada Hanako," this information is sent from the terminal to the server and stored in a database.

[0044] Update and view member information

[0045] Users can search for existing membership information through their terminals and update it as needed. The updated data is sent back to the server, which updates the database. The server then displays the new information on the terminal.

[0046] Example: When a user enters a change of address for "Hanako Yamada," the information is sent to the server, the database is updated, and the new address information is then displayed on the device.

[0047] Budget Control System

[0048] Entering and saving budget data

[0049] Users enter their income and expenditure data into a form on their device, which is then sent to the server and stored in a database.

[0050] Example: When a user enters "income and expenditure data for Event A," it is sent to the server and stored in the database.

[0051] Automatic budget report generation and alerts

[0052] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If it detects any abnormal values, it sends an alert to the user.

[0053] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[0054] Environmental Improvement System

[0055] Enter and prioritize issues and requests

[0056] Users input their concerns and requests for environmental improvements from their devices. The information is sent from the device to the server and stored in a database. The server then analyzes it and generates a prioritized list.

[0057] Example: When a user types "faulty street light" into a terminal as a request, it is sent to the server, analyzed, and added to a list of high-priority issues.

[0058] Event Planning System

[0059] Generate and modify event proposals

[0060] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device, allowing them to review and modify them.

[0061] Example: The server analyzes data on past "summer festivals" and proposes to hold a summer festival this year, notifying the user. The user can then modify the date, time, and content.

[0062] Minutes creation system

[0063] Recording meeting audio and automatically generating minutes

[0064] During a meeting, users record audio data on their devices, which is then sent to a server, which uses voice recognition technology to automatically generate minutes.

[0065] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[0066] By using this system, the operation of neighborhood associations and town councils will become much more efficient, and even elderly local residents will be able to manage and operate them more easily. In addition, the information stored in the database will be managed centrally, reducing the risk of fraud and mistakes.

[0067] The processing flow will be explained below.

[0068] Specific processing steps for member management

[0069] New member registration

[0070] Step 1:

[0071] The user enters the new member's information (name, address, contact information, etc.) into the form on the terminal.

[0072] Step 2:

[0073] The terminal transmits the input information to the server.

[0074] Step 3:

[0075] The server saves the received membership information in the database.

[0076] Step 4:

[0077] The server returns a confirmation message to the terminal that the save has been completed.

[0078] Update your membership information

[0079] Step 1:

[0080] The user uses the search function on the device to select the membership information they want to update.

[0081] Step 2:

[0082] The terminal retrieves existing member information from the server and displays it.

[0083] Step 3:

[0084] The user uses the terminal to modify the membership information and confirm the changes.

[0085] Step 4:

[0086] The terminal sends the modified information to the server.

[0087] Step 5:

[0088] The server updates the existing record in the database with the received information.

[0089] Step 6:

[0090] The server returns a confirmation message to the terminal that the update is complete.

[0091] Specific processing steps for budget control

[0092] Entering and saving accounting data

[0093] Step 1:

[0094] The user enters income and expenditure data into a form on the terminal.

[0095] Step 2:

[0096] The terminal transmits the input balance data to the server.

[0097] Step 3:

[0098] The server stores the received income and expenditure data in a database.

[0099] Automatic budget report generation and alerts

[0100] Step 1:

[0101] The server periodically (e.g., at the end of each month) retrieves income and expenditure data from the database and aggregates it.

[0102] Step 2:

[0103] The server automatically generates budget reports.

[0104] Step 3:

[0105] The server generates a budget report and sends it to the user via email or notification.

[0106] Step 4:

[0107] The server analyzes the income and expenditure data and detects abnormal values ​​and fraud.

[0108] Step 5:

[0109] If the server detects abnormal values ​​or irregularities, it will send an alert notification to the user.

[0110] Specific steps for environmental improvement

[0111] Entering and processing issues and requests

[0112] Step 1:

[0113] The user enters issues and requests regarding environmental improvements into a form on the device.

[0114] Step 2:

[0115] The device sends the input tasks and requests to the server.

[0116] Step 3:

[0117] The server stores the received data in a database.

[0118] Step 4:

[0119] The server analyzes the stored data and prioritizes it based on urgency and importance.

[0120] Step 5:

[0121] The server generates a prioritized list and notifies the user.

[0122] Specific process steps for event planning

[0123] Generate and modify event proposals

[0124] Step 1:

[0125] The server collects and analyzes past event data.

[0126] Step 2:

[0127] The server automatically generates new event suggestions based on the analysis results.

[0128] Step 3:

[0129] The server sends the generated event proposal to the terminal and notifies the user.

[0130] Step 4:

[0131] The user uses the device to check the proposal.

[0132] Step 5:

[0133] The user modifies the proposed content and presses the confirm button.

[0134] Step 6:

[0135] The device sends the modifications to the server.

[0136] Step 7:

[0137] The server updates the database with the received modifications.

[0138] Specific process steps for creating meeting minutes

[0139] Recording meeting audio and generating meeting minutes

[0140] Step 1:

[0141] During a conference, a user uses a terminal to record voice data.

[0142] Step 2:

[0143] The terminal transmits the recorded voice data to the server.

[0144] Step 3:

[0145] The server analyzes the audio data and automatically generates minutes as text data.

[0146] Checking and correcting the minutes

[0147] Step 1:

[0148] The server sends the generated minutes to the terminal and notifies the user.

[0149] Step 2:

[0150] The user uses the terminal to check the minutes.

[0151] Step 3:

[0152] The user edits the minutes and presses the confirm button.

[0153] Step 4:

[0154] The device sends the modifications to the server.

[0155] Step 5:

[0156] The server updates the database with the received modifications.

[0157] These are the specific processing steps for each system. This not only improves the efficiency of the operation of neighborhood associations, but also reduces the risk of fraud and mistakes by centralizing information management.

[0158] Example 1

[0159] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0160] In running a neighborhood association or community association, managing member information and budget data, processing requests for environmental improvements, planning events, and creating meeting minutes requires a great deal of time and effort. Much of this work is done manually, and there is a high risk of errors and fraud. The goal of this invention is to centralize and automate these management tasks, thereby significantly improving operational efficiency.

[0161] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0162] In this invention, the server includes a first means for inputting member information, a second means for saving the input member information in a database, a third means for displaying and updating the saved member information, a fourth means for inputting budget data, a fifth means for aggregating the input budget data and automatically generating a report, a sixth means for notifying the user of the generated report, a seventh means for inputting issues and requests regarding environmental improvement, an eighth means for prioritizing the input information, a ninth means for analyzing past event data and automatically generating event proposals, a tenth means for recording audio data of meetings, an eleventh means for analyzing the recorded audio data and automatically generating minutes, and a twelfth means for allowing the user to review and modify the generated minutes. This significantly reduces the effort and errors involved in running a neighborhood association and enables efficient and accurate operation.

[0163] "Member information" refers to personal information such as the names, addresses, and telephone numbers of members of neighborhood associations and local councils.

[0164] "Database" refers to a system that systematically stores and manages information such as member information, budget data, environmental improvement requests, event data, and meeting minutes.

[0165] "Budget data" refers to detailed data on the income and expenditures of neighborhood associations and town councils.

[0166] A "report" refers to a document that shows the income and expenditure status and budget usage status generated based on input budget data.

[0167] "Environmental improvement" refers to the maintenance and improvement of local public facilities and infrastructure.

[0168] "Requests" refer to issues and requests regarding environmental improvement submitted by local residents.

[0169] "Event proposal" refers to a new event plan generated by analyzing past event data.

[0170] "Audio data" refers to audio information recorded during a conference or meeting.

[0171] "Minutes" refers to a document that records what was discussed and what decisions were made at a conference or meeting.

[0172] A "generative AI model" refers to an artificial intelligence model that generates results or suggestions based on specific prompts.

[0173] A "prompt" is a document that is input to a generative AI model in the form of an instruction or question.

[0174] MODE FOR CARRYING OUT THE INVENTION

[0175] This system is designed primarily to streamline the management of neighborhood associations and community groups, and consists of a server, terminals, and users, each with a specific role, automating the following management and operation tasks:

[0176] Hardware and software used

[0177] Server: Database management system (DBMS) such as MySQL (registered trademark) or PostgreSQL, HTTP server (Apache (registered trademark), Nginx)

[0178] Devices: PC, smartphone, tablet

[0179] User interface: HTML, JavaScript (registered trademark)

[0180] Speech recognition technology: Google® Speech-to-Text API, Amazon Transcribe

[0181] Generative AI models: OpenAI (registered trademark), GPT-3 (registered trademark), etc.

[0182] Membership Management System

[0183] Enter and save member information

[0184] The user uses a terminal to input membership information (such as name, address, and phone number). The terminal sends the input information to the server in JSON format. The server analyzes the received information and stores it in a database such as MySQL or PostgreSQL.

[0185] Example: A user enters information about a new member, "Yamada Hanako," and the terminal sends this information to the server and stores it in the database.

[0186] Update and view member information

[0187] The user uses the device to search for existing membership information and make any necessary changes. The changed information is then sent back to the server in JSON format, where it updates the database. The server then displays the new information on the device.

[0188] Example: A user changes the address of "Yamada Hanako," sends the information from the terminal to the server, and the database is updated.

[0189] Budget Control System

[0190] Entering and saving budget data

[0191] The user enters income and expenditure data into a form on the device, which is then sent to the server in JSON format and stored in a database.

[0192] Example: A user enters "income and expenditure data for Event A," which is sent to the server and stored in the database.

[0193] Automatic budget report generation and alerts

[0194] The server periodically compiles income and expenditure data and automatically generates budget reports. If an abnormal value is detected, an alert is sent to the user's device.

[0195] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[0196] Environmental Improvement System

[0197] Enter and prioritize issues and requests

[0198] Users use their devices to input their environmental problems and requests, which are then sent to a server where they are stored in a database. The server then analyzes the information and generates a prioritized list.

[0199] Example: A user types "faulty street light" into a terminal as a request, which is sent to the server, analyzed, and added to a list of high-priority issues.

[0200] Event Planning System

[0201] Generate and modify event proposals

[0202] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device for confirmation and modification.

[0203] Example: The server analyzes data on past "summer festivals" and suggests holding a summer festival this year. The server notifies the user and allows the user to change the date, time, and content.

[0204] Minutes creation system

[0205] Recording meeting audio and automatically generating minutes

[0206] During a meeting, users record audio data on their devices, which is then sent to a server that uses voice recognition technology to automatically generate minutes.

[0207] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[0208] Prompt Sentence Examples

[0209] 1. "How do I enter new membership information?"

[0210] 2. "How do I enter my income and expenditure data?"

[0211] 3. "How do I request a street light malfunction?"

[0212] By utilizing this system, a wide range of tasks related to the management of neighborhood associations and town councils can be carried out efficiently and accurately.

[0213] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0214] Membership management system processing flow

[0215] Enter and save member information

[0216] Step 1:

[0217] The user enters new member information (name, address, phone number, etc.) into a form on the device. The form is created using HTML and JavaScript.

[0218] Input: Member information (e.g. "Yamada Hanako")

[0219] Output: The information entered

[0220] Step 2:

[0221] The terminal converts the entered member information into JSON format and sends it to the server using an HTTP POST request.

[0222] Input: JSON data of entered member information (e.g., {"name": "Yamada Hanako", "address": "Tokyo", "phone": "090-1234-5678"})

[0223] Output: Request sent to server

[0224] Step 3:

[0225] The server parses the received JSON data and stores it in a database, using MySQL or PostgreSQL.

[0226] Input: JSON data received from the terminal

[0227] Data processing: Generate SQL query (INSERT INTO members (name, address, phone) VALUES ('Hanako Yamada', 'Tokyo', '090-1234-5678'))

[0228] Output: Save to database

[0229] Update and view member information

[0230] Step 1:

[0231] The user uses the terminal to search for existing member information and enter the parts to be corrected.

[0232] Input: Member information to search (e.g., "Yamada Hanako"), correction details (e.g., change of address)

[0233] Output: Corrections entered

[0234] Step 2:

[0235] The device converts the modified information into JSON format and sends it to the server using an HTTP PUT request.

[0236] Input: JSON data of the corrected member information (e.g., {"name": "Yamada Hanako", "address": "Osaka Prefecture", "phone": "090-1234-5678"})

[0237] Output: Request sent to server

[0238] Step 3:

[0239] The server parses the received JSON data and generates the appropriate SQL queries to update the database.

[0240] Input: JSON data received from the terminal

[0241] Data processing: Generate SQL query (UPDATE members SET address='Osaka Prefecture' WHERE name='Yamada Hanako')

[0242] Output: Database update

[0243] Step 4:

[0244] The server retrieves the updated member information again and displays it on the terminal.

[0245] Input: Acquire corrected member information

[0246] Output: Send and display updates to the terminal

[0247] Budget control system processing flow

[0248] Entering and saving budget data

[0249] Step 1:

[0250] The user enters income and expenditure data into a form on the terminal.

[0251] Input: Income and expenditure data (e.g., "Event A Income and Expenditure")

[0252] Output: The input data

[0253] Step 2:

[0254] The terminal converts the entered income and expenditure data into JSON format and sends it to the server using an HTTP POST request.

[0255] Input: JSON data of income and expenditure data

[0256] Output: Request sent to server

[0257] Step 3:

[0258] The server parses the received JSON data and stores it in a database.

[0259] Input: JSON data received from the terminal

[0260] Data manipulation: Generate SQL queries (INSERT INTO budget (event, revenue, expense) VALUES (...))

[0261] Output: Save to database

[0262] Automatic budget report generation and alerts

[0263] Step 1:

[0264] The server periodically compiles income and expenditure data from the database and automatically generates reports.

[0265] Input: Database income and expenditure data

[0266] Data calculation: Aggregation processing (calculation of total income, total expenditure, budget status)

[0267] Output: Generated budget report

[0268] Step 2:

[0269] The server notifies the user of the generated report and sends an alert if anomalies are detected.

[0270] Input: Generated budget reports and alert information

[0271] Output: Notifying and alerting users

[0272] Environmental improvement system processing flow

[0273] Enter and prioritize issues and requests

[0274] Step 1:

[0275] Users input problems and requests regarding environmental improvements from their terminals.

[0276] Input: Issue or request details (e.g., "Street light malfunction")

[0277] Output: The input request

[0278] Step 2:

[0279] The device converts the input request into JSON format and sends it to the server using an HTTP POST request.

[0280] Input: JSON data of the request content

[0281] Output: Request sent to server

[0282] Step 3:

[0283] The server analyzes the incoming requests, generates a prioritized list, and stores it in a database.

[0284] Input: JSON data received from the terminal

[0285] Data calculation: Priority calculation (considering urgency and importance)

[0286] Output: Save the generated priority list

[0287] Event planning system processing flow

[0288] Generate and modify event proposals

[0289] Step 1:

[0290] The server analyzes past event data and automatically generates suggestions for new events.

[0291] Input: Past event data

[0292] Data calculation: analytical processing (pattern matching, trend analysis)

[0293] Output: Generated event suggestions

[0294] Step 2:

[0295] The suggestions are notified to the user via the terminal, and the user can confirm and correct them.

[0296] Input: Generated event suggestions

[0297] Output: User notification and revised proposed data

[0298] Processing flow of the minutes creation system

[0299] Recording meeting audio and automatically generating minutes

[0300] Step 1:

[0301] During a conference, a user records audio data using a terminal.

[0302] Input: Audio data (speech during a meeting)

[0303] Output: Recorded audio data

[0304] Step 2:

[0305] The recorded voice data is transmitted from the terminal to the server.

[0306] Input: Recorded audio data

[0307] Output: Send data to the server

[0308] Step 3:

[0309] The server analyzes the voice data and automatically generates minutes using voice recognition technology.

[0310] Input: Audio data received from the device

[0311] Data calculation: Speech recognition processing (Google Speech-to-Text API, etc.)

[0312] Output: Generated meeting minutes

[0313] Step 4:

[0314] The user can check the generated minutes and correct any errors.

[0315] Input: Generated minutes

[0316] Output: Display of minutes to user and modified minutes data

[0317] (Application example 1)

[0318] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0319] To streamline the operations of neighborhood associations and community groups, it is necessary to automate various tasks, such as managing member information, budget management, maintenance information management, and meeting records. Similarly, efficiency is also required for the maintenance and management of robots in factories. However, performing these tasks manually requires a great deal of time and effort, resulting in problems of decreased efficiency and human error.

[0320] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0321] In this invention, the server includes means for inputting member information, means for saving the input member information in a database, means for displaying and updating the saved member information, means for inputting robot maintenance information, means for saving the input maintenance information in a database, means for inputting budget data, means for aggregating the input budget data and automatically generating a report, and means for notifying the user of the generated report. This makes management tasks in neighborhood associations and factories more efficient, saving time and effort and reducing errors.

[0322] "Member Information" refers to data related to a User, such as personal information and contact information.

[0323] "Maintenance Information" refers to details and records relating to the maintenance of robots and equipment.

[0324] "Database" refers to a system for efficiently and securely storing and managing data.

[0325] "Budget data" refers to information relating to income and expenditure and details of expenses.

[0326] A "report" refers to a document that compiles data and summarizes the results of analysis.

[0327] A "server" refers to a computer system that centralizes data processing and storage.

[0328] "Means" refers to a process or device for achieving a specific function or task.

[0329] "Input" refers to the act of a user registering data or information into the system.

[0330] "Storage" refers to storing and preserving input data in a database.

[0331] "Display" refers to showing the stored data to the user.

[0332] "Update" refers to replacing existing data with new information.

[0333] "User" means any person or entity that operates and uses the System.

[0334] This invention is a system for streamlining administrative tasks for neighborhood associations, town associations, factories, etc., and is comprised of a server, terminals, and users. This system automates member information management, budget management, maintenance information management, event planning, and the creation of meeting minutes. Specific embodiments of this system are described below.

[0335] Membership Information Management System

[0336] The server is responsible for saving the member information entered by the user from the terminal in a database. The user can enter new member information or update existing member information through the input screen on the terminal. For example, the user can enter information such as the name, address, and phone number of a new member. The saved information is stored in the database by the server and can be displayed or edited as needed.

[0337] Budget Control System

[0338] The server stores the income and expenditure data entered by the user from the terminal in a database. The server also aggregates this data and automatically generates a budget report. The server notifies the user of this generated report. For example, at the end of the month, the server aggregates the income and expenditure data and sends the automatically generated budget report to the user by email. If any unclear expenditures are discovered, an alert is displayed to the user.

[0339] Maintenance Information Management System

[0340] Maintenance information for robots and equipment in factories is entered by users using terminals. The entered maintenance information is sent to a server and stored in a database. Based on this information, the server can automatically determine the priority of maintenance and display it to the user. For example, if a user enters "daily inspection results for robot A," the information is sent and stored on the server, and then displayed on the terminal.

[0341] Event Planning System

[0342] The server analyzes past event data and automatically generates proposals for new events. These proposals are notified to the user via their device, allowing them to confirm and modify them. For example, the server can analyze past "summer festival" data and propose a new summer festival. The user receives a notification and can modify the date, time, and content.

[0343] Minutes creation system

[0344] During a meeting, users use their devices to record the audio of the meeting. The recorded audio data is sent to a server, which then uses voice recognition technology to automatically generate minutes. The generated minutes can be viewed on the device, and the user can make any corrections. For example, after the meeting ends, the server automatically generates minutes from the audio data, and the user can review them on the device and correct any errors.

[0345] The system is written in Python and uses Flask as the server-side framework, with a SQLite database for data storage.

[0346] As a specific example, the system can perform a specific task by using the prompt sentence, "Please record the results of the daily inspection of Robot A. Enter the following information for future maintenance management: Robot ID: robot_A, Detailed information: Daily inspection successful, Date and time: 2023-10-01T08:00:00. Please save this information in the system."

[0347] This will streamline various management tasks within neighborhood associations, town halls, and factories, saving time and effort and reducing errors.

[0348] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0349] Step 1:

[0350] The user enters member information, maintenance information, or budget data on the input screen of the terminal. The entered data is sent to the server as an HTTP request. In this step, member information such as name, address, and phone number, robot maintenance information, and budget data are received as input data. The input data is sent to the server as output.

[0351] Step 2:

[0352] The server analyzes the received HTTP request and converts the data into the appropriate format. In this step, data processing is performed to convert the raw data entered by the user into the data format used internally. For example, date and number formats are checked and completed. The input is the raw data sent by the user, and the output is the converted data.

[0353] Step 3:

[0354] The server saves the formatted data to a SQLite database. In this step, a save SQL query is generated and executed against the database. As input, it has the formatted data, and as output, it persists this data to the database.

[0355] Step 4:

[0356] The server periodically aggregates financial data and maintenance information from the database to automatically generate budget reports and maintenance priority lists. In this step, SQL aggregation queries are executed and the results are generated as reports and lists. The input is the financial data and maintenance information in the database, and the output is the aggregated budget report or maintenance priority list.

[0357] Step 5:

[0358] The server notifies the user of the generated report or list. This notification can be done by sending an email or a push notification to the app. In this step, a notification message is generated and sent by an appropriate means based on the user's contact information. The inputs are the generated report or list and the user's contact information, and the output is a notification sent to the user.

[0359] Step 6:

[0360] The user checks the reports and lists on the terminal and makes any necessary corrections. The corrected content is sent back to the server and the database is updated. In this step, the user edits the displayed data and sends it to the server. The input is the data corrected by the user, and the output is the database update.

[0361] Step 7:

[0362] During a meeting, the user records voice data on their device and sends it to the server. The server uses voice recognition technology to analyze the voice data and automatically generate minutes. In this step, a data calculation is performed to convert the voice data into text data. The input is the voice data sent by the user, and the output is the automatically generated minutes in text format.

[0363] Step 8:

[0364] The server sends the automatically generated minutes to the user, allowing them to check and modify them on their terminal. Finally, the modified minutes are saved back to the database. In this step, the database is updated after the modifications are sent by the user. The input is the minutes data modified by the user, and the output is the final update to the database.

[0365] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0366] This system combines member management, budget management, automatic generation of meeting minutes, and an emotion engine that recognizes user emotions in order to streamline the management of neighborhood associations and community associations. A specific embodiment of this system will be described below.

[0367] Membership Management System

[0368] Enter and save member information

[0369] The user enters the new member's information (name, address, contact details, etc.) into a form on the terminal. The entered information is sent from the terminal to the server, which then stores it in a database.

[0370] Example: When a user enters information about "New Member Yamada Hanako," this information is sent from the terminal to the server and stored in the database.

[0371] Update and view member information

[0372] Users can search for existing membership information through their terminals and update it as necessary. The updated data is sent back to the server, which updates the database. The server then displays the new information on the terminal.

[0373] Example: When a user enters a change of address for "Hanako Yamada," the information is sent to the server, the database is updated, and the new address information is then displayed on the device.

[0374] Budget Control System

[0375] Entering and saving budget data

[0376] Users enter their income and expenditure data into a form on their device, which is then sent to the server and stored in a database.

[0377] Example: When a user enters "income and expenditure data for Event A," it is sent to the server and stored in the database.

[0378] Automatic budget report generation and alerts

[0379] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If it detects any abnormal values, it sends an alert to the user.

[0380] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[0381] Environmental Improvement System

[0382] Entering and processing issues and requests

[0383] Users enter their environmental improvement issues and requests into a form on their device. The information is sent from the device to the server and stored in a database. The server then analyzes the information and generates a prioritized list.

[0384] Example: When a user types "faulty street light" into a terminal as a request, it is sent to the server, analyzed, and added to a list of high-priority issues.

[0385] Event Planning System

[0386] Generate and modify event proposals

[0387] The server collects and analyzes past event data, and automatically generates new event suggestions based on the analysis results. The suggestions are sent to the user via their device, allowing them to review and modify them.

[0388] Example: The server analyzes data on past "summer festivals" and proposes to hold a summer festival this year, notifying the user. The user can then modify the date, time, and content.

[0389] Minutes creation system

[0390] Recording meeting audio and generating meeting minutes

[0391] During a meeting, users record audio data on their devices, which is then sent to a server, which uses voice recognition technology to automatically generate minutes.

[0392] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[0393] Emotion engine integration

[0394] User Emotion Recognition

[0395] The emotion engine recognizes emotions (e.g., joy, anger, sadness, etc.) when a user inputs something on the device. The recognized emotion data is sent from the device to the server.

[0396] Example: If a user is feeling frustrated and inputting a large amount of data, the emotion engine will recognize the frustration and send it as data to the server.

[0397] Interface Adaptation

[0398] The server dynamically adapts the user's interface based on the recognized emotion data, for example simplifying the interface if the user is feeling stressed.

[0399] Example: When the emotion engine recognizes the user's stress, the server simplifies the interface by reducing confirmation messages, etc.

[0400] Storing and using emotional data

[0401] The server stores the emotion data in a database and uses it for future analysis and interface adjustments.

[0402] Example: The server analyzes previously recognized emotional data and suggests ways to reduce the user's operational stress.

[0403] This system not only streamlines the management of neighborhood associations and community groups, but also provides an interface that takes users' emotions into consideration, making it easier for even elderly local residents to manage and operate the associations.In addition, the information stored in the database is managed centrally, reducing the risk of fraud and errors.

[0404] The processing flow will be explained below.

[0405] Specific processing steps of the system based on the combination of emotion engines

[0406] Membership Management System

[0407] Step 1:

[0408] The user enters the new member's information (name, address, contact information, etc.) into the form on the terminal.

[0409] Step 2:

[0410] The terminal transmits the input information to the server.

[0411] Step 3:

[0412] The server saves the received membership information in the database.

[0413] Step 4:

[0414] The server returns a confirmation message to the terminal that the save has been completed.

[0415] Update your membership information

[0416] Step 1:

[0417] The user uses the search function on the device to select the membership information they want to update.

[0418] Step 2:

[0419] The terminal retrieves existing member information from the server and displays it.

[0420] Step 3:

[0421] The user uses the terminal to modify the membership information and confirm the changes.

[0422] Step 4:

[0423] The terminal sends the modified information to the server.

[0424] Step 5:

[0425] The server updates the existing record in the database with the received information.

[0426] Step 6:

[0427] The server returns a confirmation message to the terminal that the update is complete.

[0428] Budget Control System

[0429] Step 1:

[0430] The user enters income and expenditure data into a form on the terminal.

[0431] Step 2:

[0432] The terminal transmits the input balance data to the server.

[0433] Step 3:

[0434] The server stores the received income and expenditure data in a database.

[0435] Automatic generation of budget reports

[0436] Step 1:

[0437] The server periodically (e.g., at the end of each month) retrieves income and expenditure data from the database and aggregates it.

[0438] Step 2:

[0439] The server automatically generates budget reports.

[0440] Step 3:

[0441] The server sends the generated budget report to the user via email or notification.

[0442] Anomaly detection and alerting

[0443] Step 1:

[0444] The server analyzes the income and expenditure data and detects abnormal values ​​and fraud.

[0445] Step 2:

[0446] If the server detects abnormal values ​​or irregularities, it will send an alert notification to the user.

[0447] Environmental Improvement System

[0448] Step 1:

[0449] The user enters issues and requests regarding environmental improvements into a form on the device.

[0450] Step 2:

[0451] The device sends the input tasks and requests to the server.

[0452] Step 3:

[0453] The server stores the received data in a database.

[0454] Step 4:

[0455] The server analyzes the stored data and prioritizes it based on urgency and importance.

[0456] Step 5:

[0457] The server generates a prioritized list and notifies the user.

[0458] Event Planning System

[0459] Step 1:

[0460] The server collects and analyzes past event data.

[0461] Step 2:

[0462] The server automatically generates new event suggestions based on the analysis results.

[0463] Step 3:

[0464] The server sends the generated event proposal to the terminal and notifies the user.

[0465] Step 4:

[0466] The user uses the device to check the proposal.

[0467] Step 5:

[0468] The user modifies the proposed content and presses the confirm button.

[0469] Step 6:

[0470] The device sends the modifications to the server.

[0471] Step 7:

[0472] The server updates the database with the received modifications.

[0473] Minutes creation system

[0474] Step 1:

[0475] During a conference, a user uses a terminal to record voice data.

[0476] Step 2:

[0477] The terminal transmits the recorded voice data to the server.

[0478] Step 3:

[0479] The server analyzes the audio data and automatically generates minutes as text data.

[0480] Checking and correcting the minutes

[0481] Step 1:

[0482] The server sends the generated minutes to the terminal and notifies the user.

[0483] Step 2:

[0484] The user uses the terminal to check the minutes.

[0485] Step 3:

[0486] The user edits the minutes and presses the confirm button.

[0487] Step 4:

[0488] The device sends the modifications to the server.

[0489] Step 5:

[0490] The server updates the database with the received modifications.

[0491] Emotion engine integration

[0492] User Emotion Recognition

[0493] Step 1:

[0494] When a user inputs information into the device, the emotion engine identifies the user's emotions (e.g., joy, anger, sadness, etc.) in real time.

[0495] Step 2:

[0496] The emotion data recognized by the emotion engine is sent from the terminal to the server.

[0497] Step 3:

[0498] The server stores the received emotion data in a database.

[0499] Interface Adaptation

[0500] Step 1:

[0501] The server analyzes the recognized emotion data.

[0502] Step 2:

[0503] The server dynamically adapts the user's operation interface based on the analysis results.

[0504] Step 3:

[0505] The terminal displays the adapted interface to the user.

[0506] Storing and using emotional data

[0507] Step 1:

[0508] The server accumulates past emotional data and stores it in a database.

[0509] Step 2:

[0510] The server analyzes the accumulated emotional data and uses it to improve the system in the future.

[0511] Step 3:

[0512] Based on the analysis results, the server proposes optimized interfaces and operating procedures for the user.

[0513] These are the specific processing steps for each system. This not only improves the efficiency of neighborhood association and community management, but also provides an interface that takes user feelings into consideration. This makes it easier for even elderly local residents to manage and operate the system. In addition, the information stored in the database is managed centrally, reducing the risk of fraud and errors.

[0514] Example 2

[0515] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0516] In conventional membership management systems, budget management systems, and automated meeting minutes systems, each function is separate and not integrated, which means users have to operate different systems separately, which is inconvenient. Furthermore, the lack of interface adjustments or stress reduction features that respond to the user's emotions during operation makes it difficult to improve the user experience. Furthermore, prioritization of environmental improvement issues and requests is often done manually. Therefore, there is a need for a system that can streamline the management of neighborhood associations and town councils and is easier to use.

[0517] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0518] In this invention, the server includes: means for inputting member information, means for saving the input member information in a database, means for displaying and updating the saved member information, means for inputting income and expenditure data, means for saving the income and expenditure data in a database, means for periodically aggregating the income and expenditure data and automatically generating a budget report, means for notifying the user of the generated budget report, means for recording conference audio data, means for analyzing the recorded audio data and automatically generating minutes, means for allowing the user to confirm and modify the generated minutes, means for recognizing the user's emotions, means for dynamically adapting the user interface based on the recognized emotion data, and means for saving the emotion data in a database and using it for future analysis and interface adjustment. This enables centralized operation with each function integrated and provides an interface that takes user emotions into consideration, thereby enabling a system that is easy to use for local residents, including the elderly.

[0519] The "means for inputting member information" is an interface for inputting information about new members using a terminal.

[0520] "Means for saving input member information in a database" is a function by which the server stores input member information in a database.

[0521] "Means for viewing and updating stored member information" refers to a function that allows users to search, view, and modify stored member information.

[0522] The "means for inputting balance data" is an interface for inputting balance data from a terminal.

[0523] The "means for saving balance data in a database" is a function by which the server stores the input balance data in a database.

[0524] The "means for periodically aggregating income and expenditure data and automatically generating a budget report" is a function in which the server aggregates income and expenditure data at regular intervals and automatically generates a budget report.

[0525] The "means for notifying the user of the generated budget report" is a function by which the server notifies the user of the generated budget report.

[0526] The "means for recording conference audio data" is an interface for recording audio during a conference on a terminal.

[0527] The "means for analyzing the recorded voice data and automatically generating minutes" is a function in which the server analyzes the recorded voice data and automatically generates minutes in text format.

[0528] The "means for enabling a user to check and modify the generated minutes" is a function that allows a user to check the automatically generated minutes and modify them as necessary.

[0529] The "means for recognizing user emotions" is an engine for recognizing the emotions felt by the user in real time during operation.

[0530] The "means for dynamically adapting the user interface based on the recognized emotion data" is a function that allows the server to change the interface based on the recognized emotion data.

[0531] "Means for storing emotion data in a database and using it for future analysis and interface adjustment" is a function in which the server stores the recognized emotion data in a database and uses it later for analysis and interface optimization.

[0532] The present invention is an integrated system for streamlining the management of neighborhood associations and community groups, and includes functions for member management, budget management, automatic generation of meeting minutes, and user emotion recognition. How each function is implemented will be explained in detail below.

[0533] Membership Management System

[0534] Enter and save member information

[0535] The user enters new member information into a form on the device. The device sends the entered information in JSON format to the server. The server generates an SQL query to save the received data to the database, connects to the database, and executes it. After the process is complete, the server sends a message to the device indicating that the save has been completed, and the device displays it to the user.

[0536] Example: When a user enters information for a new member, "Hanako Yamada," the device converts the information into JSON data and sends it to the server. The server generates and executes the SQL query "INSERT INTO members (name, address, contact) VALUES ('Hanako Yamada', 'Address', 'Contact Information')" and saves it in the database. After that, the device displays the message "Member information saved."

[0537] Update and view member information

[0538] Users search for existing membership information through their device and update it as necessary. The device sends a search query to the server, which queries the database to obtain the results and sends them to the device. The user checks the displayed information, makes any necessary updates, and sends the updates from the device to the server. The server updates the database and sends a completion message to the device.

[0539] Example: When a user changes the address of "Yamada Hanako," the terminal sends the query "SELECT FROM members WHERE name="Yamada Hanako"" to the server, and the server retrieves the relevant information from the database and sends it to the terminal. After the user enters the new address, the terminal sends the query "UPDATE members SET address="new address" WHERE name="Yamada Hanako"" to the server, and the server executes the query and updates the database. The updated information is then displayed on the terminal.

[0540] Budget Control System

[0541] Entering and saving budget data

[0542] The user enters the balance data into a form on the terminal. The terminal sends the data to the server, which then generates and executes an SQL query to save the balance data in a database. After the process is complete, the server sends a message to the terminal indicating that the data has been saved, and the terminal displays the message to the user.

[0543] Example: When a user enters "income and expenditure data for event A," the terminal sends it to the server, which then generates and executes the SQL query "INSERT INTO budget (event, income, expense) VALUES ('event A', 'income', 'expense')" and saves it in the database. After that, the terminal displays the message "Income and expenditure data saved."

[0544] Automatic budget report generation and alerts

[0545] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If an abnormal value is detected, the server generates an alert message and notifies the user. The user can check the alert message on their device.

[0546] Example: At the end of the month, the server executes the query "SELECT SUM(income), SUM(expense) FROM budget WHERE month=current_month" to aggregate income and expenditure data. Based on the aggregated results, a budget report is generated and sent to the user by email. If an unclear expenditure is detected, an alert message stating "An abnormal expenditure has been detected" is generated and sent to the terminal.

[0547] Meeting minutes creation system

[0548] Recording meeting audio and generating meeting minutes

[0549] During a meeting, users record audio data on their devices. The recorded audio data is then sent from the device to a server, which uses voice recognition technology to convert the audio data into text data and automatically generate minutes. The generated minutes can then be viewed and edited by the user.

[0550] Example: During a meeting, a user records voice data on their device and sends it to a server. The server uses voice recognition technology (e.g., Microsoft® Azure® Speech API) to convert the voice data into text and automatically generates minutes. The minutes are then sent to the user, who can review them and make any necessary corrections.

[0551] Emotion engine integration

[0552] User Emotion Recognition

[0553] When a user inputs information into the device, the emotion engine recognizes the user's emotions in real time, and the recognized emotion data is sent from the device to the server.

[0554] Example: When a user is entering a large amount of data, if an emotion of dissatisfaction is recognized, the emotion engine sends the data to the server.

[0555] Interface Adaptation

[0556] The server analyzes the received emotional data and sends instructions to the device to adjust the interface according to the emotional state. The device then dynamically changes the interface based on the instructions.

[0557] Example: When the emotion engine recognizes the user's stress state, the server sends instructions such as "reduce confirmation messages" to the device, and the device simplifies the interface based on the instructions.

[0558] Storing and using emotional data

[0559] The server stores the recognized emotion data in a database, which can be used for future analysis and interface adjustments.

[0560] Example: The server generates the SQL query "INSERT INTO emotion_data (timestamp, emotion) VALUES ('current time', 'recognized emotion')" and saves the emotion data in the database. It analyzes the saved data and makes suggestions for improving the interface to reduce user operational stress in the future.

[0561] Usage example

[0562] Examples of prompts input to the generative AI model include "Please enter the name of the new member" or "Please enter income and expenditure data." Based on this, the device issues appropriate instructions to the user, and the server processes the data on the backend.

[0563] As described above, this invention can significantly improve user convenience by integrating member management, budget management, automatic generation of meeting minutes, and user emotion recognition. By enabling centralized operation with each function integrated and providing an interface that takes user emotions into consideration, it is possible to realize a system that is easy to use, especially for local residents, including the elderly.

[0564] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0565] Enter and save member information

[0566] Step 1:

[0567] The user enters the new member's information (name, address, contact details, etc.) into the form on the terminal.

[0568] Input: New member information

[0569] Output: Information entered into the terminal

[0570] Specific operation: The user enters "Name: Yamada Hanako, Address: XX town, Contact number: 090-1234-5678" into the form on the terminal.

[0571] Step 2:

[0572] The terminal converts the entered membership information into JSON format and sends it to the server.

[0573] Input: Information entered by the user

[0574] Output: Send JSON format data to the server

[0575] Specific operation: The device generates the JSON data "{"name": "Yamada Hanako", "address": "XX town", "contact": "090-1234-5678"}".

[0576] Step 3:

[0577] The server parses the received JSON data and generates SQL queries to store it in a database.

[0578] Input: JSON data sent from the terminal

[0579] Output: Generated SQL query

[0580] Specific operation: The server generates the SQL query "INSERT INTO members (name, address, contact) VALUES ('Yamada Hanako', 'XX town', '090-1234-5678')".

[0581] Step 4:

[0582] The server connects to the database, executes the generated SQL query, and saves the member information in the database.

[0583] Input: Generated SQL query

[0584] Output: Save information to a database

[0585] Specific operation: The server executes the SQL query and saves Hanako Yamada's information in the "members" table of the database.

[0586] Step 5:

[0587] The server notifies the terminal of the completion of the process, and the terminal displays it to the user.

[0588] Input: Notification of completion of saving to database

[0589] Output: Save completed message to user

[0590] Specific operation: The message "Member information has been saved" will be displayed on the device.

[0591] Update and view member information

[0592] Step 1:

[0593] The user searches for existing membership information through the terminal.

[0594] Input: Search query

[0595] Output: Search results displayed

[0596] Specific operation: When a user searches for information about "Yamada Hanako", the query "SELECT FROM members WHERE name="Yamada Hanako"" is sent.

[0597] Step 2:

[0598] The terminal sends a search query to the server.

[0599] Input: A search request from the user

[0600] Output: Query sent to server

[0601] Specific operation: The terminal sends the query "SELECT FROM members WHERE name="Yamada Hanako"" to the server.

[0602] Step 3:

[0603] The server queries the database and retrieves the results.

[0604] Input: Search query

[0605] Output: Search results

[0606] Specific operation: The server executes an SQL query to obtain information about "Hanako Yamada."

[0607] Step 4:

[0608] The server transmits the acquired data to the terminal.

[0609] Input: Search result data

[0610] Output: Sending data to the terminal

[0611] Specific operation: The server sends the acquired data to the terminal. "Name: Yamada Hanako, Address: XX town, Contact: 090-1234-5678"

[0612] Step 5:

[0613] The device displays the acquired data.

[0614] Input: Data from the server

[0615] Output: Displaying information to the user

[0616] Specific operation: Information about "Yamada Hanako" is displayed on the terminal.

[0617] Step 6:

[0618] The user makes the necessary updates and enters the update data into the terminal.

[0619] Input: Correction information

[0620] Output: Corrected data input to terminal completed

[0621] Specific behavior: The user changes the address to "New Address."

[0622] Step 7:

[0623] The terminal transmits the update data to the server.

[0624] Input: Correction information from the user

[0625] Output: Send corrected data to the server

[0626] Specific operation: The terminal sends the query "UPDATE members SET address="new address" WHERE name="Yamada Hanako"" to the server.

[0627] Step 8:

[0628] The server updates the database with the corrected data.

[0629] Input: SQL query to modify

[0630] Output: Database update

[0631] Specific operation: The server executes an SQL query to update Hanako Yamada's address information.

[0632] Step 9:

[0633] After the server completes the process, it sends a confirmation message to the terminal.

[0634] Input: Database update completion notification

[0635] Output: Notification to terminal

[0636] Specific operation: The message "Member information has been updated" will be displayed on the device.

[0637] Budget Control System

[0638] Step 1:

[0639] The user enters income and expenditure data into a form on the terminal.

[0640] Input: Income and expenditure data

[0641] Output: Data input to terminal completed

[0642] Specific operation: The user inputs "income and expenditure for event A."

[0643] Step 2:

[0644] The terminal transmits the balance data to the server.

[0645] Input: User's income and expenditure data

[0646] Output: Send data to the server

[0647] Specific operation: The terminal sends income and expenditure data in JSON format.

[0648] Step 3:

[0649] The server generates and executes SQL queries to store the balance data in a database.

[0650] Input: JSON data for income and expenditure

[0651] Output: SQL query

[0652] Specific operation: The server generates and executes the SQL query "INSERT INTO budget (event, income, expense) VALUES ('Event A', 'Income', 'Expense')".

[0653] Step 4:

[0654] The server notifies the terminal of the completion of the process, and the terminal displays it to the user.

[0655] Input: Data save completion notification

[0656] Output: A completion message to the user

[0657] Specific operation: The message "Income and expenditure data saved" will be displayed on the device.

[0658] Step 5:

[0659] The server periodically compiles income and expenditure data from the database and automatically generates budget reports.

[0660] Input: Periodic income and expenditure data

[0661] Output: Budget Report

[0662] Specific operation: The server executes "SELECT SUM(income), SUM(expense) FROM budget WHERE date BETWEEN (registered trademark) start date AND end date" and automatically generates the aggregated data as a budget report.

[0663] Step 6:

[0664] If the server detects an abnormal value, it generates an alert message and notifies the user.

[0665] Enter: Budget Report

[0666] Output: Alert message

[0667] Specific behavior: The server detects anomalies in the budget report and generates and sends an alert message saying "Unclear expenditure detected."

[0668] Meeting minutes creation system

[0669] Step 1:

[0670] During a conference, a user records audio data on a terminal.

[0671] Input: Audio data

[0672] Output: Recording audio data to the device

[0673] Specific operation: The device records audio data in real time during the meeting.

[0674] Step 2:

[0675] The terminal transmits the recorded voice data to the server.

[0676] Input: Recorded audio data

[0677] Output: Sending audio data to the server

[0678] Specific operation: The device sends the recorded audio data to the server.

[0679] Step 3:

[0680] The server uses voice recognition technology to convert the voice data into text data and automatically generate minutes.

[0681] Input: Audio data

[0682] Output: Text data (minutes)

[0683] What happens: The server uses speech recognition technology (e.g., Microsoft Azure Speech API) to convert the voice data into text.

[0684] Step 4:

[0685] The server sends the generated minutes to the terminal so that the user can check and modify them.

[0686] Input: Generated minutes

[0687] Output: Confirm and correct minutes to the user

[0688] Specific operation: The server sends the generated minutes to the terminal, where the user can check them and make corrections if necessary.

[0689] Emotion engine integration

[0690] Step 1:

[0691] When a user performs input work on the device, the emotion engine recognizes the user's emotions in real time.

[0692] Input: User input behavior and emotions

[0693] Output: Recognized emotion data

[0694] Specific operation: The emotion engine recognizes emotions in real time based on the user's input speed, facial expressions, etc.

[0695] Step 2:

[0696] The recognized emotion data is transmitted from the terminal to the server.

[0697] Input: Recognized emotion data

[0698] Output: Send emotion data to the server

[0699] Specific operation: The device sends emotional data such as "the user is feeling stressed" to the server.

[0700] Step 3:

[0701] The server analyzes the received emotional data and sends instructions to the terminal to adjust the interface.

[0702] Input: Emotion data

[0703] Output: Interface adjustment instructions

[0704] Specific operation: The server analyzes the received emotion data and generates interface adjustment instructions such as "reduce confirmation messages."

[0705] Step 4:

[0706] The terminal dynamically changes the interface based on instructions from the server.

[0707] Input: Instructions from the server

[0708] Output: Interface changes

[0709] Specific actions: The device simplifies or adapts the user interface according to the instructions.

[0710] Step 5:

[0711] The server stores the recognized emotion data in a database for future analysis and interface adjustments.

[0712] Input: Emotion data

[0713] Output: Emotion data saved in a database

[0714] Specific operation: The server generates the SQL query "INSERT INTO emotion_data (timestamp, emotion) VALUES ('current time', 'user emotion')" and saves it in the database. In the future, the emotion data will be analyzed and used to improve the interface.

[0715] These are the specific processing steps of the system that uses membership management, budget management, meeting minutes creation, and an emotion engine. This system will improve the efficiency of neighborhood association management and provide a comfortable interface that takes user emotions into consideration.

[0716] (Application example 2)

[0717] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0718] When managing robots in factories, it is important for employees to efficiently manage the robots' operating status and maintenance records. However, with existing systems, this task is cumbersome and requires a lot of effort and time. Furthermore, budget management and the creation of meeting minutes are also time-consuming, contributing to increased employee stress. Furthermore, there is a lack of a mechanism for adapting the interface to employees' emotions, which leads to reduced operational efficiency and increased stress. Therefore, a new system is needed to improve the efficiency of overall management tasks and reduce the burden on employees.

[0719] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting member information; means for saving the input member information in a database; means for displaying and updating the saved member information; means for inputting robot information and saving operating status and maintenance records in a database; means for inputting budget data; means for aggregating the input budget data and automatically generating a report; means for notifying the user of the generated report; means for recording conference audio data; means for analyzing the recorded audio data and automatically generating minutes; means for allowing the user to confirm and modify the generated minutes; means for recognizing user emotion data; means for saving the recognized emotion data in a database and adapting the interface; and means for changing the interface based on the emotion data. This not only improves the efficiency of robot operation management in factories and automates tasks such as budget management and generating meeting minutes, but also provides an interface that takes employee emotions into consideration, reducing stress and improving operational efficiency.

[0720] "Member information" refers to personal identification information entered by a user, and includes data such as name, address, and contact details.

[0721] A "database" is an organized collection of information, a system that stores input data and allows it to be searched and updated.

[0722] "Robot information" refers to data such as the specific operating status and maintenance records of robots within a factory.

[0723] "Operational status" refers to data that indicates how a machine or system is operating, its current operating status, and operating time.

[0724] "Maintenance records" are historical data of maintenance work on a machine or system, including details of the maintenance work carried out.

[0725] "Budget Data" means the income and expenditure data, details of expenses and revenues relevant to the preparation of a budget.

[0726] A "report" is a report generated based on collected and organized data, and includes analysis and aggregation results.

[0727] "Notification" refers to the sending of a message from the system to the user to notify, warn, or convey information.

[0728] "Audio data" refers to data that includes audio information recorded during a meeting, conversation, or the like.

[0729] Minutes are documents that record the contents of a meeting or discussion, including what was said and what decisions were made.

[0730] "Emotion data" is information that indicates the user's emotional state, and is data that identifies emotions such as stress, joy, and sadness.

[0731] "Interface" refers to the screens and operating means that allow users to directly interact with the system.

[0732] "Adaptation" refers to changing the way a system behaves or displays itself depending on the environment or situation.

[0733] This invention is a system for streamlining the operation and management of robots in factories. This system allows factory managers and employees to easily manage robot operation status and maintenance records, automatically tally budget data, generate meeting minutes, and even adapt the interface based on employee emotions.

[0734] 1. Robot Management System

[0735] 1.1 Entering and saving robot information

[0736] The user uses the terminal interface to input robot information (operating status, maintenance records, etc.), which is then sent from the terminal to the server and stored in a database.

[0737] Example: When a user enters "Operating normally" as the "Operation status of Robot A," the information is sent to the server and stored in the database.

[0738] 1.2 Viewing and updating robot information

[0739] The user uses the device to search for existing robot information and update it as needed. The updated data is sent back to the server, which updates the database. The server then displays the new information on the device.

[0740] Example: When a user updates the maintenance information for "Robot A" to "Replace part X," the information is sent to the server, the database is updated, and the new information is displayed on the terminal.

[0741] 2. Budget Control System

[0742] 2.1 Entering and saving budget data

[0743] The user enters income and expenditure data into an input form on the terminal, which is then sent to the server and stored in a database.

[0744] Example: When a user enters "100,000 yen as maintenance fee," it is sent to the server and saved in the database.

[0745] 2.2 Automatic generation and notification of budget reports

[0746] The server periodically aggregates income and expenditure data from the database, automatically generates budget reports, and sends alerts to users if any abnormal values ​​are detected.

[0747] Example: At the end of the month, the server aggregates income and expenditure data and notifies the user by email of an automatically generated budget report. If any unclear expenditures are found, an alert is displayed to the user.

[0748] 3. Meeting Minutes Creation System

[0749] 3.1 Recording and saving conference audio

[0750] During a conference, users record audio data on their terminals, which are then sent to the server.

[0751] Example: A user records audio on their smartphone during a meeting and uploads the file to a server.

[0752] 3.2 Automatic generation and confirmation of minutes

[0753] The server uses voice recognition technology to automatically generate minutes from the recorded voice data. The generated minutes can then be checked by the user on their device and any errors can be corrected.

[0754] Example: After the meeting ends, the server automatically generates minutes from the audio data and displays them on the user's device. The user can then make any necessary corrections.

[0755] 4. Emotion engine integration

[0756] 4.1 User Emotion Recognition and Interface Adaptation

[0757] The emotion engine recognizes the emotions expressed by the user while operating the device. The recognized emotion data is sent to the server and stored in a database. The server then dynamically adapts the interface based on this information.

[0758] Example: If a user is feeling stressed while entering data, the emotion engine will recognize that stress and the server will simplify the interface by reducing confirmation messages, etc.

[0759] Hardware and software used

[0760] Device: A device such as a smartphone, tablet, or PC.

[0761] Server: A server system that contains a database.

[0762] Software: Software that implements voice recognition technology, emotion engines, UI adaptation algorithms, etc.

[0763] Prompt Sentence Examples

[0764] The user inputs the operation information of "New Robot XYZ123". Send the robot's operation status and maintenance records to the server.

[0765] The user enters "Event A budget data." The system aggregates the income and expenditure data and automatically generates a budget report.

[0766] Record audio data during meetings, send it to a server, and automatically generate meeting minutes using speech recognition technology.

[0767] Users get frustrated with a lot of data entry, so be aware of this and simplify your interface.

[0768] This will improve the efficiency of robot operation and management within factories, make work easier for employees, and reduce stress when operating them.

[0769] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0770] Step 1:

[0771] The user uses the terminal to input robot information (e.g., operating status, maintenance records).

[0772] Input: The user enters information such as "Robot A's operating status" into a form on the terminal.

[0773] Specific actions: The user enters information into the appropriate fields on the device interface and presses the "Submit" button.

[0774] Output: The entered robot information is sent from the terminal to the server.

[0775] Step 2:

[0776] The server stores the received robot information in a database.

[0777] Input: Robot information sent from the device.

[0778] Specific operation: The server parses the received data, converts it into the appropriate format, and writes it to the database.

[0779] Output: The robot information is saved to the database and a success message is generated.

[0780] Step 3:

[0781] A user uses a terminal to search and update existing robot information.

[0782] Input: The user enters search criteria into the terminal.

[0783] Specific operation: The user enters search criteria, presses the "Search" button, modifies the displayed information as necessary, and presses the "Save" button.

[0784] Output: Updated robot information is sent from the device to the server, where the database is updated.

[0785] Step 4:

[0786] The server stores the updated robot information in a database and displays the new information on the terminal.

[0787] Input: Update data sent from the device.

[0788] Specific operation: The server reflects the received update data in the database and sends the new data to the terminal.

[0789] Output: The terminal displays the new robot information.

[0790] Step 5:

[0791] The user inputs budget data into the input form on the terminal.

[0792] Input: The user enters income and expenditure data such as "maintenance costs" into the input form.

[0793] Specific operation: The user enters income and expenditure data and presses the "Submit" button.

[0794] Output: The entered budget data is sent from the terminal to the server.

[0795] Step 6:

[0796] The server stores the received budget data in a database.

[0797] Input: Budget data sent from the terminal.

[0798] Specific operation: The server parses the received data and writes it to the database.

[0799] Output: The budget data is saved in the database.

[0800] Step 7:

[0801] The server periodically aggregates income and expenditure data from the database and generates budget reports.

[0802] Input: Income and expenditure data stored in the database.

[0803] Specific operation: The server reads the income and expenditure data from the database, performs aggregation processing, and generates a report.

[0804] Output: Generated budget report.

[0805] Step 8:

[0806] The server notifies the user of the generated budget report.

[0807] Input: Generated budget report.

[0808] Specific Actions: The server sends the report to the user via email or notification system.

[0809] Output: The user receives and views the budget report.

[0810] Step 9:

[0811] A user records audio data on a terminal during a conference.

[0812] Input: Audio during the meeting.

[0813] Specific operation: The user uses the device's recording function to record the conference audio.

[0814] Output: Recorded audio data.

[0815] Step 10:

[0816] The terminal transmits the recorded voice data to the server.

[0817] Input: Recorded audio data.

[0818] Specific operation: The device uploads the recorded audio data to the server.

[0819] Output: The audio data is sent to the server.

[0820] Step 11:

[0821] The server automatically generates minutes using voice recognition technology.

[0822] Input: Recorded audio data.

[0823] Specific operation: The server uses a speech recognition engine to analyze the voice data, convert it into text, and generate minutes.

[0824] Output: Auto-generated meeting transcript.

[0825] Step 12:

[0826] The server notifies the user of the generated minutes and allows them to review and modify them.

[0827] Input: Auto-generated meeting minutes.

[0828] Specific operation: The server sends the generated minutes to the user's terminal so that the user can check and modify them.

[0829] Output: An interface is displayed that allows the user to review and modify the minutes.

[0830] Step 13:

[0831] The emotion engine recognizes the user's emotions and stores them in a database.

[0832] Input: Emotional data during user interaction.

[0833] Specific operation: The emotion engine identifies emotions from the user's facial expressions, input speed, etc., and sends the data to the server.

[0834] Output: The recognized emotion data is stored in the database.

[0835] Step 14:

[0836] The server adapts the interface based on the recognized emotion data.

[0837] Input: Recognized emotion data.

[0838] Specific operation: The server analyzes the emotion data, determines how to adapt the interface, and changes the device's UI.

[0839] Output: An adapted interface according to the user's emotion is displayed.

[0840] This will improve the efficiency of the system as a whole in managing robots within factories, make operation easier for users, and reduce stress.

[0841] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0842] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0843] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0844] [Second embodiment]

[0845] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0846] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0847] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0848] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0849] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0850] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0851] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0852] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0853] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0854] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0855] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0856] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0857] This system automates various management and operational tasks to improve the efficiency of neighborhood associations and community associations. The system consists of a server, terminals, and users, each with a specific role.

[0858] Membership Management System

[0859] Enter and save member information

[0860] Users enter their membership information from their terminals, which is then sent to the server, where it is stored in a database.

[0861] Example: When a user enters the name, address, and phone number of a new member, "Yamada Hanako," this information is sent from the terminal to the server and stored in a database.

[0862] Update and view member information

[0863] Users can search for existing membership information through their terminals and update it as needed. The updated data is sent back to the server, which updates the database. The server then displays the new information on the terminal.

[0864] Example: When a user enters a change of address for "Hanako Yamada," the information is sent to the server, the database is updated, and the new address information is then displayed on the device.

[0865] Budget Control System

[0866] Entering and saving budget data

[0867] Users enter their income and expenditure data into a form on their device, which is then sent to the server and stored in a database.

[0868] Example: When a user enters "income and expenditure data for Event A," it is sent to the server and stored in the database.

[0869] Automatic budget report generation and alerts

[0870] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If it detects any abnormal values, it sends an alert to the user.

[0871] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[0872] Environmental Improvement System

[0873] Enter and prioritize issues and requests

[0874] Users input their concerns and requests for environmental improvements from their devices. The information is sent from the device to the server and stored in a database. The server then analyzes it and generates a prioritized list.

[0875] Example: When a user types "faulty street light" into a terminal as a request, it is sent to the server, analyzed, and added to a list of high-priority issues.

[0876] Event Planning System

[0877] Generate and modify event proposals

[0878] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device, allowing them to review and modify them.

[0879] Example: The server analyzes data on past "summer festivals" and proposes to hold a summer festival this year, notifying the user. The user can then modify the date, time, and content.

[0880] Minutes creation system

[0881] Recording meeting audio and automatically generating minutes

[0882] During a meeting, users record audio data on their devices, which is then sent to a server, which uses voice recognition technology to automatically generate minutes.

[0883] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[0884] By using this system, the operation of neighborhood associations and town councils will become much more efficient, and even elderly local residents will be able to manage and operate them more easily. In addition, the information stored in the database will be managed centrally, reducing the risk of fraud and mistakes.

[0885] The processing flow will be explained below.

[0886] Specific processing steps for member management

[0887] New member registration

[0888] Step 1:

[0889] The user enters the new member's information (name, address, contact information, etc.) into the form on the terminal.

[0890] Step 2:

[0891] The terminal transmits the input information to the server.

[0892] Step 3:

[0893] The server saves the received membership information in the database.

[0894] Step 4:

[0895] The server returns a confirmation message to the terminal that the save has been completed.

[0896] Update your membership information

[0897] Step 1:

[0898] The user uses the search function on the device to select the membership information they want to update.

[0899] Step 2:

[0900] The terminal retrieves existing member information from the server and displays it.

[0901] Step 3:

[0902] The user uses the terminal to modify the membership information and confirm the changes.

[0903] Step 4:

[0904] The terminal sends the modified information to the server.

[0905] Step 5:

[0906] The server updates the existing record in the database with the received information.

[0907] Step 6:

[0908] The server returns a confirmation message to the terminal that the update is complete.

[0909] Specific processing steps for budget control

[0910] Entering and saving accounting data

[0911] Step 1:

[0912] The user enters income and expenditure data into a form on the terminal.

[0913] Step 2:

[0914] The terminal transmits the input balance data to the server.

[0915] Step 3:

[0916] The server stores the received income and expenditure data in a database.

[0917] Automatic budget report generation and alerts

[0918] Step 1:

[0919] The server periodically (e.g., at the end of each month) retrieves income and expenditure data from the database and aggregates it.

[0920] Step 2:

[0921] The server automatically generates budget reports.

[0922] Step 3:

[0923] The server generates a budget report and sends it to the user via email or notification.

[0924] Step 4:

[0925] The server analyzes the income and expenditure data and detects abnormal values ​​and fraud.

[0926] Step 5:

[0927] If the server detects abnormal values ​​or irregularities, it will send an alert notification to the user.

[0928] Specific steps for environmental improvement

[0929] Entering and processing issues and requests

[0930] Step 1:

[0931] The user enters issues and requests regarding environmental improvements into a form on the device.

[0932] Step 2:

[0933] The device sends the input tasks and requests to the server.

[0934] Step 3:

[0935] The server stores the received data in a database.

[0936] Step 4:

[0937] The server analyzes the stored data and prioritizes it based on urgency and importance.

[0938] Step 5:

[0939] The server generates a prioritized list and notifies the user.

[0940] Specific process steps for event planning

[0941] Generate and modify event proposals

[0942] Step 1:

[0943] The server collects and analyzes past event data.

[0944] Step 2:

[0945] The server automatically generates new event suggestions based on the analysis results.

[0946] Step 3:

[0947] The server sends the generated event proposal to the terminal and notifies the user.

[0948] Step 4:

[0949] The user uses the device to check the proposal.

[0950] Step 5:

[0951] The user modifies the proposed content and presses the confirm button.

[0952] Step 6:

[0953] The device sends the modifications to the server.

[0954] Step 7:

[0955] The server updates the database with the received modifications.

[0956] Specific process steps for creating meeting minutes

[0957] Recording meeting audio and generating meeting minutes

[0958] Step 1:

[0959] During a conference, a user uses a terminal to record voice data.

[0960] Step 2:

[0961] The terminal transmits the recorded voice data to the server.

[0962] Step 3:

[0963] The server analyzes the audio data and automatically generates minutes as text data.

[0964] Checking and correcting the minutes

[0965] Step 1:

[0966] The server sends the generated minutes to the terminal and notifies the user.

[0967] Step 2:

[0968] The user uses the terminal to check the minutes.

[0969] Step 3:

[0970] The user edits the minutes and presses the confirm button.

[0971] Step 4:

[0972] The device sends the modifications to the server.

[0973] Step 5:

[0974] The server updates the database with the received modifications.

[0975] These are the specific processing steps for each system. This not only improves the efficiency of the operation of neighborhood associations, but also reduces the risk of fraud and mistakes by centralizing information management.

[0976] Example 1

[0977] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0978] In running a neighborhood association or community association, managing member information and budget data, processing requests for environmental improvements, planning events, and creating meeting minutes requires a great deal of time and effort. Much of this work is done manually, and there is a high risk of errors and fraud. The goal of this invention is to centralize and automate these management tasks, thereby significantly improving operational efficiency.

[0979] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0980] In this invention, the server includes a first means for inputting member information, a second means for saving the input member information in a database, a third means for displaying and updating the saved member information, a fourth means for inputting budget data, a fifth means for aggregating the input budget data and automatically generating a report, a sixth means for notifying the user of the generated report, a seventh means for inputting issues and requests regarding environmental improvement, an eighth means for prioritizing the input information, a ninth means for analyzing past event data and automatically generating event proposals, a tenth means for recording audio data of meetings, an eleventh means for analyzing the recorded audio data and automatically generating minutes, and a twelfth means for allowing the user to review and modify the generated minutes. This significantly reduces the effort and errors involved in running a neighborhood association and enables efficient and accurate operation.

[0981] "Member information" refers to personal information such as the names, addresses, and telephone numbers of members of neighborhood associations and local councils.

[0982] "Database" refers to a system that systematically stores and manages information such as member information, budget data, environmental improvement requests, event data, and meeting minutes.

[0983] "Budget data" refers to detailed data on the income and expenditures of neighborhood associations and town councils.

[0984] A "report" refers to a document that shows the income and expenditure status and budget usage status generated based on input budget data.

[0985] "Environmental improvement" refers to the maintenance and improvement of local public facilities and infrastructure.

[0986] "Requests" refer to issues and requests regarding environmental improvement submitted by local residents.

[0987] "Event proposal" refers to a new event plan generated by analyzing past event data.

[0988] "Audio data" refers to audio information recorded during a conference or meeting.

[0989] "Minutes" refers to a document that records what was discussed and what decisions were made at a conference or meeting.

[0990] A "generative AI model" refers to an artificial intelligence model that generates results or suggestions based on specific prompts.

[0991] A "prompt" is a document that is input to a generative AI model in the form of an instruction or question.

[0992] MODE FOR CARRYING OUT THE INVENTION

[0993] This system is designed primarily to streamline the management of neighborhood associations and community groups, and consists of a server, terminals, and users, each with a specific role, automating the following management and operation tasks:

[0994] Hardware and software used

[0995] Server: Database management system (DBMS) such as MySQL or PostgreSQL, HTTP server (Apache, Nginx)

[0996] Devices: PC, smartphone, tablet

[0997] User interface: HTML, JavaScript

[0998] Speech recognition technology: Google Speech-to-Text API, Amazon Transcribe

[0999] Generative AI models: OpenAI GPT-3, etc.

[1000] Membership Management System

[1001] Enter and save member information

[1002] The user uses a terminal to input membership information (such as name, address, and phone number). The terminal sends the input information to the server in JSON format. The server analyzes the received information and stores it in a database such as MySQL or PostgreSQL.

[1003] Example: A user enters information about a new member, "Yamada Hanako," and the terminal sends this information to the server and stores it in the database.

[1004] Update and view member information

[1005] The user uses the device to search for existing membership information and make any necessary changes. The changed information is then sent back to the server in JSON format, where it updates the database. The server then displays the new information on the device.

[1006] Example: A user changes the address of "Yamada Hanako," sends the information from the terminal to the server, and the database is updated.

[1007] Budget Control System

[1008] Entering and saving budget data

[1009] The user enters income and expenditure data into a form on the device, which is then sent to the server in JSON format and stored in a database.

[1010] Example: A user enters "income and expenditure data for Event A," which is sent to the server and stored in the database.

[1011] Automatic budget report generation and alerts

[1012] The server periodically compiles income and expenditure data and automatically generates budget reports. If an abnormal value is detected, an alert is sent to the user's device.

[1013] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[1014] Environmental Improvement System

[1015] Enter and prioritize issues and requests

[1016] Users use their devices to input their environmental problems and requests, which are then sent to a server where they are stored in a database. The server then analyzes the information and generates a prioritized list.

[1017] Example: A user types "faulty street light" into a terminal as a request, which is sent to the server, analyzed, and added to a list of high-priority issues.

[1018] Event Planning System

[1019] Generate and modify event proposals

[1020] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device for confirmation and modification.

[1021] Example: The server analyzes data on past "summer festivals" and suggests holding a summer festival this year. The server notifies the user and allows the user to change the date, time, and content.

[1022] Minutes creation system

[1023] Recording meeting audio and automatically generating minutes

[1024] During a meeting, users record audio data on their devices, which is then sent to a server that uses voice recognition technology to automatically generate minutes.

[1025] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[1026] Prompt Sentence Examples

[1027] 1. "How do I enter new membership information?"

[1028] 2. "How do I enter my income and expenditure data?"

[1029] 3. "How do I request a street light malfunction?"

[1030] By utilizing this system, a wide range of tasks related to the management of neighborhood associations and town councils can be carried out efficiently and accurately.

[1031] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1032] Membership management system processing flow

[1033] Enter and save member information

[1034] Step 1:

[1035] The user enters new member information (name, address, phone number, etc.) into a form on the device. The form is created using HTML and JavaScript.

[1036] Input: Member information (e.g. "Yamada Hanako")

[1037] Output: The information entered

[1038] Step 2:

[1039] The terminal converts the entered member information into JSON format and sends it to the server using an HTTP POST request.

[1040] Input: JSON data of entered member information (e.g., {"name": "Yamada Hanako", "address": "Tokyo", "phone": "090-1234-5678"})

[1041] Output: Request sent to server

[1042] Step 3:

[1043] The server parses the received JSON data and stores it in a database, using MySQL or PostgreSQL.

[1044] Input: JSON data received from the terminal

[1045] Data processing: Generate SQL query (INSERT INTO members (name, address, phone) VALUES ('Hanako Yamada', 'Tokyo', '090-1234-5678'))

[1046] Output: Save to database

[1047] Update and view member information

[1048] Step 1:

[1049] The user uses the terminal to search for existing member information and enter the parts to be corrected.

[1050] Input: Member information to search (e.g., "Yamada Hanako"), correction details (e.g., change of address)

[1051] Output: Corrections entered

[1052] Step 2:

[1053] The device converts the modified information into JSON format and sends it to the server using an HTTP PUT request.

[1054] Input: JSON data of the corrected member information (e.g., {"name": "Yamada Hanako", "address": "Osaka Prefecture", "phone": "090-1234-5678"})

[1055] Output: Request sent to server

[1056] Step 3:

[1057] The server parses the received JSON data and generates the appropriate SQL queries to update the database.

[1058] Input: JSON data received from the terminal

[1059] Data processing: Generate SQL query (UPDATE members SET address='Osaka Prefecture' WHERE name='Yamada Hanako')

[1060] Output: Database update

[1061] Step 4:

[1062] The server retrieves the updated member information again and displays it on the terminal.

[1063] Input: Acquire corrected member information

[1064] Output: Send and display updates to the terminal

[1065] Budget control system processing flow

[1066] Entering and saving budget data

[1067] Step 1:

[1068] The user enters income and expenditure data into a form on the terminal.

[1069] Input: Income and expenditure data (e.g., "Event A Income and Expenditure")

[1070] Output: The input data

[1071] Step 2:

[1072] The terminal converts the entered income and expenditure data into JSON format and sends it to the server using an HTTP POST request.

[1073] Input: JSON data of income and expenditure data

[1074] Output: Request sent to server

[1075] Step 3:

[1076] The server parses the received JSON data and stores it in a database.

[1077] Input: JSON data received from the terminal

[1078] Data manipulation: Generate SQL queries (INSERT INTO budget (event, revenue, expense) VALUES (...))

[1079] Output: Save to database

[1080] Automatic budget report generation and alerts

[1081] Step 1:

[1082] The server periodically compiles income and expenditure data from the database and automatically generates reports.

[1083] Input: Database income and expenditure data

[1084] Data calculation: Aggregation processing (calculation of total income, total expenditure, budget status)

[1085] Output: Generated budget report

[1086] Step 2:

[1087] The server notifies the user of the generated report and sends an alert if anomalies are detected.

[1088] Input: Generated budget reports and alert information

[1089] Output: Notifying and alerting users

[1090] Environmental improvement system processing flow

[1091] Enter and prioritize issues and requests

[1092] Step 1:

[1093] Users input problems and requests regarding environmental improvements from their terminals.

[1094] Input: Issue or request details (e.g., "Street light malfunction")

[1095] Output: The input request

[1096] Step 2:

[1097] The device converts the input request into JSON format and sends it to the server using an HTTP POST request.

[1098] Input: JSON data of the request content

[1099] Output: Request sent to server

[1100] Step 3:

[1101] The server analyzes the incoming requests, generates a prioritized list, and stores it in a database.

[1102] Input: JSON data received from the terminal

[1103] Data calculation: Priority calculation (considering urgency and importance)

[1104] Output: Save the generated priority list

[1105] Event planning system processing flow

[1106] Generate and modify event proposals

[1107] Step 1:

[1108] The server analyzes past event data and automatically generates suggestions for new events.

[1109] Input: Past event data

[1110] Data calculation: analytical processing (pattern matching, trend analysis)

[1111] Output: Generated event suggestions

[1112] Step 2:

[1113] The suggestions are notified to the user via the terminal, and the user can confirm and correct them.

[1114] Input: Generated event suggestions

[1115] Output: User notification and revised proposed data

[1116] Processing flow of the minutes creation system

[1117] Recording meeting audio and automatically generating minutes

[1118] Step 1:

[1119] During a conference, a user records audio data using a terminal.

[1120] Input: Audio data (speech during a meeting)

[1121] Output: Recorded audio data

[1122] Step 2:

[1123] The recorded voice data is transmitted from the terminal to the server.

[1124] Input: Recorded audio data

[1125] Output: Send data to the server

[1126] Step 3:

[1127] The server analyzes the voice data and automatically generates minutes using voice recognition technology.

[1128] Input: Audio data received from the device

[1129] Data calculation: Speech recognition processing (Google Speech-to-Text API, etc.)

[1130] Output: Generated meeting minutes

[1131] Step 4:

[1132] The user can check the generated minutes and correct any errors.

[1133] Input: Generated minutes

[1134] Output: Display of minutes to user and modified minutes data

[1135] (Application example 1)

[1136] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1137] To streamline the operations of neighborhood associations and community groups, it is necessary to automate various tasks, such as managing member information, budget management, maintenance information management, and meeting records. Similarly, efficiency is also required for the maintenance and management of robots in factories. However, performing these tasks manually requires a great deal of time and effort, resulting in problems of decreased efficiency and human error.

[1138] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1139] In this invention, the server includes means for inputting member information, means for saving the input member information in a database, means for displaying and updating the saved member information, means for inputting robot maintenance information, means for saving the input maintenance information in a database, means for inputting budget data, means for aggregating the input budget data and automatically generating a report, and means for notifying the user of the generated report. This makes management tasks in neighborhood associations and factories more efficient, saving time and effort and reducing errors.

[1140] "Member Information" refers to data related to a User, such as personal information and contact information.

[1141] "Maintenance Information" refers to details and records relating to the maintenance of robots and equipment.

[1142] "Database" refers to a system for efficiently and securely storing and managing data.

[1143] "Budget data" refers to information relating to income and expenditure and details of expenses.

[1144] A "report" refers to a document that compiles data and summarizes the results of analysis.

[1145] A "server" refers to a computer system that centralizes data processing and storage.

[1146] "Means" refers to a process or device for achieving a specific function or task.

[1147] "Input" refers to the act of a user registering data or information into the system.

[1148] "Storage" refers to storing and preserving input data in a database.

[1149] "Display" refers to showing the stored data to the user.

[1150] "Update" refers to replacing existing data with new information.

[1151] "User" means any person or entity that operates and uses the System.

[1152] This invention is a system for streamlining administrative tasks for neighborhood associations, town associations, factories, etc., and is comprised of a server, terminals, and users. This system automates member information management, budget management, maintenance information management, event planning, and the creation of meeting minutes. Specific embodiments of this system are described below.

[1153] Membership Information Management System

[1154] The server is responsible for saving the member information entered by the user from the terminal in a database. The user can enter new member information or update existing member information through the input screen on the terminal. For example, the user can enter information such as the name, address, and phone number of a new member. The saved information is stored in the database by the server and can be displayed or edited as needed.

[1155] Budget Control System

[1156] The server stores the income and expenditure data entered by the user from the terminal in a database. The server also aggregates this data and automatically generates a budget report. The server notifies the user of this generated report. For example, at the end of the month, the server aggregates the income and expenditure data and sends the automatically generated budget report to the user by email. If any unclear expenditures are discovered, an alert is displayed to the user.

[1157] Maintenance Information Management System

[1158] Maintenance information for robots and equipment in factories is entered by users using terminals. The entered maintenance information is sent to a server and stored in a database. Based on this information, the server can automatically determine the priority of maintenance and display it to the user. For example, if a user enters "daily inspection results for robot A," the information is sent and stored on the server, and then displayed on the terminal.

[1159] Event Planning System

[1160] The server analyzes past event data and automatically generates proposals for new events. These proposals are notified to the user via their device, allowing them to confirm and modify them. For example, the server can analyze past "summer festival" data and propose a new summer festival. The user receives a notification and can modify the date, time, and content.

[1161] Minutes creation system

[1162] During a meeting, users use their devices to record the audio of the meeting. The recorded audio data is sent to a server, which then uses voice recognition technology to automatically generate minutes. The generated minutes can be viewed on the device, and the user can make any corrections. For example, after the meeting ends, the server automatically generates minutes from the audio data, and the user can review them on the device and correct any errors.

[1163] The system is written in Python and uses Flask as the server-side framework, with a SQLite database for data storage.

[1164] As a specific example, the system can perform a specific task by using the prompt sentence, "Please record the results of the daily inspection of Robot A. Enter the following information for future maintenance management: Robot ID: robot_A, Detailed information: Daily inspection successful, Date and time: 2023-10-01T08:00:00. Please save this information in the system."

[1165] This will streamline various management tasks within neighborhood associations, town halls, and factories, saving time and effort and reducing errors.

[1166] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1167] Step 1:

[1168] The user enters member information, maintenance information, or budget data on the input screen of the terminal. The entered data is sent to the server as an HTTP request. In this step, member information such as name, address, and phone number, robot maintenance information, and budget data are received as input data. The input data is sent to the server as output.

[1169] Step 2:

[1170] The server analyzes the received HTTP request and converts the data into the appropriate format. In this step, data processing is performed to convert the raw data entered by the user into the data format used internally. For example, date and number formats are checked and completed. The input is the raw data sent by the user, and the output is the converted data.

[1171] Step 3:

[1172] The server saves the formatted data to a SQLite database. In this step, a save SQL query is generated and executed against the database. As input, it has the formatted data, and as output, it persists this data to the database.

[1173] Step 4:

[1174] The server periodically aggregates financial data and maintenance information from the database to automatically generate budget reports and maintenance priority lists. In this step, SQL aggregation queries are executed and the results are generated as reports and lists. The input is the financial data and maintenance information in the database, and the output is the aggregated budget report or maintenance priority list.

[1175] Step 5:

[1176] The server notifies the user of the generated report or list. This notification can be done by sending an email or a push notification to the app. In this step, a notification message is generated and sent by an appropriate means based on the user's contact information. The inputs are the generated report or list and the user's contact information, and the output is a notification sent to the user.

[1177] Step 6:

[1178] The user checks the reports and lists on the terminal and makes any necessary corrections. The corrected content is sent back to the server and the database is updated. In this step, the user edits the displayed data and sends it to the server. The input is the data corrected by the user, and the output is the database update.

[1179] Step 7:

[1180] During a meeting, the user records voice data on their device and sends it to the server. The server uses voice recognition technology to analyze the voice data and automatically generate minutes. In this step, a data calculation is performed to convert the voice data into text data. The input is the voice data sent by the user, and the output is the automatically generated minutes in text format.

[1181] Step 8:

[1182] The server sends the automatically generated minutes to the user, allowing them to check and modify them on their terminal. Finally, the modified minutes are saved back to the database. In this step, the database is updated after the modifications are sent by the user. The input is the minutes data modified by the user, and the output is the final update to the database.

[1183] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1184] This system combines member management, budget management, automatic generation of meeting minutes, and an emotion engine that recognizes user emotions in order to streamline the management of neighborhood associations and community associations. A specific embodiment of this system will be described below.

[1185] Membership Management System

[1186] Enter and save member information

[1187] The user enters the new member's information (name, address, contact details, etc.) into a form on the terminal. The entered information is sent from the terminal to the server, which then stores it in a database.

[1188] Example: When a user enters information about "New Member Yamada Hanako," this information is sent from the terminal to the server and stored in the database.

[1189] Update and view member information

[1190] Users can search for existing membership information through their terminals and update it as necessary. The updated data is sent back to the server, which updates the database. The server then displays the new information on the terminal.

[1191] Example: When a user enters a change of address for "Hanako Yamada," the information is sent to the server, the database is updated, and the new address information is then displayed on the device.

[1192] Budget Control System

[1193] Entering and saving budget data

[1194] Users enter their income and expenditure data into a form on their device, which is then sent to the server and stored in a database.

[1195] Example: When a user enters "income and expenditure data for Event A," it is sent to the server and stored in the database.

[1196] Automatic budget report generation and alerts

[1197] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If it detects any abnormal values, it sends an alert to the user.

[1198] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[1199] Environmental Improvement System

[1200] Entering and processing issues and requests

[1201] Users enter their environmental improvement issues and requests into a form on their device. The information is sent from the device to the server and stored in a database. The server then analyzes the information and generates a prioritized list.

[1202] Example: When a user types "faulty street light" into a terminal as a request, it is sent to the server, analyzed, and added to a list of high-priority issues.

[1203] Event Planning System

[1204] Generate and modify event proposals

[1205] The server collects and analyzes past event data, and automatically generates new event suggestions based on the analysis results. The suggestions are sent to the user via their device, allowing them to review and modify them.

[1206] Example: The server analyzes data on past "summer festivals" and proposes to hold a summer festival this year, notifying the user. The user can then modify the date, time, and content.

[1207] Minutes creation system

[1208] Recording meeting audio and generating meeting minutes

[1209] During a meeting, users record audio data on their devices, which is then sent to a server, which uses voice recognition technology to automatically generate minutes.

[1210] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[1211] Emotion engine integration

[1212] User Emotion Recognition

[1213] The emotion engine recognizes emotions (e.g., joy, anger, sadness, etc.) when a user inputs something on the device. The recognized emotion data is sent from the device to the server.

[1214] Example: If a user is feeling frustrated and inputting a large amount of data, the emotion engine will recognize the frustration and send it as data to the server.

[1215] Interface Adaptation

[1216] The server dynamically adapts the user's interface based on the recognized emotion data, for example simplifying the interface if the user is feeling stressed.

[1217] Example: When the emotion engine recognizes the user's stress, the server simplifies the interface by reducing confirmation messages, etc.

[1218] Storing and using emotional data

[1219] The server stores the emotion data in a database and uses it for future analysis and interface adjustments.

[1220] Example: The server analyzes previously recognized emotional data and suggests ways to reduce the user's operational stress.

[1221] This system not only streamlines the management of neighborhood associations and community groups, but also provides an interface that takes users' emotions into consideration, making it easier for even elderly local residents to manage and operate the associations.In addition, the information stored in the database is managed centrally, reducing the risk of fraud and errors.

[1222] The processing flow will be explained below.

[1223] Specific processing steps of the system based on the combination of emotion engines

[1224] Membership Management System

[1225] Step 1:

[1226] The user enters the new member's information (name, address, contact information, etc.) into the form on the terminal.

[1227] Step 2:

[1228] The terminal transmits the input information to the server.

[1229] Step 3:

[1230] The server saves the received membership information in the database.

[1231] Step 4:

[1232] The server returns a confirmation message to the terminal that the save has been completed.

[1233] Update your membership information

[1234] Step 1:

[1235] The user uses the search function on the device to select the membership information they want to update.

[1236] Step 2:

[1237] The terminal retrieves existing member information from the server and displays it.

[1238] Step 3:

[1239] The user uses the terminal to modify the membership information and confirm the changes.

[1240] Step 4:

[1241] The terminal sends the modified information to the server.

[1242] Step 5:

[1243] The server updates the existing record in the database with the received information.

[1244] Step 6:

[1245] The server returns a confirmation message to the terminal that the update is complete.

[1246] Budget Control System

[1247] Step 1:

[1248] The user enters income and expenditure data into a form on the terminal.

[1249] Step 2:

[1250] The terminal transmits the input balance data to the server.

[1251] Step 3:

[1252] The server stores the received income and expenditure data in a database.

[1253] Automatic generation of budget reports

[1254] Step 1:

[1255] The server periodically (e.g., at the end of each month) retrieves income and expenditure data from the database and aggregates it.

[1256] Step 2:

[1257] The server automatically generates budget reports.

[1258] Step 3:

[1259] The server sends the generated budget report to the user via email or notification.

[1260] Anomaly detection and alerting

[1261] Step 1:

[1262] The server analyzes the income and expenditure data and detects abnormal values ​​and fraud.

[1263] Step 2:

[1264] If the server detects abnormal values ​​or irregularities, it will send an alert notification to the user.

[1265] Environmental Improvement System

[1266] Step 1:

[1267] The user enters issues and requests regarding environmental improvements into a form on the device.

[1268] Step 2:

[1269] The device sends the input tasks and requests to the server.

[1270] Step 3:

[1271] The server stores the received data in a database.

[1272] Step 4:

[1273] The server analyzes the stored data and prioritizes it based on urgency and importance.

[1274] Step 5:

[1275] The server generates a prioritized list and notifies the user.

[1276] Event Planning System

[1277] Step 1:

[1278] The server collects and analyzes past event data.

[1279] Step 2:

[1280] The server automatically generates new event suggestions based on the analysis results.

[1281] Step 3:

[1282] The server sends the generated event proposal to the terminal and notifies the user.

[1283] Step 4:

[1284] The user uses the device to check the proposal.

[1285] Step 5:

[1286] The user modifies the proposed content and presses the confirm button.

[1287] Step 6:

[1288] The device sends the modifications to the server.

[1289] Step 7:

[1290] The server updates the database with the received modifications.

[1291] Minutes creation system

[1292] Step 1:

[1293] During a conference, a user uses a terminal to record voice data.

[1294] Step 2:

[1295] The terminal transmits the recorded voice data to the server.

[1296] Step 3:

[1297] The server analyzes the audio data and automatically generates minutes as text data.

[1298] Checking and correcting the minutes

[1299] Step 1:

[1300] The server sends the generated minutes to the terminal and notifies the user.

[1301] Step 2:

[1302] The user uses the terminal to check the minutes.

[1303] Step 3:

[1304] The user edits the minutes and presses the confirm button.

[1305] Step 4:

[1306] The device sends the modifications to the server.

[1307] Step 5:

[1308] The server updates the database with the received modifications.

[1309] Emotion engine integration

[1310] User Emotion Recognition

[1311] Step 1:

[1312] When a user inputs information into the device, the emotion engine identifies the user's emotions (e.g., joy, anger, sadness, etc.) in real time.

[1313] Step 2:

[1314] The emotion data recognized by the emotion engine is sent from the terminal to the server.

[1315] Step 3:

[1316] The server stores the received emotion data in a database.

[1317] Interface Adaptation

[1318] Step 1:

[1319] The server analyzes the recognized emotion data.

[1320] Step 2:

[1321] The server dynamically adapts the user's operation interface based on the analysis results.

[1322] Step 3:

[1323] The terminal displays the adapted interface to the user.

[1324] Storing and using emotional data

[1325] Step 1:

[1326] The server accumulates past emotional data and stores it in a database.

[1327] Step 2:

[1328] The server analyzes the accumulated emotional data and uses it to improve the system in the future.

[1329] Step 3:

[1330] Based on the analysis results, the server proposes optimized interfaces and operating procedures for the user.

[1331] These are the specific processing steps for each system. This not only improves the efficiency of neighborhood association and community management, but also provides an interface that takes user feelings into consideration. This makes it easier for even elderly local residents to manage and operate the system. In addition, the information stored in the database is managed centrally, reducing the risk of fraud and errors.

[1332] Example 2

[1333] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1334] In conventional membership management systems, budget management systems, and automated meeting minutes systems, each function is separate and not integrated, which means users have to operate different systems separately, which is inconvenient. Furthermore, the lack of interface adjustments or stress reduction features that respond to the user's emotions during operation makes it difficult to improve the user experience. Furthermore, prioritization of environmental improvement issues and requests is often done manually. Therefore, there is a need for a system that can streamline the management of neighborhood associations and town councils and is easier to use.

[1335] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1336] In this invention, the server includes: means for inputting member information, means for saving the input member information in a database, means for displaying and updating the saved member information, means for inputting income and expenditure data, means for saving the income and expenditure data in a database, means for periodically aggregating the income and expenditure data and automatically generating a budget report, means for notifying the user of the generated budget report, means for recording conference audio data, means for analyzing the recorded audio data and automatically generating minutes, means for allowing the user to confirm and modify the generated minutes, means for recognizing the user's emotions, means for dynamically adapting the user interface based on the recognized emotion data, and means for saving the emotion data in a database and using it for future analysis and interface adjustment. This enables centralized operation with each function integrated and provides an interface that takes user emotions into consideration, thereby enabling a system that is easy to use for local residents, including the elderly.

[1337] The "means for inputting member information" is an interface for inputting information about new members using a terminal.

[1338] "Means for saving input member information in a database" is a function by which the server stores input member information in a database.

[1339] "Means for viewing and updating stored member information" refers to a function that allows users to search, view, and modify stored member information.

[1340] The "means for inputting balance data" is an interface for inputting balance data from a terminal.

[1341] The "means for saving balance data in a database" is a function by which the server stores the input balance data in a database.

[1342] The "means for periodically aggregating income and expenditure data and automatically generating a budget report" is a function in which the server aggregates income and expenditure data at regular intervals and automatically generates a budget report.

[1343] The "means for notifying the user of the generated budget report" is a function by which the server notifies the user of the generated budget report.

[1344] The "means for recording conference audio data" is an interface for recording audio during a conference on a terminal.

[1345] The "means for analyzing the recorded voice data and automatically generating minutes" is a function in which the server analyzes the recorded voice data and automatically generates minutes in text format.

[1346] The "means for enabling a user to check and modify the generated minutes" is a function that allows a user to check the automatically generated minutes and modify them as necessary.

[1347] The "means for recognizing user emotions" is an engine for recognizing the emotions felt by the user in real time during operation.

[1348] The "means for dynamically adapting the user interface based on the recognized emotion data" is a function that allows the server to change the interface based on the recognized emotion data.

[1349] "Means for storing emotion data in a database and using it for future analysis and interface adjustment" is a function in which the server stores the recognized emotion data in a database and uses it later for analysis and interface optimization.

[1350] The present invention is an integrated system for streamlining the management of neighborhood associations and community groups, and includes functions for member management, budget management, automatic generation of meeting minutes, and user emotion recognition. How each function is implemented will be explained in detail below.

[1351] Membership Management System

[1352] Enter and save member information

[1353] The user enters new member information into a form on the device. The device sends the entered information in JSON format to the server. The server generates an SQL query to save the received data to the database, connects to the database, and executes it. After the process is complete, the server sends a message to the device indicating that the save has been completed, and the device displays it to the user.

[1354] Example: When a user enters information for a new member, "Hanako Yamada," the device converts the information into JSON data and sends it to the server. The server generates and executes the SQL query "INSERT INTO members (name, address, contact) VALUES ('Hanako Yamada', 'Address', 'Contact Information')" and saves it in the database. After that, the device displays the message "Member information saved."

[1355] Update and view member information

[1356] Users search for existing membership information through their device and update it as necessary. The device sends a search query to the server, which queries the database to obtain the results and sends them to the device. The user checks the displayed information, makes any necessary updates, and sends the updates from the device to the server. The server updates the database and sends a completion message to the device.

[1357] Example: When a user changes the address of "Yamada Hanako," the terminal sends the query "SELECT FROM members WHERE name="Yamada Hanako"" to the server, and the server retrieves the relevant information from the database and sends it to the terminal. After the user enters the new address, the terminal sends the query "UPDATE members SET address="new address" WHERE name="Yamada Hanako"" to the server, and the server executes the query and updates the database. The updated information is then displayed on the terminal.

[1358] Budget Control System

[1359] Entering and saving budget data

[1360] The user enters the balance data into a form on the terminal. The terminal sends the data to the server, which then generates and executes an SQL query to save the balance data in a database. After the process is complete, the server sends a message to the terminal indicating that the data has been saved, and the terminal displays the message to the user.

[1361] Example: When a user enters "income and expenditure data for event A," the terminal sends it to the server, which then generates and executes the SQL query "INSERT INTO budget (event, income, expense) VALUES ('event A', 'income', 'expense')" and saves it in the database. After that, the terminal displays the message "Income and expenditure data saved."

[1362] Automatic budget report generation and alerts

[1363] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If an abnormal value is detected, the server generates an alert message and notifies the user. The user can check the alert message on their device.

[1364] Example: At the end of the month, the server executes the query "SELECT SUM(income), SUM(expense) FROM budget WHERE month=current_month" to aggregate income and expenditure data. Based on the aggregated results, a budget report is generated and sent to the user by email. If an unclear expenditure is detected, an alert message stating "An abnormal expenditure has been detected" is generated and sent to the terminal.

[1365] Meeting minutes creation system

[1366] Recording meeting audio and generating meeting minutes

[1367] During a meeting, users record audio data on their devices. The recorded audio data is then sent from the device to a server, which uses voice recognition technology to convert the audio data into text data and automatically generate minutes. The generated minutes can then be viewed and edited by the user.

[1368] Example: During a meeting, a user records voice data on their device and sends it to a server. The server uses speech recognition technology (e.g., Microsoft Azure Speech API) to convert the voice data into text and automatically generates minutes. The minutes are then sent to the user, who can review them and make any necessary corrections.

[1369] Emotion engine integration

[1370] User Emotion Recognition

[1371] When a user inputs information into the device, the emotion engine recognizes the user's emotions in real time, and the recognized emotion data is sent from the device to the server.

[1372] Example: When a user is entering a large amount of data, if an emotion of dissatisfaction is recognized, the emotion engine sends the data to the server.

[1373] Interface Adaptation

[1374] The server analyzes the received emotional data and sends instructions to the device to adjust the interface according to the emotional state. The device then dynamically changes the interface based on the instructions.

[1375] Example: When the emotion engine recognizes the user's stress state, the server sends instructions such as "reduce confirmation messages" to the device, and the device simplifies the interface based on the instructions.

[1376] Storing and using emotional data

[1377] The server stores the recognized emotion data in a database, which can be used for future analysis and interface adjustments.

[1378] Example: The server generates the SQL query "INSERT INTO emotion_data (timestamp, emotion) VALUES ('current time', 'recognized emotion')" and saves the emotion data in the database. It analyzes the saved data and makes suggestions for improving the interface to reduce user operational stress in the future.

[1379] Usage example

[1380] Examples of prompts input to the generative AI model include "Please enter the name of the new member" or "Please enter income and expenditure data." Based on this, the device issues appropriate instructions to the user, and the server processes the data on the backend.

[1381] As described above, this invention can significantly improve user convenience by integrating member management, budget management, automatic generation of meeting minutes, and user emotion recognition. By enabling centralized operation with each function integrated and providing an interface that takes user emotions into consideration, it is possible to realize a system that is easy to use, especially for local residents, including the elderly.

[1382] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1383] Enter and save member information

[1384] Step 1:

[1385] The user enters the new member's information (name, address, contact details, etc.) into the form on the terminal.

[1386] Input: New member information

[1387] Output: Information entered into the terminal

[1388] Specific operation: The user enters "Name: Yamada Hanako, Address: XX town, Contact number: 090-1234-5678" into the form on the terminal.

[1389] Step 2:

[1390] The terminal converts the entered membership information into JSON format and sends it to the server.

[1391] Input: Information entered by the user

[1392] Output: Send JSON format data to the server

[1393] Specific operation: The device generates the JSON data "{"name": "Yamada Hanako", "address": "XX town", "contact": "090-1234-5678"}".

[1394] Step 3:

[1395] The server parses the received JSON data and generates SQL queries to store it in a database.

[1396] Input: JSON data sent from the terminal

[1397] Output: Generated SQL query

[1398] Specific operation: The server generates the SQL query "INSERT INTO members (name, address, contact) VALUES ('Yamada Hanako', 'XX town', '090-1234-5678')".

[1399] Step 4:

[1400] The server connects to the database, executes the generated SQL query, and saves the member information in the database.

[1401] Input: Generated SQL query

[1402] Output: Save information to a database

[1403] Specific operation: The server executes the SQL query and saves Hanako Yamada's information in the "members" table of the database.

[1404] Step 5:

[1405] The server notifies the terminal of the completion of the process, and the terminal displays it to the user.

[1406] Input: Notification of completion of saving to database

[1407] Output: Save completed message to user

[1408] Specific operation: The message "Member information has been saved" will be displayed on the device.

[1409] Update and view member information

[1410] Step 1:

[1411] The user searches for existing membership information through the terminal.

[1412] Input: Search query

[1413] Output: Search results displayed

[1414] Specific operation: When a user searches for information about "Yamada Hanako", the query "SELECT FROM members WHERE name="Yamada Hanako"" is sent.

[1415] Step 2:

[1416] The terminal sends a search query to the server.

[1417] Input: A search request from the user

[1418] Output: Query sent to server

[1419] Specific operation: The terminal sends the query "SELECT FROM members WHERE name="Yamada Hanako"" to the server.

[1420] Step 3:

[1421] The server queries the database and retrieves the results.

[1422] Input: Search query

[1423] Output: Search results

[1424] Specific operation: The server executes an SQL query to obtain information about "Hanako Yamada."

[1425] Step 4:

[1426] The server transmits the acquired data to the terminal.

[1427] Input: Search result data

[1428] Output: Sending data to the terminal

[1429] Specific operation: The server sends the acquired data to the terminal. "Name: Yamada Hanako, Address: XX town, Contact: 090-1234-5678"

[1430] Step 5:

[1431] The device displays the acquired data.

[1432] Input: Data from the server

[1433] Output: Displaying information to the user

[1434] Specific operation: Information about "Yamada Hanako" is displayed on the terminal.

[1435] Step 6:

[1436] The user makes the necessary updates and enters the update data into the terminal.

[1437] Input: Correction information

[1438] Output: Corrected data input to terminal completed

[1439] Specific behavior: The user changes the address to "New Address."

[1440] Step 7:

[1441] The terminal transmits the update data to the server.

[1442] Input: Correction information from the user

[1443] Output: Send corrected data to the server

[1444] Specific operation: The terminal sends the query "UPDATE members SET address="new address" WHERE name="Yamada Hanako"" to the server.

[1445] Step 8:

[1446] The server updates the database with the corrected data.

[1447] Input: SQL query to modify

[1448] Output: Database update

[1449] Specific operation: The server executes an SQL query to update Hanako Yamada's address information.

[1450] Step 9:

[1451] After the server completes the process, it sends a confirmation message to the terminal.

[1452] Input: Database update completion notification

[1453] Output: Notification to terminal

[1454] Specific operation: The message "Member information has been updated" will be displayed on the device.

[1455] Budget Control System

[1456] Step 1:

[1457] The user enters income and expenditure data into a form on the terminal.

[1458] Input: Income and expenditure data

[1459] Output: Data input to terminal completed

[1460] Specific operation: The user inputs "income and expenditure for event A."

[1461] Step 2:

[1462] The terminal transmits the balance data to the server.

[1463] Input: User's income and expenditure data

[1464] Output: Send data to the server

[1465] Specific operation: The terminal sends income and expenditure data in JSON format.

[1466] Step 3:

[1467] The server generates and executes SQL queries to store the balance data in a database.

[1468] Input: JSON data for income and expenditure

[1469] Output: SQL query

[1470] Specific operation: The server generates and executes the SQL query "INSERT INTO budget (event, income, expense) VALUES ('Event A', 'Income', 'Expense')".

[1471] Step 4:

[1472] The server notifies the terminal of the completion of the process, and the terminal displays it to the user.

[1473] Input: Data save completion notification

[1474] Output: A completion message to the user

[1475] Specific operation: The message "Income and expenditure data saved" will be displayed on the device.

[1476] Step 5:

[1477] The server periodically compiles income and expenditure data from the database and automatically generates budget reports.

[1478] Input: Periodic income and expenditure data

[1479] Output: Budget Report

[1480] Specific operation: The server executes "SELECT SUM(income), SUM(expense) FROM budget WHERE date BETWEEN start date AND end date" and automatically generates the aggregated data as a budget report.

[1481] Step 6:

[1482] If the server detects an abnormal value, it generates an alert message and notifies the user.

[1483] Enter: Budget Report

[1484] Output: Alert message

[1485] Specific behavior: The server detects anomalies in the budget report and generates and sends an alert message saying "Unclear expenditure detected."

[1486] Meeting minutes creation system

[1487] Step 1:

[1488] During a conference, a user records audio data on a terminal.

[1489] Input: Audio data

[1490] Output: Recording audio data to the device

[1491] Specific operation: The device records audio data in real time during the meeting.

[1492] Step 2:

[1493] The terminal transmits the recorded voice data to the server.

[1494] Input: Recorded audio data

[1495] Output: Sending audio data to the server

[1496] Specific operation: The device sends the recorded audio data to the server.

[1497] Step 3:

[1498] The server uses voice recognition technology to convert the voice data into text data and automatically generate minutes.

[1499] Input: Audio data

[1500] Output: Text data (minutes)

[1501] What happens: The server uses speech recognition technology (e.g., Microsoft Azure Speech API) to convert the voice data into text.

[1502] Step 4:

[1503] The server sends the generated minutes to the terminal so that the user can check and modify them.

[1504] Input: Generated minutes

[1505] Output: Confirm and correct minutes to the user

[1506] Specific operation: The server sends the generated minutes to the terminal, where the user can check them and make corrections if necessary.

[1507] Emotion engine integration

[1508] Step 1:

[1509] When a user performs input work on the device, the emotion engine recognizes the user's emotions in real time.

[1510] Input: User input behavior and emotions

[1511] Output: Recognized emotion data

[1512] Specific operation: The emotion engine recognizes emotions in real time based on the user's input speed, facial expressions, etc.

[1513] Step 2:

[1514] The recognized emotion data is transmitted from the terminal to the server.

[1515] Input: Recognized emotion data

[1516] Output: Send emotion data to the server

[1517] Specific operation: The device sends emotional data such as "the user is feeling stressed" to the server.

[1518] Step 3:

[1519] The server analyzes the received emotional data and sends instructions to the terminal to adjust the interface.

[1520] Input: Emotion data

[1521] Output: Interface adjustment instructions

[1522] Specific operation: The server analyzes the received emotion data and generates interface adjustment instructions such as "reduce confirmation messages."

[1523] Step 4:

[1524] The terminal dynamically changes the interface based on instructions from the server.

[1525] Input: Instructions from the server

[1526] Output: Interface changes

[1527] Specific actions: The device simplifies or adapts the user interface according to the instructions.

[1528] Step 5:

[1529] The server stores the recognized emotion data in a database for future analysis and interface adjustments.

[1530] Input: Emotion data

[1531] Output: Emotion data saved in a database

[1532] Specific operation: The server generates the SQL query "INSERT INTO emotion_data (timestamp, emotion) VALUES ('current time', 'user emotion')" and saves it in the database. In the future, the emotion data will be analyzed and used to improve the interface.

[1533] These are the specific processing steps of the system that uses membership management, budget management, meeting minutes creation, and an emotion engine. This system will improve the efficiency of neighborhood association management and provide a comfortable interface that takes user emotions into consideration.

[1534] (Application example 2)

[1535] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1536] When managing robots in factories, it is important for employees to efficiently manage the robots' operating status and maintenance records. However, with existing systems, this task is cumbersome and requires a lot of effort and time. Furthermore, budget management and the creation of meeting minutes are also time-consuming, contributing to increased employee stress. Furthermore, there is a lack of a mechanism for adapting the interface to employees' emotions, which leads to reduced operational efficiency and increased stress. Therefore, a new system is needed to improve the efficiency of overall management tasks and reduce the burden on employees.

[1537] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting member information; means for saving the input member information in a database; means for displaying and updating the saved member information; means for inputting robot information and saving operating status and maintenance records in a database; means for inputting budget data; means for aggregating the input budget data and automatically generating a report; means for notifying the user of the generated report; means for recording conference audio data; means for analyzing the recorded audio data and automatically generating minutes; means for allowing the user to confirm and modify the generated minutes; means for recognizing user emotion data; means for saving the recognized emotion data in a database and adapting the interface; and means for changing the interface based on the emotion data. This not only improves the efficiency of robot operation management in factories and automates tasks such as budget management and generating meeting minutes, but also provides an interface that takes employee emotions into consideration, reducing stress and improving operational efficiency.

[1538] "Member information" refers to personal identification information entered by a user, and includes data such as name, address, and contact details.

[1539] A "database" is an organized collection of information, a system that stores input data and allows it to be searched and updated.

[1540] "Robot information" refers to data such as the specific operating status and maintenance records of robots within a factory.

[1541] "Operational status" refers to data that indicates how a machine or system is operating, its current operating status, and operating time.

[1542] "Maintenance records" are historical data of maintenance work on a machine or system, including details of the maintenance work carried out.

[1543] "Budget Data" means the income and expenditure data, details of expenses and revenues relevant to the preparation of a budget.

[1544] A "report" is a report generated based on collected and organized data, and includes analysis and aggregation results.

[1545] "Notification" refers to the sending of a message from the system to the user to notify, warn, or convey information.

[1546] "Audio data" refers to data that includes audio information recorded during a meeting, conversation, or the like.

[1547] Minutes are documents that record the contents of a meeting or discussion, including what was said and what decisions were made.

[1548] "Emotion data" is information that indicates the user's emotional state, and is data that identifies emotions such as stress, joy, and sadness.

[1549] "Interface" refers to the screens and operating means that allow users to directly interact with the system.

[1550] "Adaptation" refers to changing the way a system behaves or displays itself depending on the environment or situation.

[1551] This invention is a system for streamlining the operation and management of robots in factories. This system allows factory managers and employees to easily manage robot operation status and maintenance records, automatically tally budget data, generate meeting minutes, and even adapt the interface based on employee emotions.

[1552] 1. Robot Management System

[1553] 1.1 Entering and saving robot information

[1554] The user uses the terminal interface to input robot information (operating status, maintenance records, etc.), which is then sent from the terminal to the server and stored in a database.

[1555] Example: When a user enters "Operating normally" as the "Operation status of Robot A," the information is sent to the server and stored in the database.

[1556] 1.2 Viewing and updating robot information

[1557] The user uses the device to search for existing robot information and update it as needed. The updated data is sent back to the server, which updates the database. The server then displays the new information on the device.

[1558] Example: When a user updates the maintenance information for "Robot A" to "Replace part X," the information is sent to the server, the database is updated, and the new information is displayed on the terminal.

[1559] 2. Budget Control System

[1560] 2.1 Entering and saving budget data

[1561] The user enters income and expenditure data into an input form on the terminal, which is then sent to the server and stored in a database.

[1562] Example: When a user enters "100,000 yen as maintenance fee," it is sent to the server and saved in the database.

[1563] 2.2 Automatic generation and notification of budget reports

[1564] The server periodically aggregates income and expenditure data from the database, automatically generates budget reports, and sends alerts to users if any abnormal values ​​are detected.

[1565] Example: At the end of the month, the server aggregates income and expenditure data and notifies the user by email of an automatically generated budget report. If any unclear expenditures are found, an alert is displayed to the user.

[1566] 3. Meeting Minutes Creation System

[1567] 3.1 Recording and saving conference audio

[1568] During a conference, users record audio data on their terminals, which are then sent to the server.

[1569] Example: A user records audio on their smartphone during a meeting and uploads the file to a server.

[1570] 3.2 Automatic generation and confirmation of minutes

[1571] The server uses voice recognition technology to automatically generate minutes from the recorded voice data. The generated minutes can then be checked by the user on their device and any errors can be corrected.

[1572] Example: After the meeting ends, the server automatically generates minutes from the audio data and displays them on the user's device. The user can then make any necessary corrections.

[1573] 4. Emotion engine integration

[1574] 4.1 User Emotion Recognition and Interface Adaptation

[1575] The emotion engine recognizes the emotions expressed by the user while operating the device. The recognized emotion data is sent to the server and stored in a database. The server then dynamically adapts the interface based on this information.

[1576] Example: If a user is feeling stressed while entering data, the emotion engine will recognize that stress and the server will simplify the interface by reducing confirmation messages, etc.

[1577] Hardware and software used

[1578] Device: A device such as a smartphone, tablet, or PC.

[1579] Server: A server system that contains a database.

[1580] Software: Software that implements voice recognition technology, emotion engines, UI adaptation algorithms, etc.

[1581] Prompt Sentence Examples

[1582] The user inputs the operation information of "New Robot XYZ123". Send the robot's operation status and maintenance records to the server.

[1583] The user enters "Event A budget data." The system aggregates the income and expenditure data and automatically generates a budget report.

[1584] Record audio data during meetings, send it to a server, and automatically generate meeting minutes using speech recognition technology.

[1585] Users get frustrated with a lot of data entry, so be aware of this and simplify your interface.

[1586] This will improve the efficiency of robot operation and management within factories, make work easier for employees, and reduce stress when operating them.

[1587] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1588] Step 1:

[1589] The user uses the terminal to input robot information (e.g., operating status, maintenance records).

[1590] Input: The user enters information such as "Robot A's operating status" into a form on the terminal.

[1591] Specific actions: The user enters information into the appropriate fields on the device interface and presses the "Submit" button.

[1592] Output: The entered robot information is sent from the terminal to the server.

[1593] Step 2:

[1594] The server stores the received robot information in a database.

[1595] Input: Robot information sent from the device.

[1596] Specific operation: The server parses the received data, converts it into the appropriate format, and writes it to the database.

[1597] Output: The robot information is saved to the database and a success message is generated.

[1598] Step 3:

[1599] A user uses a terminal to search and update existing robot information.

[1600] Input: The user enters search criteria into the terminal.

[1601] Specific operation: The user enters search criteria, presses the "Search" button, modifies the displayed information as necessary, and presses the "Save" button.

[1602] Output: Updated robot information is sent from the device to the server, where the database is updated.

[1603] Step 4:

[1604] The server stores the updated robot information in a database and displays the new information on the terminal.

[1605] Input: Update data sent from the device.

[1606] Specific operation: The server reflects the received update data in the database and sends the new data to the terminal.

[1607] Output: The terminal displays the new robot information.

[1608] Step 5:

[1609] The user inputs budget data into the input form on the terminal.

[1610] Input: The user enters income and expenditure data such as "maintenance costs" into the input form.

[1611] Specific operation: The user enters income and expenditure data and presses the "Submit" button.

[1612] Output: The entered budget data is sent from the terminal to the server.

[1613] Step 6:

[1614] The server stores the received budget data in a database.

[1615] Input: Budget data sent from the terminal.

[1616] Specific operation: The server parses the received data and writes it to the database.

[1617] Output: The budget data is saved in the database.

[1618] Step 7:

[1619] The server periodically aggregates income and expenditure data from the database and generates budget reports.

[1620] Input: Income and expenditure data stored in the database.

[1621] Specific operation: The server reads the income and expenditure data from the database, performs aggregation processing, and generates a report.

[1622] Output: Generated budget report.

[1623] Step 8:

[1624] The server notifies the user of the generated budget report.

[1625] Input: Generated budget report.

[1626] Specific Actions: The server sends the report to the user via email or notification system.

[1627] Output: The user receives and views the budget report.

[1628] Step 9:

[1629] A user records audio data on a terminal during a conference.

[1630] Input: Audio during the meeting.

[1631] Specific operation: The user uses the device's recording function to record the conference audio.

[1632] Output: Recorded audio data.

[1633] Step 10:

[1634] The terminal transmits the recorded voice data to the server.

[1635] Input: Recorded audio data.

[1636] Specific operation: The device uploads the recorded audio data to the server.

[1637] Output: The audio data is sent to the server.

[1638] Step 11:

[1639] The server automatically generates minutes using voice recognition technology.

[1640] Input: Recorded audio data.

[1641] Specific operation: The server uses a speech recognition engine to analyze the voice data, convert it into text, and generate minutes.

[1642] Output: Auto-generated meeting transcript.

[1643] Step 12:

[1644] The server notifies the user of the generated minutes and allows them to review and modify them.

[1645] Input: Auto-generated meeting minutes.

[1646] Specific operation: The server sends the generated minutes to the user's terminal so that the user can check and modify them.

[1647] Output: An interface is displayed that allows the user to review and modify the minutes.

[1648] Step 13:

[1649] The emotion engine recognizes the user's emotions and stores them in a database.

[1650] Input: Emotional data during user interaction.

[1651] Specific operation: The emotion engine identifies emotions from the user's facial expressions, input speed, etc., and sends the data to the server.

[1652] Output: The recognized emotion data is stored in the database.

[1653] Step 14:

[1654] The server adapts the interface based on the recognized emotion data.

[1655] Input: Recognized emotion data.

[1656] Specific operation: The server analyzes the emotion data, determines how to adapt the interface, and changes the device's UI.

[1657] Output: An adapted interface according to the user's emotion is displayed.

[1658] This will improve the efficiency of the system as a whole in managing robots within factories, make operation easier for users, and reduce stress.

[1659] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1660] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1661] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1662] [Third embodiment]

[1663] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1664] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1665] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1666] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1667] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1668] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1669] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1670] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1671] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1672] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1673] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1674] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1675] This system automates various management and operational tasks to improve the efficiency of neighborhood associations and community associations. The system consists of a server, terminals, and users, each with a specific role.

[1676] Membership Management System

[1677] Enter and save member information

[1678] Users enter their membership information from their terminals, which is then sent to the server, where it is stored in a database.

[1679] Example: When a user enters the name, address, and phone number of a new member, "Yamada Hanako," this information is sent from the terminal to the server and stored in a database.

[1680] Update and view member information

[1681] Users can search for existing membership information through their terminals and update it as needed. The updated data is sent back to the server, which updates the database. The server then displays the new information on the terminal.

[1682] Example: When a user enters a change of address for "Hanako Yamada," the information is sent to the server, the database is updated, and the new address information is then displayed on the device.

[1683] Budget Control System

[1684] Entering and saving budget data

[1685] Users enter their income and expenditure data into a form on their device, which is then sent to the server and stored in a database.

[1686] Example: When a user enters "income and expenditure data for Event A," it is sent to the server and stored in the database.

[1687] Automatic budget report generation and alerts

[1688] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If it detects any abnormal values, it sends an alert to the user.

[1689] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[1690] Environmental Improvement System

[1691] Enter and prioritize issues and requests

[1692] Users input their concerns and requests for environmental improvements from their devices. The information is sent from the device to the server and stored in a database. The server then analyzes it and generates a prioritized list.

[1693] Example: When a user types "faulty street light" into a terminal as a request, it is sent to the server, analyzed, and added to a list of high-priority issues.

[1694] Event Planning System

[1695] Generate and modify event proposals

[1696] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device, allowing them to review and modify them.

[1697] Example: The server analyzes data on past "summer festivals" and proposes to hold a summer festival this year, notifying the user. The user can then modify the date, time, and content.

[1698] Minutes creation system

[1699] Recording meeting audio and automatically generating minutes

[1700] During a meeting, users record audio data on their devices, which is then sent to a server, which uses voice recognition technology to automatically generate minutes.

[1701] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[1702] By using this system, the operation of neighborhood associations and town councils will become much more efficient, and even elderly local residents will be able to manage and operate them more easily. In addition, the information stored in the database will be managed centrally, reducing the risk of fraud and mistakes.

[1703] The processing flow will be explained below.

[1704] Specific processing steps for member management

[1705] New member registration

[1706] Step 1:

[1707] The user enters the new member's information (name, address, contact information, etc.) into the form on the terminal.

[1708] Step 2:

[1709] The terminal transmits the input information to the server.

[1710] Step 3:

[1711] The server saves the received membership information in the database.

[1712] Step 4:

[1713] The server returns a confirmation message to the terminal that the save has been completed.

[1714] Update your membership information

[1715] Step 1:

[1716] The user uses the search function on the device to select the membership information they want to update.

[1717] Step 2:

[1718] The terminal retrieves existing member information from the server and displays it.

[1719] Step 3:

[1720] The user uses the terminal to modify the membership information and confirm the changes.

[1721] Step 4:

[1722] The terminal sends the modified information to the server.

[1723] Step 5:

[1724] The server updates the existing record in the database with the received information.

[1725] Step 6:

[1726] The server returns a confirmation message to the terminal that the update is complete.

[1727] Specific processing steps for budget control

[1728] Entering and saving accounting data

[1729] Step 1:

[1730] The user enters income and expenditure data into a form on the terminal.

[1731] Step 2:

[1732] The terminal transmits the input balance data to the server.

[1733] Step 3:

[1734] The server stores the received income and expenditure data in a database.

[1735] Automatic budget report generation and alerts

[1736] Step 1:

[1737] The server periodically (e.g., at the end of each month) retrieves income and expenditure data from the database and aggregates it.

[1738] Step 2:

[1739] The server automatically generates budget reports.

[1740] Step 3:

[1741] The server generates a budget report and sends it to the user via email or notification.

[1742] Step 4:

[1743] The server analyzes the income and expenditure data and detects abnormal values ​​and fraud.

[1744] Step 5:

[1745] If the server detects abnormal values ​​or irregularities, it will send an alert notification to the user.

[1746] Specific steps for environmental improvement

[1747] Entering and processing issues and requests

[1748] Step 1:

[1749] The user enters issues and requests regarding environmental improvements into a form on the device.

[1750] Step 2:

[1751] The device sends the input tasks and requests to the server.

[1752] Step 3:

[1753] The server stores the received data in a database.

[1754] Step 4:

[1755] The server analyzes the stored data and prioritizes it based on urgency and importance.

[1756] Step 5:

[1757] The server generates a prioritized list and notifies the user.

[1758] Specific process steps for event planning

[1759] Generate and modify event proposals

[1760] Step 1:

[1761] The server collects and analyzes past event data.

[1762] Step 2:

[1763] The server automatically generates new event suggestions based on the analysis results.

[1764] Step 3:

[1765] The server sends the generated event proposal to the terminal and notifies the user.

[1766] Step 4:

[1767] The user uses the device to check the proposal.

[1768] Step 5:

[1769] The user modifies the proposed content and presses the confirm button.

[1770] Step 6:

[1771] The device sends the modifications to the server.

[1772] Step 7:

[1773] The server updates the database with the received modifications.

[1774] Specific process steps for creating meeting minutes

[1775] Recording meeting audio and generating meeting minutes

[1776] Step 1:

[1777] During a conference, a user uses a terminal to record voice data.

[1778] Step 2:

[1779] The terminal transmits the recorded voice data to the server.

[1780] Step 3:

[1781] The server analyzes the audio data and automatically generates minutes as text data.

[1782] Checking and correcting the minutes

[1783] Step 1:

[1784] The server sends the generated minutes to the terminal and notifies the user.

[1785] Step 2:

[1786] The user uses the terminal to check the minutes.

[1787] Step 3:

[1788] The user edits the minutes and presses the confirm button.

[1789] Step 4:

[1790] The device sends the modifications to the server.

[1791] Step 5:

[1792] The server updates the database with the received modifications.

[1793] These are the specific processing steps for each system. This not only improves the efficiency of the operation of neighborhood associations, but also reduces the risk of fraud and mistakes by centralizing information management.

[1794] Example 1

[1795] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1796] In running a neighborhood association or community association, managing member information and budget data, processing requests for environmental improvements, planning events, and creating meeting minutes requires a great deal of time and effort. Much of this work is done manually, and there is a high risk of errors and fraud. The goal of this invention is to centralize and automate these management tasks, thereby significantly improving operational efficiency.

[1797] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1798] In this invention, the server includes a first means for inputting member information, a second means for saving the input member information in a database, a third means for displaying and updating the saved member information, a fourth means for inputting budget data, a fifth means for aggregating the input budget data and automatically generating a report, a sixth means for notifying the user of the generated report, a seventh means for inputting issues and requests regarding environmental improvement, an eighth means for prioritizing the input information, a ninth means for analyzing past event data and automatically generating event proposals, a tenth means for recording audio data of meetings, an eleventh means for analyzing the recorded audio data and automatically generating minutes, and a twelfth means for allowing the user to review and modify the generated minutes. This significantly reduces the effort and errors involved in running a neighborhood association and enables efficient and accurate operation.

[1799] "Member information" refers to personal information such as the names, addresses, and telephone numbers of members of neighborhood associations and local councils.

[1800] "Database" refers to a system that systematically stores and manages information such as member information, budget data, environmental improvement requests, event data, and meeting minutes.

[1801] "Budget data" refers to detailed data on the income and expenditures of neighborhood associations and town councils.

[1802] A "report" refers to a document that shows the income and expenditure status and budget usage status generated based on input budget data.

[1803] "Environmental improvement" refers to the maintenance and improvement of local public facilities and infrastructure.

[1804] "Requests" refer to issues and requests regarding environmental improvement submitted by local residents.

[1805] "Event proposal" refers to a new event plan generated by analyzing past event data.

[1806] "Audio data" refers to audio information recorded during a conference or meeting.

[1807] "Minutes" refers to a document that records what was discussed and what decisions were made at a conference or meeting.

[1808] A "generative AI model" refers to an artificial intelligence model that generates results or suggestions based on specific prompts.

[1809] A "prompt" is a document that is input to a generative AI model in the form of an instruction or question.

[1810] MODE FOR CARRYING OUT THE INVENTION

[1811] This system is designed primarily to streamline the management of neighborhood associations and community groups, and consists of a server, terminals, and users, each with a specific role, automating the following management and operation tasks:

[1812] Hardware and software used

[1813] Server: Database management system (DBMS) such as MySQL or PostgreSQL, HTTP server (Apache, Nginx)

[1814] Devices: PC, smartphone, tablet

[1815] User interface: HTML, JavaScript

[1816] Speech recognition technology: Google Speech-to-Text API, Amazon Transcribe

[1817] Generative AI models: OpenAI GPT-3, etc.

[1818] Membership Management System

[1819] Enter and save member information

[1820] The user uses a terminal to input membership information (such as name, address, and phone number). The terminal sends the input information to the server in JSON format. The server analyzes the received information and stores it in a database such as MySQL or PostgreSQL.

[1821] Example: A user enters information about a new member, "Yamada Hanako," and the terminal sends this information to the server and stores it in the database.

[1822] Update and view member information

[1823] The user uses the device to search for existing membership information and make any necessary changes. The changed information is then sent back to the server in JSON format, where it updates the database. The server then displays the new information on the device.

[1824] Example: A user changes the address of "Yamada Hanako," sends the information from the terminal to the server, and the database is updated.

[1825] Budget Control System

[1826] Entering and saving budget data

[1827] The user enters income and expenditure data into a form on the device, which is then sent to the server in JSON format and stored in a database.

[1828] Example: A user enters "income and expenditure data for Event A," which is sent to the server and stored in the database.

[1829] Automatic budget report generation and alerts

[1830] The server periodically compiles income and expenditure data and automatically generates budget reports. If an abnormal value is detected, an alert is sent to the user's device.

[1831] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[1832] Environmental Improvement System

[1833] Enter and prioritize issues and requests

[1834] Users use their devices to input their environmental problems and requests, which are then sent to a server where they are stored in a database. The server then analyzes the information and generates a prioritized list.

[1835] Example: A user types "faulty street light" into a terminal as a request, which is sent to the server, analyzed, and added to a list of high-priority issues.

[1836] Event Planning System

[1837] Generate and modify event proposals

[1838] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device for confirmation and modification.

[1839] Example: The server analyzes data on past "summer festivals" and suggests holding a summer festival this year. The server notifies the user and allows the user to change the date, time, and content.

[1840] Minutes creation system

[1841] Recording meeting audio and automatically generating minutes

[1842] During a meeting, users record audio data on their devices, which is then sent to a server that uses voice recognition technology to automatically generate minutes.

[1843] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[1844] Prompt Sentence Examples

[1845] 1. "How do I enter new membership information?"

[1846] 2. "How do I enter my income and expenditure data?"

[1847] 3. "How do I request a street light malfunction?"

[1848] By utilizing this system, a wide range of tasks related to the management of neighborhood associations and town councils can be carried out efficiently and accurately.

[1849] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1850] Membership management system processing flow

[1851] Enter and save member information

[1852] Step 1:

[1853] The user enters new member information (name, address, phone number, etc.) into a form on the device. The form is created using HTML and JavaScript.

[1854] Input: Member information (e.g. "Yamada Hanako")

[1855] Output: The information entered

[1856] Step 2:

[1857] The terminal converts the entered member information into JSON format and sends it to the server using an HTTP POST request.

[1858] Input: JSON data of entered member information (e.g., {"name": "Yamada Hanako", "address": "Tokyo", "phone": "090-1234-5678"})

[1859] Output: Request sent to server

[1860] Step 3:

[1861] The server parses the received JSON data and stores it in a database, using MySQL or PostgreSQL.

[1862] Input: JSON data received from the terminal

[1863] Data processing: Generate SQL query (INSERT INTO members (name, address, phone) VALUES ('Hanako Yamada', 'Tokyo', '090-1234-5678'))

[1864] Output: Save to database

[1865] Update and view member information

[1866] Step 1:

[1867] The user uses the terminal to search for existing member information and enter the parts to be corrected.

[1868] Input: Member information to search (e.g., "Yamada Hanako"), correction details (e.g., change of address)

[1869] Output: Corrections entered

[1870] Step 2:

[1871] The device converts the modified information into JSON format and sends it to the server using an HTTP PUT request.

[1872] Input: JSON data of the corrected member information (e.g., {"name": "Yamada Hanako", "address": "Osaka Prefecture", "phone": "090-1234-5678"})

[1873] Output: Request sent to server

[1874] Step 3:

[1875] The server parses the received JSON data and generates the appropriate SQL queries to update the database.

[1876] Input: JSON data received from the terminal

[1877] Data processing: Generate SQL query (UPDATE members SET address='Osaka Prefecture' WHERE name='Yamada Hanako')

[1878] Output: Database update

[1879] Step 4:

[1880] The server retrieves the updated member information again and displays it on the terminal.

[1881] Input: Acquire corrected member information

[1882] Output: Send and display updates to the terminal

[1883] Budget control system processing flow

[1884] Entering and saving budget data

[1885] Step 1:

[1886] The user enters income and expenditure data into a form on the terminal.

[1887] Input: Income and expenditure data (e.g., "Event A Income and Expenditure")

[1888] Output: The input data

[1889] Step 2:

[1890] The terminal converts the entered income and expenditure data into JSON format and sends it to the server using an HTTP POST request.

[1891] Input: JSON data of income and expenditure data

[1892] Output: Request sent to server

[1893] Step 3:

[1894] The server parses the received JSON data and stores it in a database.

[1895] Input: JSON data received from the terminal

[1896] Data manipulation: Generate SQL queries (INSERT INTO budget (event, revenue, expense) VALUES (...))

[1897] Output: Save to database

[1898] Automatic budget report generation and alerts

[1899] Step 1:

[1900] The server periodically compiles income and expenditure data from the database and automatically generates reports.

[1901] Input: Database income and expenditure data

[1902] Data calculation: Aggregation processing (calculation of total income, total expenditure, budget status)

[1903] Output: Generated budget report

[1904] Step 2:

[1905] The server notifies the user of the generated report and sends an alert if anomalies are detected.

[1906] Input: Generated budget reports and alert information

[1907] Output: Notifying and alerting users

[1908] Environmental improvement system processing flow

[1909] Enter and prioritize issues and requests

[1910] Step 1:

[1911] Users input problems and requests regarding environmental improvements from their terminals.

[1912] Input: Issue or request details (e.g., "Street light malfunction")

[1913] Output: The input request

[1914] Step 2:

[1915] The device converts the input request into JSON format and sends it to the server using an HTTP POST request.

[1916] Input: JSON data of the request content

[1917] Output: Request sent to server

[1918] Step 3:

[1919] The server analyzes the incoming requests, generates a prioritized list, and stores it in a database.

[1920] Input: JSON data received from the terminal

[1921] Data calculation: Priority calculation (considering urgency and importance)

[1922] Output: Save the generated priority list

[1923] Event planning system processing flow

[1924] Generate and modify event proposals

[1925] Step 1:

[1926] The server analyzes past event data and automatically generates suggestions for new events.

[1927] Input: Past event data

[1928] Data calculation: analytical processing (pattern matching, trend analysis)

[1929] Output: Generated event suggestions

[1930] Step 2:

[1931] The suggestions are notified to the user via the terminal, and the user can confirm and correct them.

[1932] Input: Generated event suggestions

[1933] Output: User notification and revised proposed data

[1934] Processing flow of the minutes creation system

[1935] Recording meeting audio and automatically generating minutes

[1936] Step 1:

[1937] During a conference, a user records audio data using a terminal.

[1938] Input: Audio data (speech during a meeting)

[1939] Output: Recorded audio data

[1940] Step 2:

[1941] The recorded voice data is transmitted from the terminal to the server.

[1942] Input: Recorded audio data

[1943] Output: Send data to the server

[1944] Step 3:

[1945] The server analyzes the voice data and automatically generates minutes using voice recognition technology.

[1946] Input: Audio data received from the device

[1947] Data calculation: Speech recognition processing (Google Speech-to-Text API, etc.)

[1948] Output: Generated meeting minutes

[1949] Step 4:

[1950] The user can check the generated minutes and correct any errors.

[1951] Input: Generated minutes

[1952] Output: Display of minutes to user and modified minutes data

[1953] (Application example 1)

[1954] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1955] To streamline the operations of neighborhood associations and community groups, it is necessary to automate various tasks, such as managing member information, budget management, maintenance information management, and meeting records. Similarly, efficiency is also required for the maintenance and management of robots in factories. However, performing these tasks manually requires a great deal of time and effort, resulting in problems of decreased efficiency and human error.

[1956] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1957] In this invention, the server includes means for inputting member information, means for saving the input member information in a database, means for displaying and updating the saved member information, means for inputting robot maintenance information, means for saving the input maintenance information in a database, means for inputting budget data, means for aggregating the input budget data and automatically generating a report, and means for notifying the user of the generated report. This makes management tasks in neighborhood associations and factories more efficient, saving time and effort and reducing errors.

[1958] "Member Information" refers to data related to a User, such as personal information and contact information.

[1959] "Maintenance Information" refers to details and records relating to the maintenance of robots and equipment.

[1960] "Database" refers to a system for efficiently and securely storing and managing data.

[1961] "Budget data" refers to information relating to income and expenditure and details of expenses.

[1962] A "report" refers to a document that compiles data and summarizes the results of analysis.

[1963] A "server" refers to a computer system that centralizes data processing and storage.

[1964] "Means" refers to a process or device for achieving a specific function or task.

[1965] "Input" refers to the act of a user registering data or information into the system.

[1966] "Storage" refers to storing and preserving input data in a database.

[1967] "Display" refers to showing the stored data to the user.

[1968] "Update" refers to replacing existing data with new information.

[1969] "User" means any person or entity that operates and uses the System.

[1970] This invention is a system for streamlining administrative tasks for neighborhood associations, town associations, factories, etc., and is comprised of a server, terminals, and users. This system automates member information management, budget management, maintenance information management, event planning, and the creation of meeting minutes. Specific embodiments of this system are described below.

[1971] Membership Information Management System

[1972] The server is responsible for saving the member information entered by the user from the terminal in a database. The user can enter new member information or update existing member information through the input screen on the terminal. For example, the user can enter information such as the name, address, and phone number of a new member. The saved information is stored in the database by the server and can be displayed or edited as needed.

[1973] Budget Control System

[1974] The server stores the income and expenditure data entered by the user from the terminal in a database. The server also aggregates this data and automatically generates a budget report. The server notifies the user of this generated report. For example, at the end of the month, the server aggregates the income and expenditure data and sends the automatically generated budget report to the user by email. If any unclear expenditures are discovered, an alert is displayed to the user.

[1975] Maintenance Information Management System

[1976] Maintenance information for robots and equipment in factories is entered by users using terminals. The entered maintenance information is sent to a server and stored in a database. Based on this information, the server can automatically determine the priority of maintenance and display it to the user. For example, if a user enters "daily inspection results for robot A," the information is sent and stored on the server, and then displayed on the terminal.

[1977] Event Planning System

[1978] The server analyzes past event data and automatically generates proposals for new events. These proposals are notified to the user via their device, allowing them to confirm and modify them. For example, the server can analyze past "summer festival" data and propose a new summer festival. The user receives a notification and can modify the date, time, and content.

[1979] Minutes creation system

[1980] During a meeting, users use their devices to record the audio of the meeting. The recorded audio data is sent to a server, which then uses voice recognition technology to automatically generate minutes. The generated minutes can be viewed on the device, and the user can make any corrections. For example, after the meeting ends, the server automatically generates minutes from the audio data, and the user can review them on the device and correct any errors.

[1981] The system is written in Python and uses Flask as the server-side framework, with a SQLite database for data storage.

[1982] As a specific example, the system can perform a specific task by using the prompt sentence, "Please record the results of the daily inspection of Robot A. Enter the following information for future maintenance management: Robot ID: robot_A, Detailed information: Daily inspection successful, Date and time: 2023-10-01T08:00:00. Please save this information in the system."

[1983] This will streamline various management tasks within neighborhood associations, town halls, and factories, saving time and effort and reducing errors.

[1984] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1985] Step 1:

[1986] The user enters member information, maintenance information, or budget data on the input screen of the terminal. The entered data is sent to the server as an HTTP request. In this step, member information such as name, address, and phone number, robot maintenance information, and budget data are received as input data. The input data is sent to the server as output.

[1987] Step 2:

[1988] The server analyzes the received HTTP request and converts the data into the appropriate format. In this step, data processing is performed to convert the raw data entered by the user into the data format used internally. For example, date and number formats are checked and completed. The input is the raw data sent by the user, and the output is the converted data.

[1989] Step 3:

[1990] The server saves the formatted data to a SQLite database. In this step, a save SQL query is generated and executed against the database. As input, it has the formatted data, and as output, it persists this data to the database.

[1991] Step 4:

[1992] The server periodically aggregates financial data and maintenance information from the database to automatically generate budget reports and maintenance priority lists. In this step, SQL aggregation queries are executed and the results are generated as reports and lists. The input is the financial data and maintenance information in the database, and the output is the aggregated budget report or maintenance priority list.

[1993] Step 5:

[1994] The server notifies the user of the generated report or list. This notification can be done by sending an email or a push notification to the app. In this step, a notification message is generated and sent by an appropriate means based on the user's contact information. The inputs are the generated report or list and the user's contact information, and the output is a notification sent to the user.

[1995] Step 6:

[1996] The user checks the reports and lists on the terminal and makes any necessary corrections. The corrected content is sent back to the server and the database is updated. In this step, the user edits the displayed data and sends it to the server. The input is the data corrected by the user, and the output is the database update.

[1997] Step 7:

[1998] During a meeting, the user records voice data on their device and sends it to the server. The server uses voice recognition technology to analyze the voice data and automatically generate minutes. In this step, a data calculation is performed to convert the voice data into text data. The input is the voice data sent by the user, and the output is the automatically generated minutes in text format.

[1999] Step 8:

[2000] The server sends the automatically generated minutes to the user, allowing them to check and modify them on their terminal. Finally, the modified minutes are saved back to the database. In this step, the database is updated after the modifications are sent by the user. The input is the minutes data modified by the user, and the output is the final update to the database.

[2001] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[2002] This system combines member management, budget management, automatic generation of meeting minutes, and an emotion engine that recognizes user emotions in order to streamline the management of neighborhood associations and community associations. A specific embodiment of this system will be described below.

[2003] Membership Management System

[2004] Enter and save member information

[2005] The user enters the new member's information (name, address, contact details, etc.) into a form on the terminal. The entered information is sent from the terminal to the server, which then stores it in a database.

[2006] Example: When a user enters information about "New Member Yamada Hanako," this information is sent from the terminal to the server and stored in the database.

[2007] Update and view member information

[2008] Users can search for existing membership information through their terminals and update it as necessary. The updated data is sent back to the server, which updates the database. The server then displays the new information on the terminal.

[2009] Example: When a user enters a change of address for "Hanako Yamada," the information is sent to the server, the database is updated, and the new address information is then displayed on the device.

[2010] Budget Control System

[2011] Entering and saving budget data

[2012] Users enter their income and expenditure data into a form on their device, which is then sent to the server and stored in a database.

[2013] Example: When a user enters "income and expenditure data for Event A," it is sent to the server and stored in the database.

[2014] Automatic budget report generation and alerts

[2015] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If it detects any abnormal values, it sends an alert to the user.

[2016] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[2017] Environmental Improvement System

[2018] Entering and processing issues and requests

[2019] Users enter their environmental improvement issues and requests into a form on their device. The information is sent from the device to the server and stored in a database. The server then analyzes the information and generates a prioritized list.

[2020] Example: When a user types "faulty street light" into a terminal as a request, it is sent to the server, analyzed, and added to a list of high-priority issues.

[2021] Event Planning System

[2022] Generate and modify event proposals

[2023] The server collects and analyzes past event data, and automatically generates new event suggestions based on the analysis results. The suggestions are sent to the user via their device, allowing them to review and modify them.

[2024] Example: The server analyzes data on past "summer festivals" and proposes to hold a summer festival this year, notifying the user. The user can then modify the date, time, and content.

[2025] Minutes creation system

[2026] Recording meeting audio and generating meeting minutes

[2027] During a meeting, users record audio data on their devices, which is then sent to a server, which uses voice recognition technology to automatically generate minutes.

[2028] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[2029] Emotion engine integration

[2030] User Emotion Recognition

[2031] The emotion engine recognizes emotions (e.g., joy, anger, sadness, etc.) when a user inputs something on the device. The recognized emotion data is sent from the device to the server.

[2032] Example: If a user is feeling frustrated and inputting a large amount of data, the emotion engine will recognize the frustration and send it as data to the server.

[2033] Interface Adaptation

[2034] The server dynamically adapts the user's interface based on the recognized emotion data, for example simplifying the interface if the user is feeling stressed.

[2035] Example: When the emotion engine recognizes the user's stress, the server simplifies the interface by reducing confirmation messages, etc.

[2036] Storing and using emotional data

[2037] The server stores the emotion data in a database and uses it for future analysis and interface adjustments.

[2038] Example: The server analyzes previously recognized emotional data and suggests ways to reduce the user's operational stress.

[2039] This system not only streamlines the management of neighborhood associations and community groups, but also provides an interface that takes users' emotions into consideration, making it easier for even elderly local residents to manage and operate the associations.In addition, the information stored in the database is managed centrally, reducing the risk of fraud and errors.

[2040] The processing flow will be explained below.

[2041] Specific processing steps of the system based on the combination of emotion engines

[2042] Membership Management System

[2043] Step 1:

[2044] The user enters the new member's information (name, address, contact information, etc.) into the form on the terminal.

[2045] Step 2:

[2046] The terminal transmits the input information to the server.

[2047] Step 3:

[2048] The server saves the received membership information in the database.

[2049] Step 4:

[2050] The server returns a confirmation message to the terminal that the save has been completed.

[2051] Update your membership information

[2052] Step 1:

[2053] The user uses the search function on the device to select the membership information they want to update.

[2054] Step 2:

[2055] The terminal retrieves existing member information from the server and displays it.

[2056] Step 3:

[2057] The user uses the terminal to modify the membership information and confirm the changes.

[2058] Step 4:

[2059] The terminal sends the modified information to the server.

[2060] Step 5:

[2061] The server updates the existing record in the database with the received information.

[2062] Step 6:

[2063] The server returns a confirmation message to the terminal that the update is complete.

[2064] Budget Control System

[2065] Step 1:

[2066] The user enters income and expenditure data into a form on the terminal.

[2067] Step 2:

[2068] The terminal transmits the input balance data to the server.

[2069] Step 3:

[2070] The server stores the received income and expenditure data in a database.

[2071] Automatic generation of budget reports

[2072] Step 1:

[2073] The server periodically (e.g., at the end of each month) retrieves income and expenditure data from the database and aggregates it.

[2074] Step 2:

[2075] The server automatically generates budget reports.

[2076] Step 3:

[2077] The server sends the generated budget report to the user via email or notification.

[2078] Anomaly detection and alerting

[2079] Step 1:

[2080] The server analyzes the income and expenditure data and detects abnormal values ​​and fraud.

[2081] Step 2:

[2082] If the server detects abnormal values ​​or irregularities, it will send an alert notification to the user.

[2083] Environmental Improvement System

[2084] Step 1:

[2085] The user enters issues and requests regarding environmental improvements into a form on the device.

[2086] Step 2:

[2087] The device sends the input tasks and requests to the server.

[2088] Step 3:

[2089] The server stores the received data in a database.

[2090] Step 4:

[2091] The server analyzes the stored data and prioritizes it based on urgency and importance.

[2092] Step 5:

[2093] The server generates a prioritized list and notifies the user.

[2094] Event Planning System

[2095] Step 1:

[2096] The server collects and analyzes past event data.

[2097] Step 2:

[2098] The server automatically generates new event suggestions based on the analysis results.

[2099] Step 3:

[2100] The server sends the generated event proposal to the terminal and notifies the user.

[2101] Step 4:

[2102] The user uses the device to check the proposal.

[2103] Step 5:

[2104] The user modifies the proposed content and presses the confirm button.

[2105] Step 6:

[2106] The device sends the modifications to the server.

[2107] Step 7:

[2108] The server updates the database with the received modifications.

[2109] Minutes creation system

[2110] Step 1:

[2111] During a conference, a user uses a terminal to record voice data.

[2112] Step 2:

[2113] The terminal transmits the recorded voice data to the server.

[2114] Step 3:

[2115] The server analyzes the audio data and automatically generates minutes as text data.

[2116] Checking and correcting the minutes

[2117] Step 1:

[2118] The server sends the generated minutes to the terminal and notifies the user.

[2119] Step 2:

[2120] The user uses the terminal to check the minutes.

[2121] Step 3:

[2122] The user edits the minutes and presses the confirm button.

[2123] Step 4:

[2124] The device sends the modifications to the server.

[2125] Step 5:

[2126] The server updates the database with the received modifications.

[2127] Emotion engine integration

[2128] User Emotion Recognition

[2129] Step 1:

[2130] When a user inputs information into the device, the emotion engine identifies the user's emotions (e.g., joy, anger, sadness, etc.) in real time.

[2131] Step 2:

[2132] The emotion data recognized by the emotion engine is sent from the terminal to the server.

[2133] Step 3:

[2134] The server stores the received emotion data in a database.

[2135] Interface Adaptation

[2136] Step 1:

[2137] The server analyzes the recognized emotion data.

[2138] Step 2:

[2139] The server dynamically adapts the user's operation interface based on the analysis results.

[2140] Step 3:

[2141] The terminal displays the adapted interface to the user.

[2142] Storing and using emotional data

[2143] Step 1:

[2144] The server accumulates past emotional data and stores it in a database.

[2145] Step 2:

[2146] The server analyzes the accumulated emotional data and uses it to improve the system in the future.

[2147] Step 3:

[2148] Based on the analysis results, the server proposes optimized interfaces and operating procedures for the user.

[2149] These are the specific processing steps for each system. This not only improves the efficiency of neighborhood association and community management, but also provides an interface that takes user feelings into consideration. This makes it easier for even elderly local residents to manage and operate the system. In addition, the information stored in the database is managed centrally, reducing the risk of fraud and errors.

[2150] Example 2

[2151] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2152] In conventional membership management systems, budget management systems, and automated meeting minutes systems, each function is separate and not integrated, which means users have to operate different systems separately, which is inconvenient. Furthermore, the lack of interface adjustments or stress reduction features that respond to the user's emotions during operation makes it difficult to improve the user experience. Furthermore, prioritization of environmental improvement issues and requests is often done manually. Therefore, there is a need for a system that can streamline the management of neighborhood associations and town councils and is easier to use.

[2153] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2154] In this invention, the server includes: means for inputting member information, means for saving the input member information in a database, means for displaying and updating the saved member information, means for inputting income and expenditure data, means for saving the income and expenditure data in a database, means for periodically aggregating the income and expenditure data and automatically generating a budget report, means for notifying the user of the generated budget report, means for recording conference audio data, means for analyzing the recorded audio data and automatically generating minutes, means for allowing the user to confirm and modify the generated minutes, means for recognizing the user's emotions, means for dynamically adapting the user interface based on the recognized emotion data, and means for saving the emotion data in a database and using it for future analysis and interface adjustment. This enables centralized operation with each function integrated and provides an interface that takes user emotions into consideration, thereby enabling a system that is easy to use for local residents, including the elderly.

[2155] The "means for inputting member information" is an interface for inputting information about new members using a terminal.

[2156] "Means for saving input member information in a database" is a function by which the server stores input member information in a database.

[2157] "Means for viewing and updating stored member information" refers to a function that allows users to search, view, and modify stored member information.

[2158] The "means for inputting balance data" is an interface for inputting balance data from a terminal.

[2159] The "means for saving balance data in a database" is a function by which the server stores the input balance data in a database.

[2160] The "means for periodically aggregating income and expenditure data and automatically generating a budget report" is a function in which the server aggregates income and expenditure data at regular intervals and automatically generates a budget report.

[2161] The "means for notifying the user of the generated budget report" is a function by which the server notifies the user of the generated budget report.

[2162] The "means for recording conference audio data" is an interface for recording audio during a conference on a terminal.

[2163] The "means for analyzing the recorded voice data and automatically generating minutes" is a function in which the server analyzes the recorded voice data and automatically generates minutes in text format.

[2164] The "means for enabling a user to check and modify the generated minutes" is a function that allows a user to check the automatically generated minutes and modify them as necessary.

[2165] The "means for recognizing user emotions" is an engine for recognizing the emotions felt by the user in real time during operation.

[2166] The "means for dynamically adapting the user interface based on the recognized emotion data" is a function that allows the server to change the interface based on the recognized emotion data.

[2167] "Means for storing emotion data in a database and using it for future analysis and interface adjustment" is a function in which the server stores the recognized emotion data in a database and uses it later for analysis and interface optimization.

[2168] The present invention is an integrated system for streamlining the management of neighborhood associations and community groups, and includes functions for member management, budget management, automatic generation of meeting minutes, and user emotion recognition. How each function is implemented will be explained in detail below.

[2169] Membership Management System

[2170] Enter and save member information

[2171] The user enters new member information into a form on the device. The device sends the entered information in JSON format to the server. The server generates an SQL query to save the received data to the database, connects to the database, and executes it. After the process is complete, the server sends a message to the device indicating that the save has been completed, and the device displays it to the user.

[2172] Example: When a user enters information for a new member, "Hanako Yamada," the device converts the information into JSON data and sends it to the server. The server generates and executes the SQL query "INSERT INTO members (name, address, contact) VALUES ('Hanako Yamada', 'Address', 'Contact Information')" and saves it in the database. After that, the device displays the message "Member information saved."

[2173] Update and view member information

[2174] Users search for existing membership information through their device and update it as necessary. The device sends a search query to the server, which queries the database to obtain the results and sends them to the device. The user checks the displayed information, makes any necessary updates, and sends the updates from the device to the server. The server updates the database and sends a completion message to the device.

[2175] Example: When a user changes the address of "Yamada Hanako," the terminal sends the query "SELECT FROM members WHERE name="Yamada Hanako"" to the server, and the server retrieves the relevant information from the database and sends it to the terminal. After the user enters the new address, the terminal sends the query "UPDATE members SET address="new address" WHERE name="Yamada Hanako"" to the server, and the server executes the query and updates the database. The updated information is then displayed on the terminal.

[2176] Budget Control System

[2177] Entering and saving budget data

[2178] The user enters the balance data into a form on the terminal. The terminal sends the data to the server, which then generates and executes an SQL query to save the balance data in a database. After the process is complete, the server sends a message to the terminal indicating that the data has been saved, and the terminal displays the message to the user.

[2179] Example: When a user enters "income and expenditure data for event A," the terminal sends it to the server, which then generates and executes the SQL query "INSERT INTO budget (event, income, expense) VALUES ('event A', 'income', 'expense')" and saves it in the database. After that, the terminal displays the message "Income and expenditure data saved."

[2180] Automatic budget report generation and alerts

[2181] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If an abnormal value is detected, the server generates an alert message and notifies the user. The user can check the alert message on their device.

[2182] Example: At the end of the month, the server executes the query "SELECT SUM(income), SUM(expense) FROM budget WHERE month=current_month" to aggregate income and expenditure data. Based on the aggregated results, a budget report is generated and sent to the user by email. If an unclear expenditure is detected, an alert message stating "An abnormal expenditure has been detected" is generated and sent to the terminal.

[2183] Meeting minutes creation system

[2184] Recording meeting audio and generating meeting minutes

[2185] During a meeting, users record audio data on their devices. The recorded audio data is then sent from the device to a server, which uses voice recognition technology to convert the audio data into text data and automatically generate minutes. The generated minutes can then be viewed and edited by the user.

[2186] Example: During a meeting, a user records voice data on their device and sends it to a server. The server uses speech recognition technology (e.g., Microsoft Azure Speech API) to convert the voice data into text and automatically generates minutes. The minutes are then sent to the user, who can review them and make any necessary corrections.

[2187] Emotion engine integration

[2188] User Emotion Recognition

[2189] When a user inputs information into the device, the emotion engine recognizes the user's emotions in real time, and the recognized emotion data is sent from the device to the server.

[2190] Example: When a user is entering a large amount of data, if an emotion of dissatisfaction is recognized, the emotion engine sends the data to the server.

[2191] Interface Adaptation

[2192] The server analyzes the received emotional data and sends instructions to the device to adjust the interface according to the emotional state. The device then dynamically changes the interface based on the instructions.

[2193] Example: When the emotion engine recognizes the user's stress state, the server sends instructions such as "reduce confirmation messages" to the device, and the device simplifies the interface based on the instructions.

[2194] Storing and using emotional data

[2195] The server stores the recognized emotion data in a database, which can be used for future analysis and interface adjustments.

[2196] Example: The server generates the SQL query "INSERT INTO emotion_data (timestamp, emotion) VALUES ('current time', 'recognized emotion')" and saves the emotion data in the database. It analyzes the saved data and makes suggestions for improving the interface to reduce user operational stress in the future.

[2197] Usage example

[2198] Examples of prompts input to the generative AI model include "Please enter the name of the new member" or "Please enter income and expenditure data." Based on this, the device issues appropriate instructions to the user, and the server processes the data on the backend.

[2199] As described above, this invention can significantly improve user convenience by integrating member management, budget management, automatic generation of meeting minutes, and user emotion recognition. By enabling centralized operation with each function integrated and providing an interface that takes user emotions into consideration, it is possible to realize a system that is easy to use, especially for local residents, including the elderly.

[2200] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2201] Enter and save member information

[2202] Step 1:

[2203] The user enters the new member's information (name, address, contact details, etc.) into the form on the terminal.

[2204] Input: New member information

[2205] Output: Information entered into the terminal

[2206] Specific operation: The user enters "Name: Yamada Hanako, Address: XX town, Contact number: 090-1234-5678" into the form on the terminal.

[2207] Step 2:

[2208] The terminal converts the entered membership information into JSON format and sends it to the server.

[2209] Input: Information entered by the user

[2210] Output: Send JSON format data to the server

[2211] Specific operation: The device generates the JSON data "{"name": "Yamada Hanako", "address": "XX town", "contact": "090-1234-5678"}".

[2212] Step 3:

[2213] The server parses the received JSON data and generates SQL queries to store it in a database.

[2214] Input: JSON data sent from the terminal

[2215] Output: Generated SQL query

[2216] Specific operation: The server generates the SQL query "INSERT INTO members (name, address, contact) VALUES ('Yamada Hanako', 'XX town', '090-1234-5678')".

[2217] Step 4:

[2218] The server connects to the database, executes the generated SQL query, and saves the member information in the database.

[2219] Input: Generated SQL query

[2220] Output: Save information to a database

[2221] Specific operation: The server executes the SQL query and saves Hanako Yamada's information in the "members" table of the database.

[2222] Step 5:

[2223] The server notifies the terminal of the completion of the process, and the terminal displays it to the user.

[2224] Input: Notification of completion of saving to database

[2225] Output: Save completed message to user

[2226] Specific operation: The message "Member information has been saved" will be displayed on the device.

[2227] Update and view member information

[2228] Step 1:

[2229] The user searches for existing membership information through the terminal.

[2230] Input: Search query

[2231] Output: Search results displayed

[2232] Specific operation: When a user searches for information about "Yamada Hanako", the query "SELECT FROM members WHERE name="Yamada Hanako"" is sent.

[2233] Step 2:

[2234] The terminal sends a search query to the server.

[2235] Input: A search request from the user

[2236] Output: Query sent to server

[2237] Specific operation: The terminal sends the query "SELECT FROM members WHERE name="Yamada Hanako"" to the server.

[2238] Step 3:

[2239] The server queries the database and retrieves the results.

[2240] Input: Search query

[2241] Output: Search results

[2242] Specific operation: The server executes an SQL query to obtain information about "Hanako Yamada."

[2243] Step 4:

[2244] The server transmits the acquired data to the terminal.

[2245] Input: Search result data

[2246] Output: Sending data to the terminal

[2247] Specific operation: The server sends the acquired data to the terminal. "Name: Yamada Hanako, Address: XX town, Contact: 090-1234-5678"

[2248] Step 5:

[2249] The device displays the acquired data.

[2250] Input: Data from the server

[2251] Output: Displaying information to the user

[2252] Specific operation: Information about "Yamada Hanako" is displayed on the terminal.

[2253] Step 6:

[2254] The user makes the necessary updates and enters the update data into the terminal.

[2255] Input: Correction information

[2256] Output: Corrected data input to terminal completed

[2257] Specific behavior: The user changes the address to "New Address."

[2258] Step 7:

[2259] The terminal transmits the update data to the server.

[2260] Input: Correction information from the user

[2261] Output: Send corrected data to the server

[2262] Specific operation: The terminal sends the query "UPDATE members SET address="new address" WHERE name="Yamada Hanako"" to the server.

[2263] Step 8:

[2264] The server updates the database with the corrected data.

[2265] Input: SQL query to modify

[2266] Output: Database update

[2267] Specific operation: The server executes an SQL query to update Hanako Yamada's address information.

[2268] Step 9:

[2269] After the server completes the process, it sends a confirmation message to the terminal.

[2270] Input: Database update completion notification

[2271] Output: Notification to terminal

[2272] Specific operation: The message "Member information has been updated" will be displayed on the device.

[2273] Budget Control System

[2274] Step 1:

[2275] The user enters income and expenditure data into a form on the terminal.

[2276] Input: Income and expenditure data

[2277] Output: Data input to terminal completed

[2278] Specific operation: The user inputs "income and expenditure for event A."

[2279] Step 2:

[2280] The terminal transmits the balance data to the server.

[2281] Input: User's income and expenditure data

[2282] Output: Send data to the server

[2283] Specific operation: The terminal sends income and expenditure data in JSON format.

[2284] Step 3:

[2285] The server generates and executes SQL queries to store the balance data in a database.

[2286] Input: JSON data for income and expenditure

[2287] Output: SQL query

[2288] Specific operation: The server generates and executes the SQL query "INSERT INTO budget (event, income, expense) VALUES ('Event A', 'Income', 'Expense')".

[2289] Step 4:

[2290] The server notifies the terminal of the completion of the process, and the terminal displays it to the user.

[2291] Input: Data save completion notification

[2292] Output: A completion message to the user

[2293] Specific operation: The message "Income and expenditure data saved" will be displayed on the device.

[2294] Step 5:

[2295] The server periodically compiles income and expenditure data from the database and automatically generates budget reports.

[2296] Input: Periodic income and expenditure data

[2297] Output: Budget Report

[2298] Specific operation: The server executes "SELECT SUM(income), SUM(expense) FROM budget WHERE date BETWEEN start date AND end date" and automatically generates the aggregated data as a budget report.

[2299] Step 6:

[2300] If the server detects an abnormal value, it generates an alert message and notifies the user.

[2301] Enter: Budget Report

[2302] Output: Alert message

[2303] Specific behavior: The server detects anomalies in the budget report and generates and sends an alert message saying "Unclear expenditure detected."

[2304] Meeting minutes creation system

[2305] Step 1:

[2306] During a conference, a user records audio data on a terminal.

[2307] Input: Audio data

[2308] Output: Recording audio data to the device

[2309] Specific operation: The device records audio data in real time during the meeting.

[2310] Step 2:

[2311] The terminal transmits the recorded voice data to the server.

[2312] Input: Recorded audio data

[2313] Output: Sending audio data to the server

[2314] Specific operation: The device sends the recorded audio data to the server.

[2315] Step 3:

[2316] The server uses voice recognition technology to convert the voice data into text data and automatically generate minutes.

[2317] Input: Audio data

[2318] Output: Text data (minutes)

[2319] What happens: The server uses speech recognition technology (e.g., Microsoft Azure Speech API) to convert the voice data into text.

[2320] Step 4:

[2321] The server sends the generated minutes to the terminal so that the user can check and modify them.

[2322] Input: Generated minutes

[2323] Output: Confirm and correct minutes to the user

[2324] Specific operation: The server sends the generated minutes to the terminal, where the user can check them and make corrections if necessary.

[2325] Emotion engine integration

[2326] Step 1:

[2327] When a user performs input work on the device, the emotion engine recognizes the user's emotions in real time.

[2328] Input: User input behavior and emotions

[2329] Output: Recognized emotion data

[2330] Specific operation: The emotion engine recognizes emotions in real time based on the user's input speed, facial expressions, etc.

[2331] Step 2:

[2332] The recognized emotion data is transmitted from the terminal to the server.

[2333] Input: Recognized emotion data

[2334] Output: Send emotion data to the server

[2335] Specific operation: The device sends emotional data such as "the user is feeling stressed" to the server.

[2336] Step 3:

[2337] The server analyzes the received emotional data and sends instructions to the terminal to adjust the interface.

[2338] Input: Emotion data

[2339] Output: Interface adjustment instructions

[2340] Specific operation: The server analyzes the received emotion data and generates interface adjustment instructions such as "reduce confirmation messages."

[2341] Step 4:

[2342] The terminal dynamically changes the interface based on instructions from the server.

[2343] Input: Instructions from the server

[2344] Output: Interface changes

[2345] Specific actions: The device simplifies or adapts the user interface according to the instructions.

[2346] Step 5:

[2347] The server stores the recognized emotion data in a database for future analysis and interface adjustments.

[2348] Input: Emotion data

[2349] Output: Emotion data saved in a database

[2350] Specific operation: The server generates the SQL query "INSERT INTO emotion_data (timestamp, emotion) VALUES ('current time', 'user emotion')" and saves it in the database. In the future, the emotion data will be analyzed and used to improve the interface.

[2351] These are the specific processing steps of the system that uses membership management, budget management, meeting minutes creation, and an emotion engine. This system will improve the efficiency of neighborhood association management and provide a comfortable interface that takes user emotions into consideration.

[2352] (Application example 2)

[2353] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2354] When managing robots in factories, it is important for employees to efficiently manage the robots' operating status and maintenance records. However, with existing systems, this task is cumbersome and requires a lot of effort and time. Furthermore, budget management and the creation of meeting minutes are also time-consuming, contributing to increased employee stress. Furthermore, there is a lack of a mechanism for adapting the interface to employees' emotions, which leads to reduced operational efficiency and increased stress. Therefore, a new system is needed to improve the efficiency of overall management tasks and reduce the burden on employees.

[2355] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for inputting member information; means for saving the input member information in a database; means for displaying and updating the saved member information; means for inputting robot information and saving operating status and maintenance records in a database; means for inputting budget data; means for aggregating the input budget data and automatically generating a report; means for notifying the user of the generated report; means for recording conference audio data; means for analyzing the recorded audio data and automatically generating minutes; means for allowing the user to confirm and modify the generated minutes; means for recognizing user emotion data; means for saving the recognized emotion data in a database and adapting the interface; and means for changing the interface based on the emotion data. This not only improves the efficiency of robot operation management in factories and automates tasks such as budget management and generating meeting minutes, but also provides an interface that takes employee emotions into consideration, reducing stress and improving operational efficiency.

[2356] "Member information" refers to personal identification information entered by a user, and includes data such as name, address, and contact details.

[2357] A "database" is an organized collection of information, a system that stores input data and allows it to be searched and updated.

[2358] "Robot information" refers to data such as the specific operating status and maintenance records of robots within a factory.

[2359] "Operational status" refers to data that indicates how a machine or system is operating, its current operating status, and operating time.

[2360] "Maintenance records" are historical data of maintenance work on a machine or system, including details of the maintenance work carried out.

[2361] "Budget Data" means the income and expenditure data, details of expenses and revenues relevant to the preparation of a budget.

[2362] A "report" is a report generated based on collected and organized data, and includes analysis and aggregation results.

[2363] "Notification" refers to the sending of a message from the system to the user to notify, warn, or convey information.

[2364] "Audio data" refers to data that includes audio information recorded during a meeting, conversation, or the like.

[2365] Minutes are documents that record the contents of a meeting or discussion, including what was said and what decisions were made.

[2366] "Emotion data" is information that indicates the user's emotional state, and is data that identifies emotions such as stress, joy, and sadness.

[2367] "Interface" refers to the screens and operating means that allow users to directly interact with the system.

[2368] "Adaptation" refers to changing the way a system behaves or displays itself depending on the environment or situation.

[2369] This invention is a system for streamlining the operation and management of robots in factories. This system allows factory managers and employees to easily manage robot operation status and maintenance records, automatically tally budget data, generate meeting minutes, and even adapt the interface based on employee emotions.

[2370] 1. Robot Management System

[2371] 1.1 Entering and saving robot information

[2372] The user uses the terminal interface to input robot information (operating status, maintenance records, etc.), which is then sent from the terminal to the server and stored in a database.

[2373] Example: When a user enters "Operating normally" as the "Operation status of Robot A," the information is sent to the server and stored in the database.

[2374] 1.2 Viewing and updating robot information

[2375] The user uses the device to search for existing robot information and update it as needed. The updated data is sent back to the server, which updates the database. The server then displays the new information on the device.

[2376] Example: When a user updates the maintenance information for "Robot A" to "Replace part X," the information is sent to the server, the database is updated, and the new information is displayed on the terminal.

[2377] 2. Budget Control System

[2378] 2.1 Entering and saving budget data

[2379] The user enters income and expenditure data into an input form on the terminal, which is then sent to the server and stored in a database.

[2380] Example: When a user enters "100,000 yen as maintenance fee," it is sent to the server and saved in the database.

[2381] 2.2 Automatic generation and notification of budget reports

[2382] The server periodically aggregates income and expenditure data from the database, automatically generates budget reports, and sends alerts to users if any abnormal values ​​are detected.

[2383] Example: At the end of the month, the server aggregates income and expenditure data and notifies the user by email of an automatically generated budget report. If any unclear expenditures are found, an alert is displayed to the user.

[2384] 3. Meeting Minutes Creation System

[2385] 3.1 Recording and saving conference audio

[2386] During a conference, users record audio data on their terminals, which are then sent to the server.

[2387] Example: A user records audio on their smartphone during a meeting and uploads the file to a server.

[2388] 3.2 Automatic generation and confirmation of minutes

[2389] The server uses voice recognition technology to automatically generate minutes from the recorded voice data. The generated minutes can then be checked by the user on their device and any errors can be corrected.

[2390] Example: After the meeting ends, the server automatically generates minutes from the audio data and displays them on the user's device. The user can then make any necessary corrections.

[2391] 4. Emotion engine integration

[2392] 4.1 User Emotion Recognition and Interface Adaptation

[2393] The emotion engine recognizes the emotions expressed by the user while operating the device. The recognized emotion data is sent to the server and stored in a database. The server then dynamically adapts the interface based on this information.

[2394] Example: If a user is feeling stressed while entering data, the emotion engine will recognize that stress and the server will simplify the interface by reducing confirmation messages, etc.

[2395] Hardware and software used

[2396] Device: A device such as a smartphone, tablet, or PC.

[2397] Server: A server system that contains a database.

[2398] Software: Software that implements voice recognition technology, emotion engines, UI adaptation algorithms, etc.

[2399] Prompt Sentence Examples

[2400] The user inputs the operation information of "New Robot XYZ123". Send the robot's operation status and maintenance records to the server.

[2401] The user enters "Event A budget data." The system aggregates the income and expenditure data and automatically generates a budget report.

[2402] Record audio data during meetings, send it to a server, and automatically generate meeting minutes using speech recognition technology.

[2403] Users get frustrated with a lot of data entry, so be aware of this and simplify your interface.

[2404] This will improve the efficiency of robot operation and management within factories, make work easier for employees, and reduce stress when operating them.

[2405] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2406] Step 1:

[2407] The user uses the terminal to input robot information (e.g., operating status, maintenance records).

[2408] Input: The user enters information such as "Robot A's operating status" into a form on the terminal.

[2409] Specific actions: The user enters information into the appropriate fields on the device interface and presses the "Submit" button.

[2410] Output: The entered robot information is sent from the terminal to the server.

[2411] Step 2:

[2412] The server stores the received robot information in a database.

[2413] Input: Robot information sent from the device.

[2414] Specific operation: The server parses the received data, converts it into the appropriate format, and writes it to the database.

[2415] Output: The robot information is saved to the database and a success message is generated.

[2416] Step 3:

[2417] A user uses a terminal to search and update existing robot information.

[2418] Input: The user enters search criteria into the terminal.

[2419] Specific operation: The user enters search criteria, presses the "Search" button, modifies the displayed information as necessary, and presses the "Save" button.

[2420] Output: Updated robot information is sent from the device to the server, where the database is updated.

[2421] Step 4:

[2422] The server stores the updated robot information in a database and displays the new information on the terminal.

[2423] Input: Update data sent from the device.

[2424] Specific operation: The server reflects the received update data in the database and sends the new data to the terminal.

[2425] Output: The terminal displays the new robot information.

[2426] Step 5:

[2427] The user inputs budget data into the input form on the terminal.

[2428] Input: The user enters income and expenditure data such as "maintenance costs" into the input form.

[2429] Specific operation: The user enters income and expenditure data and presses the "Submit" button.

[2430] Output: The entered budget data is sent from the terminal to the server.

[2431] Step 6:

[2432] The server stores the received budget data in a database.

[2433] Input: Budget data sent from the terminal.

[2434] Specific operation: The server parses the received data and writes it to the database.

[2435] Output: The budget data is saved in the database.

[2436] Step 7:

[2437] The server periodically aggregates income and expenditure data from the database and generates budget reports.

[2438] Input: Income and expenditure data stored in the database.

[2439] Specific operation: The server reads the income and expenditure data from the database, performs aggregation processing, and generates a report.

[2440] Output: Generated budget report.

[2441] Step 8:

[2442] The server notifies the user of the generated budget report.

[2443] Input: Generated budget report.

[2444] Specific Actions: The server sends the report to the user via email or notification system.

[2445] Output: The user receives and views the budget report.

[2446] Step 9:

[2447] A user records audio data on a terminal during a conference.

[2448] Input: Audio during the meeting.

[2449] Specific operation: The user uses the device's recording function to record the conference audio.

[2450] Output: Recorded audio data.

[2451] Step 10:

[2452] The terminal transmits the recorded voice data to the server.

[2453] Input: Recorded audio data.

[2454] Specific operation: The device uploads the recorded audio data to the server.

[2455] Output: The audio data is sent to the server.

[2456] Step 11:

[2457] The server automatically generates minutes using voice recognition technology.

[2458] Input: Recorded audio data.

[2459] Specific operation: The server uses a speech recognition engine to analyze the voice data, convert it into text, and generate minutes.

[2460] Output: Auto-generated meeting transcript.

[2461] Step 12:

[2462] The server notifies the user of the generated minutes and allows them to review and modify them.

[2463] Input: Auto-generated meeting minutes.

[2464] Specific operation: The server sends the generated minutes to the user's terminal so that the user can check and modify them.

[2465] Output: An interface is displayed that allows the user to review and modify the minutes.

[2466] Step 13:

[2467] The emotion engine recognizes the user's emotions and stores them in a database.

[2468] Input: Emotional data during user interaction.

[2469] Specific operation: The emotion engine identifies emotions from the user's facial expressions, input speed, etc., and sends the data to the server.

[2470] Output: The recognized emotion data is stored in the database.

[2471] Step 14:

[2472] The server adapts the interface based on the recognized emotion data.

[2473] Input: Recognized emotion data.

[2474] Specific operation: The server analyzes the emotion data, determines how to adapt the interface, and changes the device's UI.

[2475] Output: An adapted interface according to the user's emotion is displayed.

[2476] This will improve the efficiency of the system as a whole in managing robots within factories, make operation easier for users, and reduce stress.

[2477] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2478] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2479] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2480] [Fourth embodiment]

[2481] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2482] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2483] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2484] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2485] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2486] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2487] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2488] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2489] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2490] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2491] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2492] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2493] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2494] This system automates various management and operational tasks to improve the efficiency of neighborhood associations and community associations. The system consists of a server, terminals, and users, each with a specific role.

[2495] Membership Management System

[2496] Enter and save member information

[2497] Users enter their membership information from their terminals, which is then sent to the server, where it is stored in a database.

[2498] Example: When a user enters the name, address, and phone number of a new member, "Yamada Hanako," this information is sent from the terminal to the server and stored in a database.

[2499] Update and view member information

[2500] Users can search for existing membership information through their terminals and update it as needed. The updated data is sent back to the server, which updates the database. The server then displays the new information on the terminal.

[2501] Example: When a user enters a change of address for "Hanako Yamada," the information is sent to the server, the database is updated, and the new address information is then displayed on the device.

[2502] Budget Control System

[2503] Entering and saving budget data

[2504] Users enter their income and expenditure data into a form on their device, which is then sent to the server and stored in a database.

[2505] Example: When a user enters "income and expenditure data for Event A," it is sent to the server and stored in the database.

[2506] Automatic budget report generation and alerts

[2507] The server periodically aggregates income and expenditure data from the database and automatically generates budget reports. If it detects any abnormal values, it sends an alert to the user.

[2508] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[2509] Environmental Improvement System

[2510] Enter and prioritize issues and requests

[2511] Users input their concerns and requests for environmental improvements from their devices. The information is sent from the device to the server and stored in a database. The server then analyzes it and generates a prioritized list.

[2512] Example: When a user types "faulty street light" into a terminal as a request, it is sent to the server, analyzed, and added to a list of high-priority issues.

[2513] Event Planning System

[2514] Generate and modify event proposals

[2515] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device, allowing them to review and modify them.

[2516] Example: The server analyzes data on past "summer festivals" and proposes to hold a summer festival this year, notifying the user. The user can then modify the date, time, and content.

[2517] Minutes creation system

[2518] Recording meeting audio and automatically generating minutes

[2519] During a meeting, users record audio data on their devices, which is then sent to a server, which uses voice recognition technology to automatically generate minutes.

[2520] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[2521] By using this system, the operation of neighborhood associations and town councils will become much more efficient, and even elderly local residents will be able to manage and operate them more easily. In addition, the information stored in the database will be managed centrally, reducing the risk of fraud and mistakes.

[2522] The processing flow will be explained below.

[2523] Specific processing steps for member management

[2524] New member registration

[2525] Step 1:

[2526] The user enters the new member's information (name, address, contact information, etc.) into the form on the terminal.

[2527] Step 2:

[2528] The terminal transmits the input information to the server.

[2529] Step 3:

[2530] The server saves the received membership information in the database.

[2531] Step 4:

[2532] The server returns a confirmation message to the terminal that the save has been completed.

[2533] Update your membership information

[2534] Step 1:

[2535] The user uses the search function on the device to select the membership information they want to update.

[2536] Step 2:

[2537] The terminal retrieves existing member information from the server and displays it.

[2538] Step 3:

[2539] The user uses the terminal to modify the membership information and confirm the changes.

[2540] Step 4:

[2541] The terminal sends the modified information to the server.

[2542] Step 5:

[2543] The server updates the existing record in the database with the received information.

[2544] Step 6:

[2545] The server returns a confirmation message to the terminal that the update is complete.

[2546] Specific processing steps for budget control

[2547] Entering and saving accounting data

[2548] Step 1:

[2549] The user enters income and expenditure data into a form on the terminal.

[2550] Step 2:

[2551] The terminal transmits the input balance data to the server.

[2552] Step 3:

[2553] The server stores the received income and expenditure data in a database.

[2554] Automatic budget report generation and alerts

[2555] Step 1:

[2556] The server periodically (e.g., at the end of each month) retrieves income and expenditure data from the database and aggregates it.

[2557] Step 2:

[2558] The server automatically generates budget reports.

[2559] Step 3:

[2560] The server generates a budget report and sends it to the user via email or notification.

[2561] Step 4:

[2562] The server analyzes the income and expenditure data and detects abnormal values ​​and fraud.

[2563] Step 5:

[2564] If the server detects abnormal values ​​or irregularities, it will send an alert notification to the user.

[2565] Specific steps for environmental improvement

[2566] Entering and processing issues and requests

[2567] Step 1:

[2568] The user enters issues and requests regarding environmental improvements into a form on the device.

[2569] Step 2:

[2570] The device sends the input tasks and requests to the server.

[2571] Step 3:

[2572] The server stores the received data in a database.

[2573] Step 4:

[2574] The server analyzes the stored data and prioritizes it based on urgency and importance.

[2575] Step 5:

[2576] The server generates a prioritized list and notifies the user.

[2577] Specific process steps for event planning

[2578] Generate and modify event proposals

[2579] Step 1:

[2580] The server collects and analyzes past event data.

[2581] Step 2:

[2582] The server automatically generates new event suggestions based on the analysis results.

[2583] Step 3:

[2584] The server sends the generated event proposal to the terminal and notifies the user.

[2585] Step 4:

[2586] The user uses the device to check the proposal.

[2587] Step 5:

[2588] The user modifies the proposed content and presses the confirm button.

[2589] Step 6:

[2590] The device sends the modifications to the server.

[2591] Step 7:

[2592] The server updates the database with the received modifications.

[2593] Specific process steps for creating meeting minutes

[2594] Recording meeting audio and generating meeting minutes

[2595] Step 1:

[2596] During a conference, a user uses a terminal to record voice data.

[2597] Step 2:

[2598] The terminal transmits the recorded voice data to the server.

[2599] Step 3:

[2600] The server analyzes the audio data and automatically generates minutes as text data.

[2601] Checking and correcting the minutes

[2602] Step 1:

[2603] The server sends the generated minutes to the terminal and notifies the user.

[2604] Step 2:

[2605] The user uses the terminal to check the minutes.

[2606] Step 3:

[2607] The user edits the minutes and presses the confirm button.

[2608] Step 4:

[2609] The device sends the modifications to the server.

[2610] Step 5:

[2611] The server updates the database with the received modifications.

[2612] These are the specific processing steps for each system. This not only improves the efficiency of the operation of neighborhood associations, but also reduces the risk of fraud and mistakes by centralizing information management.

[2613] Example 1

[2614] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2615] In running a neighborhood association or community association, managing member information and budget data, processing requests for environmental improvements, planning events, and creating meeting minutes requires a great deal of time and effort. Much of this work is done manually, and there is a high risk of errors and fraud. The goal of this invention is to centralize and automate these management tasks, thereby significantly improving operational efficiency.

[2616] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2617] In this invention, the server includes a first means for inputting member information, a second means for saving the input member information in a database, a third means for displaying and updating the saved member information, a fourth means for inputting budget data, a fifth means for aggregating the input budget data and automatically generating a report, a sixth means for notifying the user of the generated report, a seventh means for inputting issues and requests regarding environmental improvement, an eighth means for prioritizing the input information, a ninth means for analyzing past event data and automatically generating event proposals, a tenth means for recording audio data of meetings, an eleventh means for analyzing the recorded audio data and automatically generating minutes, and a twelfth means for allowing the user to review and modify the generated minutes. This significantly reduces the effort and errors involved in running a neighborhood association and enables efficient and accurate operation.

[2618] "Member information" refers to personal information such as the names, addresses, and telephone numbers of members of neighborhood associations and local councils.

[2619] "Database" refers to a system that systematically stores and manages information such as member information, budget data, environmental improvement requests, event data, and meeting minutes.

[2620] "Budget data" refers to detailed data on the income and expenditures of neighborhood associations and town councils.

[2621] A "report" refers to a document that shows the income and expenditure status and budget usage status generated based on input budget data.

[2622] "Environmental improvement" refers to the maintenance and improvement of local public facilities and infrastructure.

[2623] "Requests" refer to issues and requests regarding environmental improvement submitted by local residents.

[2624] "Event proposal" refers to a new event plan generated by analyzing past event data.

[2625] "Audio data" refers to audio information recorded during a conference or meeting.

[2626] "Minutes" refers to a document that records what was discussed and what decisions were made at a conference or meeting.

[2627] A "generative AI model" refers to an artificial intelligence model that generates results or suggestions based on specific prompts.

[2628] A "prompt" is a document that is input to a generative AI model in the form of an instruction or question.

[2629] MODE FOR CARRYING OUT THE INVENTION

[2630] This system is designed primarily to streamline the management of neighborhood associations and community groups, and consists of a server, terminals, and users, each with a specific role, automating the following management and operation tasks:

[2631] Hardware and software used

[2632] Server: Database management system (DBMS) such as MySQL or PostgreSQL, HTTP server (Apache, Nginx)

[2633] Devices: PC, smartphone, tablet

[2634] User interface: HTML, JavaScript

[2635] Speech recognition technology: Google Speech-to-Text API, Amazon Transcribe

[2636] Generative AI models: OpenAI GPT-3, etc.

[2637] Membership Management System

[2638] Enter and save member information

[2639] The user uses a terminal to input membership information (such as name, address, and phone number). The terminal sends the input information to the server in JSON format. The server analyzes the received information and stores it in a database such as MySQL or PostgreSQL.

[2640] Example: A user enters information about a new member, "Yamada Hanako," and the terminal sends this information to the server and stores it in the database.

[2641] Update and view member information

[2642] The user uses the device to search for existing membership information and make any necessary changes. The changed information is then sent back to the server in JSON format, where it updates the database. The server then displays the new information on the device.

[2643] Example: A user changes the address of "Yamada Hanako," sends the information from the terminal to the server, and the database is updated.

[2644] Budget Control System

[2645] Entering and saving budget data

[2646] The user enters income and expenditure data into a form on the device, which is then sent to the server in JSON format and stored in a database.

[2647] Example: A user enters "income and expenditure data for Event A," which is sent to the server and stored in the database.

[2648] Automatic budget report generation and alerts

[2649] The server periodically compiles income and expenditure data and automatically generates budget reports. If an abnormal value is detected, an alert is sent to the user's device.

[2650] Example: At the end of the month, the server aggregates income and expenditure data and automatically generates a budget report and emails it to the user. If any unclear expenditures are found, the user is alerted.

[2651] Environmental Improvement System

[2652] Enter and prioritize issues and requests

[2653] Users use their devices to input their environmental problems and requests, which are then sent to a server where they are stored in a database. The server then analyzes the information and generates a prioritized list.

[2654] Example: A user types "faulty street light" into a terminal as a request, which is sent to the server, analyzed, and added to a list of high-priority issues.

[2655] Event Planning System

[2656] Generate and modify event proposals

[2657] The server analyzes past event data and automatically generates new event suggestions, which are then sent to the user via their device for confirmation and modification.

[2658] Example: The server analyzes data on past "summer festivals" and suggests holding a summer festival this year. The server notifies the user and allows the user to change the date, time, and content.

[2659] Minutes creation system

[2660] Recording meeting audio and automatically generating minutes

[2661] During a meeting, users record audio data on their devices, which is then sent to a server that uses voice recognition technology to automatically generate minutes.

[2662] Example: After a meeting ends, the server automatically generates minutes from the audio data, and the user checks them on their device and corrects any errors.

[2663] Prompt Sentence Examples

[2664] 1. "How do I enter new membership information?"

[2665] 2. "How do I enter my income and expenditure data?"

[2666] 3. "How do I request a street light malfunction?"

[2667] By utilizing this system, a wide range of tasks related to the management of neighborhood associations and town councils can be carried out efficiently and accurately.

[2668] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2669] Membership management system processing flow

[2670] Enter and save member information

[2671] Step 1:

[2672] The user enters new member information (name, address, phone number, etc.) into a form on the device. The form is created using HTML and JavaScript.

[2673] Input: Member information (e.g. "Yamada Hanako")

[2674] Output: The information entered

[2675] Step 2:

[2676] The terminal converts the entered member information into JSON format and sends it to the server using an HTTP POST request.

[2677] Input: JSON data of entered member information (e.g., {"name": "Yamada Hanako", "address": "Tokyo", "phone": "090-1234-5678"})

[2678] Output: Request sent to server

[2679] Step 3:

[2680] The server parses the received JSON data and stores it in a database, using MySQL or PostgreSQL.

[2681] Input: JSON data received from the terminal

[2682] Data processing: Generate SQL query (INSERT INTO members (name, address, phone) VALUES ('Hanako Yamada', 'Tokyo', '090-1234-5678'))

[2683] Output: Save to database

[2684] Update and view member information

[2685] Step 1:

[2686] The user uses the terminal to search for existing member information and enter the parts to be corrected.

[2687] Input: Member information to search (e.g., "Yamada Hanako"), correction details (e.g., change of address)

[2688] Output: Corrections entered

[2689] Step 2:

[2690] The device converts the modified information into JSON format and sends it to the server using an HTTP PUT request.

[2691] Input: JSON data of the corrected member information (e.g., {"name": "Yamada Hanako", "address": "Osaka Prefecture", "phone": "090-1234-5678"})

[2692] Output: Request sent to server

[2693] Step 3:

[2694] The server parses the received JSON data and generates the appropriate SQL queries to update the database.

[2695] Input: JSON data received from the terminal

[2696] Data processing: Generate SQL query (UPDATE members SET address='Osaka Prefecture' WHERE name='Yamada Hanako')

[2697] Output: Database update

[2698] Step 4:

[2699] The server retrieves the updated member information again and displays it on the terminal.

[2700] Input: Acquire corrected member information

[2701] Output: Send and display updates to the terminal

[2702] Budget control system processing flow

[2703] Entering and saving budget data

[2704] Step 1:

[2705] The user enters income and expenditure data into a form on the terminal.

[2706] Input: Income and expenditure data (e.g., "Event A Income and Expenditure")

[2707] Output: The input data

[2708] Step 2:

[2709] The terminal converts the entered income and expenditure data into JSON format and sends it to the server using an HTTP POST request.

[2710] Input: JSON data of income and expenditure data

[2711] Output: Request sent to server

[2712] Step 3:

[2713] The server parses the received JSON data and stores it in a database.

[2714] Input: JSON data received from the terminal

[2715] Data manipulation: Generate SQL queries (INSERT INTO budget (event, revenue, expense) VALUES (....

Claims

1. a first means for inputting member information; A second means for storing the input member information in a database; a third means for viewing and updating the stored member information; A system including:

2. 10. The system of claim 1, a fourth means for inputting budget data; a fifth means for aggregating the input budget data and automatically generating a report; a sixth means for notifying a user of the generated report; The system further comprises:

3. 10. The system of claim 1, seventh means for recording audio data of the conference; an eighth means for analyzing the recorded voice data and automatically generating minutes; A ninth means for allowing a user to check and modify the generated minutes; The system further comprises:

Images