System

Abstract

A system is provided.SOLUTION: The system for supporting the parliamentary operation includes a means for automatically generating a subject, a means for visualizing the progress situation of the parliamentary session in real time, a means for generating a summary of the contents of the utterance, a means for analyzing the approval or disapproval of the subject, a means for automatically generating a minute, a means for providing materials and data to the member by using interactive artificial intelligence, and a means for generating public information by visualizing the parliamentary data for the citizens.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] The management of local government assemblies involves many tasks, such as drafting bills, managing the progress of assembly meetings, recording each assembly member's remarks, analyzing the pros and cons of bills, and compiling minutes. As a result, inefficiency and excessive workloads have become a problem. Furthermore, the large number of assembly members is elderly, and the environment is not conducive to the adoption of IT, which is also an obstacle to efficiency. Therefore, it is necessary to improve the efficiency of assembly management and provide information to citizens in a timely and easy manner. [Means for solving the problem]

[0005] This invention is a system for supporting parliamentary operations, including means for automatically generating bills, means for visualizing the progress of parliamentary meetings in real time, means for generating summaries of speeches, means for analyzing the support and opposition of bills, means for automatically generating minutes, means for providing materials and data to members of parliament using interactive artificial intelligence, and means for visualizing parliamentary data for citizens and generating public information. Automatically generating bills reduces the time required to prepare bills and enables efficient parliamentary proceedings. Visualizing the progress of parliamentary meetings in real time and summarizing speeches and analyzing the support and opposition increases parliamentary transparency and enables rapid decision-making. Furthermore, the automatic generation of minutes enables accurate minutes to be created, and interactive artificial intelligence enables rapid response to member requests for materials and data. Furthermore, using means for visualizing parliamentary data for citizens and generating public information enables timely and easy-to-understand information to be provided to citizens.

[0006] The "means for automatically generating proposals" is a function that automatically creates proposals based on input requirements.

[0007] "Means for visualizing the progress of parliamentary proceedings in real time" refers to a function that organizes and visually displays information about the remarks of members of parliament and ongoing agenda items in real time.

[0008] The "means for generating a summary of the speech content" is a function that analyzes the speech of a member of parliament from audio data and summarizes the content concisely.

[0009] "Means for analyzing the pros and cons of bills" is a function that analyzes the pros and cons of bills based on the remarks and votes of members of parliament and clearly displays the results.

[0010] The "means for automatically generating minutes" is a function that recognizes speech spoken during a meeting in real time, converts the speech into text, and organizes and generates minutes.

[0011] "Conversational artificial intelligence" is an AI system that uses natural language processing technology to provide appropriate materials and data in response to user questions and requests.

[0012] "Means of visualizing parliamentary data for citizens and generating public information" is a function that analyzes collected parliamentary data and generates visual data that can be published in a format that is easy for citizens to understand.

[0013] "Means using voice recognition" refers to a function that records the speech of a member of parliament in real time and converts that speech into text data.

[0014] "Visualization means" is a function that displays the analysis results in a visual format, such as a graph or chart. [Brief explanation of the drawings]

[0015] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0016] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0017] First, the terms used in the following description will be explained.

[0018] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0019] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0020] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0021] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0022] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0023] [First embodiment]

[0024] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0025] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0026] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0027] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0028] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0029] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0030] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0031] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0032] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0033] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0034] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0035] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0036] The system of the present invention has the following main functions:

[0037] 1. Automatic proposal generation function

[0038] 2. Real-time visualization of parliamentary progress

[0039] 3. AI Minute-Taking Function

[0040] 4. Conversational AI support for lawmakers

[0041] 5. AI Function for Visualizing Parliamentary Data

[0042] These functions will now be described in detail.

[0043] ---

[0044] Automatic bill generation function

[0045] explanation:

[0046] The user inputs the requirements for creating a proposal into the terminal.

[0047] The terminal transmits the input information to the server.

[0048] The server automatically generates proposals using generation AI and sends them to the terminal.

[0049] The terminal displays the generated proposal to the user.

[0050] Examples:

[0051] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[0052] ---

[0053] Real-time visualization of parliamentary progress

[0054] explanation:

[0055] The device records the member's remarks in real time and sends them to a server.

[0056] The server uses voice recognition AI to analyze the content of the speech and generate a summary.

[0057] The server visualizes the progress and analyzes the pros and cons of proposals.

[0058] The server sends the visualization results to the terminal and displays them to the user.

[0059] Examples:

[0060] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[0061] ---

[0062] AI function for creating meeting minutes

[0063] explanation:

[0064] The device records the member's remarks and sends them to a server.

[0065] The server uses voice recognition AI to convert what is said into text.

[0066] The server organizes the text of the remarks and automatically generates minutes.

[0067] The server transmits the generated minutes to the terminal and displays them to the user.

[0068] Examples:

[0069] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[0070] ---

[0071] Conversational AI support for lawmakers

[0072] explanation:

[0073] The user inputs a request for materials or data into the terminal.

[0074] The terminal sends a request to the server.

[0075] The server uses conversational AI to search for and prepare appropriate materials and data.

[0076] The server sends the search results to the terminal and provides them to the user.

[0077] Examples:

[0078] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[0079] ---

[0080] Parliamentary Data Visualization AI Function

[0081] explanation:

[0082] The server collects and analyzes data on the progress of the assembly.

[0083] The server automatically generates visualized information for citizens.

[0084] The server publishes the visualized information through the terminal.

[0085] The devices display visualized information to citizens via websites and apps.

[0086] Examples:

[0087] Comments made during the council meeting, the progress of agenda items, and the pros and cons will be converted into easy-to-read graphs and charts for citizens to view and published in real time on the local government's website.

[0088] ---

[0089] This system aims to improve the efficiency of parliamentary operations by analyzing and visualizing the remarks of assembly members and the progress of parliament in real time, and by providing multiple functions such as automatically generating minutes and providing materials.In addition, by providing information to citizens in real time, it is also intended to improve the transparency and reliability of parliament.

[0090] The processing flow will be explained below.

[0091] Automatic bill generation function

[0092] Step 1:

[0093] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[0094] Step 2:

[0095] The terminal transmits the input requirement data for creating a proposal to the server.

[0096] Step 3:

[0097] The server calls up the generative AI model and automatically generates detailed proposals based on the received requirements data, for example, by referencing relevant laws and information on similar proposals from the past.

[0098] Step 4:

[0099] The server transmits the generated proposal to the terminal.

[0100] Step 5:

[0101] The terminal displays the generated proposal to the user.

[0102] ---

[0103] Real-time visualization of parliamentary progress

[0104] Step 1:

[0105] The device records the lawmaker's remarks in real time.

[0106] Step 2:

[0107] The device sends the recorded audio data to the server.

[0108] Step 3:

[0109] The server uses voice recognition AI to convert the recorded data into text and analyze the content of the speech.

[0110] Step 4:

[0111] The server summarizes the analyzed speech.

[0112] Step 5:

[0113] The server analyzes the pros and cons of the proposals from the textual content of the comments and tallys up the number of opinions in favor and against.

[0114] Step 6:

[0115] The server generates progress visualization data (graphs, charts, etc.).

[0116] Step 7:

[0117] The server sends the visualization data to the terminal.

[0118] Step 8:

[0119] The terminal displays the visualized data to the user in real time.

[0120] ---

[0121] AI function for creating meeting minutes

[0122] Step 1:

[0123] The device records the lawmaker's remarks in real time.

[0124] Step 2:

[0125] The device sends the recorded audio data to the server.

[0126] Step 3:

[0127] The server uses voice recognition AI to convert the voice data into text.

[0128] Step 4:

[0129] The server automatically organizes the textual content of the remarks and generates minutes.

[0130] Step 5:

[0131] The server transmits the generated minutes to the terminal.

[0132] Step 6:

[0133] The terminal displays the minutes to the user.

[0134] ---

[0135] Conversational AI support for lawmakers

[0136] Step 1:

[0137] The user inputs questions or requests about the materials or data they need into the terminal.

[0138] Step 2:

[0139] The device sends a question or request to the server.

[0140] Step 3:

[0141] The server uses conversational AI to search for the most appropriate materials and data based on the request.

[0142] Step 4:

[0143] The server organizes the search results and prepares the necessary materials and data.

[0144] Step 5:

[0145] The server sends the prepared materials and data to the terminal.

[0146] Step 6:

[0147] The terminal displays materials and data to the user.

[0148] ---

[0149] Parliamentary Data Visualization AI Function

[0150] Step 1:

[0151] The server collects data on the progress of parliament (statements by members of parliament, content of discussions, votes for or against, etc.) in real time.

[0152] Step 2:

[0153] The server analyzes the collected data and generates information that can be visualized in an easy-to-understand manner for citizens.

[0154] Step 3:

[0155] The server automatically generates visualization information in a visual format (such as graphs or charts).

[0156] Step 4:

[0157] The server sends the generated visualization information to the terminal and makes it available to citizens through websites and applications.

[0158] Step 5:

[0159] The terminals display visualization information through citizen websites and applications.

[0160] The above are the specific processing steps for each function of this system, and are necessary to efficiently support the management of local government assemblies.

[0161] Example 1

[0162] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0163] Traditional parliamentary operations involve a large amount of manual work, making things like drafting bills, compiling minutes, managing parliamentary progress, and searching for and providing materials extremely inefficient. It's also difficult to visualize parliamentary data and provide information to citizens in real time, creating a need for greater transparency. There's a need to solve these problems and improve the efficiency of parliamentary operations and the provision of information to citizens.

[0164] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0165] In this invention, the server includes means for receiving requirements for bill creation input by a user and using a generative AI model to automatically generate bills, means for recording council members' remarks in real time, analyzing the remarks using voice recognition technology, and visualizing the progress, means for analyzing the remarks and generating summaries, means for aggregating and analyzing votes for and against bills in real time, means for recording council members' remarks, converting them into text using voice recognition technology, and automatically generating minutes, means for providing materials and data in response to user requests using interactive AI, and means for analyzing council data, visualizing it for citizens, and generating and displaying public information. This improves the efficiency of council operations and enables real-time information provision and improved transparency.

[0166] "User" means a person or entity that operates the system and inputs and uses information.

[0167] A "terminal" is a device (e.g., a PC, tablet, smartphone, etc.) that a user uses to operate the system.

[0168] A "server" is a computer or network system that centralizes the processing of the entire system and receives and transmits data.

[0169] A "bill" is a formal proposal or plan submitted to Parliament for consideration.

[0170] A "generative AI model" is an algorithm or system that uses artificial intelligence technology to automatically generate text or data.

[0171] A "parliament" is an organization where representatives of public institutions and organizations gather to discuss and decide on policies, laws, budgets, etc.

[0172] "Progress" is information that indicates the progress of each bill or agenda item in the assembly.

[0173] "Voice recognition technology" is a technology that analyzes voice data and converts it into text data.

[0174] A "summary" is a short summary of the main points of the original information.

[0175] "For or against" refers to opinions or voting results in favor or against a motion or proposal.

[0176] "Documents" are reference materials such as data, documents, statistics, etc. used by Parliament.

[0177] "Conversational AI" is an AI system that can naturally interact with users, answering their questions and providing them with information.

[0178] "Visualization" refers to the visual representation of data in the form of a graph, chart, or other form.

[0179] "Public information" is information relating to Parliament that is made accessible to citizens and the general public.

[0180] Minutes are official documents that record statements and decisions made in parliament.

[0181] The system of the present invention aims to improve the efficiency and transparency of parliamentary operations and has the following main functions, which are implemented by the server, terminals, and users.

[0182] 1. Automatic proposal generation function

[0183] explanation:

[0184] The user inputs the requirements for creating a proposal into the terminal. For example, the user may request the creation of a proposal on the theme of "regional road development."

[0185] The terminal sends the input information to the server, which includes supplementary information such as the topic, budget, deadline, and stakeholders.

[0186] The server automatically generates a proposal using a generative AI model. Specifically, the server analyzes the user's input information and provides a prompt to the generative AI model (e.g., OpenAI (registered trademark) GPT-4 (registered trademark)) such as, "Please create a proposal regarding road construction in the area."

[0187] The server transmits the generated proposal to the terminal.

[0188] The device displays the generated agenda to the user. The agenda is provided in a human-readable format (e.g., PDF or Word document).

[0189] 2. Real-time visualization of parliamentary progress

[0190] explanation:

[0191] The device records the speech of the legislator in real time, and audio data is acquired using microphones placed in the conference room.

[0192] The device sends the recorded data to the server. The recorded data is packetized at regular intervals (e.g., every 10 seconds) and sent.

[0193] The server analyzes what is being said using speech recognition technology, for example, Google® Cloud Speech-to-Text API, to convert the speech data into text.

[0194] The server visualizes the progress, tallies votes for and against proposals, generates summaries, and converts statements and votes into graphs and charts.

[0195] The server sends the visualization results to the terminal.

[0196] The device displays the visualization results to the user, and the visualization data is provided on a web page or within a dedicated app.

[0197] 3. AI Minute-Taking Function

[0198] explanation:

[0199] The device records the speech of the legislator. For example, audio data is acquired using a microphone placed in the conference room.

[0200] The device sends the recorded data to the server in batches.

[0201] The server converts what is said into text using speech recognition technology, for example, Amazon Transcribe.

[0202] The server organizes the transcribed remarks and automatically generates minutes. It uses a natural language processing algorithm to analyze the context and automatically generates minutes according to the format.

[0203] The server transmits the generated minutes to the terminal.

[0204] The terminal displays the minutes to the user, which are provided in formats such as PDF.

[0205] 4. Conversational AI support for lawmakers

[0206] explanation:

[0207] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[0208] The terminal sends a request to the server, which converts the request into a prompt.

[0209] The server uses conversational artificial intelligence to search for appropriate materials and data, and performs the search process using a generative AI model (e.g., OpenAI GPT-4).

[0210] The server sends the search results to the device. The data is sent in JSON format or similar.

[0211] The terminal provides the search results to the user, using graphs and tables as display formats.

[0212] 5. AI Function for Visualizing Parliamentary Data

[0213] explanation:

[0214] The server collects data on the progress of the parliament and periodically retrieves data from the parliament system.

[0215] The server analyzes the progression data and uses analysis algorithms to extract important information.

[0216] The server automatically generates visualized information for citizens and converts the generated data into graphs and charts.

[0217] The server publishes the visualization information, which is then published via a Web API.

[0218] The device displays the visualized information to citizens, who can access it through the local government's website or app, for example.

[0219] This system will improve the efficiency of parliamentary operations, provide real-time information, and increase transparency.

[0220] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0221] Automatic bill generation function

[0222] Processing Steps:

[0223] Step 1:

[0224] The user inputs the requirements for creating a proposal into the terminal. For example, the topic is "regional road development," and necessary supplementary information such as the budget and deadline is included.

[0225] Step 2:

[0226] The terminal sends the entered information to the server. The entered data is encrypted and sent using a secure communication protocol (e.g. HTTPS). Input: Proposal creation requirements entered by the user. Output: Encrypted data packet.

[0227] Step 3:

[0228] The server automatically generates a proposal using a generative AI model. The server analyzes the user's input information and provides the generative AI model with a prompt: "Please create a proposal regarding road improvement in the area." Input: Encrypted data packet. Output: Automatically generated proposal data.

[0229] Step 4:

[0230] The server sends the generated proposal to the terminal. The output data is formatted as needed. Input: Automatically generated proposal data. Output: Formatted proposal data.

[0231] Step 5:

[0232] The terminal displays the generated agenda to the user. The agenda is displayed in a format that is easy for humans to understand, such as a PDF or Word document. Input: Formatted agenda data. Output: Agenda in a format that can be viewed by the user.

[0233] ---

[0234] Real-time visualization of parliamentary progress

[0235] Processing Steps:

[0236] Step 1:

[0237] The device records the speech of the legislator in real time, and captures the audio data using microphones placed in the conference room.

[0238] Step 2:

[0239] The device sends the recorded data to the server. The recorded data is packetized at regular intervals and sent over the network. Input: Recorded voice data. Output: Packetized voice data.

[0240] Step 3:

[0241] The server analyzes the speech using speech recognition technology. The speech data is converted into text data using a speech recognition engine (for example, Google Cloud Speech-to-Text API). Input: Packetized speech data. Output: Texted speech.

[0242] Step 4:

[0243] The server visualizes the progress and tally the votes for and against the proposals. The server analyzes the content of the comments and the information on the votes for and against, and converts it into graphs and charts. Input: Textualized content of the comments. Output: Visualized progress data.

[0244] Step 5:

[0245] The server sends the visualization results to the terminal. Input: visualized progress data. Output: formatted visualization data.

[0246] Step 6:

[0247] The device displays the visualization results to the user. The visualized data is displayed on a web page or in a dedicated app. Input: Formatted visualized data. Output: Visualized data in a format that can be viewed by the user.

[0248] ---

[0249] AI function for creating meeting minutes

[0250] Processing Steps:

[0251] Step 1:

[0252] The device records what the council member says, collecting audio data using microphones placed in the conference room.

[0253] Step 2:

[0254] The device sends the recorded data to the server. The data is batch processed at regular intervals and sent. Input: Recorded audio data. Output: Batched audio data.

[0255] Step 3:

[0256] The server uses speech recognition technology to convert the speech into text. A speech recognition engine (e.g., Amazon Transcribe) is used to convert the speech data into text. Input: Batched speech data. Output: Translated speech.

[0257] Step 4:

[0258] The server organizes the textual content of remarks and automatically generates minutes. A natural language processing algorithm is used to organize the text data and convert it into a format suitable for the minutes format. Input: Textual content of remarks. Output: Automatically generated minutes.

[0259] Step 5:

[0260] The server sends the generated minutes to the terminal. The generated minutes are converted into a format such as PDF or Word document. Input: Automatically generated minutes. Output: Formatted minutes data.

[0261] Step 6:

[0262] The terminal displays the minutes to the user. The generated minutes are displayed in a format that can be easily viewed by the user. Input: Formatted minutes data. Output: Minutes in a format that can be viewed by the user.

[0263] ---

[0264] Conversational AI support for lawmakers

[0265] Processing Steps:

[0266] Step 1:

[0267] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[0268] Step 2:

[0269] The terminal sends a request to the server. The request content is converted into a prompt sentence format and sent. Input: User's request content. Output: Data in prompt sentence format.

[0270] Step 3:

[0271] The server uses conversational artificial intelligence to search for appropriate materials and data. It uses a conversational AI model (e.g., OpenAI GPT-4) to search for appropriate information from databases and online resources. Input: Data in the form of a prompt sentence. Output: Search result data.

[0272] Step 4:

[0273] The server sends the search results to the terminal. The search results are formatted in JSON format and sent. Input: Search result data. Output: Formatted search result data.

[0274] Step 5:

[0275] The terminal provides the search results to the user. Graphs, tables, etc. are used as display formats. Input: Formatted search result data. Output: Search results in a format that can be viewed by the user.

[0276] ---

[0277] Parliamentary Data Visualization AI Function

[0278] Processing Steps:

[0279] Step 1:

[0280] The server collects the progress data of the assembly. It periodically obtains data from the assembly system. Input: Progress data from the assembly system. Output: Collected progress data.

[0281] Step 2:

[0282] The server parses the progress data. It uses parsing algorithms to extract important information and convert it into the required format. Input: Collected progress data. Output: Parsed progress data.

[0283] Step 3:

[0284] The server automatically generates visualized information for citizens. It converts the data into graphs and charts, making it easy for citizens to understand. Input: Analyzed progress data. Output: Visualized information data.

[0285] Step 4:

[0286] The server publishes the visualized information. The automatically generated visualized data is published via a Web API. Input: visualized information data. Output: data via the public API.

[0287] Step 5:

[0288] The device displays the visualized information to citizens. For example, it is made accessible to citizens through the local government's website or app. Input: Data via public API. Output: Visualized data in a format that citizens can view.

[0289] These processing steps will improve the efficiency of parliamentary operations, provide real-time information to citizens, and increase transparency.

[0290] (Application example 1)

[0291] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0292] Conventional parliamentary management support systems were limited to basic functions such as automatically generating bills and visualizing parliamentary progress, and were therefore unable to handle practical matters outside of parliament or security management. In particular, they lacked the functionality to analyze surveillance footage in real time and issue an immediate warning when an abnormality was detected, making it difficult to ensure safety in situations where a rapid response was required. These issues need to be resolved.

[0293] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0294] In this invention, the server includes a means for automatically generating bills, a means for visualizing the progress of the assembly in real time, a means for analyzing video data from a monitoring device in real time to detect abnormalities, a means for issuing an immediate warning when an abnormality is detected, and a means for visualizing the results of the real-time analysis. This enables support for assembly operations as well as real-time detection of abnormalities and immediate warnings using the monitoring device.

[0295] "Means for automatically generating proposals" refers to functions and processes for automatically creating proposals based on input requirements.

[0296] "Means for visualizing the progress of parliamentary proceedings in real time" refers to the function and process of aggregating statements and progress made during parliamentary proceedings in real time and displaying them in a visually easy-to-understand manner.

[0297] The "means for generating a summary of speech content" refers to a function and process for analyzing the speech of a member of parliament and automatically generating a summary that concisely summarizes the content.

[0298] "Means for analyzing the pros and cons of bills" refers to the function and process for compiling and analyzing each member's position on bills in parliament, whether for or against.

[0299] "Means for automatically generating minutes" refers to the functions and processes for converting statements made during a meeting into text, organizing it, and automatically generating it as minutes.

[0300] "Means for providing materials and data to members of parliament using interactive artificial intelligence" refers to the functions and processes for using interactive artificial intelligence to search for and provide materials and data in response to requests from members of parliament.

[0301] "Means for visualizing parliamentary data for citizens and generating public information" refers to the functions and processes for collecting and analyzing parliamentary progress data, visualizing it in a form that is easy for citizens to understand, and generating it as public information.

[0302] "Means for analyzing video data from a monitoring device in real time and detecting abnormalities" refers to functions and processes for analyzing video data sent from a monitoring device in real time and detecting abnormal behavior or abnormal conditions.

[0303] "Means for immediately issuing a warning when an abnormality is detected" refers to a function and process for immediately issuing a warning when an abnormality is detected through analysis of video data by a monitoring device.

[0304] "Means for visualizing the results of real-time analysis" refers to the functions and processes for visually displaying the results of video data analysis by a monitoring device in real time and providing them to users.

[0305] The system of the present invention has multiple functions to support parliamentary operations and analyze video data from surveillance equipment in real time. This system operates in cooperation with a server, terminals, and users. Each function and its implementation will be described below.

[0306] Automatic bill generation function

[0307] explanation:

[0308] When a user inputs the requirements for creating a proposal into the device, the device sends it to the server. The server automatically generates a proposal from the input requirements using a generative AI model and returns the proposal to the device. The device then displays the generated proposal to the user.

[0309] Examples:

[0310] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[0311] Real-time visualization of parliamentary progress

[0312] explanation:

[0313] The device records the speech of the legislator in real time and sends it to the server. The server uses speech recognition AI to analyze the speech and generate a summary. It also visualizes the progress and analyzes the pros and cons of the bills. The results are sent to the device and displayed to the user.

[0314] Examples:

[0315] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[0316] AI function for creating meeting minutes

[0317] explanation:

[0318] The device records the remarks of the legislators and sends them to the server. The server uses speech recognition AI to convert the remarks into text, and then organizes the text to automatically generate minutes. The generated minutes are sent to the device and displayed to the user.

[0319] Examples:

[0320] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[0321] Conversational AI support for lawmakers

[0322] explanation:

[0323] When a user inputs a request for materials or data into the device, the device sends it to the server, which uses conversational AI to search for and prepare the appropriate materials or data. The search results are sent to the device and provided to the user.

[0324] Examples:

[0325] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[0326] Parliamentary Data Visualization AI Function

[0327] explanation:

[0328] The server collects and analyzes data on the progress of parliamentary meetings. Visualized information is automatically generated for citizens and made available via devices. Users can view the visualized information via a website or app.

[0329] Examples:

[0330] Graphs and charts of comments made during the assembly, the progress of agenda items, and the approval or disapproval status will be published in real time on the local government's website.

[0331] Real-time analysis function of the monitoring system

[0332] explanation:

[0333] The device sends video data from the monitoring device to the server in real time, and the server uses video analysis AI to detect abnormalities. If an abnormality is detected, the server immediately sends an alert to the device and notifies the user. The analysis results are then visualized and displayed.

[0334] Examples:

[0335] If a suspicious person is caught on camera in the office at night, the video will be analyzed immediately and a notification such as "Abnormal person detected in the office" will be sent to the smartphone. At the same time, the analysis results will be displayed in graphs and charts within the app.

[0336] Example prompts for generative AI models

[0337] "We will create a monitoring system application that analyzes surveillance camera footage in real time and immediately notifies users when an abnormality is detected. It will also have a visualization function."

[0338] The above is a specific embodiment for carrying out the present invention, which not only supports the operation of an assembly, but also enables real-time abnormality detection and immediate warning using a monitoring device.

[0339] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0340] Step 1: Request for Proposal Generation

[0341] The user inputs the requirements for creating a proposal into the terminal. Specifically, the proposal topic and necessary information are entered into a form, and the data is saved on the terminal. The input data is diverse, including the proposal title, purpose, and related matters.

[0342] Step 2: Submit a proposal generation request

[0343] The terminal sends the data entered by the user to the server, which is designed to receive formatted request data through a specific API endpoint.

[0344] Step 3: Automatic generation of proposals using generative AI

[0345] The server automatically generates proposals using a generative AI model based on the received requirements data. During this process, the generative AI model analyzes large amounts of past data and related information to generate optimal proposals. Specifically, it generates documents using natural language processing (NLP).

[0346] Step 4: Return the generated proposal

[0347] The generated proposal is sent back from the server to the device. The data is sent in a standard structure such as JSON format so that the device can receive and analyze it.

[0348] Step 5: View the proposals

[0349] The terminal displays the generated proposal to the user, and the user interface is designed to clearly display the proposal details.

[0350] Step 6: Start recording parliamentary proceedings

[0351] When a parliamentary session begins, the device records the speech of the members in real time, and the recorded audio data is collected in real time and sent to the server.

[0352] Step 7: Analyze the audio data

[0353] The server converts the received voice data into text using speech recognition AI. During this process, advanced voice analysis tools are used to accurately convert what is being said into text.

[0354] Step 8: Visualize your progress

[0355] The server analyzes the text extracted from the audio data and generates a summary, which is then visually displayed as graphs and charts, and sent back to the device.

[0356] Step 9: Collect video data for anomaly detection

[0357] The surveillance equipment collects video data in real time and transmits it to a server. The surveillance equipment is installed in offices and public facilities and records video continuously.

[0358] Step 10: Analyze the video data

[0359] The server receives the video data and uses video analysis AI to detect abnormalities. If certain conditions are met (such as suspicious human movements), this is recognized as an anomaly.

[0360] Step 11: Alert when an anomaly is detected

[0361] If an abnormality is detected, the server immediately sends an alert to the terminal. The alert is designed to notify the user in real time, allowing for a prompt response.

[0362] Step 12: Visualize the analysis results

[0363] The server visualizes the results of the video analysis and sends them to the device in the form of graphs and charts, allowing the user to check the analysis results in real time through the device.

[0364] Step 13: Final notification to users

[0365] The device will notify the user of the analysis results and warnings in a variety of ways, including pop-ups, alert sounds, emails, and text messages, allowing the user to quickly check the situation and take any necessary measures.

[0366] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0367] This invention is a system to support parliamentary operations, with the following main functions and emotion engine:

[0368] 1. Automatic proposal generation function

[0369] 2. Real-time visualization of parliamentary progress

[0370] 3. AI Minute-Taking Function

[0371] 4. Conversational AI support for lawmakers

[0372] 5. AI Function for Visualizing Parliamentary Data

[0373] 6. Emotion engine that recognizes and analyzes user emotions

[0374] These functions will now be described in detail.

[0375] ---

[0376] Automatic bill generation function

[0377] explanation:

[0378] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[0379] The terminal transmits the input information to the server.

[0380] The server automatically generates proposals using generation AI and sends them to the terminal.

[0381] The terminal displays the generated proposal to the user.

[0382] Examples:

[0383] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[0384] ---

[0385] Real-time visualization of parliamentary progress

[0386] explanation:

[0387] The device records the member's remarks in real time and sends them to a server.

[0388] The server uses voice recognition AI to analyze the content of the speech and generate a summary.

[0389] The server visualizes the progress and analyzes the pros and cons of proposals.

[0390] The server sends the visualization results to the terminal and displays them to the user.

[0391] Examples:

[0392] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[0393] ---

[0394] AI function for creating meeting minutes

[0395] explanation:

[0396] The device records the member's remarks and sends them to a server.

[0397] The server uses voice recognition AI to convert what is said into text.

[0398] The server organizes the text of the remarks and automatically generates minutes.

[0399] The server transmits the generated minutes to the terminal and displays them to the user.

[0400] Examples:

[0401] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[0402] ---

[0403] Conversational AI support for lawmakers

[0404] explanation:

[0405] The user inputs a request for materials or data into the terminal.

[0406] The terminal sends a request to the server.

[0407] The server uses conversational AI to search for and prepare appropriate materials and data.

[0408] The server sends the search results to the terminal and provides them to the user.

[0409] Examples:

[0410] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[0411] ---

[0412] Parliamentary Data Visualization AI Function

[0413] explanation:

[0414] The server collects and analyzes data on the progress of the assembly.

[0415] The server automatically generates visualized information for citizens.

[0416] The server publishes the visualized information through the terminal.

[0417] The devices display visualized information to citizens via websites and apps.

[0418] Examples:

[0419] Comments made during the council meeting, the progress of agenda items, and the pros and cons will be converted into easy-to-read graphs and charts for citizens to view and published in real time on the local government's website.

[0420] ---

[0421] Emotion engine function

[0422] explanation:

[0423] The device collects emotional data from the user's (legislator's) statements and facial expressions.

[0424] The device transmits the emotion data to the server.

[0425] The server analyzes the data using an emotion engine and recognizes the user's emotional state.

[0426] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[0427] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[0428] Examples:

[0429] When a user says, "There's a problem with this plan," the emotion engine recognizes the dissatisfaction and sends the emotion data along with the content of the statement to the server. The server uses this information to enhance the analysis of pros and cons for the proposal and adds the emotion data to the progress visualization.

[0430] ---

[0431] The above is a concrete example of how this system can be implemented. By combining it with an emotion engine, it will be possible to analyze the pros and cons of bills more accurately, create minutes, and visualize progress. It will also be possible to provide information to citizens in a way that takes into account their emotional state, improving the transparency and reliability of parliaments.

[0432] The processing flow will be explained below.

[0433] Automatic bill generation function

[0434] Step 1:

[0435] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[0436] Step 2:

[0437] The terminal transmits the input requirement data for creating a proposal to the server.

[0438] Step 3:

[0439] The server calls up the generative AI model and automatically generates detailed proposals based on the received requirements data, for example, by referencing relevant laws and information on similar proposals from the past.

[0440] Step 4:

[0441] The server transmits the generated proposal to the terminal.

[0442] Step 5:

[0443] The terminal displays the generated proposal to the user.

[0444] ---

[0445] Real-time visualization of parliamentary progress

[0446] Step 1:

[0447] The device records the lawmakers' remarks in real time and collects audio data.

[0448] Step 2:

[0449] Using an emotion engine, the device collects emotional data from the speaker's facial expressions and tone of voice.

[0450] Step 3:

[0451] The terminal transmits the recorded voice data and emotion data to the server.

[0452] Step 4:

[0453] The server uses voice recognition AI to convert the voice data into text and analyze the content of the speech.

[0454] Step 5:

[0455] The server uses an emotion engine to analyze the emotion data and recognize the user's emotional state. For example, it extracts the emotion of "agree" or "disagree" along with the content of the comment.

[0456] Step 6:

[0457] The server consolidates the analysis results and generates progress visualization data (graphs, charts, etc.).

[0458] Step 7:

[0459] The server sends the visualization data to the terminal.

[0460] Step 8:

[0461] The terminal displays the visualized data to the user in real time.

[0462] ---

[0463] AI function for creating meeting minutes

[0464] Step 1:

[0465] The device records the lawmaker's remarks in real time.

[0466] Step 2:

[0467] The terminal transmits the recorded voice data and emotion data to the server.

[0468] Step 3:

[0469] The server uses voice recognition AI to convert the voice data into text.

[0470] Step 4:

[0471] The server links the emotional data with the textual content of the speech.

[0472] Step 5:

[0473] The server organizes the textual content of the remarks and emotional data and generates minutes.

[0474] Step 6:

[0475] The server transmits the generated minutes to the terminal.

[0476] Step 7:

[0477] The terminal displays the minutes to the user.

[0478] ---

[0479] Conversational AI support for lawmakers

[0480] Step 1:

[0481] The user inputs a request for the required materials or data into the terminal.

[0482] Step 2:

[0483] The device sends a question or request to the server.

[0484] Step 3:

[0485] The server uses conversational AI to search for the most appropriate materials and data, and also takes into account the user's emotional state using an emotion engine.

[0486] Step 4:

[0487] The server organizes the search results and prepares the necessary materials and data.

[0488] Step 5:

[0489] The server sends the prepared materials and data to the terminal.

[0490] Step 6:

[0491] The terminal displays materials and data to the user.

[0492] ---

[0493] Parliamentary Data Visualization AI Function

[0494] Step 1:

[0495] The server collects data on the progress of parliament (statements by members of parliament, content of discussions, votes for or against, etc.) in real time.

[0496] Step 2:

[0497] The device collects emotional data from the lawmaker's facial expressions and tone of voice and sends it to a server.

[0498] Step 3:

[0499] The server analyzes the progress and emotion data collected and generates information that can be visualized in an easy-to-understand manner for citizens.

[0500] Step 4:

[0501] The server automatically generates visualization information (such as graphs and charts) that integrates emotional data.

[0502] Step 5:

[0503] The server sends the automatically generated visualization information to the terminal and makes it available to citizens through websites and applications.

[0504] Step 6:

[0505] The terminals display visualization information through citizen websites and applications.

[0506] These are the specific processing steps of the invention that combines the emotion engine. As a result, emotional data is reflected in the analysis of pros and cons of bills, the creation of minutes, and the visualization of progress, improving the efficiency and transparency of parliamentary operations.

[0507] Example 2

[0508] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0509] In parliamentary operations, it is essential to draft bills, manage parliamentary proceedings, compile minutes, provide materials to assembly members, and disclose information to citizens. These tasks are usually performed manually, which requires a great deal of time and effort and is prone to human error. It is also difficult to manage assembly members' remarks and progress in real time and visualize them consistently. Furthermore, there is a lack of analysis and information provision that takes into account emotional data in parliamentary operations. A system that can solve these issues efficiently and accurately is needed.

[0510] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0511] In this invention, the server includes: a means for a user to input the theme and goals of the bill creation and automatically generate the bill using a generative AI model; a means for recording the remarks of assembly members in real time and sending the audio data to the server; a means for converting the remarks into text using speech recognition AI and generating summaries; a means for visualizing the progress and analyzing the pros and cons of the bill; a means for converting the recorded audio data into text and automatically generating minutes; a means for providing materials and data to assembly members using interactive AI; a means for visualizing assembly data for citizens and generating public information; and a means for recognizing the user's emotional state using an emotion engine and reflecting it in the analysis results. This enables consistent, efficient and highly accurate operations from drafting bills to managing the progress of the meeting, creating minutes, providing materials, and disclosing information to citizens. Furthermore, analysis that takes emotion data into account enables flexible assembly management that reflects the user's emotions.

[0512] An "automatic proposal generation means" is a means of automatically creating proposals based on themes and goals input by the user using a generative AI model.

[0513] The "means for visualizing progress in real time" involves recording the remarks of members of parliament in real time, sending the audio data to a server, converting it into text using voice recognition AI, and visualizing the progress and the approval or disapproval of bills.

[0514] A "generative AI model" is a type of artificial intelligence that uses pre-trained algorithms to generate new content based on input data.

[0515] "Conversational artificial intelligence" is artificial intelligence that generates appropriate responses to user input and provides materials and data.

[0516] An "emotion engine" is an algorithm that recognizes a user's emotional state from their words and facial expressions, and reflects this as an analysis result.

[0517] "Voice recognition AI" is artificial intelligence that converts voice data into text.

[0518] The "automatic minutes generation means" is a means for converting recorded audio data into text, organizing the text, and automatically creating minutes.

[0519] A "visualization method" is a method for converting and displaying data in a format that is visually easy to understand (graphs, charts, etc.).

[0520] "Emotion data" is data that indicates the emotional state of a user, collected from their utterances, facial expressions, and the like.

[0521] "Real-time recording means" refers to a means for instantly recording a member of parliament's remarks on the spot.

[0522] "Means for generating public information" refers to a means for generating information to make parliamentary data visible to citizens and make it public.

[0523] MODE FOR CARRYING OUT THE INVENTION

[0524] This invention is a system that supports parliamentary operations and is implemented using the following hardware and software. The main hardware uses client terminals (PCs, tablets, etc.) and high-performance servers. The software includes a generative AI model, conversational AI, speech recognition AI, and an emotion engine. This system provides the following functions: automatic bill generation, real-time visualization of progress, automatic generation of minutes, support for parliamentarians through conversational AI, visualization of parliamentary data for citizens, and emotion analysis.

[0525] 1. Automatic proposal generation function

[0526] overview:

[0527] The user inputs the theme and goals of the agenda creation using a client terminal.

[0528] The terminal transmits the input information to the server.

[0529] The server automatically generates proposals using a generative AI model and returns the results to the terminal.

[0530] The terminal displays the generated proposal to the user.

[0531] Examples:

[0532] The user sets the theme as "regional road development" and sends it to the server via the terminal.

[0533] The server passes prompts such as "Please create a detailed proposal for road development in the area" to the generative AI model, which then generates the proposal.

[0534] The server sends the generated proposal back to the terminal and displays it to the user.

[0535] 2. Real-time progress visualization

[0536] overview:

[0537] The device records the remarks of lawmakers in the conference room in real time.

[0538] The device sends the recorded data to the server.

[0539] The server uses voice recognition AI to convert what is said into text and generate a summary.

[0540] The server visualizes the progress and analyzes the pros and cons of proposals.

[0541] The server sends the visualization results to the terminal and displays them to the user.

[0542] Examples:

[0543] If a member of parliament says, "I support road construction," the audio is recorded in real time.

[0544] When the device sends the voice data to the server, the voice recognition AI converts it into text, saying "I support road construction," and creates a summary.

[0545] The server analyzes the data, graphs the progress and the approval or disapproval of the proposal, and sends it to the terminal for the user to review.

[0546] 3. Automatic minutes generation function

[0547] overview:

[0548] The device records the member's remarks and sends them to a server.

[0549] The server uses voice recognition AI to convert what is said into text.

[0550] The server organizes the text of the remarks and automatically generates minutes.

[0551] The server transmits the generated minutes to the terminal and displays them to the user.

[0552] Examples:

[0553] The device records the member of parliament's "statements regarding the road construction budget proposal" and sends them to the server.

[0554] The server converts the remarks into text, organizes the necessary information, automatically generates minutes, and displays them to the user.

[0555] 4. Conversational AI support for lawmakers

[0556] overview:

[0557] The user inputs a request for materials or data into the terminal.

[0558] The terminal sends the request to the server.

[0559] The server uses interactive artificial intelligence to search for and prepare relevant materials and data.

[0560] The server sends the search results to the terminal and provides them to the user.

[0561] Examples:

[0562] When a user requests "road construction budget data for the past five years," the request is sent from the terminal to the server.

[0563] The server passes the request to a conversational AI, which searches for the appropriate data and presents it to the device.

[0564] Users can check the data and use it to run the parliament.

[0565] 5. Parliamentary data visualization function

[0566] overview:

[0567] The server collects and analyzes data on the progress of the assembly.

[0568] The server automatically generates visualized information for citizens.

[0569] The server publishes the visualized information through the terminal.

[0570] The devices display visualized information to citizens via websites and apps.

[0571] Examples:

[0572] Remarks made during the assembly, the progress of agenda items, and the pros and cons of each item are converted into graphs and charts and published in real time on the local government's website.

[0573] 6. Emotion engine function

[0574] overview:

[0575] The device collects emotional data from the lawmakers' statements and facial expressions.

[0576] The device transmits the emotion data to the server.

[0577] The server uses an emotion engine to analyze the data and recognize the user's emotional state.

[0578] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[0579] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[0580] Examples:

[0581] When a member of parliament says, "There is a problem with this plan," the device collects emotional data of dissatisfaction along with the statement and sends it to the server.

[0582] The server analyzes the data and reflects the results in a pros / cons analysis and progress visualization, which is finally displayed to the user.

[0583] In this way, the system can provide a complete parliamentary management support system with functions for drafting bills, managing proceedings, searching data, disclosing information to citizens, and analyzing sentiment data.

[0584] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0585] Processing steps for the automatic proposal generation function

[0586] Step 1:

[0587] The user inputs the theme and goal of the proposal creation.

[0588] Specific operation: The user inputs a theme such as "regional road development" or the goal of a proposal into an input form on a client terminal.

[0589] Input: Proposal topic, objectives, required information

[0590] Output: The input data

[0591] Step 2:

[0592] The terminal transmits the input information to the server.

[0593] Specific operation: The terminal sends the input data to the server using the HTTPS protocol.

[0594] Input: Data entered

[0595] Output: Send data to the server

[0596] Step 3:

[0597] The server receives the information and generates a proposal using a generation AI.

[0598] Specific operation: The server passes the prompt "Please create a detailed proposal for road development in the area" to the generation AI model, and generates a proposal.

[0599] Input: User-entered themes and goals

[0600] Output: Auto-generated proposals

[0601] Step 4:

[0602] The server transmits the generated proposal to the terminal.

[0603] Specific operation: The server compiles the generated proposals in JSON format and sends them to the terminal.

[0604] Input: Auto-generated proposal

[0605] Output: Sending data to the terminal

[0606] Step 5:

[0607] The terminal displays the generated proposal to the user.

[0608] Specific operation: The device displays the received proposal on the screen so that the user can check the contents.

[0609] Input: Proposal data from the server

[0610] Output: The displayed proposal

[0611] Real-time visualization of progress of processing steps

[0612] Step 1:

[0613] The device records the lawmaker's remarks in real time.

[0614] Specific operation: The device uses the microphone in the conference room to record the member's remarks.

[0615] Input: Congressman's statement

[0616] Output: Recorded audio data

[0617] Step 2:

[0618] The terminal transmits the voice data to the server.

[0619] Specific operation: The device sends the recorded audio data to the server in real time.

[0620] Input: Recorded audio data

[0621] Output: Send audio data to the server

[0622] Step 3:

[0623] The server uses voice recognition AI to convert what is said into text.

[0624] Specific operation: The server uses voice recognition AI to convert the received voice data into text.

[0625] Input: Audio data

[0626] Output: Translated utterances

[0627] Step 4:

[0628] The server visualizes the progress and analyzes the pros and cons of proposals.

[0629] Specific operation: The server analyzes the textual comments and converts the progress and the pros and cons of the proposals into graphs and charts.

[0630] Input: Textual statements, pros and cons data

[0631] Output: visualized data (graphs, charts)

[0632] Step 5:

[0633] The server sends the visualization results to the terminal.

[0634] Specific operation: The server compiles the visualization data in JSON format and sends it to the terminal.

[0635] Input: Visualized data

[0636] Output: Sending data to the terminal

[0637] Step 6:

[0638] The terminal displays the visualization results to the user.

[0639] Specific operation: The device displays the visualization data received on the screen as graphs and charts.

[0640] Input: Visualization data from the server

[0641] Output: The displayed visualization result

[0642] Processing steps of the meeting minutes automatic generation function

[0643] Step 1:

[0644] The device records the member's remarks and sends them to a server.

[0645] Specific operation: The device records the member's speech and sends the audio data to the server.

[0646] Input: Congressman's statement

[0647] Output: Send audio data to the server

[0648] Step 2:

[0649] The server uses voice recognition AI to convert what is said into text.

[0650] Specific operation: The server uses voice recognition AI to convert the received voice data into text.

[0651] Input: Audio data

[0652] Output: Translated utterances

[0653] Step 3:

[0654] The server organizes the text of the remarks and automatically generates minutes.

[0655] Specific operation: The server organizes the textual comments and compiles them into minutes.

[0656] Input: Transcribed speech

[0657] Output: Auto-generated meeting transcript

[0658] Step 4:

[0659] The server transmits the generated minutes to the terminal and displays them to the user.

[0660] Specific operation: The server sends the generated minutes to the terminal, and the terminal displays the contents to the user.

[0661] Input: Auto-generated meeting minutes

[0662] Output: Display the minutes to the user

[0663] Processing steps for the lawmaker support function using conversational AI

[0664] Step 1:

[0665] The user inputs a request for materials or data into the terminal.

[0666] Specific operation: The user requests "road construction budget data for the past five years" from the client terminal interface.

[0667] Input: Request for materials or data

[0668] Output: The requested data entered

[0669] Step 2:

[0670] The terminal sends a request to the server.

[0671] Specific operation: The device compiles the requested data and sends it to the server.

[0672] Input: The requested data

[0673] Output: Sends request data to the server

[0674] Step 3:

[0675] The server uses conversational AI to search for and prepare relevant materials and data.

[0676] Specific operation: The server uses conversational AI to search for "budget data for road construction over the past five years" and prepares the appropriate data.

[0677] Input: The requested data

[0678] Output: Search results and data

[0679] Step 4:

[0680] The server sends the search results to the terminal and provides them to the user.

[0681] Specific operation: The server sends prepared materials and data to the terminal so that the user can check them.

[0682] Input: Prepared materials and data

[0683] Output: Sending materials and data to the terminal and providing them to the user

[0684] Parliamentary Data Visualization Feature Processing Steps

[0685] Step 1:

[0686] The server collects and analyzes data on the progress of the assembly.

[0687] Specific operation: The server collects and analyzes data generated during the session (such as statements, progress on agenda items, and votes for or against).

[0688] Input: Congressional proceedings data

[0689] Output: Parsed data

[0690] Step 2:

[0691] The server automatically generates visualized information for citizens.

[0692] Specific operation: The server uses the analyzed data to automatically generate graphs and charts that are easy for citizens to understand.

[0693] Input: Parsed data

[0694] Output: Automatically generated visualization information

[0695] Step 3:

[0696] The server publishes the visualized information through the terminal.

[0697] Specific operation: The server sends the generated visualization information to the device and makes it available via a website or app.

[0698] Input: Automatically generated visualization information

[0699] Output: Sending and publishing data to a device

[0700] Step 4:

[0701] The devices display visualized information to citizens via websites and apps.

[0702] Specific operation: The visualized information received by the device is displayed on a website or app screen for citizens to see.

[0703] Input: Visualization information from the server

[0704] Output: Display information to citizens

[0705] Emotion Engine Function Processing Steps

[0706] Step 1:

[0707] The device collects emotional data from the user's (legislator's) statements and facial expressions.

[0708] How it works: The device uses the lawmaker's camera and microphone to collect real-time emotional data from what they say and their facial expressions.

[0709] Input: Speech content, facial expression

[0710] Output: Emotion data

[0711] Step 2:

[0712] The device transmits the emotion data to the server.

[0713] Specific operation: The device sends the collected emotion data to the server.

[0714] Input: Emotion data

[0715] Output: Send data to the server

[0716] Step 3:

[0717] The server uses an emotion engine to analyze the data and recognize the user's emotional state.

[0718] Specific operation: The server uses the emotion engine to analyze the received emotion data and recognize the user's emotional state.

[0719] Input: Emotion data

[0720] Output: Analysis results

[0721] Step 4:

[0722] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[0723] Specific operation: The server applies the recognized emotion data to other system functions, such as analyzing pros and cons, visualizing progress, and creating meeting minutes.

[0724] Input: Emotion data, other function data

[0725] Output: Analysis results reflecting emotion data

[0726] Step 5:

[0727] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[0728] Specific operation: The server sends the analysis results, including emotion data, to the device, which then displays the results on the screen.

[0729] Input: Analysis results containing emotion data

[0730] Output: what is displayed to the user

[0731] As described above, through the processing steps of each function, this system supports parliamentary operations, enabling efficient and accurate drafting of bills, recording of minutes, progress management, sentiment analysis, and disclosure of information to citizens.

[0732] (Application example 2)

[0733] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0734] In conventional factory systems, the generation of production instructions, the monitoring of the progress of the production line, the recording of work content, and the management of production records are often done manually, resulting in a large amount of labor and time consumption and inefficiency. The present invention aims to solve these problems and provide an efficient and automated production management system. It also provides a means for understanding the emotional state of workers and appropriately managing the work environment.

[0735] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0736] In this invention, the server includes a means for automatically generating production instructions, a means for visualizing the progress of the production line in real time, a means for recording work content and automatically generating production records, a means for providing materials and data to workers using interactive AI, a means for visualizing production data for managers and generating public information, and a means for recognizing and analyzing worker emotions. This enables the automation and efficiency of production management and improves the work environment.

[0737] "Production instructions" refers to instructions or orders that direct the production of specific tasks or products in a factory.

[0738] "Auto-generation" refers to the creation of data or information by a system using pre-set algorithms or processes without human intervention.

[0739] A "production line" refers to a series of equipment or arrangements in which multiple processes or work steps are carried out consecutively in the production process of a product.

[0740] "Status" refers to the state or condition that indicates the stage at which a particular project or task is.

[0741] "Real-time" refers to a state in which information or data is processed or displayed the moment it is generated.

[0742] "Visualization" refers to converting data and information into a visually easy-to-understand form and displaying it.

[0743] "Work content" refers to the specific actions and steps performed in a particular job or task.

[0744] "Production records" refers to documents and data that record various data and events that occur during the production process of a product.

[0745] "Conversational artificial intelligence" refers to AI systems designed to converse with humans in a natural way, providing information in response to questions and commands.

[0746] "Materials" refers to documents or data containing information for a particular purpose or topic.

[0747] "Data" refers to a collection of information, such as facts and figures, that can be used for calculations and analysis.

[0748] "Administrator-oriented" means that the system or data is intended primarily for administrator use.

[0749] "Recognizing emotions" refers to determining a person's emotional state from facial expressions, tone of voice, etc.

[0750] "Analyze" refers to examining data or information in detail to clarify its meaning and structure.

[0751] The system that realizes this application example is a robot-equipped AI system that supports factory production line management. This system includes functions such as automatic generation of production instructions, real-time visualization of production line progress, automatic generation of work records and production records, support for workers using interactive AI, visualization of production data for managers, and recognition and analysis of worker emotions.

[0752] Automatic production instruction generation function

[0753] The server automatically generates production instructions based on order and inventory data. Users input order details into a terminal, and the server automatically generates appropriate production instructions using a generative AI model. This reduces the time and effort required to create production instructions.

[0754] Real-time visualization of production line progress

[0755] The server monitors and visualizes the progress of the production line in real time. The terminals send data obtained from sensors to the server, which analyzes the data and displays the progress as graphs and charts. This allows managers to grasp the current status of the production line at a glance.

[0756] Production record creation AI function

[0757] The server records the robot's work and production progress in real time and automatically creates a production record. The server converts the data recorded by the terminal into text, organizes and compiles it into a production record. This function eliminates the need to manually create production records.

[0758] Conversational AI-based worker support function

[0759] The server uses conversational artificial intelligence to provide appropriate information in response to questions and document requests from workers. When a worker enters a query into their terminal, the server searches for relevant documents and data and provides them through the terminal. This function allows workers to quickly obtain the information they need.

[0760] Production data visualization AI function

[0761] The server collects and analyzes production data and generates visualized information for managers. The server analyzes data acquired through terminals and provides visualized information such as graphs and charts to managers. This function allows managers to efficiently grasp the overall picture of production.

[0762] Emotion engine function

[0763] The server collects data on workers' facial expressions and voices and analyzes it using an emotion engine. The server then analyzes the emotion data acquired by the device and uses it to improve the work environment. The results of this analysis are linked with other functions to contribute to optimizing the work environment.

[0764] As a concrete example, consider the case where a worker requests production instructions. The user enters order data into a terminal, and production instructions are automatically generated using a generative AI model. In this process, the following prompt sentences are used:

[0765] Example prompt sentence:

[0766] "Please generate production instructions based on the following order data.

[0767] Order ID: 12345

[0768] Product Name: Part A

[0769] Quantity: 100"

[0770] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0771] Step 1:

[0772] The user enters order data into the terminal and sends the data to the server. The user enters the necessary information such as product name, quantity, and deadline, and clicks the send button to send the input data to the server. The input includes the order ID, product name, quantity, and deadline.

[0773] Step 2:

[0774] The server uses the generative AI model to carry out the process of automatically generating production instructions. The server inputs the received order data into the AI ​​model and generates appropriate production instructions using an algorithm. During this process, the server obtains necessary information from the relevant database and performs data calculations. The output includes the generated production instructions.

[0775] Step 3:

[0776] The server sends the generated production instructions to the terminal and displays them to the user. The generated production instructions are received by the terminal and displayed on the user's screen. The user checks the production instructions and makes corrections as necessary. The input includes production instruction data from the server, and the output includes a display to the user.

[0777] Step 4:

[0778] The terminal acquires data from sensors on the progress of the production line in real time and sends it to the server. The terminal collects data obtained from the sensors and periodically sends it to the server. The input includes progress data from the sensors, and the output includes data sent to the server.

[0779] Step 5:

[0780] The server analyzes the progress data in real time and generates graphs and charts for visualization. The server analyzes the data it receives and creates graphs and charts for easy-to-understand progress display. This includes data processing and calculations. The output includes visualized graphs and charts.

[0781] Step 6:

[0782] The server sends the visualized progress data to the terminal and displays it to the user. The terminal updates the screen displaying the progress status for the administrator based on the received data. The input includes the visualized data from the server, and the output includes the display to the user.

[0783] Step 7:

[0784] The terminal accepts questions and requests for materials from workers and sends them to the server. When a worker enters a question or request for materials into the terminal and clicks the send button, the data is sent to the server. The input includes the question data from the worker, and the output is the data sent to the server.

[0785] Step 8:

[0786] The server uses conversational artificial intelligence to search for and prepare the requested materials and data. It searches for appropriate materials based on the received query data and compiles the results. The input includes the query data from the worker, and the output includes the search results.

[0787] Step 9:

[0788] The server sends the retrieved materials and data to the terminal and provides them to the worker. The terminal displays the received materials to the worker. The input includes the material data from the server, and the output includes the display to the worker.

[0789] Step 10:

[0790] The terminal collects emotional data such as facial expressions and tone of voice of the worker and sends it to the server. This data, collected using a camera and microphone, is periodically sent to the server. The input includes emotional data, and the output includes transmission to the server.

[0791] Step 11:

[0792] The server uses an emotion engine to analyze the received emotion data and recognize the emotional state. It performs data analysis and determines the emotional state of the worker. The input includes emotion data, and the output includes the emotion analysis results.

[0793] Step 12:

[0794] The server connects the results of the emotion analysis with other system functions to help improve the overall system. Based on the analysis results, progress can be visualized and production instructions can be adjusted. The input includes the emotion analysis results, and the output includes the optimization of other system functions.

[0795] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0796] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0797] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0798] [Second embodiment]

[0799] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0800] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0801] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0802] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0803] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0804] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0805] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0806] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0807] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0808] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0809] In the smart glasses 214, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0810] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0811] The system of the present invention has the following main functions:

[0812] 1. Automatic proposal generation function

[0813] 2. Real-time visualization of parliamentary progress

[0814] 3. AI Minute-Taking Function

[0815] 4. Conversational AI support for lawmakers

[0816] 5. AI Function for Visualizing Parliamentary Data

[0817] These functions will now be described in detail.

[0818] ---

[0819] Automatic bill generation function

[0820] explanation:

[0821] The user inputs the requirements for creating a proposal into the terminal.

[0822] The terminal transmits the input information to the server.

[0823] The server automatically generates proposals using generation AI and sends them to the terminal.

[0824] The terminal displays the generated proposal to the user.

[0825] Examples:

[0826] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[0827] ---

[0828] Real-time visualization of parliamentary progress

[0829] explanation:

[0830] The device records the member's remarks in real time and sends them to a server.

[0831] The server uses voice recognition AI to analyze the content of the speech and generate a summary.

[0832] The server visualizes the progress and analyzes the pros and cons of proposals.

[0833] The server sends the visualization results to the terminal and displays them to the user.

[0834] Examples:

[0835] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[0836] ---

[0837] AI function for creating meeting minutes

[0838] explanation:

[0839] The device records the member's remarks and sends them to a server.

[0840] The server uses voice recognition AI to convert what is said into text.

[0841] The server organizes the text of the remarks and automatically generates minutes.

[0842] The server transmits the generated minutes to the terminal and displays them to the user.

[0843] Examples:

[0844] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[0845] ---

[0846] Conversational AI support for lawmakers

[0847] explanation:

[0848] The user inputs a request for materials or data into the terminal.

[0849] The terminal sends a request to the server.

[0850] The server uses conversational AI to search for and prepare appropriate materials and data.

[0851] The server sends the search results to the terminal and provides them to the user.

[0852] Examples:

[0853] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[0854] ---

[0855] Parliamentary Data Visualization AI Function

[0856] explanation:

[0857] The server collects and analyzes data on the progress of the assembly.

[0858] The server automatically generates visualized information for citizens.

[0859] The server publishes the visualized information through the terminal.

[0860] The devices display visualized information to citizens via websites and apps.

[0861] Examples:

[0862] Comments made during the council meeting, the progress of agenda items, and the pros and cons will be converted into easy-to-read graphs and charts for citizens to view and published in real time on the local government's website.

[0863] ---

[0864] This system aims to improve the efficiency of parliamentary operations by analyzing and visualizing the remarks of assembly members and the progress of parliament in real time, and by providing multiple functions such as automatically generating minutes and providing materials.In addition, by providing information to citizens in real time, it is also intended to improve the transparency and reliability of parliament.

[0865] The processing flow will be explained below.

[0866] Automatic bill generation function

[0867] Step 1:

[0868] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[0869] Step 2:

[0870] The terminal transmits the input requirement data for creating a proposal to the server.

[0871] Step 3:

[0872] The server calls up the generative AI model and automatically generates detailed proposals based on the received requirements data, for example, by referencing relevant laws and information on similar proposals from the past.

[0873] Step 4:

[0874] The server transmits the generated proposal to the terminal.

[0875] Step 5:

[0876] The terminal displays the generated proposal to the user.

[0877] ---

[0878] Real-time visualization of parliamentary progress

[0879] Step 1:

[0880] The device records the lawmaker's remarks in real time.

[0881] Step 2:

[0882] The device sends the recorded audio data to the server.

[0883] Step 3:

[0884] The server uses voice recognition AI to convert the recorded data into text and analyze the content of the speech.

[0885] Step 4:

[0886] The server summarizes the analyzed speech.

[0887] Step 5:

[0888] The server analyzes the pros and cons of the proposals from the textual content of the comments and tallys up the number of opinions in favor and against.

[0889] Step 6:

[0890] The server generates progress visualization data (graphs, charts, etc.).

[0891] Step 7:

[0892] The server sends the visualization data to the terminal.

[0893] Step 8:

[0894] The terminal displays the visualized data to the user in real time.

[0895] ---

[0896] AI function for creating meeting minutes

[0897] Step 1:

[0898] The device records the lawmaker's remarks in real time.

[0899] Step 2:

[0900] The device sends the recorded audio data to the server.

[0901] Step 3:

[0902] The server uses voice recognition AI to convert the voice data into text.

[0903] Step 4:

[0904] The server automatically organizes the textual content of the remarks and generates minutes.

[0905] Step 5:

[0906] The server transmits the generated minutes to the terminal.

[0907] Step 6:

[0908] The terminal displays the minutes to the user.

[0909] ---

[0910] Conversational AI support for lawmakers

[0911] Step 1:

[0912] The user inputs questions or requests about the materials or data they need into the terminal.

[0913] Step 2:

[0914] The device sends a question or request to the server.

[0915] Step 3:

[0916] The server uses conversational AI to search for the most appropriate materials and data based on the request.

[0917] Step 4:

[0918] The server organizes the search results and prepares the necessary materials and data.

[0919] Step 5:

[0920] The server sends the prepared materials and data to the terminal.

[0921] Step 6:

[0922] The terminal displays materials and data to the user.

[0923] ---

[0924] Parliamentary Data Visualization AI Function

[0925] Step 1:

[0926] The server collects data on the progress of parliament (statements by members of parliament, content of discussions, votes for or against, etc.) in real time.

[0927] Step 2:

[0928] The server analyzes the collected data and generates information that can be visualized in an easy-to-understand manner for citizens.

[0929] Step 3:

[0930] The server automatically generates visualization information in a visual format (such as graphs or charts).

[0931] Step 4:

[0932] The server sends the generated visualization information to the terminal and makes it available to citizens through websites and applications.

[0933] Step 5:

[0934] The terminals display visualization information through citizen websites and applications.

[0935] The above are the specific processing steps for each function of this system, and are necessary to efficiently support the management of local government assemblies.

[0936] Example 1

[0937] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0938] Traditional parliamentary operations involve a large amount of manual work, making things like drafting bills, compiling minutes, managing parliamentary progress, and searching for and providing materials extremely inefficient. It's also difficult to visualize parliamentary data and provide information to citizens in real time, creating a need for greater transparency. There's a need to solve these problems and improve the efficiency of parliamentary operations and the provision of information to citizens.

[0939] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0940] In this invention, the server includes means for receiving requirements for bill creation input by a user and using a generative AI model to automatically generate bills, means for recording council members' remarks in real time, analyzing the remarks using voice recognition technology, and visualizing the progress, means for analyzing the remarks and generating summaries, means for aggregating and analyzing votes for and against bills in real time, means for recording council members' remarks, converting them into text using voice recognition technology, and automatically generating minutes, means for providing materials and data in response to user requests using interactive AI, and means for analyzing council data, visualizing it for citizens, and generating and displaying public information. This improves the efficiency of council operations and enables real-time information provision and improved transparency.

[0941] "User" means a person or entity that operates the system and inputs and uses information.

[0942] A "terminal" is a device (e.g., a PC, tablet, smartphone, etc.) that a user uses to operate the system.

[0943] A "server" is a computer or network system that centralizes the processing of the entire system and receives and transmits data.

[0944] A "bill" is a formal proposal or plan submitted to Parliament for consideration.

[0945] A "generative AI model" is an algorithm or system that uses artificial intelligence technology to automatically generate text or data.

[0946] A "parliament" is an organization where representatives of public institutions and organizations gather to discuss and decide on policies, laws, budgets, etc.

[0947] "Progress" is information that indicates the progress of each bill or agenda item in the assembly.

[0948] "Voice recognition technology" is a technology that analyzes voice data and converts it into text data.

[0949] A "summary" is a short summary of the main points of the original information.

[0950] "For or against" refers to opinions or voting results in favor or against a motion or proposal.

[0951] "Documents" are reference materials such as data, documents, statistics, etc. used by Parliament.

[0952] "Conversational AI" is an AI system that can naturally interact with users, answering their questions and providing them with information.

[0953] "Visualization" refers to the visual representation of data in the form of a graph, chart, or other form.

[0954] "Public information" is information relating to Parliament that is made accessible to citizens and the general public.

[0955] Minutes are official documents that record statements and decisions made in parliament.

[0956] The system of the present invention aims to improve the efficiency and transparency of parliamentary operations and has the following main functions, which are implemented by the server, terminals, and users.

[0957] 1. Automatic proposal generation function

[0958] explanation:

[0959] The user inputs the requirements for creating a proposal into the terminal. For example, the user may request the creation of a proposal on the theme of "regional road development."

[0960] The terminal sends the input information to the server, which includes supplementary information such as the topic, budget, deadline, and stakeholders.

[0961] The server automatically generates a proposal using a generative AI model. Specifically, the server analyzes the user's input information and provides the generative AI model (e.g., OpenAI GPT-4) with a prompt such as, "Please create a proposal regarding road construction in the area."

[0962] The server transmits the generated proposal to the terminal.

[0963] The device displays the generated agenda to the user. The agenda is provided in a human-readable format (e.g., PDF or Word document).

[0964] 2. Real-time visualization of parliamentary progress

[0965] explanation:

[0966] The device records the speech of the legislator in real time, and audio data is acquired using microphones placed in the conference room.

[0967] The device sends the recorded data to the server. The recorded data is packetized at regular intervals (e.g., every 10 seconds) and sent.

[0968] The server analyzes what is being said using speech recognition technology, for example, the Google Cloud Speech-to-Text API, to convert the speech data into text.

[0969] The server visualizes the progress, tallies votes for and against proposals, generates summaries, and converts statements and votes into graphs and charts.

[0970] The server sends the visualization results to the terminal.

[0971] The device displays the visualization results to the user, and the visualization data is provided on a web page or within a dedicated app.

[0972] 3. AI Minute-Taking Function

[0973] explanation:

[0974] The device records the speech of the legislator. For example, audio data is acquired using a microphone placed in the conference room.

[0975] The device sends the recorded data to the server in batches.

[0976] The server converts what is said into text using speech recognition technology, for example, Amazon Transcribe.

[0977] The server organizes the transcribed remarks and automatically generates minutes. It uses a natural language processing algorithm to analyze the context and automatically generates minutes according to the format.

[0978] The server transmits the generated minutes to the terminal.

[0979] The terminal displays the minutes to the user, which are provided in formats such as PDF.

[0980] 4. Conversational AI support for lawmakers

[0981] explanation:

[0982] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[0983] The terminal sends a request to the server, which converts the request into a prompt.

[0984] The server uses conversational artificial intelligence to search for appropriate materials and data, and performs the search process using a generative AI model (e.g., OpenAI GPT-4).

[0985] The server sends the search results to the device. The data is sent in JSON format or similar.

[0986] The terminal provides the search results to the user, using graphs and tables as display formats.

[0987] 5. AI Function for Visualizing Parliamentary Data

[0988] explanation:

[0989] The server collects data on the progress of the parliament and periodically retrieves data from the parliament system.

[0990] The server analyzes the progression data and uses analysis algorithms to extract important information.

[0991] The server automatically generates visualized information for citizens and converts the generated data into graphs and charts.

[0992] The server publishes the visualization information, which is then published via a Web API.

[0993] The device displays the visualized information to citizens, who can access it through the local government's website or app, for example.

[0994] This system will improve the efficiency of parliamentary operations, provide real-time information, and increase transparency.

[0995] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0996] Automatic bill generation function

[0997] Processing Steps:

[0998] Step 1:

[0999] The user inputs the requirements for creating a proposal into the terminal. For example, the topic is "regional road development," and necessary supplementary information such as the budget and deadline is included.

[1000] Step 2:

[1001] The terminal sends the entered information to the server. The entered data is encrypted and sent using a secure communication protocol (e.g. HTTPS). Input: Proposal creation requirements entered by the user. Output: Encrypted data packet.

[1002] Step 3:

[1003] The server automatically generates a proposal using a generative AI model. The server analyzes the user's input information and provides the generative AI model with a prompt: "Please create a proposal regarding road improvement in the area." Input: Encrypted data packet. Output: Automatically generated proposal data.

[1004] Step 4:

[1005] The server sends the generated proposal to the terminal. The output data is formatted as needed. Input: Automatically generated proposal data. Output: Formatted proposal data.

[1006] Step 5:

[1007] The terminal displays the generated agenda to the user. The agenda is displayed in a format that is easy for humans to understand, such as a PDF or Word document. Input: Formatted agenda data. Output: Agenda in a format that can be viewed by the user.

[1008] ---

[1009] Real-time visualization of parliamentary progress

[1010] Processing Steps:

[1011] Step 1:

[1012] The device records the speech of the legislator in real time, and captures the audio data using microphones placed in the conference room.

[1013] Step 2:

[1014] The device sends the recorded data to the server. The recorded data is packetized at regular intervals and sent over the network. Input: Recorded voice data. Output: Packetized voice data.

[1015] Step 3:

[1016] The server analyzes the speech using speech recognition technology. The speech data is converted into text data using a speech recognition engine (for example, Google Cloud Speech-to-Text API). Input: Packetized speech data. Output: Texted speech.

[1017] Step 4:

[1018] The server visualizes the progress and tally the votes for and against the proposals. The server analyzes the content of the comments and the information on the votes for and against, and converts it into graphs and charts. Input: Textualized content of the comments. Output: Visualized progress data.

[1019] Step 5:

[1020] The server sends the visualization results to the terminal. Input: visualized progress data. Output: formatted visualization data.

[1021] Step 6:

[1022] The device displays the visualization results to the user. The visualized data is displayed on a web page or in a dedicated app. Input: Formatted visualized data. Output: Visualized data in a format that can be viewed by the user.

[1023] ---

[1024] AI function for creating meeting minutes

[1025] Processing Steps:

[1026] Step 1:

[1027] The device records what the council member says, collecting audio data using microphones placed in the conference room.

[1028] Step 2:

[1029] The device sends the recorded data to the server. The data is batch processed at regular intervals and sent. Input: Recorded audio data. Output: Batched audio data.

[1030] Step 3:

[1031] The server uses speech recognition technology to convert the speech into text. A speech recognition engine (e.g., Amazon Transcribe) is used to convert the speech data into text. Input: Batched speech data. Output: Translated speech.

[1032] Step 4:

[1033] The server organizes the textual content of remarks and automatically generates minutes. A natural language processing algorithm is used to organize the text data and convert it into a format suitable for the minutes format. Input: Textual content of remarks. Output: Automatically generated minutes.

[1034] Step 5:

[1035] The server sends the generated minutes to the terminal. The generated minutes are converted into a format such as PDF or Word document. Input: Automatically generated minutes. Output: Formatted minutes data.

[1036] Step 6:

[1037] The terminal displays the minutes to the user. The generated minutes are displayed in a format that can be easily viewed by the user. Input: Formatted minutes data. Output: Minutes in a format that can be viewed by the user.

[1038] ---

[1039] Conversational AI support for lawmakers

[1040] Processing Steps:

[1041] Step 1:

[1042] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[1043] Step 2:

[1044] The terminal sends a request to the server. The request content is converted into a prompt sentence format and sent. Input: User's request content. Output: Data in prompt sentence format.

[1045] Step 3:

[1046] The server uses conversational artificial intelligence to search for appropriate materials and data. It uses a conversational AI model (e.g., OpenAI GPT-4) to search for appropriate information from databases and online resources. Input: Data in the form of a prompt sentence. Output: Search result data.

[1047] Step 4:

[1048] The server sends the search results to the terminal. The search results are formatted in JSON format and sent. Input: Search result data. Output: Formatted search result data.

[1049] Step 5:

[1050] The terminal provides the search results to the user. Graphs, tables, etc. are used as display formats. Input: Formatted search result data. Output: Search results in a format that can be viewed by the user.

[1051] ---

[1052] Parliamentary Data Visualization AI Function

[1053] Processing Steps:

[1054] Step 1:

[1055] The server collects the progress data of the assembly. It periodically obtains data from the assembly system. Input: Progress data from the assembly system. Output: Collected progress data.

[1056] Step 2:

[1057] The server parses the progress data. It uses parsing algorithms to extract important information and convert it into the required format. Input: Collected progress data. Output: Parsed progress data.

[1058] Step 3:

[1059] The server automatically generates visualized information for citizens. It converts the data into graphs and charts, making it easy for citizens to understand. Input: Analyzed progress data. Output: Visualized information data.

[1060] Step 4:

[1061] The server publishes the visualized information. The automatically generated visualized data is published via a Web API. Input: visualized information data. Output: data via the public API.

[1062] Step 5:

[1063] The device displays the visualized information to citizens. For example, it is made accessible to citizens through the local government's website or app. Input: Data via public API. Output: Visualized data in a format that citizens can view.

[1064] These processing steps will improve the efficiency of parliamentary operations, provide real-time information to citizens, and increase transparency.

[1065] (Application example 1)

[1066] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1067] Conventional parliamentary management support systems were limited to basic functions such as automatically generating bills and visualizing parliamentary progress, and were therefore unable to handle practical matters outside of parliament or security management. In particular, they lacked the functionality to analyze surveillance footage in real time and issue an immediate warning when an abnormality was detected, making it difficult to ensure safety in situations where a rapid response was required. These issues need to be resolved.

[1068] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1069] In this invention, the server includes a means for automatically generating bills, a means for visualizing the progress of the assembly in real time, a means for analyzing video data from a monitoring device in real time to detect abnormalities, a means for issuing an immediate warning when an abnormality is detected, and a means for visualizing the results of the real-time analysis. This enables support for assembly operations as well as real-time detection of abnormalities and immediate warnings using the monitoring device.

[1070] "Means for automatically generating proposals" refers to functions and processes for automatically creating proposals based on input requirements.

[1071] "Means for visualizing the progress of parliamentary proceedings in real time" refers to the function and process of aggregating statements and progress made during parliamentary proceedings in real time and displaying them in a visually easy-to-understand manner.

[1072] The "means for generating a summary of speech content" refers to a function and process for analyzing the speech of a member of parliament and automatically generating a summary that concisely summarizes the content.

[1073] "Means for analyzing the pros and cons of bills" refers to the function and process for compiling and analyzing each member's position on bills in parliament, whether for or against.

[1074] "Means for automatically generating minutes" refers to the functions and processes for converting statements made during a meeting into text, organizing it, and automatically generating it as minutes.

[1075] "Means for providing materials and data to members of parliament using interactive artificial intelligence" refers to the functions and processes for using interactive artificial intelligence to search for and provide materials and data in response to requests from members of parliament.

[1076] "Means for visualizing parliamentary data for citizens and generating public information" refers to the functions and processes for collecting and analyzing parliamentary progress data, visualizing it in a form that is easy for citizens to understand, and generating it as public information.

[1077] "Means for analyzing video data from a monitoring device in real time and detecting abnormalities" refers to functions and processes for analyzing video data sent from a monitoring device in real time and detecting abnormal behavior or abnormal conditions.

[1078] "Means for immediately issuing a warning when an abnormality is detected" refers to a function and process for immediately issuing a warning when an abnormality is detected through analysis of video data by a monitoring device.

[1079] "Means for visualizing the results of real-time analysis" refers to the functions and processes for visually displaying the results of video data analysis by a monitoring device in real time and providing them to users.

[1080] The system of the present invention has multiple functions to support parliamentary operations and analyze video data from surveillance equipment in real time. This system operates in cooperation with a server, terminals, and users. Each function and its implementation will be described below.

[1081] Automatic bill generation function

[1082] explanation:

[1083] When a user inputs the requirements for creating a proposal into the device, the device sends it to the server. The server automatically generates a proposal from the input requirements using a generative AI model and returns the proposal to the device. The device then displays the generated proposal to the user.

[1084] Examples:

[1085] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[1086] Real-time visualization of parliamentary progress

[1087] explanation:

[1088] The device records the speech of the legislator in real time and sends it to the server. The server uses speech recognition AI to analyze the speech and generate a summary. It also visualizes the progress and analyzes the pros and cons of the bills. The results are sent to the device and displayed to the user.

[1089] Examples:

[1090] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[1091] AI function for creating meeting minutes

[1092] explanation:

[1093] The device records the remarks of the legislators and sends them to the server. The server uses speech recognition AI to convert the remarks into text, and then organizes the text to automatically generate minutes. The generated minutes are sent to the device and displayed to the user.

[1094] Examples:

[1095] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[1096] Conversational AI support for lawmakers

[1097] explanation:

[1098] When a user inputs a request for materials or data into the device, the device sends it to the server, which uses conversational AI to search for and prepare the appropriate materials or data. The search results are sent to the device and provided to the user.

[1099] Examples:

[1100] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[1101] Parliamentary Data Visualization AI Function

[1102] explanation:

[1103] The server collects and analyzes data on the progress of parliamentary meetings. Visualized information is automatically generated for citizens and made available via devices. Users can view the visualized information via a website or app.

[1104] Examples:

[1105] Graphs and charts of comments made during the assembly, the progress of agenda items, and the approval or disapproval status will be published in real time on the local government's website.

[1106] Real-time analysis function of the monitoring system

[1107] explanation:

[1108] The device sends video data from the monitoring device to the server in real time, and the server uses video analysis AI to detect abnormalities. If an abnormality is detected, the server immediately sends an alert to the device and notifies the user. The analysis results are then visualized and displayed.

[1109] Examples:

[1110] If a suspicious person is caught on camera in the office at night, the video will be analyzed immediately and a notification such as "Abnormal person detected in the office" will be sent to the smartphone. At the same time, the analysis results will be displayed in graphs and charts within the app.

[1111] Example prompts for generative AI models

[1112] "We will create a monitoring system application that analyzes surveillance camera footage in real time and immediately notifies users when an abnormality is detected. It will also have a visualization function."

[1113] The above is a specific embodiment for carrying out the present invention, which not only supports the operation of an assembly, but also enables real-time abnormality detection and immediate warning using a monitoring device.

[1114] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1115] Step 1: Request for Proposal Generation

[1116] The user inputs the requirements for creating a proposal into the terminal. Specifically, the proposal topic and necessary information are entered into a form, and the data is saved on the terminal. The input data is diverse, including the proposal title, purpose, and related matters.

[1117] Step 2: Submit a proposal generation request

[1118] The terminal sends the data entered by the user to the server, which is designed to receive formatted request data through a specific API endpoint.

[1119] Step 3: Automatic generation of proposals using generative AI

[1120] The server automatically generates proposals using a generative AI model based on the received requirements data. During this process, the generative AI model analyzes large amounts of past data and related information to generate optimal proposals. Specifically, it generates documents using natural language processing (NLP).

[1121] Step 4: Return the generated proposal

[1122] The generated proposal is sent back from the server to the device. The data is sent in a standard structure such as JSON format so that the device can receive and analyze it.

[1123] Step 5: View the proposals

[1124] The terminal displays the generated proposal to the user, and the user interface is designed to clearly display the proposal details.

[1125] Step 6: Start recording parliamentary proceedings

[1126] When a parliamentary session begins, the device records the speech of the members in real time, and the recorded audio data is collected in real time and sent to the server.

[1127] Step 7: Analyze the audio data

[1128] The server converts the received voice data into text using speech recognition AI. During this process, advanced voice analysis tools are used to accurately convert what is being said into text.

[1129] Step 8: Visualize your progress

[1130] The server analyzes the text extracted from the audio data and generates a summary, which is then visually displayed as graphs and charts, and sent back to the device.

[1131] Step 9: Collect video data for anomaly detection

[1132] The surveillance equipment collects video data in real time and transmits it to a server. The surveillance equipment is installed in offices and public facilities and records video continuously.

[1133] Step 10: Analyze the video data

[1134] The server receives the video data and uses video analysis AI to detect abnormalities. If certain conditions are met (such as suspicious human movements), this is recognized as an anomaly.

[1135] Step 11: Alert when an anomaly is detected

[1136] If an abnormality is detected, the server immediately sends an alert to the terminal. The alert is designed to notify the user in real time, allowing for a prompt response.

[1137] Step 12: Visualize the analysis results

[1138] The server visualizes the results of the video analysis and sends them to the device in the form of graphs and charts, allowing the user to check the analysis results in real time through the device.

[1139] Step 13: Final notification to users

[1140] The device will notify the user of the analysis results and warnings in a variety of ways, including pop-ups, alert sounds, emails, and text messages, allowing the user to quickly check the situation and take any necessary measures.

[1141] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1142] This invention is a system to support parliamentary operations, with the following main functions and emotion engine:

[1143] 1. Automatic proposal generation function

[1144] 2. Real-time visualization of parliamentary progress

[1145] 3. AI Minute-Taking Function

[1146] 4. Conversational AI support for lawmakers

[1147] 5. AI Function for Visualizing Parliamentary Data

[1148] 6. Emotion engine that recognizes and analyzes user emotions

[1149] These functions will now be described in detail.

[1150] ---

[1151] Automatic bill generation function

[1152] explanation:

[1153] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[1154] The terminal transmits the input information to the server.

[1155] The server automatically generates proposals using generation AI and sends them to the terminal.

[1156] The terminal displays the generated proposal to the user.

[1157] Examples:

[1158] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[1159] ---

[1160] Real-time visualization of parliamentary progress

[1161] explanation:

[1162] The device records the member's remarks in real time and sends them to a server.

[1163] The server uses voice recognition AI to analyze the content of the speech and generate a summary.

[1164] The server visualizes the progress and analyzes the pros and cons of proposals.

[1165] The server sends the visualization results to the terminal and displays them to the user.

[1166] Examples:

[1167] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[1168] ---

[1169] AI function for creating meeting minutes

[1170] explanation:

[1171] The device records the member's remarks and sends them to a server.

[1172] The server uses voice recognition AI to convert what is said into text.

[1173] The server organizes the text of the remarks and automatically generates minutes.

[1174] The server transmits the generated minutes to the terminal and displays them to the user.

[1175] Examples:

[1176] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[1177] ---

[1178] Conversational AI support for lawmakers

[1179] explanation:

[1180] The user inputs a request for materials or data into the terminal.

[1181] The terminal sends a request to the server.

[1182] The server uses conversational AI to search for and prepare appropriate materials and data.

[1183] The server sends the search results to the terminal and provides them to the user.

[1184] Examples:

[1185] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[1186] ---

[1187] Parliamentary Data Visualization AI Function

[1188] explanation:

[1189] The server collects and analyzes data on the progress of the assembly.

[1190] The server automatically generates visualized information for citizens.

[1191] The server publishes the visualized information through the terminal.

[1192] The devices display visualized information to citizens via websites and apps.

[1193] Examples:

[1194] Comments made during the council meeting, the progress of agenda items, and the pros and cons will be converted into easy-to-read graphs and charts for citizens to view and published in real time on the local government's website.

[1195] ---

[1196] Emotion engine function

[1197] explanation:

[1198] The device collects emotional data from the user's (legislator's) statements and facial expressions.

[1199] The device transmits the emotion data to the server.

[1200] The server analyzes the data using an emotion engine and recognizes the user's emotional state.

[1201] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[1202] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[1203] Examples:

[1204] When a user says, "There's a problem with this plan," the emotion engine recognizes the dissatisfaction and sends the emotion data along with the content of the statement to the server. The server uses this information to enhance the analysis of pros and cons for the proposal and adds the emotion data to the progress visualization.

[1205] ---

[1206] The above is a concrete example of how this system can be implemented. By combining it with an emotion engine, it will be possible to analyze the pros and cons of bills more accurately, create minutes, and visualize progress. It will also be possible to provide information to citizens in a way that takes into account their emotional state, improving the transparency and reliability of parliaments.

[1207] The processing flow will be explained below.

[1208] Automatic bill generation function

[1209] Step 1:

[1210] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[1211] Step 2:

[1212] The terminal transmits the input requirement data for creating a proposal to the server.

[1213] Step 3:

[1214] The server calls up the generative AI model and automatically generates detailed proposals based on the received requirements data, for example, by referencing relevant laws and information on similar proposals from the past.

[1215] Step 4:

[1216] The server transmits the generated proposal to the terminal.

[1217] Step 5:

[1218] The terminal displays the generated proposal to the user.

[1219] ---

[1220] Real-time visualization of parliamentary progress

[1221] Step 1:

[1222] The device records the lawmakers' remarks in real time and collects audio data.

[1223] Step 2:

[1224] Using an emotion engine, the device collects emotional data from the speaker's facial expressions and tone of voice.

[1225] Step 3:

[1226] The terminal transmits the recorded voice data and emotion data to the server.

[1227] Step 4:

[1228] The server uses voice recognition AI to convert the voice data into text and analyze the content of the speech.

[1229] Step 5:

[1230] The server uses an emotion engine to analyze the emotion data and recognize the user's emotional state. For example, it extracts the emotion of "agree" or "disagree" along with the content of the comment.

[1231] Step 6:

[1232] The server consolidates the analysis results and generates progress visualization data (graphs, charts, etc.).

[1233] Step 7:

[1234] The server sends the visualization data to the terminal.

[1235] Step 8:

[1236] The terminal displays the visualized data to the user in real time.

[1237] ---

[1238] AI function for creating meeting minutes

[1239] Step 1:

[1240] The device records the lawmaker's remarks in real time.

[1241] Step 2:

[1242] The terminal transmits the recorded voice data and emotion data to the server.

[1243] Step 3:

[1244] The server uses voice recognition AI to convert the voice data into text.

[1245] Step 4:

[1246] The server links the emotional data with the textual content of the speech.

[1247] Step 5:

[1248] The server organizes the textual content of the remarks and emotional data and generates minutes.

[1249] Step 6:

[1250] The server transmits the generated minutes to the terminal.

[1251] Step 7:

[1252] The terminal displays the minutes to the user.

[1253] ---

[1254] Conversational AI support for lawmakers

[1255] Step 1:

[1256] The user inputs a request for the required materials or data into the terminal.

[1257] Step 2:

[1258] The device sends a question or request to the server.

[1259] Step 3:

[1260] The server uses conversational AI to search for the most appropriate materials and data, and also takes into account the user's emotional state using an emotion engine.

[1261] Step 4:

[1262] The server organizes the search results and prepares the necessary materials and data.

[1263] Step 5:

[1264] The server sends the prepared materials and data to the terminal.

[1265] Step 6:

[1266] The terminal displays materials and data to the user.

[1267] ---

[1268] Parliamentary Data Visualization AI Function

[1269] Step 1:

[1270] The server collects data on the progress of parliament (statements by members of parliament, content of discussions, votes for or against, etc.) in real time.

[1271] Step 2:

[1272] The device collects emotional data from the lawmaker's facial expressions and tone of voice and sends it to a server.

[1273] Step 3:

[1274] The server analyzes the progress and emotion data collected and generates information that can be visualized in an easy-to-understand manner for citizens.

[1275] Step 4:

[1276] The server automatically generates visualization information (such as graphs and charts) that integrates emotional data.

[1277] Step 5:

[1278] The server sends the automatically generated visualization information to the terminal and makes it available to citizens through websites and applications.

[1279] Step 6:

[1280] The terminals display visualization information through citizen websites and applications.

[1281] These are the specific processing steps of the invention that combines the emotion engine. As a result, emotional data is reflected in the analysis of pros and cons of bills, the creation of minutes, and the visualization of progress, improving the efficiency and transparency of parliamentary operations.

[1282] Example 2

[1283] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1284] In parliamentary operations, it is essential to draft bills, manage parliamentary proceedings, compile minutes, provide materials to assembly members, and disclose information to citizens. These tasks are usually performed manually, which requires a great deal of time and effort and is prone to human error. It is also difficult to manage assembly members' remarks and progress in real time and visualize them consistently. Furthermore, there is a lack of analysis and information provision that takes into account emotional data in parliamentary operations. A system that can solve these issues efficiently and accurately is needed.

[1285] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1286] In this invention, the server includes: a means for a user to input the theme and goals of the bill creation and automatically generate the bill using a generative AI model; a means for recording the remarks of assembly members in real time and sending the audio data to the server; a means for converting the remarks into text using speech recognition AI and generating summaries; a means for visualizing the progress and analyzing the pros and cons of the bill; a means for converting the recorded audio data into text and automatically generating minutes; a means for providing materials and data to assembly members using interactive AI; a means for visualizing assembly data for citizens and generating public information; and a means for recognizing the user's emotional state using an emotion engine and reflecting it in the analysis results. This enables consistent, efficient and highly accurate operations from drafting bills to managing the progress of the meeting, creating minutes, providing materials, and disclosing information to citizens. Furthermore, analysis that takes emotion data into account enables flexible assembly management that reflects the user's emotions.

[1287] An "automatic proposal generation means" is a means of automatically creating proposals based on themes and goals input by the user using a generative AI model.

[1288] The "means for visualizing progress in real time" involves recording the remarks of members of parliament in real time, sending the audio data to a server, converting it into text using voice recognition AI, and visualizing the progress and the approval or disapproval of bills.

[1289] A "generative AI model" is a type of artificial intelligence that uses pre-trained algorithms to generate new content based on input data.

[1290] "Conversational artificial intelligence" is artificial intelligence that generates appropriate responses to user input and provides materials and data.

[1291] An "emotion engine" is an algorithm that recognizes a user's emotional state from their words and facial expressions, and reflects this as an analysis result.

[1292] "Voice recognition AI" is artificial intelligence that converts voice data into text.

[1293] The "automatic minutes generation means" is a means for converting recorded audio data into text, organizing the text, and automatically creating minutes.

[1294] A "visualization method" is a method for converting and displaying data in a format that is visually easy to understand (graphs, charts, etc.).

[1295] "Emotion data" is data that indicates the emotional state of a user, collected from their utterances, facial expressions, and the like.

[1296] "Real-time recording means" refers to a means for instantly recording a member of parliament's remarks on the spot.

[1297] "Means for generating public information" refers to a means for generating information to make parliamentary data visible to citizens and make it public.

[1298] MODE FOR CARRYING OUT THE INVENTION

[1299] This invention is a system that supports parliamentary operations and is implemented using the following hardware and software. The main hardware uses client terminals (PCs, tablets, etc.) and high-performance servers. The software includes a generative AI model, conversational AI, speech recognition AI, and an emotion engine. This system provides the following functions: automatic bill generation, real-time visualization of progress, automatic generation of minutes, support for parliamentarians through conversational AI, visualization of parliamentary data for citizens, and emotion analysis.

[1300] 1. Automatic proposal generation function

[1301] overview:

[1302] The user inputs the theme and goals of the agenda creation using a client terminal.

[1303] The terminal transmits the input information to the server.

[1304] The server automatically generates proposals using a generative AI model and returns the results to the terminal.

[1305] The terminal displays the generated proposal to the user.

[1306] Examples:

[1307] The user sets the theme as "regional road development" and sends it to the server via the terminal.

[1308] The server passes prompts such as "Please create a detailed proposal for road development in the area" to the generative AI model, which then generates the proposal.

[1309] The server sends the generated proposal back to the terminal and displays it to the user.

[1310] 2. Real-time progress visualization

[1311] overview:

[1312] The device records the remarks of lawmakers in the conference room in real time.

[1313] The device sends the recorded data to the server.

[1314] The server uses voice recognition AI to convert what is said into text and generate a summary.

[1315] The server visualizes the progress and analyzes the pros and cons of proposals.

[1316] The server sends the visualization results to the terminal and displays them to the user.

[1317] Examples:

[1318] If a member of parliament says, "I support road construction," the audio is recorded in real time.

[1319] When the device sends the voice data to the server, the voice recognition AI converts it into text, saying "I support road construction," and creates a summary.

[1320] The server analyzes the data, graphs the progress and the approval or disapproval of the proposal, and sends it to the terminal for the user to review.

[1321] 3. Automatic minutes generation function

[1322] overview:

[1323] The device records the member's remarks and sends them to a server.

[1324] The server uses voice recognition AI to convert what is said into text.

[1325] The server organizes the text of the remarks and automatically generates minutes.

[1326] The server transmits the generated minutes to the terminal and displays them to the user.

[1327] Examples:

[1328] The device records the member of parliament's "statements regarding the road construction budget proposal" and sends them to the server.

[1329] The server converts the remarks into text, organizes the necessary information, automatically generates minutes, and displays them to the user.

[1330] 4. Conversational AI support for lawmakers

[1331] overview:

[1332] The user inputs a request for materials or data into the terminal.

[1333] The terminal sends the request to the server.

[1334] The server uses interactive artificial intelligence to search for and prepare relevant materials and data.

[1335] The server sends the search results to the terminal and provides them to the user.

[1336] Examples:

[1337] When a user requests "road construction budget data for the past five years," the request is sent from the terminal to the server.

[1338] The server passes the request to a conversational AI, which searches for the appropriate data and presents it to the device.

[1339] Users can check the data and use it to run the parliament.

[1340] 5. Parliamentary data visualization function

[1341] overview:

[1342] The server collects and analyzes data on the progress of the assembly.

[1343] The server automatically generates visualized information for citizens.

[1344] The server publishes the visualized information through the terminal.

[1345] The devices display visualized information to citizens via websites and apps.

[1346] Examples:

[1347] Remarks made during the assembly, the progress of agenda items, and the pros and cons of each item are converted into graphs and charts and published in real time on the local government's website.

[1348] 6. Emotion engine function

[1349] overview:

[1350] The device collects emotional data from the lawmakers' statements and facial expressions.

[1351] The device transmits the emotion data to the server.

[1352] The server uses an emotion engine to analyze the data and recognize the user's emotional state.

[1353] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[1354] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[1355] Examples:

[1356] When a member of parliament says, "There is a problem with this plan," the device collects emotional data of dissatisfaction along with the statement and sends it to the server.

[1357] The server analyzes the data and reflects the results in a pros / cons analysis and progress visualization, which is finally displayed to the user.

[1358] In this way, the system can provide a complete parliamentary management support system with functions for drafting bills, managing proceedings, searching data, disclosing information to citizens, and analyzing sentiment data.

[1359] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1360] Processing steps for the automatic proposal generation function

[1361] Step 1:

[1362] The user inputs the theme and goal of the proposal creation.

[1363] Specific operation: The user inputs a theme such as "regional road development" or the goal of a proposal into an input form on a client terminal.

[1364] Input: Proposal topic, objectives, required information

[1365] Output: The input data

[1366] Step 2:

[1367] The terminal transmits the input information to the server.

[1368] Specific operation: The terminal sends the input data to the server using the HTTPS protocol.

[1369] Input: Data entered

[1370] Output: Send data to the server

[1371] Step 3:

[1372] The server receives the information and generates a proposal using a generation AI.

[1373] Specific operation: The server passes the prompt "Please create a detailed proposal for road development in the area" to the generation AI model, and generates a proposal.

[1374] Input: User-entered themes and goals

[1375] Output: Auto-generated proposals

[1376] Step 4:

[1377] The server transmits the generated proposal to the terminal.

[1378] Specific operation: The server compiles the generated proposals in JSON format and sends them to the terminal.

[1379] Input: Auto-generated proposal

[1380] Output: Sending data to the terminal

[1381] Step 5:

[1382] The terminal displays the generated proposal to the user.

[1383] Specific operation: The device displays the received proposal on the screen so that the user can check the contents.

[1384] Input: Proposal data from the server

[1385] Output: The displayed proposal

[1386] Real-time visualization of progress of processing steps

[1387] Step 1:

[1388] The device records the lawmaker's remarks in real time.

[1389] Specific operation: The device uses the microphone in the conference room to record the member's remarks.

[1390] Input: Congressman's statement

[1391] Output: Recorded audio data

[1392] Step 2:

[1393] The terminal transmits the voice data to the server.

[1394] Specific operation: The device sends the recorded audio data to the server in real time.

[1395] Input: Recorded audio data

[1396] Output: Send audio data to the server

[1397] Step 3:

[1398] The server uses voice recognition AI to convert what is said into text.

[1399] Specific operation: The server uses voice recognition AI to convert the received voice data into text.

[1400] Input: Audio data

[1401] Output: Translated utterances

[1402] Step 4:

[1403] The server visualizes the progress and analyzes the pros and cons of proposals.

[1404] Specific operation: The server analyzes the textual comments and converts the progress and the pros and cons of the proposals into graphs and charts.

[1405] Input: Textual statements, pros and cons data

[1406] Output: visualized data (graphs, charts)

[1407] Step 5:

[1408] The server sends the visualization results to the terminal.

[1409] Specific operation: The server compiles the visualization data in JSON format and sends it to the terminal.

[1410] Input: Visualized data

[1411] Output: Sending data to the terminal

[1412] Step 6:

[1413] The terminal displays the visualization results to the user.

[1414] Specific operation: The device displays the visualization data received on the screen as graphs and charts.

[1415] Input: Visualization data from the server

[1416] Output: The displayed visualization result

[1417] Processing steps of the meeting minutes automatic generation function

[1418] Step 1:

[1419] The device records the member's remarks and sends them to a server.

[1420] Specific operation: The device records the member's speech and sends the audio data to the server.

[1421] Input: Congressman's statement

[1422] Output: Send audio data to the server

[1423] Step 2:

[1424] The server uses voice recognition AI to convert what is said into text.

[1425] Specific operation: The server uses voice recognition AI to convert the received voice data into text.

[1426] Input: Audio data

[1427] Output: Translated utterances

[1428] Step 3:

[1429] The server organizes the text of the remarks and automatically generates minutes.

[1430] Specific operation: The server organizes the textual comments and compiles them into minutes.

[1431] Input: Transcribed speech

[1432] Output: Auto-generated meeting transcript

[1433] Step 4:

[1434] The server transmits the generated minutes to the terminal and displays them to the user.

[1435] Specific operation: The server sends the generated minutes to the terminal, and the terminal displays the contents to the user.

[1436] Input: Auto-generated meeting minutes

[1437] Output: Display the minutes to the user

[1438] Processing steps for the lawmaker support function using conversational AI

[1439] Step 1:

[1440] The user inputs a request for materials or data into the terminal.

[1441] Specific operation: The user requests "road construction budget data for the past five years" from the client terminal interface.

[1442] Input: Request for materials or data

[1443] Output: The requested data entered

[1444] Step 2:

[1445] The terminal sends a request to the server.

[1446] Specific operation: The device compiles the requested data and sends it to the server.

[1447] Input: The requested data

[1448] Output: Sends request data to the server

[1449] Step 3:

[1450] The server uses conversational AI to search for and prepare relevant materials and data.

[1451] Specific operation: The server uses conversational AI to search for "budget data for road construction over the past five years" and prepares the appropriate data.

[1452] Input: The requested data

[1453] Output: Search results and data

[1454] Step 4:

[1455] The server sends the search results to the terminal and provides them to the user.

[1456] Specific operation: The server sends prepared materials and data to the terminal so that the user can check them.

[1457] Input: Prepared materials and data

[1458] Output: Sending materials and data to the terminal and providing them to the user

[1459] Parliamentary Data Visualization Feature Processing Steps

[1460] Step 1:

[1461] The server collects and analyzes data on the progress of the assembly.

[1462] Specific operation: The server collects and analyzes data generated during the session (such as statements, progress on agenda items, and votes for or against).

[1463] Input: Congressional proceedings data

[1464] Output: Parsed data

[1465] Step 2:

[1466] The server automatically generates visualized information for citizens.

[1467] Specific operation: The server uses the analyzed data to automatically generate graphs and charts that are easy for citizens to understand.

[1468] Input: Parsed data

[1469] Output: Automatically generated visualization information

[1470] Step 3:

[1471] The server publishes the visualized information through the terminal.

[1472] Specific operation: The server sends the generated visualization information to the device and makes it available via a website or app.

[1473] Input: Automatically generated visualization information

[1474] Output: Sending and publishing data to a device

[1475] Step 4:

[1476] The devices display visualized information to citizens via websites and apps.

[1477] Specific operation: The visualized information received by the device is displayed on a website or app screen for citizens to see.

[1478] Input: Visualization information from the server

[1479] Output: Display information to citizens

[1480] Emotion Engine Function Processing Steps

[1481] Step 1:

[1482] The device collects emotional data from the user's (legislator's) statements and facial expressions.

[1483] How it works: The device uses the lawmaker's camera and microphone to collect real-time emotional data from what they say and their facial expressions.

[1484] Input: Speech content, facial expression

[1485] Output: Emotion data

[1486] Step 2:

[1487] The device transmits the emotion data to the server.

[1488] Specific operation: The device sends the collected emotion data to the server.

[1489] Input: Emotion data

[1490] Output: Send data to the server

[1491] Step 3:

[1492] The server uses an emotion engine to analyze the data and recognize the user's emotional state.

[1493] Specific operation: The server uses the emotion engine to analyze the received emotion data and recognize the user's emotional state.

[1494] Input: Emotion data

[1495] Output: Analysis results

[1496] Step 4:

[1497] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[1498] Specific operation: The server applies the recognized emotion data to other system functions, such as analyzing pros and cons, visualizing progress, and creating meeting minutes.

[1499] Input: Emotion data, other function data

[1500] Output: Analysis results reflecting emotion data

[1501] Step 5:

[1502] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[1503] Specific operation: The server sends the analysis results, including emotion data, to the device, which then displays the results on the screen.

[1504] Input: Analysis results containing emotion data

[1505] Output: what is displayed to the user

[1506] As described above, through the processing steps of each function, this system supports parliamentary operations, enabling efficient and accurate drafting of bills, recording of minutes, progress management, sentiment analysis, and disclosure of information to citizens.

[1507] (Application example 2)

[1508] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1509] In conventional factory systems, the generation of production instructions, the monitoring of the progress of the production line, the recording of work content, and the management of production records are often done manually, resulting in a large amount of labor and time consumption and inefficiency. The present invention aims to solve these problems and provide an efficient and automated production management system. It also provides a means for understanding the emotional state of workers and appropriately managing the work environment.

[1510] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1511] In this invention, the server includes a means for automatically generating production instructions, a means for visualizing the progress of the production line in real time, a means for recording work content and automatically generating production records, a means for providing materials and data to workers using interactive AI, a means for visualizing production data for managers and generating public information, and a means for recognizing and analyzing worker emotions. This enables the automation and efficiency of production management and improves the work environment.

[1512] "Production instructions" refers to instructions or orders that direct the production of specific tasks or products in a factory.

[1513] "Auto-generation" refers to the creation of data or information by a system using pre-set algorithms or processes without human intervention.

[1514] A "production line" refers to a series of equipment or arrangements in which multiple processes or work steps are carried out consecutively in the production process of a product.

[1515] "Status" refers to the state or condition that indicates the stage at which a particular project or task is.

[1516] "Real-time" refers to a state in which information or data is processed or displayed the moment it is generated.

[1517] "Visualization" refers to converting data and information into a visually easy-to-understand form and displaying it.

[1518] "Work content" refers to the specific actions and steps performed in a particular job or task.

[1519] "Production records" refers to documents and data that record various data and events that occur during the production process of a product.

[1520] "Conversational artificial intelligence" refers to AI systems designed to converse with humans in a natural way, providing information in response to questions and commands.

[1521] "Materials" refers to documents or data containing information for a particular purpose or topic.

[1522] "Data" refers to a collection of information, such as facts and figures, that can be used for calculations and analysis.

[1523] "Administrator-oriented" means that the system or data is intended primarily for administrator use.

[1524] "Recognizing emotions" refers to determining a person's emotional state from facial expressions, tone of voice, etc.

[1525] "Analyze" refers to examining data or information in detail to clarify its meaning and structure.

[1526] The system that realizes this application example is a robot-equipped AI system that supports factory production line management. This system includes functions such as automatic generation of production instructions, real-time visualization of production line progress, automatic generation of work records and production records, support for workers using interactive AI, visualization of production data for managers, and recognition and analysis of worker emotions.

[1527] Automatic production instruction generation function

[1528] The server automatically generates production instructions based on order and inventory data. Users input order details into a terminal, and the server automatically generates appropriate production instructions using a generative AI model. This reduces the time and effort required to create production instructions.

[1529] Real-time visualization of production line progress

[1530] The server monitors and visualizes the progress of the production line in real time. The terminals send data obtained from sensors to the server, which analyzes the data and displays the progress as graphs and charts. This allows managers to grasp the current status of the production line at a glance.

[1531] Production record creation AI function

[1532] The server records the robot's work and production progress in real time and automatically creates a production record. The server converts the data recorded by the terminal into text, organizes and compiles it into a production record. This function eliminates the need to manually create production records.

[1533] Conversational AI-based worker support function

[1534] The server uses conversational artificial intelligence to provide appropriate information in response to questions and document requests from workers. When a worker enters a query into their terminal, the server searches for relevant documents and data and provides them through the terminal. This function allows workers to quickly obtain the information they need.

[1535] Production data visualization AI function

[1536] The server collects and analyzes production data and generates visualized information for managers. The server analyzes data acquired through terminals and provides visualized information such as graphs and charts to managers. This function allows managers to efficiently grasp the overall picture of production.

[1537] Emotion engine function

[1538] The server collects data on workers' facial expressions and voices and analyzes it using an emotion engine. The server then analyzes the emotion data acquired by the device and uses it to improve the work environment. The results of this analysis are linked with other functions to contribute to optimizing the work environment.

[1539] As a concrete example, consider the case where a worker requests production instructions. The user enters order data into a terminal, and production instructions are automatically generated using a generative AI model. In this process, the following prompt sentences are used:

[1540] Example prompt sentence:

[1541] "Please generate production instructions based on the following order data.

[1542] Order ID: 12345

[1543] Product Name: Part A

[1544] Quantity: 100"

[1545] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1546] Step 1:

[1547] The user enters order data into the terminal and sends the data to the server. The user enters the necessary information such as product name, quantity, and deadline, and clicks the send button to send the input data to the server. The input includes the order ID, product name, quantity, and deadline.

[1548] Step 2:

[1549] The server uses the generative AI model to carry out the process of automatically generating production instructions. The server inputs the received order data into the AI ​​model and generates appropriate production instructions using an algorithm. During this process, the server obtains necessary information from the relevant database and performs data calculations. The output includes the generated production instructions.

[1550] Step 3:

[1551] The server sends the generated production instructions to the terminal and displays them to the user. The generated production instructions are received by the terminal and displayed on the user's screen. The user checks the production instructions and makes corrections as necessary. The input includes production instruction data from the server, and the output includes a display to the user.

[1552] Step 4:

[1553] The terminal acquires data from sensors on the progress of the production line in real time and sends it to the server. The terminal collects data obtained from the sensors and periodically sends it to the server. The input includes progress data from the sensors, and the output includes data sent to the server.

[1554] Step 5:

[1555] The server analyzes the progress data in real time and generates graphs and charts for visualization. The server analyzes the data it receives and creates graphs and charts for easy-to-understand progress display. This includes data processing and calculations. The output includes visualized graphs and charts.

[1556] Step 6:

[1557] The server sends the visualized progress data to the terminal and displays it to the user. The terminal updates the screen displaying the progress status for the administrator based on the received data. The input includes the visualized data from the server, and the output includes the display to the user.

[1558] Step 7:

[1559] The terminal accepts questions and requests for materials from workers and sends them to the server. When a worker enters a question or request for materials into the terminal and clicks the send button, the data is sent to the server. The input includes the question data from the worker, and the output is the data sent to the server.

[1560] Step 8:

[1561] The server uses conversational artificial intelligence to search for and prepare the requested materials and data. It searches for appropriate materials based on the received query data and compiles the results. The input includes the query data from the worker, and the output includes the search results.

[1562] Step 9:

[1563] The server sends the retrieved materials and data to the terminal and provides them to the worker. The terminal displays the received materials to the worker. The input includes the material data from the server, and the output includes the display to the worker.

[1564] Step 10:

[1565] The terminal collects emotional data such as facial expressions and tone of voice of the worker and sends it to the server. This data, collected using a camera and microphone, is periodically sent to the server. The input includes emotional data, and the output includes transmission to the server.

[1566] Step 11:

[1567] The server uses an emotion engine to analyze the received emotion data and recognize the emotional state. It performs data analysis and determines the emotional state of the worker. The input includes emotion data, and the output includes the emotion analysis results.

[1568] Step 12:

[1569] The server connects the results of the emotion analysis with other system functions to help improve the overall system. Based on the analysis results, progress can be visualized and production instructions can be adjusted. The input includes the emotion analysis results, and the output includes the optimization of other system functions.

[1570] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1571] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1572] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1573] [Third embodiment]

[1574] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1575] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1576] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1577] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1578] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1579] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1580] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1581] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1582] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1583] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1584] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1585] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1586] The system of the present invention has the following main functions:

[1587] 1. Automatic proposal generation function

[1588] 2. Real-time visualization of parliamentary progress

[1589] 3. AI Minute-Taking Function

[1590] 4. Conversational AI support for lawmakers

[1591] 5. AI Function for Visualizing Parliamentary Data

[1592] These functions will now be described in detail.

[1593] ---

[1594] Automatic bill generation function

[1595] explanation:

[1596] The user inputs the requirements for creating a proposal into the terminal.

[1597] The terminal transmits the input information to the server.

[1598] The server automatically generates proposals using generation AI and sends them to the terminal.

[1599] The terminal displays the generated proposal to the user.

[1600] Examples:

[1601] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[1602] ---

[1603] Real-time visualization of parliamentary progress

[1604] explanation:

[1605] The device records the member's remarks in real time and sends them to a server.

[1606] The server uses voice recognition AI to analyze the content of the speech and generate a summary.

[1607] The server visualizes the progress and analyzes the pros and cons of proposals.

[1608] The server sends the visualization results to the terminal and displays them to the user.

[1609] Examples:

[1610] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[1611] ---

[1612] AI function for creating meeting minutes

[1613] explanation:

[1614] The device records the member's remarks and sends them to a server.

[1615] The server uses voice recognition AI to convert what is said into text.

[1616] The server organizes the text of the remarks and automatically generates minutes.

[1617] The server transmits the generated minutes to the terminal and displays them to the user.

[1618] Examples:

[1619] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[1620] ---

[1621] Conversational AI support for lawmakers

[1622] explanation:

[1623] The user inputs a request for materials or data into the terminal.

[1624] The terminal sends a request to the server.

[1625] The server uses conversational AI to search for and prepare appropriate materials and data.

[1626] The server sends the search results to the terminal and provides them to the user.

[1627] Examples:

[1628] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[1629] ---

[1630] Parliamentary Data Visualization AI Function

[1631] explanation:

[1632] The server collects and analyzes data on the progress of the assembly.

[1633] The server automatically generates visualized information for citizens.

[1634] The server publishes the visualized information through the terminal.

[1635] The devices display visualized information to citizens via websites and apps.

[1636] Examples:

[1637] Comments made during the council meeting, the progress of agenda items, and the pros and cons will be converted into easy-to-read graphs and charts for citizens to view and published in real time on the local government's website.

[1638] ---

[1639] This system aims to improve the efficiency of parliamentary operations by analyzing and visualizing the remarks of assembly members and the progress of parliament in real time, and by providing multiple functions such as automatically generating minutes and providing materials.In addition, by providing information to citizens in real time, it is also intended to improve the transparency and reliability of parliament.

[1640] The processing flow will be explained below.

[1641] Automatic bill generation function

[1642] Step 1:

[1643] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[1644] Step 2:

[1645] The terminal transmits the input requirement data for creating a proposal to the server.

[1646] Step 3:

[1647] The server calls up the generative AI model and automatically generates detailed proposals based on the received requirements data, for example, by referencing relevant laws and information on similar proposals from the past.

[1648] Step 4:

[1649] The server transmits the generated proposal to the terminal.

[1650] Step 5:

[1651] The terminal displays the generated proposal to the user.

[1652] ---

[1653] Real-time visualization of parliamentary progress

[1654] Step 1:

[1655] The device records the lawmaker's remarks in real time.

[1656] Step 2:

[1657] The device sends the recorded audio data to the server.

[1658] Step 3:

[1659] The server uses voice recognition AI to convert the recorded data into text and analyze the content of the speech.

[1660] Step 4:

[1661] The server summarizes the analyzed speech.

[1662] Step 5:

[1663] The server analyzes the pros and cons of the proposals from the textual content of the comments and tallys up the number of opinions in favor and against.

[1664] Step 6:

[1665] The server generates progress visualization data (graphs, charts, etc.).

[1666] Step 7:

[1667] The server sends the visualization data to the terminal.

[1668] Step 8:

[1669] The terminal displays the visualized data to the user in real time.

[1670] ---

[1671] AI function for creating meeting minutes

[1672] Step 1:

[1673] The device records the lawmaker's remarks in real time.

[1674] Step 2:

[1675] The device sends the recorded audio data to the server.

[1676] Step 3:

[1677] The server uses voice recognition AI to convert the voice data into text.

[1678] Step 4:

[1679] The server automatically organizes the textual content of the remarks and generates minutes.

[1680] Step 5:

[1681] The server transmits the generated minutes to the terminal.

[1682] Step 6:

[1683] The terminal displays the minutes to the user.

[1684] ---

[1685] Conversational AI support for lawmakers

[1686] Step 1:

[1687] The user inputs questions or requests about the materials or data they need into the terminal.

[1688] Step 2:

[1689] The device sends a question or request to the server.

[1690] Step 3:

[1691] The server uses conversational AI to search for the most appropriate materials and data based on the request.

[1692] Step 4:

[1693] The server organizes the search results and prepares the necessary materials and data.

[1694] Step 5:

[1695] The server sends the prepared materials and data to the terminal.

[1696] Step 6:

[1697] The terminal displays materials and data to the user.

[1698] ---

[1699] Parliamentary Data Visualization AI Function

[1700] Step 1:

[1701] The server collects data on the progress of parliament (statements by members of parliament, content of discussions, votes for or against, etc.) in real time.

[1702] Step 2:

[1703] The server analyzes the collected data and generates information that can be visualized in an easy-to-understand manner for citizens.

[1704] Step 3:

[1705] The server automatically generates visualization information in a visual format (such as graphs or charts).

[1706] Step 4:

[1707] The server sends the generated visualization information to the terminal and makes it available to citizens through websites and applications.

[1708] Step 5:

[1709] The terminals display visualization information through citizen websites and applications.

[1710] The above are the specific processing steps for each function of this system, and are necessary to efficiently support the management of local government assemblies.

[1711] Example 1

[1712] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1713] Traditional parliamentary operations involve a large amount of manual work, making things like drafting bills, compiling minutes, managing parliamentary progress, and searching for and providing materials extremely inefficient. It's also difficult to visualize parliamentary data and provide information to citizens in real time, creating a need for greater transparency. There's a need to solve these problems and improve the efficiency of parliamentary operations and the provision of information to citizens.

[1714] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1715] In this invention, the server includes means for receiving requirements for bill creation input by a user and using a generative AI model to automatically generate bills, means for recording council members' remarks in real time, analyzing the remarks using voice recognition technology, and visualizing the progress, means for analyzing the remarks and generating summaries, means for aggregating and analyzing votes for and against bills in real time, means for recording council members' remarks, converting them into text using voice recognition technology, and automatically generating minutes, means for providing materials and data in response to user requests using interactive AI, and means for analyzing council data, visualizing it for citizens, and generating and displaying public information. This improves the efficiency of council operations and enables real-time information provision and improved transparency.

[1716] "User" means a person or entity that operates the system and inputs and uses information.

[1717] A "terminal" is a device (e.g., a PC, tablet, smartphone, etc.) that a user uses to operate the system.

[1718] A "server" is a computer or network system that centralizes the processing of the entire system and receives and transmits data.

[1719] A "bill" is a formal proposal or plan submitted to Parliament for consideration.

[1720] A "generative AI model" is an algorithm or system that uses artificial intelligence technology to automatically generate text or data.

[1721] A "parliament" is an organization where representatives of public institutions and organizations gather to discuss and decide on policies, laws, budgets, etc.

[1722] "Progress" is information that indicates the progress of each bill or agenda item in the assembly.

[1723] "Voice recognition technology" is a technology that analyzes voice data and converts it into text data.

[1724] A "summary" is a short summary of the main points of the original information.

[1725] "For or against" refers to opinions or voting results in favor or against a motion or proposal.

[1726] "Documents" are reference materials such as data, documents, statistics, etc. used by Parliament.

[1727] "Conversational AI" is an AI system that can naturally interact with users, answering their questions and providing them with information.

[1728] "Visualization" refers to the visual representation of data in the form of a graph, chart, or other form.

[1729] "Public information" is information relating to Parliament that is made accessible to citizens and the general public.

[1730] Minutes are official documents that record statements and decisions made in parliament.

[1731] The system of the present invention aims to improve the efficiency and transparency of parliamentary operations and has the following main functions, which are implemented by the server, terminals, and users.

[1732] 1. Automatic proposal generation function

[1733] explanation:

[1734] The user inputs the requirements for creating a proposal into the terminal. For example, the user may request the creation of a proposal on the theme of "regional road development."

[1735] The terminal sends the input information to the server, which includes supplementary information such as the topic, budget, deadline, and stakeholders.

[1736] The server automatically generates a proposal using a generative AI model. Specifically, the server analyzes the user's input information and provides the generative AI model (e.g., OpenAI GPT-4) with a prompt such as, "Please create a proposal regarding road construction in the area."

[1737] The server transmits the generated proposal to the terminal.

[1738] The device displays the generated agenda to the user. The agenda is provided in a human-readable format (e.g., PDF or Word document).

[1739] 2. Real-time visualization of parliamentary progress

[1740] explanation:

[1741] The device records the speech of the legislator in real time, and audio data is acquired using microphones placed in the conference room.

[1742] The device sends the recorded data to the server. The recorded data is packetized at regular intervals (e.g., every 10 seconds) and sent.

[1743] The server analyzes what is being said using speech recognition technology, for example, the Google Cloud Speech-to-Text API, to convert the speech data into text.

[1744] The server visualizes the progress, tallies votes for and against proposals, generates summaries, and converts statements and votes into graphs and charts.

[1745] The server sends the visualization results to the terminal.

[1746] The device displays the visualization results to the user, and the visualization data is provided on a web page or within a dedicated app.

[1747] 3. AI Minute-Taking Function

[1748] explanation:

[1749] The device records the speech of the legislator. For example, audio data is acquired using a microphone placed in the conference room.

[1750] The device sends the recorded data to the server in batches.

[1751] The server converts what is said into text using speech recognition technology, for example, Amazon Transcribe.

[1752] The server organizes the transcribed remarks and automatically generates minutes. It uses a natural language processing algorithm to analyze the context and automatically generates minutes according to the format.

[1753] The server transmits the generated minutes to the terminal.

[1754] The terminal displays the minutes to the user, which are provided in formats such as PDF.

[1755] 4. Conversational AI support for lawmakers

[1756] explanation:

[1757] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[1758] The terminal sends a request to the server, which converts the request into a prompt.

[1759] The server uses conversational artificial intelligence to search for appropriate materials and data, and performs the search process using a generative AI model (e.g., OpenAI GPT-4).

[1760] The server sends the search results to the device. The data is sent in JSON format or similar.

[1761] The terminal provides the search results to the user, using graphs and tables as display formats.

[1762] 5. AI Function for Visualizing Parliamentary Data

[1763] explanation:

[1764] The server collects data on the progress of the parliament and periodically retrieves data from the parliament system.

[1765] The server analyzes the progression data and uses analysis algorithms to extract important information.

[1766] The server automatically generates visualized information for citizens and converts the generated data into graphs and charts.

[1767] The server publishes the visualization information, which is then published via a Web API.

[1768] The device displays the visualized information to citizens, who can access it through the local government's website or app, for example.

[1769] This system will improve the efficiency of parliamentary operations, provide real-time information, and increase transparency.

[1770] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1771] Automatic bill generation function

[1772] Processing Steps:

[1773] Step 1:

[1774] The user inputs the requirements for creating a proposal into the terminal. For example, the topic is "regional road development," and necessary supplementary information such as the budget and deadline is included.

[1775] Step 2:

[1776] The terminal sends the entered information to the server. The entered data is encrypted and sent using a secure communication protocol (e.g. HTTPS). Input: Proposal creation requirements entered by the user. Output: Encrypted data packet.

[1777] Step 3:

[1778] The server automatically generates a proposal using a generative AI model. The server analyzes the user's input information and provides the generative AI model with a prompt: "Please create a proposal regarding road improvement in the area." Input: Encrypted data packet. Output: Automatically generated proposal data.

[1779] Step 4:

[1780] The server sends the generated proposal to the terminal. The output data is formatted as needed. Input: Automatically generated proposal data. Output: Formatted proposal data.

[1781] Step 5:

[1782] The terminal displays the generated agenda to the user. The agenda is displayed in a format that is easy for humans to understand, such as a PDF or Word document. Input: Formatted agenda data. Output: Agenda in a format that can be viewed by the user.

[1783] ---

[1784] Real-time visualization of parliamentary progress

[1785] Processing Steps:

[1786] Step 1:

[1787] The device records the speech of the legislator in real time, and captures the audio data using microphones placed in the conference room.

[1788] Step 2:

[1789] The device sends the recorded data to the server. The recorded data is packetized at regular intervals and sent over the network. Input: Recorded voice data. Output: Packetized voice data.

[1790] Step 3:

[1791] The server analyzes the speech using speech recognition technology. The speech data is converted into text data using a speech recognition engine (for example, Google Cloud Speech-to-Text API). Input: Packetized speech data. Output: Texted speech.

[1792] Step 4:

[1793] The server visualizes the progress and tally the votes for and against the proposals. The server analyzes the content of the comments and the information on the votes for and against, and converts it into graphs and charts. Input: Textualized content of the comments. Output: Visualized progress data.

[1794] Step 5:

[1795] The server sends the visualization results to the terminal. Input: visualized progress data. Output: formatted visualization data.

[1796] Step 6:

[1797] The device displays the visualization results to the user. The visualized data is displayed on a web page or in a dedicated app. Input: Formatted visualized data. Output: Visualized data in a format that can be viewed by the user.

[1798] ---

[1799] AI function for creating meeting minutes

[1800] Processing Steps:

[1801] Step 1:

[1802] The device records what the council member says, collecting audio data using microphones placed in the conference room.

[1803] Step 2:

[1804] The device sends the recorded data to the server. The data is batch processed at regular intervals and sent. Input: Recorded audio data. Output: Batched audio data.

[1805] Step 3:

[1806] The server uses speech recognition technology to convert the speech into text. A speech recognition engine (e.g., Amazon Transcribe) is used to convert the speech data into text. Input: Batched speech data. Output: Translated speech.

[1807] Step 4:

[1808] The server organizes the textual content of remarks and automatically generates minutes. A natural language processing algorithm is used to organize the text data and convert it into a format suitable for the minutes format. Input: Textual content of remarks. Output: Automatically generated minutes.

[1809] Step 5:

[1810] The server sends the generated minutes to the terminal. The generated minutes are converted into a format such as PDF or Word document. Input: Automatically generated minutes. Output: Formatted minutes data.

[1811] Step 6:

[1812] The terminal displays the minutes to the user. The generated minutes are displayed in a format that can be easily viewed by the user. Input: Formatted minutes data. Output: Minutes in a format that can be viewed by the user.

[1813] ---

[1814] Conversational AI support for lawmakers

[1815] Processing Steps:

[1816] Step 1:

[1817] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[1818] Step 2:

[1819] The terminal sends a request to the server. The request content is converted into a prompt sentence format and sent. Input: User's request content. Output: Data in prompt sentence format.

[1820] Step 3:

[1821] The server uses conversational artificial intelligence to search for appropriate materials and data. It uses a conversational AI model (e.g., OpenAI GPT-4) to search for appropriate information from databases and online resources. Input: Data in the form of a prompt sentence. Output: Search result data.

[1822] Step 4:

[1823] The server sends the search results to the terminal. The search results are formatted in JSON format and sent. Input: Search result data. Output: Formatted search result data.

[1824] Step 5:

[1825] The terminal provides the search results to the user. Graphs, tables, etc. are used as display formats. Input: Formatted search result data. Output: Search results in a format that can be viewed by the user.

[1826] ---

[1827] Parliamentary Data Visualization AI Function

[1828] Processing Steps:

[1829] Step 1:

[1830] The server collects the progress data of the assembly. It periodically obtains data from the assembly system. Input: Progress data from the assembly system. Output: Collected progress data.

[1831] Step 2:

[1832] The server parses the progress data. It uses parsing algorithms to extract important information and convert it into the required format. Input: Collected progress data. Output: Parsed progress data.

[1833] Step 3:

[1834] The server automatically generates visualized information for citizens. It converts the data into graphs and charts, making it easy for citizens to understand. Input: Analyzed progress data. Output: Visualized information data.

[1835] Step 4:

[1836] The server publishes the visualized information. The automatically generated visualized data is published via a Web API. Input: visualized information data. Output: data via the public API.

[1837] Step 5:

[1838] The device displays the visualized information to citizens. For example, it is made accessible to citizens through the local government's website or app. Input: Data via public API. Output: Visualized data in a format that citizens can view.

[1839] These processing steps will improve the efficiency of parliamentary operations, provide real-time information to citizens, and increase transparency.

[1840] (Application example 1)

[1841] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1842] Conventional parliamentary management support systems were limited to basic functions such as automatically generating bills and visualizing parliamentary progress, and were therefore unable to handle practical matters outside of parliament or security management. In particular, they lacked the functionality to analyze surveillance footage in real time and issue an immediate warning when an abnormality was detected, making it difficult to ensure safety in situations where a rapid response was required. These issues need to be resolved.

[1843] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1844] In this invention, the server includes a means for automatically generating bills, a means for visualizing the progress of the assembly in real time, a means for analyzing video data from a monitoring device in real time to detect abnormalities, a means for issuing an immediate warning when an abnormality is detected, and a means for visualizing the results of the real-time analysis. This enables support for assembly operations as well as real-time detection of abnormalities and immediate warnings using the monitoring device.

[1845] "Means for automatically generating proposals" refers to functions and processes for automatically creating proposals based on input requirements.

[1846] "Means for visualizing the progress of parliamentary proceedings in real time" refers to the function and process of aggregating statements and progress made during parliamentary proceedings in real time and displaying them in a visually easy-to-understand manner.

[1847] The "means for generating a summary of speech content" refers to a function and process for analyzing the speech of a member of parliament and automatically generating a summary that concisely summarizes the content.

[1848] "Means for analyzing the pros and cons of bills" refers to the function and process for compiling and analyzing each member's position on bills in parliament, whether for or against.

[1849] "Means for automatically generating minutes" refers to the functions and processes for converting statements made during a meeting into text, organizing it, and automatically generating it as minutes.

[1850] "Means for providing materials and data to members of parliament using interactive artificial intelligence" refers to the functions and processes for using interactive artificial intelligence to search for and provide materials and data in response to requests from members of parliament.

[1851] "Means for visualizing parliamentary data for citizens and generating public information" refers to the functions and processes for collecting and analyzing parliamentary progress data, visualizing it in a form that is easy for citizens to understand, and generating it as public information.

[1852] "Means for analyzing video data from a monitoring device in real time and detecting abnormalities" refers to functions and processes for analyzing video data sent from a monitoring device in real time and detecting abnormal behavior or abnormal conditions.

[1853] "Means for immediately issuing a warning when an abnormality is detected" refers to a function and process for immediately issuing a warning when an abnormality is detected through analysis of video data by a monitoring device.

[1854] "Means for visualizing the results of real-time analysis" refers to the functions and processes for visually displaying the results of video data analysis by a monitoring device in real time and providing them to users.

[1855] The system of the present invention has multiple functions to support parliamentary operations and analyze video data from surveillance equipment in real time. This system operates in cooperation with a server, terminals, and users. Each function and its implementation will be described below.

[1856] Automatic bill generation function

[1857] explanation:

[1858] When a user inputs the requirements for creating a proposal into the device, the device sends it to the server. The server automatically generates a proposal from the input requirements using a generative AI model and returns the proposal to the device. The device then displays the generated proposal to the user.

[1859] Examples:

[1860] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[1861] Real-time visualization of parliamentary progress

[1862] explanation:

[1863] The device records the speech of the legislator in real time and sends it to the server. The server uses speech recognition AI to analyze the speech and generate a summary. It also visualizes the progress and analyzes the pros and cons of the bills. The results are sent to the device and displayed to the user.

[1864] Examples:

[1865] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[1866] AI function for creating meeting minutes

[1867] explanation:

[1868] The device records the remarks of the legislators and sends them to the server. The server uses speech recognition AI to convert the remarks into text, and then organizes the text to automatically generate minutes. The generated minutes are sent to the device and displayed to the user.

[1869] Examples:

[1870] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[1871] Conversational AI support for lawmakers

[1872] explanation:

[1873] When a user inputs a request for materials or data into the device, the device sends it to the server, which uses conversational AI to search for and prepare the appropriate materials or data. The search results are sent to the device and provided to the user.

[1874] Examples:

[1875] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[1876] Parliamentary Data Visualization AI Function

[1877] explanation:

[1878] The server collects and analyzes data on the progress of parliamentary meetings. Visualized information is automatically generated for citizens and made available via devices. Users can view the visualized information via a website or app.

[1879] Examples:

[1880] Graphs and charts of comments made during the assembly, the progress of agenda items, and the approval or disapproval status will be published in real time on the local government's website.

[1881] Real-time analysis function of the monitoring system

[1882] explanation:

[1883] The device sends video data from the monitoring device to the server in real time, and the server uses video analysis AI to detect abnormalities. If an abnormality is detected, the server immediately sends an alert to the device and notifies the user. The analysis results are then visualized and displayed.

[1884] Examples:

[1885] If a suspicious person is caught on camera in the office at night, the video will be analyzed immediately and a notification such as "Abnormal person detected in the office" will be sent to the smartphone. At the same time, the analysis results will be displayed in graphs and charts within the app.

[1886] Example prompts for generative AI models

[1887] "We will create a monitoring system application that analyzes surveillance camera footage in real time and immediately notifies users when an abnormality is detected. It will also have a visualization function."

[1888] The above is a specific embodiment for carrying out the present invention, which not only supports the operation of an assembly, but also enables real-time abnormality detection and immediate warning using a monitoring device.

[1889] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1890] Step 1: Request for Proposal Generation

[1891] The user inputs the requirements for creating a proposal into the terminal. Specifically, the proposal topic and necessary information are entered into a form, and the data is saved on the terminal. The input data is diverse, including the proposal title, purpose, and related matters.

[1892] Step 2: Submit a proposal generation request

[1893] The terminal sends the data entered by the user to the server, which is designed to receive formatted request data through a specific API endpoint.

[1894] Step 3: Automatic generation of proposals using generative AI

[1895] The server automatically generates proposals using a generative AI model based on the received requirements data. During this process, the generative AI model analyzes large amounts of past data and related information to generate optimal proposals. Specifically, it generates documents using natural language processing (NLP).

[1896] Step 4: Return the generated proposal

[1897] The generated proposal is sent back from the server to the device. The data is sent in a standard structure such as JSON format so that the device can receive and analyze it.

[1898] Step 5: View the proposals

[1899] The terminal displays the generated proposal to the user, and the user interface is designed to clearly display the proposal details.

[1900] Step 6: Start recording parliamentary proceedings

[1901] When a parliamentary session begins, the device records the speech of the members in real time, and the recorded audio data is collected in real time and sent to the server.

[1902] Step 7: Analyze the audio data

[1903] The server converts the received voice data into text using speech recognition AI. During this process, advanced voice analysis tools are used to accurately convert what is being said into text.

[1904] Step 8: Visualize your progress

[1905] The server analyzes the text extracted from the audio data and generates a summary, which is then visually displayed as graphs and charts, and sent back to the device.

[1906] Step 9: Collect video data for anomaly detection

[1907] The surveillance equipment collects video data in real time and transmits it to a server. The surveillance equipment is installed in offices and public facilities and records video continuously.

[1908] Step 10: Analyze the video data

[1909] The server receives the video data and uses video analysis AI to detect abnormalities. If certain conditions are met (such as suspicious human movements), this is recognized as an anomaly.

[1910] Step 11: Alert when an anomaly is detected

[1911] If an abnormality is detected, the server immediately sends an alert to the terminal. The alert is designed to notify the user in real time, allowing for a prompt response.

[1912] Step 12: Visualize the analysis results

[1913] The server visualizes the results of the video analysis and sends them to the device in the form of graphs and charts, allowing the user to check the analysis results in real time through the device.

[1914] Step 13: Final notification to users

[1915] The device will notify the user of the analysis results and warnings in a variety of ways, including pop-ups, alert sounds, emails, and text messages, allowing the user to quickly check the situation and take any necessary measures.

[1916] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1917] This invention is a system to support parliamentary operations, with the following main functions and emotion engine:

[1918] 1. Automatic proposal generation function

[1919] 2. Real-time visualization of parliamentary progress

[1920] 3. AI Minute-Taking Function

[1921] 4. Conversational AI support for lawmakers

[1922] 5. AI Function for Visualizing Parliamentary Data

[1923] 6. Emotion engine that recognizes and analyzes user emotions

[1924] These functions will now be described in detail.

[1925] ---

[1926] Automatic bill generation function

[1927] explanation:

[1928] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[1929] The terminal transmits the input information to the server.

[1930] The server automatically generates proposals using generation AI and sends them to the terminal.

[1931] The terminal displays the generated proposal to the user.

[1932] Examples:

[1933] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[1934] ---

[1935] Real-time visualization of parliamentary progress

[1936] explanation:

[1937] The device records the member's remarks in real time and sends them to a server.

[1938] The server uses voice recognition AI to analyze the content of the speech and generate a summary.

[1939] The server visualizes the progress and analyzes the pros and cons of proposals.

[1940] The server sends the visualization results to the terminal and displays them to the user.

[1941] Examples:

[1942] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[1943] ---

[1944] AI function for creating meeting minutes

[1945] explanation:

[1946] The device records the member's remarks and sends them to a server.

[1947] The server uses voice recognition AI to convert what is said into text.

[1948] The server organizes the text of the remarks and automatically generates minutes.

[1949] The server transmits the generated minutes to the terminal and displays them to the user.

[1950] Examples:

[1951] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[1952] ---

[1953] Conversational AI support for lawmakers

[1954] explanation:

[1955] The user inputs a request for materials or data into the terminal.

[1956] The terminal sends a request to the server.

[1957] The server uses conversational AI to search for and prepare appropriate materials and data.

[1958] The server sends the search results to the terminal and provides them to the user.

[1959] Examples:

[1960] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[1961] ---

[1962] Parliamentary Data Visualization AI Function

[1963] explanation:

[1964] The server collects and analyzes data on the progress of the assembly.

[1965] The server automatically generates visualized information for citizens.

[1966] The server publishes the visualized information through the terminal.

[1967] The devices display visualized information to citizens via websites and apps.

[1968] Examples:

[1969] Comments made during the council meeting, the progress of agenda items, and the pros and cons will be converted into easy-to-read graphs and charts for citizens to view and published in real time on the local government's website.

[1970] ---

[1971] Emotion engine function

[1972] explanation:

[1973] The device collects emotional data from the user's (legislator's) statements and facial expressions.

[1974] The device transmits the emotion data to the server.

[1975] The server analyzes the data using an emotion engine and recognizes the user's emotional state.

[1976] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[1977] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[1978] Examples:

[1979] When a user says, "There's a problem with this plan," the emotion engine recognizes the dissatisfaction and sends the emotion data along with the content of the statement to the server. The server uses this information to enhance the analysis of pros and cons for the proposal and adds the emotion data to the progress visualization.

[1980] ---

[1981] The above is a concrete example of how this system can be implemented. By combining it with an emotion engine, it will be possible to analyze the pros and cons of bills more accurately, create minutes, and visualize progress. It will also be possible to provide information to citizens in a way that takes into account their emotional state, improving the transparency and reliability of parliaments.

[1982] The processing flow will be explained below.

[1983] Automatic bill generation function

[1984] Step 1:

[1985] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[1986] Step 2:

[1987] The terminal transmits the input requirement data for creating a proposal to the server.

[1988] Step 3:

[1989] The server calls up the generative AI model and automatically generates detailed proposals based on the received requirements data, for example, by referencing relevant laws and information on similar proposals from the past.

[1990] Step 4:

[1991] The server transmits the generated proposal to the terminal.

[1992] Step 5:

[1993] The terminal displays the generated proposal to the user.

[1994] ---

[1995] Real-time visualization of parliamentary progress

[1996] Step 1:

[1997] The device records the lawmakers' remarks in real time and collects audio data.

[1998] Step 2:

[1999] Using an emotion engine, the device collects emotional data from the speaker's facial expressions and tone of voice.

[2000] Step 3:

[2001] The terminal transmits the recorded voice data and emotion data to the server.

[2002] Step 4:

[2003] The server uses voice recognition AI to convert the voice data into text and analyze the content of the speech.

[2004] Step 5:

[2005] The server uses an emotion engine to analyze the emotion data and recognize the user's emotional state. For example, it extracts the emotion of "agree" or "disagree" along with the content of the comment.

[2006] Step 6:

[2007] The server consolidates the analysis results and generates progress visualization data (graphs, charts, etc.).

[2008] Step 7:

[2009] The server sends the visualization data to the terminal.

[2010] Step 8:

[2011] The terminal displays the visualized data to the user in real time.

[2012] ---

[2013] AI function for creating meeting minutes

[2014] Step 1:

[2015] The device records the lawmaker's remarks in real time.

[2016] Step 2:

[2017] The terminal transmits the recorded voice data and emotion data to the server.

[2018] Step 3:

[2019] The server uses voice recognition AI to convert the voice data into text.

[2020] Step 4:

[2021] The server links the emotional data with the textual content of the speech.

[2022] Step 5:

[2023] The server organizes the textual content of the remarks and emotional data and generates minutes.

[2024] Step 6:

[2025] The server transmits the generated minutes to the terminal.

[2026] Step 7:

[2027] The terminal displays the minutes to the user.

[2028] ---

[2029] Conversational AI support for lawmakers

[2030] Step 1:

[2031] The user inputs a request for the required materials or data into the terminal.

[2032] Step 2:

[2033] The device sends a question or request to the server.

[2034] Step 3:

[2035] The server uses conversational AI to search for the most appropriate materials and data, and also takes into account the user's emotional state using an emotion engine.

[2036] Step 4:

[2037] The server organizes the search results and prepares the necessary materials and data.

[2038] Step 5:

[2039] The server sends the prepared materials and data to the terminal.

[2040] Step 6:

[2041] The terminal displays materials and data to the user.

[2042] ---

[2043] Parliamentary Data Visualization AI Function

[2044] Step 1:

[2045] The server collects data on the progress of parliament (statements by members of parliament, content of discussions, votes for or against, etc.) in real time.

[2046] Step 2:

[2047] The device collects emotional data from the lawmaker's facial expressions and tone of voice and sends it to a server.

[2048] Step 3:

[2049] The server analyzes the progress and emotion data collected and generates information that can be visualized in an easy-to-understand manner for citizens.

[2050] Step 4:

[2051] The server automatically generates visualization information (such as graphs and charts) that integrates emotional data.

[2052] Step 5:

[2053] The server sends the automatically generated visualization information to the terminal and makes it available to citizens through websites and applications.

[2054] Step 6:

[2055] The terminals display visualization information through citizen websites and applications.

[2056] These are the specific processing steps of the invention that combines the emotion engine. As a result, emotional data is reflected in the analysis of pros and cons of bills, the creation of minutes, and the visualization of progress, improving the efficiency and transparency of parliamentary operations.

[2057] Example 2

[2058] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2059] In parliamentary operations, it is essential to draft bills, manage parliamentary proceedings, compile minutes, provide materials to assembly members, and disclose information to citizens. These tasks are usually performed manually, which requires a great deal of time and effort and is prone to human error. It is also difficult to manage assembly members' remarks and progress in real time and visualize them consistently. Furthermore, there is a lack of analysis and information provision that takes into account emotional data in parliamentary operations. A system that can solve these issues efficiently and accurately is needed.

[2060] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2061] In this invention, the server includes: a means for a user to input the theme and goals of the bill creation and automatically generate the bill using a generative AI model; a means for recording the remarks of assembly members in real time and sending the audio data to the server; a means for converting the remarks into text using speech recognition AI and generating summaries; a means for visualizing the progress and analyzing the pros and cons of the bill; a means for converting the recorded audio data into text and automatically generating minutes; a means for providing materials and data to assembly members using interactive AI; a means for visualizing assembly data for citizens and generating public information; and a means for recognizing the user's emotional state using an emotion engine and reflecting it in the analysis results. This enables consistent, efficient and highly accurate operations from drafting bills to managing the progress of the meeting, creating minutes, providing materials, and disclosing information to citizens. Furthermore, analysis that takes emotion data into account enables flexible assembly management that reflects the user's emotions.

[2062] An "automatic proposal generation means" is a means of automatically creating proposals based on themes and goals input by the user using a generative AI model.

[2063] The "means for visualizing progress in real time" involves recording the remarks of members of parliament in real time, sending the audio data to a server, converting it into text using voice recognition AI, and visualizing the progress and the approval or disapproval of bills.

[2064] A "generative AI model" is a type of artificial intelligence that uses pre-trained algorithms to generate new content based on input data.

[2065] "Conversational artificial intelligence" is artificial intelligence that generates appropriate responses to user input and provides materials and data.

[2066] An "emotion engine" is an algorithm that recognizes a user's emotional state from their words and facial expressions, and reflects this as an analysis result.

[2067] "Voice recognition AI" is artificial intelligence that converts voice data into text.

[2068] The "automatic minutes generation means" is a means for converting recorded audio data into text, organizing the text, and automatically creating minutes.

[2069] A "visualization method" is a method for converting and displaying data in a format that is visually easy to understand (graphs, charts, etc.).

[2070] "Emotion data" is data that indicates the emotional state of a user, collected from their utterances, facial expressions, and the like.

[2071] "Real-time recording means" refers to a means for instantly recording a member of parliament's remarks on the spot.

[2072] "Means for generating public information" refers to a means for generating information to make parliamentary data visible to citizens and make it public.

[2073] MODE FOR CARRYING OUT THE INVENTION

[2074] This invention is a system that supports parliamentary operations and is implemented using the following hardware and software. The main hardware uses client terminals (PCs, tablets, etc.) and high-performance servers. The software includes a generative AI model, conversational AI, speech recognition AI, and an emotion engine. This system provides the following functions: automatic bill generation, real-time visualization of progress, automatic generation of minutes, support for parliamentarians through conversational AI, visualization of parliamentary data for citizens, and emotion analysis.

[2075] 1. Automatic proposal generation function

[2076] overview:

[2077] The user inputs the theme and goals of the agenda creation using a client terminal.

[2078] The terminal transmits the input information to the server.

[2079] The server automatically generates proposals using a generative AI model and returns the results to the terminal.

[2080] The terminal displays the generated proposal to the user.

[2081] Examples:

[2082] The user sets the theme as "regional road development" and sends it to the server via the terminal.

[2083] The server passes prompts such as "Please create a detailed proposal for road development in the area" to the generative AI model, which then generates the proposal.

[2084] The server sends the generated proposal back to the terminal and displays it to the user.

[2085] 2. Real-time progress visualization

[2086] overview:

[2087] The device records the remarks of lawmakers in the conference room in real time.

[2088] The device sends the recorded data to the server.

[2089] The server uses voice recognition AI to convert what is said into text and generate a summary.

[2090] The server visualizes the progress and analyzes the pros and cons of proposals.

[2091] The server sends the visualization results to the terminal and displays them to the user.

[2092] Examples:

[2093] If a member of parliament says, "I support road construction," the audio is recorded in real time.

[2094] When the device sends the voice data to the server, the voice recognition AI converts it into text, saying "I support road construction," and creates a summary.

[2095] The server analyzes the data, graphs the progress and the approval or disapproval of the proposal, and sends it to the terminal for the user to review.

[2096] 3. Automatic minutes generation function

[2097] overview:

[2098] The device records the member's remarks and sends them to a server.

[2099] The server uses voice recognition AI to convert what is said into text.

[2100] The server organizes the text of the remarks and automatically generates minutes.

[2101] The server transmits the generated minutes to the terminal and displays them to the user.

[2102] Examples:

[2103] The device records the member of parliament's "statements regarding the road construction budget proposal" and sends them to the server.

[2104] The server converts the remarks into text, organizes the necessary information, automatically generates minutes, and displays them to the user.

[2105] 4. Conversational AI support for lawmakers

[2106] overview:

[2107] The user inputs a request for materials or data into the terminal.

[2108] The terminal sends the request to the server.

[2109] The server uses interactive artificial intelligence to search for and prepare relevant materials and data.

[2110] The server sends the search results to the terminal and provides them to the user.

[2111] Examples:

[2112] When a user requests "road construction budget data for the past five years," the request is sent from the terminal to the server.

[2113] The server passes the request to a conversational AI, which searches for the appropriate data and presents it to the device.

[2114] Users can check the data and use it to run the parliament.

[2115] 5. Parliamentary data visualization function

[2116] overview:

[2117] The server collects and analyzes data on the progress of the assembly.

[2118] The server automatically generates visualized information for citizens.

[2119] The server publishes the visualized information through the terminal.

[2120] The devices display visualized information to citizens via websites and apps.

[2121] Examples:

[2122] Remarks made during the assembly, the progress of agenda items, and the pros and cons of each item are converted into graphs and charts and published in real time on the local government's website.

[2123] 6. Emotion engine function

[2124] overview:

[2125] The device collects emotional data from the lawmakers' statements and facial expressions.

[2126] The device transmits the emotion data to the server.

[2127] The server uses an emotion engine to analyze the data and recognize the user's emotional state.

[2128] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[2129] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[2130] Examples:

[2131] When a member of parliament says, "There is a problem with this plan," the device collects emotional data of dissatisfaction along with the statement and sends it to the server.

[2132] The server analyzes the data and reflects the results in a pros / cons analysis and progress visualization, which is finally displayed to the user.

[2133] In this way, the system can provide a complete parliamentary management support system with functions for drafting bills, managing proceedings, searching data, disclosing information to citizens, and analyzing sentiment data.

[2134] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2135] Processing steps for the automatic proposal generation function

[2136] Step 1:

[2137] The user inputs the theme and goal of the proposal creation.

[2138] Specific operation: The user inputs a theme such as "regional road development" or the goal of a proposal into an input form on a client terminal.

[2139] Input: Proposal topic, objectives, required information

[2140] Output: The input data

[2141] Step 2:

[2142] The terminal transmits the input information to the server.

[2143] Specific operation: The terminal sends the input data to the server using the HTTPS protocol.

[2144] Input: Data entered

[2145] Output: Send data to the server

[2146] Step 3:

[2147] The server receives the information and generates a proposal using a generation AI.

[2148] Specific operation: The server passes the prompt "Please create a detailed proposal for road development in the area" to the generation AI model, and generates a proposal.

[2149] Input: User-entered themes and goals

[2150] Output: Auto-generated proposals

[2151] Step 4:

[2152] The server transmits the generated proposal to the terminal.

[2153] Specific operation: The server compiles the generated proposals in JSON format and sends them to the terminal.

[2154] Input: Auto-generated proposal

[2155] Output: Sending data to the terminal

[2156] Step 5:

[2157] The terminal displays the generated proposal to the user.

[2158] Specific operation: The device displays the received proposal on the screen so that the user can check the contents.

[2159] Input: Proposal data from the server

[2160] Output: The displayed proposal

[2161] Real-time visualization of progress of processing steps

[2162] Step 1:

[2163] The device records the lawmaker's remarks in real time.

[2164] Specific operation: The device uses the microphone in the conference room to record the member's remarks.

[2165] Input: Congressman's statement

[2166] Output: Recorded audio data

[2167] Step 2:

[2168] The terminal transmits the voice data to the server.

[2169] Specific operation: The device sends the recorded audio data to the server in real time.

[2170] Input: Recorded audio data

[2171] Output: Send audio data to the server

[2172] Step 3:

[2173] The server uses voice recognition AI to convert what is said into text.

[2174] Specific operation: The server uses voice recognition AI to convert the received voice data into text.

[2175] Input: Audio data

[2176] Output: Translated utterances

[2177] Step 4:

[2178] The server visualizes the progress and analyzes the pros and cons of proposals.

[2179] Specific operation: The server analyzes the textual comments and converts the progress and the pros and cons of the proposals into graphs and charts.

[2180] Input: Textual statements, pros and cons data

[2181] Output: visualized data (graphs, charts)

[2182] Step 5:

[2183] The server sends the visualization results to the terminal.

[2184] Specific operation: The server compiles the visualization data in JSON format and sends it to the terminal.

[2185] Input: Visualized data

[2186] Output: Sending data to the terminal

[2187] Step 6:

[2188] The terminal displays the visualization results to the user.

[2189] Specific operation: The device displays the visualization data received on the screen as graphs and charts.

[2190] Input: Visualization data from the server

[2191] Output: The displayed visualization result

[2192] Processing steps of the meeting minutes automatic generation function

[2193] Step 1:

[2194] The device records the member's remarks and sends them to a server.

[2195] Specific operation: The device records the member's speech and sends the audio data to the server.

[2196] Input: Congressman's statement

[2197] Output: Send audio data to the server

[2198] Step 2:

[2199] The server uses voice recognition AI to convert what is said into text.

[2200] Specific operation: The server uses voice recognition AI to convert the received voice data into text.

[2201] Input: Audio data

[2202] Output: Translated utterances

[2203] Step 3:

[2204] The server organizes the text of the remarks and automatically generates minutes.

[2205] Specific operation: The server organizes the textual comments and compiles them into minutes.

[2206] Input: Transcribed speech

[2207] Output: Auto-generated meeting transcript

[2208] Step 4:

[2209] The server transmits the generated minutes to the terminal and displays them to the user.

[2210] Specific operation: The server sends the generated minutes to the terminal, and the terminal displays the contents to the user.

[2211] Input: Auto-generated meeting minutes

[2212] Output: Display the minutes to the user

[2213] Processing steps for the lawmaker support function using conversational AI

[2214] Step 1:

[2215] The user inputs a request for materials or data into the terminal.

[2216] Specific operation: The user requests "road construction budget data for the past five years" from the client terminal interface.

[2217] Input: Request for materials or data

[2218] Output: The requested data entered

[2219] Step 2:

[2220] The terminal sends a request to the server.

[2221] Specific operation: The device compiles the requested data and sends it to the server.

[2222] Input: The requested data

[2223] Output: Sends request data to the server

[2224] Step 3:

[2225] The server uses conversational AI to search for and prepare relevant materials and data.

[2226] Specific operation: The server uses conversational AI to search for "budget data for road construction over the past five years" and prepares the appropriate data.

[2227] Input: The requested data

[2228] Output: Search results and data

[2229] Step 4:

[2230] The server sends the search results to the terminal and provides them to the user.

[2231] Specific operation: The server sends prepared materials and data to the terminal so that the user can check them.

[2232] Input: Prepared materials and data

[2233] Output: Sending materials and data to the terminal and providing them to the user

[2234] Parliamentary Data Visualization Feature Processing Steps

[2235] Step 1:

[2236] The server collects and analyzes data on the progress of the assembly.

[2237] Specific operation: The server collects and analyzes data generated during the session (such as statements, progress on agenda items, and votes for or against).

[2238] Input: Congressional proceedings data

[2239] Output: Parsed data

[2240] Step 2:

[2241] The server automatically generates visualized information for citizens.

[2242] Specific operation: The server uses the analyzed data to automatically generate graphs and charts that are easy for citizens to understand.

[2243] Input: Parsed data

[2244] Output: Automatically generated visualization information

[2245] Step 3:

[2246] The server publishes the visualized information through the terminal.

[2247] Specific operation: The server sends the generated visualization information to the device and makes it available via a website or app.

[2248] Input: Automatically generated visualization information

[2249] Output: Sending and publishing data to a device

[2250] Step 4:

[2251] The devices display visualized information to citizens via websites and apps.

[2252] Specific operation: The visualized information received by the device is displayed on a website or app screen for citizens to see.

[2253] Input: Visualization information from the server

[2254] Output: Display information to citizens

[2255] Emotion Engine Function Processing Steps

[2256] Step 1:

[2257] The device collects emotional data from the user's (legislator's) statements and facial expressions.

[2258] How it works: The device uses the lawmaker's camera and microphone to collect real-time emotional data from what they say and their facial expressions.

[2259] Input: Speech content, facial expression

[2260] Output: Emotion data

[2261] Step 2:

[2262] The device transmits the emotion data to the server.

[2263] Specific operation: The device sends the collected emotion data to the server.

[2264] Input: Emotion data

[2265] Output: Send data to the server

[2266] Step 3:

[2267] The server uses an emotion engine to analyze the data and recognize the user's emotional state.

[2268] Specific operation: The server uses the emotion engine to analyze the received emotion data and recognize the user's emotional state.

[2269] Input: Emotion data

[2270] Output: Analysis results

[2271] Step 4:

[2272] The server incorporates the emotional data into other functions (analysis of the pros and cons of proposals, visualization of progress, and creation of minutes) and reflects it in the analysis results.

[2273] Specific operation: The server applies the recognized emotion data to other system functions, such as analyzing pros and cons, visualizing progress, and creating meeting minutes.

[2274] Input: Emotion data, other function data

[2275] Output: Analysis results reflecting emotion data

[2276] Step 5:

[2277] The server sends the analysis results, including the emotion data, to the terminal and displays them to the user.

[2278] Specific operation: The server sends the analysis results, including emotion data, to the device, which then displays the results on the screen.

[2279] Input: Analysis results containing emotion data

[2280] Output: what is displayed to the user

[2281] As described above, through the processing steps of each function, this system supports parliamentary operations, enabling efficient and accurate drafting of bills, recording of minutes, progress management, sentiment analysis, and disclosure of information to citizens.

[2282] (Application example 2)

[2283] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2284] In conventional factory systems, the generation of production instructions, the monitoring of the progress of the production line, the recording of work content, and the management of production records are often done manually, resulting in a large amount of labor and time consumption and inefficiency. The present invention aims to solve these problems and provide an efficient and automated production management system. It also provides a means for understanding the emotional state of workers and appropriately managing the work environment.

[2285] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[2286] In this invention, the server includes a means for automatically generating production instructions, a means for visualizing the progress of the production line in real time, a means for recording work content and automatically generating production records, a means for providing materials and data to workers using interactive AI, a means for visualizing production data for managers and generating public information, and a means for recognizing and analyzing worker emotions. This enables the automation and efficiency of production management and improves the work environment.

[2287] "Production instructions" refers to instructions or orders that direct the production of specific tasks or products in a factory.

[2288] "Auto-generation" refers to the creation of data or information by a system using pre-set algorithms or processes without human intervention.

[2289] A "production line" refers to a series of equipment or arrangements in which multiple processes or work steps are carried out consecutively in the production process of a product.

[2290] "Status" refers to the state or condition that indicates the stage at which a particular project or task is.

[2291] "Real-time" refers to a state in which information or data is processed or displayed the moment it is generated.

[2292] "Visualization" refers to converting data and information into a visually easy-to-understand form and displaying it.

[2293] "Work content" refers to the specific actions and steps performed in a particular job or task.

[2294] "Production records" refers to documents and data that record various data and events that occur during the production process of a product.

[2295] "Conversational artificial intelligence" refers to AI systems designed to converse with humans in a natural way, providing information in response to questions and commands.

[2296] "Materials" refers to documents or data containing information for a particular purpose or topic.

[2297] "Data" refers to a collection of information, such as facts and figures, that can be used for calculations and analysis.

[2298] "Administrator-oriented" means that the system or data is intended primarily for administrator use.

[2299] "Recognizing emotions" refers to determining a person's emotional state from facial expressions, tone of voice, etc.

[2300] "Analyze" refers to examining data or information in detail to clarify its meaning and structure.

[2301] The system that realizes this application example is a robot-equipped AI system that supports factory production line management. This system includes functions such as automatic generation of production instructions, real-time visualization of production line progress, automatic generation of work records and production records, support for workers using interactive AI, visualization of production data for managers, and recognition and analysis of worker emotions.

[2302] Automatic production instruction generation function

[2303] The server automatically generates production instructions based on order and inventory data. Users input order details into a terminal, and the server automatically generates appropriate production instructions using a generative AI model. This reduces the time and effort required to create production instructions.

[2304] Real-time visualization of production line progress

[2305] The server monitors and visualizes the progress of the production line in real time. The terminals send data obtained from sensors to the server, which analyzes the data and displays the progress as graphs and charts. This allows managers to grasp the current status of the production line at a glance.

[2306] Production record creation AI function

[2307] The server records the robot's work and production progress in real time and automatically creates a production record. The server converts the data recorded by the terminal into text, organizes and compiles it into a production record. This function eliminates the need to manually create production records.

[2308] Conversational AI-based worker support function

[2309] The server uses conversational artificial intelligence to provide appropriate information in response to questions and document requests from workers. When a worker enters a query into their terminal, the server searches for relevant documents and data and provides them through the terminal. This function allows workers to quickly obtain the information they need.

[2310] Production data visualization AI function

[2311] The server collects and analyzes production data and generates visualized information for managers. The server analyzes data acquired through terminals and provides visualized information such as graphs and charts to managers. This function allows managers to efficiently grasp the overall picture of production.

[2312] Emotion engine function

[2313] The server collects data on workers' facial expressions and voices and analyzes it using an emotion engine. The server then analyzes the emotion data acquired by the device and uses it to improve the work environment. The results of this analysis are linked with other functions to contribute to optimizing the work environment.

[2314] As a concrete example, consider the case where a worker requests production instructions. The user enters order data into a terminal, and production instructions are automatically generated using a generative AI model. In this process, the following prompt sentences are used:

[2315] Example prompt sentence:

[2316] "Please generate production instructions based on the following order data.

[2317] Order ID: 12345

[2318] Product Name: Part A

[2319] Quantity: 100"

[2320] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2321] Step 1:

[2322] The user enters order data into the terminal and sends the data to the server. The user enters the necessary information such as product name, quantity, and deadline, and clicks the send button to send the input data to the server. The input includes the order ID, product name, quantity, and deadline.

[2323] Step 2:

[2324] The server uses the generative AI model to carry out the process of automatically generating production instructions. The server inputs the received order data into the AI ​​model and generates appropriate production instructions using an algorithm. During this process, the server obtains necessary information from the relevant database and performs data calculations. The output includes the generated production instructions.

[2325] Step 3:

[2326] The server sends the generated production instructions to the terminal and displays them to the user. The generated production instructions are received by the terminal and displayed on the user's screen. The user checks the production instructions and makes corrections as necessary. The input includes production instruction data from the server, and the output includes a display to the user.

[2327] Step 4:

[2328] The terminal acquires data from sensors on the progress of the production line in real time and sends it to the server. The terminal collects data obtained from the sensors and periodically sends it to the server. The input includes progress data from the sensors, and the output includes data sent to the server.

[2329] Step 5:

[2330] The server analyzes the progress data in real time and generates graphs and charts for visualization. The server analyzes the data it receives and creates graphs and charts for easy-to-understand progress display. This includes data processing and calculations. The output includes visualized graphs and charts.

[2331] Step 6:

[2332] The server sends the visualized progress data to the terminal and displays it to the user. The terminal updates the screen displaying the progress status for the administrator based on the received data. The input includes the visualized data from the server, and the output includes the display to the user.

[2333] Step 7:

[2334] The terminal accepts questions and requests for materials from workers and sends them to the server. When a worker enters a question or request for materials into the terminal and clicks the send button, the data is sent to the server. The input includes the question data from the worker, and the output is the data sent to the server.

[2335] Step 8:

[2336] The server uses conversational artificial intelligence to search for and prepare the requested materials and data. It searches for appropriate materials based on the received query data and compiles the results. The input includes the query data from the worker, and the output includes the search results.

[2337] Step 9:

[2338] The server sends the retrieved materials and data to the terminal and provides them to the worker. The terminal displays the received materials to the worker. The input includes the material data from the server, and the output includes the display to the worker.

[2339] Step 10:

[2340] The terminal collects emotional data such as facial expressions and tone of voice of the worker and sends it to the server. This data, collected using a camera and microphone, is periodically sent to the server. The input includes emotional data, and the output includes transmission to the server.

[2341] Step 11:

[2342] The server uses an emotion engine to analyze the received emotion data and recognize the emotional state. It performs data analysis and determines the emotional state of the worker. The input includes emotion data, and the output includes the emotion analysis results.

[2343] Step 12:

[2344] The server connects the results of the emotion analysis with other system functions to help improve the overall system. Based on the analysis results, progress can be visualized and production instructions can be adjusted. The input includes the emotion analysis results, and the output includes the optimization of other system functions.

[2345] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[2346] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2347] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[2348] [Fourth embodiment]

[2349] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[2350] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[2351] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[2352] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[2353] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[2354] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[2355] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[2356] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[2357] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[2358] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[2359] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[2360] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[2361] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2362] The system of the present invention has the following main functions:

[2363] 1. Automatic proposal generation function

[2364] 2. Real-time visualization of parliamentary progress

[2365] 3. AI Minute-Taking Function

[2366] 4. Conversational AI support for lawmakers

[2367] 5. AI Function for Visualizing Parliamentary Data

[2368] These functions will now be described in detail.

[2369] ---

[2370] Automatic bill generation function

[2371] explanation:

[2372] The user inputs the requirements for creating a proposal into the terminal.

[2373] The terminal transmits the input information to the server.

[2374] The server automatically generates proposals using generation AI and sends them to the terminal.

[2375] The terminal displays the generated proposal to the user.

[2376] Examples:

[2377] When a user requests the creation of a proposal on the theme of "regional road improvement," the server collects relevant data, generates a detailed proposal on regional road improvement, and displays it to the user.

[2378] ---

[2379] Real-time visualization of parliamentary progress

[2380] explanation:

[2381] The device records the member's remarks in real time and sends them to a server.

[2382] The server uses voice recognition AI to analyze the content of the speech and generate a summary.

[2383] The server visualizes the progress and analyzes the pros and cons of proposals.

[2384] The server sends the visualization results to the terminal and displays them to the user.

[2385] Examples:

[2386] The voice of a member of parliament who says "I support road construction" during a meeting is analyzed in real time, and the server summarizes this as "I support road construction," and the votes for and against the bill are tallied and displayed on the terminal.

[2387] ---

[2388] AI function for creating meeting minutes

[2389] explanation:

[2390] The device records the member's remarks and sends them to a server.

[2391] The server uses voice recognition AI to convert what is said into text.

[2392] The server organizes the text of the remarks and automatically generates minutes.

[2393] The server transmits the generated minutes to the terminal and displays them to the user.

[2394] Examples:

[2395] The content of "remarks on the road construction budget proposal" is converted into text in real time and incorporated directly into the minutes of the meeting.

[2396] ---

[2397] Conversational AI support for lawmakers

[2398] explanation:

[2399] The user inputs a request for materials or data into the terminal.

[2400] The terminal sends a request to the server.

[2401] The server uses conversational AI to search for and prepare appropriate materials and data.

[2402] The server sends the search results to the terminal and provides them to the user.

[2403] Examples:

[2404] When a user requests "road construction budget data for the past five years," the server instantly searches for the data and displays it on the terminal.

[2405] ---

[2406] Parliamentary Data Visualization AI Function

[2407] explanation:

[2408] The server collects and analyzes data on the progress of the assembly.

[2409] The server automatically generates visualized information for citizens.

[2410] The server publishes the visualized information through the terminal.

[2411] The devices display visualized information to citizens via websites and apps.

[2412] Examples:

[2413] Comments made during the council meeting, the progress of agenda items, and the pros and cons will be converted into easy-to-read graphs and charts for citizens to view and published in real time on the local government's website.

[2414] ---

[2415] This system aims to improve the efficiency of parliamentary operations by analyzing and visualizing the remarks of assembly members and the progress of parliament in real time, and by providing multiple functions such as automatically generating minutes and providing materials.In addition, by providing information to citizens in real time, it is also intended to improve the transparency and reliability of parliament.

[2416] The processing flow will be explained below.

[2417] Automatic bill generation function

[2418] Step 1:

[2419] The user inputs the agenda creation theme, goals, and necessary information into the terminal.

[2420] Step 2:

[2421] The terminal transmits the input requirement data for creating a proposal to the server.

[2422] Step 3:

[2423] The server calls up the generative AI model and automatically generates detailed proposals based on the received requirements data, for example, by referencing relevant laws and information on similar proposals from the past.

[2424] Step 4:

[2425] The server transmits the generated proposal to the terminal.

[2426] Step 5:

[2427] The terminal displays the generated proposal to the user.

[2428] ---

[2429] Real-time visualization of parliamentary progress

[2430] Step 1:

[2431] The device records the lawmaker's remarks in real time.

[2432] Step 2:

[2433] The device sends the recorded audio data to the server.

[2434] Step 3:

[2435] The server uses voice recognition AI to convert the recorded data into text and analyze the content of the speech.

[2436] Step 4:

[2437] The server summarizes the analyzed speech.

[2438] Step 5:

[2439] The server analyzes the pros and cons of the proposals from the textual content of the comments and tallys up the number of opinions in favor and against.

[2440] Step 6:

[2441] The server generates progress visualization data (graphs, charts, etc.).

[2442] Step 7:

[2443] The server sends the visualization data to the terminal.

[2444] Step 8:

[2445] The terminal displays the visualized data to the user in real time.

[2446] ---

[2447] AI function for creating meeting minutes

[2448] Step 1:

[2449] The device records the lawmaker's remarks in real time.

[2450] Step 2:

[2451] The device sends the recorded audio data to the server.

[2452] Step 3:

[2453] The server uses voice recognition AI to convert the voice data into text.

[2454] Step 4:

[2455] The server automatically organizes the textual content of the remarks and generates minutes.

[2456] Step 5:

[2457] The server transmits the generated minutes to the terminal.

[2458] Step 6:

[2459] The terminal displays the minutes to the user.

[2460] ---

[2461] Conversational AI support for lawmakers

[2462] Step 1:

[2463] The user inputs questions or requests about the materials or data they need into the terminal.

[2464] Step 2:

[2465] The device sends a question or request to the server.

[2466] Step 3:

[2467] The server uses conversational AI to search for the most appropriate materials and data based on the request.

[2468] Step 4:

[2469] The server organizes the search results and prepares the necessary materials and data.

[2470] Step 5:

[2471] The server sends the prepared materials and data to the terminal.

[2472] Step 6:

[2473] The terminal displays materials and data to the user.

[2474] ---

[2475] Parliamentary Data Visualization AI Function

[2476] Step 1:

[2477] The server collects data on the progress of parliament (statements by members of parliament, content of discussions, votes for or against, etc.) in real time.

[2478] Step 2:

[2479] The server analyzes the collected data and generates information that can be visualized in an easy-to-understand manner for citizens.

[2480] Step 3:

[2481] The server automatically generates visualization information in a visual format (such as graphs or charts).

[2482] Step 4:

[2483] The server sends the generated visualization information to the terminal and makes it available to citizens through websites and applications.

[2484] Step 5:

[2485] The terminals display visualization information through citizen websites and applications.

[2486] The above are the specific processing steps for each function of this system, and are necessary to efficiently support the management of local government assemblies.

[2487] Example 1

[2488] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2489] Traditional parliamentary operations involve a large amount of manual work, making things like drafting bills, compiling minutes, managing parliamentary progress, and searching for and providing materials extremely inefficient. It's also difficult to visualize parliamentary data and provide information to citizens in real time, creating a need for greater transparency. There's a need to solve these problems and improve the efficiency of parliamentary operations and the provision of information to citizens.

[2490] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[2491] In this invention, the server includes means for receiving requirements for bill creation input by a user and using a generative AI model to automatically generate bills, means for recording council members' remarks in real time, analyzing the remarks using voice recognition technology, and visualizing the progress, means for analyzing the remarks and generating summaries, means for aggregating and analyzing votes for and against bills in real time, means for recording council members' remarks, converting them into text using voice recognition technology, and automatically generating minutes, means for providing materials and data in response to user requests using interactive AI, and means for analyzing council data, visualizing it for citizens, and generating and displaying public information. This improves the efficiency of council operations and enables real-time information provision and improved transparency.

[2492] "User" means a person or entity that operates the system and inputs and uses information.

[2493] A "terminal" is a device (e.g., a PC, tablet, smartphone, etc.) that a user uses to operate the system.

[2494] A "server" is a computer or network system that centralizes the processing of the entire system and receives and transmits data.

[2495] A "bill" is a formal proposal or plan submitted to Parliament for consideration.

[2496] A "generative AI model" is an algorithm or system that uses artificial intelligence technology to automatically generate text or data.

[2497] A "parliament" is an organization where representatives of public institutions and organizations gather to discuss and decide on policies, laws, budgets, etc.

[2498] "Progress" is information that indicates the progress of each bill or agenda item in the assembly.

[2499] "Voice recognition technology" is a technology that analyzes voice data and converts it into text data.

[2500] A "summary" is a short summary of the main points of the original information.

[2501] "For or against" refers to opinions or voting results in favor or against a motion or proposal.

[2502] "Documents" are reference materials such as data, documents, statistics, etc. used by Parliament.

[2503] "Conversational AI" is an AI system that can naturally interact with users, answering their questions and providing them with information.

[2504] "Visualization" refers to the visual representation of data in the form of a graph, chart, or other form.

[2505] "Public information" is information relating to Parliament that is made accessible to citizens and the general public.

[2506] Minutes are official documents that record statements and decisions made in parliament.

[2507] The system of the present invention aims to improve the efficiency and transparency of parliamentary operations and has the following main functions, which are implemented by the server, terminals, and users.

[2508] 1. Automatic proposal generation function

[2509] explanation:

[2510] The user inputs the requirements for creating a proposal into the terminal. For example, the user may request the creation of a proposal on the theme of "regional road development."

[2511] The terminal sends the input information to the server, which includes supplementary information such as the topic, budget, deadline, and stakeholders.

[2512] The server automatically generates a proposal using a generative AI model. Specifically, the server analyzes the user's input information and provides the generative AI model (e.g., OpenAI GPT-4) with a prompt such as, "Please create a proposal regarding road construction in the area."

[2513] The server transmits the generated proposal to the terminal.

[2514] The device displays the generated agenda to the user. The agenda is provided in a human-readable format (e.g., PDF or Word document).

[2515] 2. Real-time visualization of parliamentary progress

[2516] explanation:

[2517] The device records the speech of the legislator in real time, and audio data is acquired using microphones placed in the conference room.

[2518] The device sends the recorded data to the server. The recorded data is packetized at regular intervals (e.g., every 10 seconds) and sent.

[2519] The server analyzes what is being said using speech recognition technology, for example, the Google Cloud Speech-to-Text API, to convert the speech data into text.

[2520] The server visualizes the progress, tallies votes for and against proposals, generates summaries, and converts statements and votes into graphs and charts.

[2521] The server sends the visualization results to the terminal.

[2522] The device displays the visualization results to the user, and the visualization data is provided on a web page or within a dedicated app.

[2523] 3. AI Minute-Taking Function

[2524] explanation:

[2525] The device records the speech of the legislator. For example, audio data is acquired using a microphone placed in the conference room.

[2526] The device sends the recorded data to the server in batches.

[2527] The server converts what is said into text using speech recognition technology, for example, Amazon Transcribe.

[2528] The server organizes the transcribed remarks and automatically generates minutes. It uses a natural language processing algorithm to analyze the context and automatically generates minutes according to the format.

[2529] The server transmits the generated minutes to the terminal.

[2530] The terminal displays the minutes to the user, which are provided in formats such as PDF.

[2531] 4. Conversational AI support for lawmakers

[2532] explanation:

[2533] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[2534] The terminal sends a request to the server, which converts the request into a prompt.

[2535] The server uses conversational artificial intelligence to search for appropriate materials and data, and performs the search process using a generative AI model (e.g., OpenAI GPT-4).

[2536] The server sends the search results to the device. The data is sent in JSON format or similar.

[2537] The terminal provides the search results to the user, using graphs and tables as display formats.

[2538] 5. AI Function for Visualizing Parliamentary Data

[2539] explanation:

[2540] The server collects data on the progress of the parliament and periodically retrieves data from the parliament system.

[2541] The server analyzes the progression data and uses analysis algorithms to extract important information.

[2542] The server automatically generates visualized information for citizens and converts the generated data into graphs and charts.

[2543] The server publishes the visualization information, which is then published via a Web API.

[2544] The device displays the visualized information to citizens, who can access it through the local government's website or app, for example.

[2545] This system will improve the efficiency of parliamentary operations, provide real-time information, and increase transparency.

[2546] The flow of the identification process in the first embodiment will be described with reference to FIG.

[2547] Automatic bill generation function

[2548] Processing Steps:

[2549] Step 1:

[2550] The user inputs the requirements for creating a proposal into the terminal. For example, the topic is "regional road development," and necessary supplementary information such as the budget and deadline is included.

[2551] Step 2:

[2552] The terminal sends the entered information to the server. The entered data is encrypted and sent using a secure communication protocol (e.g. HTTPS). Input: Proposal creation requirements entered by the user. Output: Encrypted data packet.

[2553] Step 3:

[2554] The server automatically generates a proposal using a generative AI model. The server analyzes the user's input information and provides the generative AI model with a prompt: "Please create a proposal regarding road improvement in the area." Input: Encrypted data packet. Output: Automatically generated proposal data.

[2555] Step 4:

[2556] The server sends the generated proposal to the terminal. The output data is formatted as needed. Input: Automatically generated proposal data. Output: Formatted proposal data.

[2557] Step 5:

[2558] The terminal displays the generated agenda to the user. The agenda is displayed in a format that is easy for humans to understand, such as a PDF or Word document. Input: Formatted agenda data. Output: Agenda in a format that can be viewed by the user.

[2559] ---

[2560] Real-time visualization of parliamentary progress

[2561] Processing Steps:

[2562] Step 1:

[2563] The device records the speech of the legislator in real time, and captures the audio data using microphones placed in the conference room.

[2564] Step 2:

[2565] The device sends the recorded data to the server. The recorded data is packetized at regular intervals and sent over the network. Input: Recorded voice data. Output: Packetized voice data.

[2566] Step 3:

[2567] The server analyzes the speech using speech recognition technology. The speech data is converted into text data using a speech recognition engine (for example, Google Cloud Speech-to-Text API). Input: Packetized speech data. Output: Texted speech.

[2568] Step 4:

[2569] The server visualizes the progress and tally the votes for and against the proposals. The server analyzes the content of the comments and the information on the votes for and against, and converts it into graphs and charts. Input: Textualized content of the comments. Output: Visualized progress data.

[2570] Step 5:

[2571] The server sends the visualization results to the terminal. Input: visualized progress data. Output: formatted visualization data.

[2572] Step 6:

[2573] The device displays the visualization results to the user. The visualized data is displayed on a web page or in a dedicated app. Input: Formatted visualized data. Output: Visualized data in a format that can be viewed by the user.

[2574] ---

[2575] AI function for creating meeting minutes

[2576] Processing Steps:

[2577] Step 1:

[2578] The device records what the council member says, collecting audio data using microphones placed in the conference room.

[2579] Step 2:

[2580] The device sends the recorded data to the server. The data is batch processed at regular intervals and sent. Input: Recorded audio data. Output: Batched audio data.

[2581] Step 3:

[2582] The server uses speech recognition technology to convert the speech into text. A speech recognition engine (e.g., Amazon Transcribe) is used to convert the speech data into text. Input: Batched speech data. Output: Translated speech.

[2583] Step 4:

[2584] The server organizes the textual content of remarks and automatically generates minutes. A natural language processing algorithm is used to organize the text data and convert it into a format suitable for the minutes format. Input: Textual content of remarks. Output: Automatically generated minutes.

[2585] Step 5:

[2586] The server sends the generated minutes to the terminal. The generated minutes are converted into a format such as PDF or Word document. Input: Automatically generated minutes. Output: Formatted minutes data.

[2587] Step 6:

[2588] The terminal displays the minutes to the user. The generated minutes are displayed in a format that can be easily viewed by the user. Input: Formatted minutes data. Output: Minutes in a format that can be viewed by the user.

[2589] ---

[2590] Conversational AI support for lawmakers

[2591] Processing Steps:

[2592] Step 1:

[2593] A user inputs a request for information or data, for example, "Please provide me with road maintenance budget data for the past five years."

[2594] Step 2:

[2595] The terminal sends a request to the server. The request content is converted into a prompt sentence format and sent. Input: User's request content. Output: Data in prompt sentence format.

[2596] Step 3:

[2597] The server uses conversational artificial intelligence to search for appropriate materials and data. It uses a conversational AI model (e.g., OpenAI GPT-4) to search for appropriate information from databases and online resources. Input: Data in the form of a prompt sentence. Output: Search result data.

[2598] Step 4:

[2599] The server sends the search results to the terminal. The search results are formatted in JSON format and sent. Input: Search result data. Output: Formatted search result data.

[2600] Step 5:

[2601] The terminal provides the search results to the user. Graphs, tables, etc. are used as display formats. Input: Formatted search result data. Output: Search results in a format that can be viewed by the user.

[2602] ---

[2603] Parliamentary Data Visualization AI Function

[2604] Processing Steps:

[2605] Step 1:

[2606] The server collects the progress data of the assembly. It periodically obtains data from the assembly system. Input: Progress data from the assembly system. Output: Collected progress data.

[2607] Step 2:

[2608] The server parses the progress data. It uses parsing algorithms to extract important information and convert it into the required format. Input: Collected progress data. Output: Parsed progress data.

[2609] Step 3:

[2610] The server automatically generates visualized information for citizens. It converts the data into graphs and charts, making it easy for citizens to understand. Input: Analyzed progress data. Output: Visualized information data.

[2611] Step 4:

[2612] The server publishes the visualized information. The automatically generated visualized data is published via a Web API. Input: visualized information data. Output: data via the public API.

[2613] Step 5:

[2614] The device displays the visualized information to citizens. For example, it is made accessible to citizens through the local government's website or app. Input: Data via public API. Output: Visualized data in a format that citizens can view.

[2615] These processing steps will improve the efficiency of parliamentary operations, provide real-time information to citizens, and increase transparency.

[2616] (Application example 1)

[2617] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2618] Conventional parliamentary management support systems were limited to basic functions such as automatically generating bills and visualizing parliamentary progress, and were therefore unable to handle practical matters outside of parliament or security management. In particular, they lacked the functionality to analyze surveillance footage in real time and issue an immediate warning when an abnormality was detected, making it difficult to ensure safety in situations where a rapid response was required. These issues need to be resolved.

[2619] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2620] In this invention, the server includes a means for automatically generating bills, a means for visualizing the progress of the assembly in real time, a means for analyzing video data from a monitoring device in real time to detect abnormalities, a means for issuing an immediate warning when an abnormality is detected, and a means for visualizing the results of the real-time analysis. This enables support for assembly operations as well as real-time detection of abnormalities and immediate warnings using the monitoring device.

[2621] "Means for automatically generating proposals" refers to functions and processes for automatically creating proposals based on input requirements.

[2622] "Means for visualizing the progress of parliamentary proceedings in real time" refers to the function and process of aggregating statements and progress made during parliamentary proceedings in real time and displaying them in a visually easy-to-understand manner.

[2623] The "means for generating a summary of speech content" refers to a function and process for analyzing the speech of a member of parliament and automatically generating a summary that concisely summarizes the content.

[2624] "Means for analyzing the pros and cons of bills" refers to the function and process for compiling and analyzing each member's position on bills in parliament, whether for or against.

[2625] "Means for automatically generating minutes" refers to the functions and processes for converting statements made during a meeting into text, organizing it, and automatically generating it as minutes.

[2626] "Means for providing materials and data to members of parliament using interactive artificial intelligence" refers to the functions and processes for using interactive artificial intelligence to search for and provide materials and data in response to requests from members of parliament.

[2627] "Means for visualizing parliamentary data for citizens and generating public information" refers to the functions and processes for collecting and analyzing parliamentary progress data, visualizing it in a form that is easy for citizens to understand, and generating it as public information.

[2628] "Means for analyzing video data from a monitoring devic...

Claims

1. A system to support parliamentary operations, a means for automatically generating proposals; a means of visualizing the progress of parliamentary proceedings in real time; means for generating a summary of the utterances; A means of analyzing the pros and cons of proposals; A means for automatically generating minutes; A means of providing materials and data to lawmakers using conversational artificial intelligence; A means to visualize parliamentary data for citizens and generate public information; A system including:

2. 2. The system according to claim 1, further comprising means for recording speech data in real time and converting it into text using speech recognition.

3. 2. The system according to claim 1, further comprising a visualization unit that analyzes the content of statements and the pros and cons of proposals in real time and generates graphs or charts for visualization.

Images