System
The system addresses reservation inefficiencies and information leaks by automating facility selection, managing user patterns, and digitizing meeting content, improving overall conference management.
Patent Information
- Application Number
- JP2024131303
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2024-08-07
- Publication Date
- 2026-02-20
AI Technical Summary
Companies face issues with overlapping reservations, unclear facility availability, mismatched facility capacity, user non-compliance with reservation rules, and the risk of information leaks during meetings.
A system that allows users to input meeting details, automatically selects suitable facilities, manages reservations based on user creditworthiness, and digitizes meeting content for secure storage and retrieval.
Enhances conference facility reservation efficiency and reduces information leaks by optimizing facility use and managing reservations effectively.
Smart Images

Figure 2026028687000001_ABST
Abstract
Description
[Technical Field]
[0001] The technology of the present disclosure relates to a system. [Background technology]
[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]
[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]
[0004] Even in today's information society, many companies still face the problem of reserving facilities for conferences. Specific issues include the following:
[0005] 1. Confusion due to overlapping reservations.
[0006] 2. The availability of conference facilities is unclear, making it difficult to use them efficiently.
[0007] 3. Inconvenience caused by the facility capacity not matching the number of participants in the meeting.
[0008] 4. Troubles caused by users not following reservation rules.
[0009] 5. Risk of information discussed during the meeting being leaked to the outside.
[0010] There is a need for a system that can solve these problems efficiently and safely. [Means for solving the problem]
[0011] In order to solve the above problems, the present invention provides the following means.
[0012] 1. Provide a reception method for entering the date, time, and number of people for a meeting, allowing users to easily enter reservation information.
[0013] 2. Provide a means to automatically select and reserve the most suitable conference facility based on the input information, thereby preventing duplicate reservations.
[0014] 3. Establish a system for scheduling meetings based on their importance, including the use of online meetings, to ensure efficient use of physical facilities.
[0015] 4. Analyze the reservation patterns of multiple users, establish a means to manage reservations based on creditworthiness, and set priority for legitimate users.
[0016] 5. Maximize utilization by understanding the usage status of meeting facilities in real time and providing notification in the event of cancellations.
[0017] 6. Establish a means to automatically digitize and save meeting content, so that important information can be managed without leaking.
[0018] 7. Centrally manage the information assets decided at the meeting, establish measures to support project recovery, and make effective use of important information.
[0019] This will make it possible to make the reservation and operation of conference facilities more efficient and reduce the risk of information leaks.
[0020] The "reception means" is an interface for inputting and processing reservation information such as the date and time of the meeting, the number of people, and the importance of the meeting.
[0021] The "automatic selection and reservation means" is a system that automatically selects the most suitable conference facility based on information obtained from the reception means and confirms the reservation.
[0022] "Means for coordinating reservations, including the use of online meetings" refers to a system that analyzes the importance and content of meetings and, if necessary, changes them to online meetings without using physical facilities.
[0023] The "means of analyzing reservation patterns and managing reservations based on creditworthiness" refers to a system that evaluates the creditworthiness of each user based on their past reservation history and cancellation frequency, and prioritizes and limits reservations.
[0024] "Means of understanding usage status in real time and notifying in the event of cancellations" refers to a system that constantly monitors the usage status of conference facilities and appropriately notifies users when a reservation is canceled.
[0025] "Means for automatically converting meeting contents into data and saving them" refers to a system that automatically records discussions and decision-making during meetings as text or audio data and saves it in a secure location.
[0026] "A means of centrally managing information assets decided in meetings and supporting project recovery" is a system that centrally manages meeting minutes and decisions, and uses that information to respond quickly when a project faces problems. [Brief explanation of the drawings]
[0027] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION
[0028] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.
[0029] First, the terms used in the following description will be explained.
[0030] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).
[0031] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.
[0032] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.
[0033] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.
[0034] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."
[0035] [First embodiment]
[0036] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.
[0037] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.
[0038] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0039] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.
[0040] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.
[0041] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.
[0042] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.
[0043] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.
[0044] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0045] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0046] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0047] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0048] This invention is a conference facility management system that uses AI technology and comprehensively manages everything from conference reservations to operation and information management. This system is composed of users, terminals, and a server.
[0049] Overall system overview
[0050] The system provides the following main functions:
[0051] 1. Meeting reception function
[0052] 2. Reservation arrangement function
[0053] 3. User pattern analysis
[0054] 4. Understanding usage status
[0055] 5. Meeting pattern analysis and management support
[0056] 6. Digitization of meeting information
[0057] 7. Information asset management function
[0058] 1. Meeting reception function
[0059] Embodiments:
[0060] The terminal provides an interface for the user to input the date, time, and number of people for the conference. When the user inputs the information and presses the reservation button, the terminal sends this information to the server. Based on the received information, the server searches for available conference facilities, automatically selects the most suitable facility, and confirms the reservation. The terminal notifies the user that the reservation was successful.
[0061] Specific working example:
[0062] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server. The server searches for the most suitable meeting facility and confirms the reservation. The device displays a "Reservation Complete" notification to the user.
[0063] 2. Reservation arrangement function
[0064] Embodiments:
[0065] The server analyzes past reservation data and meeting importance information. When a user enters a reservation, the server determines whether to secure a physical facility or use an online meeting and proposes the optimal choice. The device notifies the user of this proposal and prompts them to make a final decision.
[0066] Specific working example:
[0067] A user books an "important meeting." The device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed. The device displays this suggestion to the user.
[0068] 3. User pattern analysis
[0069] Embodiments:
[0070] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a user enters a new reservation, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results.
[0071] Specific working example:
[0072] User A enters a new reservation. The device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low." The device notifies the user that "reservations have been restricted."
[0073] 4. Understanding usage status
[0074] Embodiments:
[0075] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. The terminal receives the notification and displays it to the user.
[0076] Specific working example:
[0077] When a meeting is canceled, the server detects it and updates the usage database. Based on the waiting list, it notifies the waiting users that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal displays the notification.
[0078] 5. Meeting pattern analysis and management support
[0079] Embodiments:
[0080] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities) and notifies the administrator of the proposal.
[0081] Specific working example:
[0082] The server analyzes data from the past three months and notifies the administrator that "Conference facility C is being used frequently, so we suggest increasing the capacity from 15 to 20 people." The proposal is displayed on the administrator's device.
[0083] 6. Digitization of meeting information
[0084] Embodiments:
[0085] During the meeting, the server automatically collects audio and text data and generates minutes, which are then stored on a secure server and notified to participants.
[0086] Specific working example:
[0087] During the meeting, the server records audio data and automatically generates minutes. The minutes are saved on a secure server and a notification that "the minutes have been saved" is displayed on the participants' devices.
[0088] 7. Information asset management function
[0089] Embodiments:
[0090] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server uses the meeting data to present an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[0091] Specific working example:
[0092] A problem occurs during a project. The server references the meeting data and sends a notification that a recovery plan has been generated. The server also provides access links to related documents and sends a notification. The notification is displayed on the device.
[0093] In this way, the present invention is a system that improves the efficiency of reservation and management of conference facilities and reduces the risk of information leaks.
[0094] The processing flow will be explained below.
[0095] 1. Meeting reception function
[0096] Process flow:
[0097] Step 1:
[0098] The user inputs the date and time of the meeting and the number of people at the terminal.
[0099] Step 2:
[0100] The terminal transmits the input information to the server.
[0101] Step 3:
[0102] The server searches a schedule database of conference facilities based on the received information.
[0103] Step 4:
[0104] The server identifies the best meeting venue that meets the criteria.
[0105] Step 5:
[0106] The server updates the database with the confirmed reservation information.
[0107] Step 6:
[0108] The terminal displays a notification to the user that the reservation is complete.
[0109] 2. Reservation arrangement function
[0110] Process flow:
[0111] Step 1:
[0112] The user inputs the importance of the conference on the terminal and transmits the reservation information.
[0113] Step 2:
[0114] Based on the reservation information received by the server, the past reservation history and importance data are analyzed.
[0115] Step 3:
[0116] The server determines whether a facility needs to be reserved for a physical meeting or whether an online meeting is appropriate.
[0117] Step 4:
[0118] The server generates information that suggests the best reservation method for the user.
[0119] Step 5:
[0120] The terminal displays the server's proposals to the user and prompts them to make a final decision.
[0121] 3. User pattern analysis
[0122] Process flow:
[0123] Step 1:
[0124] The user inputs and transmits new reservation information on the terminal.
[0125] Step 2:
[0126] Based on the reservation information received by the server, the user's past reservation history, cancellation frequency, and rule violation record are analyzed.
[0127] Step 3:
[0128] The server evaluates the user's creditworthiness and sets reservation priorities and limits.
[0129] Step 4:
[0130] The server confirms or restricts reservations based on the evaluation results.
[0131] Step 5:
[0132] The terminal notifies the user of the evaluation results and reservation status.
[0133] 4. Understanding usage status
[0134] Process flow:
[0135] Step 1:
[0136] The server monitors the availability of conference facilities in real time.
[0137] Step 2:
[0138] The server periodically updates the usage data to a database.
[0139] Step 3:
[0140] If a meeting facility is cancelled, the server will immediately update the cancellation information.
[0141] Step 4:
[0142] The server checks the cancellation waiting list and notifies the waiting users of the cancellation information.
[0143] Step 5:
[0144] The device displays the notification to the user.
[0145] 5. Meeting pattern analysis and management support
[0146] Process flow:
[0147] Step 1:
[0148] A server periodically collects usage data of conference facilities.
[0149] Step 2:
[0150] The server analyzes the frequency of use of conference facilities, the number of people, and the time of day based on the data collected.
[0151] Step 3:
[0152] Based on the analysis results, the server will propose the optimal management method.
[0153] Step 4:
[0154] The server notifies the administrator of the proposal.
[0155] Step 5:
[0156] The terminal displays the proposal to the administrator and prompts them to decide whether to implement it.
[0157] 6. Digitization of meeting information
[0158] Process flow:
[0159] Step 1:
[0160] During the meeting, the server collects audio data and notes.
[0161] Step 2:
[0162] Minutes are automatically generated based on the data collected by the server.
[0163] Step 3:
[0164] The server stores minutes and meeting contents on a secure server.
[0165] Step 4:
[0166] The server notifies the conference participants that the minutes have been saved.
[0167] Step 5:
[0168] The terminal displays a notification to the user, prompting them to confirm the meeting content.
[0169] 7. Information asset management function
[0170] Process flow:
[0171] Step 1:
[0172] The server centrally manages the decisions made at the meeting and related documents.
[0173] Step 2:
[0174] If a problem occurs during the project, the server references the meeting data and generates a recovery plan.
[0175] Step 3:
[0176] The server notifies relevant parties of the recovery plan and provides links to access related documents.
[0177] Step 4:
[0178] The device will display a notification to the user, prompting them to review the recovery plan and related documentation.
[0179] Step 5:
[0180] The user checks the recovery plan on the terminal and carries out the project recovery.
[0181] Example 1
[0182] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0183] Conventional conference facility management systems made reservation management cumbersome and required constant manual adjustments, making it difficult to secure optimal conference facilities and determine reservation priorities. Meeting content also had to be organized manually, which involved a lot of effort and errors. Furthermore, it was difficult to properly manage past usage data and meeting content and reflect it in future operations. This led to problems such as reduced meeting management efficiency and the risk of information leaks.
[0184] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0185] In this invention, the server includes: means for searching for optimal conference facilities based on information entered by a user and automatically selecting and reserving them; means for analyzing past reservation data and conference importance information to determine whether to use physical facilities or online conferences and suggest the optimal choice; means for analyzing each user's reservation history, cancellation frequency, and rule violation record to set reservation priorities and restrictions based on their creditworthiness; means for monitoring the use of conference facilities in real time and notifying users on the waiting list in the event of a cancellation; means for automatically collecting audio and text data from conferences and generating and saving minutes; means for centrally managing meeting decisions and related documents and presenting project recovery plans. This improves the efficiency of conference facility reservations and management, reduces the risk of information leaks, and enables appropriate recovery plans to be presented quickly during projects.
[0186] An "interface" is a screen or means by which a user inputs information such as the date and time of a meeting and the number of participants.
[0187] A "server" is a computer system that searches for conference facilities based on information sent by users and finalizes reservations.
[0188] "Means for automatically selecting and confirming reservations" refers to a function that selects the most suitable conference facility based on the date, time and number of participants of the conference received by the server, and reserves that facility.
[0189] "Past reservation data" is historical information about conference reservations made by the user up to now.
[0190] "Meeting importance information" is information about the content and importance of a meeting, and is used to determine whether the meeting is held at a physical facility or online.
[0191] "Credit rating" is an evaluation value calculated based on a user's past reservation history, cancellation frequency, rule violation record, etc.
[0192] A "user waiting for a cancellation" is a user who is waiting for a cancellation to occur when a facility for a conference has already been reserved.
[0193] "Audio data" refers to audio information recorded during a conference.
[0194] "Text data" refers to documents and character information created during a meeting.
[0195] "Minutes" are a record of what was discussed during a meeting.
[0196] "Related documents" are materials used at the meeting and related documents.
[0197] A "recovery plan" is a solution that is formulated based on past meeting data when a problem occurs during the project.
[0198] This invention relates to a conference facility management system that uses AI technology and comprehensively manages everything from conference reservations to operation and information management. This system is composed of users, terminals, and a server, and provides the following main functions: conference reception, reservation arrangement, user pattern analysis, usage status assessment, conference pattern analysis and operation support, conference information digitization, and information asset management.
[0199] Overall system overview
[0200] The system configuration is as follows:
[0201] 1. A terminal that provides an interface for users to enter the date, time, and number of people for a meeting.
[0202] 2. A server that searches, selects, and reserves conference facilities based on information input from the terminal.
[0203] 3. A function in which the server returns reservation results and suggestions to the terminal and notifies the user.
[0204] 1. Meeting reception function
[0205] The user uses the device's interface to input the "date and time" and "number of people" for the meeting. For example, "October 15th, 14:00-15:00, 10 people." The device then sends this information to the server. Based on the received information, the server searches a database for available conference facilities, automatically selects the most suitable facility, and confirms the reservation. The server then returns the reservation results to the device and displays a "reservation complete" notification to the user.
[0206] 2. Reservation arrangement function
[0207] When a user enters details of a meeting (e.g., "important meeting"), the device sends this information to the server. The server analyzes past reservation data and meeting importance information to determine whether a physical conference facility is necessary or an online meeting is better. It then proposes the best option and notifies the user. The user then reviews the proposal and makes a final decision.
[0208] 3. User pattern analysis
[0209] The server analyzes each user's past reservation history, cancellation frequency, rule violation record, etc. to calculate their credit rating. Based on this credit rating, it sets priorities and restrictions for new reservations. For example, the terminal may receive a notification saying, "User A's credit rating is low, so reservations have been restricted."
[0210] 4. Understanding usage status
[0211] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. For example, a user on the waiting list might be notified that "Conference facility B has been canceled from 14:00 to 15:00."
[0212] 5. Meeting pattern analysis and management support
[0213] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities). The proposals are then notified to the administrator.
[0214] 6. Digitization of meeting information
[0215] During the meeting, the server automatically collects audio and text data and generates minutes. This information is stored on a secure server, and participants are notified that the minutes have been saved.
[0216] 7. Information asset management function
[0217] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server refers to the meeting data and presents an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[0218] Examples of prompt statements
[0219] Here are some examples of prompts to input to a generative AI model:
[0220] "Please explain in detail how information is exchanged between the user and the server in a conference reservation system. Please include specific processing steps and examples of how it works."
[0221] A system with the above-described configuration and functions will streamline the reservation and operation of conference facilities, reduce the risk of information leaks, and enable the prompt presentation of appropriate recovery plans while a project is underway.
[0222] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0223] Meeting reception function
[0224] Step 1:
[0225] The user enters the date, time, and number of people attending the meeting.
[0226] Input: The user uses the terminal interface to input the "date and time" and "number of people." For example, the user inputs "October 15th, 14:00-15:00, number of people: 10."
[0227] Output: The conference information entered by the user is sent to the terminal.
[0228] Specific operation: The user enters the "date and time" and "number of people" and clicks the "reserve" button on the terminal.
[0229] Step 2:
[0230] The device sends the user's input information to the server
[0231] Input: User-entered meeting information.
[0232] Output: The terminal sends the user's input information to the server.
[0233] Specific operation: The terminal sends the conference information to the server, and the server receives the information.
[0234] Step 3:
[0235] The server searches for the best meeting room
[0236] Input: The "date and time" and "number of people" information of the meeting received by the server.
[0237] Data Processing: The server searches the database for available conference rooms and finds the one that best matches the entered criteria.
[0238] Output: Best meeting room information.
[0239] Specific operation: The server searches for meeting rooms that meet the conditions and executes an algorithm to select candidates.
[0240] Step 4:
[0241] The server reserves the conference room and returns the reservation result to the terminal.
[0242] Input: Best meeting room information.
[0243] Output: Confirmation of reservation information is returned to the terminal.
[0244] Specific operation: The server reserves the selected conference room and notifies the terminal of the result.
[0245] Step 5:
[0246] The terminal notifies the user of the reservation result.
[0247] Input: Confirmed booking information returned from the server.
[0248] Output: The device displays a "Reservation Complete" notification on the screen.
[0249] Specific operation: The terminal displays to the user, "Conference room reservation for October 15th, 14:00-15:00 has been completed."
[0250] Reservation arrangement function
[0251] Step 1:
[0252] User enters meeting reservation details
[0253] Input: Details of the meeting, for example, "Important Meeting".
[0254] Output: Detailed information is typed into the terminal.
[0255] Specific operation: The user enters the meeting details into the device interface and clicks the "Accept Proposal" button.
[0256] Step 2:
[0257] The device sends the input information to the server
[0258] Input: The meeting details entered by the user.
[0259] Output: The device sends information to the server.
[0260] Specific operation: The terminal sends detailed information about the meeting to the server, and the server receives the information.
[0261] Step 3:
[0262] The server analyzes past data
[0263] Input: Historical booking data and meeting importance information.
[0264] Data processing: The server performs analysis based on past data to determine whether the meeting will take place in a physical facility or online.
[0265] Output: Analysis results.
[0266] Specific operation: The server analyzes past data and generates a list of options.
[0267] Step 4:
[0268] The server will suggest the best reservation method
[0269] Input: Analysis results.
[0270] Output: Optimal booking method suggestions.
[0271] Specific operation: The server creates a proposal such as "Physical meeting facilities are needed" and sends it to the terminal.
[0272] Step 5:
[0273] The device notifies the user of the suggestion
[0274] Input: Suggestion from the server.
[0275] Output: The proposal is displayed on the screen.
[0276] What happens: The device displays a suggestion to the user, such as "Physical meeting room recommended."
[0277] Step 6:
[0278] The user reviews the proposal and makes a final decision
[0279] Input: User actions when reviewing server suggestions.
[0280] Output: The final decision is entered into the terminal and sent to the server.
[0281] What happens: The user reviews the suggestions and clicks a button to make a final decision and submit their input.
[0282] User pattern analysis
[0283] Step 1:
[0284] A user enters a new reservation
[0285] Input: Booking information for the new meeting.
[0286] Output: Reservation information is entered into the terminal.
[0287] Specific operation: The user enters new reservation information into the terminal and clicks the "Confirm reservation" button.
[0288] Step 2:
[0289] The device sends the information to the server
[0290] Input: New reservation information.
[0291] Output: The device sends information to the server.
[0292] Specific operation: The terminal sends conference reservation information to the server, and the server receives the information.
[0293] Step 3:
[0294] The server analyzes past data
[0295] Input: Each user's past booking history, cancellation frequency, and rule violation records.
[0296] Data processing: The server calculates the user's creditworthiness based on this data.
[0297] Output: Credit score.
[0298] Specific operation: The server scans past data and makes an evaluation based on each item.
[0299] Step 4:
[0300] The server evaluates the user's trustworthiness
[0301] Input: Credit score calculation result
[0302] Output: The user's credit rating.
[0303] Specific operation: The server aggregates the evaluation results and calculates the overall credibility.
[0304] Step 5:
[0305] The server sets reservation priorities and limits
[0306] Input: The user's credit rating.
[0307] Output: Priority and limit settings.
[0308] What it does: The server applies rules that prioritize and limit requests based on their trustworthiness.
[0309] Step 6:
[0310] The device notifies the user of the results.
[0311] Input: Server configuration results.
[0312] Output: Notification display.
[0313] Specific behavior: The device displays a notification to the user, such as "Reservations have been restricted."
[0314] Understanding usage status
[0315] Step 1:
[0316] The server monitors the usage of conference facilities
[0317] Input: Facility usage data.
[0318] Output: Real-time usage.
[0319] Specific operation: The server periodically runs a program that checks the database and updates usage status.
[0320] Step 2:
[0321] The server detects the cancellation of the reservation
[0322] Input: Reservation cancellation information.
[0323] Output: Prepare to notify users on the waiting list.
[0324] Specific operation: The server checks the reservation data, and if a cancellation occurs, obtains information about users on the waiting list based on that information.
[0325] Step 3:
[0326] The server sends notifications to the waiting list users
[0327] Input: Cancellation information and waiting list user information.
[0328] Output: Notification content.
[0329] Specific operation: The server sends a notification to users on the waiting list. It creates and sends a notification such as "Conference facility B has been canceled from 14:00 to 15:00."
[0330] Step 4:
[0331] The device displays the notification to the user
[0332] Input: Notification data from the server.
[0333] Output: A notification is displayed to the user.
[0334] Specific operation: The device displays a notification to the user such as "Facility B from 14:00 to 15:00 has been canceled."
[0335] Meeting pattern analysis and management support
[0336] Step 1:
[0337] The server collects data on meeting facilities
[0338] Input: Data such as past usage frequency, number of people, time of day, etc.
[0339] Data processing: Data collection.
[0340] Output: Collected data.
[0341] Specific operation: The server periodically collects system usage data and stores it in a database.
[0342] Step 2:
[0343] The server analyzes the collected data
[0344] Input: Collected data.
[0345] Data processing: Data analysis.
[0346] Output: Analysis results.
[0347] What it does: The server runs data analysis algorithms to generate insights that indicate whether changes to capacity or the addition of new facilities are needed.
[0348] Step 3:
[0349] The server proposes the operation method
[0350] Input: Analysis results.
[0351] Output: Proposal.
[0352] Specific operation: The server generates a proposal and notifies the administrator, sending a message such as "Conference facility C is being used frequently, so we propose increasing the capacity from 15 to 20 people."
[0353] Step 4:
[0354] The device notifies the administrator of the proposed action.
[0355] Input: Suggestion from the server.
[0356] Output: Notification displayed to administrator.
[0357] Specific operation: The device displays the suggestions on the screen.
[0358] Digitization of meeting information
[0359] Step 1:
[0360] The server collects audio and text data during the meeting.
[0361] Input: Voice and text data collected in real time during the meeting.
[0362] Data processing: Recording audio data and generating text data.
[0363] Output: Collected data.
[0364] Specific operation: The server collects data during the meeting in real time and prepares to store it on a secure server.
[0365] Step 2:
[0366] The server generates the minutes.
[0367] Input: Collected speech and text data.
[0368] Data processing: Converts audio data into text and automatically generates minutes.
[0369] Output: The generated transcript.
[0370] Specific operation: The server converts the collected voice data into text, organizes the contents of the meeting, and generates minutes.
[0371] Step 3:
[0372] The server saves the minutes and notifies the participants.
[0373] Input: Generated minutes.
[0374] Output: Notifications to participants and an access link to the saved minutes.
[0375] Specific operation: The server saves the minutes on a secure server and sends a notification to the participants that the minutes have been saved.
[0376] Step 4:
[0377] The device displays a notification to the participant
[0378] Input: Notification data from the server.
[0379] Output: Notification display to participants.
[0380] Specific behavior: The device displays a notification to participants, such as "Minutes have been saved."
[0381] Information asset management function
[0382] Step 1:
[0383] The server manages meeting decisions and related documents.
[0384] Input: Decisions made at the meeting and related documents.
[0385] Data processing: Centralized data management.
[0386] Output: Managed information.
[0387] Specific operation: The server performs database operations to centrally manage the agenda decided at the meeting and related documents.
[0388] Step 2:
[0389] Server detects problems during project execution
[0390] Input: Project progress data.
[0391] Data processing: Identifying the problem.
[0392] Output: Problem detection information.
[0393] What it does: The server monitors the progress of the project and detects problems as they occur.
[0394] Step 3:
[0395] The server generates a recovery plan
[0396] Input: Meeting data and project issue detection information.
[0397] Output: The generated recovery plan.
[0398] Specific operation: The server references past conference data and automatically generates an appropriate recovery plan.
[0399] Step 4:
[0400] The server notifies the relevant parties of the recovery plan
[0401] Input: The generated recovery plan.
[0402] Output: Notification and access link to interested parties.
[0403] Specific operation: The server sends the details of the recovery plan and access links to related documents to the relevant parties.
[0404] Step 5:
[0405] The device displays a notification to the relevant person.
[0406] Input: Notification data from the server.
[0407] Output: Notification displayed to relevant parties.
[0408] Specific operation: The device displays a notification to the relevant parties, such as "A recovery plan has been generated."
[0409] (Application example 1)
[0410] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0411] Manual scheduling and management of meetings and discussions held within factories can be inefficient and lead to reduced productivity. In addition, incomplete management of meeting information and delayed response to cancellations can have a negative impact on the operation of the entire factory. Furthermore, insufficient recording and sharing of meeting content can cause problems in the progress of projects. The goal is to solve these problems and improve the efficiency of factory meetings and thorough information management.
[0412] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[0413] In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a meeting; a means for automatically selecting and reserving the most suitable meeting facility based on the input information; a means for adjusting reservations, including the use of online meetings, based on the importance of the meeting; a means for analyzing the reservation patterns of multiple users and managing reservations based on their trustworthiness; a means for understanding the usage status of meeting facilities in real time and notifying in the event of a cancellation; a means for automatically digitizing and saving the contents of the meeting; a means for centrally managing information assets determined in the meeting and supporting project recovery; a means for controlling factory robots that reserve and manage meetings within the factory and provide the most suitable meeting space; and a means for analyzing audio information, automatically generating minutes, and saving them in a secure database. This automates the scheduling and management of factory meetings, improves productivity, and enables thorough information management.
[0414] "Means for accepting meetings" is a function that provides an interface for inputting and managing the date, time, and number of people for a meeting.
[0415] "Means for making reservations based on input information" refers to a function that automatically selects the most suitable conference facility based on the information input by the user and confirms the reservation.
[0416] "Means for adjusting reservations" is a function that optimizes the use of physical conference rooms and online meetings by taking into account factors such as the importance of the meeting.
[0417] "Means for analyzing and managing reservation patterns" refers to a function that sets priorities and restrictions on user reservations based on past usage data and creditworthiness.
[0418] "Means for understanding usage status" refers to a function that monitors the current status of conference facilities in real time and responds quickly to any changes or cancellations to reservations.
[0419] "Means for automatically converting content into data and saving it" refers to a function that automatically collects audio and text information during a meeting and saves it in a database as minutes.
[0420] "A means of centrally managing information assets" is a function that consolidates and manages matters decided in meetings and related documents, and helps deal with problems as the project progresses.
[0421] "Means for controlling factory robots" refers to the function of instructing and managing robots to schedule and manage meetings within a factory.
[0422] "Means for analyzing audio information and automatically generating minutes" is a function that analyzes audio data collected during a meeting, automatically generates minutes, and stores them in a secure database.
[0423] This invention is a system for improving the efficiency of booking, running, and information management of meetings within a factory, and includes a reception means for inputting the date, time, and number of participants of a meeting, a reservation adjustment means based on the importance of the meeting, a reservation pattern analysis means, a usage status understanding means, a means for digitizing the contents of the meeting, an information asset management means, a factory robot control means, and a means for analyzing audio information and automatically generating minutes of the meeting.
[0424] Hardware and Software Configuration
[0425] This system uses the following hardware and software:
[0426] Hardware: Robots for factory navigation and meeting room management (e.g., robots powered by Raspberry Pi or NVIDIA Jetson Nano)
[0427] Software: The main components running on the server side include a Python program and an SQLite database.
[0428] Meeting reservation method
[0429] The server provides an interface on the terminal for entering the date, time, and number of people for the meeting. When the user enters the date, time, and number of people for the meeting, the information is sent to the server. The server automatically selects the most suitable conference facility based on the received information and confirms the reservation. This allows users to efficiently reserve meetings.
[0430] A method for adjusting reservations based on the importance of meetings
[0431] The server analyzes past reservation data and meeting importance information to determine whether to secure a physical facility or use an online meeting. If a user reserves an important meeting, the server will suggest whether a physical meeting facility would be more suitable and notify the user on their device.
[0432] A means to analyze and manage booking patterns
[0433] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a new reservation is entered, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results. This function ensures fairness in reservations.
[0434] Means of understanding usage status
[0435] The server monitors the usage status of conference facilities in real time, and if a reservation is changed or canceled, it immediately updates the information and notifies users on the waiting list, thereby improving the efficiency of facility usage.
[0436] How to digitize meeting content
[0437] The server automatically collects audio and text data during the meeting and generates minutes. This information is stored on a secure server and notifications are sent to participants, who can then refer to the data later.
[0438] A means of centrally managing information assets
[0439] The server centrally manages the decisions made in meetings and related documents, and if a problem occurs during the project, it uses the meeting data to present an appropriate recovery plan, sends notifications to stakeholders, and provides access links to related documents, ensuring the smooth progress of the project.
[0440] Control methods for factory robots
[0441] The server instructs and manages the robots to reserve and manage meetings within the factory. The robots then make the necessary preparations to provide the optimal meeting space. This automates the management of meetings within the factory.
[0442] Analysis of audio information and automatic generation of minutes
[0443] The server analyzes the audio data collected during the meeting, automatically generates minutes, and stores them in a secure database, simplifying the recording of meeting content.
[0444] Examples of concrete examples and prompts
[0445] For example, if a user inputs "Hold a meeting with 10 people on 2023-10-15 at 14:00," the server will reserve the most suitable conference room and, if necessary, instruct the robot to prepare for it. Furthermore, minutes of the meeting will be automatically generated based on the voice data, and can be referenced later.
[0446] Example prompts to input to the generative AI model:
[0447] Write a Python program for a factory robot that accepts reservations for meetings. The user inputs the date, time, and number of people, and the robot reserves the most suitable conference room. There are three conference rooms: "RoomA" (capacity 20 people), "RoomB" (capacity 10 people), and "RoomC" (capacity 30 people), and the reservation status is managed using a dictionary. No database is used.
[0448] This will automate the scheduling and management of factory meetings, improving productivity and ensuring thorough information management.
[0449] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[0450] Step 1:
[0451] The user inputs the date and time of the meeting and the number of participants. The user inputs "2023-10-15 14:00, 10 participants" into the terminal interface and presses the reservation button. The input information is sent from the terminal to the server. The input data is the date, start time, and number of participants of the meeting.
[0452] Step 2:
[0453] The server searches for the most suitable conference facility based on the received information. From the list of registered conference rooms, the server searches for a conference room that is available on the specified date and time and can accommodate the number of participants. The server has a database of conference room capacities and reservation status. The server confirms that "Room B (capacity 10 people)" is available and selects it as the most suitable conference room.
[0454] Step 3:
[0455] The server confirms the reservation for the selected conference room and saves it in the database. The server adds "2023-10-15 14:00-15:00, Room B reservation" to the reservation information database. After the reservation is confirmed, the server sends a notification of reservation completion to the terminal.
[0456] Step 4:
[0457] The terminal displays a notification to the user that the reservation is complete. Upon receiving the notification from the server, the terminal displays the message "Conference room RoomB has been reserved from 14:00 to 15:00 on 2023-10-15."
[0458] Step 5:
[0459] The server adjusts reservations, including the use of online meetings, based on the importance of the meeting. When a user sets the importance of a meeting, the server analyzes past data and, if necessary, determines whether a physical conference room or an online meeting is more appropriate, and makes a recommendation. For example, the server may determine that "based on past data, a physical conference room is necessary" and notify the user of the result.
[0460] Step 6:
[0461] The server analyzes the reservation patterns of multiple users and manages reservations based on their creditworthiness. The server analyzes past reservation history, cancellation frequency, and rule violation records to evaluate creditworthiness. When a new reservation is entered, the server sets reservation priorities and restrictions based on the user's creditworthiness information.
[0462] Step 7:
[0463] The server monitors the availability of conference facilities in real time, immediately updates the information when a cancellation occurs, and automatically notifies users on the waiting list. When a cancellation occurs, the server updates the conference facility reservation information database and notifies relevant users based on the waiting list.
[0464] Step 8:
[0465] During the meeting, the server collects voice data and automatically generates minutes, which are then stored in a secure database. The server uses speech recognition technology to convert the conversations during the meeting into text data, formatting the data into minutes and storing it in the database. After the meeting ends, a notification is sent to participants informing them that the minutes have been saved.
[0466] Step 9:
[0467] The server centralizes the management of information assets decided in meetings and supports project recovery. If a problem occurs during the project, the server references related meeting data and generates an appropriate recovery plan. It notifies the relevant parties of the plan and provides access links to the necessary documents.
[0468] Step 10:
[0469] The factory robot prepares for the meeting. The server issues instructions to the factory robot to prepare the reserved conference room. The robot prepares the conference room and arranges materials, ensuring that the meeting starts smoothly.
[0470] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.
[0471] This invention is a conference facility management system that uses AI technology to comprehensively manage everything from conference reservations to operation and information management, and also optimizes the conference experience by recognizing user emotions. This system is composed of users, terminals, a server, and an emotion engine.
[0472] Overall system overview
[0473] The system provides the following main functions:
[0474] 1. Meeting reception function
[0475] 2. Reservation arrangement function
[0476] 3. User pattern analysis
[0477] 4. Understanding usage status
[0478] 5. Meeting pattern analysis and management support
[0479] 6. Digitization of meeting information
[0480] 7. Information asset management function
[0481] 8. Emotion recognition function
[0482] 1. Meeting reception function
[0483] Embodiments:
[0484] The terminal provides an interface for the user to input the date, time, and number of people for the meeting. When the user inputs the information and presses the reservation button, the terminal sends this information to the server. Based on the received information, the server automatically selects the most suitable facility for the meeting and confirms the reservation. The terminal notifies the user that the reservation was successful.
[0485] Specific working example:
[0486] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server. The server searches for the most suitable meeting facility and confirms the reservation. The device displays a "Reservation Complete" notification to the user.
[0487] 2. Reservation arrangement function
[0488] Embodiments:
[0489] The server analyzes past reservation data and meeting importance information. When a user enters a reservation, the server determines whether to reserve a physical meeting facility or use an online meeting, and proposes the optimal choice. The device notifies the user of this proposal and prompts them to make a final decision.
[0490] Specific working example:
[0491] A user books an "important meeting." The device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed. The device displays this suggestion to the user.
[0492] 3. User pattern analysis
[0493] Embodiments:
[0494] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a user enters a new reservation, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results.
[0495] Specific working example:
[0496] User A enters a new reservation. The device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low." The device notifies the user that "reservations have been restricted."
[0497] 4. Understanding usage status
[0498] Embodiments:
[0499] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. The terminal receives the notification and displays it to the user.
[0500] Specific working example:
[0501] When a meeting is canceled, the server detects it and updates the usage database. Based on the waiting list, it notifies the waiting users that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal displays the notification.
[0502] 5. Meeting pattern analysis and management support
[0503] Embodiments:
[0504] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities) and notifies the administrator of the proposal.
[0505] Specific working example:
[0506] The server analyzes data from the past three months and notifies the administrator that "Conference facility C is being used frequently, so we suggest increasing the capacity from 15 to 20 people." The proposal is displayed on the administrator's device.
[0507] 6. Digitization of meeting information
[0508] Embodiments:
[0509] During the meeting, the server automatically collects audio and text data and generates minutes, which are then stored on a secure server and notified to participants.
[0510] Specific working example:
[0511] During the meeting, the server records audio data and automatically generates minutes. The minutes are saved on a secure server and a notification that "the minutes have been saved" is displayed on the participants' devices.
[0512] 7. Information asset management function
[0513] Embodiments:
[0514] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server uses the meeting data to present an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[0515] Specific working example:
[0516] A problem occurs during a project. The server references the meeting data and sends a notification that a recovery plan has been generated. The server also provides access links to related documents and sends a notification. The notification is displayed on the device.
[0517] 8. Emotion recognition function
[0518] Embodiments:
[0519] The system incorporates an emotion engine that recognizes users' emotions and collects emotional data during meetings. The server automatically records and saves the emotional data obtained from the emotion engine along with the meeting minutes. Furthermore, the emotional data is used to analyze the efficiency and productivity of meetings, and suggests rescheduling or environmental adjustments as necessary.
[0520] Specific working example:
[0521] During the meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting emotional state data. The server automatically saves this data along with the minutes. A notification is sent saying, "User's emotional data has been recorded." The server then sends suggestions for improving the meeting to the administrator based on the emotional data. The suggestions are displayed on the administrator's device.
[0522] In this way, the present invention is a system that not only streamlines the reservation and operation of conference facilities and reduces the risk of information leakage, but also analyzes user emotions to optimize the conference experience.
[0523] The processing flow will be explained below.
[0524] 8. Emotion recognition function
[0525] Process flow:
[0526] Step 1:
[0527] At the start of a conference, a user logs in through a terminal and connects to the conference facility or to an online conference.
[0528] Step 2:
[0529] The emotion engine collects emotional data such as the user's facial expressions and tone of voice in real time using sensors such as cameras and microphones.
[0530] Step 3:
[0531] The device transmits the collected emotion data to a server.
[0532] Step 4:
[0533] The server analyzes the received emotional data and determines the user's emotional state (e.g., stress, satisfaction, concentration, etc.).
[0534] Step 5:
[0535] The server automatically records and saves the analyzed emotional data along with the meeting minutes.
[0536] Step 6:
[0537] The server evaluates the efficiency and productivity of the meeting based on emotional data, and if necessary, suggests rescheduling the meeting or switching to an online meeting.
[0538] Step 7:
[0539] The server notifies the administrator of the emotion data and suggestions for improving the meeting. The terminal displays this information to the administrator.
[0540] Specific working example:
[0541] 1. The user arrives at the conference facility at 10:00 and logs in to the conference via a terminal. The emotion engine is automatically activated.
[0542] 2. While the meeting is in progress, the emotion engine recognizes the user's face with a camera and collects the user's voice tone with a microphone. For example, if the user's facial expression is stern, it is interpreted as irritation, and if the user's voice tone is high, it is interpreted as tension.
[0543] 3. The device sequentially transmits the collected emotion data to the server, which receives it in real time.
[0544] 4. The server analyzes the emotional data and determines the user's emotional state. For example, it determines that more than half of the participants are in a stressful state.
[0545] 5. The server automatically generates meeting minutes based on the emotional data and stores them in secure storage. This includes information such as "Many of the participants felt stressed during the meeting."
[0546] 6. The server analyzes the emotion data and generates adjustment suggestions such as, "The current meeting is running behind schedule, so let's start the next meeting five minutes later."
[0547] 7. The server notifies the administrator of the adjustment proposal and details of the emotion data. The administrator's device displays a notification saying, "Participants are feeling stressed in the current meeting, so we suggest taking a break."
[0548] In this way, the present invention, which combines emotion recognition functionality, is a system that not only streamlines the reservation and management of conference facilities and reduces the risk of information leakage, but also analyzes user emotions to optimize the conference experience.
[0549] Example 2
[0550] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0551] Conventional meeting management systems often lack efficiency and do not fully optimize meetings because reservations, management, and information management are handled separately. Furthermore, they lack the ability to analyze user sentiment, limiting their ability to improve the quality and efficiency of communication during meetings. As a result, problems often arise related to meeting progress and the risk of information leaks.
[0552] The identification processing by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a conference; a means for automatically selecting and reserving the optimal conference facility based on the input information; a means for adjusting reservations, including the use of online conferences, based on the importance of the conference; a means for analyzing the reservation patterns of multiple users and managing reservations based on their trustworthiness; a means for understanding the utilization status of conference facilities in real time and notifying users in the event of cancellations; a means for automatically digitizing and saving the contents of the conference; a means for centrally managing information assets determined in the conference and supporting project recovery; and a means for analyzing the efficiency and productivity of the conference based on emotion data acquired by an emotion engine and making improvement suggestions. This significantly improves the efficiency of conference management, reduces the risk of information leaks, and optimizes the conference experience by analyzing user emotions.
[0553] The "reception means" is an interface for inputting the date and time of the meeting and the number of people, and is a device or system that allows the user to input information about the meeting.
[0554] A "reservation means" is a device or system that automatically selects and reserves the most suitable conference facility based on input information.
[0555] The "reservation adjustment means" is a device or system for adjusting reservations, including the use of online conferences, based on the importance of the conference.
[0556] The "credit management means" is a device or system for analyzing the reservation patterns of multiple users and managing reservations based on their credit scores.
[0557] The "usage status monitoring means" is a device or system that monitors the usage status of conference facilities in real time and notifies users in the event of a cancellation.
[0558] The "digitization means" is a device or system for automatically digitizing and saving the contents of a conference.
[0559] "Information asset management means" refers to a device or system that centrally manages the information assets decided at the meeting and supports project recovery.
[0560] The "emotion data analysis means" is a device or system that analyzes the efficiency and productivity of a meeting based on the emotion data acquired by the emotion engine and makes suggestions for improvement.
[0561] An "emotion engine" is a device or software that analyzes a user's facial expressions and tone of voice to collect emotional data.
[0562] An "online conference tool" is a device or software that supports conferences conducted over the Internet.
[0563] This invention is a conference facility management system that utilizes AI technology to comprehensively manage conference reservations, operations, information management, and user emotion recognition. The system consists of users, terminals, a server, and an emotion engine.
[0564] System configuration and operation
[0565] 1. Reception method
[0566] The user inputs the date and time of the meeting and the number of people through the terminal interface.
[0567] The terminal transmits the input information to the server.
[0568] Examples:
[0569] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server.
[0570] 2. Reservation Method
[0571] The server automatically selects the most suitable conference venue based on the received information.
[0572] The server confirms the reservation and transmits the result to the terminal.
[0573] The terminal displays a notification to the user that the reservation is complete.
[0574] Examples:
[0575] The server searches for the most suitable conference facility and confirms the reservation. The terminal displays a "reservation completed" notification to the user.
[0576] 3. Reservation Adjustment Methods
[0577] The user inputs the importance of the conference and the desired reservation details into the terminal.
[0578] The terminal transmits the information to the server.
[0579] The server analyzes past reservation data and the importance of the meeting to determine whether a physical conference facility is necessary or whether an online meeting is appropriate.
[0580] The server proposes the best choice and sends the result to the terminal.
[0581] The device will notify the user of the proposal and prompt them to make a final decision.
[0582] Examples:
[0583] A user enters an "important meeting" as a reservation into a device. The device sends this information to a server. The server analyzes past meeting data and determines that a physical meeting facility is required. The device displays this suggestion to the user and prompts for confirmation.
[0584] 4. Credit management measures
[0585] The server analyzes the user's past reservation history, cancellation frequency, rule violations, etc. to evaluate their trustworthiness.
[0586] When a user enters a new reservation, the terminal sends the information to the server.
[0587] The server sets reservation priorities and limits based on the user's creditworthiness.
[0588] The server sends the result to the terminal, which notifies the user.
[0589] Examples:
[0590] User A enters a new reservation. The device sends the information to the server. The server determines that "User A's credibility is low" based on past data. The device notifies the user that "reservations have been restricted."
[0591] 5. Usage Monitoring Methods
[0592] The server monitors the availability of conference facilities in real time.
[0593] The server automatically sends a notification to users on the waiting list when a reservation is canceled.
[0594] The terminal receives the notification and displays it to the user.
[0595] Examples:
[0596] When a meeting is canceled, the server immediately detects it and updates the usage database. The server notifies the waiting user that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal receives the notification and displays it to the user.
[0597] 6. Data Collection Methods
[0598] The server automatically collects audio and text data during the conference.
[0599] The server generates minutes based on the collected information and stores them securely.
[0600] The server notifies the participants of the generated minutes.
[0601] The device receives the notification and displays it to the participants.
[0602] Examples:
[0603] During the meeting, the server records audio data and automatically generates minutes. The server securely stores the minutes and notifies participants that the minutes have been saved. The device receives the notification and displays it to the participants.
[0604] 7. Information Asset Management Measures
[0605] The server centrally manages the decisions made at the meeting and related documents.
[0606] If a problem occurs during the project, the server will present an appropriate recovery plan based on the meeting data.
[0607] The server notifies the relevant parties of the access links to the recovery plan and related documents.
[0608] The device displays a notification.
[0609] Examples:
[0610] When a problem occurs during a project, the server references the meeting data and notifies the user that a recovery plan has been generated. The server then sends a notification providing access links to related documents. The device then displays a notification containing related links.
[0611] 8. Sentiment Data Analysis Methods
[0612] The emotion engine analyzes users' facial expressions and tone of voice during meetings to collect emotional data.
[0613] The server automatically stores the emotion data along with the minutes.
[0614] The server analyzes the efficiency and productivity of meetings based on the emotional data and sends improvement suggestions to the administrator as needed.
[0615] The terminal displays the proposed content to the administrator.
[0616] Examples:
[0617] During a meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting data on their emotional state. The server automatically saves this data along with the minutes. The server then sends "suggestions for improving the meeting" to the administrator based on the emotion data. The device then displays the suggestions to the administrator.
[0618] Prompt Sentence Examples
[0619] "I would like to reserve a conference room for 10 people from 2:00 PM to 3:00 PM on October 15th."
[0620] "I have an important meeting and would like to know if I need a physical conference facility."
[0621] This invention is a system that not only makes meetings more efficient and reduces the risk of information leaks, but also analyzes users' emotions to optimize the meeting experience.
[0622] The flow of the identification process in the second embodiment will be described with reference to FIG.
[0623] Step 1:
[0624] (Reception processing)
[0625] User: Enter the date, time and number of people for the meeting.
[0626] Terminal: Receives the meeting date and time and number of participants entered by the user.
[0627] Input: Information entered by the user: "October 15th, 14:00-15:00, 10 people."
[0628] Output: Sends the entered conference information to the server.
[0629] Specific operation: The user enters "October 15th, 14:00-15:00, number of people: 10", and the device sends this information to the server.
[0630] Step 2:
[0631] (Reservation processing)
[0632] Server: Automatically selects the most suitable conference facility based on the received conference information.
[0633] Input: Meeting information sent from the device (date, time and number of people).
[0634] Data processing: Matching the availability of conference facilities with requirements and selecting the most suitable facility, for example, querying the availability database to list relevant facilities.
[0635] Output: Confirmed reservation of the best meeting venue.
[0636] Terminal: Notifies the user that the reservation is complete.
[0637] Specific operation: The server searches for the most suitable conference facility, confirms the reservation, and the terminal displays a "reservation completed" notification to the user.
[0638] Step 3:
[0639] (Reservation adjustment process)
[0640] User: Enter the importance of the meeting and the desired reservation details.
[0641] Terminal: Receives the importance of the meeting and the desired reservation details, and sends them to the server.
[0642] Server: Analyzes past reservation data and meeting importance information.
[0643] Input: Meeting information and past reservation data sent from the device.
[0644] Data analysis: Algorithms that reference a meeting database to determine whether a physical meeting facility is necessary or whether an online meeting is appropriate prioritize physical facilities for more important meetings.
[0645] Output: What is the best meeting format (physical or online) and why?
[0646] Terminal: Notifies the user of the proposal and prompts them to make a final decision.
[0647] How it works: A user enters a reservation for an "important meeting," and the device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed, and the device displays this suggestion to the user.
[0648] Step 4:
[0649] (Credit Management Processing)
[0650] Server: Analyzes the user's past reservation history, cancellation frequency, and rule violations to evaluate their creditworthiness.
[0651] Input: User's booking history, cancellation frequency, and rule violation data.
[0652] Data analysis: Apply a scoring algorithm to assess a user's creditworthiness. For example, if they cancel frequently, the score will be lowered.
[0653] Output: The estimated credit score.
[0654] Terminal: When a user enters a new reservation, the results are displayed, prioritizing and limiting the reservation based on creditworthiness.
[0655] Specific operation: User A enters a new reservation, and the device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low," and the device notifies the user that "reservations have been restricted."
[0656] Step 5:
[0657] (Usage status monitoring process)
[0658] Server: Monitors the availability of conference facilities in real time.
[0659] Input: Real-time facility usage data.
[0660] Data monitoring: Monitors the usage of conference facilities and immediately detects any changes. For example, if a reservation is canceled, that information is reflected in the waiting list.
[0661] Output: Notification information about the cancellation.
[0662] Server: When a reservation is canceled, users on the waiting list are automatically notified.
[0663] Terminal: Receives notifications and displays them to the user.
[0664] Specific operation: When a meeting is canceled, the server detects it and updates the usage database. Based on the cancellation waiting list, the server notifies the waiting user that "Facility B for the meeting has been canceled from 14:00 to 15:00," and the terminal displays this.
[0665] Step 6:
[0666] (Data processing)
[0667] Server: Automatically collects audio and text data during the meeting.
[0668] Input: Audio and text data during the meeting.
[0669] Data processing: Converting voice data into text and generating meeting minutes in an appended format. For example, using speech recognition technology to automatically transcribe meeting content into text.
[0670] Output: Auto-generated meeting minutes text.
[0671] Server: Generates minutes based on the collected information and stores them securely.
[0672] Server: Notifies participants of the generated minutes.
[0673] Device: Receives notifications and displays them to participants.
[0674] Specific operation: The server records audio data during the meeting and automatically generates minutes. The server securely saves the minutes, notifies participants that the minutes have been saved, and the device displays a notification to the participants.
[0675] Step 7:
[0676] (Information Asset Management Processing)
[0677] Server: Centrally manages the decisions made at meetings and related documents.
[0678] Input: Decisions made at the meeting and related documents.
[0679] Data management: Decisions made at meetings and related documents are stored in a centralized database. For example, resolutions and related files are aggregated in a project folder.
[0680] Output: Centralized meeting content and related documents.
[0681] Server: If a problem occurs during the project, it will present an appropriate recovery plan based on the meeting data.
[0682] Server: Notifies relevant parties of the recovery plan and access links to related documents.
[0683] Device: Show notifications.
[0684] Specific operation: When a problem occurs during a project, the server references the meeting data and notifies the user that a recovery plan has been generated. The server provides an access link to the relevant document, and the device displays the notification.
[0685] Step 8:
[0686] (Emotion data analysis processing)
[0687] Emotion Engine: Collects emotional data by analyzing the user's facial expressions and tone of voice during the meeting.
[0688] Input: Facial expression data and tone of voice data of users during the meeting.
[0689] Data analysis: Analyze the user's emotional state using an emotion engine, for example, identify emotions based on facial expression recognition and voice analysis.
[0690] Output: Parsed emotion data.
[0691] Server: Emotion data is automatically saved along with the minutes.
[0692] Server: Analyzes the efficiency and productivity of meetings based on emotional data and sends improvement suggestions to the administrator as needed.
[0693] Terminal: Display the proposal to the administrator.
[0694] How it works: During a meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting data on their emotional state. The server automatically saves this data along with the minutes, and sends "suggestions for improving the meeting" to the administrator based on the emotion data, which are then displayed on the device.
[0695] (Application example 2)
[0696] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."
[0697] Conventional conference facility management systems are designed solely to streamline conference reservations and management, leaving out important features such as security monitoring during the conference and monitoring of participants' emotions. This makes it difficult to immediately respond to abnormal behavior during a conference, potentially leading to security issues and participant stress. Furthermore, the lack of a system that integrates these features makes centralized management difficult. Therefore, there is a need for a comprehensive system that ensures security during a conference and also takes into account the emotional state of participants.
[0698] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a conference; a means for automatically selecting and reserving the optimal conference facility based on the input information; a means for adjusting reservations, including the use of online conferences, based on the importance of the conference; a means for analyzing the reservation patterns of multiple users and managing reservations based on their credit ratings; a means for understanding the utilization status of conference facilities in real time and notifying users in the event of cancellations; a means for automatically digitizing and saving the contents of the conference; a means for centrally managing information assets determined in the conference and supporting project recovery; a means for automatically starting security monitoring at the start of a reserved conference; a means for monitoring users' emotions in real time during the conference and detecting abnormal behavior; and a means for sending notifications based on detected abnormal behavior and enhancing security. This improves the efficiency of conference reservations and management, integrates security monitoring and emotion monitoring, and enables rapid response to abnormal behavior during the conference.
[0699] The "reception means" is a device or software that provides an interface for inputting the date and time of the meeting and the number of participants.
[0700] A "reservation means" is a device or software that automatically selects the most suitable conference facility based on input information and reserves that facility.
[0701] The "means for adjusting reservations" refers to devices or software for adjusting reservations, including the use of online meetings, based on the importance of the meetings.
[0702] A "means for managing reservations" is a device or software that analyzes the reservation patterns of multiple users and sets reservation priorities and limits based on creditworthiness.
[0703] "Means for notifying in the event of a cancellation" refers to devices or software that monitor the usage status of conference facilities in real time and notify users when their reservations are canceled.
[0704] "Means for digitizing and saving" refers to devices or software that automatically collect meeting content as audio or text data, generate minutes, and save them.
[0705] "Means to support recovery" refers to devices or software that centrally manage information assets decided in meetings and, if a problem occurs during the project, use the meeting data as a reference to present an appropriate recovery plan.
[0706] The "means for starting security monitoring" refers to a device or software for automatically starting the security monitoring function at the start of a scheduled conference.
[0707] "Means for detecting abnormal behavior" refers to devices or software that monitor users' emotions in real time during a meeting and detect abnormal behavior.
[0708] "Means for sending notifications and enhancing security" refers to devices or software that send notifications in real time based on detected abnormal behavior and enhance security.
[0709] This invention is a conference facility management system equipped with security functions using AI technology. An embodiment of the system that realizes this application example is described below.
[0710] Overall system configuration
[0711] The system consists of a user terminal, a server, and an emotion engine, and comprehensively manages everything from conference reservations to operation, information management, and security monitoring.
[0712] Hardware and software used
[0713] Hardware: Smartphones, tablets, smart glasses
[0714] Software and Technology:
[0715] Camera and microphone: Used for image recognition and voice analysis.
[0716] Emotion Engine: Recognizes user emotions in real time.
[0717] Firebase: Used for real-time database and authentication.
[0718] OpenCV: Used for image and video processing.
[0719] TensorFlow: Used for emotion recognition models.
[0720] Processing flow
[0721] 1. Schedule a meeting
[0722] The user inputs the date, time and number of people for the meeting.
[0723] The terminal transmits the input information to the server, which then automatically selects the most suitable facility for the conference and confirms the reservation.
[0724] 2. Start security monitoring
[0725] At the start of the meeting, the device's camera and microphone are activated and the emotion engine analyzes the user's emotions in real time.
[0726] 3. Monitoring during meetings
[0727] During the meeting, the device uses a camera and microphone to monitor users' emotions in real time and detect abnormal behavior.
[0728] When the server detects abnormal behavior, it immediately sends a notification and alerts relevant parties.
[0729] 4. Ending the meeting
[0730] At the end of the meeting, the collected emotional data and meeting minutes are automatically generated and stored on a secure server.
[0731] 5. Recovery plan proposal
[0732] Based on any issues detected during the meeting, the server generates a recovery plan and notifies the relevant parties.
[0733] Examples of concrete examples and prompts
[0734] As a concrete example, the following prompt sentence will be used.
[0735] Example prompt sentence:
[0736] "I've booked an important meeting for 10 people on October 15, 2023, from 2:00 PM to 3:00 PM. I'll begin security monitoring and notify you if any abnormal activity is detected."
[0737] Example notification:
[0738] "At 2:30 PM, signs of stress were detected in Conference Room A. Security team has been notified."
[0739] System Effects
[0740] The system will streamline conference booking and management, integrate security and emotion monitoring to enable rapid response to abnormal behavior during meetings, and use the collected data to optimize the conference experience.
[0741] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[0742] Step 1:
[0743] Schedule a meeting:
[0744] The user inputs the date and time of the meeting and the number of people. The device sends the input information (e.g., "October 15, 2023, 14:00-15:00, 10 people") to the server. The server automatically selects the most suitable facility for the meeting based on the received information and confirms the reservation. Finally, the device notifies the user that the reservation was successful.
[0745] Input: The meeting date, time, and number of people entered by the user
[0746] Data processing: The server selects the best meeting venue
[0747] Output: Reservation completion notification
[0748] Specific behavior:
[0749] The user enters "October 15, 2023, 14:00-15:00, 10 people" on the application screen and presses the send button.
[0750] The terminal sends the data to the server, and the server confirms the reservation.
[0751] The terminal displays a "reservation complete" notification to the user.
[0752] Step 2:
[0753] Start security monitoring:
[0754] When a meeting starts, the device's camera and microphone are activated. The server detects the start of the meeting and activates the emotion engine to monitor users' emotions in real time.
[0755] Input: Meeting start notification
[0756] Data processing: Activate the camera and microphone, and the emotion engine collects emotion data
[0757] Output: Real-time emotion data
[0758] Specific behavior:
[0759] When the meeting starts, the device's camera and microphone will automatically turn on.
[0760] The emotion engine begins to analyze the user's emotions in real time.
[0761] Step 3:
[0762] In-meeting monitoring:
[0763] During the meeting, the device uses a camera and microphone to monitor the user's emotions and detect abnormal behavior. The server uses data from the emotion engine to send a notification if it detects abnormal behavior.
[0764] Input: Real-time emotion data
[0765] Data processing: Emotion engine detects abnormal behavior
[0766] Output: Abnormal behavior notification
[0767] Specific behavior:
[0768] During the actual meeting, the device's camera and microphone analyze the user's movements and voice in real time.
[0769] If any abnormal behavior is detected, the server will immediately notify and send an alert to the security team.
[0770] Step 4:
[0771] Ending a meeting:
[0772] At the end of the meeting, the collected emotional data and minutes of the meeting are automatically generated, stored on a secure server, and a notification is sent to participants.
[0773] Input: End of meeting notification
[0774] Data processing: Automatic generation and storage of emotion data and minutes
[0775] Output: Data storage notification
[0776] Specific behavior:
[0777] When the conference ends, the terminal notifies the server of the end of the conference.
[0778] The server automatically generates emotion data and meeting minutes, and stores this data on a secure server.
[0779] The device displays a "Data saved" notification to the user.
[0780] Step 5:
[0781] Recovery plan proposal:
[0782] Based on the issues detected during the meeting, the server generates a recovery plan and notifies the relevant parties. The server analyzes the sentiment data and identifies areas for improvement.
[0783] Input: Emotion data and problem information
[0784] Data processing: Recovery plan generation
[0785] Output: Recovery plan notification
[0786] Specific behavior:
[0787] The server performs analysis based on the emotional data collected during the meeting and the issues detected.
[0788] The server generates a recovery plan and notifies the relevant parties.
[0789] The terminal displays a notification to the relevant parties saying "Recovery plan has been generated."
[0790] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[0791] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[0792] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.
[0793] [Second embodiment]
[0794] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.
[0795] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.
[0796] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[0797] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.
[0798] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[0799] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[0800] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[0801] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[0802] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[0803] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[0804] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[0805] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."
[0806] This invention is a conference facility management system that uses AI technology and comprehensively manages everything from conference reservations to operation and information management. This system is composed of users, terminals, and a server.
[0807] Overall system overview
[0808] The system provides the following main functions:
[0809] 1. Meeting reception function
[0810] 2. Reservation arrangement function
[0811] 3. User pattern analysis
[0812] 4. Understanding usage status
[0813] 5. Meeting pattern analysis and management support
[0814] 6. Digitization of meeting information
[0815] 7. Information asset management function
[0816] 1. Meeting reception function
[0817] Embodiments:
[0818] The terminal provides an interface for the user to input the date, time, and number of people for the conference. When the user inputs the information and presses the reservation button, the terminal sends this information to the server. Based on the received information, the server searches for available conference facilities, automatically selects the most suitable facility, and confirms the reservation. The terminal notifies the user that the reservation was successful.
[0819] Specific working example:
[0820] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server. The server searches for the most suitable meeting facility and confirms the reservation. The device displays a "Reservation Complete" notification to the user.
[0821] 2. Reservation arrangement function
[0822] Embodiments:
[0823] The server analyzes past reservation data and meeting importance information. When a user enters a reservation, the server determines whether to secure a physical facility or use an online meeting and proposes the optimal choice. The device notifies the user of this proposal and prompts them to make a final decision.
[0824] Specific working example:
[0825] A user books an "important meeting." The device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed. The device displays this suggestion to the user.
[0826] 3. User pattern analysis
[0827] Embodiments:
[0828] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a user enters a new reservation, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results.
[0829] Specific working example:
[0830] User A enters a new reservation. The device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low." The device notifies the user that "reservations have been restricted."
[0831] 4. Understanding usage status
[0832] Embodiments:
[0833] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. The terminal receives the notification and displays it to the user.
[0834] Specific working example:
[0835] When a meeting is canceled, the server detects it and updates the usage database. Based on the waiting list, it notifies the waiting users that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal displays the notification.
[0836] 5. Meeting pattern analysis and management support
[0837] Embodiments:
[0838] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities) and notifies the administrator of the proposal.
[0839] Specific working example:
[0840] The server analyzes data from the past three months and notifies the administrator that "Conference facility C is being used frequently, so we suggest increasing the capacity from 15 to 20 people." The proposal is displayed on the administrator's device.
[0841] 6. Digitization of meeting information
[0842] Embodiments:
[0843] During the meeting, the server automatically collects audio and text data and generates minutes, which are then stored on a secure server and notified to participants.
[0844] Specific working example:
[0845] During the meeting, the server records audio data and automatically generates minutes. The minutes are saved on a secure server and a notification that "the minutes have been saved" is displayed on the participants' devices.
[0846] 7. Information asset management function
[0847] Embodiments:
[0848] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server uses the meeting data to present an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[0849] Specific working example:
[0850] A problem occurs during a project. The server references the meeting data and sends a notification that a recovery plan has been generated. The server also provides access links to related documents and sends a notification. The notification is displayed on the device.
[0851] In this way, the present invention is a system that improves the efficiency of reservation and management of conference facilities and reduces the risk of information leaks.
[0852] The processing flow will be explained below.
[0853] 1. Meeting reception function
[0854] Process flow:
[0855] Step 1:
[0856] The user inputs the date and time of the meeting and the number of people at the terminal.
[0857] Step 2:
[0858] The terminal transmits the input information to the server.
[0859] Step 3:
[0860] The server searches a schedule database of conference facilities based on the received information.
[0861] Step 4:
[0862] The server identifies the best meeting venue that meets the criteria.
[0863] Step 5:
[0864] The server updates the database with the confirmed reservation information.
[0865] Step 6:
[0866] The terminal displays a notification to the user that the reservation is complete.
[0867] 2. Reservation arrangement function
[0868] Process flow:
[0869] Step 1:
[0870] The user inputs the importance of the conference on the terminal and transmits the reservation information.
[0871] Step 2:
[0872] Based on the reservation information received by the server, the past reservation history and importance data are analyzed.
[0873] Step 3:
[0874] The server determines whether a facility needs to be reserved for a physical meeting or whether an online meeting is appropriate.
[0875] Step 4:
[0876] The server generates information that suggests the best reservation method for the user.
[0877] Step 5:
[0878] The terminal displays the server's proposals to the user and prompts them to make a final decision.
[0879] 3. User pattern analysis
[0880] Process flow:
[0881] Step 1:
[0882] The user inputs and transmits new reservation information on the terminal.
[0883] Step 2:
[0884] Based on the reservation information received by the server, the user's past reservation history, cancellation frequency, and rule violation record are analyzed.
[0885] Step 3:
[0886] The server evaluates the user's creditworthiness and sets reservation priorities and limits.
[0887] Step 4:
[0888] The server confirms or restricts reservations based on the evaluation results.
[0889] Step 5:
[0890] The terminal notifies the user of the evaluation results and reservation status.
[0891] 4. Understanding usage status
[0892] Process flow:
[0893] Step 1:
[0894] The server monitors the availability of conference facilities in real time.
[0895] Step 2:
[0896] The server periodically updates the usage data to a database.
[0897] Step 3:
[0898] If a meeting facility is cancelled, the server will immediately update the cancellation information.
[0899] Step 4:
[0900] The server checks the cancellation waiting list and notifies the waiting users of the cancellation information.
[0901] Step 5:
[0902] The device displays the notification to the user.
[0903] 5. Meeting pattern analysis and management support
[0904] Process flow:
[0905] Step 1:
[0906] A server periodically collects usage data of conference facilities.
[0907] Step 2:
[0908] The server analyzes the frequency of use of conference facilities, the number of people, and the time of day based on the data collected.
[0909] Step 3:
[0910] Based on the analysis results, the server will propose the optimal management method.
[0911] Step 4:
[0912] The server notifies the administrator of the proposal.
[0913] Step 5:
[0914] The terminal displays the proposal to the administrator and prompts them to decide whether to implement it.
[0915] 6. Digitization of meeting information
[0916] Process flow:
[0917] Step 1:
[0918] During the meeting, the server collects audio data and notes.
[0919] Step 2:
[0920] Minutes are automatically generated based on the data collected by the server.
[0921] Step 3:
[0922] The server stores minutes and meeting contents on a secure server.
[0923] Step 4:
[0924] The server notifies the conference participants that the minutes have been saved.
[0925] Step 5:
[0926] The terminal displays a notification to the user, prompting them to confirm the meeting content.
[0927] 7. Information asset management function
[0928] Process flow:
[0929] Step 1:
[0930] The server centrally manages the decisions made at the meeting and related documents.
[0931] Step 2:
[0932] If a problem occurs during the project, the server references the meeting data and generates a recovery plan.
[0933] Step 3:
[0934] The server notifies relevant parties of the recovery plan and provides links to access related documents.
[0935] Step 4:
[0936] The device will display a notification to the user, prompting them to review the recovery plan and related documentation.
[0937] Step 5:
[0938] The user checks the recovery plan on the terminal and carries out the project recovery.
[0939] Example 1
[0940] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[0941] Conventional conference facility management systems made reservation management cumbersome and required constant manual adjustments, making it difficult to secure optimal conference facilities and determine reservation priorities. Meeting content also had to be organized manually, which involved a lot of effort and errors. Furthermore, it was difficult to properly manage past usage data and meeting content and reflect it in future operations. This led to problems such as reduced meeting management efficiency and the risk of information leaks.
[0942] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[0943] In this invention, the server includes: means for searching for optimal conference facilities based on information entered by a user and automatically selecting and reserving them; means for analyzing past reservation data and conference importance information to determine whether to use physical facilities or online conferences and suggest the optimal choice; means for analyzing each user's reservation history, cancellation frequency, and rule violation record to set reservation priorities and restrictions based on their creditworthiness; means for monitoring the use of conference facilities in real time and notifying users on the waiting list in the event of a cancellation; means for automatically collecting audio and text data from conferences and generating and saving minutes; means for centrally managing meeting decisions and related documents and presenting project recovery plans. This improves the efficiency of conference facility reservations and management, reduces the risk of information leaks, and enables appropriate recovery plans to be presented quickly during projects.
[0944] An "interface" is a screen or means by which a user inputs information such as the date and time of a meeting and the number of participants.
[0945] A "server" is a computer system that searches for conference facilities based on information sent by users and finalizes reservations.
[0946] "Means for automatically selecting and confirming reservations" refers to a function that selects the most suitable conference facility based on the date, time and number of participants of the conference received by the server, and reserves that facility.
[0947] "Past reservation data" is historical information about conference reservations made by the user up to now.
[0948] "Meeting importance information" is information about the content and importance of a meeting, and is used to determine whether the meeting is held at a physical facility or online.
[0949] "Credit rating" is an evaluation value calculated based on a user's past reservation history, cancellation frequency, rule violation record, etc.
[0950] A "user waiting for a cancellation" is a user who is waiting for a cancellation to occur when a facility for a conference has already been reserved.
[0951] "Audio data" refers to audio information recorded during a conference.
[0952] "Text data" refers to documents and character information created during a meeting.
[0953] "Minutes" are a record of what was discussed during a meeting.
[0954] "Related documents" are materials used at the meeting and related documents.
[0955] A "recovery plan" is a solution that is formulated based on past meeting data when a problem occurs during the project.
[0956] This invention relates to a conference facility management system that uses AI technology and comprehensively manages everything from conference reservations to operation and information management. This system is composed of users, terminals, and a server, and provides the following main functions: conference reception, reservation arrangement, user pattern analysis, usage status assessment, conference pattern analysis and operation support, conference information digitization, and information asset management.
[0957] Overall system overview
[0958] The system configuration is as follows:
[0959] 1. A terminal that provides an interface for users to enter the date, time, and number of people for a meeting.
[0960] 2. A server that searches, selects, and reserves conference facilities based on information input from the terminal.
[0961] 3. A function in which the server returns reservation results and suggestions to the terminal and notifies the user.
[0962] 1. Meeting reception function
[0963] The user uses the device's interface to input the "date and time" and "number of people" for the meeting. For example, "October 15th, 14:00-15:00, 10 people." The device then sends this information to the server. Based on the received information, the server searches a database for available conference facilities, automatically selects the most suitable facility, and confirms the reservation. The server then returns the reservation results to the device and displays a "reservation complete" notification to the user.
[0964] 2. Reservation arrangement function
[0965] When a user enters details of a meeting (e.g., "important meeting"), the device sends this information to the server. The server analyzes past reservation data and meeting importance information to determine whether a physical conference facility is necessary or an online meeting is better. It then proposes the best option and notifies the user. The user then reviews the proposal and makes a final decision.
[0966] 3. User pattern analysis
[0967] The server analyzes each user's past reservation history, cancellation frequency, rule violation record, etc. to calculate their credit rating. Based on this credit rating, it sets priorities and restrictions for new reservations. For example, the terminal may receive a notification saying, "User A's credit rating is low, so reservations have been restricted."
[0968] 4. Understanding usage status
[0969] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. For example, a user on the waiting list might be notified that "Conference facility B has been canceled from 14:00 to 15:00."
[0970] 5. Meeting pattern analysis and management support
[0971] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities). The proposals are then notified to the administrator.
[0972] 6. Digitization of meeting information
[0973] During the meeting, the server automatically collects audio and text data and generates minutes. This information is stored on a secure server, and participants are notified that the minutes have been saved.
[0974] 7. Information asset management function
[0975] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server refers to the meeting data and presents an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[0976] Examples of prompt statements
[0977] Here are some examples of prompts to input to a generative AI model:
[0978] "Please explain in detail how information is exchanged between the user and the server in a conference reservation system. Please include specific processing steps and examples of how it works."
[0979] A system with the above-described configuration and functions will streamline the reservation and operation of conference facilities, reduce the risk of information leaks, and enable the prompt presentation of appropriate recovery plans while a project is underway.
[0980] The flow of the identification process in the first embodiment will be described with reference to FIG.
[0981] Meeting reception function
[0982] Step 1:
[0983] The user enters the date, time, and number of people attending the meeting.
[0984] Input: The user uses the terminal interface to input the "date and time" and "number of people." For example, the user inputs "October 15th, 14:00-15:00, number of people: 10."
[0985] Output: The conference information entered by the user is sent to the terminal.
[0986] Specific operation: The user enters the "date and time" and "number of people" and clicks the "reserve" button on the terminal.
[0987] Step 2:
[0988] The device sends the user's input information to the server
[0989] Input: User-entered meeting information.
[0990] Output: The terminal sends the user's input information to the server.
[0991] Specific operation: The terminal sends the conference information to the server, and the server receives the information.
[0992] Step 3:
[0993] The server searches for the best meeting room
[0994] Input: The "date and time" and "number of people" information of the meeting received by the server.
[0995] Data Processing: The server searches the database for available conference rooms and finds the one that best matches the entered criteria.
[0996] Output: Best meeting room information.
[0997] Specific operation: The server searches for meeting rooms that meet the conditions and executes an algorithm to select candidates.
[0998] Step 4:
[0999] The server reserves the conference room and returns the reservation result to the terminal.
[1000] Input: Best meeting room information.
[1001] Output: Confirmation of reservation information is returned to the terminal.
[1002] Specific operation: The server reserves the selected conference room and notifies the terminal of the result.
[1003] Step 5:
[1004] The terminal notifies the user of the reservation result.
[1005] Input: Confirmed booking information returned from the server.
[1006] Output: The device displays a "Reservation Complete" notification on the screen.
[1007] Specific operation: The terminal displays to the user, "Conference room reservation for October 15th, 14:00-15:00 has been completed."
[1008] Reservation arrangement function
[1009] Step 1:
[1010] User enters meeting reservation details
[1011] Input: Details of the meeting, for example, "Important Meeting".
[1012] Output: Detailed information is typed into the terminal.
[1013] Specific operation: The user enters the meeting details into the device interface and clicks the "Accept Proposal" button.
[1014] Step 2:
[1015] The device sends the input information to the server
[1016] Input: The meeting details entered by the user.
[1017] Output: The device sends information to the server.
[1018] Specific operation: The terminal sends detailed information about the meeting to the server, and the server receives the information.
[1019] Step 3:
[1020] The server analyzes past data
[1021] Input: Historical booking data and meeting importance information.
[1022] Data processing: The server performs analysis based on past data to determine whether the meeting will take place in a physical facility or online.
[1023] Output: Analysis results.
[1024] Specific operation: The server analyzes past data and generates a list of options.
[1025] Step 4:
[1026] The server will suggest the best reservation method
[1027] Input: Analysis results.
[1028] Output: Optimal booking method suggestions.
[1029] Specific operation: The server creates a proposal such as "Physical meeting facilities are needed" and sends it to the terminal.
[1030] Step 5:
[1031] The device notifies the user of the suggestion
[1032] Input: Suggestion from the server.
[1033] Output: The proposal is displayed on the screen.
[1034] What happens: The device displays a suggestion to the user, such as "Physical meeting room recommended."
[1035] Step 6:
[1036] The user reviews the proposal and makes a final decision
[1037] Input: User actions when reviewing server suggestions.
[1038] Output: The final decision is entered into the terminal and sent to the server.
[1039] What happens: The user reviews the suggestions and clicks a button to make a final decision and submit their input.
[1040] User pattern analysis
[1041] Step 1:
[1042] A user enters a new reservation
[1043] Input: Booking information for the new meeting.
[1044] Output: Reservation information is entered into the terminal.
[1045] Specific operation: The user enters new reservation information into the terminal and clicks the "Confirm reservation" button.
[1046] Step 2:
[1047] The device sends the information to the server
[1048] Input: New reservation information.
[1049] Output: The device sends information to the server.
[1050] Specific operation: The terminal sends conference reservation information to the server, and the server receives the information.
[1051] Step 3:
[1052] The server analyzes past data
[1053] Input: Each user's past booking history, cancellation frequency, and rule violation records.
[1054] Data processing: The server calculates the user's creditworthiness based on this data.
[1055] Output: Credit score.
[1056] Specific operation: The server scans past data and makes an evaluation based on each item.
[1057] Step 4:
[1058] The server evaluates the user's trustworthiness
[1059] Input: Credit score calculation result
[1060] Output: The user's credit rating.
[1061] Specific operation: The server aggregates the evaluation results and calculates the overall credibility.
[1062] Step 5:
[1063] The server sets reservation priorities and limits
[1064] Input: The user's credit rating.
[1065] Output: Priority and limit settings.
[1066] What it does: The server applies rules that prioritize and limit requests based on their trustworthiness.
[1067] Step 6:
[1068] The device notifies the user of the results.
[1069] Input: Server configuration results.
[1070] Output: Notification display.
[1071] Specific behavior: The device displays a notification to the user, such as "Reservations have been restricted."
[1072] Understanding usage status
[1073] Step 1:
[1074] The server monitors the usage of conference facilities
[1075] Input: Facility usage data.
[1076] Output: Real-time usage.
[1077] Specific operation: The server periodically runs a program that checks the database and updates usage status.
[1078] Step 2:
[1079] The server detects the cancellation of the reservation
[1080] Input: Reservation cancellation information.
[1081] Output: Prepare to notify users on the waiting list.
[1082] Specific operation: The server checks the reservation data, and if a cancellation occurs, obtains information about users on the waiting list based on that information.
[1083] Step 3:
[1084] The server sends notifications to the waiting list users
[1085] Input: Cancellation information and waiting list user information.
[1086] Output: Notification content.
[1087] Specific operation: The server sends a notification to users on the waiting list. It creates and sends a notification such as "Conference facility B has been canceled from 14:00 to 15:00."
[1088] Step 4:
[1089] The device displays the notification to the user
[1090] Input: Notification data from the server.
[1091] Output: A notification is displayed to the user.
[1092] Specific operation: The device displays a notification to the user such as "Facility B from 14:00 to 15:00 has been canceled."
[1093] Meeting pattern analysis and management support
[1094] Step 1:
[1095] The server collects data on meeting facilities
[1096] Input: Data such as past usage frequency, number of people, time of day, etc.
[1097] Data processing: Data collection.
[1098] Output: Collected data.
[1099] Specific operation: The server periodically collects system usage data and stores it in a database.
[1100] Step 2:
[1101] The server analyzes the collected data
[1102] Input: Collected data.
[1103] Data processing: Data analysis.
[1104] Output: Analysis results.
[1105] What it does: The server runs data analysis algorithms to generate insights that indicate whether changes to capacity or the addition of new facilities are needed.
[1106] Step 3:
[1107] The server proposes the operation method
[1108] Input: Analysis results.
[1109] Output: Proposal.
[1110] Specific operation: The server generates a proposal and notifies the administrator, sending a message such as "Conference facility C is being used frequently, so we propose increasing the capacity from 15 to 20 people."
[1111] Step 4:
[1112] The device notifies the administrator of the proposed action.
[1113] Input: Suggestion from the server.
[1114] Output: Notification displayed to administrator.
[1115] Specific operation: The device displays the suggestions on the screen.
[1116] Digitization of meeting information
[1117] Step 1:
[1118] The server collects audio and text data during the meeting.
[1119] Input: Voice and text data collected in real time during the meeting.
[1120] Data processing: Recording audio data and generating text data.
[1121] Output: Collected data.
[1122] Specific operation: The server collects data during the meeting in real time and prepares to store it on a secure server.
[1123] Step 2:
[1124] The server generates the minutes.
[1125] Input: Collected speech and text data.
[1126] Data processing: Converts audio data into text and automatically generates minutes.
[1127] Output: The generated transcript.
[1128] Specific operation: The server converts the collected voice data into text, organizes the contents of the meeting, and generates minutes.
[1129] Step 3:
[1130] The server saves the minutes and notifies the participants.
[1131] Input: Generated minutes.
[1132] Output: Notifications to participants and an access link to the saved minutes.
[1133] Specific operation: The server saves the minutes on a secure server and sends a notification to the participants that the minutes have been saved.
[1134] Step 4:
[1135] The device displays a notification to the participant
[1136] Input: Notification data from the server.
[1137] Output: Notification display to participants.
[1138] Specific behavior: The device displays a notification to participants, such as "Minutes have been saved."
[1139] Information asset management function
[1140] Step 1:
[1141] The server manages meeting decisions and related documents.
[1142] Input: Decisions made at the meeting and related documents.
[1143] Data processing: Centralized data management.
[1144] Output: Managed information.
[1145] Specific operation: The server performs database operations to centrally manage the agenda decided at the meeting and related documents.
[1146] Step 2:
[1147] Server detects problems during project execution
[1148] Input: Project progress data.
[1149] Data processing: Identifying the problem.
[1150] Output: Problem detection information.
[1151] What it does: The server monitors the progress of the project and detects problems as they occur.
[1152] Step 3:
[1153] The server generates a recovery plan
[1154] Input: Meeting data and project issue detection information.
[1155] Output: The generated recovery plan.
[1156] Specific operation: The server references past conference data and automatically generates an appropriate recovery plan.
[1157] Step 4:
[1158] The server notifies the relevant parties of the recovery plan
[1159] Input: The generated recovery plan.
[1160] Output: Notification and access link to interested parties.
[1161] Specific operation: The server sends the details of the recovery plan and access links to related documents to the relevant parties.
[1162] Step 5:
[1163] The device displays a notification to the relevant person.
[1164] Input: Notification data from the server.
[1165] Output: Notification displayed to relevant parties.
[1166] Specific operation: The device displays a notification to the relevant parties, such as "A recovery plan has been generated."
[1167] (Application example 1)
[1168] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1169] Manual scheduling and management of meetings and discussions held within factories can be inefficient and lead to reduced productivity. In addition, incomplete management of meeting information and delayed response to cancellations can have a negative impact on the operation of the entire factory. Furthermore, insufficient recording and sharing of meeting content can cause problems in the progress of projects. The goal is to solve these problems and improve the efficiency of factory meetings and thorough information management.
[1170] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1171] In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a meeting; a means for automatically selecting and reserving the most suitable meeting facility based on the input information; a means for adjusting reservations, including the use of online meetings, based on the importance of the meeting; a means for analyzing the reservation patterns of multiple users and managing reservations based on their trustworthiness; a means for understanding the usage status of meeting facilities in real time and notifying in the event of a cancellation; a means for automatically digitizing and saving the contents of the meeting; a means for centrally managing information assets determined in the meeting and supporting project recovery; a means for controlling factory robots that reserve and manage meetings within the factory and provide the most suitable meeting space; and a means for analyzing audio information, automatically generating minutes, and saving them in a secure database. This automates the scheduling and management of factory meetings, improves productivity, and enables thorough information management.
[1172] "Means for accepting meetings" is a function that provides an interface for inputting and managing the date, time, and number of people for a meeting.
[1173] "Means for making reservations based on input information" refers to a function that automatically selects the most suitable conference facility based on the information input by the user and confirms the reservation.
[1174] "Means for adjusting reservations" is a function that optimizes the use of physical conference rooms and online meetings by taking into account factors such as the importance of the meeting.
[1175] "Means for analyzing and managing reservation patterns" refers to a function that sets priorities and restrictions on user reservations based on past usage data and creditworthiness.
[1176] "Means for understanding usage status" refers to a function that monitors the current status of conference facilities in real time and responds quickly to any changes or cancellations to reservations.
[1177] "Means for automatically converting content into data and saving it" refers to a function that automatically collects audio and text information during a meeting and saves it in a database as minutes.
[1178] "A means of centrally managing information assets" is a function that consolidates and manages matters decided in meetings and related documents, and helps deal with problems as the project progresses.
[1179] "Means for controlling factory robots" refers to the function of instructing and managing robots to schedule and manage meetings within a factory.
[1180] "Means for analyzing audio information and automatically generating minutes" is a function that analyzes audio data collected during a meeting, automatically generates minutes, and stores them in a secure database.
[1181] This invention is a system for improving the efficiency of booking, running, and information management of meetings within a factory, and includes a reception means for inputting the date, time, and number of participants of a meeting, a reservation adjustment means based on the importance of the meeting, a reservation pattern analysis means, a usage status understanding means, a means for digitizing the contents of the meeting, an information asset management means, a factory robot control means, and a means for analyzing audio information and automatically generating minutes of the meeting.
[1182] Hardware and Software Configuration
[1183] This system uses the following hardware and software:
[1184] Hardware: Robots for factory navigation and meeting room management (e.g., robots powered by Raspberry Pi or NVIDIA Jetson Nano)
[1185] Software: The main components running on the server side include a Python program and an SQLite database.
[1186] Meeting reservation method
[1187] The server provides an interface on the terminal for entering the date, time, and number of people for the meeting. When the user enters the date, time, and number of people for the meeting, the information is sent to the server. The server automatically selects the most suitable conference facility based on the received information and confirms the reservation. This allows users to efficiently reserve meetings.
[1188] A method for adjusting reservations based on the importance of meetings
[1189] The server analyzes past reservation data and meeting importance information to determine whether to secure a physical facility or use an online meeting. If a user reserves an important meeting, the server will suggest whether a physical meeting facility would be more suitable and notify the user on their device.
[1190] A means to analyze and manage booking patterns
[1191] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a new reservation is entered, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results. This function ensures fairness in reservations.
[1192] Means of understanding usage status
[1193] The server monitors the usage status of conference facilities in real time, and if a reservation is changed or canceled, it immediately updates the information and notifies users on the waiting list, thereby improving the efficiency of facility usage.
[1194] How to digitize meeting content
[1195] The server automatically collects audio and text data during the meeting and generates minutes. This information is stored on a secure server and notifications are sent to participants, who can then refer to the data later.
[1196] A means of centrally managing information assets
[1197] The server centrally manages the decisions made in meetings and related documents, and if a problem occurs during the project, it uses the meeting data to present an appropriate recovery plan, sends notifications to stakeholders, and provides access links to related documents, ensuring the smooth progress of the project.
[1198] Control methods for factory robots
[1199] The server instructs and manages the robots to reserve and manage meetings within the factory. The robots then make the necessary preparations to provide the optimal meeting space. This automates the management of meetings within the factory.
[1200] Analysis of audio information and automatic generation of minutes
[1201] The server analyzes the audio data collected during the meeting, automatically generates minutes, and stores them in a secure database, simplifying the recording of meeting content.
[1202] Examples of concrete examples and prompts
[1203] For example, if a user inputs "Hold a meeting with 10 people on 2023-10-15 at 14:00," the server will reserve the most suitable conference room and, if necessary, instruct the robot to prepare for it. Furthermore, minutes of the meeting will be automatically generated based on the voice data, and can be referenced later.
[1204] Example prompts to input to the generative AI model:
[1205] Write a Python program for a factory robot that accepts reservations for meetings. The user inputs the date, time, and number of people, and the robot reserves the most suitable conference room. There are three conference rooms: "RoomA" (capacity 20 people), "RoomB" (capacity 10 people), and "RoomC" (capacity 30 people), and the reservation status is managed using a dictionary. No database is used.
[1206] This will automate the scheduling and management of factory meetings, improving productivity and ensuring thorough information management.
[1207] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1208] Step 1:
[1209] The user inputs the date and time of the meeting and the number of participants. The user inputs "2023-10-15 14:00, 10 participants" into the terminal interface and presses the reservation button. The input information is sent from the terminal to the server. The input data is the date, start time, and number of participants of the meeting.
[1210] Step 2:
[1211] The server searches for the most suitable conference facility based on the received information. From the list of registered conference rooms, the server searches for a conference room that is available on the specified date and time and can accommodate the number of participants. The server has a database of conference room capacities and reservation status. The server confirms that "Room B (capacity 10 people)" is available and selects it as the most suitable conference room.
[1212] Step 3:
[1213] The server confirms the reservation for the selected conference room and saves it in the database. The server adds "2023-10-15 14:00-15:00, Room B reservation" to the reservation information database. After the reservation is confirmed, the server sends a notification of reservation completion to the terminal.
[1214] Step 4:
[1215] The terminal displays a notification to the user that the reservation is complete. Upon receiving the notification from the server, the terminal displays the message "Conference room RoomB has been reserved from 14:00 to 15:00 on 2023-10-15."
[1216] Step 5:
[1217] The server adjusts reservations, including the use of online meetings, based on the importance of the meeting. When a user sets the importance of a meeting, the server analyzes past data and, if necessary, determines whether a physical conference room or an online meeting is more appropriate, and makes a recommendation. For example, the server may determine that "based on past data, a physical conference room is necessary" and notify the user of the result.
[1218] Step 6:
[1219] The server analyzes the reservation patterns of multiple users and manages reservations based on their creditworthiness. The server analyzes past reservation history, cancellation frequency, and rule violation records to evaluate creditworthiness. When a new reservation is entered, the server sets reservation priorities and restrictions based on the user's creditworthiness information.
[1220] Step 7:
[1221] The server monitors the availability of conference facilities in real time, immediately updates the information when a cancellation occurs, and automatically notifies users on the waiting list. When a cancellation occurs, the server updates the conference facility reservation information database and notifies relevant users based on the waiting list.
[1222] Step 8:
[1223] During the meeting, the server collects voice data and automatically generates minutes, which are then stored in a secure database. The server uses speech recognition technology to convert the conversations during the meeting into text data, formatting the data into minutes and storing it in the database. After the meeting ends, a notification is sent to participants informing them that the minutes have been saved.
[1224] Step 9:
[1225] The server centralizes the management of information assets decided in meetings and supports project recovery. If a problem occurs during the project, the server references related meeting data and generates an appropriate recovery plan. It notifies the relevant parties of the plan and provides access links to the necessary documents.
[1226] Step 10:
[1227] The factory robot prepares for the meeting. The server issues instructions to the factory robot to prepare the reserved conference room. The robot prepares the conference room and arranges materials, ensuring that the meeting starts smoothly.
[1228] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1229] This invention is a conference facility management system that uses AI technology to comprehensively manage everything from conference reservations to operation and information management, and also optimizes the conference experience by recognizing user emotions. This system is composed of users, terminals, a server, and an emotion engine.
[1230] Overall system overview
[1231] The system provides the following main functions:
[1232] 1. Meeting reception function
[1233] 2. Reservation arrangement function
[1234] 3. User pattern analysis
[1235] 4. Understanding usage status
[1236] 5. Meeting pattern analysis and management support
[1237] 6. Digitization of meeting information
[1238] 7. Information asset management function
[1239] 8. Emotion recognition function
[1240] 1. Meeting reception function
[1241] Embodiments:
[1242] The terminal provides an interface for the user to input the date, time, and number of people for the meeting. When the user inputs the information and presses the reservation button, the terminal sends this information to the server. Based on the received information, the server automatically selects the most suitable facility for the meeting and confirms the reservation. The terminal notifies the user that the reservation was successful.
[1243] Specific working example:
[1244] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server. The server searches for the most suitable meeting facility and confirms the reservation. The device displays a "Reservation Complete" notification to the user.
[1245] 2. Reservation arrangement function
[1246] Embodiments:
[1247] The server analyzes past reservation data and meeting importance information. When a user enters a reservation, the server determines whether to reserve a physical meeting facility or use an online meeting, and proposes the optimal choice. The device notifies the user of this proposal and prompts them to make a final decision.
[1248] Specific working example:
[1249] A user books an "important meeting." The device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed. The device displays this suggestion to the user.
[1250] 3. User pattern analysis
[1251] Embodiments:
[1252] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a user enters a new reservation, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results.
[1253] Specific working example:
[1254] User A enters a new reservation. The device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low." The device notifies the user that "reservations have been restricted."
[1255] 4. Understanding usage status
[1256] Embodiments:
[1257] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. The terminal receives the notification and displays it to the user.
[1258] Specific working example:
[1259] When a meeting is canceled, the server detects it and updates the usage database. Based on the waiting list, it notifies the waiting users that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal displays the notification.
[1260] 5. Meeting pattern analysis and management support
[1261] Embodiments:
[1262] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities) and notifies the administrator of the proposal.
[1263] Specific working example:
[1264] The server analyzes data from the past three months and notifies the administrator that "Conference facility C is being used frequently, so we suggest increasing the capacity from 15 to 20 people." The proposal is displayed on the administrator's device.
[1265] 6. Digitization of meeting information
[1266] Embodiments:
[1267] During the meeting, the server automatically collects audio and text data and generates minutes, which are then stored on a secure server and notified to participants.
[1268] Specific working example:
[1269] During the meeting, the server records audio data and automatically generates minutes. The minutes are saved on a secure server and a notification that "the minutes have been saved" is displayed on the participants' devices.
[1270] 7. Information asset management function
[1271] Embodiments:
[1272] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server uses the meeting data to present an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[1273] Specific working example:
[1274] A problem occurs during a project. The server references the meeting data and sends a notification that a recovery plan has been generated. The server also provides access links to related documents and sends a notification. The notification is displayed on the device.
[1275] 8. Emotion recognition function
[1276] Embodiments:
[1277] The system incorporates an emotion engine that recognizes users' emotions and collects emotional data during meetings. The server automatically records and saves the emotional data obtained from the emotion engine along with the meeting minutes. Furthermore, the emotional data is used to analyze the efficiency and productivity of meetings, and suggests rescheduling or environmental adjustments as necessary.
[1278] Specific working example:
[1279] During the meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting emotional state data. The server automatically saves this data along with the minutes. A notification is sent saying, "User's emotional data has been recorded." The server then sends suggestions for improving the meeting to the administrator based on the emotional data. The suggestions are displayed on the administrator's device.
[1280] In this way, the present invention is a system that not only streamlines the reservation and operation of conference facilities and reduces the risk of information leakage, but also analyzes user emotions to optimize the conference experience.
[1281] The processing flow will be explained below.
[1282] 8. Emotion recognition function
[1283] Process flow:
[1284] Step 1:
[1285] At the start of a conference, a user logs in through a terminal and connects to the conference facility or to an online conference.
[1286] Step 2:
[1287] The emotion engine collects emotional data such as the user's facial expressions and tone of voice in real time using sensors such as cameras and microphones.
[1288] Step 3:
[1289] The device transmits the collected emotion data to a server.
[1290] Step 4:
[1291] The server analyzes the received emotional data and determines the user's emotional state (e.g., stress, satisfaction, concentration, etc.).
[1292] Step 5:
[1293] The server automatically records and saves the analyzed emotional data along with the meeting minutes.
[1294] Step 6:
[1295] The server evaluates the efficiency and productivity of the meeting based on emotional data, and if necessary, suggests rescheduling the meeting or switching to an online meeting.
[1296] Step 7:
[1297] The server notifies the administrator of the emotion data and suggestions for improving the meeting. The terminal displays this information to the administrator.
[1298] Specific working example:
[1299] 1. The user arrives at the conference facility at 10:00 and logs in to the conference via a terminal. The emotion engine is automatically activated.
[1300] 2. While the meeting is in progress, the emotion engine recognizes the user's face with a camera and collects the user's voice tone with a microphone. For example, if the user's facial expression is stern, it is interpreted as irritation, and if the user's voice tone is high, it is interpreted as tension.
[1301] 3. The device sequentially transmits the collected emotion data to the server, which receives it in real time.
[1302] 4. The server analyzes the emotional data and determines the user's emotional state. For example, it determines that more than half of the participants are in a stressful state.
[1303] 5. The server automatically generates meeting minutes based on the emotional data and stores them in secure storage. This includes information such as "Many of the participants felt stressed during the meeting."
[1304] 6. The server analyzes the emotion data and generates adjustment suggestions such as, "The current meeting is running behind schedule, so let's start the next meeting five minutes later."
[1305] 7. The server notifies the administrator of the adjustment proposal and details of the emotion data. The administrator's device displays a notification saying, "Participants are feeling stressed in the current meeting, so we suggest taking a break."
[1306] In this way, the present invention, which combines emotion recognition functionality, is a system that not only streamlines the reservation and management of conference facilities and reduces the risk of information leakage, but also analyzes user emotions to optimize the conference experience.
[1307] Example 2
[1308] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1309] Conventional meeting management systems often lack efficiency and do not fully optimize meetings because reservations, management, and information management are handled separately. Furthermore, they lack the ability to analyze user sentiment, limiting their ability to improve the quality and efficiency of communication during meetings. As a result, problems often arise related to meeting progress and the risk of information leaks.
[1310] The identification processing by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a conference; a means for automatically selecting and reserving the optimal conference facility based on the input information; a means for adjusting reservations, including the use of online conferences, based on the importance of the conference; a means for analyzing the reservation patterns of multiple users and managing reservations based on their trustworthiness; a means for understanding the utilization status of conference facilities in real time and notifying users in the event of cancellations; a means for automatically digitizing and saving the contents of the conference; a means for centrally managing information assets determined in the conference and supporting project recovery; and a means for analyzing the efficiency and productivity of the conference based on emotion data acquired by an emotion engine and making improvement suggestions. This significantly improves the efficiency of conference management, reduces the risk of information leaks, and optimizes the conference experience by analyzing user emotions.
[1311] The "reception means" is an interface for inputting the date and time of the meeting and the number of people, and is a device or system that allows the user to input information about the meeting.
[1312] A "reservation means" is a device or system that automatically selects and reserves the most suitable conference facility based on input information.
[1313] The "reservation adjustment means" is a device or system for adjusting reservations, including the use of online conferences, based on the importance of the conference.
[1314] The "credit management means" is a device or system for analyzing the reservation patterns of multiple users and managing reservations based on their credit scores.
[1315] The "usage status monitoring means" is a device or system that monitors the usage status of conference facilities in real time and notifies users in the event of a cancellation.
[1316] The "digitization means" is a device or system for automatically digitizing and saving the contents of a conference.
[1317] "Information asset management means" refers to a device or system that centrally manages the information assets decided at the meeting and supports project recovery.
[1318] The "emotion data analysis means" is a device or system that analyzes the efficiency and productivity of a meeting based on the emotion data acquired by the emotion engine and makes suggestions for improvement.
[1319] An "emotion engine" is a device or software that analyzes a user's facial expressions and tone of voice to collect emotional data.
[1320] An "online conference tool" is a device or software that supports conferences conducted over the Internet.
[1321] This invention is a conference facility management system that utilizes AI technology to comprehensively manage conference reservations, operations, information management, and user emotion recognition. The system consists of users, terminals, a server, and an emotion engine.
[1322] System configuration and operation
[1323] 1. Reception method
[1324] The user inputs the date and time of the meeting and the number of people through the terminal interface.
[1325] The terminal transmits the input information to the server.
[1326] Examples:
[1327] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server.
[1328] 2. Reservation Method
[1329] The server automatically selects the most suitable conference venue based on the received information.
[1330] The server confirms the reservation and transmits the result to the terminal.
[1331] The terminal displays a notification to the user that the reservation is complete.
[1332] Examples:
[1333] The server searches for the most suitable conference facility and confirms the reservation. The terminal displays a "reservation completed" notification to the user.
[1334] 3. Reservation Adjustment Methods
[1335] The user inputs the importance of the conference and the desired reservation details into the terminal.
[1336] The terminal transmits the information to the server.
[1337] The server analyzes past reservation data and the importance of the meeting to determine whether a physical conference facility is necessary or whether an online meeting is appropriate.
[1338] The server proposes the best choice and sends the result to the terminal.
[1339] The device will notify the user of the proposal and prompt them to make a final decision.
[1340] Examples:
[1341] A user enters an "important meeting" as a reservation into a device. The device sends this information to a server. The server analyzes past meeting data and determines that a physical meeting facility is required. The device displays this suggestion to the user and prompts for confirmation.
[1342] 4. Credit management measures
[1343] The server analyzes the user's past reservation history, cancellation frequency, rule violations, etc. to evaluate their trustworthiness.
[1344] When a user enters a new reservation, the terminal sends the information to the server.
[1345] The server sets reservation priorities and limits based on the user's creditworthiness.
[1346] The server sends the result to the terminal, which notifies the user.
[1347] Examples:
[1348] User A enters a new reservation. The device sends the information to the server. The server determines that "User A's credibility is low" based on past data. The device notifies the user that "reservations have been restricted."
[1349] 5. Usage Monitoring Methods
[1350] The server monitors the availability of conference facilities in real time.
[1351] The server automatically sends a notification to users on the waiting list when a reservation is canceled.
[1352] The terminal receives the notification and displays it to the user.
[1353] Examples:
[1354] When a meeting is canceled, the server immediately detects it and updates the usage database. The server notifies the waiting user that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal receives the notification and displays it to the user.
[1355] 6. Data Collection Methods
[1356] The server automatically collects audio and text data during the conference.
[1357] The server generates minutes based on the collected information and stores them securely.
[1358] The server notifies the participants of the generated minutes.
[1359] The device receives the notification and displays it to the participants.
[1360] Examples:
[1361] During the meeting, the server records audio data and automatically generates minutes. The server securely stores the minutes and notifies participants that the minutes have been saved. The device receives the notification and displays it to the participants.
[1362] 7. Information Asset Management Measures
[1363] The server centrally manages the decisions made at the meeting and related documents.
[1364] If a problem occurs during the project, the server will present an appropriate recovery plan based on the meeting data.
[1365] The server notifies the relevant parties of the access links to the recovery plan and related documents.
[1366] The device displays a notification.
[1367] Examples:
[1368] When a problem occurs during a project, the server references the meeting data and notifies the user that a recovery plan has been generated. The server then sends a notification providing access links to related documents. The device then displays a notification containing related links.
[1369] 8. Sentiment Data Analysis Methods
[1370] The emotion engine analyzes users' facial expressions and tone of voice during meetings to collect emotional data.
[1371] The server automatically stores the emotion data along with the minutes.
[1372] The server analyzes the efficiency and productivity of meetings based on the emotional data and sends improvement suggestions to the administrator as needed.
[1373] The terminal displays the proposed content to the administrator.
[1374] Examples:
[1375] During a meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting data on their emotional state. The server automatically saves this data along with the minutes. The server then sends "suggestions for improving the meeting" to the administrator based on the emotion data. The device then displays the suggestions to the administrator.
[1376] Prompt Sentence Examples
[1377] "I would like to reserve a conference room for 10 people from 2:00 PM to 3:00 PM on October 15th."
[1378] "I have an important meeting and would like to know if I need a physical conference facility."
[1379] This invention is a system that not only makes meetings more efficient and reduces the risk of information leaks, but also analyzes users' emotions to optimize the meeting experience.
[1380] The flow of the identification process in the second embodiment will be described with reference to FIG.
[1381] Step 1:
[1382] (Reception processing)
[1383] User: Enter the date, time and number of people for the meeting.
[1384] Terminal: Receives the meeting date and time and number of participants entered by the user.
[1385] Input: Information entered by the user: "October 15th, 14:00-15:00, 10 people."
[1386] Output: Sends the entered conference information to the server.
[1387] Specific operation: The user enters "October 15th, 14:00-15:00, number of people: 10", and the device sends this information to the server.
[1388] Step 2:
[1389] (Reservation processing)
[1390] Server: Automatically selects the most suitable conference facility based on the received conference information.
[1391] Input: Meeting information sent from the device (date, time and number of people).
[1392] Data processing: Matching the availability of conference facilities with requirements and selecting the most suitable facility, for example, querying the availability database to list relevant facilities.
[1393] Output: Confirmed reservation of the best meeting venue.
[1394] Terminal: Notifies the user that the reservation is complete.
[1395] Specific operation: The server searches for the most suitable conference facility, confirms the reservation, and the terminal displays a "reservation completed" notification to the user.
[1396] Step 3:
[1397] (Reservation adjustment process)
[1398] User: Enter the importance of the meeting and the desired reservation details.
[1399] Terminal: Receives the importance of the meeting and the desired reservation details, and sends them to the server.
[1400] Server: Analyzes past reservation data and meeting importance information.
[1401] Input: Meeting information and past reservation data sent from the device.
[1402] Data analysis: Algorithms that reference a meeting database to determine whether a physical meeting facility is necessary or whether an online meeting is appropriate prioritize physical facilities for more important meetings.
[1403] Output: What is the best meeting format (physical or online) and why?
[1404] Terminal: Notifies the user of the proposal and prompts them to make a final decision.
[1405] How it works: A user enters a reservation for an "important meeting," and the device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed, and the device displays this suggestion to the user.
[1406] Step 4:
[1407] (Credit Management Processing)
[1408] Server: Analyzes the user's past reservation history, cancellation frequency, and rule violations to evaluate their creditworthiness.
[1409] Input: User's booking history, cancellation frequency, and rule violation data.
[1410] Data analysis: Apply a scoring algorithm to assess a user's creditworthiness. For example, if they cancel frequently, the score will be lowered.
[1411] Output: The estimated credit score.
[1412] Terminal: When a user enters a new reservation, the results are displayed, prioritizing and limiting the reservation based on creditworthiness.
[1413] Specific operation: User A enters a new reservation, and the device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low," and the device notifies the user that "reservations have been restricted."
[1414] Step 5:
[1415] (Usage status monitoring process)
[1416] Server: Monitors the availability of conference facilities in real time.
[1417] Input: Real-time facility usage data.
[1418] Data monitoring: Monitors the usage of conference facilities and immediately detects any changes. For example, if a reservation is canceled, that information is reflected in the waiting list.
[1419] Output: Notification information about the cancellation.
[1420] Server: When a reservation is canceled, users on the waiting list are automatically notified.
[1421] Terminal: Receives notifications and displays them to the user.
[1422] Specific operation: When a meeting is canceled, the server detects it and updates the usage database. Based on the cancellation waiting list, the server notifies the waiting user that "Facility B for the meeting has been canceled from 14:00 to 15:00," and the terminal displays this.
[1423] Step 6:
[1424] (Data processing)
[1425] Server: Automatically collects audio and text data during the meeting.
[1426] Input: Audio and text data during the meeting.
[1427] Data processing: Converting voice data into text and generating meeting minutes in an appended format. For example, using speech recognition technology to automatically transcribe meeting content into text.
[1428] Output: Auto-generated meeting minutes text.
[1429] Server: Generates minutes based on the collected information and stores them securely.
[1430] Server: Notifies participants of the generated minutes.
[1431] Device: Receives notifications and displays them to participants.
[1432] Specific operation: The server records audio data during the meeting and automatically generates minutes. The server securely saves the minutes, notifies participants that the minutes have been saved, and the device displays a notification to the participants.
[1433] Step 7:
[1434] (Information Asset Management Processing)
[1435] Server: Centrally manages the decisions made at meetings and related documents.
[1436] Input: Decisions made at the meeting and related documents.
[1437] Data management: Decisions made at meetings and related documents are stored in a centralized database. For example, resolutions and related files are aggregated in a project folder.
[1438] Output: Centralized meeting content and related documents.
[1439] Server: If a problem occurs during the project, it will present an appropriate recovery plan based on the meeting data.
[1440] Server: Notifies relevant parties of the recovery plan and access links to related documents.
[1441] Device: Show notifications.
[1442] Specific operation: When a problem occurs during a project, the server references the meeting data and notifies the user that a recovery plan has been generated. The server provides an access link to the relevant document, and the device displays the notification.
[1443] Step 8:
[1444] (Emotion data analysis processing)
[1445] Emotion Engine: Collects emotional data by analyzing the user's facial expressions and tone of voice during the meeting.
[1446] Input: Facial expression data and tone of voice data of users during the meeting.
[1447] Data analysis: Analyze the user's emotional state using an emotion engine, for example, identify emotions based on facial expression recognition and voice analysis.
[1448] Output: Parsed emotion data.
[1449] Server: Emotion data is automatically saved along with the minutes.
[1450] Server: Analyzes the efficiency and productivity of meetings based on emotional data and sends improvement suggestions to the administrator as needed.
[1451] Terminal: Display the proposal to the administrator.
[1452] How it works: During a meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting data on their emotional state. The server automatically saves this data along with the minutes, and sends "suggestions for improving the meeting" to the administrator based on the emotion data, which are then displayed on the device.
[1453] (Application example 2)
[1454] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."
[1455] Conventional conference facility management systems are designed solely to streamline conference reservations and management, leaving out important features such as security monitoring during the conference and monitoring of participants' emotions. This makes it difficult to immediately respond to abnormal behavior during a conference, potentially leading to security issues and participant stress. Furthermore, the lack of a system that integrates these features makes centralized management difficult. Therefore, there is a need for a comprehensive system that ensures security during a conference and also takes into account the emotional state of participants.
[1456] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a conference; a means for automatically selecting and reserving the optimal conference facility based on the input information; a means for adjusting reservations, including the use of online conferences, based on the importance of the conference; a means for analyzing the reservation patterns of multiple users and managing reservations based on their credit ratings; a means for understanding the utilization status of conference facilities in real time and notifying users in the event of cancellations; a means for automatically digitizing and saving the contents of the conference; a means for centrally managing information assets determined in the conference and supporting project recovery; a means for automatically starting security monitoring at the start of a reserved conference; a means for monitoring users' emotions in real time during the conference and detecting abnormal behavior; and a means for sending notifications based on detected abnormal behavior and enhancing security. This improves the efficiency of conference reservations and management, integrates security monitoring and emotion monitoring, and enables rapid response to abnormal behavior during the conference.
[1457] The "reception means" is a device or software that provides an interface for inputting the date and time of the meeting and the number of participants.
[1458] A "reservation means" is a device or software that automatically selects the most suitable conference facility based on input information and reserves that facility.
[1459] The "means for adjusting reservations" refers to devices or software for adjusting reservations, including the use of online meetings, based on the importance of the meetings.
[1460] A "means for managing reservations" is a device or software that analyzes the reservation patterns of multiple users and sets reservation priorities and limits based on creditworthiness.
[1461] "Means for notifying in the event of a cancellation" refers to devices or software that monitor the usage status of conference facilities in real time and notify users when their reservations are canceled.
[1462] "Means for digitizing and saving" refers to devices or software that automatically collect meeting content as audio or text data, generate minutes, and save them.
[1463] "Means to support recovery" refers to devices or software that centrally manage information assets decided in meetings and, if a problem occurs during the project, use the meeting data as a reference to present an appropriate recovery plan.
[1464] The "means for starting security monitoring" refers to a device or software for automatically starting the security monitoring function at the start of a scheduled conference.
[1465] "Means for detecting abnormal behavior" refers to devices or software that monitor users' emotions in real time during a meeting and detect abnormal behavior.
[1466] "Means for sending notifications and enhancing security" refers to devices or software that send notifications in real time based on detected abnormal behavior and enhance security.
[1467] This invention is a conference facility management system equipped with security functions using AI technology. An embodiment of the system that realizes this application example is described below.
[1468] Overall system configuration
[1469] The system consists of a user terminal, a server, and an emotion engine, and comprehensively manages everything from conference reservations to operation, information management, and security monitoring.
[1470] Hardware and software used
[1471] Hardware: Smartphones, tablets, smart glasses
[1472] Software and Technology:
[1473] Camera and microphone: Used for image recognition and voice analysis.
[1474] Emotion Engine: Recognizes user emotions in real time.
[1475] Firebase: Used for real-time database and authentication.
[1476] OpenCV: Used for image and video processing.
[1477] TensorFlow: Used for emotion recognition models.
[1478] Processing flow
[1479] 1. Schedule a meeting
[1480] The user inputs the date, time and number of people for the meeting.
[1481] The terminal transmits the input information to the server, which then automatically selects the most suitable facility for the conference and confirms the reservation.
[1482] 2. Start security monitoring
[1483] At the start of the meeting, the device's camera and microphone are activated and the emotion engine analyzes the user's emotions in real time.
[1484] 3. Monitoring during meetings
[1485] During the meeting, the device uses a camera and microphone to monitor users' emotions in real time and detect abnormal behavior.
[1486] When the server detects abnormal behavior, it immediately sends a notification and alerts relevant parties.
[1487] 4. Ending the meeting
[1488] At the end of the meeting, the collected emotional data and meeting minutes are automatically generated and stored on a secure server.
[1489] 5. Recovery plan proposal
[1490] Based on any issues detected during the meeting, the server generates a recovery plan and notifies the relevant parties.
[1491] Examples of concrete examples and prompts
[1492] As a concrete example, the following prompt sentence will be used.
[1493] Example prompt sentence:
[1494] "I've booked an important meeting for 10 people on October 15, 2023, from 2:00 PM to 3:00 PM. I'll begin security monitoring and notify you if any abnormal activity is detected."
[1495] Example notification:
[1496] "At 2:30 PM, signs of stress were detected in Conference Room A. Security team has been notified."
[1497] System Effects
[1498] The system will streamline conference booking and management, integrate security and emotion monitoring to enable rapid response to abnormal behavior during meetings, and use the collected data to optimize the conference experience.
[1499] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[1500] Step 1:
[1501] Schedule a meeting:
[1502] The user inputs the date and time of the meeting and the number of people. The device sends the input information (e.g., "October 15, 2023, 14:00-15:00, 10 people") to the server. The server automatically selects the most suitable facility for the meeting based on the received information and confirms the reservation. Finally, the device notifies the user that the reservation was successful.
[1503] Input: The meeting date, time, and number of people entered by the user
[1504] Data processing: The server selects the best meeting venue
[1505] Output: Reservation completion notification
[1506] Specific behavior:
[1507] The user enters "October 15, 2023, 14:00-15:00, 10 people" on the application screen and presses the send button.
[1508] The terminal sends the data to the server, and the server confirms the reservation.
[1509] The terminal displays a "reservation complete" notification to the user.
[1510] Step 2:
[1511] Start security monitoring:
[1512] When a meeting starts, the device's camera and microphone are activated. The server detects the start of the meeting and activates the emotion engine to monitor users' emotions in real time.
[1513] Input: Meeting start notification
[1514] Data processing: Activate the camera and microphone, and the emotion engine collects emotion data
[1515] Output: Real-time emotion data
[1516] Specific behavior:
[1517] When the meeting starts, the device's camera and microphone will automatically turn on.
[1518] The emotion engine begins to analyze the user's emotions in real time.
[1519] Step 3:
[1520] In-meeting monitoring:
[1521] During the meeting, the device uses a camera and microphone to monitor the user's emotions and detect abnormal behavior. The server uses data from the emotion engine to send a notification if it detects abnormal behavior.
[1522] Input: Real-time emotion data
[1523] Data processing: Emotion engine detects abnormal behavior
[1524] Output: Abnormal behavior notification
[1525] Specific behavior:
[1526] During the actual meeting, the device's camera and microphone analyze the user's movements and voice in real time.
[1527] If any abnormal behavior is detected, the server will immediately notify and send an alert to the security team.
[1528] Step 4:
[1529] Ending a meeting:
[1530] At the end of the meeting, the collected emotional data and minutes of the meeting are automatically generated, stored on a secure server, and a notification is sent to participants.
[1531] Input: End of meeting notification
[1532] Data processing: Automatic generation and storage of emotion data and minutes
[1533] Output: Data storage notification
[1534] Specific behavior:
[1535] When the conference ends, the terminal notifies the server of the end of the conference.
[1536] The server automatically generates emotion data and meeting minutes, and stores this data on a secure server.
[1537] The device displays a "Data saved" notification to the user.
[1538] Step 5:
[1539] Recovery plan proposal:
[1540] Based on the issues detected during the meeting, the server generates a recovery plan and notifies the relevant parties. The server analyzes the sentiment data and identifies areas for improvement.
[1541] Input: Emotion data and problem information
[1542] Data processing: Recovery plan generation
[1543] Output: Recovery plan notification
[1544] Specific behavior:
[1545] The server performs analysis based on the emotional data collected during the meeting and the issues detected.
[1546] The server generates a recovery plan and notifies the relevant parties.
[1547] The terminal displays a notification to the relevant parties saying "Recovery plan has been generated."
[1548] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[1549] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[1550] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.
[1551] [Third embodiment]
[1552] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.
[1553] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.
[1554] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[1555] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.
[1556] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[1557] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[1558] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[1559] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[1560] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[1561] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[1562] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[1563] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."
[1564] This invention is a conference facility management system that uses AI technology and comprehensively manages everything from conference reservations to operation and information management. This system is composed of users, terminals, and a server.
[1565] Overall system overview
[1566] The system provides the following main functions:
[1567] 1. Meeting reception function
[1568] 2. Reservation arrangement function
[1569] 3. User pattern analysis
[1570] 4. Understanding usage status
[1571] 5. Meeting pattern analysis and management support
[1572] 6. Digitization of meeting information
[1573] 7. Information asset management function
[1574] 1. Meeting reception function
[1575] Embodiments:
[1576] The terminal provides an interface for the user to input the date, time, and number of people for the conference. When the user inputs the information and presses the reservation button, the terminal sends this information to the server. Based on the received information, the server searches for available conference facilities, automatically selects the most suitable facility, and confirms the reservation. The terminal notifies the user that the reservation was successful.
[1577] Specific working example:
[1578] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server. The server searches for the most suitable meeting facility and confirms the reservation. The device displays a "Reservation Complete" notification to the user.
[1579] 2. Reservation arrangement function
[1580] Embodiments:
[1581] The server analyzes past reservation data and meeting importance information. When a user enters a reservation, the server determines whether to secure a physical facility or use an online meeting and proposes the optimal choice. The device notifies the user of this proposal and prompts them to make a final decision.
[1582] Specific working example:
[1583] A user books an "important meeting." The device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed. The device displays this suggestion to the user.
[1584] 3. User pattern analysis
[1585] Embodiments:
[1586] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a user enters a new reservation, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results.
[1587] Specific working example:
[1588] User A enters a new reservation. The device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low." The device notifies the user that "reservations have been restricted."
[1589] 4. Understanding usage status
[1590] Embodiments:
[1591] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. The terminal receives the notification and displays it to the user.
[1592] Specific working example:
[1593] When a meeting is canceled, the server detects it and updates the usage database. Based on the waiting list, it notifies the waiting users that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal displays the notification.
[1594] 5. Meeting pattern analysis and management support
[1595] Embodiments:
[1596] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities) and notifies the administrator of the proposal.
[1597] Specific working example:
[1598] The server analyzes data from the past three months and notifies the administrator that "Conference facility C is being used frequently, so we suggest increasing the capacity from 15 to 20 people." The proposal is displayed on the administrator's device.
[1599] 6. Digitization of meeting information
[1600] Embodiments:
[1601] During the meeting, the server automatically collects audio and text data and generates minutes, which are then stored on a secure server and notified to participants.
[1602] Specific working example:
[1603] During the meeting, the server records audio data and automatically generates minutes. The minutes are saved on a secure server and a notification that "the minutes have been saved" is displayed on the participants' devices.
[1604] 7. Information asset management function
[1605] Embodiments:
[1606] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server uses the meeting data to present an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[1607] Specific working example:
[1608] A problem occurs during a project. The server references the meeting data and sends a notification that a recovery plan has been generated. The server also provides access links to related documents and sends a notification. The notification is displayed on the device.
[1609] In this way, the present invention is a system that improves the efficiency of reservation and management of conference facilities and reduces the risk of information leaks.
[1610] The processing flow will be explained below.
[1611] 1. Meeting reception function
[1612] Process flow:
[1613] Step 1:
[1614] The user inputs the date and time of the meeting and the number of people at the terminal.
[1615] Step 2:
[1616] The terminal transmits the input information to the server.
[1617] Step 3:
[1618] The server searches a schedule database of conference facilities based on the received information.
[1619] Step 4:
[1620] The server identifies the best meeting venue that meets the criteria.
[1621] Step 5:
[1622] The server updates the database with the confirmed reservation information.
[1623] Step 6:
[1624] The terminal displays a notification to the user that the reservation is complete.
[1625] 2. Reservation arrangement function
[1626] Process flow:
[1627] Step 1:
[1628] The user inputs the importance of the conference on the terminal and transmits the reservation information.
[1629] Step 2:
[1630] Based on the reservation information received by the server, the past reservation history and importance data are analyzed.
[1631] Step 3:
[1632] The server determines whether a facility needs to be reserved for a physical meeting or whether an online meeting is appropriate.
[1633] Step 4:
[1634] The server generates information that suggests the best reservation method for the user.
[1635] Step 5:
[1636] The terminal displays the server's proposals to the user and prompts them to make a final decision.
[1637] 3. User pattern analysis
[1638] Process flow:
[1639] Step 1:
[1640] The user inputs and transmits new reservation information on the terminal.
[1641] Step 2:
[1642] Based on the reservation information received by the server, the user's past reservation history, cancellation frequency, and rule violation record are analyzed.
[1643] Step 3:
[1644] The server evaluates the user's creditworthiness and sets reservation priorities and limits.
[1645] Step 4:
[1646] The server confirms or restricts reservations based on the evaluation results.
[1647] Step 5:
[1648] The terminal notifies the user of the evaluation results and reservation status.
[1649] 4. Understanding usage status
[1650] Process flow:
[1651] Step 1:
[1652] The server monitors the availability of conference facilities in real time.
[1653] Step 2:
[1654] The server periodically updates the usage data to a database.
[1655] Step 3:
[1656] If a meeting facility is cancelled, the server will immediately update the cancellation information.
[1657] Step 4:
[1658] The server checks the cancellation waiting list and notifies the waiting users of the cancellation information.
[1659] Step 5:
[1660] The device displays the notification to the user.
[1661] 5. Meeting pattern analysis and management support
[1662] Process flow:
[1663] Step 1:
[1664] A server periodically collects usage data of conference facilities.
[1665] Step 2:
[1666] The server analyzes the frequency of use of conference facilities, the number of people, and the time of day based on the data collected.
[1667] Step 3:
[1668] Based on the analysis results, the server will propose the optimal management method.
[1669] Step 4:
[1670] The server notifies the administrator of the proposal.
[1671] Step 5:
[1672] The terminal displays the proposal to the administrator and prompts them to decide whether to implement it.
[1673] 6. Digitization of meeting information
[1674] Process flow:
[1675] Step 1:
[1676] During the meeting, the server collects audio data and notes.
[1677] Step 2:
[1678] Minutes are automatically generated based on the data collected by the server.
[1679] Step 3:
[1680] The server stores minutes and meeting contents on a secure server.
[1681] Step 4:
[1682] The server notifies the conference participants that the minutes have been saved.
[1683] Step 5:
[1684] The terminal displays a notification to the user, prompting them to confirm the meeting content.
[1685] 7. Information asset management function
[1686] Process flow:
[1687] Step 1:
[1688] The server centrally manages the decisions made at the meeting and related documents.
[1689] Step 2:
[1690] If a problem occurs during the project, the server references the meeting data and generates a recovery plan.
[1691] Step 3:
[1692] The server notifies relevant parties of the recovery plan and provides links to access related documents.
[1693] Step 4:
[1694] The device will display a notification to the user, prompting them to review the recovery plan and related documentation.
[1695] Step 5:
[1696] The user checks the recovery plan on the terminal and carries out the project recovery.
[1697] Example 1
[1698] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1699] Conventional conference facility management systems made reservation management cumbersome and required constant manual adjustments, making it difficult to secure optimal conference facilities and determine reservation priorities. Meeting content also had to be organized manually, which involved a lot of effort and errors. Furthermore, it was difficult to properly manage past usage data and meeting content and reflect it in future operations. This led to problems such as reduced meeting management efficiency and the risk of information leaks.
[1700] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.
[1701] In this invention, the server includes: means for searching for optimal conference facilities based on information entered by a user and automatically selecting and reserving them; means for analyzing past reservation data and conference importance information to determine whether to use physical facilities or online conferences and suggest the optimal choice; means for analyzing each user's reservation history, cancellation frequency, and rule violation record to set reservation priorities and restrictions based on their creditworthiness; means for monitoring the use of conference facilities in real time and notifying users on the waiting list in the event of a cancellation; means for automatically collecting audio and text data from conferences and generating and saving minutes; means for centrally managing meeting decisions and related documents and presenting project recovery plans. This improves the efficiency of conference facility reservations and management, reduces the risk of information leaks, and enables appropriate recovery plans to be presented quickly during projects.
[1702] An "interface" is a screen or means by which a user inputs information such as the date and time of a meeting and the number of participants.
[1703] A "server" is a computer system that searches for conference facilities based on information sent by users and finalizes reservations.
[1704] "Means for automatically selecting and confirming reservations" refers to a function that selects the most suitable conference facility based on the date, time and number of participants of the conference received by the server, and reserves that facility.
[1705] "Past reservation data" is historical information about conference reservations made by the user up to now.
[1706] "Meeting importance information" is information about the content and importance of a meeting, and is used to determine whether the meeting is held at a physical facility or online.
[1707] "Credit rating" is an evaluation value calculated based on a user's past reservation history, cancellation frequency, rule violation record, etc.
[1708] A "user waiting for a cancellation" is a user who is waiting for a cancellation to occur when a facility for a conference has already been reserved.
[1709] "Audio data" refers to audio information recorded during a conference.
[1710] "Text data" refers to documents and character information created during a meeting.
[1711] "Minutes" are a record of what was discussed during a meeting.
[1712] "Related documents" are materials used at the meeting and related documents.
[1713] A "recovery plan" is a solution that is formulated based on past meeting data when a problem occurs during the project.
[1714] This invention relates to a conference facility management system that uses AI technology and comprehensively manages everything from conference reservations to operation and information management. This system is composed of users, terminals, and a server, and provides the following main functions: conference reception, reservation arrangement, user pattern analysis, usage status assessment, conference pattern analysis and operation support, conference information digitization, and information asset management.
[1715] Overall system overview
[1716] The system configuration is as follows:
[1717] 1. A terminal that provides an interface for users to enter the date, time, and number of people for a meeting.
[1718] 2. A server that searches, selects, and reserves conference facilities based on information input from the terminal.
[1719] 3. A function in which the server returns reservation results and suggestions to the terminal and notifies the user.
[1720] 1. Meeting reception function
[1721] The user uses the device's interface to input the "date and time" and "number of people" for the meeting. For example, "October 15th, 14:00-15:00, 10 people." The device then sends this information to the server. Based on the received information, the server searches a database for available conference facilities, automatically selects the most suitable facility, and confirms the reservation. The server then returns the reservation results to the device and displays a "reservation complete" notification to the user.
[1722] 2. Reservation arrangement function
[1723] When a user enters details of a meeting (e.g., "important meeting"), the device sends this information to the server. The server analyzes past reservation data and meeting importance information to determine whether a physical conference facility is necessary or an online meeting is better. It then proposes the best option and notifies the user. The user then reviews the proposal and makes a final decision.
[1724] 3. User pattern analysis
[1725] The server analyzes each user's past reservation history, cancellation frequency, rule violation record, etc. to calculate their credit rating. Based on this credit rating, it sets priorities and restrictions for new reservations. For example, the terminal may receive a notification saying, "User A's credit rating is low, so reservations have been restricted."
[1726] 4. Understanding usage status
[1727] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. For example, a user on the waiting list might be notified that "Conference facility B has been canceled from 14:00 to 15:00."
[1728] 5. Meeting pattern analysis and management support
[1729] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities). The proposals are then notified to the administrator.
[1730] 6. Digitization of meeting information
[1731] During the meeting, the server automatically collects audio and text data and generates minutes. This information is stored on a secure server, and participants are notified that the minutes have been saved.
[1732] 7. Information asset management function
[1733] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server refers to the meeting data and presents an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[1734] Examples of prompt statements
[1735] Here are some examples of prompts to input to a generative AI model:
[1736] "Please explain in detail how information is exchanged between the user and the server in a conference reservation system. Please include specific processing steps and examples of how it works."
[1737] A system with the above-described configuration and functions will streamline the reservation and operation of conference facilities, reduce the risk of information leaks, and enable the prompt presentation of appropriate recovery plans while a project is underway.
[1738] The flow of the identification process in the first embodiment will be described with reference to FIG.
[1739] Meeting reception function
[1740] Step 1:
[1741] The user enters the date, time, and number of people attending the meeting.
[1742] Input: The user uses the terminal interface to input the "date and time" and "number of people." For example, the user inputs "October 15th, 14:00-15:00, number of people: 10."
[1743] Output: The conference information entered by the user is sent to the terminal.
[1744] Specific operation: The user enters the "date and time" and "number of people" and clicks the "reserve" button on the terminal.
[1745] Step 2:
[1746] The device sends the user's input information to the server
[1747] Input: User-entered meeting information.
[1748] Output: The terminal sends the user's input information to the server.
[1749] Specific operation: The terminal sends the conference information to the server, and the server receives the information.
[1750] Step 3:
[1751] The server searches for the best meeting room
[1752] Input: The "date and time" and "number of people" information of the meeting received by the server.
[1753] Data Processing: The server searches the database for available conference rooms and finds the one that best matches the entered criteria.
[1754] Output: Best meeting room information.
[1755] Specific operation: The server searches for meeting rooms that meet the conditions and executes an algorithm to select candidates.
[1756] Step 4:
[1757] The server reserves the conference room and returns the reservation result to the terminal.
[1758] Input: Best meeting room information.
[1759] Output: Confirmation of reservation information is returned to the terminal.
[1760] Specific operation: The server reserves the selected conference room and notifies the terminal of the result.
[1761] Step 5:
[1762] The terminal notifies the user of the reservation result.
[1763] Input: Confirmed booking information returned from the server.
[1764] Output: The device displays a "Reservation Complete" notification on the screen.
[1765] Specific operation: The terminal displays to the user, "Conference room reservation for October 15th, 14:00-15:00 has been completed."
[1766] Reservation arrangement function
[1767] Step 1:
[1768] User enters meeting reservation details
[1769] Input: Details of the meeting, for example, "Important Meeting".
[1770] Output: Detailed information is typed into the terminal.
[1771] Specific operation: The user enters the meeting details into the device interface and clicks the "Accept Proposal" button.
[1772] Step 2:
[1773] The device sends the input information to the server
[1774] Input: The meeting details entered by the user.
[1775] Output: The device sends information to the server.
[1776] Specific operation: The terminal sends detailed information about the meeting to the server, and the server receives the information.
[1777] Step 3:
[1778] The server analyzes past data
[1779] Input: Historical booking data and meeting importance information.
[1780] Data processing: The server performs analysis based on past data to determine whether the meeting will take place in a physical facility or online.
[1781] Output: Analysis results.
[1782] Specific operation: The server analyzes past data and generates a list of options.
[1783] Step 4:
[1784] The server will suggest the best reservation method
[1785] Input: Analysis results.
[1786] Output: Optimal booking method suggestions.
[1787] Specific operation: The server creates a proposal such as "Physical meeting facilities are needed" and sends it to the terminal.
[1788] Step 5:
[1789] The device notifies the user of the suggestion
[1790] Input: Suggestion from the server.
[1791] Output: The proposal is displayed on the screen.
[1792] What happens: The device displays a suggestion to the user, such as "Physical meeting room recommended."
[1793] Step 6:
[1794] The user reviews the proposal and makes a final decision
[1795] Input: User actions when reviewing server suggestions.
[1796] Output: The final decision is entered into the terminal and sent to the server.
[1797] What happens: The user reviews the suggestions and clicks a button to make a final decision and submit their input.
[1798] User pattern analysis
[1799] Step 1:
[1800] A user enters a new reservation
[1801] Input: Booking information for the new meeting.
[1802] Output: Reservation information is entered into the terminal.
[1803] Specific operation: The user enters new reservation information into the terminal and clicks the "Confirm reservation" button.
[1804] Step 2:
[1805] The device sends the information to the server
[1806] Input: New reservation information.
[1807] Output: The device sends information to the server.
[1808] Specific operation: The terminal sends conference reservation information to the server, and the server receives the information.
[1809] Step 3:
[1810] The server analyzes past data
[1811] Input: Each user's past booking history, cancellation frequency, and rule violation records.
[1812] Data processing: The server calculates the user's creditworthiness based on this data.
[1813] Output: Credit score.
[1814] Specific operation: The server scans past data and makes an evaluation based on each item.
[1815] Step 4:
[1816] The server evaluates the user's trustworthiness
[1817] Input: Credit score calculation result
[1818] Output: The user's credit rating.
[1819] Specific operation: The server aggregates the evaluation results and calculates the overall credibility.
[1820] Step 5:
[1821] The server sets reservation priorities and limits
[1822] Input: The user's credit rating.
[1823] Output: Priority and limit settings.
[1824] What it does: The server applies rules that prioritize and limit requests based on their trustworthiness.
[1825] Step 6:
[1826] The device notifies the user of the results.
[1827] Input: Server configuration results.
[1828] Output: Notification display.
[1829] Specific behavior: The device displays a notification to the user, such as "Reservations have been restricted."
[1830] Understanding usage status
[1831] Step 1:
[1832] The server monitors the usage of conference facilities
[1833] Input: Facility usage data.
[1834] Output: Real-time usage.
[1835] Specific operation: The server periodically runs a program that checks the database and updates usage status.
[1836] Step 2:
[1837] The server detects the cancellation of the reservation
[1838] Input: Reservation cancellation information.
[1839] Output: Prepare to notify users on the waiting list.
[1840] Specific operation: The server checks the reservation data, and if a cancellation occurs, obtains information about users on the waiting list based on that information.
[1841] Step 3:
[1842] The server sends notifications to the waiting list users
[1843] Input: Cancellation information and waiting list user information.
[1844] Output: Notification content.
[1845] Specific operation: The server sends a notification to users on the waiting list. It creates and sends a notification such as "Conference facility B has been canceled from 14:00 to 15:00."
[1846] Step 4:
[1847] The device displays the notification to the user
[1848] Input: Notification data from the server.
[1849] Output: A notification is displayed to the user.
[1850] Specific operation: The device displays a notification to the user such as "Facility B from 14:00 to 15:00 has been canceled."
[1851] Meeting pattern analysis and management support
[1852] Step 1:
[1853] The server collects data on meeting facilities
[1854] Input: Data such as past usage frequency, number of people, time of day, etc.
[1855] Data processing: Data collection.
[1856] Output: Collected data.
[1857] Specific operation: The server periodically collects system usage data and stores it in a database.
[1858] Step 2:
[1859] The server analyzes the collected data
[1860] Input: Collected data.
[1861] Data processing: Data analysis.
[1862] Output: Analysis results.
[1863] What it does: The server runs data analysis algorithms to generate insights that indicate whether changes to capacity or the addition of new facilities are needed.
[1864] Step 3:
[1865] The server proposes the operation method
[1866] Input: Analysis results.
[1867] Output: Proposal.
[1868] Specific operation: The server generates a proposal and notifies the administrator, sending a message such as "Conference facility C is being used frequently, so we propose increasing the capacity from 15 to 20 people."
[1869] Step 4:
[1870] The device notifies the administrator of the proposed action.
[1871] Input: Suggestion from the server.
[1872] Output: Notification displayed to administrator.
[1873] Specific operation: The device displays the suggestions on the screen.
[1874] Digitization of meeting information
[1875] Step 1:
[1876] The server collects audio and text data during the meeting.
[1877] Input: Voice and text data collected in real time during the meeting.
[1878] Data processing: Recording audio data and generating text data.
[1879] Output: Collected data.
[1880] Specific operation: The server collects data during the meeting in real time and prepares to store it on a secure server.
[1881] Step 2:
[1882] The server generates the minutes.
[1883] Input: Collected speech and text data.
[1884] Data processing: Converts audio data into text and automatically generates minutes.
[1885] Output: The generated transcript.
[1886] Specific operation: The server converts the collected voice data into text, organizes the contents of the meeting, and generates minutes.
[1887] Step 3:
[1888] The server saves the minutes and notifies the participants.
[1889] Input: Generated minutes.
[1890] Output: Notifications to participants and an access link to the saved minutes.
[1891] Specific operation: The server saves the minutes on a secure server and sends a notification to the participants that the minutes have been saved.
[1892] Step 4:
[1893] The device displays a notification to the participant
[1894] Input: Notification data from the server.
[1895] Output: Notification display to participants.
[1896] Specific behavior: The device displays a notification to participants, such as "Minutes have been saved."
[1897] Information asset management function
[1898] Step 1:
[1899] The server manages meeting decisions and related documents.
[1900] Input: Decisions made at the meeting and related documents.
[1901] Data processing: Centralized data management.
[1902] Output: Managed information.
[1903] Specific operation: The server performs database operations to centrally manage the agenda decided at the meeting and related documents.
[1904] Step 2:
[1905] Server detects problems during project execution
[1906] Input: Project progress data.
[1907] Data processing: Identifying the problem.
[1908] Output: Problem detection information.
[1909] What it does: The server monitors the progress of the project and detects problems as they occur.
[1910] Step 3:
[1911] The server generates a recovery plan
[1912] Input: Meeting data and project issue detection information.
[1913] Output: The generated recovery plan.
[1914] Specific operation: The server references past conference data and automatically generates an appropriate recovery plan.
[1915] Step 4:
[1916] The server notifies the relevant parties of the recovery plan
[1917] Input: The generated recovery plan.
[1918] Output: Notification and access link to interested parties.
[1919] Specific operation: The server sends the details of the recovery plan and access links to related documents to the relevant parties.
[1920] Step 5:
[1921] The device displays a notification to the relevant person.
[1922] Input: Notification data from the server.
[1923] Output: Notification displayed to relevant parties.
[1924] Specific operation: The device displays a notification to the relevant parties, such as "A recovery plan has been generated."
[1925] (Application example 1)
[1926] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[1927] Manual scheduling and management of meetings and discussions held within factories can be inefficient and lead to reduced productivity. In addition, incomplete management of meeting information and delayed response to cancellations can have a negative impact on the operation of the entire factory. Furthermore, insufficient recording and sharing of meeting content can cause problems in the progress of projects. The goal is to solve these problems and improve the efficiency of factory meetings and thorough information management.
[1928] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.
[1929] In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a meeting; a means for automatically selecting and reserving the most suitable meeting facility based on the input information; a means for adjusting reservations, including the use of online meetings, based on the importance of the meeting; a means for analyzing the reservation patterns of multiple users and managing reservations based on their trustworthiness; a means for understanding the usage status of meeting facilities in real time and notifying in the event of a cancellation; a means for automatically digitizing and saving the contents of the meeting; a means for centrally managing information assets determined in the meeting and supporting project recovery; a means for controlling factory robots that reserve and manage meetings within the factory and provide the most suitable meeting space; and a means for analyzing audio information, automatically generating minutes, and saving them in a secure database. This automates the scheduling and management of factory meetings, improves productivity, and enables thorough information management.
[1930] "Means for accepting meetings" is a function that provides an interface for inputting and managing the date, time, and number of people for a meeting.
[1931] "Means for making reservations based on input information" refers to a function that automatically selects the most suitable conference facility based on the information input by the user and confirms the reservation.
[1932] "Means for adjusting reservations" is a function that optimizes the use of physical conference rooms and online meetings by taking into account factors such as the importance of the meeting.
[1933] "Means for analyzing and managing reservation patterns" refers to a function that sets priorities and restrictions on user reservations based on past usage data and creditworthiness.
[1934] "Means for understanding usage status" refers to a function that monitors the current status of conference facilities in real time and responds quickly to any changes or cancellations to reservations.
[1935] "Means for automatically converting content into data and saving it" refers to a function that automatically collects audio and text information during a meeting and saves it in a database as minutes.
[1936] "A means of centrally managing information assets" is a function that consolidates and manages matters decided in meetings and related documents, and helps deal with problems as the project progresses.
[1937] "Means for controlling factory robots" refers to the function of instructing and managing robots to schedule and manage meetings within a factory.
[1938] "Means for analyzing audio information and automatically generating minutes" is a function that analyzes audio data collected during a meeting, automatically generates minutes, and stores them in a secure database.
[1939] This invention is a system for improving the efficiency of booking, running, and information management of meetings within a factory, and includes a reception means for inputting the date, time, and number of participants of a meeting, a reservation adjustment means based on the importance of the meeting, a reservation pattern analysis means, a usage status understanding means, a means for digitizing the contents of the meeting, an information asset management means, a factory robot control means, and a means for analyzing audio information and automatically generating minutes of the meeting.
[1940] Hardware and Software Configuration
[1941] This system uses the following hardware and software:
[1942] Hardware: Robots for factory navigation and meeting room management (e.g., robots powered by Raspberry Pi or NVIDIA Jetson Nano)
[1943] Software: The main components running on the server side include a Python program and an SQLite database.
[1944] Meeting reservation method
[1945] The server provides an interface on the terminal for entering the date, time, and number of people for the meeting. When the user enters the date, time, and number of people for the meeting, the information is sent to the server. The server automatically selects the most suitable conference facility based on the received information and confirms the reservation. This allows users to efficiently reserve meetings.
[1946] A method for adjusting reservations based on the importance of meetings
[1947] The server analyzes past reservation data and meeting importance information to determine whether to secure a physical facility or use an online meeting. If a user reserves an important meeting, the server will suggest whether a physical meeting facility would be more suitable and notify the user on their device.
[1948] A means to analyze and manage booking patterns
[1949] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a new reservation is entered, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results. This function ensures fairness in reservations.
[1950] Means of understanding usage status
[1951] The server monitors the usage status of conference facilities in real time, and if a reservation is changed or canceled, it immediately updates the information and notifies users on the waiting list, thereby improving the efficiency of facility usage.
[1952] How to digitize meeting content
[1953] The server automatically collects audio and text data during the meeting and generates minutes. This information is stored on a secure server and notifications are sent to participants, who can then refer to the data later.
[1954] A means of centrally managing information assets
[1955] The server centrally manages the decisions made in meetings and related documents, and if a problem occurs during the project, it uses the meeting data to present an appropriate recovery plan, sends notifications to stakeholders, and provides access links to related documents, ensuring the smooth progress of the project.
[1956] Control methods for factory robots
[1957] The server instructs and manages the robots to reserve and manage meetings within the factory. The robots then make the necessary preparations to provide the optimal meeting space. This automates the management of meetings within the factory.
[1958] Analysis of audio information and automatic generation of minutes
[1959] The server analyzes the audio data collected during the meeting, automatically generates minutes, and stores them in a secure database, simplifying the recording of meeting content.
[1960] Examples of concrete examples and prompts
[1961] For example, if a user inputs "Hold a meeting with 10 people on 2023-10-15 at 14:00," the server will reserve the most suitable conference room and, if necessary, instruct the robot to prepare for it. Furthermore, minutes of the meeting will be automatically generated based on the voice data, and can be referenced later.
[1962] Example prompts to input to the generative AI model:
[1963] Write a Python program for a factory robot that accepts reservations for meetings. The user inputs the date, time, and number of people, and the robot reserves the most suitable conference room. There are three conference rooms: "RoomA" (capacity 20 people), "RoomB" (capacity 10 people), and "RoomC" (capacity 30 people), and the reservation status is managed using a dictionary. No database is used.
[1964] This will automate the scheduling and management of factory meetings, improving productivity and ensuring thorough information management.
[1965] The flow of the specific processing in the application example 1 will be described with reference to FIG.
[1966] Step 1:
[1967] The user inputs the date and time of the meeting and the number of participants. The user inputs "2023-10-15 14:00, 10 participants" into the terminal interface and presses the reservation button. The input information is sent from the terminal to the server. The input data is the date, start time, and number of participants of the meeting.
[1968] Step 2:
[1969] The server searches for the most suitable conference facility based on the received information. From the list of registered conference rooms, the server searches for a conference room that is available on the specified date and time and can accommodate the number of participants. The server has a database of conference room capacities and reservation status. The server confirms that "Room B (capacity 10 people)" is available and selects it as the most suitable conference room.
[1970] Step 3:
[1971] The server confirms the reservation for the selected conference room and saves it in the database. The server adds "2023-10-15 14:00-15:00, Room B reservation" to the reservation information database. After the reservation is confirmed, the server sends a notification of reservation completion to the terminal.
[1972] Step 4:
[1973] The terminal displays a notification to the user that the reservation is complete. Upon receiving the notification from the server, the terminal displays the message "Conference room RoomB has been reserved from 14:00 to 15:00 on 2023-10-15."
[1974] Step 5:
[1975] The server adjusts reservations, including the use of online meetings, based on the importance of the meeting. When a user sets the importance of a meeting, the server analyzes past data and, if necessary, determines whether a physical conference room or an online meeting is more appropriate, and makes a recommendation. For example, the server may determine that "based on past data, a physical conference room is necessary" and notify the user of the result.
[1976] Step 6:
[1977] The server analyzes the reservation patterns of multiple users and manages reservations based on their creditworthiness. The server analyzes past reservation history, cancellation frequency, and rule violation records to evaluate creditworthiness. When a new reservation is entered, the server sets reservation priorities and restrictions based on the user's creditworthiness information.
[1978] Step 7:
[1979] The server monitors the availability of conference facilities in real time, immediately updates the information when a cancellation occurs, and automatically notifies users on the waiting list. When a cancellation occurs, the server updates the conference facility reservation information database and notifies relevant users based on the waiting list.
[1980] Step 8:
[1981] During the meeting, the server collects voice data and automatically generates minutes, which are then stored in a secure database. The server uses speech recognition technology to convert the conversations during the meeting into text data, formatting the data into minutes and storing it in the database. After the meeting ends, a notification is sent to participants informing them that the minutes have been saved.
[1982] Step 9:
[1983] The server centralizes the management of information assets decided in meetings and supports project recovery. If a problem occurs during the project, the server references related meeting data and generates an appropriate recovery plan. It notifies the relevant parties of the plan and provides access links to the necessary documents.
[1984] Step 10:
[1985] The factory robot prepares for the meeting. The server issues instructions to the factory robot to prepare the reserved conference room. The robot prepares the conference room and arranges materials, ensuring that the meeting starts smoothly.
[1986] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.
[1987] This invention is a conference facility management system that uses AI technology to comprehensively manage everything from conference reservations to operation and information management, and also optimizes the conference experience by recognizing user emotions. This system is composed of users, terminals, a server, and an emotion engine.
[1988] Overall system overview
[1989] The system provides the following main functions:
[1990] 1. Meeting reception function
[1991] 2. Reservation arrangement function
[1992] 3. User pattern analysis
[1993] 4. Understanding usage status
[1994] 5. Meeting pattern analysis and management support
[1995] 6. Digitization of meeting information
[1996] 7. Information asset management function
[1997] 8. Emotion recognition function
[1998] 1. Meeting reception function
[1999] Embodiments:
[2000] The terminal provides an interface for the user to input the date, time, and number of people for the meeting. When the user inputs the information and presses the reservation button, the terminal sends this information to the server. Based on the received information, the server automatically selects the most suitable facility for the meeting and confirms the reservation. The terminal notifies the user that the reservation was successful.
[2001] Specific working example:
[2002] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server. The server searches for the most suitable meeting facility and confirms the reservation. The device displays a "Reservation Complete" notification to the user.
[2003] 2. Reservation arrangement function
[2004] Embodiments:
[2005] The server analyzes past reservation data and meeting importance information. When a user enters a reservation, the server determines whether to reserve a physical meeting facility or use an online meeting, and proposes the optimal choice. The device notifies the user of this proposal and prompts them to make a final decision.
[2006] Specific working example:
[2007] A user books an "important meeting." The device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed. The device displays this suggestion to the user.
[2008] 3. User pattern analysis
[2009] Embodiments:
[2010] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a user enters a new reservation, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results.
[2011] Specific working example:
[2012] User A enters a new reservation. The device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low." The device notifies the user that "reservations have been restricted."
[2013] 4. Understanding usage status
[2014] Embodiments:
[2015] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. The terminal receives the notification and displays it to the user.
[2016] Specific working example:
[2017] When a meeting is canceled, the server detects it and updates the usage database. Based on the waiting list, it notifies the waiting users that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal displays the notification.
[2018] 5. Meeting pattern analysis and management support
[2019] Embodiments:
[2020] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities) and notifies the administrator of the proposal.
[2021] Specific working example:
[2022] The server analyzes data from the past three months and notifies the administrator that "Conference facility C is being used frequently, so we suggest increasing the capacity from 15 to 20 people." The proposal is displayed on the administrator's device.
[2023] 6. Digitization of meeting information
[2024] Embodiments:
[2025] During the meeting, the server automatically collects audio and text data and generates minutes, which are then stored on a secure server and notified to participants.
[2026] Specific working example:
[2027] During the meeting, the server records audio data and automatically generates minutes. The minutes are saved on a secure server and a notification that "the minutes have been saved" is displayed on the participants' devices.
[2028] 7. Information asset management function
[2029] Embodiments:
[2030] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server uses the meeting data to present an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[2031] Specific working example:
[2032] A problem occurs during a project. The server references the meeting data and sends a notification that a recovery plan has been generated. The server also provides access links to related documents and sends a notification. The notification is displayed on the device.
[2033] 8. Emotion recognition function
[2034] Embodiments:
[2035] The system incorporates an emotion engine that recognizes users' emotions and collects emotional data during meetings. The server automatically records and saves the emotional data obtained from the emotion engine along with the meeting minutes. Furthermore, the emotional data is used to analyze the efficiency and productivity of meetings, and suggests rescheduling or environmental adjustments as necessary.
[2036] Specific working example:
[2037] During the meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting emotional state data. The server automatically saves this data along with the minutes. A notification is sent saying, "User's emotional data has been recorded." The server then sends suggestions for improving the meeting to the administrator based on the emotional data. The suggestions are displayed on the administrator's device.
[2038] In this way, the present invention is a system that not only streamlines the reservation and operation of conference facilities and reduces the risk of information leakage, but also analyzes user emotions to optimize the conference experience.
[2039] The processing flow will be explained below.
[2040] 8. Emotion recognition function
[2041] Process flow:
[2042] Step 1:
[2043] At the start of a conference, a user logs in through a terminal and connects to the conference facility or to an online conference.
[2044] Step 2:
[2045] The emotion engine collects emotional data such as the user's facial expressions and tone of voice in real time using sensors such as cameras and microphones.
[2046] Step 3:
[2047] The device transmits the collected emotion data to a server.
[2048] Step 4:
[2049] The server analyzes the received emotional data and determines the user's emotional state (e.g., stress, satisfaction, concentration, etc.).
[2050] Step 5:
[2051] The server automatically records and saves the analyzed emotional data along with the meeting minutes.
[2052] Step 6:
[2053] The server evaluates the efficiency and productivity of the meeting based on emotional data, and if necessary, suggests rescheduling the meeting or switching to an online meeting.
[2054] Step 7:
[2055] The server notifies the administrator of the emotion data and suggestions for improving the meeting. The terminal displays this information to the administrator.
[2056] Specific working example:
[2057] 1. The user arrives at the conference facility at 10:00 and logs in to the conference via a terminal. The emotion engine is automatically activated.
[2058] 2. While the meeting is in progress, the emotion engine recognizes the user's face with a camera and collects the user's voice tone with a microphone. For example, if the user's facial expression is stern, it is interpreted as irritation, and if the user's voice tone is high, it is interpreted as tension.
[2059] 3. The device sequentially transmits the collected emotion data to the server, which receives it in real time.
[2060] 4. The server analyzes the emotional data and determines the user's emotional state. For example, it determines that more than half of the participants are in a stressful state.
[2061] 5. The server automatically generates meeting minutes based on the emotional data and stores them in secure storage. This includes information such as "Many of the participants felt stressed during the meeting."
[2062] 6. The server analyzes the emotion data and generates adjustment suggestions such as, "The current meeting is running behind schedule, so let's start the next meeting five minutes later."
[2063] 7. The server notifies the administrator of the adjustment proposal and details of the emotion data. The administrator's device displays a notification saying, "Participants are feeling stressed in the current meeting, so we suggest taking a break."
[2064] In this way, the present invention, which combines emotion recognition functionality, is a system that not only streamlines the reservation and management of conference facilities and reduces the risk of information leakage, but also analyzes user emotions to optimize the conference experience.
[2065] Example 2
[2066] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2067] Conventional meeting management systems often lack efficiency and do not fully optimize meetings because reservations, management, and information management are handled separately. Furthermore, they lack the ability to analyze user sentiment, limiting their ability to improve the quality and efficiency of communication during meetings. As a result, problems often arise related to meeting progress and the risk of information leaks.
[2068] The identification processing by the identification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a conference; a means for automatically selecting and reserving the optimal conference facility based on the input information; a means for adjusting reservations, including the use of online conferences, based on the importance of the conference; a means for analyzing the reservation patterns of multiple users and managing reservations based on their trustworthiness; a means for understanding the utilization status of conference facilities in real time and notifying users in the event of cancellations; a means for automatically digitizing and saving the contents of the conference; a means for centrally managing information assets determined in the conference and supporting project recovery; and a means for analyzing the efficiency and productivity of the conference based on emotion data acquired by an emotion engine and making improvement suggestions. This significantly improves the efficiency of conference management, reduces the risk of information leaks, and optimizes the conference experience by analyzing user emotions.
[2069] The "reception means" is an interface for inputting the date and time of the meeting and the number of people, and is a device or system that allows the user to input information about the meeting.
[2070] A "reservation means" is a device or system that automatically selects and reserves the most suitable conference facility based on input information.
[2071] The "reservation adjustment means" is a device or system for adjusting reservations, including the use of online conferences, based on the importance of the conference.
[2072] The "credit management means" is a device or system for analyzing the reservation patterns of multiple users and managing reservations based on their credit scores.
[2073] The "usage status monitoring means" is a device or system that monitors the usage status of conference facilities in real time and notifies users in the event of a cancellation.
[2074] The "digitization means" is a device or system for automatically digitizing and saving the contents of a conference.
[2075] "Information asset management means" refers to a device or system that centrally manages the information assets decided at the meeting and supports project recovery.
[2076] The "emotion data analysis means" is a device or system that analyzes the efficiency and productivity of a meeting based on the emotion data acquired by the emotion engine and makes suggestions for improvement.
[2077] An "emotion engine" is a device or software that analyzes a user's facial expressions and tone of voice to collect emotional data.
[2078] An "online conference tool" is a device or software that supports conferences conducted over the Internet.
[2079] This invention is a conference facility management system that utilizes AI technology to comprehensively manage conference reservations, operations, information management, and user emotion recognition. The system consists of users, terminals, a server, and an emotion engine.
[2080] System configuration and operation
[2081] 1. Reception method
[2082] The user inputs the date and time of the meeting and the number of people through the terminal interface.
[2083] The terminal transmits the input information to the server.
[2084] Examples:
[2085] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server.
[2086] 2. Reservation Method
[2087] The server automatically selects the most suitable conference venue based on the received information.
[2088] The server confirms the reservation and transmits the result to the terminal.
[2089] The terminal displays a notification to the user that the reservation is complete.
[2090] Examples:
[2091] The server searches for the most suitable conference facility and confirms the reservation. The terminal displays a "reservation completed" notification to the user.
[2092] 3. Reservation Adjustment Methods
[2093] The user inputs the importance of the conference and the desired reservation details into the terminal.
[2094] The terminal transmits the information to the server.
[2095] The server analyzes past reservation data and the importance of the meeting to determine whether a physical conference facility is necessary or whether an online meeting is appropriate.
[2096] The server proposes the best choice and sends the result to the terminal.
[2097] The device will notify the user of the proposal and prompt them to make a final decision.
[2098] Examples:
[2099] A user enters an "important meeting" as a reservation into a device. The device sends this information to a server. The server analyzes past meeting data and determines that a physical meeting facility is required. The device displays this suggestion to the user and prompts for confirmation.
[2100] 4. Credit management measures
[2101] The server analyzes the user's past reservation history, cancellation frequency, rule violations, etc. to evaluate their trustworthiness.
[2102] When a user enters a new reservation, the terminal sends the information to the server.
[2103] The server sets reservation priorities and limits based on the user's creditworthiness.
[2104] The server sends the result to the terminal, which notifies the user.
[2105] Examples:
[2106] User A enters a new reservation. The device sends the information to the server. The server determines that "User A's credibility is low" based on past data. The device notifies the user that "reservations have been restricted."
[2107] 5. Usage Monitoring Methods
[2108] The server monitors the availability of conference facilities in real time.
[2109] The server automatically sends a notification to users on the waiting list when a reservation is canceled.
[2110] The terminal receives the notification and displays it to the user.
[2111] Examples:
[2112] When a meeting is canceled, the server immediately detects it and updates the usage database. The server notifies the waiting user that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal receives the notification and displays it to the user.
[2113] 6. Data Collection Methods
[2114] The server automatically collects audio and text data during the conference.
[2115] The server generates minutes based on the collected information and stores them securely.
[2116] The server notifies the participants of the generated minutes.
[2117] The device receives the notification and displays it to the participants.
[2118] Examples:
[2119] During the meeting, the server records audio data and automatically generates minutes. The server securely stores the minutes and notifies participants that the minutes have been saved. The device receives the notification and displays it to the participants.
[2120] 7. Information Asset Management Measures
[2121] The server centrally manages the decisions made at the meeting and related documents.
[2122] If a problem occurs during the project, the server will present an appropriate recovery plan based on the meeting data.
[2123] The server notifies the relevant parties of the access links to the recovery plan and related documents.
[2124] The device displays a notification.
[2125] Examples:
[2126] When a problem occurs during a project, the server references the meeting data and notifies the user that a recovery plan has been generated. The server then sends a notification providing access links to related documents. The device then displays a notification containing related links.
[2127] 8. Sentiment Data Analysis Methods
[2128] The emotion engine analyzes users' facial expressions and tone of voice during meetings to collect emotional data.
[2129] The server automatically stores the emotion data along with the minutes.
[2130] The server analyzes the efficiency and productivity of meetings based on the emotional data and sends improvement suggestions to the administrator as needed.
[2131] The terminal displays the proposed content to the administrator.
[2132] Examples:
[2133] During a meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting data on their emotional state. The server automatically saves this data along with the minutes. The server then sends "suggestions for improving the meeting" to the administrator based on the emotion data. The device then displays the suggestions to the administrator.
[2134] Prompt Sentence Examples
[2135] "I would like to reserve a conference room for 10 people from 2:00 PM to 3:00 PM on October 15th."
[2136] "I have an important meeting and would like to know if I need a physical conference facility."
[2137] This invention is a system that not only makes meetings more efficient and reduces the risk of information leaks, but also analyzes users' emotions to optimize the meeting experience.
[2138] The flow of the identification process in the second embodiment will be described with reference to FIG.
[2139] Step 1:
[2140] (Reception processing)
[2141] User: Enter the date, time and number of people for the meeting.
[2142] Terminal: Receives the meeting date and time and number of participants entered by the user.
[2143] Input: Information entered by the user: "October 15th, 14:00-15:00, 10 people."
[2144] Output: Sends the entered conference information to the server.
[2145] Specific operation: The user enters "October 15th, 14:00-15:00, number of people: 10", and the device sends this information to the server.
[2146] Step 2:
[2147] (Reservation processing)
[2148] Server: Automatically selects the most suitable conference facility based on the received conference information.
[2149] Input: Meeting information sent from the device (date, time and number of people).
[2150] Data processing: Matching the availability of conference facilities with requirements and selecting the most suitable facility, for example, querying the availability database to list relevant facilities.
[2151] Output: Confirmed reservation of the best meeting venue.
[2152] Terminal: Notifies the user that the reservation is complete.
[2153] Specific operation: The server searches for the most suitable conference facility, confirms the reservation, and the terminal displays a "reservation completed" notification to the user.
[2154] Step 3:
[2155] (Reservation adjustment process)
[2156] User: Enter the importance of the meeting and the desired reservation details.
[2157] Terminal: Receives the importance of the meeting and the desired reservation details, and sends them to the server.
[2158] Server: Analyzes past reservation data and meeting importance information.
[2159] Input: Meeting information and past reservation data sent from the device.
[2160] Data analysis: Algorithms that reference a meeting database to determine whether a physical meeting facility is necessary or whether an online meeting is appropriate prioritize physical facilities for more important meetings.
[2161] Output: What is the best meeting format (physical or online) and why?
[2162] Terminal: Notifies the user of the proposal and prompts them to make a final decision.
[2163] How it works: A user enters a reservation for an "important meeting," and the device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed, and the device displays this suggestion to the user.
[2164] Step 4:
[2165] (Credit Management Processing)
[2166] Server: Analyzes the user's past reservation history, cancellation frequency, and rule violations to evaluate their creditworthiness.
[2167] Input: User's booking history, cancellation frequency, and rule violation data.
[2168] Data analysis: Apply a scoring algorithm to assess a user's creditworthiness. For example, if they cancel frequently, the score will be lowered.
[2169] Output: The estimated credit score.
[2170] Terminal: When a user enters a new reservation, the results are displayed, prioritizing and limiting the reservation based on creditworthiness.
[2171] Specific operation: User A enters a new reservation, and the device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low," and the device notifies the user that "reservations have been restricted."
[2172] Step 5:
[2173] (Usage status monitoring process)
[2174] Server: Monitors the availability of conference facilities in real time.
[2175] Input: Real-time facility usage data.
[2176] Data monitoring: Monitors the usage of conference facilities and immediately detects any changes. For example, if a reservation is canceled, that information is reflected in the waiting list.
[2177] Output: Notification information about the cancellation.
[2178] Server: When a reservation is canceled, users on the waiting list are automatically notified.
[2179] Terminal: Receives notifications and displays them to the user.
[2180] Specific operation: When a meeting is canceled, the server detects it and updates the usage database. Based on the cancellation waiting list, the server notifies the waiting user that "Facility B for the meeting has been canceled from 14:00 to 15:00," and the terminal displays this.
[2181] Step 6:
[2182] (Data processing)
[2183] Server: Automatically collects audio and text data during the meeting.
[2184] Input: Audio and text data during the meeting.
[2185] Data processing: Converting voice data into text and generating meeting minutes in an appended format. For example, using speech recognition technology to automatically transcribe meeting content into text.
[2186] Output: Auto-generated meeting minutes text.
[2187] Server: Generates minutes based on the collected information and stores them securely.
[2188] Server: Notifies participants of the generated minutes.
[2189] Device: Receives notifications and displays them to participants.
[2190] Specific operation: The server records audio data during the meeting and automatically generates minutes. The server securely saves the minutes, notifies participants that the minutes have been saved, and the device displays a notification to the participants.
[2191] Step 7:
[2192] (Information Asset Management Processing)
[2193] Server: Centrally manages the decisions made at meetings and related documents.
[2194] Input: Decisions made at the meeting and related documents.
[2195] Data management: Decisions made at meetings and related documents are stored in a centralized database. For example, resolutions and related files are aggregated in a project folder.
[2196] Output: Centralized meeting content and related documents.
[2197] Server: If a problem occurs during the project, it will present an appropriate recovery plan based on the meeting data.
[2198] Server: Notifies relevant parties of the recovery plan and access links to related documents.
[2199] Device: Show notifications.
[2200] Specific operation: When a problem occurs during a project, the server references the meeting data and notifies the user that a recovery plan has been generated. The server provides an access link to the relevant document, and the device displays the notification.
[2201] Step 8:
[2202] (Emotion data analysis processing)
[2203] Emotion Engine: Collects emotional data by analyzing the user's facial expressions and tone of voice during the meeting.
[2204] Input: Facial expression data and tone of voice data of users during the meeting.
[2205] Data analysis: Analyze the user's emotional state using an emotion engine, for example, identify emotions based on facial expression recognition and voice analysis.
[2206] Output: Parsed emotion data.
[2207] Server: Emotion data is automatically saved along with the minutes.
[2208] Server: Analyzes the efficiency and productivity of meetings based on emotional data and sends improvement suggestions to the administrator as needed.
[2209] Terminal: Display the proposal to the administrator.
[2210] How it works: During a meeting, the emotion engine analyzes the user's facial expressions and tone of voice, collecting data on their emotional state. The server automatically saves this data along with the minutes, and sends "suggestions for improving the meeting" to the administrator based on the emotion data, which are then displayed on the device.
[2211] (Application example 2)
[2212] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."
[2213] Conventional conference facility management systems are designed solely to streamline conference reservations and management, leaving out important features such as security monitoring during the conference and monitoring of participants' emotions. This makes it difficult to immediately respond to abnormal behavior during a conference, potentially leading to security issues and participant stress. Furthermore, the lack of a system that integrates these features makes centralized management difficult. Therefore, there is a need for a comprehensive system that ensures security during a conference and also takes into account the emotional state of participants.
[2214] The identification processing by the identification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: a reception means for inputting the date, time, and number of participants of a conference; a means for automatically selecting and reserving the optimal conference facility based on the input information; a means for adjusting reservations, including the use of online conferences, based on the importance of the conference; a means for analyzing the reservation patterns of multiple users and managing reservations based on their credit ratings; a means for understanding the utilization status of conference facilities in real time and notifying users in the event of cancellations; a means for automatically digitizing and saving the contents of the conference; a means for centrally managing information assets determined in the conference and supporting project recovery; a means for automatically starting security monitoring at the start of a reserved conference; a means for monitoring users' emotions in real time during the conference and detecting abnormal behavior; and a means for sending notifications based on detected abnormal behavior and enhancing security. This improves the efficiency of conference reservations and management, integrates security monitoring and emotion monitoring, and enables rapid response to abnormal behavior during the conference.
[2215] The "reception means" is a device or software that provides an interface for inputting the date and time of the meeting and the number of participants.
[2216] A "reservation means" is a device or software that automatically selects the most suitable conference facility based on input information and reserves that facility.
[2217] The "means for adjusting reservations" refers to devices or software for adjusting reservations, including the use of online meetings, based on the importance of the meetings.
[2218] A "means for managing reservations" is a device or software that analyzes the reservation patterns of multiple users and sets reservation priorities and limits based on creditworthiness.
[2219] "Means for notifying in the event of a cancellation" refers to devices or software that monitor the usage status of conference facilities in real time and notify users when their reservations are canceled.
[2220] "Means for digitizing and saving" refers to devices or software that automatically collect meeting content as audio or text data, generate minutes, and save them.
[2221] "Means to support recovery" refers to devices or software that centrally manage information assets decided in meetings and, if a problem occurs during the project, use the meeting data as a reference to present an appropriate recovery plan.
[2222] The "means for starting security monitoring" refers to a device or software for automatically starting the security monitoring function at the start of a scheduled conference.
[2223] "Means for detecting abnormal behavior" refers to devices or software that monitor users' emotions in real time during a meeting and detect abnormal behavior.
[2224] "Means for sending notifications and enhancing security" refers to devices or software that send notifications in real time based on detected abnormal behavior and enhance security.
[2225] This invention is a conference facility management system equipped with security functions using AI technology. An embodiment of the system that realizes this application example is described below.
[2226] Overall system configuration
[2227] The system consists of a user terminal, a server, and an emotion engine, and comprehensively manages everything from conference reservations to operation, information management, and security monitoring.
[2228] Hardware and software used
[2229] Hardware: Smartphones, tablets, smart glasses
[2230] Software and Technology:
[2231] Camera and microphone: Used for image recognition and voice analysis.
[2232] Emotion Engine: Recognizes user emotions in real time.
[2233] Firebase: Used for real-time database and authentication.
[2234] OpenCV: Used for image and video processing.
[2235] TensorFlow: Used for emotion recognition models.
[2236] Processing flow
[2237] 1. Schedule a meeting
[2238] The user inputs the date, time and number of people for the meeting.
[2239] The terminal transmits the input information to the server, which then automatically selects the most suitable facility for the conference and confirms the reservation.
[2240] 2. Start security monitoring
[2241] At the start of the meeting, the device's camera and microphone are activated and the emotion engine analyzes the user's emotions in real time.
[2242] 3. Monitoring during meetings
[2243] During the meeting, the device uses a camera and microphone to monitor users' emotions in real time and detect abnormal behavior.
[2244] When the server detects abnormal behavior, it immediately sends a notification and alerts relevant parties.
[2245] 4. Ending the meeting
[2246] At the end of the meeting, the collected emotional data and meeting minutes are automatically generated and stored on a secure server.
[2247] 5. Recovery plan proposal
[2248] Based on any issues detected during the meeting, the server generates a recovery plan and notifies the relevant parties.
[2249] Examples of concrete examples and prompts
[2250] As a concrete example, the following prompt sentence will be used.
[2251] Example prompt sentence:
[2252] "I've booked an important meeting for 10 people on October 15, 2023, from 2:00 PM to 3:00 PM. I'll begin security monitoring and notify you if any abnormal activity is detected."
[2253] Example notification:
[2254] "At 2:30 PM, signs of stress were detected in Conference Room A. Security team has been notified."
[2255] System Effects
[2256] The system will streamline conference booking and management, integrate security and emotion monitoring to enable rapid response to abnormal behavior during meetings, and use the collected data to optimize the conference experience.
[2257] The flow of the specific processing in the application example 2 will be described with reference to FIG.
[2258] Step 1:
[2259] Schedule a meeting:
[2260] The user inputs the date and time of the meeting and the number of people. The device sends the input information (e.g., "October 15, 2023, 14:00-15:00, 10 people") to the server. The server automatically selects the most suitable facility for the meeting based on the received information and confirms the reservation. Finally, the device notifies the user that the reservation was successful.
[2261] Input: The meeting date, time, and number of people entered by the user
[2262] Data processing: The server selects the best meeting venue
[2263] Output: Reservation completion notification
[2264] Specific behavior:
[2265] The user enters "October 15, 2023, 14:00-15:00, 10 people" on the application screen and presses the send button.
[2266] The terminal sends the data to the server, and the server confirms the reservation.
[2267] The terminal displays a "reservation complete" notification to the user.
[2268] Step 2:
[2269] Start security monitoring:
[2270] When a meeting starts, the device's camera and microphone are activated. The server detects the start of the meeting and activates the emotion engine to monitor users' emotions in real time.
[2271] Input: Meeting start notification
[2272] Data processing: Activate the camera and microphone, and the emotion engine collects emotion data
[2273] Output: Real-time emotion data
[2274] Specific behavior:
[2275] When the meeting starts, the device's camera and microphone will automatically turn on.
[2276] The emotion engine begins to analyze the user's emotions in real time.
[2277] Step 3:
[2278] In-meeting monitoring:
[2279] During the meeting, the device uses a camera and microphone to monitor the user's emotions and detect abnormal behavior. The server uses data from the emotion engine to send a notification if it detects abnormal behavior.
[2280] Input: Real-time emotion data
[2281] Data processing: Emotion engine detects abnormal behavior
[2282] Output: Abnormal behavior notification
[2283] Specific behavior:
[2284] During the actual meeting, the device's camera and microphone analyze the user's movements and voice in real time.
[2285] If any abnormal behavior is detected, the server will immediately notify and send an alert to the security team.
[2286] Step 4:
[2287] Ending a meeting:
[2288] At the end of the meeting, the collected emotional data and minutes of the meeting are automatically generated, stored on a secure server, and a notification is sent to participants.
[2289] Input: End of meeting notification
[2290] Data processing: Automatic generation and storage of emotion data and minutes
[2291] Output: Data storage notification
[2292] Specific behavior:
[2293] When the conference ends, the terminal notifies the server of the end of the conference.
[2294] The server automatically generates emotion data and meeting minutes, and stores this data on a secure server.
[2295] The device displays a "Data saved" notification to the user.
[2296] Step 5:
[2297] Recovery plan proposal:
[2298] Based on the issues detected during the meeting, the server generates a recovery plan and notifies the relevant parties. The server analyzes the sentiment data and identifies areas for improvement.
[2299] Input: Emotion data and problem information
[2300] Data processing: Recovery plan generation
[2301] Output: Recovery plan notification
[2302] Specific behavior:
[2303] The server performs analysis based on the emotional data collected during the meeting and the issues detected.
[2304] The server generates a recovery plan and notifies the relevant parties.
[2305] The terminal displays a notification to the relevant parties saying "Recovery plan has been generated."
[2306] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.
[2307] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.
[2308] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.
[2309] [Fourth embodiment]
[2310] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.
[2311] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.
[2312] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).
[2313] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.
[2314] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.
[2315] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).
[2316] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.
[2317] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.
[2318] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.
[2319] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.
[2320] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.
[2321] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.
[2322] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."
[2323] This invention is a conference facility management system that uses AI technology and comprehensively manages everything from conference reservations to operation and information management. This system is composed of users, terminals, and a server.
[2324] Overall system overview
[2325] The system provides the following main functions:
[2326] 1. Meeting reception function
[2327] 2. Reservation arrangement function
[2328] 3. User pattern analysis
[2329] 4. Understanding usage status
[2330] 5. Meeting pattern analysis and management support
[2331] 6. Digitization of meeting information
[2332] 7. Information asset management function
[2333] 1. Meeting reception function
[2334] Embodiments:
[2335] The terminal provides an interface for the user to input the date, time, and number of people for the conference. When the user inputs the information and presses the reservation button, the terminal sends this information to the server. Based on the received information, the server searches for available conference facilities, automatically selects the most suitable facility, and confirms the reservation. The terminal notifies the user that the reservation was successful.
[2336] Specific working example:
[2337] The user enters "October 15th, 14:00-15:00, 10 people." The device sends this information to the server. The server searches for the most suitable meeting facility and confirms the reservation. The device displays a "Reservation Complete" notification to the user.
[2338] 2. Reservation arrangement function
[2339] Embodiments:
[2340] The server analyzes past reservation data and meeting importance information. When a user enters a reservation, the server determines whether to secure a physical facility or use an online meeting and proposes the optimal choice. The device notifies the user of this proposal and prompts them to make a final decision.
[2341] Specific working example:
[2342] A user books an "important meeting." The device sends the information to the server. The server analyzes past data and determines that a physical meeting facility is needed. The device displays this suggestion to the user.
[2343] 3. User pattern analysis
[2344] Embodiments:
[2345] The server analyzes each user's past reservation history, cancellation frequency, and rule violation record to evaluate their creditworthiness. When a user enters a new reservation, the server sets reservation priorities and restrictions based on the user's creditworthiness. The terminal notifies the user of the results.
[2346] Specific working example:
[2347] User A enters a new reservation. The device sends the information to the server. The server analyzes past data and determines that "User A's credibility is low." The device notifies the user that "reservations have been restricted."
[2348] 4. Understanding usage status
[2349] Embodiments:
[2350] The server monitors the availability of conference facilities in real time. If a reservation is canceled, the server immediately updates the information and automatically notifies users on the waiting list. The terminal receives the notification and displays it to the user.
[2351] Specific working example:
[2352] When a meeting is canceled, the server detects it and updates the usage database. Based on the waiting list, it notifies the waiting users that "Facility B for the meeting has been canceled from 14:00 to 15:00." The terminal displays the notification.
[2353] 5. Meeting pattern analysis and management support
[2354] Embodiments:
[2355] The server periodically collects and analyzes data such as the frequency of use of conference facilities, the number of people, and the time of day. Based on this data, it proposes optimal management methods (for example, changing the capacity or adding new facilities) and notifies the administrator of the proposal.
[2356] Specific working example:
[2357] The server analyzes data from the past three months and notifies the administrator that "Conference facility C is being used frequently, so we suggest increasing the capacity from 15 to 20 people." The proposal is displayed on the administrator's device.
[2358] 6. Digitization of meeting information
[2359] Embodiments:
[2360] During the meeting, the server automatically collects audio and text data and generates minutes, which are then stored on a secure server and notified to participants.
[2361] Specific working example:
[2362] During the meeting, the server records audio data and automatically generates minutes. The minutes are saved on a secure server and a notification that "the minutes have been saved" is displayed on the participants' devices.
[2363] 7. Information asset management function
[2364] Embodiments:
[2365] The server centrally manages the decisions made in meetings and related documents. If a problem occurs during the project, the server uses the meeting data to present an appropriate recovery plan. It also sends notifications to stakeholders and provides access links to related documents.
[2366] Specific working example:
[2367] A problem occurs during a project. The server references the meeting data and sends a notification that a recovery plan has been generated. The server also provides access links to related documents and sends a notification. The notification is displayed on the device.
[2368] In this way, the present invention is a system that improves the efficiency of reservation and management of conference facilities and reduces the risk of information leaks.
[2369] The processing flow will be explained below.
[2370] 1. Meeting reception function
[2371] Process flow:
[2372] Step 1:
[2373] The user inputs the date and time of the meeting and the number of people at the terminal.
[2374] Step 2:
[2375] The terminal transmits the input information to the server.
[2376] Step 3:
[2377] The server searches a schedule database of conference facilities based on the received information.
[2378] Step 4:
[2379] The server identifies the best meeting venue that meets the criteria.
[2380] Step 5:
[2381] The server updates the database with the confirmed reservation information.
[2382] Step 6:
[2383] The terminal displays a notification to the user that the reservation is complete.
[2384] 2. Reservation arrangement function
[2385] Process flow:
[2386] Step 1:
[2387] The user inputs the importance of the conference on the terminal and transmits the reservation information.
[2388] Step 2:
[2389] Based on the reservation information received by the server, the past reservation history and importance data are analyzed.
[2390] Step 3:
[2391] The server determines whether a facility needs to be reserved for a physical meeting or whether an online meeting is appropriate.
[2392] Step 4:
[2393] The server generates information that suggests the best reservation method for the user.
[2394] Step 5:
[2395] The terminal displays the server's proposals to the user and prompts them to make a final decision.
[2396] 3. User pattern analysis
[2397] Process flow:
[2398] Step 1:
[2399] The user inputs and transmits new reservation information on the terminal.
[2400] Step 2:
[2401] Based on the reservation information received by the server, the user's past reservation history, cancellation frequency, and rule violation record are analyzed.
[2402] Step 3:
[2403] The server evaluates the user's creditworthiness and sets reservation priorities and limits.
[2404] Step 4:
[2405] The server confirms or restricts reservations based on the evaluation results.
[2406] Step 5:
[2407] The terminal notifies the user of the evaluation results and reservation status.
[2408] 4. Understanding usage status
[2409] Process flow:
[2410] Step 1:
[2411] The server monitors the availability of conference facilities in real time.
[2412] Step 2:
[2413] The server periodically updates the usage data to a database.
[2414] Step 3:
[2415] If a meeting facility is cancelled, the server will immediately update the cancellation information.
[2416] Step 4:
[2417] The server checks the cancellation waiting list and notifies the waiting users of the cancellation information.
[2418] Step 5:
[2419] The device displays the notification to the user.
[2420] 5. Meeting pattern analysis and management support
[2421] Process flow:
[2422] Step 1:
[2423] A server periodically collects usage data of conference facilities.
[2424] Step 2:
[2425] The server analyzes the frequency of use of conference facilities, the number of people, and the time of day based on the data collected.
[2426] Step 3:
[2427] Based on the analysis results, the server will propose the optimal management method.
[2428] Step 4:
[2429] The server notifies the administrator of the proposal.
[2430] Step 5:
[2431] The terminal displays the proposal to the administrator and prompts them to decide whether to implement it.
[2432] 6. Digitization of meeting information
[2433] Process flow:
[2434] Step 1:
[2435] During the meeting, the server collects audio data and notes.
[2436] Step 2:
[2437] Minutes are automatically generated based on the data collected by the server.
[2438] Step 3:
[2439] The server stores minutes and meeting contents on a secure server.
[2440] Step 4:
[2441] The server notifies the conference participants that the minutes have been saved.
[2442] Step 5:
[2443] The terminal displays a notification to the user, prompting them to confirm the meeting content.
[2444] 7. Information asset management function
[2445] Process flow:
[2446] Step 1:
[2447] The server centrally manages the decisions made at the meeting and related documents.
[2448] Step 2:
[2449] If a problem occurs during the project, the server references the meeting data and generates a recovery plan.
[2450] Step 3:
[2451] The server notifies relevant parties of the recovery plan and provides links to access related documents.
[2452] Step 4:
[2453] The device will display a notification to the user, prompting them to review the recovery plan and related documentation.
[2454] Step 5: ...
Claims
1. a reception means for inputting the date, time and number of people for a meeting; A means for automatically selecting and reserving the most suitable conference facility based on the input information; A means for adjusting reservations, including the use of online meetings, based on the importance of the meetings; means for analyzing the reservation patterns of a plurality of users and managing reservations based on creditworthiness; A means to monitor the availability of meeting facilities in real time and notify you if cancellations occur. A means to automatically digitize and save the contents of meetings, A means to centrally manage the information assets decided at the meeting and support project recovery, A system including:
2. 10. The system of claim 1, further comprising means for analyzing usage patterns of said conference facilities and proposing optimal management methods.
3. 10. The system of claim 1, further comprising means for automatically sending a notification to a waiting list user when a reservation for said conference facility is canceled.
Citation Information
Patent Citations
Persona chatbot control method and system
JP2022180282A