Conference summary generation system, method, device and equipment
By using smart glasses to collect voice and image data during meetings and inserting them into meeting minutes according to the shooting time, the problem of high network traffic and low efficiency in existing technologies is solved, and efficient generation of meeting minutes is achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-12-30
- Publication Date
- 2026-05-05
AI Technical Summary
Existing technologies require the transmission of the entire meeting video to extract key content when generating meeting minutes, resulting in high network traffic consumption and low efficiency, which cannot meet the needs of real-time generation.
The system uses smart glasses to collect audio data streams from meetings and receives user commands to capture image data of meeting segments. The image data is then inserted into the meeting minutes according to the capture time, avoiding the need to capture the entire meeting video and reducing network transmission.
It improves the efficiency of generating meeting minutes containing important meeting images, meets the needs of real-time or offline generation, and saves network resources.
Smart Images
Figure CN121984797A_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of data processing technology, specifically to meeting minutes generation systems, methods, and apparatus, as well as electronic devices. Background Technology
[0002] Meetings are increasingly used in daily life and work as a crucial means of organizational collaboration. However, recording meeting content often requires dedicated personnel, which is costly and inefficient. With the continuous development of voice technology, technologies have emerged that allow recording devices to capture meeting minutes and then use speech-to-text functions to automatically generate meeting summaries.
[0003] During audio conference minutes, the audio is transcribed into text and used as the meeting minutes content. However, when encountering important meeting content, it is still necessary to record corresponding images of the meeting content. Including these images as part of the meeting minutes can significantly improve readability. Currently, a typical method for generating meeting minutes that include images of important meeting content is to capture both the audio and video of the complete meeting presentation simultaneously. When generating the meeting minutes, the video footage containing the important meeting content corresponding to the meeting minutes entries is extracted from the complete video.
[0004] However, the applicant of this application has found that the existing solution has at least the following problems: Since it is necessary to transmit the complete meeting video including the meeting sharing content, and filter out the important meeting content from the complete video which is filled with a lot of invalid information, it will result in a lot of network traffic consumption and affect the efficiency of meeting minutes generation, thus failing to meet the application requirements for real-time generation of meeting minutes. Summary of the Invention
[0005] This application provides a meeting minutes generation system to address the problem of low efficiency in meeting minutes generation in existing technologies. This application also provides a meeting minutes generation apparatus and electronic equipment.
[0006] This application provides a meeting minutes generation system, including: The smart glasses are used to collect conference audio data streams and send the audio data streams to the client; receive shooting instructions, collect image data of conference segments, and send the image data to the client. The client is configured to receive the voice data stream and send it to the server; receive a text stream corresponding to the voice data stream provided by the server and display the text stream; receive image data and display the image data in the corresponding text position according to the image capture time; receive meeting minutes provided by the server, obtain the target meeting minutes entry corresponding to the image capture time; insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes. The server is used to receive the voice data stream, convert the voice data stream into a text stream, and provide the text stream to the client; based on the speech-to-text transcription, it generates meeting minutes and provides the meeting minutes to the client.
[0007] This application provides a meeting minutes generation system, including: The smart glasses are used to collect conference audio data; receive shooting instructions, collect image data of conference segments, and record the image shooting time; and send the audio data, the image data, and the image shooting time to the client. The client is configured to receive the voice data, the image data, and the image capture time; send the voice data to the server; receive meeting minutes provided by the server; obtain the target meeting minutes entry corresponding to the image capture time; insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes. The server receives the voice data, converts the voice data into text, generates meeting minutes based on the transcribed text, and provides the meeting minutes to the client.
[0008] This application provides a meeting minutes generation system, including: The smart glasses are used to collect conference audio data; receive shooting instructions, collect image data of conference segments, and record the image shooting time; and send the audio data, the image data, and the image shooting time to the server. The server receives the voice data, the image data, and the image capture time; converts the voice data into text; generates meeting minutes based on the text; obtains the target meeting minutes entry corresponding to the image capture time; and inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes.
[0009] This application provides a method for generating meeting minutes, including: Collect the conference audio data stream and send the audio data stream to the client; Receive shooting instructions; The system collects image data from meeting segments and sends the image data to the client.
[0010] Optionally, the shooting instructions include a start shooting instruction and an end shooting instruction; The process of receiving the shooting command and acquiring image data of the meeting segment includes: Obtain the start recording command and collect video data of the meeting segment; The system receives the command to stop recording and ceases collecting video data.
[0011] Optionally, the start shooting command comes from the video start shooting operation button of the smart glasses, and the end shooting command comes from the video end shooting operation button of the smart glasses.
[0012] Optionally, the shooting command includes a start shooting command; The process of receiving the shooting command and acquiring image data of the meeting segment includes: Obtain the start shooting command and collect photo data of the meeting segments.
[0013] Optionally, the start shooting command comes from the photo shooting operation button on the smart glasses.
[0014] This application provides a method for generating meeting minutes, including: Receive the conference voice data stream sent by the smart glasses and send the voice data stream to the server; Receive a text stream corresponding to the voice data stream provided by the server, and display the text stream; Receive image data of meeting segments sent by smart glasses, and display the image data in the corresponding text position according to the image capture time; Receive meeting minutes provided by the server; Obtain the target meeting minutes entry corresponding to the image capture time; The image data is inserted into the meeting minutes as the image data corresponding to the target meeting minutes entry; Show the meeting minutes.
[0015] This application provides a method for generating meeting minutes, including: Collect conference audio data; Receive shooting instructions, acquire image data of meeting segments, and record the image shooting time; Send the voice data, the image data, and the image capture time.
[0016] This application provides a method for generating meeting minutes, including: Receive conference voice data, conference segment image data, and image capture time sent by smart glasses; Send the voice data to the server and receive the meeting minutes provided by the server. Obtain the target meeting minutes entry corresponding to the image capture time; The image data is inserted into the meeting minutes as the image data corresponding to the target meeting minutes entry; Show the meeting minutes.
[0017] This application provides a method for generating meeting minutes, including: Receive conference audio data, image data of conference segments, and image capture time; Convert the voice data into text; Generate meeting minutes based on the text; Obtain the target meeting minutes entry corresponding to the image capture time; The image data is inserted into the meeting minutes as the image data corresponding to the target meeting minutes entry.
[0018] This application provides a meeting minutes generation device, comprising: A voice transmission unit is used to receive conference voice data streams sent by smart glasses and send the voice data streams to the server. The text display unit is used to receive a text stream corresponding to the voice data stream provided by the server and to display the text stream. An image processing unit is used to receive image data of meeting segments sent by smart glasses, and display the image data in the corresponding text position according to the image capture time; The meeting minutes processing unit is used to receive meeting minutes provided by the server; obtain the target meeting minutes entry corresponding to the image capture time; insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes.
[0019] This application provides an electronic device, including: Processor; and A memory for storing a program that implements the meeting minutes generation method described in any of the above descriptions, wherein the device is powered on and the program of the method is run by the processor.
[0020] This application also provides a computer-readable storage medium storing instructions that, when executed on a computer, cause the computer to perform the various meeting minutes generation methods described above.
[0021] This application also provides a computer program product including instructions that, when run on a computer, cause the computer to perform the various methods described above.
[0022] Compared with the prior art, this application has the following advantages: The meeting minutes generation system provided in this application embodiment collects meeting audio data streams through smart glasses and sends the audio data streams to a client; receives user-input shooting instructions, collects image data of meeting segments, and sends the image data to the client; receives the audio data streams through the client and sends the audio data streams to the server; receives a text stream corresponding to the audio data streams provided by the server and displays the text streams; receives image data and displays the image data at the corresponding text stream position according to the image shooting time; receives meeting minutes provided by the server, obtains the target meeting minutes entry corresponding to the image shooting time; inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; displays the meeting minutes; receives the audio data streams through the server, converts the audio data streams into text streams, and provides the text streams to the client; generates meeting minutes based on speech-to-text transcription and provides the meeting minutes to the client. This processing method allows for simultaneous audio recording via smart glasses and real-time photo / video capture. Photos / video clips are then inserted into the corresponding entries in the audio-based meeting minutes, avoiding the need to record the entire meeting video. Only a small number of photos or video clips need to be transmitted, eliminating the need to extract crucial images from the full video and allowing direct access to key content. Therefore, it effectively improves the efficiency of generating meeting minutes containing important images, meeting the application requirements for real-time generation of such minutes while conserving network resources. In summary, this method balances the lightweight nature of audio meeting minutes with the challenge of understanding them later due to the lack of photographs.
[0023] The meeting minutes generation system provided in this application embodiment collects meeting audio data through smart glasses; receives a user-input shooting command, collects image data of meeting segments, and records the image shooting time; sends the audio data, image data, and image shooting time to a client; receives the audio data, image data, and image shooting time through the client, sends the audio data stream to a server, and receives speech-to-text provided by the server; obtains a target meeting minutes entry corresponding to the image shooting time, inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; displays the meeting minutes; receives the audio data through the server, converts the audio data into text; generates meeting minutes based on the speech-to-text, and provides the meeting minutes to the client. This processing method allows for simultaneous recording of meeting audio via smart glasses and triggering of video capture at any time. Photo / video clips are then inserted into the corresponding entries in the meeting minutes generated from the audio, avoiding the need to record the entire meeting video and extract important images from it. Therefore, it effectively improves the efficiency of generating meeting minutes containing important images, meeting the application requirements for offline generation of meeting minutes with important images, and saving network resources.
[0024] The meeting minutes generation system provided in this application embodiment collects meeting audio data through smart glasses; receives user-input shooting instructions, collects image data of meeting segments, and records the image shooting time; sends the audio data, image data, and image shooting time to the server; the server receives the audio data, image data, and image shooting time, converts the audio data into text; generates meeting minutes based on the text; obtains the target meeting minutes entry corresponding to the image shooting time, and inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes. This processing method allows for simultaneous audio collection through smart glasses and real-time shooting via smart glasses, inserting photo / video clips into the corresponding meeting minutes entries generated from the audio-based meeting minutes according to the shooting time. This avoids capturing the entire meeting video and extracting important images from the complete video. Therefore, it effectively improves the generation efficiency of meeting minutes containing important meeting images, meets the application requirements for offline generation of meeting minutes containing important meeting images, and saves network resources. Attached Figure Description
[0025] Figure 1 This is a schematic diagram of device interaction of an embodiment of the meeting minutes generation system provided in this application; Figure 2This is a schematic diagram of device interaction of an embodiment of the meeting minutes generation system provided in this application; Figure 3 This is a flowchart illustrating an embodiment of the meeting minutes generation method provided in this application. Detailed Implementation
[0026] Many specific details are set forth in the following description to provide a full understanding of this application. However, this application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar extensions without departing from the spirit of this application. Therefore, this application is not limited to the specific implementations disclosed below.
[0027] This application provides a meeting minutes generation system, method, and apparatus, as well as an electronic device. The various solutions are described in detail below in each embodiment.
[0028] First Embodiment Please refer to Figure 1 This is a schematic diagram of the device interaction for the meeting minutes generation system of this application. In this embodiment, the system may include: smart glasses, a client, and a server.
[0029] The system includes: smart glasses for collecting conference audio data streams and sending them to a client; receiving shooting instructions to collect image data of conference segments and sending the image data to the client; a client for receiving the audio data stream and sending it to a server; receiving a text stream corresponding to the audio data stream from the server and displaying the text stream; receiving image data and displaying it in the corresponding text position according to the image capture time; receiving meeting minutes from the server and obtaining the target meeting minutes entry corresponding to the image capture time; inserting the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and displaying the meeting minutes; and a server for receiving the audio data stream, converting it into a text stream, and providing the text stream to the client; generating meeting minutes based on the speech-to-text transcription and providing the meeting minutes to the client.
[0030] In this embodiment, the smart glasses can collect conference audio data via a microphone. The audio data stream is forwarded to the server via a client, where it is transcribed into a text stream and sent back to the client. The client then displays the text stream, thus displaying the conference speech content in text format. During the conference, the user can send a shooting command to the smart glasses at any time as needed. For certain important speeches, image data (such as images from the presentation slides) is simultaneously captured. After the images are captured, they are sent to the client. The client displays the images at the corresponding points in the conference speech text based on the image capture time. This allows participants to see not only the conference speech content but also the images corresponding to important speeches, thus helping them better understand the content.
[0031] The client can be a device that can connect to the smart glasses via near-field communication, such as a smartphone, tablet, or personal computer with Bluetooth that connects to the smart glasses via Bluetooth.
[0032] In one example, smart glasses can send the collected voice data stream to the client in real time. Upon receiving the voice data stream, the client immediately forwards it to the server. The server, upon receiving the voice data stream, uses speech recognition technology to transcribe it into a meeting text stream and sends it back to the client, which then displays the meeting text stream. This processing method allows the client to synchronously display the corresponding meeting speech text according to the speaker's speaking progress; therefore, it effectively improves the efficiency of meeting speech text display, thereby enhancing the user experience.
[0033] In practice, smart glasses can also send the collected voice data stream to the client at certain time intervals (such as every 10 seconds). After receiving the voice data stream, the client sends the voice data stream to the server. After receiving the voice data stream, the server uses speech recognition technology to transcribe the voice data stream into a conference text stream and sends the conference text stream back to the client, which then displays the conference text stream.
[0034] In one example, the shooting instructions include a start shooting instruction and an end shooting instruction; receiving the shooting instruction and acquiring image data of the meeting segment includes: acquiring the start shooting instruction input by the user and acquiring video data of the meeting segment; acquiring the end shooting instruction input by the user and stopping the acquisition of video data. The start shooting instruction can be an instruction from the video start shooting operation button of the smart glasses, and the end shooting instruction can be an instruction from the video end shooting operation button of the smart glasses. For example, if the user looks at the blackboard, quickly clicks the start shooting button on the temple of the smart glasses to acquire a video segment of the teacher writing and lecturing on the blackboard, and then quickly clicks the end shooting button on the temple of the smart glasses to stop the video recording. Using this processing method, the image data of the meeting segment becomes a video segment, and a video segment matching the meeting minutes entry can be inserted into the meeting minutes as a video supplement to the entry. For example, if the meeting minutes entry is a summary of an important knowledge point by the teacher, the corresponding video segment is the teacher's core explanation video of that knowledge point.
[0035] In one example, the shooting instruction includes a start shooting instruction; receiving the user-input shooting instruction and acquiring image data of the meeting segment includes: acquiring the user-input start shooting instruction and acquiring photo data of the meeting segment. The start shooting instruction can be from a photo shooting button built into the smart glasses; for example, if a user looks at a blackboard and quickly clicks the photo button on the temple of the smart glasses, a photo of the blackboard content can be captured. Using this processing method, the image data of the meeting segment is converted into photos, allowing one or more photos matching the meeting minutes entry to be inserted into the meeting minutes as supplementary visual descriptions. For example, if a meeting minutes entry is a teacher's summary of an important knowledge point, the corresponding photo could be a visual description of that knowledge point by the teacher.
[0036] In one example, the shooting command can be a voice command, such as a voice command to start recording video, a voice command to stop recording video, or a voice command to start taking a photo. Using this approach, users only need to issue voice commands to capture the corresponding image data, eliminating the need for manual commands; therefore, it effectively improves the speed of capturing meeting images, thereby enhancing the user experience.
[0037] In one example, the smart glasses are also used to receive and respond to a meeting start command, collect meeting audio data through a microphone, and take pictures through an image capture device; receive a meeting minutes generation command, send the command to the client, and the client sends a meeting minutes generation request to the server; the server responds to the meeting minutes generation request and generates meeting minutes based on the speech-to-text transcription.
[0038] In one example, the server includes a speech-to-text server and a meeting minutes generation server. The speech-to-text server converts the speech data stream into a text stream, and the meeting minutes generation server generates meeting minutes based on the speech-to-text. In specific implementations, the meeting minutes generation server can employ an artificial intelligence summary model to generate meeting minutes based on the speech-to-text.
[0039] As can be seen from the above embodiments, the meeting minutes generation system provided in this application collects meeting audio data streams through smart glasses and sends the audio data streams to the client; receives user-input shooting instructions, collects image data of meeting segments, and sends the image data to the client; receives the audio data streams through the client and sends the audio data streams to the server; receives a text stream corresponding to the audio data streams provided by the server and displays the text streams; receives the image data and displays the image data in the corresponding text position according to the image shooting time; receives meeting minutes provided by the server, obtains the target meeting minutes entry corresponding to the image shooting time; inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; displays the meeting minutes; receives the audio data streams through the server, converts the audio data streams into text streams, and provides the text streams to the client; generates meeting minutes based on speech-to-text transcription and provides the meeting minutes to the client. This processing method allows for simultaneous recording of meeting audio via smart glasses and triggering of video capture at any time. Photo / video clips are then inserted into the corresponding entries in the meeting minutes generated from the audio, avoiding the need to record the entire meeting video and extract important images from it. Therefore, it effectively improves the efficiency of generating meeting minutes containing important images, meeting the application requirements for real-time generation of such minutes, and conserving network resources.
[0040] Second Embodiment In the above embodiments, a meeting minutes generation system is provided. Correspondingly, this application also provides a meeting minutes generation system. This system corresponds to the embodiments of the above-described system. Since this system embodiment is basically similar to System Embodiment 1, it is described simply, and relevant parts can be referred to in the description of System Embodiment 1. The method embodiments described below are merely illustrative.
[0041] Please refer to Figure 2 This is a schematic diagram of the device interaction for the meeting minutes generation system of this application. This application also provides a meeting minutes generation system, which may include: smart glasses, a client, and a server.
[0042] The system includes: smart glasses for collecting meeting audio data; receiving shooting instructions to collect image data of meeting segments and recording the image shooting time; sending the audio data, image data, and image shooting time to a client; the client for receiving the audio data, image data, and image shooting time, sending the audio data to a server; receiving meeting minutes provided by the server, obtaining the target meeting minutes entry corresponding to the image shooting time, inserting the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and displaying the meeting minutes; and the server for receiving the audio data, converting the audio data into text, generating meeting minutes based on the speech-to-text transcription, and providing the meeting minutes to the client.
[0043] The system provided in this embodiment differs from the system provided in Embodiment 1 in that: the system provided in this embodiment sends the conference audio data, image data captured during the conference according to user instructions, and image capture timestamps to the client after the conference audio data is collected; the client then sends the conference audio data to the server, which performs speech-to-text transcription and generates meeting minutes based on the transcribed text. Therefore, this processing method is an offline method for generating meeting minutes, suitable for use scenarios where smart glasses cannot connect to the client.
[0044] In one example, the client can send the conference audio data to the cloud storage service provider and send the cloud storage link address to the server. The server can then download the conference audio data from the cloud storage service provider based on the link address, perform speech-to-text transcription, and generate meeting minutes based on the speech-to-text transcript.
[0045] As can be seen from the above embodiments, the meeting minutes generation system provided in this application collects meeting audio data through smart glasses; receives a user-input shooting command, collects image data of meeting segments, and records the image shooting time; sends the audio data, the image data, and the image shooting time to the client; receives the audio data, the image data, and the image shooting time through the client, sends the audio data stream to the server, and receives the speech-to-text provided by the server; obtains the target meeting minutes entry corresponding to the image shooting time, inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; displays the meeting minutes; receives the audio data through the server, converts the audio data into text; generates meeting minutes based on the speech-to-text, and provides the meeting minutes to the client. This processing method allows for simultaneous recording of meeting audio via smart glasses and triggering of video capture at any time. Photo / video clips are then inserted into the corresponding entries in the meeting minutes generated from the audio, avoiding the need to record the entire meeting video and extract important images from it. Therefore, it effectively improves the efficiency of generating meeting minutes containing important images, meeting the application requirements for offline generation of meeting minutes with important images, and saving network resources.
[0046] Third Embodiment In the above embodiments, a meeting minutes generation system is provided. Correspondingly, this application also provides a meeting minutes generation system. This system corresponds to the embodiments of the above-described system. Since this system embodiment is basically similar to System Embodiment 1, it is described simply, and relevant parts can be referred to in the description of System Embodiment 1. The method embodiments described below are merely illustrative.
[0047] Please refer to Figure 3 This is a schematic diagram of the device interaction for the meeting minutes generation system of this application. This application also provides a meeting minutes generation system, which may include: smart glasses and a server.
[0048] The smart glasses are used to collect meeting audio data; receive user-input shooting commands, collect image data of meeting segments, and record the image shooting time; send the audio data, image data, and image shooting time to the server; the server receives the audio data, image data, and image shooting time, converts the audio data into text; generates meeting minutes based on the text; obtains the target meeting minutes entry corresponding to the image shooting time, and inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes.
[0049] The system provided in this embodiment differs from the system provided in Embodiment 2 in that: the system provided in this embodiment does not involve a client during the meeting. After the smart glasses complete the meeting audio recording, they can connect to the network via a wireless access point (AP) and directly send the meeting audio data, image data captured according to user instructions during the meeting, and the image capture time to the server. The server then performs speech-to-text transcription and generates meeting minutes based on the transcribed text, inserting the image data into the target meeting minutes entry corresponding to the image capture time. Therefore, this processing method is also an offline method for generating meeting minutes, suitable for use scenarios where the smart glasses cannot connect to a client.
[0050] As can be seen from the above embodiments, the meeting minutes generation system provided in this application collects meeting audio data through smart glasses; receives a user-input shooting command, collects image data of meeting segments, and records the image shooting time; sends the audio data, image data, and image shooting time to the server; the server receives the audio data, image data, and image shooting time, converts the audio data into text; generates meeting minutes based on the text; obtains the target meeting minutes entry corresponding to the image shooting time, and inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes. This processing method allows for simultaneous audio collection through smart glasses and triggering of shooting at any time, inserting photo / video clips into the corresponding meeting minutes entries generated from the audio-based meeting minutes according to the shooting time, avoiding the need to capture the entire meeting video and extract important images from the complete video. Therefore, it can effectively improve the generation efficiency of meeting minutes containing important meeting images, meet the application requirements for offline generation of meeting minutes containing important meeting images, and save network resources.
[0051] Fourth embodiment In the above embodiments, a meeting minutes generation system is provided. Correspondingly, this application also provides a meeting minutes generation method for terminal devices such as smart glasses, which include a sound pickup device and an image acquisition device. This method corresponds to the embodiments of the above system. Since the method embodiments are basically similar to the system embodiments, they are described simply, and relevant details can be found in the descriptions of the system embodiments. The method embodiments described below are merely illustrative.
[0052] This application also provides a method for generating meeting minutes, which may include the following steps: Step 1: Collect the conference audio data stream and provide the audio data stream to the client.
[0053] Step 2: Receive shooting instructions.
[0054] Step 3: Collect image data of the meeting segment and send the image data to the client.
[0055] In one example, the shooting instructions include a start shooting instruction and a stop shooting instruction; receiving the shooting instructions and acquiring image data of the meeting segment can be implemented as follows: acquiring the start shooting instruction to acquire video data of the meeting segment; acquiring the stop shooting instruction to stop acquiring video data. The start shooting instruction comes from the video start shooting operation button of the smart glasses, and the stop shooting instruction comes from the video end shooting operation button of the smart glasses.
[0056] In one example, the shooting instruction includes a start shooting instruction; receiving the shooting instruction and acquiring image data of the meeting segment can be implemented as follows: acquiring the start shooting instruction and acquiring photo data of the meeting segment. The start shooting instruction originates from the photo shooting operation button on the smart glasses.
[0057] Fifth Embodiment In the above embodiments, a method for generating meeting minutes is provided. Correspondingly, this application also provides a device for generating meeting minutes. This device corresponds to the embodiments of the method described above. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments. The device embodiments described below are merely illustrative.
[0058] This application also provides a meeting minutes generation device, comprising: a voice acquisition and transmission unit, a shooting instruction receiving unit, and an image acquisition and transmission unit. The voice acquisition and transmission unit is used to acquire meeting voice data streams and send the voice data streams to a client; the shooting instruction receiving unit is used to receive shooting instructions; and the image acquisition and transmission unit is used to acquire image data of meeting segments and send the image data to the client.
[0059] In one example, the shooting instructions include a start shooting instruction and an end shooting instruction; receiving the shooting instructions and acquiring image data of the meeting segment includes: acquiring the start shooting instruction and acquiring video data of the meeting segment; acquiring the end shooting instruction and stopping the acquisition of video data. The start shooting instruction comes from the video start shooting operation button of the smart glasses, and the end shooting instruction comes from the video end shooting operation button of the smart glasses.
[0060] In one example, the shooting instruction includes a start shooting instruction; receiving the shooting instruction and acquiring image data of the meeting segment includes: acquiring the start shooting instruction and acquiring photo data of the meeting segment. The start shooting instruction originates from the photo shooting operation button on the smart glasses.
[0061] Sixth Embodiment In the above embodiments, a meeting minutes generation system is provided. Correspondingly, this application also provides a meeting minutes generation method for a client. This method corresponds to the embodiments of the above system. Since the method embodiments are basically similar to the system embodiments, they are described simply, and relevant details can be found in the descriptions of the system embodiments. The method embodiments described below are merely illustrative.
[0062] This application also provides a method for generating meeting minutes, which may include the following steps: Step 1: Receive the conference voice data stream sent by the smart glasses and send the voice data stream to the server.
[0063] Step 2: Receive the text stream corresponding to the voice data stream provided by the server, and display the text stream.
[0064] Step 3: Receive image data of the meeting segment sent by the smart glasses, and display the image data in the corresponding text position according to the image capture time.
[0065] Step 4: Receive the meeting minutes provided by the server.
[0066] Step 5: Obtain the target meeting minutes entry corresponding to the image capture time.
[0067] Step 6: Insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes.
[0068] Step 7: Present the meeting minutes.
[0069] Seventh Embodiment In the above embodiments, a method for generating meeting minutes is provided. Correspondingly, this application also provides a device for generating meeting minutes. This device corresponds to the embodiments of the method described above. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments. The device embodiments described below are merely illustrative.
[0070] This application also provides a meeting minutes generation device, comprising: a voice transmission unit, a text display unit, an image processing unit, and a meeting minutes processing unit. The voice transmission unit is used to receive a meeting voice data stream sent by smart glasses and send the voice data stream to a server; the text display unit is used to receive a text stream corresponding to the voice data stream provided by the server and display the text stream; the image processing unit is used to receive image data of meeting segments sent by smart glasses and display the image data at the corresponding text position according to the image capture time; the meeting minutes processing unit is used to receive the meeting minutes provided by the server; obtain a target meeting minutes entry corresponding to the image capture time; insert the image data as image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes.
[0071] Eighth embodiment In the above embodiments, a meeting minutes generation system is provided. Correspondingly, this application also provides a meeting minutes generation method for smart glasses. This method corresponds to the embodiments of the above system. Since the method embodiments are basically similar to the system embodiments, they are described simply, and relevant details can be found in the descriptions of the system embodiments. The method embodiments described below are merely illustrative.
[0072] This application also provides a method for generating meeting minutes, which may include the following steps: Step 1: Collect conference audio data.
[0073] Step 2: Receive the shooting instruction, collect image data of the meeting segment, and record the image shooting time.
[0074] Step 3: Send the voice data, the image data, and the image capture time.
[0075] In practice, the voice data, the image data, and the image capture time can be sent to the client or the server.
[0076] Ninth Embodiment In the above embodiments, a method for generating meeting minutes is provided. Correspondingly, this application also provides a device for generating meeting minutes. This device corresponds to the embodiments of the method described above. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments. The device embodiments described below are merely illustrative.
[0077] This application also provides a meeting minutes generation device, comprising: a voice acquisition unit, an image capture unit, and a data transmission unit. The voice acquisition unit is used to acquire meeting voice data; the image capture unit is used to receive a capture command, acquire image data of meeting segments, and record the image capture time; the data transmission unit is used to transmit the voice data, the image data, and the image capture time.
[0078] Tenth Embodiment In the above embodiments, a meeting minutes generation system is provided. Correspondingly, this application also provides a meeting minutes generation method for a client. This method corresponds to the embodiments of the above system. Since the method embodiments are basically similar to the system embodiments, they are described simply, and relevant details can be found in the descriptions of the system embodiments. The method embodiments described below are merely illustrative.
[0079] This application also provides a method for generating meeting minutes, which may include the following steps: Step 1: Receive conference audio data, conference segment image data, and image capture time sent by the smart glasses.
[0080] Step 2: Send the voice data to the server and receive the meeting minutes provided by the server.
[0081] Step 3: Obtain the target meeting minutes entry corresponding to the image capture time.
[0082] Step 4: Insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes.
[0083] Step 5: Present the meeting minutes.
[0084] Eleventh Embodiment In the above embodiments, a method for generating meeting minutes is provided. Correspondingly, this application also provides a device for generating meeting minutes. This device corresponds to the embodiments of the method described above. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments. The device embodiments described below are merely illustrative.
[0085] This application also provides a meeting minutes generation device, comprising: a data receiving unit, a data sending unit, and a meeting minutes processing unit. The data receiving unit is used to receive meeting audio data, image data of meeting segments, and image capture timestamps sent by smart glasses; the data sending unit is used to send the audio data to a server; the meeting minutes processing unit is used to receive meeting minutes provided by the server; obtain a target meeting minutes entry corresponding to the image capture time; insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes.
[0086] Twelfth Embodiment In the above embodiments, a meeting minutes generation system is provided. Correspondingly, this application also provides a meeting minutes generation method for a server. This method corresponds to the embodiments of the above system. Since the method embodiments are basically similar to the system embodiments, they are described simply, and relevant details can be found in the descriptions of the system embodiments. The method embodiments described below are merely illustrative.
[0087] This application also provides a method for generating meeting minutes, which may include the following steps: Step 1: Receive conference audio data, conference segment image data, and image capture time.
[0088] Step 2: Convert the voice data into text.
[0089] Step 3: Generate meeting minutes based on the text.
[0090] Step 4: Obtain the target meeting minutes entry corresponding to the image capture time.
[0091] Step 5: Insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes.
[0092] Thirteenth Embodiment In the above embodiments, a method for generating meeting minutes is provided. Correspondingly, this application also provides a device for generating meeting minutes. This device corresponds to the embodiments of the method described above. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant parts can be referred to in the description of the method embodiments. The device embodiments described below are merely illustrative.
[0093] This application also provides a meeting minutes generation device, comprising: a data receiving unit, a speech-to-text unit, a meeting minutes generation unit, a meeting minutes entry matching unit, and an image insertion unit. The data receiving unit is used to receive meeting audio data, image data of meeting segments, and image capture timestamps; the speech-to-text unit is used to convert the audio data into text; the meeting minutes generation unit is used to generate meeting minutes based on the text; the meeting minutes entry matching unit is used to obtain target meeting minutes entries corresponding to the image capture timestamps; and the image insertion unit is used to insert the image data as image data corresponding to the target meeting minutes entry into the meeting minutes.
[0094] Fourteenth Embodiment In the above embodiments, a method for generating meeting minutes is provided. Correspondingly, this application also provides an electronic device. This device corresponds to the embodiments of the above method. Since the device embodiments are basically similar to the method embodiments, the description is relatively simple, and relevant details can be found in the description of the method embodiments. The device embodiments described below are merely illustrative.
[0095] The electronic device of this embodiment includes: a memory and a processor; the memory is used to store a program for implementing the meeting minutes generation method, and the device is powered on and runs the program for the meeting minutes generation method through the processor.
[0096] Memory can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.
[0097] In specific implementations, the electronic device may further include one or more of the following components: a power supply component, an input / output (I / O) interface, and a communication component. The power supply component provides power to various components of the electronic device. The power supply component may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device. The I / O interface provides an interface between the processor 503 and peripheral interface modules, which may be a keyboard, click wheel, buttons, etc. The communication component is configured to facilitate wired or wireless communication between the electronic device and user devices (such as smartphones, tablets, etc.).
[0098] Fifteenth Embodiment This application also provides a computer-readable storage medium. Since the embodiments of the computer-readable storage medium are substantially similar to the method embodiments, the description is relatively simple; relevant details can be found in the description of the method embodiments. The computer-readable storage medium embodiments described below are merely illustrative.
[0099] In this embodiment, a non-transitory computer-readable storage medium including instructions is provided, such as a memory including instructions, which can be executed by a processor of an electronic device to complete the meeting minutes generation method provided in this disclosure. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.
[0100] It should be noted that the embodiments of this application may involve the use of user data. In practical applications, user-specific personal data may be used in the scheme described herein within the scope permitted by applicable laws and regulations, provided that it complies with the applicable laws and regulations of the country (e.g., with the user's explicit consent, with the user being properly notified, etc.).
[0101] Although this application discloses preferred embodiments as described above, it is not intended to limit this application. Any person skilled in the art can make possible changes and modifications without departing from the spirit and scope of this application. Therefore, the scope of protection of this application should be determined by the scope defined in the claims of this application.
[0102] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.
[0103] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.
[0104] 1. Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information by any method or technology. Information can be computer-readable instructions, data structures, program modules, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include non-transitory computer-readable media, such as modulated data signals and carrier waves.
[0105] 2. Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.
Claims
1. A meeting minutes generation system, characterized in that, include: Smart glasses are used to collect conference voice data streams and send the voice data streams to the client. Receive shooting instructions, collect image data of meeting segments, and send the image data to the client; The client is configured to receive the voice data stream and send it to the server; receive a text stream corresponding to the voice data stream provided by the server and display the text stream; receive image data and display the image data in the corresponding text position according to the image capture time; receive meeting minutes provided by the server, obtain the target meeting minutes entry corresponding to the image capture time; insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes. The server is used to receive the voice data stream, convert the voice data stream into a text stream, and provide the text stream to the client; based on the speech-to-text transcription, it generates meeting minutes and provides the meeting minutes to the client.
2. A meeting minutes generation system, characterized in that, include: Smart glasses are used to collect conference audio data; receive shooting instructions, capture image data of conference segments, and record the image capture time; The voice data, the image data, and the image capture time are sent to the client. The client is configured to receive the voice data, the image data, and the image capture time; send the voice data to the server; receive meeting minutes provided by the server; obtain the target meeting minutes entry corresponding to the image capture time; insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes. The server receives the voice data, converts the voice data into text, generates meeting minutes based on the transcribed text, and provides the meeting minutes to the client.
3. A meeting minutes generation system, characterized in that, include: Smart glasses are used to collect conference audio data; receive shooting instructions, capture image data of conference segments, and record the image capture time; The voice data, the image data, and the image capture time are sent to the server. The server receives the voice data, the image data, and the image capture time; converts the voice data into text; generates meeting minutes based on the text; obtains the target meeting minutes entry corresponding to the image capture time; and inserts the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes.
4. A method for generating meeting minutes, characterized in that, include: Collect the conference audio data stream and send the audio data stream to the client; Receive shooting instructions; The system collects image data from meeting segments and sends the image data to the client.
5. The method according to claim 4, characterized in that, The shooting instructions include start shooting instructions and end shooting instructions; The process of receiving the shooting command and acquiring image data of the meeting segment includes: Obtain the start recording command and collect video data of the meeting segment; The system receives the command to stop recording and ceases collecting video data.
6. The method according to claim 5, characterized in that, The start shooting command comes from the video start shooting operation button on the smart glasses, and the end shooting command comes from the video end shooting operation button on the smart glasses.
7. The method according to claim 4, characterized in that, The shooting instructions include the start shooting instruction; The process of receiving the shooting command and acquiring image data of the meeting segment includes: Obtain the start shooting command and collect photo data of the meeting segments.
8. The method according to claim 7, characterized in that, The command to start shooting comes from the photo shooting button on the smart glasses.
9. A method for generating meeting minutes, characterized in that, include: Receive the conference voice data stream sent by the smart glasses and send the voice data stream to the server; Receive a text stream corresponding to the voice data stream provided by the server, and display the text stream; Receive image data of meeting segments sent by smart glasses, and display the image data in the corresponding text position according to the image capture time; Receive meeting minutes provided by the server; Obtain the target meeting minutes entry corresponding to the image capture time; The image data is inserted into the meeting minutes as the image data corresponding to the target meeting minutes entry; Show the meeting minutes.
10. A method for generating meeting minutes, characterized in that, include: Collect conference audio data; Receive shooting instructions, acquire image data of meeting segments, and record the image shooting time; Send the voice data, the image data, and the image capture time.
11. A method for generating meeting minutes, characterized in that, include: Receive conference voice data, conference segment image data, and image capture time sent by smart glasses; Send the voice data to the server and receive the meeting minutes provided by the server. Obtain the target meeting minutes entry corresponding to the image capture time; The image data is inserted into the meeting minutes as the image data corresponding to the target meeting minutes entry; Show the meeting minutes.
12. A method for generating meeting minutes, characterized in that, include: Receive conference audio data, image data of conference segments, and image capture time; Convert the voice data into text; Generate meeting minutes based on the text; Obtain the target meeting minutes entry corresponding to the image capture time; The image data is inserted into the meeting minutes as the image data corresponding to the target meeting minutes entry.
13. A meeting minutes generation device, characterized in that, include: A voice transmission unit is used to receive conference voice data streams sent by smart glasses and send the voice data streams to the server. The text display unit is used to receive a text stream corresponding to the voice data stream provided by the server and to display the text stream. An image processing unit is used to receive image data of meeting segments sent by smart glasses, and display the image data in the corresponding text position according to the image capture time; The meeting minutes processing unit is used to receive meeting minutes provided by the server; obtain the target meeting minutes entry corresponding to the image capture time; insert the image data as the image data corresponding to the target meeting minutes entry into the meeting minutes; and display the meeting minutes.
14. An electronic device, characterized in that, include: processor; as well as A memory for storing a program for implementing the method according to any one of claims 4 to 12, wherein the device is powered on and the program for running the method is executed by the processor.