Display device and method for generating meeting minutes

Abstract

The embodiment of the present application provides a display device and a method for generating meeting minutes, wherein the display device includes: a display; a controller, which is in communication connection with the display, and the controller is configured to: after the meeting is started, record the multimedia file of the meeting in real time; receive a trigger operation of a meeting minutes control input by a user; in response to the trigger operation of the meeting minutes control, generate and display a floating layer for recording meeting minutes on a meeting interface, and obtain the minutes data input on the meeting record floating layer; when the user exits the meeting record floating layer, generate a meeting record containing a starting recording time and the minutes data, and the starting recording time is the recording time of the multimedia file when the floating layer is generated; send the meeting record to a server, so that the server generates meeting minutes based on all the meeting records of the meeting. The embodiment of the present application improves the efficiency of generating meeting minutes.

Description

Technical Field

[0001] The present application relates to the field of server technology, and in particular to a display device and a method for generating meeting minutes. Background Art

[0002] Meeting minutes are a kind of regulatory official document that records and conveys the basic situation or main spirit of the meeting, agreed matters, etc. To facilitate the preparation of meeting minutes, some conference applications in related technologies are equipped with recording and video recording functions, which can generate audio and video files of the meeting. After the meeting, users can compile meeting minutes based on the audio and video files. However, when the meeting lasts for a long time, it will be time-consuming and laborious to find the content required to generate meeting minutes due to the large size of audio and video files, resulting in low efficiency in generating meeting minutes. Summary of the invention

[0003] In order to solve the technical problem of low efficiency in generating meeting minutes, the present application provides a display device and a method for generating meeting minutes.

[0004] In a first aspect, the present application provides a display device, including:

[0005] monitor;

[0006] A controller is communicatively connected to the display, and the controller is configured to:

[0007] After the meeting is started, recording the multimedia files of the meeting in real time;

[0008] Receive the triggering action of the meeting minutes control from the user;

[0009] In response to the triggering operation of the meeting minutes control, a floating layer for recording meeting minutes is generated and displayed on the meeting interface, and the minutes data input on the meeting minutes floating layer is obtained;

[0010] When the user exits the conference record floating layer, a conference record including a start recording time and the minutes data is generated, wherein the start recording time is the recording time of the multimedia file when the floating layer is generated;

[0011] The meeting record is sent to a server, so that the server generates a meeting minutes based on all the meeting records of the meeting.

[0012] In some embodiments, obtaining the minutes data input on the conference record floating layer includes:

[0013] Obtaining the coordinate area selected by the user on the conference interface;

[0014] Text recognition is performed on the image in the coordinate area, the recognized text is determined as the minutes data input on the conference record floating layer, and the recognized text is added to the input box of the conference record floating layer.

[0015] In some embodiments, obtaining the minutes data input on the conference record floating layer includes:

[0016] The text data inputted by the user in the input box of the conference record floating layer is obtained, and the text data inputted in the input box is determined as the minutes data inputted on the conference record floating layer.

[0017] In some embodiments, obtaining the minutes data input on the conference record floating layer includes:

[0018] The voice data input by the user in the input box of the conference record floating layer is obtained, the voice data is converted into text data, and the converted text data is determined as the minutes data input on the conference record floating layer.

[0019] In some embodiments, obtaining the minutes data input on the conference record floating layer includes:

[0020] The text data sent by the server from another display device is acquired, and the text data sent by the server from another display device is determined as the minutes data input on the conference record floating layer.

[0021] In some embodiments, generating a meeting record including a start recording time and the minutes data includes:

[0022] A meeting record is generated that includes a record type, a start record time, and the record data, wherein the record type includes a key point record type, a to-do record type, and a question-and-answer record type.

[0023] In some embodiments, the meeting minutes control is a key point recording control, a to-do list recording control, or a question and answer recording control, and the minutes type is obtained according to the control data of the meeting minutes control. The minutes type in the control data of the key point recording control is a key point recording type, the minutes type in the control data of the to-do list recording control is a to-do list recording type, and the minutes type in the control data of the question and answer recording control is a question and answer recording type.

[0024] In some embodiments, the controller is further configured to:

[0025] A hyperlink is generated according to the start recording time, and the hyperlink is configured to jump to the start recording time of the multimedia file.

[0026] In a second aspect, the present application provides a method for generating meeting minutes, the method comprising:

[0027] After the meeting is started, recording the multimedia files of the meeting in real time;

[0028] Receive the triggering action of the meeting minutes control from the user;

[0029] In response to the triggering operation of the meeting minutes control, a floating layer for recording meeting minutes is generated and displayed on the meeting interface, and the minutes data input on the meeting minutes floating layer is obtained;

[0030] When the user exits the conference record floating layer, a conference record including a start recording time and the minutes data is generated, wherein the start recording time is the recording time of the multimedia file when the floating layer is generated;

[0031] The meeting record is sent to a server, so that the server generates a meeting minutes based on all the meeting records of the meeting.

[0032] The beneficial effects of the display device and the method for generating meeting minutes provided by the present application include:

[0033] The embodiment of the present application generates a floating layer for recording meeting minutes during the meeting, allowing the user to input minute data during the meeting and determine the starting recording time when the minute data is input. After the meeting, the meeting minutes can be quickly generated based on the minute data input by the user and the starting recording time. If the generated meeting minutes need to be edited, the relative position of the minute data in the multimedia file of the meeting can also be quickly located based on the starting recording time, without the need to view the multimedia file from the beginning, thereby improving the efficiency of generating meeting minutes. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0035] Figure 1 An operation scenario between a display device and a control device according to some embodiments is shown;

[0036] Figure 2 A schematic diagram of a video conference scenario according to some embodiments is shown;

[0037] Figure 3 A schematic diagram showing a flow chart of a method for generating meeting minutes according to some embodiments;

[0038] Figure 4 A partial timing diagram of a method for generating meeting minutes according to some embodiments is shown;

[0039] Figure 5 exemplarily shows a schematic diagram of an interface of a conference application according to some embodiments;

[0040] Figure 6 FIG. 4 exemplarily shows a partial timing diagram of a method for generating meeting minutes according to some embodiments;

[0041] Figure 7 Schematic diagram of the interface of a conference application according to some embodiments is exemplarily shown in FIG.

[0042] Figure 8 FIG. 4 exemplarily shows a partial timing diagram of a method for generating meeting minutes according to some embodiments;

[0043] Fig. 9 exemplarily shows a schematic diagram of an interface of a conference application according to some embodiments;

[0044] Fig.10 FIG. 4 exemplarily shows a partial timing diagram of a method for generating meeting minutes according to some embodiments;

[0045] Fig.11 exemplarily shows a schematic diagram of an interface of a conference application according to some embodiments;

[0046] Fig.12 A partial timing diagram of a method for generating meeting minutes according to some embodiments is shown;

[0047] Fig.13 A schematic diagram of an interface of a meeting minutes according to some embodiments is shown. DETAILED DESCRIPTION

[0048] In order to make the purpose and implementation method of the present application clearer, the exemplary implementation method of the present application will be clearly and completely described below in conjunction with the drawings in the exemplary embodiments of the present application. Obviously, the described exemplary embodiments are only part of the embodiments of the present application, rather than all the embodiments.

[0049] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0050] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0051] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0052] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figure 1 This is a specific implementation of the display device of the present application.

[0053] Figure 1 FIG. 1 is a schematic diagram of an operation scenario between a display device and a control device according to an embodiment. Figure 1 As shown, the user can operate the display device 200 through the smart device 300 or the control apparatus 100 .

[0054] In some embodiments, the control device 100 may be a remote controller, and the communication between the remote controller and the display device includes infrared protocol communication or Bluetooth protocol communication, and other short-range communication methods, and the display device 200 is controlled wirelessly or wired. The user may control the display device 200 by inputting user commands through buttons on the remote controller, voice input, control panel input, etc.

[0055] In some embodiments, a smart device 300 (such as a mobile terminal, a tablet computer, a computer, a laptop computer, etc.) may also be used to control the display device 200. For example, the display device 200 is controlled using an application running on the smart device.

[0056] In some embodiments, the display device may not use the above-mentioned smart device or control device to receive instructions, but may receive user control through touch or gestures.

[0057] In some embodiments, the display device 200 can also be controlled in a manner other than the control device 100 and the smart device 300. For example, the user's voice command control can be directly received through a module for obtaining voice commands configured inside the display device 200, or the user's voice command control can be received through a voice control device set outside the display device 200.

[0058] In some embodiments, the display device 200 also communicates data with the server 400. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactions to the display device 200. The server 400 may be one cluster or multiple clusters, and may include one or more types of servers.

[0059] In some embodiments, a conference application may be installed on the display device 200 , and a user may conduct a video conference with users of other devices that have the conference application installed through the display device 200 .

[0060] In some embodiments, the conference application may not be installed on the display device 200. It only needs to be connected to a device with the conference application installed by wire or wirelessly, and the video screen of the conference application can be displayed and the audio of the conference application can be played.

[0061] See also Figure 2 , is a schematic diagram of a video conference scenario according to some embodiments. Figure 2 As shown, the participants of the video conference may include a speaker, on-site audiences, and online audiences. The device used by the speaker to participate in the video conference is device A, which may be a smart TV, i.e., the display device 200 in the above embodiment. It is assumed that there are three online audiences, and the devices used to participate in the video conference are device B1, device B2, and device B3, wherein device B1 is a laptop, device B2 is a video conferencing device, such as a mobile phone or a tablet, and device B3 is a desktop computer.

[0062] In some embodiments, device A may be a display device supporting touch operations, such as a touch-controlled TV.

[0063] In some embodiments, device A may be a display device that supports voice operation, such as a voice-activated television.

[0064] In some embodiments, device A supports both touch operation and voice operation, and also supports control by terminal devices such as remote controls and smart phones.

[0065] In some embodiments, after the presenter ends the video conference on device A, he or she may compile meeting minutes based on the meeting video and audio recorded by device A. However, this method is less efficient in generating meeting minutes.

[0066] In order to solve the technical problem of low efficiency in generating meeting minutes, the present application embodiment provides a method for generating meeting minutes, see Figure 3 The method for generating the meeting minutes may include the following steps:

[0067] Step S101: after a conference is started, a multimedia file of the conference is recorded in real time.

[0068] In some embodiments, after the speaker starts a meeting in a conference application, the conference application can automatically record a multimedia file of the meeting in real time. The multimedia file may include a video file of the display screen of the speaker's device A after starting the meeting, an audio file, and a subtitle file, wherein the subtitle file can be generated by performing voice recognition on the audio file.

[0069] In some embodiments, the server creates a virtual room for the conference, and different terminals join the virtual room and transmit and exchange audio and video through the virtual room. In some embodiments, the terminal can go to the virtual room according to the user identifier corresponding to the window in the display interface, pull the audio and video data of the corresponding user, and then parse and display it on the terminal.

[0070] In some embodiments, the server can recognize and convert the audio uploaded by each terminal into text, and combine the texts corresponding to different terminals according to time points to form a subtitle file. For example, the subtitles at moment 1 may include the speeches of user 1 and user 2 at the same time, and the subtitles at moment 2 may include the speeches of user 1 and user 3 at the same time.

[0071] In some embodiments, the texts corresponding to different terminals are combined to form a subtitle file, and the text corresponding to a terminal among the different terminals is taken as a text, and the logo corresponding to the terminal is added in front of it. The different texts are arranged to form the subtitle file at that moment. In some embodiments, the above arrangement may include the arrangement of display positions and / or the arrangement of display order.

[0072] In some embodiments, since the conference application is run on a terminal, the screen recorded by the terminal may be the screen displayed on the terminal. In some embodiments, the screens displayed on different terminals of the conference may be different.

[0073] Step S102: receiving a trigger operation of a meeting minutes control input by a user.

[0074] In some embodiments, the meeting minutes control may be displayed only on the presenter's device A, and the meeting minutes control may not be displayed on the devices of participants other than the presenter.

[0075] In some embodiments, the meeting minutes control may be displayed on the device of any participant.

[0076] Taking the example of displaying the meeting minutes control only on the presenter's device A, in some embodiments, after the meeting starts, the meeting minutes control may be displayed on the interface of the presenter's conference application. After the presenter clicks on the meeting minutes control, device A may generate a trigger operation for the meeting minutes control.

[0077] In some embodiments, the meeting minutes control may be a control with a single function, for example, the meeting minutes control may be a control for recording meeting key points, or a control for recording to-do items, or a control for recording interactive questions, etc. Device A may display multiple meeting minutes controls with different functions, and after the user clicks on one of the meeting minutes controls, device A may generate a trigger operation for the control.

[0078] In some embodiments, the meeting minutes control may be a control with integrated functions. After the user clicks on the meeting minutes control, device A may pop up multiple single-function controls such as a control for recording meeting key points, or a control for recording to-do lists, or a control for recording interactive questions for the user to choose.

[0079] If the meeting minutes control is a single-function control, during the meeting, the user may trigger different meeting minutes controls multiple times to generate multiple meeting minutes. If the meeting minutes control is an integrated function control, during the meeting, the user may trigger the control multiple times to select different single-function controls to generate multiple meeting minutes data. Of course, during the meeting, the user may also trigger the meeting minutes control only once to generate only one meeting minutes data.

[0080] Step S103: In response to the triggering operation of the meeting minutes control, a floating layer for recording meeting minutes is generated and displayed on the conference interface, and the minutes data input on the meeting minutes floating layer is obtained.

[0081] Taking the conference minutes control as an example, in some embodiments, device A can generate a floating layer for recording the conference minutes on the conference interface of device A according to the trigger operation of the conference minutes control, and display the floating layer above the conference interface. When generating the floating layer, the current recording time of the multimedia file is obtained as the starting recording time of the conference minutes, and the starting recording time can be called the starting recording time. Exemplarily, the starting recording time is the 10th minute of the meeting.

[0082] In some embodiments, the content in the conference record floating layer is a combination of the current interface and the subtitle file, without the need for manual entry by the user. The combination of the current interface and the subtitle file can be generated by taking a screenshot of the video window layer and the subtitle floating layer, or by combining a screenshot of the video window layer and the text of the subtitle file.

[0083] In some embodiments, the user is required to enter the record content in the meeting record floating layer. The user can enter the minutes data in the meeting record floating layer. The minutes data can be data copied or screenshot by the user from the display interface, or data entered by the user through voice or touch.

[0084] Step S104: When the user exits the conference record floating layer, a conference record including a start recording time and the minutes data is generated, where the start recording time is the recording time of the multimedia file when the floating layer is generated.

[0085] In some embodiments, the user can exit the meeting record pop-up layer using a control in the meeting record pop-up layer (eg, a save control). When exiting the meeting record pop-up layer, device A can automatically save the data entered by the user.

[0086] In some embodiments, after the user exits the meeting record pop-up layer, a hyperlink can be generated based on the starting recording time. The hyperlink is configured to enable the user to access the multimedia file generated by the recording of the meeting after selecting the hyperlink, and jump to the starting recording time of the meeting record pop-up layer corresponding to the multimedia file, and highlight the data of the starting recording time.

[0087] Step S105: Send the meeting record to the server, so that the server generates a meeting minutes based on all the meeting records of the meeting.

[0088] In some embodiments, at the end of the meeting, if the user has only triggered the meeting minutes control once, device A can generate a meeting minutes containing one meeting minutes data; if the user has triggered the meeting minutes control multiple times, device A can generate a meeting minutes containing multiple meeting minutes data.

[0089] It can be seen that the embodiment of the present application sets up a meeting minutes control in the conference application, so that users can generate meeting minutes in real time during the meeting, and by recording the generation time and exit time of the meeting minutes pop-up layer, it is convenient for users to locate the file location corresponding to the meeting minutes in the multimedia file later, so that users can edit the meeting minutes and review the meeting according to the multimedia file later.

[0090] To further describe the method for generating meeting minutes, the generation process of meeting minutes is introduced below in combination with some timing diagrams of the generation process of meeting minutes and some interface diagrams of conference applications.

[0091] See also Figure 4 , is a partial timing diagram of a method for generating meeting minutes according to some embodiments. Figure 4 In the example, an online audience is taken as one person, and device B can be device B1, device B2, device B3, etc., which are devices used by the online audience to participate in the meeting. After the presenter and the online audience successfully enter the same meeting, they can send a meeting joining message to the server, which can include the presenter or the online audience's user ID in the meeting and the meeting ID, so that the server can determine the participating device of the meeting ID.

[0092] In some embodiments, the interface of the conference application may be provided with the following operation controls: screen projection control, microphone control, camera control, conference member control, and meeting minutes control.

[0093] like Figure 4 As shown, after the meeting starts, the speaker opens a presentation material such as a PPT, word file, etc. on device A, clicks the screen projection control on device A, and then operates the microphone control on device A to start the presentation.

[0094] In some embodiments, after receiving the trigger operation of the screen projection control, device A can transmit the display screen on device A to the server in real time. After receiving the trigger operation of the microphone control, device A can turn on the microphone to record the speaker's speech audio and transmit the speech audio to the server in real time. In addition to sending the display screen and speech audio, device A also sends the conference ID to the server at the same time.

[0095] In some embodiments, after receiving the display screen sent by device A, the server may send the display screen to the participating devices other than device A corresponding to the conference ID, such as device B, according to the conference ID. After receiving the speech audio sent by device A, the server converts the sound into subtitle text, and sends the speech audio and subtitle text to the participating devices other than device A corresponding to the conference ID, such as device B. After receiving the video, audio and subtitles, device B plays the video and audio and displays the subtitles.

[0096] In some embodiments, see Figure 5 During the meeting, device A can display the following meeting minutes controls: "Key Points Record" control, "To-Do Record" control, and "Question and Answer Record" control.

[0097] In some embodiments, in addition to Figure 5 In addition to the controls shown, device A can also display other controls, such as controls corresponding to each participant. During the meeting, the controls on device A are automatically hidden to ensure that the speech content is not blocked. If the presenter needs to operate a certain control, the control can be called up through a preset instruction. Exemplarily, the preset instruction can be to operate a preset button, for example, to operate an exit full screen button.

[0098] The following describes the process of generating meeting minutes by taking the speaker operating the "Key Points Record" control, "To-Do Record" control, and "Question and Answer Record" control as examples. No matter which meeting minutes control the speaker operates, device A can generate a corresponding meeting minutes floating layer.

[0099] See also Figure 6 , is a partial timing diagram of a method for generating meeting minutes according to some embodiments.

[0100] like Figure 6 As shown in the figure, the presenter can operate the "Key Points Record" control on device A. Figure 5 If the "Key Points Record" control is operated in the device A, device A can be triggered according to the control to generate a key points record floating layer, and the floating layer can be displayed on the current interface of device A. The floating layer can be a floating layer with adjustable size and position, and the floating layer can be provided with an input box. Device A also records the length of time the multimedia file has been recorded when the speaker operates the "Key Points Record" control, and determines the time when the speaker records the key points based on the length of time. For example, if the recorded time is 10 minutes, the 10th minute is the starting time for recording the minutes of this meeting.

[0101] In some embodiments, the presenter can select text as the main points of the meeting on device A. Figure 7 , the text selected by the presenter for the first time may include "AAAA". In some embodiments, the text selected by the presenter for the second time is "BBBB".

[0102] In some embodiments, if device A supports touch operation, the speaker can select the text as the key points of the meeting by long pressing device A until device A selects a line of text where the speaker's touch point is located or displays a text selection prompt. Device A uses the touch point as the starting point. The speaker selects a line of text and moves the touch position. Device A can expand the selected position and release the touch. The position where the speaker releases the touch is used as the end point, and the rectangular area between the start point and the end point is used as the selected area selected by the user. The selected area is a coordinate area. The text in the selected area is recognized and / or copied to the key point record floating layer, and the text in the selected area is stored in device A. The text in the selected area can be called key point text, and the key point text is used as the minutes data entered by the user, that is, the speaker. Figure 7 In the figure, the text selected by the speaker is the text located in the selected area 501, the text in the area is "AAAA", and the display area of ​​the key point record floating layer is area 502, which can be an input box.

[0103] In some embodiments, if the selected area does not support text copying, for example, the selected area is in picture format, the text in the selected area can be recognized by an OCR (Optical Character Recognition) algorithm and then copied to area 502 .

[0104] In some embodiments, the key point record floating layer supports size adjustment and position adjustment. The key point record floating layer can be configured to adjust the position after receiving a long press operation. The speaker can drag the key point record floating layer, and the adjustment of the position of the key point record floating layer can be completed after releasing the touch. The key point record floating layer can also be configured to adjust the size after receiving a double-click operation. The speaker can slide the corner position of the key point record floating layer to adjust the size of the key point record floating layer. Alternatively, the key point record floating layer can also be configured to pop up a control menu after receiving a long press operation, and multiple controls are displayed in the control menu, such as a mobile control for moving the floating layer position and a size control for adjusting the size of the floating layer.

[0105] In some embodiments, after the speaker copies the text in a selected area to the key point record floating layer, if there is text that needs to be copied in the current interface, he / she selects an area again, and device A overlays the text in the new selected area of ​​the speaker on the key point record floating layer. The overlay method can be set below the last selected text. If the last selected text occupies the area of ​​the key point record floating layer, the key point record floating layer can move the last selected text upward to move part of the text or all of the text out of the upper boundary of the key point record floating layer, so as to make room for the display area for the text in the new selected area, thereby achieving the effect of floating text changes.

[0106] In some embodiments, the key point record floating layer may be provided with a save control. After the presenter clicks the save control, device A may record the recorded duration of the multimedia file at that time to determine the end time of the meeting minutes.

[0107] In some embodiments, after the presenter clicks the save control, device A determines to end the meeting minutes, and transmits the cached user-entered meeting minutes data, the start recording time, and the end time as a key point record to the server.

[0108] For example, the format of the key points record generated by device A is: highlights: {"text":"AAAA\BBBB","time":t1}. Among them, highlights indicates that the type of the meeting minutes is key points record, text is the text selected by the user, and time is the start recording time of this meeting minutes, that is, t1 is a time, such as 10:00, indicating that the start recording time of this meeting minutes is the 10th minute of the meeting.

[0109] In some embodiments, after receiving a key point record, the server can determine whether the key point record is the first meeting minutes corresponding to the meeting ID. If so, it generates a meeting_minutes list and stores the key point record in the meeting_minutes list. If the key point record is not the first meeting minutes corresponding to the meeting ID, the key point record can be added to the meeting_minutes list.

[0110] Exemplarily, the format of a highlight record stored in the server is: [{"type":"highlights","text":"AAAA\BBBB","time":t1}].

[0111] See also Figure 8 , a partial timing diagram of a method for generating meeting minutes according to some embodiments.

[0112] like Figure 8 As shown in the figure, the presenter can operate the "To-do List Record" control on device A. Figure 5 If the "To-do Record" control is operated in the meeting, device A can be triggered according to the control to generate a To-do Record floating layer, and display the floating layer on the current interface of device A. The floating layer can be a floating layer with adjustable size and position. Device A also records the length of time the multimedia file has been recorded when the speaker operates the "To-do Record" control, and determines the time when the speaker records the To-do List based on the length of time. For example, if the recorded time is 20 minutes, the 20th minute is the starting time for recording the minutes of this meeting.

[0113] See also Fig. 9 , the display area of ​​the to-do list record floating layer is area 503, which can be an input box, and the presenter can input the to-do list in area 503 by voice, touch, or through a computer connected to device A. If the user inputs voice data, the voice data is converted into text data, and the text data is used as the minutes data input by the user. If the user enters text data in the input box, the text data entered by the user is directly used as the minutes data entered by the user.

[0114] Exemplarily, the format of the to-do list input by the user is: complete xx items; responsible person: xx; x year x month x day.

[0115] After receiving the to-do list input by the user, device A displays the to-do list.

[0116] In some embodiments, the to-do list pop-up layer may be provided with a save control. After the presenter clicks the save control, device A may record the recorded duration of the multimedia file at that time to determine the end time of the meeting minutes.

[0117] In some embodiments, after the presenter clicks the save control, device A determines to end the meeting minutes, and transmits the cached user-entered meeting minutes data, the start recording time, and the end time as a key point record to the server.

[0118] For example, the format of the to-do list generated by device A is: todo: {"text":"Complete xx item. Responsible person: xx; x month x day", "time": t2}. Todo indicates that the type of the meeting minutes is a to-do record, text is the to-do item entered by the user, and time is the start time of recording the meeting minutes, that is, t2 is a time, such as 20:00, indicating that the start time of recording the meeting minutes is the 20th minute of the meeting.

[0119] In some embodiments, after receiving a to-do record, the server can determine whether the to-do record is the first meeting minutes corresponding to the meeting ID. If so, a meeting_minutes list is generated and the key points record is stored in the meeting_minutes list. If the key points record is not the first meeting minutes corresponding to the meeting ID, the to-do record can be added to the meeting_minutes list.

[0120] Exemplarily, the format of a to-do record stored in the server is: [{"type":"todo","text":"Complete xx item. Responsible person: xx; x month x day","time":t2}].

[0121] See also Fig.10 , is a partial timing diagram of a method for generating meeting minutes according to some embodiments.

[0122] like Fig.10 As shown in the figure, the presenter can operate the "Question and Answer Record" control on device A. Figure 5 If the "Q&A Record" control is operated in the device A, device A can be triggered according to the control to generate a Q&A record floating layer, and display the floating layer on the current interface of device A. The floating layer can be a floating layer with adjustable size and position. Device A also records the length of time the multimedia file has been recorded when the speaker operates the "Q&A Record" control, and determines the time the speaker records the Q&A based on the length of time. For example, if the recorded time is 30 minutes, the 30th minute is the starting time for recording the minutes of this meeting.

[0123] See also Fig.11The display area of ​​the question and answer record floating layer includes area 504 and area 505, wherein area 504 is used to display the audience's questions, and area 505 is used to display the speaker's answers.

[0124] In some embodiments, area 504 and area 505 may also be two separate floating layers, so that the presenter can adjust the positions and sizes of the two areas respectively.

[0125] In some embodiments, the speaker can make an interactive speech after operating the "Question and Answer Record" control to prompt the audience to interact. After the speaker's speech audio is transmitted to device B via the server, device B can play the speech audio, and the audience can ask questions after hearing the speech audio.

[0126] In some embodiments, if an online audience needs to ask a question, they can operate the "Ask" control on their own device, such as device B. After receiving the trigger instruction of the "Ask" control, device B can generate a question request and send the question request to the server. The question request includes the conference ID and the user ID of device B. After receiving the question request, the server can send the question request to device A. After receiving the question request, device A can display a hand-raising icon on the audience control corresponding to the question request, so that the speaker knows that the audience wants to ask a question. The speaker can click the hand-raising icon. After receiving the operation of clicking the hand-raising icon, device A can generate response data for agreeing to ask the question and send the response data to the server. The response data includes the user ID of device B. The server can send the response data to device B based on the user ID. Device B is configured to cancel the mute state of the microphone of device B after receiving the user ID, and update the microphone icon to the recording state, wherein the microphone of device B is set to be in the mute state by default after entering the meeting. After seeing the microphone state, the audience can ask questions. The question can be voice or text.

[0127] In some embodiments, during the question-and-answer session, all devices except those of the speaker and the questioner are muted.

[0128] If the question from the audience received by device B is in the form of voice, device B can transmit the voice to device A via the server, so that device A can play the voice.

[0129] Furthermore, the server also performs voice recognition on the voice sent by device B to obtain question text, and encapsulates the storage address of the voice sent by device B on the server, the question text, the user ID of device B, the user nickname and other data into a data packet, and sends the data packet to device A so that device A displays the question content of device B in area 504, that is, device A can also determine the text data sent by the server from another display device as the minutes data entered on the floating layer of the meeting record.

[0130] For example, when the question from the audience received by device B is voice, the format of the data packet encapsulated by the server is as follows:

[0131] question:{“audience”:”audience 1”,”id”xxx”,”voice”:”xxx”,”text”:”question1”}. “question1” is the question text. “voice” is the storage address of the voice of the audience’s question on the server.

[0132] If the audience's question received by device B is text, device B can encapsulate the text, device B's user ID, user nickname and other data into a data packet and send the data packet to device A, so that device A displays the content of device B's question in area 504.

[0133] For example, when the question from the audience received by device B is in text form, the format of the data packet encapsulated by the server is as follows:

[0134] question:{“audience”:”Audience 1”,”id”:”xxx”,”text”:”question1”}.

[0135] See also Fig.11 After receiving the data packet encapsulated by the server, device A can extract the audience nickname and question text, and display the audience nickname and question text in area 504.

[0136] In some embodiments, after seeing the question text displayed in area 504 , the presenter may respond to the question text.

[0137] After receiving the reply data of the speaker, such as the reply audio, device A may encapsulate the reply data into the following format:

[0138] answer:{"text":"xxx","voice":"xxx"}.

[0139] In some embodiments, device A can transmit the packaged question data, answer data, and answer audio to the server, and the server can transmit the packaged question data, answer data, and answer audio to device B, so that device B plays the speaker's answer audio. Fig.11 The floating layer shown on the right side, in which device B can display its own question data and the speaker's answer data.

[0140] In some embodiments, after the presenter clicks the close button in area 504, device A determines to end the current audience's question and answer session, and device A can generate a question and answer record of the current audience's question and answer session in the following format:

[0141]

[0142] After generating a question-and-answer record, device A may clear the display data in area 504 and area 505, and the speaker may start the next round of question-and-answer.

[0143] In some embodiments, the question and answer record floating layer may be provided with a save control, and the speaker clicks the save control. Then multiple question and answer records and the start recording time of the question and answer are sent to the server, and the server stores the question and answer records in the following format:

[0144]

[0145]

[0146] Among them, time is the time of this meeting minutes, that is, t3 is a moment, such as 30:00, which means that the time range of this meeting minutes is the 30th minute of the meeting.

[0147] According to the above embodiment, during the meeting, the speaker can set multiple meeting records of different minutes types or the same minutes type. The process of the server collating these meeting records into one meeting minute can be found in Fig.12 , is a partial timing diagram of a method for generating meeting minutes according to some embodiments.

[0148] like Fig.12 As shown, after the presenter clicks to exit the meeting, device A can generate and send a meeting minutes generation request to the server based on the received operation of exiting the meeting. The request may include the meeting ID.

[0149] In some embodiments, after receiving a request to generate meeting minutes, the server can obtain multiple meeting records corresponding to the meeting ID, and generate a hyperlink to the multimedia file of the meeting ID based on the starting recording time in each meeting record. The hyperlink can be a link that can jump to the meeting application, and the jump position is the corresponding starting recording time.

[0150] In some embodiments, the server may also arrange meeting records of the same type adjacent to each other according to the minute type in each meeting record. The minute types include key point record type, to-do record type and question and answer record type. The key point record type is represented by highlights, the to-do record type is represented by todo, and the to-do record type is represented by qa_record.

[0151] See also Fig.13 , is a schematic diagram of the interface of meeting minutes according to some embodiments. Fig.13 In the conference, the topic, time, speakers and participants can be determined by the speaker at the conference booking stage before the meeting begins.

[0152] like Fig.13 As shown, the content of the key point record is generated according to the record of type="highlights" in meeting_minutes. The text value of each key point is obtained from the text field, and its hyperlink is generated according to the time field and the meeting number to the video conference app, that is, the jump link of the conference application, such as videoconf: / / conference_id=12345&type=highlights&time=t1;

[0153] The content of the to-do list is generated based on the records with type="todo" in meeting_minutes. The text value of each record is obtained from the text field, and its hyperlink is a jump link to the video conference app generated based on the time field and the meeting number, such as videoconf: / / conference_id=12345&type=todo&time=t2;

[0154] The content of the QA record is generated based on the record with type = "qa_record" in meeting_minutes. The text value of each question and answer record is obtained from the qa_record.record.question.text and qa_record.record.answer.text fields. Its hyperlink is a jump link to the video conference app generated based on the qa_record.time field and the meeting number, such as videoconf: / / conference_id=12345&type=qa_record&time=t3.

[0155] like Fig.13 As shown, some minutes types, such as question-and-answer minutes, may not generate hyperlinks.

[0156] In some embodiments, after the speaker confirms that the content is correct, he logs in to the video conference background and clicks to confirm the sending. The server will send an email to all the audience participating in the meeting. The audience can jump to the multimedia file, such as the specified time of the speech video playback, through the hyperlink in the body of the email on the device with the video conference application installed. For example, clicking on a hyperlink of a meeting key points record will jump to the start recording time of the meeting key points record.

[0157] It can be seen from the above embodiments that the embodiments of the present application generate a floating layer for recording meeting minutes during the meeting, so that the user can input the minutes data during the meeting and determine the starting recording time when the minutes data is input. After the meeting, the meeting minutes can be quickly generated according to the minutes data input by the user and the starting recording time. If the generated meeting minutes need to be edited, the relative position of the minutes data in the multimedia file of the meeting can also be quickly located according to the starting recording time, and there is no need to view the multimedia file from the beginning, thereby improving the efficiency of generating meeting minutes.

[0158] Since the above embodiments are all described by citing and combining with other embodiments, different embodiments have the same parts, and the same and similar parts between the embodiments in this specification can be referred to each other. No further detailed description is given here.

[0159] It should be noted that, in this specification, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a circuit structure, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such circuit structure, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the circuit structure, article or device including the element.

[0160] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the disclosure of the invention herein. The present application is intended to cover any modification, use or adaptation of the present invention, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present application. The specification and examples are to be considered as exemplary only, and the true scope and spirit of the present application are indicated by the content of the claims.

[0161] The above implementation modes of the present application do not constitute a limitation on the protection scope of the present application.

Claims

1. A display device, characterized in that: include: monitor; A controller is communicatively connected to the display, and the controller is configured to: After the meeting is started, recording the multimedia files of the meeting in real time; Receiving a trigger operation of a meeting minutes control input by a user, wherein the meeting minutes control includes a first control of an interactive question recording function; In response to the triggering operation of the meeting minutes control, a meeting minutes floating layer for recording meeting minutes is generated and displayed on the meeting interface, and the minutes data input on the meeting minutes floating layer is obtained; wherein, when the meeting minutes control is the first control, the meeting minutes floating layer includes a first area for inputting question information, a second area for inputting reply information, and a close control for clearing the displayed data in the first area and the second area, the minutes data is generated by the controller according to the displayed data in the first area and the second area in response to receiving the triggering operation of the close control, and the controller also clears the displayed data in the first area and the second area in response to receiving the triggering operation of the close control, so that the meeting minutes floating layer is used to display the question information and reply information of the next round; When the user exits the conference record floating layer, a conference record including a start recording time and the minutes data is generated, wherein the start recording time is the recording time of the multimedia file when the floating layer is generated; The meeting record is sent to a server, so that the server generates a meeting minutes based on all the meeting records of the meeting.

2. The display device according to claim 1, characterized in that Obtain the minutes data entered on the meeting record floating layer, including: Obtaining the coordinate area selected by the user on the conference interface; Text recognition is performed on the image in the coordinate area, the recognized text is determined as the minutes data input on the conference record floating layer, and the recognized text is added to the input box of the conference record floating layer.

3. The display device according to claim 1, characterized in that Obtain the minutes data entered on the meeting record floating layer, including: The text data inputted by the user in the input box of the conference record floating layer is obtained, and the text data inputted in the input box is determined as the minutes data inputted on the conference record floating layer.

4. The display device according to claim 1, characterized in that Obtain the minutes data entered on the meeting record floating layer, including: The voice data input by the user in the input box of the conference record floating layer is obtained, the voice data is converted into text data, and the converted text data is determined as the minutes data input on the conference record floating layer.

5. The display device according to claim 1, characterized in that Obtain the minutes data entered on the meeting record floating layer, including: The text data sent by the server from another display device is acquired, and the text data sent by the server from another display device is determined as the minutes data input on the conference record floating layer.

6. The display device according to claim 1, characterized in that Generate a meeting record containing the start recording time and the minutes data, including: A meeting record is generated that includes a record type, a start record time, and the record data, wherein the record type includes a key point record type, a to-do record type, and a question-and-answer record type.

7. The display device according to claim 6, characterized in that The meeting minutes control also includes a key point recording control and a to-do item recording control, and the minutes type is obtained from the control data of the meeting minutes control.

8. The display device according to claim 1, characterized in that The controller is also configured to: A hyperlink is generated according to the start recording time, and the hyperlink is configured to jump to the start recording time of the multimedia file corresponding to the conference record floating layer.

9. The display device according to claim 1, characterized in that: Before acquiring the minutes data input on the conference record floating layer, the controller is further configured to: In response to a question request from another display device, generating a question identification indicating that the question request has been received; In response to the triggering operation of the questioning identifier, generating response data representing agreement to the questioning; The other display device is configured to: update the microphone from a mute state to a recording state according to the response data, so as to receive the question data, and send the question data to the server.

10. A method for generating meeting minutes, characterized in that: include: After the meeting is started, recording the multimedia files of the meeting in real time; Receiving a trigger operation of a meeting minutes control input by a user, wherein the meeting minutes control includes a first control of an interactive question recording function; In response to the triggering operation of the meeting minutes control, a meeting minutes floating layer for recording meeting minutes is generated and displayed on the meeting interface, and the minutes data input on the meeting minutes floating layer is obtained; wherein, when the meeting minutes control is the first control, the meeting minutes floating layer includes a first area for inputting question information, a second area for inputting reply information, and a close control for clearing the displayed data in the first area and the second area, and the obtaining of the minutes data input on the meeting minutes floating layer includes: displaying the question data in the first area, and displaying the reply data in the second area; in response to the triggering operation of the close control, storing the question data and the reply data as minutes data, and clearing the displayed data in the first area and the second area, so that the meeting minutes floating layer is used to display the next round of question information and reply information; when the user exits the meeting minutes floating layer, a meeting record including a starting recording time and the minutes data is generated, and the starting recording time is the recording time of the multimedia file when the floating layer is generated; The meeting record is sent to a server, so that the server generates a meeting minutes based on all the meeting records of the meeting.

11. The method for generating meeting minutes according to claim 10, characterized in that: Obtain the minutes data entered on the meeting record floating layer, including: Obtaining the coordinate area selected by the user on the conference interface; Text recognition is performed on the image in the coordinate area, the recognized text is determined as the minutes data input on the conference record floating layer, and the recognized text is added to the input box of the conference record floating layer.

Images