Information processing device and information processing method

Abstract

To provide an information processing device and an information processing method for generating minute book data on the basis of both voice recognition result obtained by analyzing voice data of each utterance during a conference and operation contents and operation times of memo inputs or the like by participants.SOLUTION: An information processing device 100 includes a voice information acquisition part 111, a voice recognition part 112, an operation information acquisition part 113, and a minute book generation part 114. The voice information acquisition part 111 acquires voice information Ix including voice data Dx and an utterance time tx in each utterance by a plurality of participants P of a conference. The voice recognition part 112 converts the voice data Dx into character data Dc. The operation information acquisition part 113 acquires operation information Iy including operation contents Cy and an operation time ty in each operation by the participants P. The minute book generation part 114 generates minute book data Dm on the basis of the voice information Ix, the character data Dc, and the operation information Iy.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present disclosure relates to an information processing apparatus and an information processing method.

Background Art

[0002] In the browsing system described in Patent Document 1, for each speech time information, the identification information of the speaker and the text data of the speech recognition result are associated and stored. On the speech list screen of a series of speech recognition results, markers can be added to the speeches, and the speeches can be searched according to specified search conditions. The searched results are displayed on the search screen.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] Conventionally, even if a participant himself / herself performs an operation such as memo input on a terminal device or the like, the content of the operation is not reflected in the content of the automatically generated minutes of the meeting, so the content of the minutes of the meeting may not be accurate.

[0005] An object of the present disclosure is to provide an information processing apparatus and an information processing method that generate accurate minutes data based not only on character data converted from voice data for each speech during a meeting but also on the operation content in a terminal device by a participant.

Means for Solving the Problems

[0006] The information processing apparatus of the present disclosure includes a voice information acquisition unit, a voice recognition unit, an operation information acquisition unit, and a minutes generation unit. The voice information acquisition unit acquires voice information including voice data and a speech time for each speech by a plurality of participants in a meeting. The voice recognition unit converts the voice data into character data. The operation information acquisition unit acquires operation information including an operation content and an operation time for each operation by the participant. The minutes generation unit generates minutes data based on the voice information, the character data, and the operation information.

[0007] The information processing method of the present disclosure includes a voice information acquisition step, a voice recognition step, an operation information acquisition step, and a minutes generation step. In the voice information acquisition step, voice information including voice data and a speech time is acquired for each speech by a plurality of participants in a meeting. In the voice recognition step, the voice data is converted into character data. In the operation information acquisition step, operation information including an operation content and an operation time is acquired for each operation by the participant. In the minutes generation step, minutes data is generated based on the voice information, the character data, and the operation information.

Effect of the Invention

[0008] According to the present disclosure, minutes data is generated based not only on character data converted from voice data for each speech during a meeting but also on the operation content in the terminal device by the participant. As a result, more accurate generation of minutes is possible by appropriately reflecting the operation content by the participant.

Brief Description of the Drawings

[0009]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0010] Embodiments of the present disclosure will be described with reference to the drawings. Note that the same or corresponding parts in the drawings are denoted by the same reference numerals and the description will not be repeated.

[0011] <First Embodiment> 1.1 Overall Configuration of the Minutes Generation System 1 First, with reference to FIG. 1, the overall configuration of the minutes generation system 1 including the information processing device 100 that automatically generates the minutes of a meeting will be described. FIG. 1 is a block diagram showing the configuration of the minutes generation system 1 including the information processing device 100 according to the first embodiment of the present disclosure.

[0012] As shown in FIG. 1, the minutes generation system 1 includes an information processing device 100 and a terminal device 10. The terminal device 10 is a device that a participant P operates to create his / her own minutes, memo, etc. during or before and after a meeting. This terminal device 10 is network-connected to the information processing device 100 by wire or wirelessly, but the connection method is not limited to network connection. For example, the terminal device 10 may be directly connected to the information processing device 100 by a USB cable, a dedicated cable, or a wireless connection method such as Bluetooth (registered trademark).

[0013] 1.2 Configuration of the Information Processing Device 100 The information processing apparatus 100 includes a CPU (Central Processing Unit) 110, a display unit 120 having a display screen 121, a storage unit 130, a communication unit 140, and an audio input unit 150.

[0014] The audio input unit 150 receives the voice of the speech X by each participant P and outputs the audio data Dx to the audio information acquisition unit 111. The audio input unit 150 may output not only the directly input voice but also, for example, the audio data transmitted from the outside via a network and received by the communication unit 140 to the audio information acquisition unit 111.

[0015] Examples of the audio input unit 150 include a microphone, but are not limited thereto. The audio input unit 150 may be built into the information processing apparatus 100. The audio input unit 150 may be a wired or wireless hand microphone, or a microphone of a wireless headset may be applied. Also, two or more of these may be used in combination. When a wireless headset is connected to the terminal device 10, the audio data from the microphone is received by the information processing apparatus 100 via the communication unit 16 and the communication unit 140 and transmitted to the audio input unit 150. However, the wireless headset may be directly connected to the information processing apparatus 100 wirelessly. When a plurality of wireless headsets are used, since each participant P uses a separate wireless headset, the speech X of a plurality of participants P does not mix in one audio data. Thereby, it becomes easy to identify the speaker of the audio data.

[0016] The CPU 110 controls each part of the information processing apparatus 100. The CPU 110 includes an audio information acquisition unit 111, an audio recognition unit 112, an operation information acquisition unit 113, a minutes generation unit 114, a display control unit 115, and a clock unit 116.

[0017] The CPU 110 may be, for example, a processor or an MPU (Micro Processing Unit), but is not limited thereto. For example, if an OS (Operating System, sometimes called "basic software") that operates on this CPU 110 and programs for each function corresponding to the above-mentioned respective parts are stored in the storage unit 130, the above-mentioned respective parts are realized by the CPU 110 executing those OS and programs. Examples of the OS include, but are not limited to, Microsoft Windows (registered trademark), Android (registered trademark), and Linux (registered trademark). The above-mentioned respective parts may be composed of an electronic circuit, a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Array), an ASIC (Application Specific Integrated Circuit), etc., but are not limited thereto.

[0018] The clock unit 116 has a clock function and outputs at least the time, minute, and second data at that point in time. The clock unit 116 may further have a calendar function and be capable of outputting year, month, and day data.

[0019] The voice information acquisition unit 111 acquires voice information Ix including voice data Dx and a speaking time tx for each utterance X by a plurality of participants P in a meeting. The voice information acquisition unit 111 acquires the voice data Dx from the voice input unit 150 and acquires the speaking time tx from the clock unit 116. For example, when the speaker of each voice data Dx is known in advance by each participant P using an individual wireless headset or the like, the voice information Ix may include the speaker's name.

[0020] The voice recognition unit 112 converts the voice data Dx into character data Dc. Examples of voice recognition include, but are not limited to, existing technologies in which AI (Artificial Intelligence) analyzes words or conversations uttered by humans and converts them into text data.

[0021] The operation information acquisition unit 113 acquires operation information Iy including operation content Cy and operation time ty for each operation Y by the participant P. Examples of the operation content Cy include input of characters, symbols, etc., and specific operations. Input of characters, symbols, etc. includes, for example, input of a predetermined character string related to the progress of the meeting, input of special symbols (e.g.,? or ☆), but is not limited thereto. Specific operations, etc. include click operations, double-click operations, tap operations, etc., but are not limited thereto.

[0022] The minutes generation unit 114 generates minutes data Dm based on the voice information Ix, character data Dc, and operation information Iy.

[0023] Therefore, the minutes data is generated not only based on the character data Dc converted from the voice data Dx for each speech X during the meeting, but also based on the operation content such as memo input by the participant P. As a result, more accurate generation of the minutes is possible by appropriately reflecting the operation content Cy by the participant P. Note that the minutes data Dm includes, for example, the content for each speech X (so-called "transcription"), summary, excerpts of the speech content, but is not limited thereto.

[0024] The minutes generation unit 114 may generate the minutes data Dm by regarding the operation content Cy corresponding to the operation time ty included in the predetermined proximity time tn determined for each character data Dc as corresponding to the character data Dc. The predetermined proximity time tn is the time from the speech time tx corresponding to the character data Dc until a predetermined time has elapsed. As this predetermined time, for example, about several seconds to ten-odd seconds is assumed, but is not limited to such a time. Furthermore, when the operation content Cy includes input data of characters, since the input data is approximated, the corresponding character data Dc may be specified. By combining the approximation judgment by the input characters, it is also possible to more accurately specify the corresponding character data Dc. Note that the predetermined proximity time tn will be described later with reference to FIG. 2.

[0025] Therefore, the operation content Cy that is highly likely to actually correspond is reflected in the character data Dc converted from the voice data Dx for each speech X, and the minutes data Dm is generated. As a result, more accurate generation of the minutes becomes possible.

[0026] The display unit 120 displays the character data Dc. Also, as will be described later, the content of the operation content Cy may be displayed so that it can be visually confirmed. Further, the minutes data Dm generated at regular intervals may also be displayed on the display unit 120. As a result, it becomes possible to visually confirm how the content of the operation content Cy and the minutes data Dm are created.

[0027] The display unit 120 includes those without memory properties and those with memory properties. Examples of the display unit without memory properties include, but are not limited to, liquid crystal and organic EL (Organic Electro-Luminescence). Examples of the display unit with memory properties include, but are not limited to, electronic paper.

[0028] The display control unit 115 may cause the display unit 120 to display the character data Dc and the operation information Iy. Therefore, the character data Dc converted from the voice data Dx, and the operation information Iy including the operation content Cy and the operation time ty are displayed on the display unit 120. As a result, it becomes possible to visually confirm what operations were performed on what speech X.

[0029] The storage unit 130 stores the voice data Dx associated with the speech time tx and stores the operation content Cy associated with the operation time ty. Therefore, the voice data Dx for each speech X is stored associated with the speech time tx, and the operation content Cy is stored associated with the operation time ty. As a result, it becomes possible to generate the minutes data Dm not only during the meeting but also after the meeting.

[0030] The storage unit 130 also stores information and data necessary for controlling each part of the information processing apparatus 100. The storage unit 130 may store or hold an OS, programs, etc. executed by the CPU 110. The storage unit 130 includes a memory, specifically, a volatile memory and a non-volatile memory. The volatile memory includes, for example, but is not limited to, DRAM (Dynamic Random Access Memory) and SRAM (Static Random Access Memory). The non-volatile memory includes, for example, but is not limited to, ROM (Read-Only Member), flash memory, SSD (Solid State Drive), and hard disk.

[0031] The communication unit 140 is connected to the communication unit 16 of the terminal device 10 by wire or wirelessly. Thereby, the terminal device 10 and the information processing apparatus 100 can communicate bidirectionally.

[0032] 1.3 Temporal relationship between the speech X and operation Y by each participant P Next, with reference to FIG. 2, a determination example of whether the speech X and operation Y by each participant P are temporally close will be described. FIG. 2 is a time chart showing the temporal relationship between the speech X and operation Y by each participant P.

[0033] As shown in FIG. 2, it is assumed that the voice data Dx for each speech X in the order of the speech time tx is managed with a serial number or time information attached. For example, the nth voice data Dx is denoted as "Dr(n)" here. Each voice data Dx is illustrated as a rectangle, and the horizontal width of this rectangle corresponds to the duration of each speech X. The left end of the rectangle corresponds to the start time of the speech X, and the right end of the rectangle corresponds to the end time of the speech X.

[0034] The speech time tx corresponds to the start time (left end of the rectangle) of each speech X here, but is not limited to such correspondence. The speech time tx may be, for example, the intermediate time between the start time and the end time.

[0035] Each voice data Dx has corresponding character data Dc converted by the voice recognition unit 112. This character data Dc is also managed with a serial number or time information attached, similar to the voice data Dx. The nth voice data Dx(n) corresponds to the nth character data Dc(n).

[0036] On the other hand, the operation content Cy performed by the participant P during the meeting is also managed with a serial number or time information attached in the same way. For example, the mth operation content Cy is denoted as "Co(m)" here.

[0037] As described above, the minutes generation unit 114 regards the operation content Cy corresponding to the operation time ty included in the predetermined proximity time tn determined for each character data Dc as corresponding to the character data Dc. For example, below the character data Dc(n) at the upper center of FIG. 2, a range of the predetermined proximity time tn is shown just above the time axis t. This predetermined proximity time tn includes the operation time ty of the operation content Cy(m). Therefore, the minutes generation unit 114 regards the operation content Cy(m) as corresponding to the character data Dc(n).

[0038] That is, the minutes generation unit 114 determines that the operation content Cy(m) is temporally close to the nth speech X. This means that there is a high possibility that the operation content Cy(m) corresponds to the nth speech X.

[0039] However, for example, when the duration is long like the (n + 1)th speech X, it may be difficult to accurately determine which part of the speech X any operation Y is temporally close to. For such a speech X, for example, it is preferable to subdivide each sentence within the speech X and handle them separately. For example, if the (n + 1)th speech X is divided into four parts, it can be determined that the second part is temporally close to the operation content Cy(m + 1).

[0040] 1.4 Configuration of the Terminal Device 10 As described above, the terminal device 10 is a device that a participant P operates to create his / her own minutes, memo, etc. during or before and after a meeting. Examples of the terminal device 10 include, but are not limited to, a notebook computer, a smartphone, and a tablet.

[0041] As shown in FIG. 1, the terminal device 10 includes a CPU 11, an imaging unit 12, an operation unit 13, a display unit 14, a storage unit 15, and a communication unit 16. Since these hardware configurations are the same as those of general notebook computers, smartphones, tablets, etc., detailed descriptions thereof are omitted.

[0042] The imaging unit 12 reads the face of the participant P operating the terminal device 10. It is also possible to identify the participant P by recognizing the face image. Examples of the imaging unit 12 include, but are not limited to, a built-in camera.

[0043] The operation unit 13 receives operation inputs. Examples of the operation unit 13 include, but are not limited to, buttons, a keyboard, and a touch panel that enables touch operations.

[0044] Examples of the display unit 14 include, but are not limited to, liquid crystal and organic EL. The display unit 14 may be a touch panel or may be combined with the operation unit 13.

[0045] 1.5 Display example of minutes by the information processing device 100 Next, with reference to FIGS. 3 to 5, a display example of minutes by the information processing device 100 will be described. FIG. 3 is an explanatory diagram illustrating an operation in which a participant P creates his / her own minutes, memo, etc. on the terminal device 10. FIG. 4 is an explanatory diagram showing an example in which operation inputs, etc. on the terminal device 10 are reflected in the minutes generated by the information processing device 100. FIG. 5 is an explanatory diagram showing an example in which key points and a summary are displayed together with the minutes.

[0046] 1.5.1 Display example on the terminal device 10 As shown in FIG. 3, when a participant P performs an operation such as character input from the operation unit 13 in the terminal device 10 connected to the information processing device 100, the input content is displayed on the display unit 14, and additional display by the information processing device 100 is also performed. Note that the operation content Cy in the terminal device 10 is stored in the storage unit 130 in association with the operation time ty each time.

[0047] For example, when a single sentence such as "Explanation from the other party" is input, the single sentence is displayed on the display unit 14. The operation time ty is displayed right-aligned on the same line where the single sentence is displayed.

[0048] When a special symbol (in this case, "?") such as "Number of employees???" is input in a part that the participant P could not hear, if possible based on the character data Dc, the content is complemented and displayed as "Number of employees: 120".

[0049] When "☆" is preset as one of the symbols for designating important parts, for example, when inputting "☆ More than 1000 introducing companies", the operation time ty is highlighted. Examples of this highlighting include, but are not limited to, display in a more prominent color or boldface.

[0050] For example, when an input including a character string related to the progress of the meeting such as "Conclusion" is made, it is recorded that the topic is segmented at the position corresponding to the operation time ty. How it is segmented, etc., may be displayed in a form that can be clearly shown to the user on the display unit 120, or may be used when reflected at the time of generating the minutes by the minutes generation unit 114 without display.

[0051] 1.5.2 Display Examples in the Information Processing Device 100 As shown in FIG. 4, character data Dc is displayed on the display unit 120 of the information processing device 100. Specifically, for example, each speech X that has been transcribed is displayed in chronological order together with the speech time tx and the name of the speaker.

[0052] For a statement X for which an operation Y determined to be temporally proximate exists, the operation content Cy thereof is displayed right-justified on the same line. Along with this operation content Cy, the operation time ty and the operator name may also be displayed. For example, for the statement X by Mr. Kawasaki at 14:15, a display is made such that it can be immediately seen that there was a reaction by Mr. Yoshimura, a participant P, at 14:19. In this display, the content of the reaction is not known, but it may be replaced with a display that shows the content. Note that on the terminal device 10 used by Mr. Yoshimura, an application (annotation application) suitable for the present disclosure is launched, and the display unit 14 shows that Mr. Yoshimura input "In favor of the majority" at 14:19. Note that the display position and display method are not limited to the above.

[0053] Further, when the input of the character string C regarding the progress of the meeting is included in the operation content Cy, the minutes generation unit 114 may divide the minutes data Dm for each topic at the position corresponding to the character string C. Therefore, when the input of the character string C regarding the progress of the meeting is included in the operation content Cy of the participant P, the minutes data Dm is divided for each topic at the position corresponding to the character string. As a result, the minutes data Dm is accurately divided for each topic.

[0054] The display unit 120 of the information processing apparatus 100 shows that Mr. Tanaka spoke at 14:24, saying "Thank you. Then I would like to move on to the next topic." In response to this statement X, it is shown on the display unit 14 of the terminal device 10 that Mr. Yoshimura input "----" at 14:28. Here, "-" or consecutive "-" is one of the character strings regarding the progress of the meeting. Therefore, the minutes generation unit 114 may divide the minutes data Dm at the position corresponding to this "----". A dividing line may be displayed at this dividing position. Also, a character string "Topic division" may be displayed on the same line as this dividing line, together with the operation time ty and the operator name. Note that the display position and display method are not limited to the above.

[0055] When the operation content Cy includes the input of a predetermined operation or a predetermined symbol, the minutes generation unit 114 may generate minutes data Dm with the portion corresponding to the operation content Cy being regarded as an important portion. Therefore, when the operation content Cy includes the input of a predetermined operation or a predetermined symbol, the portion corresponding to the predetermined operation is regarded as an important portion. As a result, important portions are accurately discriminated in the minutes data Dm.

[0056] On the display unit 120 of the information processing apparatus 100, it is displayed that at 15:04, Mr. Yamada made a statement "Please summarize including the supplement to the content reported last time." In response to this statement X, it is displayed on the display unit 14 of the terminal device 10 that at the same 15:04, Mr. Yoshimura input "!". Here, "!" is one of the symbols indicating important portions during the meeting. Therefore, the minutes generation unit 114 may generate minutes data Dm with the portion corresponding to this "!" being regarded as an important portion. For the statement X regarded as an important portion, a mark or the like indicating its importance may be displayed together with the operation time ty and the operator name on the same line. Specifically, it may be displayed in a more prominent color or with reverse display or the like. Note that the display position and display method are not limited to the above.

[0057] 1.5.3 Another display example in the information processing apparatus 100 As shown in FIG. 5, in the information processing apparatus 100, key points and a summary may be displayed together with the character data Dc. For example, assume that the display screen 121 of the display unit 120 is divided into left and right, and the right side is further divided into upper and lower limits. At this time, each statement X transcribed into characters may be displayed on the left side, the key points extracted on the upper right, and the summary on the lower right. Note that the display position and display method are not limited to the above.

[0058] The minutes generation unit 114 may extract key points from the generated minutes data Dm based on the important portions, and generate a summary of the minutes data Dm. Therefore, not only is the minutes data Dm generated, but also key points are extracted and a summary is generated based on the portions considered important by the participants P. As a result, more accurate key points and summaries can be obtained.

[0059] Note that although it is possible to summarize the main points and summary after the meeting and generate them as minutes, it is also possible to update the display content of the display screen 121 by generating or modifying them in real time according to the progress of the speech X by the participant P and the operation Y from the terminal device 10, or based on the amount of speech, elapsed time, and timing of topic segmentation after the start of the meeting.

[0060] 1.6 Information processing method for generating minutes by the information processing apparatus 100 Next, with reference to FIG. 6, an outline of an information processing method for generating minutes by the information processing apparatus 100 will be described. FIG. 6 is a flowchart showing the information processing method by the information processing apparatus 100.

[0061] As shown in FIG. 6, first, in step S1, the voice information acquisition unit 111 acquires voice information Ix including voice data Dx and speech time tx for each speech X by a plurality of participants P in the meeting. Note that this step S1 is an example of the "voice information acquisition step" of the present disclosure.

[0062] In step S2, the voice recognition unit 112 analyzes the voice data Dx and converts it into character data Dc. Note that this step S2 is an example of the "voice recognition step" of the present disclosure.

[0063] In step S3, the operation information acquisition unit 113 acquires operation information Iy including operation content Cy and operation time ty for each operation Y by the participant P. Note that this step S3 is an example of the "operation information acquisition step" of the present disclosure.

[0064] Finally, in step S4, after the minutes generation unit 114 generates minutes data Dm based on the voice information Ix, character data DDc, and operation information Iy, a series of processes are terminated. Note that this step S4 is an example of the "minutes generation step" of the present disclosure.

[0065] Therefore, the minutes data is generated based not only on the speech recognition result (character data Dc) obtained by analyzing the voice data Dx for each speech X during the meeting, but also on the operation content Cy such as memo input by the participant P. As a result, more accurate generation of the minutes is possible by appropriately reflecting the operation content Cy by the participant P.

[0066] <Second Embodiment> Next, with reference to FIG. 7, a case where a plurality of participants P perform operation inputs and the like on their respective terminal devices 10 will be described. FIG. 7 is an explanatory diagram showing an example in which operation inputs and the like from a plurality of terminal devices 10 are reflected in the minutes generated by the minutes generation system 1A according to the second embodiment of the present disclosure.

[0067] As shown in FIG. 7, the minutes generation system 1A includes an information processing device 100 and terminal devices 10. Note that the information processing device 100 and each terminal device 10 basically have the same configuration as that of the first embodiment. When it is necessary to individually identify each terminal device 10, reference numerals such as 10-1, 10-2, and 10-3 will be used. Hereinafter, the differences from the first embodiment will be mainly described.

[0068] When the operation information acquisition unit 113 acquires the operation information Iy including the operation content Cy from a plurality of participants P, the minutes generation unit 114 may regard the locations in the minutes data Dm corresponding to the operation content Cy from the plurality of participants P as important locations. Therefore, when there are input operations from a plurality of participants P, the locations corresponding to their operation content Cy are regarded as important locations in the minutes data Dm. As a result, important locations in the minutes data are more accurately discriminated.

[0069] The display of the speech recognition results of each speech X in the display unit 120 of the information processing device 100, with the speech time tx and the name of the speaker in chronological order, and further the operation content Cy is the same as the display shown in FIG. 4.

[0070] After receiving the statement from Mr. Yamada at 14:04, "We will adopt Plan A. Is there any objection?", Mr. Kawasaki spoke at 14:15 and Mr. Kinoshita spoke at 14:19. Although Mr. Takeda and Mr. Yoshimura did not speak, it can be seen that they reacted at 14:05 and 14:19 respectively. Based on these statements and reactions, it is clearly understood that Mr. Tanaka's statement at 14:24, "Thank you. Then I would like to move on to the next topic.", was made after it was determined that the consent of Participant P was obtained.

[0071] The fact that there are multiple reactions to a specific statement X can be judged as highly likely that the statement X corresponds to an important part. If the number of Participant P is small, it may be judged that just having multiple reactions makes it highly likely to correspond to an important part, but this is not the case when the number of Participant P is large. For example, a threshold for the number of people can be set, and it may be judged that it is highly likely to correspond to an important part only when there are reactions from a number of people exceeding that threshold. Also, for example, the weight of the judgment may be changed according to the role or position of Participant P. For example, it may be limited to 5 or more for ordinary employees, while for officers, it may be judged that even 1 person is highly likely to correspond to an important part. Regarding the role or position of Participant P, for example, the role, position, or weight of judgment, etc. may be stored in the storage unit 130 associated with the name of the participant.

[0072] The present invention can be implemented in various other forms without departing from its gist or main features. Therefore, the above-described embodiments are merely illustrative in every respect and should not be construed in a limiting sense. The scope of the present invention is indicated by the claims and is not restricted by the text of the specification at all. Further, modifications and changes belonging to the equivalent scope of the claims are all within the scope of the present invention.

Industrial Applicability

[0073] This disclosure can be used in an information processing apparatus, an information processing method, and the like.

Explanation of Signs

[0074] 1 Minutes generation system 1A Minutes generation system 10 Terminal device 11 CPU 12 Imaging unit 13 Operation unit 14 Display unit 15 Memory unit 16 Communication unit 100 Information processing device 110 CPU 111 Audio information acquisition unit 112 Speech recognition unit 113 Operation information acquisition unit 114 Minutes generation unit 115 Display control unit 116 Clock unit 120 Display unit 121 Display screen 130 Memory unit 140 Communication unit 150 Audio input unit

Claims

1. An audio information acquisition unit that acquires audio information including audio data and the speech time for each speech by a plurality of participants in a meeting; An audio recognition unit that converts the audio data into character data; An operation information acquisition unit that acquires operation information including the operation content and the operation time for each operation by the participant; A minutes generation unit that generates minutes data based on the audio information, the character data, and the operation information An information processing apparatus comprising:

2. The minutes generation unit generates the minutes data by regarding the operation content corresponding to the operation time included in a predetermined proximity time determined for each of the character data as corresponding to the character data, The information processing apparatus according to claim 1, wherein the predetermined proximity time is a time from the speech time corresponding to the character data until a predetermined time has elapsed.

3. The information processing apparatus according to claim 1 or claim 2, further comprising a display unit that displays the minutes data.

4. The information processing apparatus according to claim 3, further comprising a display control unit that causes the character data and the operation information to be displayed on the display unit.

5. The information processing apparatus according to claim 1 or claim 2, further comprising a storage unit that stores the audio data associated with the speech time and stores the operation content associated with the operation time.

6. The minutes generation unit divides the minutes data at a position corresponding to the character string when the operation content includes an input of a character string related to the progress of the meeting, according to the information processing apparatus according to claim 1 or claim 2.

7. When the operation content includes an input of a predetermined operation or a predetermined symbol, the minutes generation unit generates the minutes data with the portion corresponding to the operation content as an important portion, according to the information processing apparatus according to claim 1.

8. When the operation information acquisition unit acquires the operation information including the operation content from a plurality of the participants, in the minutes data, the information processing apparatus according to claim 1 regards the portions corresponding to the operation content from the plurality of the participants as important portions.

9. Based on the important portions, the minutes generation unit extracts key points from the generated minutes data and generates a summary of the minutes data, according to the information processing apparatus according to claim 7 or claim 8.

10. An audio information acquisition step of acquiring audio information including audio data and the speech time for each speech by a plurality of participants in a meeting, respectively; An audio recognition step of converting the audio data into character data; An operation information acquisition step of acquiring operation information including the operation content and the operation time for each operation by the participant, respectively; A minutes generation step of generating minutes data based on the audio information, the character data, and the operation information An information processing method including the above steps.

Images