Information processing system, information processing method, electronic apparatus, and information processing program

Abstract

To allow a user to more intuitively and easily correct misrecognized language units in text sentences resulting from speech input information recognition.SOLUTION: An information processing system comprises: an information processing device having an input unit that inputs voice input information, which is a user's speech directed at an electronic apparatus, from a voice input device, an interpretation unit that interprets a text sentence of the voice input information and divides it into a plurality of meaningful language units, and an instruction unit that outputs the plurality of language units to the electronic apparatus; and an electronic apparatus having a correction unit that inputs the plurality of language units from the information processing device, and displays the plurality of language units distinguished from each other on a display unit so as to be able to correct it for each language unit, and is able to accept correction input from a user for at least a portion of the displayed plurality of language units, and a conversion unit that converts the multiple language units, at least a portion of which has been corrected, into a job execution command containing corrected setting values, to output.SELECTED DRAWING: Figure 5

Description

[Technical Field]

[0001] The present disclosure relates to an electronic device, an information processing system, an information processing method, and an information processing program that are capable of executing a job based on a user's speech. [Background technology]

[0002] There is a technology in which an electronic device executes a job based on voice input information, which is a user's speech. If there is a recognition error in a text sentence resulting from the recognition of the voice input information, it is necessary to correct the misrecognized linguistic unit. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2017-161850 A Summary of the Invention [Problem to be solved by the invention]

[0004] According to Patent Document 1, in a conference system, the speech recognition results are displayed as text data (subtitles), and when a user requests a correction, a person in charge corrects the subtitles. Here, the corrections are specified by dragging and dropping with a mouse or the like on the person in charge's PC.

[0005] When correcting erroneously recognized language units in a text sentence that is the recognition result of speech input information, it is desirable for the user to be able to make the correction more intuitively and easily. [Means for solving the problem]

[0006] An information processing system according to an embodiment of the present disclosure includes: an input unit that inputs voice input information, which is a user's speech to the electronic device, from a voice input device; an interpretation unit that interprets the text sentence of the voice input information and divides it into a plurality of meaningful linguistic units; an instruction unit that outputs the plurality of linguistic units to the electronic device; an information processing device having a correction unit that receives the plurality of linguistic units from the information processing device, distinguishes the plurality of linguistic units from one another on a display unit so that each linguistic unit can be corrected, and receives corrections from a user to at least some of the displayed linguistic units; a conversion unit that converts the plurality of linguistic units, at least some of which have been corrected, into a job execution command including the corrected setting value and outputs the command; and an electronic device having It is equipped with:

[0007] An information processing method according to an embodiment of the present disclosure includes: inputting voice input information, which is a user's speech to the electronic device, from a voice input device; interpreting the text of the voice input information and dividing it into a plurality of meaningful linguistic units; outputting the plurality of linguistic units to the electronic device; inputting the plurality of linguistic units, distinguishing and displaying the plurality of linguistic units on a display unit so that each linguistic unit can be corrected, and receiving input of corrections to at least some of the displayed plurality of linguistic units from a user; The plurality of language units, at least some of which have been corrected, are converted into job execution commands including the corrected setting values ​​and output.

[0008] An electronic device according to an embodiment of the present disclosure includes: an input unit that inputs voice input information, which is a user's speech to the electronic device, from a voice input device; an interpretation unit that interprets the text sentence of the voice input information and divides it into a plurality of meaningful linguistic units; an instruction unit that outputs the plurality of linguistic units to the electronic device; From an information processing device having a correction unit that inputs the plurality of linguistic units, displays the plurality of linguistic units on a display unit in a distinguished manner so that each linguistic unit can be corrected, and receives input of corrections to at least some of the displayed plurality of linguistic units from a user; a conversion unit that converts the plurality of linguistic units, at least some of which have been corrected, into a job execution command including the corrected setting value and outputs the command; It is equipped with:

[0009] An information processing program according to an embodiment of the present disclosure includes: Electronic equipment computers, an input unit that inputs voice input information, which is a user's speech to the electronic device, from a voice input device; an interpretation unit that interprets the text sentence of the voice input information and divides it into a plurality of meaningful linguistic units; an instruction unit that outputs the plurality of linguistic units to the electronic device; From an information processing device having a correction unit that inputs the plurality of linguistic units, displays the plurality of linguistic units on a display unit in a distinguished manner so that each linguistic unit can be corrected, and receives input of corrections to at least some of the displayed plurality of linguistic units from a user; a conversion unit that converts the at least partially corrected language units into a job execution command including the corrected setting value and outputs the command; Operate as. [Effects of the Invention]

[0010] According to the present disclosure, when correcting an erroneously recognized language unit in a text sentence that is the recognition result of speech input information, the user can make the correction more intuitively and easily.

[0011] The effects described here are not necessarily limited to those described herein, and may be any of the effects described in this disclosure. [Brief explanation of the drawings]

[0012] [Figure 1] 1 illustrates an information processing system according to an embodiment of the present disclosure. [Figure 2] 1 shows a hardware configuration of an image forming apparatus when the information processing apparatus is an image forming apparatus. [Figure 3]1 shows the functional configuration of an information processing system. [Figure 4] 1 shows an operation flow of the information processing system. [Figure 5] 10 shows an example of a screen displayed on the display unit. DETAILED DESCRIPTION OF THE INVENTION

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0014] 1. Information Processing System

[0015] FIG. 1 illustrates an information processing system according to an embodiment of the present disclosure.

[0016] The information processing system 1 includes an electronic device 10, a voice input device 20, and an information processing device 30. The electronic device 10, the voice input device 20, and the information processing device 30 are communicably connected via a network N such as the Internet.

[0017] The electronic device 10 is, for example, an image forming device such as an MFP (Multifunction Peripheral), but may be any electronic device. Hereinafter, the electronic device 10 may be referred to as the image forming device 10.

[0018] The voice input device 20 is a smart speaker, a smartphone, a tablet computer, a personal computer, a wearable device, a microphone device with a communication function, etc. The voice input device 20 may be built into the electronic device 10 or may be externally attached.

[0019] The information processing device 30 is a server that interprets the voice input from the voice input device 20 and supplies the voice input to the electronic device 10.

[0020] 2. Hardware configuration of image forming device

[0021] FIG. 2 shows a hardware configuration of an image forming apparatus when the information processing apparatus is an image forming apparatus.

[0022] The image forming apparatus 10 includes a control circuit 100 that constitutes a computer. The control circuit 100 is composed of a processor, such as a CPU 11a (Central Processing Unit), a RAM 11b (Random Access Memory), a ROM 11c (Read Only Memory), and dedicated hardware circuits, and is responsible for overall operational control of the image forming apparatus 10. The CPU 11a loads an information processing program stored in the ROM 11c into the RAM 11b and executes it to perform the operations described in the operational flow below and control the display and operational input of the touch panel 17. The ROM 11c permanently stores the programs and data executed by the CPU 11a. The ROM 11c is an example of a non-transitory computer-readable recording medium.

[0023] The control circuit 100 is connected to an image reading unit 12 (image scanner), an image processing unit 14 (including a GPU (Graphics Processing Unit)), an image memory 15, an image forming unit 16 (printer), a touch panel (front panel) 17 which is an operation unit equipped with a display unit 17a, a large-capacity non-volatile storage device 18 such as an HDD (Hard Disk Drive) or an SSD (Solid State Drive), a facsimile communication unit 19, and a network communication interface 13 (communication unit). The control circuit 100 controls the operation of each of the above-mentioned connected units and transmits and receives signals or data to and from each unit. The operation unit of the touch panel 17 is one form of input device, and a voice input device including a microphone may be provided as the input device.

[0024] 3. Functional configuration of information processing system

[0025] FIG. 3 shows the functional configuration of the information processing system.

[0026] The computer of the information processing device 30 executes an information processing program to operate as an input unit 301, an interpretation unit 302, and an instruction unit 304. The information processing device 30 has a storage unit 303 which is a non-volatile storage device. The computer of the electronic device 10 executes an information processing program to operate as a correction unit 101, a conversion unit 102, and an execution unit 103.

[0027] 4. Operational flow of the information processing system

[0028] FIG. 4 shows the operation flow of the information processing system.

[0029] The user inputs speech to the speech input device 20 as a job execution instruction to the electronic device 10. For example, the user may say, "Monochrome, 3 copies, double-sided...or rather, 2-in-1 copy. Send a copy too."

[0030] The input unit 301 of the information processing device 30 receives voice input information, which is a user's speech to the electronic device 10, from the voice input device 20 (step S31). The voice input device 20 may transmit a voice signal to the information processing device 30, and the input unit 301 of the information processing device 30 may generate a text sentence of the voice input information from the voice signal. Alternatively, the voice input device 20 may generate a text sentence of the voice input information from the voice signal, transmit the text sentence of the voice input information to the information processing device 30, and the input unit 301 of the information processing device 30 may input the text sentence of the voice input information. Here, it is assumed that the text sentence acquired by the input unit 301 is "Instead of monochrome 3-minute double-sided printing, you can also send a copy as a 2-in-1." The utterance "3 copies" is erroneously recognized as "3 minutes."

[0031] The interpretation unit 302 of the information processing device 30 interprets the text sentence of the voice input information and divides it into multiple meaningful linguistic units (for example, morphological analysis). In this example, the interpretation unit 302 divides the text sentence into multiple meaningful linguistic units such as "Monochrome / 3 minutes / double-sided / not / two-in-one / but / copy / copy / copy / send / also / yes / with / ." The interpretation unit 302 extracts one or more setting value linguistic units, which are linguistic units indicating setting values, from the multiple generated linguistic units. In this example, the interpretation unit 302 extracts "monochrome, double-sided, two-in-one, copy, copy, send" as the setting value linguistic units (step S32). A "meaningful linguistic unit" may be a single morpheme (the smallest unit with meaning), or a combination of multiple morphemes may be used as one linguistic unit.

[0032] The storage unit 303 of the information processing device 30 stores user account information in which a user, a voice input device 20 used by the user, and an electronic device 10 used by the user are associated with each other.

[0033] The instruction unit 304 of the information processing device 30 outputs (transmits) all of the multiple language units (i.e., segmented text sentences) including one or more set value language units, "Monochrome / 3 minutes / double-sided / not / two-in-one / copy / copy / copy / send / also / available / with / " to the electronic device 10 (step S33). The instruction unit 304 refers to the storage unit 303 and transmits the multiple language units (i.e., segmented text sentences) that are the result of the morphological analysis to the electronic device 10 linked to the voice input device 20 that is the input source of the voice input information.

[0034] FIG. 5 shows an example of a screen displayed on the display unit.

[0035] The correction unit 101 of the electronic device 10 inputs a plurality of linguistic units from the information processing device 30 and displays the plurality of linguistic units on the display unit 17a (touch panel 17) in a distinguishable manner so that each linguistic unit can be corrected (step S11). In this example, the correction unit 101 arranges each linguistic unit 400 in a vertical row, thereby distinguishing and displaying the plurality of linguistic units 400, such as "monochrome / 3 minutes / double-sided / not / two-in-one / with / copy / copy / send / also / yes / with / ." The correction unit 101 highlights one or more set value linguistic units. In this example, the correction unit 101 highlights (in bold) one or more set value linguistic units 401, "monochrome, double-sided, two-in-one, copy, copy, send."

[0036] The correction unit 101 can accept, from the user, input of corrections for at least some of the one or more displayed linguistic units. The correction unit 101 can accept corrections 402, correction details 403, and invalid 404 as correction details for each linguistic unit 400. For example, if the user marks the linguistic unit "3 minutes" 405 as "Correction Required" 402 and inputs the correction details 403 as "3 copies," the correction unit 101 accepts this input. If the user marks the linguistic unit "double-sided" 406 as "invalid" 404, the correction unit 101 accepts this input. The correction unit 101 may accept the correction details and / or invalidation by operation input on the touch panel 17 or voice input from the voice input device 20. The correction unit 101 corrects the linguistic units for which the correction details have been input (changing "3 minutes" to "3 copies") and invalidates the linguistic unit "double-sided" for which invalidity has been selected, thereby correcting the multiple linguistic units (step S12).

[0037] The conversion unit 102 of the electronic device 10 converts one or more setting value linguistic units, at least a portion of which has been corrected, into a job execution command including the corrected setting values. Specifically, the conversion unit 102 converts the corrected multiple linguistic units, which reflect the corrected linguistic units (changing "3 minutes" to "3 copies") and the invalidated linguistic units (invalidating "double-sided"), into a job execution command. In this example, the conversion unit 102 converts into a job execution command including the corrected setting values ​​"monochrome, 3 copies, 2-in-1, copy, copy, send" ("double-sided" is invalid and is not included). The conversion unit 102 outputs the job execution command to the execution unit 103 (step S13).

[0038] The execution unit 103 of the electronic device 10 receives the job execution command from the execution unit 103, and interprets and executes the job execution command (step S14).

[0039] 5. Conclusion

[0040] There is a technology in which an electronic device executes a job based on voice input information, which is speech input by a user. If there is a recognition error in a text sentence that is the recognition result of the voice input information, the misrecognized language unit needs to be corrected. According to Patent Document 1, in a conference system, the voice recognition result is displayed as text data (subtitles), and when the user requests a correction, a person in charge corrects the subtitles. Here, the correction part is specified by dragging and dropping with a mouse or the like on the person's PC.

[0041] On the other hand, if voice input information to the image forming device is recognized and interpreted, and there is a recognition or interpretation error, the voice input information text can be corrected using the touch panel of the image forming device.Compared to the PC mentioned above, it is difficult to intuitively specify the correction point by dragging and dropping on the touch panel of the image forming device, and it takes time to specify the correction point using the cursor.

[0042] In contrast, according to this embodiment, voice input information to the electronic device 10 is morphologically analyzed, and corrections are specified for each language unit using buttons on the touch panel 17 of the electronic device 10. The correction method may be either by speaking from the keyboard or microphone of the touch panel 17 of the electronic device 10. This allows the voice input information to the electronic device 10 to be easily specified on the touch panel 17, thereby enabling intuitive correction operations without spending time. Dividing the voice input information into each language unit makes it easier for the user to find the corrections. As described above, according to this embodiment, when correcting incorrectly recognized language units in a text sentence that is the recognition result of the voice input information, the correction can be made more intuitively and easily for the user.

[0043] Although the embodiments and modified examples of the present technology have been described above, the present technology is not limited to the above-described embodiments, and it goes without saying that various modifications can be made within the scope of the gist of the present technology. [Explanation of symbols]

[0044] 1. Information Processing Systems 10 Electronic equipment 100 control circuit 101 Corrections Department 102 Conversion unit 103 Executive Department 17 Touch Panel 17a Display section 20 Voice input device 30 Information processing equipment 301 Input section 302 Interpretation Department 303 Storage section 304 Instruction section

Claims

1. an input unit that inputs voice input information, which is a user's speech to the electronic device, from a voice input device; an interpretation unit that interprets the text sentence of the voice input information and divides it into a plurality of meaningful linguistic units; an instruction unit that outputs the plurality of linguistic units to the electronic device; an information processing device having a correction unit that receives the plurality of linguistic units from the information processing device, distinguishes the plurality of linguistic units from one another on a display unit so that each linguistic unit can be corrected, and receives corrections from a user to at least some of the displayed linguistic units; a conversion unit that converts the plurality of linguistic units, at least some of which have been corrected, into a job execution command including the corrected setting value and outputs the command; and an electronic device having An information processing system comprising:

2. 2. The information processing system according to claim 1, The correction unit The correction content for each language unit can be correction content and / or invalidation, The language units for which correction content has been input are corrected with the correction content, and / or the language units for which invalidation has been selected are invalidated, thereby correcting the plurality of language units. The conversion unit converts the corrected language units into a job execution command. Information processing system.

3. 3. The information processing system according to claim 1, the interpretation unit extracts one or more setting value linguistic units, which are linguistic units indicating setting values, from the plurality of linguistic units; The correction unit highlights the one or more setting value linguistic units. Information processing system.

4. 3. The information processing system according to claim 1, The correction unit receives correction content and / or invalidation by operation input or voice input. Information processing system.

5. inputting voice input information, which is a user's speech to the electronic device, from a voice input device; interpreting the text of the voice input information and dividing it into a plurality of meaningful linguistic units; outputting the plurality of linguistic units to the electronic device; inputting the plurality of linguistic units, distinguishing and displaying the plurality of linguistic units on a display unit so that each linguistic unit can be corrected, and receiving input of corrections to at least some of the displayed plurality of linguistic units from a user; The plurality of language units, at least some of which have been corrected, are converted into job execution commands including the corrected setting values, and the command is output. Information processing methods.

6. an input unit that inputs voice input information, which is a user's speech to the electronic device, from a voice input device; an interpretation unit that interprets the text sentence of the voice input information and divides it into a plurality of meaningful linguistic units; an instruction unit that outputs the plurality of linguistic units to the electronic device; From an information processing device having a correction unit that inputs the plurality of linguistic units, displays the plurality of linguistic units on a display unit in a distinguished manner so that each linguistic unit can be corrected, and receives input of corrections to at least some of the displayed plurality of linguistic units from a user; a conversion unit that converts the plurality of linguistic units, at least some of which have been corrected, into a job execution command including the corrected setting value and outputs the command; An electronic device comprising:

7. Electronic equipment computers, an input unit that inputs voice input information, which is a user's speech to the electronic device, from a voice input device; an interpretation unit that interprets the text sentence of the voice input information and divides it into a plurality of meaningful linguistic units; an instruction unit that outputs the plurality of linguistic units to the electronic device; From an information processing device having a correction unit that inputs the plurality of linguistic units, displays the plurality of linguistic units on a display unit in a distinguished manner so that each linguistic unit can be corrected, and receives input of corrections to at least some of the displayed plurality of linguistic units from a user; a conversion unit that converts the at least partially corrected language units into a job execution command including the corrected setting value and outputs the command; An information processing program that operates as a

Images