Voice recognition system used for facility inspection and the like, voice recognition device, voice recognition method, and program

Abstract

To reduce the time for inputting voice.SOLUTION: A voice recognition system provided herein comprises voice input means for inputting first voice, voice recognition means for performing voice recognition based on the first voice, registration means for registering second voice, output means for outputting the second voice, and limiting means configured to limit the output of the second voice if the first voice is input while the second voice is being output.SELECTED DRAWING: Figure 7

Description

[Technical field]

[0001] The present invention relates to a voice recognition system, a voice recognition device, a voice recognition method, and a program used for facility inspection and the like. [Background technology]

[0002] 2. Description of the Related Art Techniques are known that assist an inspector in inspecting equipment or the like.

[0003] For example, a technology is known in which barcodes attached to equipment are scanned and managed using a tablet terminal or a handheld terminal. By using such barcodes, the status of the equipment can be quickly determined. In addition, a technology is known in which inspection data is digitized, compiled, and managed, thereby preventing human errors such as forgetting to perform inspections and omissions in inspections, and supporting the implementation of reliable inspections (for example, Non-Patent Document 1, etc.). [Prior art documents] [Non-patent literature]

[0004] [Non-Patent Document 1] "Equipment Patrol Inspection System", [online], [Retrieved March 11, 2020], Internet〈URL:http: / / www.tm-es.co.jp / service-product / services / products / mimawari-kun-mit.html〉 Summary of the Invention [Problem to be solved by the invention]

[0005] In conventional technology, the user may not be able to input the inspection results by voice until all the voices explaining the inspection, etc. have been output. Therefore, the user may not be able to input voice, start voice recognition processing, or output the results of the voice recognition processing until the device has finished outputting the voice, which may result in a long waiting time for voice input.

[0006] The present invention has been made in consideration of the above-mentioned problems, and has an object to reduce the time required to input voice. [Means for solving the problem]

[0007] A voice recognition system according to each embodiment of the present invention includes the following configuration.

[0008] A voice recognition system (for example, voice recognition system 1) A voice input means (e.g., step S03) for inputting a first voice (e.g., the first voice SD1); A voice recognition means (e.g., step S05) that performs voice recognition based on the first voice; A registration means (e.g., step S01) for registering a second voice (e.g., the second voice SD2); An output means for outputting the second sound (e.g., step S02); a limiting means (e.g., step S04) for limiting the output of the second voice when the first voice is input while the second voice is being output; Includes.

[0009] With this configuration, the time required to input voice can be reduced.

[0010] It is also desirable for the voice recognition system to be used for equipment inspection (eg, FIG. 6).

[0011] With this configuration, inspection can be carried out efficiently.

[0012] In addition, the voice recognition system an input data generating means for generating first input data indicating the content of the first voice based on a speech recognition result of the first voice; a storage means for storing second input data used to check the first input data; a determination means for comparing the first input data with the second input data to determine whether or not the first input data is abnormal; It is preferable that the configuration further includes:

[0013] In addition, the voice recognition system The second input data is Inputted before the first input data (for example, the previous result V21), The determination means is It is desirable to determine that an abnormality exists when the first input data and the second input data are different, or when the first input data is outside an allowable range (for example, allowable range V22) with respect to the second input data.

[0014] In addition, the voice recognition system The second input data is A value indicating a normal value or normal range (for example, normal value V23), The determination means is It is desirable to determine that an abnormality exists if the first input data and the second input data are different, or if the first input data is outside the normal range.

[0015] In this way, when there is a difference between the previous result V21, i.e., the most recent inspection result, it is determined that there is an abnormality in the equipment. When such a check is performed, the voice recognition system 1 can notify the user of the equipment in which the abnormality is occurring.

[0016] Also, the allowable range V22 may be configured to have a certain margin for the previous result V21. In particular, when a numerical value is the subject of inspection, a small fluctuation in the numerical value is often not abnormal. Therefore, if an allowable range can be set in this way, abnormalities can be accurately determined.

[0017] In addition, the voice recognition system A speech recognition system including a first information processing device and a second information processing device, The first information processing device is Performing speech recognition using a first dictionary (e.g., the first dictionary D211); The second information processing device is The speech recognition means recognizes the first speech by using a second dictionary (e.g., the second dictionary D212) (e.g., FIG. 17 ); The second dictionary is preferably a dictionary for the domain of the search.

[0018] Since the second information processing device is a portable information processing device, the memory area MEM tends to be smaller than that of the first information processing device.

[0019] Moreover, the second dictionary D212 is a dictionary for the inspection field. Therefore, the second dictionary D212 can have a smaller data capacity than the first dictionary D211. Therefore, it is preferable that the second dictionary D212 is a dictionary that can be stored even in an information processing device with a storage area MEM having a smaller storage capacity than the first information processing device, such as the second information processing device.

[0020] The dictionary for the inspection field is a dictionary suitable for voice recognition of terms frequently used in inspection. For example, the dictionary for the inspection field is set with numerical values, terms used in inspection results, names of equipment, etc. In this way, when a dictionary limited to terms frequently used in inspection is used, voice recognition can be realized in a small storage area, and the first input data V10 can be generated by executing voice recognition with high accuracy.

[0021] In addition, the voice recognition system Further comprising a noise canceling means for canceling noises (e.g., a first noise NZ1, a second noise NZ2, and a third noise NZ3) included in the first voice, The voice recognition means performing voice recognition using the third voice in which the noise has been attenuated by the noise canceling means; It is desirable that the noise cancellation means sets frequency bands (for example, a first frequency band FR1 and a second frequency band FR2) to be cancelled for each site or position (for example, as shown in FIG. 18).

[0022] In this way, noise cancellation suitable for each site or location can be performed, and therefore, speech recognition can be performed using the third speech in which the noise contained in the speech has been attenuated, thereby improving the accuracy of speech recognition.

[0023] In addition, the voice recognition system It is desirable for the limiting means to limit the output of the second voice by stopping the output of the second voice, reducing the volume of the second voice, gradually reducing the volume of the second voice, starting the output of a voice to be output after the second voice, or increasing the output speed of the second voice (e.g., step S04).

[0024] When such a restriction process PR1 is performed, it is possible to reduce the output of unnecessary audio.

[0025] In addition, the voice recognition system The registration means registers a plurality of inspection items in association with the second sound, A group setting means for setting a group (for example, group GS) that includes the inspection items (for example, as shown in FIG. 13 ); an omission operation means for inputting an omission operation (e.g., an omission operation C3) for omitting the group; It is preferable that when the omission operation is input, output of the second sound based on the inspection item belonging to the group corresponding to the omission operation is omitted.

[0026] For example, when a facility is not in operation, inspection may not be required. If inspection of such a facility can be omitted, inspection can be performed more efficiently.

[0027] In addition, the voice recognition device (for example, the mobile terminal 11) A voice input means for inputting a first voice; A voice recognition means for performing voice recognition based on the first voice; A registration means for registering a second voice; an output means for outputting the second sound; a limiting means for limiting the output of the second voice when the first voice is input while the second voice is being output; Includes.

[0028] Also, a speech recognition method (for example, FIG. 3) performed by a speech recognition system, a speech input step of inputting a first speech by the speech recognition system; a speech recognition step in which a speech recognition system performs speech recognition based on the first speech; a registration step in which the voice recognition system registers a second voice; an output step of the speech recognition system outputting the second speech; a limiting step of limiting output of the second voice when the first voice is input while the second voice is being output by the voice recognition system; Includes.

[0029] Also, it is a program for causing a computer to execute the speech recognition method (for example, FIG. 3). Effect of the Invention

[0030] According to each embodiment of the present invention, it is possible to reduce the time required to input voice. [Brief description of the drawings]

[0031] [Figure 1] FIG. 1 is a diagram illustrating an example of a system configuration of a voice recognition system 1. [Diagram 2] FIG. 2 is a diagram illustrating an example of a hardware configuration of an information processing device. [Diagram 3] FIG. 4 is a diagram illustrating an example of an overall process in the first embodiment. [Figure 4] FIG. 2 is a diagram showing an example of a registration database D1. [Diagram 5] FIG. 11 is a diagram showing an example of a processing result in the first embodiment. [Figure 6] FIG. 4 is a diagram showing an example of a screen display of a mobile terminal in the first embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of a functional configuration in the first embodiment. [Figure 8] FIG. 11 is a diagram illustrating an example of overall processing in the second embodiment. [Figure 9] FIG. 11 is a diagram showing an example of a processing result in the second embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a screen display of a mobile terminal in the second embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of a functional configuration in a second embodiment. [Figure 12] FIG. 13 is a diagram showing a modified example in which group setting and omission are performed. [Figure 13] FIG. 13 is a diagram illustrating an example of group settings. [Figure 14] FIG. 13 is a diagram showing an example in which second input data is used as a previous result. [Figure 15] FIG. 13 is a diagram illustrating an example of setting a tolerance range. [Figure 16] FIG. 13 is a diagram showing an example in which second input data is set as a normal value or a normal range. [Figure 17] FIG. 13 is a diagram showing a modified example in which a first dictionary D211 and a second dictionary D212 are used. [Figure 18] FIG. 13 is a diagram illustrating an example of setting a frequency band to be canceled for each site. [Figure 19] FIG. 11 is a diagram showing a first modified example of interruption and release. [Figure 20] FIG. 11 is a diagram showing a second modified example of interruption and release. [Figure 21] FIG. 13 is a diagram showing a modified example of audio input and audio output. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0032] The optimum and minimum mode for carrying out the invention will be described below with reference to the drawings. Note that in the drawings, when the same reference numerals are used, it indicates that the configuration is the same, and duplicated explanations will be omitted. Also, the specific examples shown in the drawings are merely examples, and the configuration may further include configurations other than those shown in the drawings.

[0033] First Embodiment <Overall configuration example> 1 is a diagram showing an example of a system configuration of a voice recognition system 1. For example, the voice recognition system 1 includes a server 10, a mobile terminal 11 which is an example of a voice recognition device, and an earphone 12.

[0034] The server 10, the mobile terminal 11, and the earphones 12 are connected via a network NW.

[0035] As shown in the figure, a user 13 wears earphones 12 and inspects equipment. The user 13 also inspects the equipment while holding a mobile terminal 11. Meanwhile, a server 10 is installed in a location different from the site where the equipment inspection is performed. Therefore, setting values, data, etc. are input in advance to the server 10, and when the inspection is performed, the mobile terminal 11 acquires the setting values, data, etc. via a network NW.

[0036] The equipment to be inspected is, for example, air conditioning equipment. Therefore, the inspection site is a machine room in a company. During the inspection, the values ​​indicated by measuring instruments such as a pressure gauge, a voltmeter, an ammeter, a chemical solution level gauge, a thermometer, and a hygrometer are inspected by the user 13.

[0037] The server 10 and the mobile terminal 11 are information processing devices. For example, the information processing device is a device having the following hardware configuration.

[0038] <Hardware configuration example> 2 is a diagram showing an example of a hardware configuration of an information processing device. For example, an information processing device such as a server 10 has a hardware configuration including a CPU (Central Processing Unit, hereinafter referred to as "CPUHW1"), a storage device HW2, a network interface HW3, an input device HW4, an output device HW5, and an interface HW6.

[0039] CPUHW1 is an example of a computing device and a control device.

[0040] The storage device HW2 is a main storage device, an auxiliary storage device, or the like.

[0041] The network interface HW3 is a communication device that transmits and receives data to and from external devices via a network.

[0042] The input device HW4 is a device for inputting user operations, and is, for example, a mouse and a keyboard.

[0043] The output device HW5 is a device for outputting the processing result to the user, for example, a display.

[0044] The interface HW6 is a connector or the like for connecting peripheral devices.

[0045] The earphones 12 are an input device for inputting voice. The voice uttered by the user 13 and input through the earphones 12 is input to the mobile terminal 11, where processing such as voice recognition is performed. The earphones 12 are also an output device for outputting voice. Therefore, the earphones 12 output voice to the user 13 through processing by the mobile terminal 11.

[0046] Hereinafter, the sound input by the user 13 through the earphones 12 will be referred to as a "first sound SD1." On the other hand, the sound output to the user 13 through the earphones 12 will be referred to as a "second sound SD2."

[0047] <Overall processing example> 3 is a diagram showing an example of the overall processing in the first embodiment. Below, as shown in the figure, the overall processing will be explained by dividing it into "pre-processing" and "main processing." The "pre-processing" is a process that is performed before the "main processing" and is a preparation process for operating the voice recognition system 1. Therefore, the "pre-processing" and the "main processing" do not have to be performed consecutively, and it is sufficient that the "pre-processing" is completed before the "main processing" starts.

[0048] <Example of pre-processing> In the "pre-processing", the following processing is carried out:

[0049] In step S01, the voice recognition system 1 registers, for example, inspection items and data for the second voice SD2, and constructs a registration database D1. That is, the registration database D1 indicates the contents to be read out as the second voice SD2 during inspection. In addition, the correspondence between the inspection items and which data of the input voice and the timing at which the data should be output as the second voice SD2 is also registered in the registration database D1. For example, the registration procedure is performed in this manner. In this way, in the "pre-processing", the voice recognition system 1 inputs and sets data to enable the second voice SD2 to be output in the "main processing". Specifically, the registration database D1 is constructed as follows.

[0050] 4 is a diagram showing an example of the registration database D1. As shown in the figure, the registration database D1 is made up of "item numbers" and "inspection items."

[0051] For example, the content output by the second voice SD2 is the content input to "inspection item." Specifically, the name of the equipment that identifies the equipment to be inspected (for example, in the example where the "item number" is "1," it is "fire pump") is input to "inspection item." Therefore, when the name of the equipment is read out by the second voice, the user 13 can identify the equipment to be inspected by listening to the second voice SD2.

[0052] Furthermore, as shown in the figure, detailed inspection content is input in "inspection item". Specifically, the detailed inspection content is "pressure value" in the example where "item number" is "1". When such detailed inspection content is read out by the second voice, the user 13 knows that he or she will check the pressure value by listening to the second voice SD2 and input the pressure value by using the first voice SD1.

[0053] In step S01, the voice recognition system 1 inputs the dictionary D2. That is, in the "pre-processing", the voice recognition system 1 inputs and sets data to enable voice recognition, that is, to recognize the voice input in the first voice SD1 as words in the "main processing".

[0054] <Example of this process> "This process" begins when inspection begins.

[0055] In step S02, the voice recognition system 1 performs an output procedure for outputting the registered second voice SD2.

[0056] Hereinafter, it is assumed that the first voice SD1 is input while step S02 is being executed, that is, while the second voice SD2 is being output. In this case, the voice recognition system 1 proceeds to step S03.

[0057] In step S03, the voice recognition system 1 performs a voice input procedure for inputting the first voice SD1. That is, in step S03, the voice recognition system 1 detects that the user 13 has uttered a voice. When the first voice SD1 is thus input, the voice recognition system 1 proceeds to step S04.

[0058] In step S04, the voice recognition system 1 performs a limiting procedure for limiting the output of the second voice SD2.

[0059] In step S05, the voice recognition system 1 performs a voice recognition procedure for performing voice recognition based on the first voice SD1.

[0060] In step S06, the voice recognition system 1 outputs the voice recognition result obtained by recognizing the first voice SD1 as a second voice SD2.

[0061] For example, when the overall process described above is performed, the following processing results are obtained.

[0062] 5 is a diagram showing an example of a processing result in the first embodiment. In the following, a "first item execution example" in which no restriction is imposed and a "second item execution example" in which a restriction is imposed will be compared and described.

[0063] In the "first item execution example," first, the voice recognition system 1 outputs the eleventh output EX11 by the second voice SD2. In this example, the eleventh output EX11 is a voice that successively indicates the name of the equipment to be inspected and the details of the inspection, such as "fire pump: pressure."

[0064] In response to the 11th output EX11, the user 13 performs an operation of inputting the 12th output EX12, which indicates the result of inspecting the equipment indicated by the 11th output EX11, to the speech recognition system 1 by using the first speech SD1. Specifically, in this example, the user 13 reads out "12.3", which is the "pressure" value indicated by the pressure gauge of the "fire pump" equipment. The speech emitted by this reading becomes the 12th output EX12.

[0065] Next, in this example, the voice recognition system 1 performs voice recognition on the twelfth output EX12. Then, in the thirteenth output EX13, the content that the inspection has been completed and the voice recognition result are output by the second voice SD2. As shown in the figure, the first half of the content output in the thirteenth output EX13 is a repetition of the eleventh output EX11. Next, in the second half of the thirteenth output EX13, the voice recognition result, that is, the same content as the twelfth output EX12, is output. In this way, if no restrictions are imposed and the voice recognition is performed correctly, the voice recognition system 1 operates in the order of output of the inspection items, input of the inspection result, voice recognition, and output of the voice recognition result.

[0066] In the "second item execution example" for a voice recognition system 1 capable of such operation, while the second voice SD2 is being output, the user 13 inputs the first voice SD1 to limit the output of the second voice SD2.

[0067] In the illustrated example, the second voice SD2 to be restricted is set as the 21st output EX21 (step S02). The 21st output EX21 is the inspection item that follows the inspection item indicated by the 11th output EX11. If not restricted, the 21st output EX21 has the content "Fire pump: appearance."

[0068] As shown in the figure, in the "second item execution example", while the 21st output EX21 is being output (step S02), the user 13 performs an operation to input the 22nd output EX22, which indicates the results of inspecting the equipment shown in the 21st output EX21, to the speech recognition system 1 using the first voice SD1 (step S03).

[0069] In this way, when the 22nd output EX22 is input while the 21st output EX21 is being output, the speech recognition system 1 performs a restriction process PR1 that restricts the output of the 21st output EX21 (step S04). For example, the restriction process PR1 is a process that stops the output of the 21st output EX21.

[0070] The user 13 also reads out the result of checking the appearance of the equipment "fire pump", "X, liquid leakage" (step S03). The voice generated by this reading out becomes the 22nd output EX22.

[0071] Next, in this example, the voice recognition system 1 performs voice recognition on the 22nd output EX22 (step S05). Then, the voice recognition system 1 outputs the content that the inspection has been completed and the voice recognition result by the second voice SD2 in the 23rd output EX23, similar to the 13th output EX13 (step S06). As shown in the figure, the first half of the content output in the 23rd output EX23 is a repetition of the 21st output EX21. Next, in the second half of the 23rd output EX23, the voice recognition result, that is, the same content as the 22nd output EX22, is continuously output.

[0072] <Screen display example> 6 is a diagram showing an example of a screen display of a mobile terminal in the first embodiment. For example, inspection is performed in the following order. However, the screen display, order, and input items as shown in the figure are not essential.

[0073] Fig. 6(A) is a screen showing the "Main Menu". Hereinafter, the screen shown in Fig. 6(A) will be referred to as the eleventh screen PN11. When "Inspection Flow" is pressed on the eleventh screen PN11, the screen transitions to Fig. 6(B), which is a screen for preparing for inspection.

[0074] Fig. 6(B) is a screen for selecting "Inspection flow list". Hereinafter, the screen shown in Fig. 6(B) will be referred to as the 12th screen PN12. The 12th screen PN12 is a screen for selecting the equipment to be inspected. Next, when equipment is selected on the 12th screen PN12, the screen transitions to Fig. 6(C), which is a screen for specifying the user 13 who will perform the inspection.

[0075] Fig. 6(C) is a screen for "selecting an operator." Hereinafter, the screen shown in Fig. 6(C) will be referred to as the 13th screen PN13. The 13th screen PN13 is a screen for selecting a user 13 who will be the operator who will carry out the inspection. Next, when a user 13 is selected on the 13th screen PN13, the inspection starts and the screen transitions to Fig. 6(D).

[0076] FIG. 6(D) is a screen for the first inspection item. Hereinafter, the screen shown in FIG. 6(D) is referred to as the 14th screen PN14. The 14th screen PN14 indicates the name of the equipment to be inspected and the progress of the inspection in the "Inspection Item List". The 14th screen PN14 also indicates the "boiler pressure" which is the inspection content in the "Inspection Item". For example, in response to the display of the 14th screen PN14, a second voice SD2 indicating the same content is output (step S02). Next, when the first voice SD1 indicating the inspection result is input (step S03), voice recognition is performed (step S05), and the screen transitions to FIG. 6(E).

[0077] FIG. 6(E) is a screen showing the first inspection result. Hereinafter, the screen shown in FIG. 6(E) is referred to as the fifteenth screen PN15. The fifteenth screen PN15 differs from the fourteenth screen PN14 in that the recognition result displays a numerical value of "0.66." This "0.66" is the result of the voice recognition of the first voice SD1. When the voice recognition result is displayed on the screen in this manner, the user 13 can easily check the voice recognition result.

[0078] For example, the first inspection item is inspected as described above. The second and subsequent inspection items are inspected in the same manner.

[0079] Fig. 6(F) is a screen for the second inspection item. Hereinafter, the screen shown in Fig. 6(F) is referred to as the 16th screen PN16. While the first inspection item was "inner pressure", the inspection item in the 16th screen PN16 is "forced fan current value". Then, in the 16th screen PN16, the second voice SD2 indicating the same content as in the screen is output, as in the first inspection item (step S02). Next, when the first voice SD1 indicating the inspection result is input (step S03), voice recognition is performed (step S05), and the screen transitions to Fig. 6(G).

[0080] Fig. 6(G) is a screen showing the second inspection result. Hereinafter, the screen shown in Fig. 6(G) is referred to as the 17th screen PN17. The 17th screen PN17 differs from the 16th screen PN16 in that the recognition result shows the number "43." This "43" is the result of voice recognition of the first voice SD1.

[0081] For example, when the first voice SD1 is input while the second voice SD2 indicating the same content as the screen is being output on the 14th screen PN14 or the 16th screen PN16, the voice recognition system 1 restricts the output of the second voice SD2 (step S04), starts voice recognition, and transitions to the next screen.

[0082] <Example of functional configuration> 7 is a diagram showing an example of a functional configuration in the first embodiment. For example, the voice recognition system 1 has a functional configuration including a voice input means 1F11, a voice recognition means 1F12, a registration means 1F13, an output means 1F14, a restriction means 1F15, an input data generation means 1F16, a storage means 1F17, a determination means 1F18, a noise cancellation means 1F19, a group setting means 1F20, and an omission operation means 1F21.

[0083] The voice input means 1F11 and the output means 1F14 are realized by, for example, earphones 12. The voice recognition means 1F12, the registration means 1F13, the restriction means 1F15, the input data generation means 1F16, the storage means 1F17, the determination means 1F18, the noise cancellation means 1F19, the group setting means 1F20, and the omission operation means 1F21 are realized by the cooperation of the arithmetic units, storage units, input devices, and output devices, such as the CPU HW1, the storage unit HW2, the input device HW4, the output device HW5, and the interface HW6, of the mobile terminal 11 or the server 10.

[0084] In particular, if the user 13 performing the inspection is familiar with the inspection, the user 13 may be familiar with the details of the inspection, such as the contents and sequence of the inspection, even if the details are not guided by the second voice SD2. In such a case, the user 13 may want to input the inspection results in the first voice SD1 before the second voice SD2 is completely output, and finish the inspection quickly. Therefore, as in the above example, it is desirable to limit the output of the second voice SD2 when the first voice SD1 is input while the second voice SD2 is being output. In this way, if the output of the second voice SD2 is limited and the first voice SD1 can be input, the user 13 does not need to wait for the second voice SD2 to be output, and the time required for voice input can be shortened.

[0085] <Second embodiment> The second embodiment is realized by a voice recognition system 1 having the same system configuration as the first embodiment. The hardware configurations of the mobile terminal 11 and the server 10 in the second embodiment are also the same as those in the first embodiment. The second embodiment differs from the first embodiment in the overall processing. The following description will focus on the differences and omit redundant description.

[0086] <Overall processing example> 8 is a diagram showing an example of the overall processing in the second embodiment. Compared with the first embodiment, the second embodiment differs in that steps S21 to S23 are performed. Also, the "pre-processing" in the second embodiment is the same as that in the first embodiment.

[0087] In step S02, the voice recognition system 1 outputs the registered second voice SD2.

[0088] Hereinafter, an example will be described in which the interrupt operation C1 is input while step S02 is being executed, that is, while the second voice SD2 is being output. In such a case, the voice recognition system 1 proceeds to step S21. Note that the type of operation that the interrupt operation C1 is is set in advance.

[0089] In step S21, the voice recognition system 1 inputs the interruption operation C1. In this manner, when the interruption operation C1 is input, the voice recognition system 1 interrupts the output of the second voice SD2.

[0090] Furthermore, when a cancel operation C2 for canceling the interruption is input while the output of the second voice SD2 is interrupted, the voice recognition system 1 proceeds to step S22. Note that the type of operation of the cancel operation C2 is set in advance.

[0091] In step S22, the voice recognition system 1 releases the interruption based on the release operation C2.

[0092] In step S23, the voice recognition system 1 resumes output of the second voice SD2.

[0093] For example, when the overall process described above is performed, the following processing results are obtained.

[0094] 9 is a diagram showing an example of a processing result in the second embodiment. Hereinafter, an example in which the 21st output EX21 of the "second item execution example" in the second embodiment is the subject of interruption will be described.

[0095] For example, suppose that an interruption operation C1 is input while an output voice indicating the 21st output EX21 is being output (step S02). When the interruption operation C1 is input, the voice recognition system 1 performs an interruption process PR2 (step S21). Hereinafter, the point in time when the interruption operation C1 is input and interrupted is referred to as the "first point in time."

[0096] The interruption process PR2 is a process for stopping the output during the 21st output EX21 as shown in the figure. Furthermore, the interruption process PR2 is a process for preventing output from being performed after the interruption until a release operation C2 is input.

[0097] Next, when the cancel operation C2 is input, the voice recognition system 1 cancels the interruption (step S22). Specifically, when the cancel operation C2 is input, the voice recognition system 1 outputs the output voice indicating the 200th output EX200, and resumes output of the output voice indicating the 21st output EX21.

[0098] The 200th output EX200 is an output voice indicating the contents of the inspection that was completed at the first point in time. Such an output voice reminds the user 13 of how much of the inspection has been completed.

[0099] Then, after the 200th output EX200 is output, the output of the 21st output EX21 is resumed (step S23).

[0100] <Screen display example> 10 is a diagram showing an example of a screen display of a mobile terminal in the second embodiment. For example, inspection is performed in the following order. However, the screen display, order, and input items as shown in the figure are not essential.

[0101] Fig. 10(A) is a screen showing the first inspection result. Hereinafter, the screen shown in Fig. 10(A) will be referred to as the 21st screen PN21. The 21st screen PN21 is an example of a screen displayed when the content of the first inspection is "steam temperature" and "120" is entered as the inspection result. As shown in the figure, the voice recognition result is output by text output B2. Then, if the voice recognition result is incorrect when looking at the text output B2, it is desirable to be able to press the re-input button B1 and enter the inspection result again.

[0102] Similarly, the second, third, and fourth inspections are performed in that order. In this example, the twenty-second screen PN22 shown in FIG. 10(B) is an example of a screen that is displayed when the second inspection result is input.

[0103] The 23rd screen PN23 shown in Fig. 10(C) is an example of a screen displayed when the third inspection result is input, and the 24th screen PN24 shown in Fig. 10(D) is an example of a screen displayed when the fourth inspection result is input.

[0104] <Example of functional configuration> 11 is a diagram showing an example of a functional configuration in the second embodiment. For example, the voice recognition system 1 has a functional configuration including a voice input unit 1F11, a voice recognition unit 1F12, an output unit 1F14, a release unit 1F101, and an interruption unit 1F100.

[0105] The voice input means 1F11 and the output means 1F14 are realized by, for example, earphones 12. The voice recognition means 1F12, the release means 1F101, and the interruption means 1F100 are realized by the cooperation of arithmetic units, storage units, input devices, and output devices, such as the CPU HW1, the storage unit HW2, the input device HW4, the output device HW5, and the interface HW6, which the mobile terminal 11 or the server 10 has.

[0106] For example, as shown in FIG. 10, an inspection is performed based on a plurality of inspection items that are set in advance. In the flow of such an inspection work, an interrupting task may occur, for example, the telephone rings or someone speaks to the user. When such an interruption occurs, it is desirable for the user 13 to be able to interrupt the inspection by performing an interrupting operation C1. In this way, if the user 13 can interrupt the inspection by performing an interrupting operation C1, the user 13 can interrupt the inspection and then perform the interrupting task. Then, after completing the interrupting task, the user 13 can resume the inspection by performing a canceling operation C2.

[0107] <Modification> The inspection items may be either "standardized" items that are input and checked in the form of numerical values ​​or "o" or "x" (or "YES" or "NO", etc.), or "non-standardized" items that the user 13 inputs as comments, such as "missing". Also, images taken by the user 13 may be attached to the inspection results.

[0108] The voice recognition system 1 may be used for purposes other than facility inspection. In other words, the object to be inspected may be a device other than facility. The voice recognition system 1 may be used for purposes other than inspection.

[0109] When the voice recognition system 1 is used for inspecting equipment, the time required for inspecting the equipment can be shortened, leading to labor savings in the work.

[0110] The voice recognition system 1 is preferably used for inspections in the machine room of air conditioning equipment. In inspections in the machine room of air conditioning equipment, inspection points are often scattered throughout the machine room. Furthermore, when many large pieces of equipment are installed, the meters to be inspected for each piece of large equipment are often also scattered throughout the machine room. In such machine rooms, there are often many different inspection items. Furthermore, when performing such a large number of inspections, the user moves around a lot to carry out the inspections. Furthermore, in some cases, the user may have to move around by climbing a ladder, for example.

[0111] Furthermore, when inspecting, the user also performs incidental tasks such as turning on the lights (and turning them off when finished) or opening the door to the power panel. For this reason, there is a need to eliminate manual input of inspection results as much as possible. Therefore, if the voice recognition system 1 can input the inspection results by voice, it will be easier for the user to inspect.

[0112] In addition, when there is a lot of movement, such as in the above-mentioned inspection in a machine room, there is a high possibility that other workers and managers will talk to the inspector while he or she is performing the inspection. Therefore, if the voice recognition system 1 can suspend and cancel the inspection, the inspection can be suspended and resumed, allowing the inspection to be performed efficiently.

[0113] Depending on the arrangement of the equipment and meters, multiple instruments may be installed in one location. In such an installation situation, many inspection results are often input in one location. Therefore, if the user waits until the device finishes outputting audio before inputting audio, the waiting time for inputting audio increases, and the inspection takes time. On the other hand, if the device is configured to limit audio output and allow audio input, the user does not need to wait for audio output to finish, and the time required for inputting audio can be shortened. Therefore, the inspection can be performed efficiently.

[0114] The earphones 12 used to output the sound are preferably of the inner ear type. The inner ear type has a shape that blocks external sounds when the earphones 12 are worn. For example, at a site where equipment is in operation, the environment is often noisy due to the sound of the equipment operating. Therefore, with the inner ear type earphones 12, the output sound is easy to hear even in a noisy environment. Also, compared to bone conduction type earphones, inner ear type earphones can often be made smaller.

[0115] The order of inspection items and the necessity of inspection may be set. For example, the second voice SD2 is output in the order of "item numbers" in the registration database D1. Therefore, before the inspection, the order of inspection may be changed by changing the setting of "item numbers" or the correspondence between "inspection items" and "item numbers" in "pre-processing."

[0116] It may also be possible to set "inspection items" that are not to be inspected to "OFF."

[0117] The items to be inspected may differ depending on the operation status of the equipment, etc. Therefore, if the order and necessity of inspection can be set, the contents of the inspection can be flexibly changed to match the operation status, etc. on the day of inspection.

[0118] The information processing device is not limited to the hardware configuration shown above. For example, the information processing device may have a hardware configuration further including a calculation device, a control device, a storage device, an input device, an output device, and peripheral devices other than those shown above. The input device and the output device may be integrated into a touch panel or the like. The mobile terminal 11 and the server 10 may be devices with different hardware configurations. Furthermore, the connection with the peripheral devices and other devices may be wired or wireless.

[0119] Furthermore, the mobile terminal 11 may be an information processing device such as a tablet, a smartphone, or a mobile personal computer.

[0120] <Modification of restriction process> Note that the restriction process PR1 is not limited to a process of stopping the output of the second sound SD2. For example, the restriction process PR1 may be a process of limiting the second sound SD2 by lowering the volume of the second sound SD2. The restriction process PR1 may also be a process of limiting the second sound SD2 by gradually lowering the volume of the second sound SD2. In this way, the restriction process PR1 may limit the output of the second sound SD2 by lowering the volume more than usual.

[0121] Alternatively, the restriction process PR1 may be a process for restricting the second sound SD2 that starts to be outputted after the second sound SD2. In this manner, the restriction process PR1 may restrict the output of the second sound SD2 by moving from the inspection item currently indicated by the second sound SD2 to the next inspection item.

[0122] Alternatively, the limiting process PR1 may be a process of limiting the second audio SD2 by increasing the output speed of the second audio SD2. In other words, the limiting process PR1 may limit the output of the second audio SD2 by fast-forwarding the second audio SD2.

[0123] When such a restriction process PR1 is performed, it is possible to reduce the output of unnecessary audio.

[0124] <Modification for group setting and omission> In addition, some of the inspections may be omitted. For example, the following process may be omitted.

[0125] 12 is a diagram showing a modified example in which group setting and omission are performed. In the following, an example will be described in which the equipment to be inspected is "first equipment", "second equipment", "third equipment", and "fourth equipment", and inspections are performed in this order.

[0126] In this example, similarly to the first embodiment, etc., it is assumed that the inspection items for the first equipment are output in the 31st output EX31. Also, in this example, it is assumed that the inspection of the first equipment including the 31st output EX31 is to be omitted.

[0127] When omitting, the user 13 performs the omission operation C3. For example, the omission operation C3 is an operation of pressing a predetermined button, or inputting a word set in advance, such as "omission," in the first voice SD1. Note that the type of operation of the omission operation C3 is set in advance.

[0128] As shown in the figure, when an omission operation C3 is performed while the 31st output EX31 is being output, the voice recognition system 1 performs an omission process PR3 that omits the inspection of the first equipment including the 31st output EX31. For example, the omission process PR3 is a process that stops the output of the 31st output EX31 and proceeds to the inspection of the second equipment. Therefore, when the omission operation C3 is performed, the voice recognition system 1 starts outputting the 32nd output EX32 that indicates the inspection items for the second equipment.

[0129] Incidentally, which of the inspection items registered in advance corresponds to the inspection of the first equipment is determined based on, for example, a group setting such as the one below.

[0130] FIG. 13 is a diagram showing an example of group settings. For example, a case will be described where inspection items as shown in the figure have been registered in advance. In this example, the "inspection items" with "item numbers" of "1" and "2" are inspections of the first equipment. Similarly, the "inspection items" with "item numbers" of "3" through "5" are inspections of the second equipment. Furthermore, the "inspection item" with "item number" of "6" is an inspection of the third equipment. Furthermore, the "inspection item" with "item number" of "7" is an inspection of the fourth equipment.

[0131] A group GS is set for these multiple inspection items. For example, as shown in the figure, the voice recognition system 1 performs a group setting procedure in which a numerical value is input into "group" to set the group GS. In this example, "inspection items" with "item numbers" of "1" and "2" are grouped together and set as a group "G1". Similarly, in this example, "inspection items" with "item numbers" of "3" to "5" are grouped together and set as a group "G2". Note that the group GS is not limited to each piece of equipment, and may be set as one group such as "G3", which includes inspection items for a third piece of equipment and a fourth piece of equipment.

[0132] As shown in FIG. 12, for example, when an abbreviation operation C3 is performed on the 31st output EX31 corresponding to an inspection of the first equipment, the voice recognition system 1 determines that the abbreviation operation C3 is an operation corresponding to the group “G1.”

[0133] 13, the group GS of "G1" includes "inspection items" with "item numbers" of "1" and "2." Therefore, the speech recognition system 1 performs an omission procedure to omit the second speech SD2 indicating the "inspection items" with "item numbers" of "1" and "2."

[0134] The omission operation C3 may be an operation of inputting the name of the group or facility to be omitted.

[0135] For example, when a facility is not in operation, inspection may not be required. If inspection of such a facility can be omitted, inspection can be performed more efficiently.

[0136] <Modification for checking> It is desirable that the voice recognition system 1 is configured to check the inspection results and determine whether or not there is an abnormality in the equipment. Hereinafter, the value to be checked, i.e., the data input by the first voice SD1 and showing the voice recognition result, will be referred to as the "first input data." On the other hand, the data used to check the first data will be referred to as the "second input data."

[0137] When the first input data is generated in the first data generation procedure, that is, by voice recognition, the voice recognition system 1 performs a determination procedure in which the first input data is compared with the second input data to determine whether or not the first input data is abnormal.

[0138] The second input data may be stored before the first input data, that is, by the storage procedure before the first input data is checked. For example, the second input data may be stored as follows.

[0139] 14 is a diagram showing an example in which the second input data is the previous result. Below, an example will be described in which the inspection items are the same as those in the first embodiment. For example, the second input data is the previous inspection result (hereinafter referred to as "previous result V21") stored in correspondence with each "inspection item" as shown in the figure as "second input data."

[0140] The previous result V21 is based on the assumption that no abnormality was found in the previous inspection. Therefore, if an abnormality was found in the previous inspection, the previous inspection result or a normal value may be input to the previous result V21.

[0141] That is, the voice recognition system 1 compares the first input data, i.e., the current inspection result, with the previous result V21 to determine whether there is a difference. If the first input data and the second input data are different, the voice recognition system 1 determines that there is an abnormality.

[0142] The range that is determined to be normal may have a certain tolerance. That is, the voice recognition system 1 determines that the first input data is abnormal if it is outside the tolerance range for the second input data. For example, the tolerance range is set as follows:

[0143] Fig. 15 is a diagram showing an example of setting an allowable range. For example, allowable range V22 indicates a range in which the result is judged to be "normal" even if it deviates from the previous result V21, as in the "allowable range" shown in the figure. Note that this example is an example in which allowable range V22 is set to "none" so that all cases in which there is no match with the previous result V21, such as when the "item number" is "2", are judged to be "abnormal".

[0144] In this way, the allowable range V22 may be configured to have a certain margin for the previous result V21. In particular, when a numerical value is the subject of inspection, a small fluctuation in the numerical value is often not abnormal. Therefore, if an allowable range can be set in this way, abnormalities can be accurately determined.

[0145] In this way, when there is a difference between the previous result V21, i.e., the most recent inspection result, it is determined that there is an abnormality in the equipment. When such a check is performed, the voice recognition system 1 can notify the user of the equipment in which an abnormality has occurred.

[0146] The check may be performed by setting a value indicating a normal value or a normal range in the second input data as follows.

[0147] 16 is a diagram showing an example in which the second input data is set to a normal value or normal range. For example, a value such as the illustrated "normal value or normal range of second input data" (hereinafter referred to as "normal value V23") may be set in advance.

[0148] When the normal value V23 is set, the voice recognition system 1 can grasp the normal value or range. Therefore, the voice recognition system 1 compares the first input data with the normal value V23, and if the first input data and the second input data are different or the first input data is outside the normal range, it determines that there is an abnormality. When such a check is performed, the voice recognition system 1 can notify equipment in which an abnormality is occurring.

[0149] <Modification using first and second dictionaries> Note that data, programs, and the like may be downloaded to the mobile terminal 11, and the entire processing may be performed by the mobile terminal 11. For example, the communication environment at the site where the inspection is performed may not be good. That is, the communication environment at the site may be such that it is difficult to communicate between the mobile terminal 11 and the server 10.

[0150] Therefore, a configuration may be adopted in which before the start of the inspection, setting values ​​and the like input in advance are downloaded from the server 10, and while the inspection is being performed, the entire process can be completed without communication between the mobile terminal 11 and the server 10. In this case, when the inspection is completed and an environment is created in which communication can be performed between the mobile terminal 11 and the server 10, the inspection results and the like may be uploaded from the mobile terminal 11 to the server 10.

[0151] In such a case, it is desirable that the dictionary used for speech recognition is a dictionary for the inspection field, as follows.

[0152] 17 is a diagram showing a modified example using a first dictionary D211 and a second dictionary D212. Hereinafter, an information processing device that can be used via a network NW, such as the server 10, is referred to as a "first information processing device." In contrast to the first information processing device, an information processing device such as the mobile terminal 11 that can be used by a user 13 on-site is referred to as a "second information processing device."

[0153] As illustrated, the dictionary used for voice recognition in the first information processing device is called a "first dictionary D211." On the other hand, the dictionary used for voice recognition in the second information processing device is called a "second dictionary D212."

[0154] Since the second information processing device is a portable information processing device, the memory area MEM tends to be smaller than that of the first information processing device.

[0155] The second dictionary D212 is a dictionary for the inspection field. Therefore, the second dictionary D212 can have a smaller data capacity than the first dictionary D211. Therefore, it is preferable that the second dictionary D212 is a dictionary that can be stored even in an information processing device with a storage area MEM having a smaller storage capacity than the first information processing device, such as the second information processing device.

[0156] The dictionary for the inspection field is a dictionary suitable for voice recognition of terms frequently used in inspection. For example, the dictionary for the inspection field is set with numerical values, terms used in inspection results, names of equipment, etc. In this way, when a dictionary limited to terms frequently used in inspection is used, voice recognition can be realized in a small storage area, and the first input data V10 can be generated by executing voice recognition with high accuracy.

[0157] <Modification of noise cancellation> The voice recognition system 1 is preferably configured to cancel noise contained in the first voice SD1, and preferably performs voice recognition based on a voice (hereinafter referred to as a "third voice") from which the noise of the first voice SD1 has been cancelled.

[0158] Noise cancellation is performed by attenuating noise included in a target frequency band using, for example, a low-pass filter, a band-pass filter, or a combination of multiple filters. For example, the filter is realized by a digital filter or a filtering circuit.

[0159] In addition, it is desirable to set the frequency band to be canceled for each site or position individually. An example of setting the frequency band to be canceled for each site will be described below.

[0160] Fig. 18 is a diagram showing an example of setting a frequency band to be cancelled for each site. Hereinafter, Fig. 18(A) is for a "first site" and Fig. 18(B) is for a "second site." Note that the frequency band to be cancelled may be set based on location information using a GPS or the like.

[0161] For example, at the first site, if a certain period of voice (assuming that there is no voice produced by the user 13) is input and frequency analysis (e.g., FFT (Fast Fourier Transform)) is performed on the voice input data, frequency analysis results such as those shown in Figures 18(A) and 18(B) are obtained.

[0162] FIG. 18(A) shows an example in which noise (hereinafter, the noise generated at the first site is referred to as "first noise NZ1") occurs at a first site in the frequency band as shown in FIG. 18(A) (hereinafter, referred to as "first frequency band FR1").

[0163] Figure 18(B) is an example in which noise (hereinafter, the two noises occurring at the second site are referred to as "second noise NZ2" and "third noise NZ3") occurs at a second site in the frequency band shown in Figure 18(B) (hereinafter, referred to as "second frequency band FR2").

[0164] Noise may vary from site to site or location. For example, if different types of equipment are in operation at each site, the equipment may emit different sounds, and the frequency bands in which noise occurs may also differ. In this example, the first site generates a first noise NZ1, whereas the second site generates a second noise NZ2 and a third noise NZ3. In this example, the first site generates noise in a lower frequency band than the second site.

[0165] Therefore, in the first site, it is desirable to target the first frequency band FR1 for cancellation in order to attenuate the first noise NZ1, whereas in the second site, it is desirable to target the second frequency band FR2 for cancellation in order to attenuate the second noise NZ2 and the third noise NZ3.

[0166] The first frequency band FR1 and the second frequency band FR2 are set by analyzing the sound for each site or position before an inspection is performed, for example. The frequency bands may be set by inputting numerical values.

[0167] In this way, noise cancellation suitable for each site or location can be performed, and therefore, speech recognition can be performed using the third speech in which the noise contained in the speech has been attenuated, thereby improving the accuracy of speech recognition.

[0168] <Variations of Suspension and Cancellation> The interruption process PR2 may be performed when the voice recognition system 1 recognizes a predetermined word by voice recognition, as follows.

[0169] Fig. 19 is a diagram showing a first modified example of interruption and cancellation. The following describes an example in which the second voice SD2 is output similarly to the second embodiment. Compared to the second embodiment, this modified example is different in that a predetermined word is used for interruption and cancellation.

[0170] In this example, when the word "pause" (hereinafter referred to as "interrupted voice C11") is input in the first voice SD1, the voice recognition system 1 interrupts the output of the second voice SD2.

[0171] After the interruption, when the voice recognition system 1 inputs the word "cancel" (hereinafter referred to as "cancel voice C21") in the first voice SD1, the interruption is cancelled.

[0172] The words of the interruption voice C11 and the release voice C21 are set in advance.

[0173] In this way, if the interruption and release can be operated by using a predetermined word, the user 13 can perform the operation even when, for example, holding a tool in his / her hand, thereby improving operability.

[0174] 20 is a diagram showing a second modified example of the interruption and cancellation. In this example, as shown in the figure, the operation of pressing a button on the earphone 12 is the interruption operation.

[0175] For example, a first button press (hereinafter referred to as a "first operation C12") causes the voice recognition system 1 to stop outputting the second voice SD2.

[0176] Next, by pressing the button a second time (hereinafter referred to as "second operation C22"), the voice recognition system 1 releases the interruption.

[0177] If the operation can be performed using such earphones 12, the trouble of taking out mobile terminal 11 can be eliminated.

[0178] As shown in the figure, the 200th output EX200 may be omitted. In this example, the speech recognition system 1 outputs the output speech from the time point at which the 21st output EX21 is started (hereinafter referred to as the "second time point"), which is a time point prior to the first time point at which the interruption occurred. The second time point is set in advance, or is the initial time point of the output speech that was output at the first time point, etc. In this way, the output speech may be restated.

[0179] The interruption and release may also be realized by a button or the like, for example by interrupting while a specific button is pressed and releasing when the button is no longer pressed.

[0180] Alternatively, the interruption and release may be linked to the start and end of a predetermined operation by the mobile terminal 11 or the like. For example, when detecting an incoming call to the mobile terminal 11, the voice recognition system 1 interrupts the output of the second voice SD2. The predetermined operation is set in advance. The predetermined operation may also be an operation by an external device.

[0181] <Modifications of Audio Input and Audio Output> 21 is a diagram showing a modified example of voice input and voice output. Hereinafter, an example will be described in which a numeric value of "12.3" (hereinafter referred to as "target numeric value 20") is handled by voice as shown in the figure.

[0182] In the first voice SD1, that is, in the input, it is preferable that the target number 20 is input one digit at a time. Specifically, as shown in the figure, the pronunciation 21 that becomes the first voice SD1 is preferable to read out one digit at a time by breaking down the target number 20 into "ichi," "ni," "ten," and "san."

[0183] In the second voice SD2, i.e., in the output, it is desirable that the target numerical value 20 is output so as to express the entire numerical value. Specifically, as shown in the figure, it is desirable that the data voice 22 which becomes the second voice SD2 expresses the entire target numerical value 20 and outputs it so as to express the entire numerical value, such as "ten-ten-san."

[0184] Voice recognition can be performed with high accuracy when the voice reads out one digit at a time, such as the pronunciation 21. On the other hand, when the data voice 22 expresses the entire numerical value, the user 13 can easily understand the numerical value by voice rather than when the numerical value is output one digit at a time.

[0185] <Modification for Offline Speech Recognition> It is desirable to have a configuration that can recognize input speech even in an offline environment.

[0186] Construction and maintenance sites are often in an environment where it is difficult to connect to the Internet due to the communication environment. Therefore, it is often difficult to use the cloud all the time. Therefore, if a voice recognition engine in the cloud is always used, voice recognition and the like may not be able to be performed at the work site. In order to avoid such a situation, a configuration using a voice recognition engine operating in the mobile terminal 11 is desirable. In particular, a configuration in which fixed, short words are voice-recognized by the voice recognition engine operating in the mobile terminal 11 is desirable.

[0187] With this configuration, it is possible to use the voice recognition system 1 even offline. Therefore, even in an environment where it is difficult to connect to the Internet, it is possible to input voice using the voice recognition system 1.

[0188] Furthermore, it is preferable that the mobile terminal 11 is configured to record non-standard voice input such as comments by the user 13. In an environment connected to the Internet such as an office, the mobile terminal 11 is configured to transmit the recorded voice to a voice recognition engine on the cloud and convert it into text.

[0189] In this way, it is desirable to have a configuration in which a voice recognition engine that can be used offline and a voice recognition engine that can be used online are used separately.

[0190] The voice recognition engine may be switched depending on the communication environment. Specifically, the mobile terminal 11 measures radio wave strength to determine whether the communication environment is good or bad. The quality of the communication environment may be registered in advance for each site, or previous determination results may be stored. In this way, a configuration that takes the communication environment into consideration can prevent problems such as the inability to use a voice recognition engine on the cloud.

[0191] In addition, in order to perform recording offline as described above, it is preferable that the mobile terminal 11 has a configuration including a memory unit and a recording data generation unit that can record input voice data, generate recording data, and store the recording data.

[0192] The storage unit and the recorded data generating unit are not limited to being used offline. That is, the storage unit and the recorded data generating unit may generate and store recorded data even in an environment where a voice recognition engine on the cloud can be used.

[0193] Since communication may be suddenly cut off, it is desirable to have a configuration that allows recording even if a voice recognition engine on the cloud is available, and such a configuration allows backup.

[0194] <Other embodiments> The embodiment is not limited to the above example. For example, the number of devices is not limited to the number shown in the above example. Therefore, each device in the above example may be a system of two or more devices. On the other hand, the device may be a single device. In addition, the types and combinations of information processing devices may not be the devices shown above.

[0195] The embodiment is not limited to the above process. For example, the speech recognition method according to the present invention may be performed in an order other than that described above. Furthermore, the speech recognition method may be executed by a plurality of information processing devices. That is, each step in the speech recognition method may be executed in a redundant, distributed, parallel, virtualized, or combination thereof.

[0196] The embodiment may be realized by a program. That is, a computer such as an information processing device may control an arithmetic device and a storage device based on the program to execute the above-mentioned method. The program may be recorded on a computer-readable recording medium and distributed. The recording medium may be a medium such as a magnetic tape, a flash memory, an optical disk, a magneto-optical disk, or a magnetic disk. Furthermore, the program may be distributed through a telecommunication line.

[0197] The present invention is not limited to the above-described configuration of the embodiment, combination with other elements, etc. These points can be changed without departing from the spirit of the present invention, and can be appropriately determined according to the application form. [Explanation of symbols]

[0198] 1. Voice Recognition System 1F100 Interruption means 1F101 Release method 1F11 Voice input means 1F12 Voice recognition means 1F13 Registration method 1F14 Output method 1F15 Restrictive measures 1F16 Input data generation means 1F17 Storage means 1F18 Judgment means 1F19 Noise cancellation means 1F20 Group setting method 1F21 Omitted operation means 10 Server 11 Mobile devices 12 Earphones 13 users 20 Target figures 21 Pronunciation 22 Data Voice C1 Interrupt operation C2 release operation C3 Omit operation C11 Audio interruption C12 1st operation C21 Release Voice C22 2nd operation D211 First Dictionary D212 Second Dictionary EX11 11th output EX12 12th output EX13 13th output EX21 21st output EX22 Output 22 EX23 23rd output EX31 31st output EX32 32nd output EX200 200th output FR1 First frequency band FR2 Second frequency band GS Group MEM storage area NW Network NZ1 No. 1 noise NZ2 2nd noise NZ3 3rd Noise PR1 Restriction Processing PR2 Abort Processing PR3 Omission processing SD1 1st Audio SD2 2nd Audio V10 1st input data V21 Previous Results V22 Tolerance V23 Normal Value

Claims

1. A voice input means for inputting a first voice; a voice recognition unit that performs voice recognition based on the first voice; A registration means for registering a second voice; an output means for outputting the second sound; a limiting means for limiting the output of the second sound when the first sound is input while the second sound is being output; A speech recognition system including:

2. Used for equipment inspection 2. The speech recognition system of claim 1.

3. an input data generating means for generating first input data indicating the content of the first voice based on a speech recognition result of the first voice; a storage means for storing second input data used to check the first input data; a determination means for comparing the first input data with the second input data to determine whether or not the first input data is abnormal; Further includes 3. A speech recognition system according to claim 1 or 2.

4. The second input data is inputted before the first input data, The determination means is If the first input data and the second input data are different, or if the first input data is outside a tolerance range for the second input data, it is determined that an abnormality has occurred.

4. The speech recognition system of claim 3.

5. The second input data is A value indicating a normal value or normal range, The determination means is If the first input data and the second input data are different, or if the first input data is outside the normal range, it is determined that an abnormality has occurred.

4. The speech recognition system of claim 3.

6. A speech recognition system including a first information processing device and a second information processing device, The first information processing device, Performing speech recognition using the first dictionary; The second information processing device is the speech recognition means for recognizing the first speech using a second dictionary; The second dictionary is a dictionary for the inspection domain. A speech recognition system according to any one of claims 1 to 5.

7. a noise canceling unit that cancels noise included in the first sound to generate a third sound, The voice recognition means performing speech recognition using the third speech; The noise canceling means sets a frequency band to be cancelled for each site or position. A speech recognition system according to any one of claims 1 to 6.

8. The limiting means limits the output of the second voice by stopping the output of the second voice, reducing the volume of the second voice, gradually reducing the volume of the second voice, starting the output of a voice to be output next to the second voice, or increasing the output speed of the second voice. A speech recognition system according to any one of claims 1 to 7.

9. The registration means registers a plurality of inspection items in association with the second sound, A group setting means for setting a group of the inspection items; an omission operation means for inputting an omission operation for omitting the group; When the omission operation is input, the output of the second sound based on the inspection item belonging to the group corresponding to the omission operation is omitted. A speech recognition system according to any one of claims 1 to 8.

10. A voice input means for inputting a first voice; a voice recognition unit that performs voice recognition based on the first voice; A registration means for registering a second voice; an output means for outputting the second sound; a limiting means for limiting the output of the second sound when the first sound is input while the second sound is being output; A voice recognition device comprising:

11. A speech recognition method performed by a speech recognition system, comprising: a speech input step of inputting a first speech by the speech recognition system; a speech recognition step in which a speech recognition system performs speech recognition based on the first speech; a registration step in which the voice recognition system registers the second voice; an output step of the speech recognition system outputting the second speech; a limiting step of limiting output of the second voice when the first voice is input while the second voice is being output by the voice recognition system; A speech recognition method comprising:

12. A program for causing a computer to execute the speech recognition method according to claim 11.

Images