Voice display device, voice display system, voice display method, and program

Abstract

To provide a voice display device, voice display system, voice display method, and program that can be used for collecting information in an emergency.SOLUTION: A voice display device comprises: an acquisition unit for acquiring voice signals; a voice recognition unit for recognizing the acquired voice signals; a display unit for displaying the results of the voice recognition; and a processing unit for, when a wake word is acquired, launching an application that displays results of voice recognition of voice signals containing the wake word, and displaying the results of voice recognition of the voice signals containing the wake word on the display unit.SELECTED DRAWING: Figure 2

Description

[Technical Field]

[0001] The present invention relates to an audio display device, an audio display system, an audio display method, and a program. [Background technology]

[0002] For example, a conference support system has been proposed for people with hearing impairments, which recognizes speech and displays the recognized text on a screen (see, for example, Patent Document 1). Such a system has been used, for example, in company meetings. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6548045 Summary of the Invention [Problem to be solved by the invention]

[0004] There has been a demand for using conventional technology systems not only for meetings but also for gathering information in emergencies. However, it has been difficult to use conventional technology for gathering information in emergencies.

[0005] The present invention has been made in consideration of the above-mentioned problems, and aims to provide an audio display device, an audio display system, an audio display method, and a program that can be used to collect information in an emergency. [Means for solving the problem]

[0006] (1) In order to achieve the above object, an audio display device according to one embodiment of the present invention is an audio display device that includes an acquisition unit that acquires an audio signal, a voice recognition unit that recognizes the acquired audio signal, a display unit that displays the results of the voice recognition, and a processing unit that, when a wake word is acquired, launches an application that displays the results of the voice recognition of the audio signal including the wake word, and displays the results of the voice recognition of the audio signal including the wake word on the display unit.

[0007] (2) In one aspect of the audio display device according to (1) above, the application may display the results of voice recognition of the audio signal including the wake word on a first screen image, and a plurality of function selection button images may be displayed on the first screen image. When one of the plurality of function selection button images is selected, the processing unit may transition to a second screen image corresponding to the selected function selection button image and display on the second screen image an image indicating that the user of the audio display device is a hearing person.

[0008] (3) In one aspect of the audio display device of (2) above, the second screen image may include an audio capture button image, and when the audio capture button image is selected, the processing unit may acquire a speaker's audio signal, perform voice recognition on the acquired speaker's audio signal, and convert the voice recognition result into text and display it in the second screen image.

[0009] (4) In an audio display device according to any one of the above aspects (1) to (3), the device may further include a vibration unit that provides an alert by vibration, and when the wake word is acquired, the processing unit may launch an application that displays the results of voice recognition of the audio signal including the wake word, and may vibrate the vibration unit to provide an alert.

[0010] (5) In order to achieve the above object, one aspect of the present invention provides an audio display system comprising an audio display device and an information processing device, wherein the audio display device comprises an acquisition unit that acquires an audio signal, a voice recognition unit that recognizes the acquired audio signal, a communication unit that transmits the voice recognition results to the information processing device and receives the results of the information processing device detecting a wake word, a display unit that displays the voice recognition results, and a processing unit that, when a wake word is detected, launches an application that displays the voice recognition results of the audio signal including the wake word and displays the voice recognition results of the audio signal including the wake word on the display unit, and the information processing device comprises an information processing unit that receives the voice recognition results from the audio display device, determines whether the wake word is included in the voice recognition results, and, if the wake word is included, transmits a phrase including the wake word to the audio display device as information indicating that the wake word is included.

[0011] (6) In order to achieve the above object, one aspect of the present invention provides an audio display method in which an acquisition unit acquires an audio signal, a voice recognition unit recognizes the acquired audio signal, a display unit displays the results of the voice recognition, and a processing unit, when a wake word is acquired, launches an application that displays the results of the voice recognition of the audio signal including the wake word, and displays the results of the voice recognition of the audio signal including the wake word on the display unit.

[0012] (7) In order to achieve the above object, one aspect of the present invention provides a program that causes a computer of an audio display device to acquire an audio signal, recognize the acquired audio signal, display the results of the audio recognition, and, when a wake word is acquired, launch an application that displays the results of the audio recognition of the audio signal including the wake word, and display the results of the audio recognition of the audio signal including the wake word. [Effects of the Invention]

[0013] According to the above (1) to (7), it can be used to gather information in emergencies. Also, according to the above (1) to (7), even the hard-of-hearing and hearing-impaired people can notice emergency broadcasts in the building and know the contents of the emergency broadcasts. [Brief explanation of the drawings]

[0014] [Figure 1] FIG. 10 is a diagram showing an example of an emergency broadcast in a commercial facility or the like. [Figure 2] 1 is a diagram illustrating an example of the configuration of an audio display system according to a first embodiment. [Figure 3] FIG. 4 is a diagram illustrating an example of information stored in a storage unit. [Figure 4] 3A and 3B are diagrams showing a first example of a screen and a second example of a screen displayed on an image display unit of a mobile terminal according to an embodiment. [Figure 5] 4 is a flowchart of processing performed by the mobile terminal according to the first embodiment. [Figure 6] FIG. 10 is a diagram illustrating an example of the configuration of an audio display system according to a second embodiment. [Figure 7] 10 is a flowchart of processing performed by a mobile terminal and an information processing device according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0015] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the drawings used in the following description, the scale of each component is appropriately changed so that each component can be recognized. In all the drawings for explaining the embodiments, the same reference numerals are used for components having the same functions, and repeated explanations will be omitted. Furthermore, in this application, "based on XX" means "based on at least XX," and includes cases where it is based on other elements in addition to XX. Furthermore, "based on XX" is not limited to cases where XX is used directly, but also includes cases where it is based on XX that has been calculated or processed. "XX" is any element (for example, any information).

[0016] <Summary> Figure 1 shows an example of an emergency broadcast in a commercial facility. Nowadays, announcements and in-house announcements are often made in emergencies at stations, on trains, large commercial facilities, etc. People with normal hearing can notice such broadcasts. However, if someone in the area is hard of hearing or has a hearing impairment, they may not notice such an emergency broadcast.

[0017] For this reason, in this embodiment, for example, when an emergency broadcast is made by the alarm unit 44 of the in-house public address system 4, an application is launched based on words contained in the broadcast, and an emergency broadcast detection screen (first screen) is displayed on the mobile terminal 2 used by the user Hu. Note that the emergency broadcast detection screen displays, for example, the emergency broadcast content after being converted into text through voice recognition. Furthermore, in this embodiment, a "HELP button" image or the like is displayed on the first screen, allowing the user to call for help from people around them.

[0018] [First embodiment] In this embodiment, an example will be described in which a mobile terminal starts an application and performs processing when an emergency broadcast is received.

[0019] <Example of audio display system configuration> FIG. 1 is a diagram showing an example of the configuration of an audio display system according to this embodiment. As shown in FIG. 1, the audio display system 1 includes, for example, a mobile terminal 2 (audio display device) and an in-house broadcasting device 4. The mobile terminal 2 includes, for example, a voice signal acquisition unit 21, a voice recognition unit 22, a wake word detection unit 23, a processing unit 24, a vibration unit 25, an image display unit 26, an operation detection unit 27, a voice output unit 28, a memory unit 29, and a lighting unit 30. The in-house broadcasting device 4 includes, for example, an emergency information acquisition unit 41, a voice information generation unit 42, a control unit 43, and an alarm issuing unit 44.

[0020] The in-house broadcasting device 4 is a broadcasting system used in, for example, stations, ward offices, commercial facilities, department stores, supermarkets, shopping centers, and the like.

[0021] The emergency information acquisition unit 41 acquires emergency information from, for example, the national government, prefectures, mayors and villages, the Meteorological Agency, the Defense Agency, etc. The emergency information acquisition unit 41 acquires emergency information from, for example, a security guard when an emergency (fire, suspicious object, suspicious person) or the like occurs or is discovered within the building.

[0022] The audio information generating unit 42 generates an emergency audio signal to be broadcast over the public address system. The emergency audio signal may be generated by an announcer or the like reading out a script directly, or may be a pre-recorded signal.

[0023] When emergency information is acquired and an emergency voice signal is generated, the control unit 43 causes the alarm unit 44 to issue the generated emergency voice signal.

[0024] The alarm issuing unit 44 is, for example, a speaker, and issues an emergency audio signal in response to control by the control unit 43.

[0025] The mobile terminal 2 is, for example, a smartphone or tablet terminal equipped with a display unit, a speaker, a microphone, and the like.

[0026] The audio signal acquisition unit 21 is, for example, a microphone. The number of microphones may be multiple. The audio signal acquisition unit 21 acquires an audio signal.

[0027] The voice recognition unit 22 performs well-known voice recognition processing (noise suppression, sound source separation, language analysis, text conversion, etc.) on the acquired voice signal. The voice recognition unit 22 converts each sound source into text and outputs the text to the wake word detection unit 23.

[0028] Wake word detection unit 23 determines whether the text contains a wake word stored in storage unit 29. If the text contains a wake word, wake word detection unit 23 outputs the wake word contained in the text and information indicating that the wake word was included to processing unit 24. Wake word detection unit 23 also extracts phrases containing the wake word from the text for each utterance output by speech recognition unit 22 and outputs the phrases to processing unit 24.

[0029] When processing unit 24 acquires from wake word detection unit 23 the wake word contained in the text and information indicating that the wake word is included, it launches the emergency broadcast application stored in storage unit 29, and displays a display screen (first screen) corresponding to the wake word on image display unit 26 while vibrating vibration unit 25. Processing unit 24 also displays a phrase containing the wake word on the first screen. An example of the first screen will be described later. When a button image (function selection button image) on the first screen is operated, processing unit 24 performs processing corresponding to the button image. An example of the button image and an example of processing corresponding to the button image will be described later.

[0030] The vibration unit 25 vibrates in response to processing by the processing unit 24. For example, the vibration unit 25 has a vibrator connected to the rotating shaft of a motor, and generates vibrations through rotation. This vibration allows users who are hard of hearing or have hearing impairments to know that an emergency broadcast has been made.

[0031] The image display unit 26 displays a first screen, a second screen corresponding to the button image, and the like, in accordance with the control of the processing unit 24.

[0032] The operation detection unit 27 is, for example, a touch panel sensor or the like provided on the image display unit 26. The operation detection unit 27 detects an operation (touch, swipe, etc.) by the user and outputs the detection result to the processing unit 24.

[0033] The audio output unit 28 is, for example, a speaker. The audio output unit 28 may output, for example, text to be displayed on the first screen to the person requesting help or another person requesting help, in accordance with the processing of the processing unit 24.

[0034] The storage unit 29 stores a display image to be displayed in association with the wake word. The storage unit 29 stores an emergency broadcast application.

[0035] The illumination unit 30 is, for example, a light using an LED (light emitting diode). The illumination unit 30 switches the light on and off in response to control from the processing unit 24.

[0036] <wake word> Next, the wake word, information stored in the storage unit 29, and the like will be described. 3 is a diagram showing an example of information stored in the storage unit 29. The storage unit 29 stores the wake word in association with the first screen and the second screen to be displayed in accordance with the button image included on the first screen. Examples of wake words include "emergency broadcast," "fire," "earthquake," "tsunami," "suspicious person," "suspicious object," etc. Note that the wake word may be, for example, just one "emergency broadcast." The first screen is an image that matches these wake words. Note that the image on the first screen may be common to all wake words. The second screen is an image corresponding to each button image in the first screen. The storage unit 29 may store other information in association with the above information.

[0037] <Examples of images and button images displayed on mobile devices> Next, a description will be given of an example of an image displayed on the image display unit 26 of the mobile terminal 2. Fig. 4 is a diagram showing a first example of a screen and a second example of a screen displayed on the image display unit of the mobile terminal according to this embodiment.

[0038] Image g10 is an example in which, when an emergency broadcast audio signal is acquired and a wake word is detected, the emergency broadcast application is launched and the first screen is displayed. Image g11 is an example of an image showing an application that was automatically started by an emergency broadcast. Image g12 is an example of an image in which the audio signal of an emergency broadcast is processed by online voice recognition and converted into text and displayed. The area of image g13 is an example of a button image. Image g14 is a button image for "Dialogue mode" for people who need help or assistance. Image g14 is a button image for "HELP display" for people who need help or assistance. Image g16 is a button image for "H light on."

[0039] An image g20 is an example of an image of the second screen that is displayed when, for example, the "HELP display" button image g14 is operated by the user. Image g21 is an example of an image that displays the reason for wanting help, etc. The content of this may be set by the user in advance by selecting from a set of standard phrases, or may be set by the user by operating a software keyboard or the like displayed on the image display unit 26. Image g22 is an example image showing an example of a question to be asked. Such content may be registered in advance in the application. For example, the user may ask a question by pointing at the sentence of the question. Image g23 is an example of a speech voice acquisition button that can be selected when acquiring the voice of a person you want to talk to (someone who needs help, or someone who needs assistance). Note that text such as "Press this button when you start speaking" may also be displayed. Image g24 is an example of an image in which the speech of a person who wants to have a conversation (someone who needs help, or someone who needs assistance) is processed online, recognized, converted into text, and displayed.

[0040] <Example of processing procedure> Next, an example of a processing procedure performed by the mobile terminal 2 will be described. Fig. 5 is a flowchart of the processing performed by the mobile terminal according to this embodiment. In the following example, the wake word is "emergency broadcast."

[0041] (Step S1) The audio signal acquisition unit 21 acquires an audio signal.

[0042] (Step S2) Wake word detection unit 23 determines whether the text contains a wake word stored in storage unit 29. If the text contains a wake word, wake word detection unit 23 outputs to processing unit 24 the wake word contained in the text and information indicating that the wake word is included.

[0043] (Step S3) Processing unit 24 determines whether or not the wake word "emergency broadcast" is detected as an audio signal using the information output by wake word detection unit 23. If it is an emergency broadcast (step S3; YES), processing unit 24 proceeds to the process of step S4. If it is not an emergency broadcast (step S3; NO), processing unit 24 returns to the process of step S1.

[0044] (Step S4) Processing unit 24, for example, vibrates vibration unit 25 for a predetermined time, starts an application for emergency broadcasts, and displays a screen for when the wake word is "emergency broadcast" on image display unit 26. Note that if multiple wake words are set, processing unit 24 performs the process of step S4 for each wake word.

[0045] (Step S5) The processing unit 24 determines whether or not any one of the button images in the first screen has been operated based on the detection result of the operation detection unit 27. If any one of the button images has been operated (Step S5; YES), the processing unit 24 proceeds to the processing of Step S6. If any one of the button images has not been operated (Step S5; NO), the processing unit 24 repeats the processing of Step S5.

[0046] (Step S6) The processing unit 24 selects an image of the second screen corresponding to the selected button image, and switches the display on the image display unit 26 from the image of the first screen to the image of the second screen.

[0047] (Step S7) The processing unit 24 determines whether or not a button image (for example, image g23 in FIG. 4) has been selected on the second screen. If a button image has been selected on the second screen (step S7; YES), the processing unit 24 proceeds to the processing of step S8. If a button image has not been selected on the second screen (step S7; NO), the processing unit 24 repeats the processing of step S7.

[0048] (Step S8) The processing unit 24 performs processing according to the button image selected on the second screen, such as processing of recognizing voice and converting it into text.

[0049] 5 are merely examples, and the mobile terminal 2 may also be configured to perform other processes.

[0050] As described above, in this embodiment, when the wake word included in an emergency broadcast is recognized, the emergency broadcast application is launched and the emergency broadcast detection screen (first screen) is displayed. This allows the present embodiment to recognize and display the broadcast audio heard on the spot, so that users with hearing impairments, etc., can be notified of the emergency broadcast. In addition, in this embodiment, a "HELP display" button or the like is displayed on the emergency broadcast detection screen. Thus, according to this embodiment, when this button is pressed, predetermined text such as "I am hearing impaired" is displayed, allowing the user to ask for help from hearing people nearby.

[0051] [Second embodiment] In the first embodiment, an example has been described in which the mobile terminal 2 performs all of the processing, but this is not limiting. Some of the processing, such as voice recognition processing, wake word detection, and generation of the first and second screens, may be performed by the information processing device 5.

[0052] FIG. 6 is a diagram showing an example of the configuration of an audio display system according to this embodiment. As shown in FIG. 6, the audio display system 1A includes, for example, a mobile terminal 2A (audio display device), an in-house broadcasting device 4, and an information processing device 5. The mobile terminal 2A includes, for example, a voice signal acquisition unit 21, a voice recognition unit 22, a wake word detection unit 23, a processing unit 24A, a vibration unit 25, an image display unit 26, an operation detection unit 27, a voice output unit 28, a memory unit 29, a lighting unit 30, and a communication unit 31. The in-house broadcasting device 4 includes, for example, an emergency information acquisition unit 41, a voice information generation unit 42, a control unit 43, and an alarm issuing unit 44. The information processing device 5 includes, for example, a communication unit 51 (information processing device communication unit), a processing unit 52 (information processing device processing unit), a voice recognition unit 53 (information processing device voice recognition unit), a display image generation unit 54, and a memory unit 55.

[0053] The communication unit 31 transmits and receives information via a network NW to and from the information processing device 5. The network NW is a wireless line, such as the Internet.

[0054] The processing unit 24A transmits, for example, the acquired voice signal to the information processing device 5 via the communication unit 31. The processing unit 24A acquires the result of the voice recognition process performed by the information processing device 5.

[0055] The information processing device 5 is, for example, a server, a personal computer, or the like.

[0056] The communication unit 51 receives information (for example, a voice signal) from the mobile terminal 2A and outputs the received voice signal to the processing unit 52. The communication unit 51 transmits information (for example, a voice recognition processing result) output by the processing unit 52 to the mobile terminal 2A under the control of the processing unit 52. The communication unit 51 transmits image data of the first screen and the second screen generated by the display image generation unit 54 to the mobile terminal 2A.

[0057] The processing unit 52 outputs the voice signal received by the communication unit 51 to the voice recognition unit 53. The processing unit 52 transmits text information resulting from the voice recognition process performed by the voice recognition unit 53 to the mobile terminal 2A via the communication unit 51. The processing unit 52 transmits image data generated by the display image generation unit 54 to the mobile terminal 2A via the communication unit 51. Note that the processing unit 52 may detect a wake word from the text that has been subjected to the voice recognition process.

[0058] The voice recognition unit 53 performs a predetermined voice recognition process on the received voice signal.

[0059] The display image generating unit 54 generates image data for the first screen and the second screen.

[0060] The storage unit 55 stores programs, thresholds, wake words, image data for the first screen, image data for the second screen, and the like used by each functional unit.

[0061] All or part of the processing performed by the information processing device 5 may be performed on the cloud.

[0062] <Example of processing procedure between mobile terminal and information processing device> An example of a processing procedure performed by the mobile terminal 2A and the information processing device 5 will be described. Fig. 7 is a flowchart of processing performed by the mobile terminal and the information processing device according to this embodiment. The processing example in Fig. 7 is, for example, an example in which the information processing device 5 recognizes voice.

[0063] (Step S11) The voice signal acquisition unit 21 of the mobile terminal 2A acquires a voice signal.

[0064] (Step S12) The voice recognition unit 22 of the mobile terminal 2A performs voice recognition processing on the acquired voice signal using a known method.

[0065] (Step S13) The processing unit 24A of the mobile terminal 2A transmits the voice recognition processing result to the information processing device 5 via the communication unit 31. Note that the transmitted voice recognition processing result is provided with identification information for identifying the mobile terminal 2A.

[0066] (Step S14) The processing unit 52 of the information processing device 5 receives the voice recognition processing signal via the communication unit 51. The voice recognition unit 53 detects the wake word from the voice recognition processing signal received by the processing unit 52.

[0067] (Step S15) If the text contains a wake word, the processing unit 52 of the information processing device 5 transmits the wake word contained in the text and information indicating that the wake word was included to the mobile terminal 2A via the communication unit 51.

[0068] (Step S16) Processing unit 24A of mobile terminal 2A determines whether or not the wake word "emergency broadcast" has been detected as an audio signal, using the information output by wake word detection unit 23. If it is an emergency broadcast (step S16; YES), processing unit 24A proceeds to the process of step S17. If it is not an emergency broadcast (step S16; NO), processing unit 24A returns to the process of step S11.

[0069] (Step S17) Processing unit 24A of mobile terminal 2A, for example, vibrates vibration unit 25 for a predetermined time, starts an application for emergency broadcasts, and displays a screen for when the wake word is "emergency broadcast" on image display unit 26. Note that if multiple wake words are set, processing unit 24A performs the process of step S4 for each wake word.

[0070] (Step S18) The processing unit 24A of the mobile terminal 2A determines whether or not any one of the button images in the first screen has been operated, based on the detection result of the operation detection unit 27. If any one of the button images has been operated (Step S18; YES), the processing unit 24A proceeds to the processing of Step S19. If any one of the button images has not been operated (Step S18; NO), the processing unit 24A repeats the processing of Step S18.

[0071] (Step S19) The processing unit 24A of the mobile terminal 2A selects an image of the second screen corresponding to the selected button image, and switches the display on the image display unit 26 from the image of the first screen to the image of the second screen.

[0072] (Step S20) The processing unit 24A of the mobile terminal 2A determines whether or not a button image (for example, image g23 in FIG. 4) has been selected on the second screen. If a button image has been selected on the second screen (Step S20; YES), the processing unit 24A proceeds to the processing of Step S21. If a button image has not been selected on the second screen (Step S20; NO), the processing unit 24A repeats the processing of Step S20.

[0073] (Step S21) The processing unit 24A of the mobile terminal 2A performs processing according to the button image selected on the second screen, such as processing of recognizing voice and converting it into text.

[0074] 7 are merely examples and are not intended to be limiting. For example, the information processing device 5 may perform speech recognition processing on a speech signal acquired by the mobile terminal 2A and transmit the speech recognition result to the mobile terminal 2A online.

[0075] As described above, in this embodiment, the information processing device 5 performs part of the processing performed by the mobile terminal 2A. As a result, according to this embodiment, it is possible to reduce the processing load of the mobile terminal 2A.

[0076] <Application example> In the above example, the case where the user of the mobile terminal 2 is hard of hearing or has a hearing impairment has been described, but the present invention is not limited to this. Recently, some people walk in such environments while wearing earphones. Even such people may not notice an emergency broadcast. However, according to this embodiment, even users of such earphones can be notified first by vibration and then on the first screen by setting the mobile terminal 2. As a result, the method and device of this embodiment can be applied to people other than those who are hard of hearing or have a hearing impairment.

[0077] Note that a program for implementing all or part of the functions of the mobile terminal 2 (or 2A) and information processing device 5 of the present invention may be recorded on a computer-readable recording medium, and the program recorded on the recording medium may be loaded into a computer system and executed to perform all or part of the processing performed by the mobile terminal 2 (or 2A) and information processing device 5. Note that the term "computer system" as used herein includes hardware such as an OS and peripheral devices. The term "computer system" also includes a WWW system equipped with a homepage provision environment (or display environment). The term "computer-readable recording medium" refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems. The term "computer-readable recording medium" also refers to devices that retain a program for a certain period of time, such as volatile memory (RAM) within a computer system that acts as a server or client when the program is transmitted via a network such as the Internet or a communication line such as a telephone line. Alternatively, some or all of these components may be realized by hardware (including circuitry) such as an LSI (Large Scale Integration), an ASIC (Application Specific Integrated Circuit), an FPGA (Field-Programmable Gate Array), a GPU (Graphics Processing Unit), or an SOC (System On Chip), or may be realized by a combination of software and hardware.

[0078] The program may also be transmitted from a computer system storing the program in a storage device or the like to another computer system via a transmission medium or by transmission waves in the transmission medium. Here, the "transmission medium" that transmits the program refers to a medium that has the function of transmitting information, such as a network (communication network) such as the Internet or a communication line (communication line) such as a telephone line. The program may also be a program that realizes part of the above-mentioned functions. Furthermore, the program may be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0079] The above describes the form for carrying out the present invention using an embodiment, but the present invention is not limited to such an embodiment, and various modifications and substitutions can be made within the scope that does not deviate from the gist of the present invention. [Explanation of symbols]

[0080] 1,1A...audio display system, 2,2...mobile terminal, 4...in-house public address device, 5...information processing device, 21...audio signal acquisition unit, 22...audio recognition unit, 23...wake word detection unit, 24,24A...processing unit, 25...vibration unit, 26...image display unit, 27...operation detection unit, 28...audio output unit, 29...storage unit, 30...lighting unit, 31...communication unit, 41...emergency information acquisition unit, 42...audio information generation unit, 43...control unit, 44...alarm unit, 51...communication unit, 52...processing unit, 53...audio recognition unit, 54...display image generation unit, 55...storage unit, NW...network

Claims

1. an acquisition unit that acquires an audio signal; a voice recognition unit that recognizes the acquired voice signal; a display unit that displays the results of the voice recognition; a processing unit that, when a wake word is acquired, launches an application that displays a result of speech recognition of the audio signal including the wake word, and displays the result of speech recognition of the audio signal including the wake word on the display unit; An audio display device comprising:

2. the application displays a result of speech recognition of the speech signal including the wake word on a first screen image; A plurality of function selection button images are displayed on the first screen image, when one of the plurality of function selection button images is selected, the processing unit transitions to a second screen image corresponding to the selected function selection button image, and displays an image indicating that the user of the audio display device is a hearing person on the second screen image. The audio display device according to claim 1 .

3. the second screen image includes an audio capture button image; The processing unit When the voice acquisition button image is selected, a voice signal of the speaker is acquired, the acquired voice signal of the speaker is subjected to voice recognition, and the result of the voice recognition is converted into text and displayed on the second screen image. The audio display device according to claim 2 .

4. Further provided is a vibration unit that notifies by vibration, When the wake word is acquired, the processing unit starts an application that displays a result of speech recognition of the audio signal including the wake word, and vibrates the vibration unit to notify the user.

3. The audio display device according to claim 1.

5. an audio display device; an information processing device, The audio display device includes: an acquisition unit that acquires an audio signal; a voice recognition unit that recognizes the acquired voice signal; a communication unit that transmits a speech recognition result to the information processing device and receives a wake word detection result from the information processing device; a display unit that displays the results of the voice recognition; a processing unit that, when a wake word is detected, launches an application that displays a result of speech recognition of the audio signal including the wake word, and displays the result of speech recognition of the audio signal including the wake word on the display unit; Equipped with The information processing device includes: an information processing device processing unit that receives the voice recognition result from the voice display device, determines whether the wake word is included in the voice recognition result, and, if the wake word is included, transmits a phrase including the wake word to the voice display device as information indicating that the wake word is included; Equipped with Audio display system.

6. The acquisition unit acquires the audio signal, a voice recognition unit that recognizes the acquired voice signal; The display unit displays the results of the voice recognition. a processing unit, when a wake word is acquired, launching an application that displays a result of speech recognition of the audio signal including the wake word, and displaying the result of speech recognition of the audio signal including the wake word on the display unit; Audio display method.

7. To the computer of the audio display device, Acquire an audio signal, Recognizing the acquired audio signal; Display the voice recognition results, When a wake word is acquired, launching an application that displays a result of speech recognition of the audio signal including the wake word, and displaying the result of speech recognition of the audio signal including the wake word. program.

Images